EP1679690A1 - System und Methode zur Musik Generierung - Google Patents

System und Methode zur Musik Generierung Download PDF

Info

Publication number
EP1679690A1
EP1679690A1 EP05109316A EP05109316A EP1679690A1 EP 1679690 A1 EP1679690 A1 EP 1679690A1 EP 05109316 A EP05109316 A EP 05109316A EP 05109316 A EP05109316 A EP 05109316A EP 1679690 A1 EP1679690 A1 EP 1679690A1
Authority
EP
European Patent Office
Prior art keywords
computing device
mobile computing
song
master
playing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP05109316A
Other languages
English (en)
French (fr)
Inventor
Tilman Herberger
Titus Tost
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Magix AG
Original Assignee
Magix AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Magix AG filed Critical Magix AG
Publication of EP1679690A1 publication Critical patent/EP1679690A1/de
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/36Accompaniment arrangements
    • G10H1/361Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems
    • G10H1/365Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems the accompaniment information being stored on a host computer and transmitted to a reproducing terminal by means of a network, e.g. public telephone lines
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/36Accompaniment arrangements
    • G10H1/40Rhythm
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/375Tempo or beat alterations; Music timing control
    • G10H2210/381Manual tempo setting or adjustment
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2240/00Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
    • G10H2240/171Transmission of musical instrument data, control or status information; Transmission, remote access or control of music data for electrophonic musical instruments
    • G10H2240/175Transmission of musical instrument data, control or status information; Transmission, remote access or control of music data for electrophonic musical instruments for jam sessions or musical collaboration through a network, e.g. for composition, ensemble playing or repeating; Compensation of network or internet delays therefor
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2240/00Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
    • G10H2240/171Transmission of musical instrument data, control or status information; Transmission, remote access or control of music data for electrophonic musical instruments
    • G10H2240/201Physical layer or hardware aspects of transmission to or from an electrophonic musical instrument, e.g. voltage levels, bit streams, code words or symbols over a physical link connecting network nodes or instruments
    • G10H2240/241Telephone transmission, i.e. using twisted pair telephone lines or any type of telephone network
    • G10H2240/251Mobile telephone transmission, i.e. transmitting, accessing or controlling music data wirelessly via a wireless or mobile telephone receiver, analog or digital, e.g. DECT GSM, UMTS

Definitions

  • the present invention relates generally to the creation of music on cell phones or other portable electronic devices. More particularly, but not by way of limitation, the present invention relates to a synchronized music creation process wherein a multi-device, multi-user music creation process can be enabled.
  • Cell phones which initially were limited to performing the basic telephone and minimal task planning functions today have evolved into small portable computers which utilize their own internal microprocessor, memory, and display device to provide features such as internet connectivity, receipt of email, and calendar functionality, etc. Additionally, and of particular importance to the instant disclosure, many cell phone models also include multimedia capabilities. These capabilities might include digital photography, AM/FM radio reception, interactive games that are played on the cell phone's LCD screen, and possibly some ability to play digital audio files (e.g., mp3 files).
  • the increase in internal processing power has encouraged the development of open-architecture operating systems that allow for customisation or development of additional applications by third parties.
  • the multimedia capabilities of cell phones are typically limited to a "create the media - transfer the media" level of functionality.
  • the audio features in a cell phone typically include capabilities such as creating a ring tone, storing audio files, listening to audio files and recording audio data.
  • these features are designed to be experienced solely by the cell phone owner and feature only a very limited ability to work with the provided audio data.
  • the central purpose of a cell phone is interaction with another person, to date no known multimedia function permits one cell phone user to interact in a cooperative way with another while utilizing the multimedia capabilities of his or her phone.
  • a system and method for generating music on multiple cell phones or other mobile computing devices wherein two or more users (to include a user and a computer) acting together may create a joint musical work.
  • a method of music creation which utilizes a plurality of cellular phones to create a musical composition.
  • a cell phone will have been pre-loaded with specialized music creation software as is described more fully hereinafter.
  • an owner of such a cellular phone selects a song, or selects an option that allows him or her to create a song and sets a tempo.
  • the tempo is preferably set by tapping one of the cell phone keys.
  • the initiating user will then invite others who are in his vicinity to join in, the inviter's phone being referred to hereinafter as the "master" phone.
  • Any user who so desires may configure his or her own cell phone to play the same (or a complementary) musical work.
  • the inviter presses a button to initiate the playing of the selected song.
  • an audible series of tones e.g., "beeps”
  • This series of tones allows the participants to manually synchronize their phones (i.e., the "slave” phones) to the master, preferably by pressing a designed key in time to the tones.
  • the tempo of the chosen musical work is communicated to each accompanying / slave phone.
  • each user may synchronize his or her cell phone by "tapping in” after the master phone has already started playing a musical work, e.g., by pressing a cell phone button in time to the in-progress playing of the chosen musical work.
  • a mapping in after the master phone has already started playing a musical work, e.g., by pressing a cell phone button in time to the in-progress playing of the chosen musical work.
  • such may not result in cooperative works that are as euphonious as those where all of the cell phones start together.
  • each button press results in the playing of a sound of some sort through the cell phone speaker in conjunction with the playing of the selected musical work.
  • each sound is a simple beep such as is available by default in telephones (e.g., the standard DTMF phone tones) and/or others sorts of tones that are synthesized internally by the phone.
  • each button might be associated with a single digitally recorded sound (e.g., a horn playing a single note), a recorded musical phrase (e.g., one digitally sampled measure of a piano playing), or even more complex recorded sounds.
  • the participating parties would be able to not only accompany a playing song but they would also be able to create new musical arrangements out of the selected and played digitally recorded sounds and/or music sound loops.
  • the software within the cell phone will act to help the user select which specific sounds are played in response to a button press and the timing of those sounds.
  • the user's button press is only used to determine the relative timing of the note that is played, with the actual sound selection being made automatically so as to complement the musical work that is playing.
  • the user could repeatedly press the same key with a potentially different / complementary sound being played each time the key is pressed.
  • the user's button press will not be played immediately, but instead the sound that corresponds thereto will be played in exact tempo with the currently playing musical work. Obviously, such an arrangement would be a boon to the user who is rhythmically challenged.
  • a computer i.e., the "play along” mode, hereinafter.
  • the user would typically access the computer and select a musical work. Then, optionally and in one embodiment, the user would select that same musical work on his or her own cell phone and then accompany the computer while it plays.
  • the user in the "play along” mode the user preferably will not need to configure any specific settings on the "master” device. Additionally, there will preferably be no need to transmit lead-in tones that originate in the "master” device.
  • the user who wants to play along with such a device need not necessarily synchronize the accompaniment to the start of the song from the "master.” Instead, the user will preferably begin to "play along” at any time during playback.
  • One preferred method of implementing this feature is to have the user, upon hearing the song being played, tap along with it, such tapping providing the instant invention with an approximate measure of the song's tempo. This user will preferably be required to tap in concert with the playing song until the tempo determination has sufficient information to estimate the tempo of the song with some degree of accuracy.
  • each participating non-master cell phone will utilize software that functions as a recognition engine for purposes of automatically synchronizing one or more cell phones.
  • the master cell phone will signal to cell phones proximate thereto that a song is about to commence, preferably by sounding a series of tones through its speaker. This series of tones will preferably be sonically distinct so that the non-master phones will be able to distinguish them from background noise.
  • the recognition engine within each participating cell phone will hear the transmission, determine the tempo associated therewith, and begin to play its own copy of the chosen song at the appropriate moment, thereafter allowing the user to accompany the playing song according to the methods discussed previously.
  • Figure 1 depicts a preferred selection menu of the instant method while executing on a user's cell phone.
  • Figure 2 illustrates another preferred menu of options as displayed on a cell phone.
  • Figure 3 contains an illustration of a preferred master / slave cell phone arrangement suitable for use with the instant invention.
  • Figure 4 depicts illustrates a preferred general environment of the "play along" embodiment of the instant invention.
  • Figure 5 depicts an embodiment of a graphical user interface suitable for use with the instant invention.
  • Figure 6 contains a flowchart of basic variant of the "play with” mode.
  • Figure 7 contains an illustration of a preferred recognition engine logic.
  • Figure 8 illustrates a preferred program logic for use with the "play along" mode of the instant invention.
  • Figure 9 illustrates a preferred signalling mechanism for use in communicating a tempo from a master cell phone to a slave cell phone.
  • a preferred system and method for enabling a user to implement a synchronized music creation process which utilizes one or more cellular phones playing together in concert.
  • a system and method for generating synchronized music on multiple cell phones or other mobile computing devices wherein two or more users (to include a user and a computer) acting together may create a joint musical work.
  • the same musical work will be synchronously played through the speaker of each participating cell phone.
  • each cell phone will then press one or more buttons on the face of his or her phone in time with the playing of the musical work, each button press preferably generating a sound that is aesthetically consistent with the selected musical work, thereby creating a pleasing musical experience for the participants.
  • At least a portion of the instant invention will be implemented in the form of software running on a user's cell phone 100.
  • a cell phone will preferably have some amount of internal program memory and data storage (e.g., computer RAM) which is normally supplied with such units.
  • the instant invention will utilize the speaker 140 and microphone 130 of the cell phone 100 and/or a separate speaker / amplifier combination that is in electronic communication with the cell phone 100.
  • a cell phone might have more than one speaker. For example, it might have one that is used during phone calls and another that is used to signal an incoming call (i.e., play a ring tone) or that allows the phone to be used as a speakerphone.
  • the term “speaker” when used that term should be broadly construed to include any of the one or more speakers that might be utilized by a cell phone.
  • users often utilize a microphone-type audio input that is different from that provided within the body of the cell phone (e.g., many cell phones can be utilized with a separate wired or wireless headset that contains a microphone and speaker) and, as a consequence, when the term “microphone” is used herein that term should be understood to mean any sort of audio input device whether it is integral to the cell phone or not.
  • each user's cell phone 310 - 340 will preferably contain software resident therein that presents the user with menu choices 205 ( Figure 2) via the cell phone display 110.
  • the instant invention features two preferred modes of operation: a "play with” mode and "play along" mode.
  • the "play with” mode allows a user to create a musical composition in cooperation with one or more other users, wherein the other "users” might be human beings or a computer, whereas, the "play along” mode is typically utilized where an individual user wishes to create a musical composition by using the cell phone as a musical instrument to accompany another music source such as a computer that is playing a CD, an MP3 file, or other digital source.
  • the "play with” mode is directed more toward a multi-user arrangement (e.g., Figure 3), whereas the "play along” mode is directed more toward a situation where the user is playing along or in accompaniment to a musical source ( Figure 4).
  • a user will interact with the instant invention by way of the graphical display 110 of the cell phone 100 or other mobile computing device (e.g., a handheld computer / PDA, a combination cell phone PDA, etc.).
  • a screen layout similar to that which appears on the display 110 will be provided to the user to allow him or her to select between the two preferred operating modes.
  • the standard telephone keypad 120 can be used for the purpose of scrolling and/or selecting from among the menu items 105 or, alternatively, the various special function keys that are often provided with the cell phone 100 could also be used for this same purpose.
  • buttons are graphical representations of buttons that are drawn on the display device 110 and which could also be used to receive instructions from a user.
  • interaction with the user can also be carried by use of different methods and/or devices (to include the user of peripherals that have been attached to the cell phone) and are not limited to the use of the physical buttons that might be present on the face of the selected device.
  • FIG. 3 illustrates in a general way a preferred arrangement of the "play with” feature of the instant invention, wherein multiple cell phones 310-340 are utilized, thereby allowing all of the participating users to create a composite musical work.
  • a first user will initiate the jam session and, for purposes of clarity hereinafter, that user's phone will be designated as the master phone 310.
  • the master phone 310 As is also indicated in this figure, it is preferred that multiple other participants be brought together to create music, with the number of participant users not being limited to any specific number.
  • the mobile devices 320 to 340 of the other participants will be referred to hereinafter as "accompanying", “non-master” or “slave” units.
  • a cell phone 100 will have been pre-loaded with specialized music creation software that is designed to minimally perform the functions of Figure 6, which generally illustrates the "play with” aspect 600 of the instant invention.
  • an owner of such a cellular phone determines to create music and selects the software within the cell phone that makes this possible (step 605).
  • the software will include options to perform both the "play with” and “play along” embodiments and will present both options to the user via the cell phone display (e.g., using menu items 205).
  • step 610 the user will select between the options “playing with” or “playing along” (step 610). Assuming for purposes of discussion that the user has selected the "play with” mode (step 610), an inquiry will next be made to determine whether the user desires to initiate the performance (i.e., whether the user wishes his or her cell phone to act as the "master" phone) or whether he or she wants to accompany another's cell phone performance (steps 615 and 620). If the user desires to initiate the performance, a next preferred step would be to select a song and a part (step 623). That is, in the preferred arrangement the user will select a specific song from among a list of one or more such songs.
  • the user might automatically be assigned a song and that would be the case, for example, if the cell phone were supplied with a single song.
  • the term "song" should be interpreted in its broadest sense to include traditional songs as well as simple rhythm patterns (e.g., a looped drum track), random chord changes, or any other musical or rhythmic pattern that a user might wish to accompany.
  • the songs be stored within the local memory (e.g., computer RAM, ROM, flash RAM, etc.) of each cell phone either as digital music files (e.g., MP3, WAV, AIF, etc.) or as MIDI files.
  • digital music files e.g., MP3, WAV, AIF, etc.
  • MIDI files e.g., MIDI files
  • the instant invention will operate to allow a user to compose a new song by using the musical loops provided.
  • the "master" user would not select a specific song but would instead merely select a song style (e.g., Latin, swing, rock, blues, etc.).
  • the master user's cell phone will preferably begin to play general song patterns or riffs that are consistent with the selected style, during which time the user will be free to accompany the background music and create a unique composition.
  • the term “song” that term should be broadly construed to include conventional songs as well as song patterns or riffs in a particular style.
  • part is meant, for example, an instrument type (e.g., a piano sound, a guitar sound, a trumpet sound, an entire sampled orchestra, a synthesized sound, etc.). It could also mean the length or complexity of the sound that is produced by each button press (e.g., a single note of an instrument, an entire measure or musical phrase, etc.). In brief, when the user specifies which part he or she would like to play that step might include any choice that relates to the quality or quantity of sound produced by each button press during the performance.
  • the originating user will be given the option of setting the length of time (or the number of taps) that will be provided by the user in order to set the tempo of the selected song.
  • setting the tempo might be done in any number of ways, in the preferred embodiment the user will press a cell phone key repeatedly at the tempo that he or she wishes the selected song to be played, thereby communicating a preferred tempo to the software resident therein. Usually only a few taps (e.g., 5 to 10) will be necessary to establish the rhythm.
  • the user might set the tempo including, without limitation, specifying a numerical beats-per-minutes value, playing the selected song and allowing the user to speed it up or slow it down interactively, etc. That being said, the instant inventors find that the "tap-in" method is especially convenient and intuitive. If the user has elected to tap-in the tempo, the cell phone software will next preferably use that information to calculate the tempo according to methods well known to those of ordinary skill in the art (step 635). Note that in some cases, rather than specifying a tempo via steps 625 through 635, the user might instead accept the default tempo for the chosen musical work (i.e., the tempo selected by the individual who created the stored musical work).
  • the instant invention will continue by playing a predetermined number of tones through the cell phone speaker (step 640) at the tempo that was specified by the user.
  • This step has two main purposes. First, it acts as an introduction or lead-in for the owner of the master phone and will allow him or her to start playing an accompaniment at the same time that the musical selection starts. Additionally, and as is described in greater detail below, this provides a convenient way for other users who might be within hearing distance to join in at the same tempo. Also, and as is discussed in greater detail below, in some instances the transmitted taps will be used as a way of communicating with the slave cell phones via the recognition engine software resident therein.
  • the master cell phone will begin playing the selected musical work at the selected tempo (step 670). This will be the cue for the cell phone's owner to begin playing in concert by pressing various of the cell phone buttons. Each such button press will result in the playing of a sound of some sort through the cell phone speaker in conjunction with the playing of the selected musical work.
  • each sound that is generated will be a simple beep such as is typically available by default in cellular telephones (e.g., the standard DTMF phone tones) and/or others sorts of tones that are synthesized internally by the phone.
  • each button might be associated with a single digitally recorded or sampled sound (e.g., a digital sampling of horn playing a single note), a recorded musical phrase (e.g., one digitally sampled measure of a piano playing) or even more complex recorded sounds.
  • the CPU within the cell phone could create synthesized sounds (e.g., sounds that are synthesized according to a mathematical algorithm) according to methods well known to those of ordinary skill in the art.
  • the one or more buttons / keys that will be pressed to create the user-generated musical component will be referred to as the performance keys.
  • the cell phone store the actual button presses and their timing, together with some indication of the loop that is played in response thereto. This would allow the phone to function somewhat like a tape recorder (or sequencer) so that the user's musical composition could be stored and later replayed if it turned out to be especially pleasant.
  • the sounds that are played in response to performance key presses will have been pre-selected by the software designer and/or the user to complement the musical work that is currently playing.
  • the selected musical work is in the key of C and is written in 4/4 time
  • the samples which are selected by the button presses will preferably includes notes or musical phrases that are compatible with the key of C and will be similarly suitable for play in 4/4 time.
  • the underlying work is from the blues genre
  • the notes, musical scales, and musical phrases that are provided to the user will preferably also be from that same musical genre.
  • the software within the cell phone will act to help the user select which specific sounds are played in response to a button press and the timing of those sounds.
  • the user's button press will only be used to determine the relative timing of the note that is played, with the actual sound selection being made automatically so as to harmoniously accompany the musical work that is playing.
  • the user could repeatedly press the same key and have a potentially different /complementary sound played each time the key is pressed.
  • the user's pressing of the performance key or keys will not be played immediately, but instead the sound that corresponds thereto will be delayed until it can be played in tempo with the underlying musical work. Obviously, such an arrangement would be a boon to the user who is rhythmically challenged.
  • step 650 which describes the functioning of the slave cell phones
  • the user if the user has elected to participate in the music creation process as an accompanist (i.e., this is a "slave" phone), that user will preferably begin by selecting the same song as that which was specified by the master cell phone owner (step 650).
  • the same songs be selected by each accompanist, as there could certainly be circumstances where it would be desirable to choose a different or complementary song.
  • the accompanist will likely wish to select a part to play which, as has been described previously, complements the selected tune and/or the part selected by the master cell phone owner.
  • the accompanist wouldn't necessarily be required to select the same song as that which was specified by the master cell phone owner. In this event it would suffice to synchronize the slave device to the master device to start the music creation process.
  • the accompanist will typically wish to synchronize his or her cell phone's playing of the song with that of the master unit.
  • a first preferable way of implementing that synchronization is by having the accompanist tap the tempo of the master phone into the slave cell phone (step 655).
  • the master cell phone will preferably play a series of synchronizing tones (e.g., 5 to 10) through its speaker in advance of beginning to play the selected song (step 640).
  • the tempo of the accompanying phone will be set by the user by tapping one of its cell phone keys in time with the tones that are being broadcast from the master phone's speaker.
  • a second preferred method of determining the tempo of the master cell phone is by utilizing the recognition engine discussed below.
  • the key that is tapped to set the tempo will be known hereinafter as the sync key.
  • the sync key may serve multiple functions. ⁇ . This is just a reflection of the fact that a typical cell phone does not have many keys and, as such, some keys may have multiple functions associated therewith.
  • the inviter upon receipt of acknowledgement from the participating users that they are ready, the inviter presses a button to initiate the playing of the selected song or to initiate the music creation process.
  • an audible series of tones e.g., "beeps”
  • the participating users will then preferably "tap-in” using the designated sync key to synchronize their phones. By doing this, the owner of each accompanying phone will be able to at least approximately synchronize his or her phone with the master.
  • each user could synchronize his or her cell phone by tapping in after the master phone has already started playing a musical work.
  • the user will be provided with one or more buttons that will cause the resident software to jump to, say, the start of the song, the chorus, the bridge, etc., at the next measure, thereby allowing a late participant to catch up with a song that is currently in progress.
  • the underlying music is a repeating (e.g., looping) chord structure, users could readily join in each time the chord pattern begins to repeat.
  • the user will play a cell phone 410 in concert with a musical work that is being played by computer or any other device 420 through speakers 430.
  • the computer 420 will act similarly to the master cell phone discussed previously.
  • the microphone 440 provides the computer 420 with the capability of receiving audible instructions from the user or from the cell phone 410, which means that the computer could function in the role of a "slave” if so desired (e.g., if a user elected to "accompany” a song being played on the cell phone 410 by rhythmically pressing keys on the computer 420 in time therewith).
  • the source of the music that is played by the computer might be, for example, taken from a separate (or integrated) CD player, a DVD player, an MP3 (or other digital music) player, a record player, etc. Further, to the extent that the computer is functioning as passive music source, that function could be performed by a stereo system, boom box, etc.
  • the user will begin by selecting the music creation system within the cell phone (step 805) and then choose the "play along” option (step 810).
  • the user will also select a song and a part (step 815) on the cell phone as has been discussed previously.
  • the user will typically activate the music creation program that is resident on the computer (step 820).
  • the computer music creation program will function similarly to the program that resides on a master cell phone in that it will "lead” the performance. That is, the user will preferably instruct the computer software that a "play along" performance is desired (step 825) and then continue to select the performance tempo (step 835) preferably by tapping in the desired tempo on the keyboard or mouse and the song (step 830).
  • a part might be selected as well (step 830) if, for example, a second user wished to "play” the computer by pressing its keys in a fashion analogous to that described previously in connection with a cell phone performance.
  • the tempo could certainly be set directly by typing in a desired BPM (i.e., beats per minute) value or by some other means.
  • the user will not need to configure specific settings for the device that is to be accompanied.
  • the user will need only to establish a tempo, which will preferably be done by tapping in concert either with lead-in tones provided for that purpose or with the song that is currently playing.
  • the "play along” mode is not limited to use with a computer as the "master” or source device, but rather the "master” device could be any device that transmits music/sounds.
  • the user will preferably initiate the playing of the selected song at the desired tempo on the computer (step 840).
  • the performance will preferably provide for synchronization as has been discussed previously, e.g., by sounding a series of tones in advance of starting the playback of the song, thereby allowing the cell phone user to manually synchronize the phone with the computer (step 845). Note that the methods of automatic synchronization discussed below could also be used.
  • the user will now be able to accompany the playback of the selected music work by pressing the performance keys on the cell phone (step 850) as has been discussed previously. Rather than hearing the music from the "master" via the speaker of a cell phone, the user will instead hear the rich tones that can be produced by the large speakers 430 that are suitable for use with a personal computer.
  • Figure 5 illustrates a screen display of the general sort that would be appropriate for creating musical works on a computer that could thereafter be played according to the instant invention.
  • the screen representations of such tracks 510 are typically designed to let a user add, delete, and reposition graphical representations of music clips by manipulating the cursor 530 on the screen.
  • the multiple tracks are filled with music clips and then mixed down to two (i.e., stereo) tracks to prepare the work to be played on conventional stereo equipment.
  • Software of the sort represented by Figure 5 could be used to compose musical works that would be suitable for performance via the instant invention.
  • the screen display of Figure 5 illustrates the graphical user interface of one embodiment of the instant invention.
  • This embodiment is primarily directed to the music creation process, therefore the screen display corresponds to the graphical user interface on both the master and the slave devices participating in the play along as well as the play with mode, at least to the extent - that the dissimilarities in screen size make display of the same graphic user interface possible.
  • a method of creating music on a plurality of cellular telephones or on a cell phone and another computing device wherein the cell phones are automatically synchronized without the need for manual tapping.
  • a recognition engine will be used to automatically identify beats from the master cell phone and to set the tempo and starting time accordingly. That is, this embodiment automates steps 655 and 660 discussed previously.
  • each participating non-master cell phone will utilize a software recognition engine that automatically synchronizes it with the master cell phone.
  • the master cell phone will signal to cell phones proximate thereto that a song is about to commence, preferably by sounding a series of tones through its speaker. This series of tones will preferably be sonically distinct so that the non-master phones will be able to distinguish them from background noise.
  • the recognition engine within each participating cell phone will sense the transmission of synchronizing information, determine the tempo associated therewith, and begin to play its own copy of the chosen song at the appropriate moment, thereafter allowing the user to accompany the playing song according to the methods discussed previously.
  • the owner of a non-master cell phone after selection of the song and part, will preferably engage the recognition engine to cause his or her cell phone to be receptive to the receipt of signal tones (steps 700 and 705).
  • a loop is preferably entered that will read the audio input from the cell phone receiver (step 710) or other audio input source and convert it to digital form.
  • the incoming sound stream will then preferably be continuously analyzed to determine whether a signal tone is present (step 715). If not, a further check is preferably made to determine whether or not the user has cancelled his or her "listen” command or whether some predetermined period of time has elapsed and the phone should return to normal operations (i.e., the "time out” in step 720).
  • a next preferred step will be to determine whether it is the last tone of the series (step 730). If so, the user's cell phone will then begin to broadcast the selected song at the determined tempo / BPM (step 735).
  • the user's cell phone will then begin to broadcast the selected song at the determined tempo / BPM (step 735).
  • a "last" tone including, without limitation, varying its frequency content from the tones preceding it, changing its duration, playing a tone on the half-beat that immediately precedes the last tone, etc.
  • the total number of tones that are to be sounded will be known in advance (e.g., as might have been specified by the user).
  • the slave cell phone misses one or more of the synchronizing tones (e.g., due to the presence of intermittent noise) it may be necessary to provide the phone software additional information to make certain that it begins playing the selected tone at exactly the correct moment, hence, the preferred different "last" tone.
  • the instant method preferably continues by determining the tone count (step 740) and an estimate of the tempo (step 745), before returning to the top of the input loop (step 710).
  • the starting time of the tone series or, equivalently, at least one time separation between successive tones
  • an estimate of the BPM / tempo of the music may readily be determined according to methods well known to those of ordinary skill in the art. Further, in some cases it might be desirable to modify each tone to identify, for example, its location within the measure.
  • each pulse is proportional to the length of time that the corresponding tone would be played by the master phone. Note that, although this figure might suggest that each of the synchronizing tones would be played at the same amplitude, that is only a preferred embodiment and it is certainly possible that variations in amplitude could be used in communicating with the slave phones.
  • the determination of whether or not a synchronizing tone is currently being played by the master device might be accomplished in many different ways.
  • the sound that is read from the microphone 130 will be converted to a digital time series, after which standard signal processing techniques can be applied thereto. For example, by taking short-time (or longer) Fourier transforms of the incoming signal it will be possible to identify signals that are within predetermined frequency bands (e.g., within the 1 kHz to 2 kHz frequency range) or that have predetermined frequency characteristics (e.g., a frequency sweep, DTMF tone signals, etc.). Clearly, such an approach could be invaluable in the presence of noise.
  • the instant invention preferably works with cell phones, many other devices would also be suitable.
  • the instant invention requires a handheld device which includes a microprocessor or similar programmable device and which is capable of wireless or wired communications.
  • hand held computing devices such as those utilizing the Palm® and Windows CE® operating systems would certainly be suitable for use with the instant invention and it is contemplated that such devices could readily be intermixed (e.g., one or more cell phones and one or more PDAs) to create a joint musical work as has been described previously.
  • mobile computing device that term should be interpreted in its broadest sense to include any device that meets the minimal requirements set out above, whether or not that device is capable of voice communication.
  • the instant invention minimally requires that the microprocessor / CPU be an active device, i.e., one that is minimally programmable to achieve the functionality required (e.g., reading a song choice from the user, reading the user's input tempo, synchronization with other phones, etc.).
  • PLD programmable logic devices
  • gate arrays FPGA's (i.e., field programmable gate arrays), CPLD's (i.e., complex PLD's), EPLD's (i.e., erasable PLD's), SPLD's (i.e., simple PLD's), PAL's (programmable array logic), FPLA's (i.e., field programmable logic array), FPLS (i.e., fuse programmable logic sequencers), GAL (i.e., generic array logic), PLA (i.e., programmable logic array), FPAA (i.e., field programmable analog array), PsoC (i.e., programmable system-on-chip), SoC (i.e., system-on-chip), CsoC (i.e., configurable system-on-chip), ASIC (i.e., application specific integrated chip), etc
  • processors integral thereto.
  • CPU central processing unit
  • the user can choose to display the music lyrics so that the user can sing along in a karaoke-like fashion with the music that is broadcast during the "play with" embodiment. That is, in this embodiment the user sings along with - rather than accompanies - synchronized music that is playing on two or more mobile computing devices.
  • the performance step 670 in Figure 6 is (in part or in total) a vocal event, preferably with the cell phone / PDA displaying the song lyrics in tempo to the music as an aid to the user.
  • the cell phone will simply function in a stand-alone mode and play the selected song through a speaker at the selected tempo while simultaneously displaying the song lyrics on the cell phone display timed to match the playing of the song (e.g., scrolling the typically small cell phone display to reveal successive sections of the text), thereby allowing the user to readily sing in accompaniment thereto.
  • the users will not actually participate in any fashion (e.g., they will not sing or "play” along) with the currently selected and playing musical work but instead will simply listen to the synchronized music that originates from a plurality of mobile computing devices. In this case, the performance of step 670 would simply be the playing of a synchronized musical work from two or more mobile computing devices.
  • buttons 120 or a special purpose function button e.g., one of the keypad buttons 120 or a special purpose function button
  • a button that is a graphic representation that has been drawn on a touch screen.
  • the button that is used for synchronization could also be reused subsequently during a performance, i.e., each button could serve multiple roles / functions depending on the state of the software at the time the button is pressed.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Electrophonic Musical Instruments (AREA)
EP05109316A 2004-10-08 2005-10-07 System und Methode zur Musik Generierung Withdrawn EP1679690A1 (de)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US96128204P 2004-10-08 2004-10-08

Publications (1)

Publication Number Publication Date
EP1679690A1 true EP1679690A1 (de) 2006-07-12

Family

ID=36283014

Family Applications (1)

Application Number Title Priority Date Filing Date
EP05109316A Withdrawn EP1679690A1 (de) 2004-10-08 2005-10-07 System und Methode zur Musik Generierung

Country Status (1)

Country Link
EP (1) EP1679690A1 (de)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GR20080100499A (el) * 2008-07-25 2010-02-24 Γεωργιος Σιωρος Μεθοδος και μηχανισμος για την αλληλεπιδραση, σε πραγματικο χρονο, μεσω υπολογιστικου δικτυου, οργανων ή συσκευων παραγωγης ηχου, εικονας ή αποτελεσματος που συνδυαζει ηχο και εικονα
EP2337018A1 (de) * 2009-11-24 2011-06-22 TuneWiki Limited Verfahren und System für eine Karaoke-Kollage

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1073034A2 (de) * 1999-07-28 2001-01-31 Yamaha Corporation Tragbare Telefonvorrichtung mit Musikerzeugung
US20040173083A1 (en) * 2003-01-22 2004-09-09 Hidefumi Konishi Music data producing system, server apparatus and music data producing method
US20040176025A1 (en) * 2003-02-07 2004-09-09 Nokia Corporation Playing music with mobile phones

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1073034A2 (de) * 1999-07-28 2001-01-31 Yamaha Corporation Tragbare Telefonvorrichtung mit Musikerzeugung
US20040173083A1 (en) * 2003-01-22 2004-09-09 Hidefumi Konishi Music data producing system, server apparatus and music data producing method
US20040176025A1 (en) * 2003-02-07 2004-09-09 Nokia Corporation Playing music with mobile phones

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GR20080100499A (el) * 2008-07-25 2010-02-24 Γεωργιος Σιωρος Μεθοδος και μηχανισμος για την αλληλεπιδραση, σε πραγματικο χρονο, μεσω υπολογιστικου δικτυου, οργανων ή συσκευων παραγωγης ηχου, εικονας ή αποτελεσματος που συνδυαζει ηχο και εικονα
EP2337018A1 (de) * 2009-11-24 2011-06-22 TuneWiki Limited Verfahren und System für eine Karaoke-Kollage

Similar Documents

Publication Publication Date Title
US7164906B2 (en) System and method of music generation
JP6122404B2 (ja) 携帯用音声合成のためのシステム及び方法
EP1736961B1 (de) System und Methode zur automatischen Erstellung von digital verbesserten Klingeltönen für Mobiltelefone
US7022906B2 (en) Systems and methods for creating, modifying, interacting with and playing musical compositions
US7525037B2 (en) System and method for automatically beat mixing a plurality of songs using an electronic equipment
US8452432B2 (en) Realtime editing and performance of digital audio tracks
US20070051229A1 (en) Systems and methods for creating, modifying, interacting with and playing musical compositions
US20120024131A1 (en) Systems and methods for portable audio synthesis
US20140000440A1 (en) Systems and methods for creating, modifying, interacting with and playing musical compositions
EP2135237A1 (de) Dateierzeugungsprozess, dateiformat und dateiwiedergabevorrichtung zur ermöglichung von erweiterten audiointeraktions- und kollaborationsfähigkeiten
MX2011012749A (es) Sistema y metodo para recibir, analizar y editar audio para crear composiciones musicales.
CN105637579B (zh) 通过在多组波形数据之间切换来再现波形的技术
EP1679690A1 (de) System und Methode zur Musik Generierung
KR20030029503A (ko) 사운드 믹서를 구비한 무선 이동 통신 핸드세트와 방법
JP2003015672A (ja) 声域告知機能付きカラオケ装置
EP1436802B1 (de) Midi-komponiervorrichtung
KR100841047B1 (ko) 곡 데이터 편집 기능 및 mp3기능이 내장된 휴대용 플레이어
JP3974069B2 (ja) 合唱曲や重唱曲を処理するカラオケ演奏方法およびカラオケシステム
Arrasvuori et al. Designing interactive music mixing applications for mobile devices
EP1735848A2 (de) Systeme und verfahren zur ortsveränderlichen audiosynthese
Howard From Ghetto Laboratory to the Technosphere: The influence of Jamaican studio techniques on popular music
Augspurger Transience: An Album-Length Recording for Solo Percussion and Electronics
Martin Mobile computer music for percussionists
KR100620973B1 (ko) 음원데이타 출력시스템
KR20050111110A (ko) 웹상에서의 음악편집장치와 방법

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK YU

AKX Designation fees paid
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20070113

REG Reference to a national code

Ref country code: DE

Ref legal event code: 8566