CN106023969A

CN106023969A - System and method for producing a more harmonious musical accompaniment and for applying a chain of effects to a musical composition

Info

Publication number: CN106023969A
Application number: CN201610208527.2A
Authority: CN
Inventors: M.塞尔勒蒂克; P.伍德沃德; F.卡波迪奇; R.拉苏尔
Original assignee: Music planning Co
Current assignee: Music planning Co; Music Mastermind Inc
Priority date: 2011-07-29
Filing date: 2012-07-30
Publication date: 2016-10-12
Anticipated expiration: 2032-07-30
Also published as: CN106023969B; EP2737475A1; EP2737475B1; WO2013028315A1; EP2737475A4; CA2843437A1; HK1201975A1; CN104040618A; EP3059886B1; MX345589B; IN2014CN00741A; BR112014002269A2; CN104040618B; MX2014001192A; EP3059886A1

Abstract

A system and a process for producing a more harmonious musical accompaniment for a musical compilation, the process comprising determining a plurality of probable key signatures for the musical compilation, creating an interval profiling matrix for each of the probable key signatures, finding products of a major key interval profile matrix with each of the interval profiling matrices, summing each of the major key interval products into a running major key sum, finding a product of a minor key interval profile with each of the interval profiling matrices, summing each of the minor key interval products into a running minor key sum, and selecting the most probable key signature from the plurality of probable key signatures by comparing the minor key sum and the major key sum.

Description

For making more harmonious musical background and for by what effect chain was applied to melody being System and method

The application is divisional application, its female case invention entitled " for making more harmonious musical background and for will Effect chain is applied to the system and method for melody ", filing date on July 30th, 2012, Application No. 201280048059.7.

This application claims the priority from following application: in the U.S. Provisional Patent Application that on June 1st, 2009 submits to No. 61/182,982；In U.S. Provisional Patent Application No. 61/248,238 that on October 2nd, 2009 submits to；In 2009 12 U.S. Provisional Patent Application No. 12/791,792 that the moon 3 was submitted to；The U.S. Patent application all submitted on June 1st, 2010 No. 12/791,792,12/791,798,12/791,803 and 12/791,807.

Technical field

This patent disclosure relates generally to the creation of music, and more specifically it relates to for make more harmonious musical background be System and method.

Background technology

Music be mankind self-expression with the well-known form of good reputation.However, it is possible to obtain by different way The people's personal appreciation to this artistic endeavors.Generally, this people can be by listening to other people creation rather than by himself Or herself generates music, more easily enjoy music.For many people, listen to and recognize the energy of attractive melody Power is born, and the ability manually creating the suitable acquisition of note is the most out of reach.The ability creating new music of people May be good enough to the most arbitrarily reproduce necessary to tune time, money and/or technical ability by learning instrument retrain.To great majority For people, themselves imaginative power can be the source of new music, but they hum or chant the ability limit of this identical tune The tune having made them can be retained by formal and create the degree enjoyed for other people again.

The performance of record accompanying music person is also likely to be laborious process.Multiple tunes (take) of identical material are remembered Record and it painstakingly is gone through, until single tune can be assembled in the case of eliminating all flaws being Only.Good tune typically requires gifted artist and correspondingly adjusts his or her drilling under the artistical guidance of another one Play.In the case of the sparetime records, best tune is the result of accident and therefore can not be repeated.Often, the sparetime drills The person of playing makes the tune that part has with difference part both of which.If each of each tune can be analyzed the most meticulously Construct song in the case of part, then recording process is by simply too much and have more enjoyment.Therefore, just about these and its He considers, has made the present invention.

Additionally, the music of the desired creation of people is probably complexity.Such as, the tune being envisioned as is likely to be of more than one Musical instrument, this more than one musical instrument can be played with other musical instruments by possible layout simultaneously.This complexity increases further Single people generates the time needed for desired voice combination, technical ability and/or money.The physical configuration of most of musical instruments also needs to The complete physics attention of people manually generates note, thus needs further exist for additional personnel and play the appendix of expectation tune Point.Additionally, then, extra examination & verification and management are probably the suitable of the various involved musical instruments guaranteeing to expect tune and element Mutual necessary.

Even for having enjoyed the people of music of creation their own, those listeners may lack the suitable composition of realization Expertise with the type of musical composition.Thus, the music created may comprise and is not in same music tone or string Note.In most of music styles, getting out of tune or taking off the existence of string note (being often referred to as " being discord " note) makes music not Melodious and ear-piercing.Lacking experience accordingly, due to them and train, the music that music listener generally creates sounds and not conforming to Anticipate and the most professional.

For some people, artistic inspiration not by identical time of being typically associated with the generation of new music and record and Position limitation is retrained.Such as, when the idea of new tune shapes suddenly, people may be not at playable musical instrument at hands In production studio.After the moment of inspiration disappears, this people may not regain the integrated degree of original tune, thus Cause the loss of artistic endeavors.Additionally, this people is such as being only capable of creating the inferior of his or her initial music enlightenment again With during imperfect version application time and effort and become dejected.

Music composition and the software for editing instrument of specialty are currently generally available.But, these instruments show abecedarian The entry threshold hung back for user.This complex user interface may quickly weaken dare to be at the road of its art illusion The enthusiasm of any new hand of upper risk.It is limited to Specialty Hi-Fi server external member also fettered and want in movement refined tune The style of mobile creator.

What is desired is that a kind of music composition system and method, its can easily with most of primary ability phases of user Interaction, musical composition complicated as being but capable of the imaginative power with user and expectation.Promotion is the most associatedly needed not have The musical composition of discordant note.Additionally, be required in the art by multiple based on automatization's selection criterion polymerization The part of tune generates music works (authoring) system of music album track.It is also contemplated that, when inspiration occurs Time, in the way of not by the position limitation of user, realize this system, thus realize the capture expressed first to new melody.

The most associatedly needing a kind of system and method, it can be by automatically assessing the track of precedence record Quality and optimal track in selecting the track of the precedence record recorded via e text system create from multiple tunes Make album track.

It is also expected to realize a kind of system and method for musical composition based on cloud, thus, process intensive function by Server away from client device realizes.But, owing to digital music creation depends on the data of enormous amount, the most this join Put and typically limited by some questions.For supplier, processing, store and serve this large amount of data may enormous amount , unless central processing unit is the most powerful and therefore from cost and from the viewpoint of the waiting time costly.Given being used for In the case of the most current cost of storage and transmission data, data transmission from presence server to client may become into rapidly This is too high and is also possible to increase the less desirable waiting time.From the perspective of client, bandwidth limits and also can result in significantly Waiting time problem, this detracts Consumer's Experience.Therefore, there is a need for being able in the art solve and overcome these defects System.

Accompanying drawing explanation

With reference to figure below, the non-limiting and embodiment of nonexhaustive is described.In the accompanying drawings, all each width are run through Figure, similar reference refers to similar part, unless otherwise specified.

In order to be more fully understood that the disclosure, the detailed description below will read explicitly with accompanying drawing will be carried out Reference, in the accompanying drawings:

Figure 1A, 1B and 1C illustrate some embodiments of the system of the aspect that can implement the present invention；

Fig. 2 is the block diagram of an embodiment of the possible parts of the audio converter 140 of the system of Fig. 1；

Fig. 3 illustrates an exemplary embodiment of the progress of music album；

Fig. 4 is the block diagram of an embodiment of the possible parts of the track zonal device 204 of the system of Fig. 2；

Fig. 5 be a diagram that the exemplary frequency spectrum figure of the frequency distribution of the audio frequency input with fundamental frequency and multiple harmonic wave；

Fig. 6 is the exemplary pitch curve chart relative to the time, which illustrates between the first and second pitches change and with After the pitch of voice that disposes around the second pitch；

Fig. 7 is the exemplary embodiment of the form drawn relative to the time as pitch event, each pitch event have from Dissipate the persistent period；

Fig. 8 be a diagram that the block diagram of the content of the data file in one embodiment of the present of invention；

Fig. 9 be a diagram that the flow process of an embodiment of the method for generating music track in the record accompaniment of circulation continuously Figure；

Figure 10,10A are formed together with 10B may user for one of generation music track in the record accompaniment of circulation continuously The diagram at interface；

Figure 11 is the diagram of a possible user interface for calibration record accompaniment；

Figure 12 A, 12B and 12C together illustrate and music in the record accompaniment being in circulation continuously three time periods separated The second possible user interface that the generation of track is associated；

Figure 13 A, 13B and 13C together illustrate the music track input in system of the user interface modifications for using Figure 12 One of user interface may use；

Figure 14 A, 14B and 14C together illustrate a possible use for creating rhythm audio track at three time periods separated Interface, family；

Figure 15 is the block diagram of an embodiment of the possible parts of the MTAC module 144 of the system of Fig. 1；

Figure 16 be a diagram that of the music tone for determining the one or more notes reflection inputted by audio frequency may mistake The flow chart of journey；

Figure 16 A illustrates the interval distribution matrix that may be used for preferably determining key signature；

Figure 16 B and 16C respectively illustrates be used in association with providing preferred key signature to determine with interval distribution matrix little Mediation ditty interval distribution matrix；

Figure 17,17A formed together with 17B illustrate for based on string sequence constraints, the part of music track is given a mark one The flow chart of individual possible process；

Figure 18 illustrates an embodiment of the process of the barycenter for determining form；

Figure 19 illustrates harmonic oscillator step response in time, has damping response, overdamped response and underdamped response；

Figure 20 illustrates the logical flow chart illustrating the embodiment given a mark for the part inputting music；

Figure 21 illustrates the logical flow chart of an embodiment for the process from multiple record tracks composition " most preferably " track；

Figure 22 illustrates the exemplary audio waveform of score and a figured embodiment, it illustrates actual pitch and reason Think the difference of pitch；

Figure 23 illustrates an embodiment of the new track being made up of the subregion of the track of precedence record；

Figure 24 illustrates and illustrates for accompaniment music input is played the embodiment that music input carries out the process of harmony with main Data flowchart；

Figure 25 illustrates the data flowchart of the process played by the conversion note module of Figure 24；

Figure 26 illustrates an exemplary embodiment of super keyboard；

Figure 27 A-B illustrates two exemplary embodiments of string wheel；

Figure 28 illustrates an exemplary embodiment of the network configuration that can implement the present invention；

Figure 29 illustrates the block diagram of the equipment supporting process discussed herein；

Figure 30 illustrates an embodiment of music network equipment；

Figure 31 illustrates a possible embodiment at the first interface in game environment；

Figure 32 illustrates the interface playing voice or musical instrument track for creating one or more master in the game environment of Figure 31 One may embodiment；

Figure 33 illustrates of the interface for creating one or more percussion instrument track in the game environment of Figure 31 can Can embodiment；

Figure 34 A-C illustrates may implementing of the interface for creating one or more accompaniment track in the game environment of Figure 31 Example；

Figure 35 illustrates a possible enforcement of the graphical interfaces that the chord describing to play as the main accompaniment playing music is carried out Example；

Figure 36 illustrates for carrying out the possibility selected in the game environment of Figure 31 in the middle of the different sections of music album Embodiment；

Figure 37 A and 37B illustrates and the file structure can being associated with the music assets that the game environment of Figure 31-36 is combined with Possible embodiment；

Figure 38 illustrates the embodiment presenting cache according to the present invention；

Figure 39 illustrates the logic illustrating the embodiment for obtaining audio frequency for the note asked according to the present invention One embodiment of flow chart；

Figure 40 illustrates an embodiment of the flow chart of the cache control process for realizing Figure 39 according to the present invention；

Figure 41 illustrates the embodiment for realizing presenting the framework of cache according to the present invention；

Figure 42 illustrates the second embodiment for realizing presenting the framework of cache according to the present invention；

Figure 43 illustrates and illustrates the signal graph according to the communication between client, server and the edge cache of the present invention One embodiment；

Figure 44 illustrates and illustrates communication between client, server and edge cache according to an embodiment of the invention Second embodiment of signal graph；

Figure 45 illustrates the embodiment of the first process for optimizing audio request process queue according to the present invention；

Figure 46 illustrates the embodiment of the second process for optimizing audio request process queue according to the present invention；

Figure 47 illustrates the embodiment of the 3rd process for optimizing audio request process queue according to the present invention；

Figure 48 illustrates an exemplary embodiment of live play according to an embodiment of the invention circulation；

Figure 49 illustrates an embodiment of a series of effects of the be applied to music album according to the present invention；

Figure 50 illustrates an embodiment of a series of happy person role's effect of the be applied to musical instrument track according to the present invention；

Figure 51 illustrates an enforcement of a series of producer role's effects of the be applied to musical instrument track according to the present invention Example；

Figure 52 illustrates an enforcement of a series of producer role's effects of the be applied to album track according to the present invention Example.

Detailed description of the invention

Now, being described more fully with the present invention hereinafter with reference to accompanying drawing, accompanying drawing forms the part of the present invention, and The specific illustrative embodiment that can implement the present invention is shown by the way of diagram.But, the present invention can be with many different Form embodies and should not be construed as limited to embodiment set forth herein；On the contrary, these embodiments are provided so that these public affairs Opening will be thorough and comprehensive, and can will fully convey the scope of the invention to those skilled in the art.In addition to other things, this Bright can be embodied as method or equipment.Correspondingly, the present invention can use the embodiment of complete hardware, the enforcement of complete software Example or the form of embodiment that software and hardware aspect is combined.Therefore, detailed description below should not limit Use in meaning.

Definition.

Running through specification and claims, terms below uses the implication of explicit associations herein, unless context Otherwise clearly indicate.Phrase " in one embodiment " is not necessarily referring to for identical embodiment as used herein, most Manage it and may refer to identical embodiment.Additionally, phrase " in another embodiment " is different not necessarily referring to generation as used herein Embodiment, although it may refer to different embodiments.Therefore, as described below, without departing from the scope of the present invention or spirit In the case of, can easily combine each embodiment of the present invention.

Additionally, as used herein, term "or" is the "or" operator of inclusive, and is equivalent to term "and/or", unless Context otherwise clearly indicates.Term "based" not exclusively, and allows, based on the additive factors not described, to remove Non-context otherwise clearly indicates.Additionally, run through description, the implication of " ", " " and " being somebody's turn to do " includes that plural number draws With." ... in " implication include " ... in " and include plural reference." ... in " implication include " ... In " and " ... on ".

As used herein, term " music input " refers to comprise by including but not limited to that air, mike, circuit enter The music of the medium transmission of mechanism etc. and/or any signal input of the information of control.Music input is not limited to may be by people The signal incoming frequency that ear is heard, it is possible to outside including the frequency can heard by human ear or have and be not easy to be heard by human ear Other frequencies of form.Additionally, the use of term " music " is not intended to pass on the internal need to beat, rhythm etc..Therefore, Such as, music input can include various input, such as rap (including singly striking), tap, the mankind input (such as voice is (such as Do, re, mi), hit input (such as, ka, cha, da-da) etc.) and generated by musical instrument or other amplitudes and/or frequency The indirect input that mechanism is carried out via transmission, includes but not limited to that mike input, circuit enter input, MIDI input, having can For passing on the file of signal message that music inputs or enabling transmitted signal to be converted into other inputs of music.

As used herein, term " music tone " is one group of harmonious musical tones.Tone is typically big and adjusts or ditty. It is C big " tune " that happy person speaks of melody continually, and such as, this implies that one section of music is harmoniously centered by note C and utilize first Note or keynote are the major scale of C.Major scale is by complete and big semitone (such as, C D E F G A B or do re mi Fa so la ti) constitute octave symbol advanced.About piano, such as, central authorities C(is sometimes referred to as " C4 ") there is frequency 261.626 Hz, and D4 is 293.665 Hz；E4 is 329.628 Hz；F4 is 349.228 Hz；G4 is 391.995 Hz；A4 is 440.000 Hz；And B4 is 493.883 Hz.Although the identical note on other musical instruments will be played at same frequency, but also should manage Solving, some musical instruments are played in a tone or another tone.

As used herein, term " be discord note " is the note being not in correct music tone or string, wherein, just Really music tone and correct string are the current music tone played by another happy person or music source or string.

As used herein, term " blue note " is to be not in correct music tone or string but is allowed to do not converting In the case of play note.

As used herein, the term note of input " accompaniment music " be played by accompanying music person play rotation with corresponding master The note that the note played in rule is associated.

The overall description of the present invention.

Each embodiment is briefly described below, with provide the present invention some in terms of basic comprehension.This brief description is not It is intended to as comprehensively general introduction.It is not intended to identify crucial or decisive element or delimitation or the scope that otherwise narrows. Its purpose is only that and proposes some designs in a simplified manner, as the preamble in greater detail being set forth below.

In short, the collection that each embodiment relates to the audio tracks by circulation through precedence record merges reception for often The audible input of the audio tracks of individual interpolation generates multitone rail record.In one embodiment, can always self terminal user The input of audible sounding generate each audio tracks in many tracks record.Can provide every after repeating playback current record Individual new audible input, or circulate each new audible input one or many.By not receiving the input of new track during it This records series that the circulation period separates can allow user thoroughly, continuously and in the additional input not being immediately required to Time correlation pressure in the case of listen to current record.Unrelated with the circulation that the most additional track is transfused to, returning of circulation Put and can also allow for performing other actions, such as amendment previous audio track or the parameter of change record system.

Additionally, at least one in audio tracks in many tracks record can include based on providing in audible input One or more musical instrument sounds that one or more alternative sounds generate.The audible input received can be performed various forms Process to create audio tracks, this process include the alignment of the timing of audible input and adjustment, frequency identification and adjustment, can Listen tone color that input is converted to be associated with musical instrument, add known acoustic cue of being associated with musical instrument etc..Furthermore, it is possible to it is real Each during these of Shi Zhihang, thus allow the most instantaneous playback of generated audio tracks, and make it possible to stand I.e. with another audible input of receipt of subsequent for processing and covering in many tracks record or many as audio tracks On the track of individual precedence record.

In one embodiment, circulation or the repeating part of many tracks record can include wall scroll music.This length Can be determined by the bat being associated with track and time signature (time signature).In another embodiment, bar number or The circulation point of the playback of person's many tracks record can be dynamic.That is, the repetition of the first audio tracks in many tracks record can To occur at the time different from the time of the second audio tracks in many tracks record.The adjustment of this dynamic circulation point is such as Can the length of audible input based on follow-up track and automatically determine.

Each embodiment further relates to automatically make single " most preferably " tune being derived from a series of tune.An embodiment In, during one or more accompaniments, the multiple tunes played be recorded on many tracks recorder.Each tune is divided automatically District is segmentation.Based on selectable criterion, the quality of each subregion of each in multiple tunes is given a mark, and Automatically track is constructed by the best in quality segmentation of each tune.In one embodiment, optimal segmentation is by having from multiple points The segmentation definition of the top score in Duan get Fen.

Each embodiment is further directed to protect happy person to avoid performance to be discord note.In one embodiment, accompaniment The note of musical instrument is received, and device of independently playing music.Then, self-adjoint is revised based on main tone, string and/or the timing played Play music the note of device.In one embodiment, it is provided that virtual musical instrument, wherein, the input tone of musical instrument is dynamically mapped to On safe note.Therefore, if melody is accompanied by the player of virtual musical instrument, then virtual musical instrument can identify safe sound Symbol, safe note include the note of the current string of the melody for being accompanied or be in the music tone of melody in note.

Equipment framework.

Fig. 1 shows an embodiment of the system 100 can disposed in plurality of devices 50, for diagrammatic purposes, equipment 50 can be any multi-application computer (Figure 1A), handheld computing device (Figure 1B) and/or special games system (Fig. 1 C).System 100 can be deployed as the application installed on the device.Alternatively, it is possible to operate this in http browser environment it is System, this http browser environment can insert technology optionally with web and extend the function of browser to realize and system 100 The function being associated.Equipment 50 can include the parts many or fewer than the parts shown in Figure 29.But, those skilled in the art Should be appreciated that particular elements is not to carry out system 100 necessary to operation, and such as processor, mike, video display units It is important with the miscellaneous part of audio tweeter etc, if not necessary to the aspect of the enforcement present invention.

As shown in Figure 29, equipment 50 includes that processor 2902, processor 2902 can be via bus 2906 and great Rong The CPU of amount memorizer 2904 communication.As those skilled in the art will when it has this specification, drawings and claims in front As understanding, processor 2902 can also include individually or one or more general processors of combination with one another, digital signal Processor, other application specific processors and/or ASIC.Equipment 50 also includes power supply 2908, one or more network interface 2910, sound Frequently interface 2912, display driver 2914, user's input processing program 2916, illumination apparatus 2918, input/output interface 2920, Optional haptic interface 2922 and optional global positioning system (GPS) receiver 2924.Equipment 50 can also include that video camera (does not shows Go out), it enables video to be acquired and/or is associated with specific many tracks record.From video camera or other sources video also Online social networks and/or Online Music community can be further provided to.Equipment 50 can also (not show with base station alternatively Go out) communicate or direct and another computing device communication.Other calculate equipment (such as base station) can include that supplemental audio is correlated with Parts, such as professional audio processor, maker, amplifier, speaker, XLR adapter and/or power supply.

Continuing Figure 29, power supply 2908 can include rechargeable or non-rechargeable battery, or can be by external power source (such as, battery also can carry out AC adapter or the power supply docking support supplementing and/or recharging) provides.Network interface 2910 Including the circuit for equipment 50 being coupled to one or more network, and it is configured to and one or more communication protocol and skill Art is used together, and this communication protocol and technology include but not limited to: global system for mobile communications (GSM), CDMA (CDMA), Time division multiple acess (TDMA), UDP (UDP), transmission control protocol/Internet protocol (TCP/IP), SMS, general point Group wireless radio service (GPRS), WAP, ultra broadband (UWB), IEEE 802.16 World Interoperability for Microwave Access, WiMax (WiMax), Any one in SIP/RTP or other wireless communication protocols multiple.Correspondingly, network interface 2910 can include as receipts Send out transceiver or the NIC (NIC) of device.

Audio interface 2912(Figure 29) it is arranged to produce and receive audio signal, the sound of such as human speech.Such as, As be clearly shown that the most to the full extent, audio interface 2912 be coupled to speaker 51 and/or Mike 52 is to realize the music output in system 100 and input.Display driver 2914(Figure 29) it is arranged to generation and regards Frequently signal is to drive various types of display.Such as, display driver 2914 can drive the video monitor shown in Figure 1A Display 75, video surveillance 75 can be based on liquid crystal, gaseous plasma or the display of light emitting diode (LED) Or the display of any other type can being used together with calculating equipment.As shown in fig. 1b, display driver 2914 can Alternatively to drive hand-held touch sensitive screen 80, hand-held touch sensitive screen 80 also will be arranged to via user input Reason program 2916 receives the input of the object from such as stylus etc or from the numeral (see Figure 31) of staff.Keypad 55 is permissible Including be arranged to receive from user input any input equipment (such as, keyboard, game console, trace ball and/or Mouse).Such as, keypad 55 can include one or more button, digital dial and/or key.Keypad 55 can also include with Select and send the order button that image is associated.

Equipment 50 also includes for logical with external equipment (such as earphone, speaker 51 or other input or outut device) The input/output interface 2920 of letter.Input/output interface 2920 can utilize one or more communication technologys, such as USB, red Outward, bluetooth (Bluetooth) etc..Optional haptic interface 2922 is arranged to be supplied to sense of touch feedback the user of equipment 50. Such as, it is mobile or in the embodiment (such as, the embodiment shown in Figure 1B) of handheld device at equipment 50, optional haptic interface 2922 may be adapted so that in a specific way (the most such as, when another user of the equipment of calculating calls) vibratory equipment.

Optional GPS transceiver 2924 may determine that the physical coordinates that equipment 100 is gone up at the earth's surface, and this typically exports work For dimension and the position of longitude.GPS transceiver 2924 can also use other geo-positioning mechanisms (to include but not limited to triangle Measurement, assistant GPS (AGPS), E-OTD, CI, SAI, ETA, BSS etc.) to further determine that what equipment 50 was gone up at the earth's surface Physical location.But, in one embodiment, mobile device can be provided by miscellaneous part and may be utilized to determine equipment Other information of physical location, including such as MAC Address, IP address etc..

As shown in Figure 29, mass storage 2904 includes RAM 2924, ROM 2926 and other storage devices.Great Rong Amount memorizer 2904 illustrates for storing such as computer-readable instruction, data structure, program module or other data etc The example of computer-readable recording medium of information.Mass storage 2904 stores the low level behaviour for controlling equipment 50 The basic input/output (" BIOS ") 2928 made.Mass storage also stores the behaviour of the operation for controlling equipment 50 Make system 2930.It will be appreciated that these parts can include the general-purpose operating system (such as MAC OS, WINDOWS, UNIX, LINUX Version) or special purpose operating system (the most such as Xbox 360 systems soft ware, Wii IOS, Windows MobileTM, iOS, Android, webOS, QNX or Symbian operating system).Operating system can include making it possible to via Java application journey Sequence controls hardware component and/or the Java Virtual Machine module of operating system operation or docks with this Java Virtual Machine module.Operation System can also include the secure virtual container making it possible to perform application (such as, Flash and Unity) safely, the most also It is referred to as " sandbox ".

One or more data memory modules 132 can be stored in the memorizer 2904 of equipment 50.Such as this area skill When art personnel have this specification, drawings and claims in face of it it will be appreciated that as, data memory module 132 stores The part of information be also stored on the disk drive that is associated with equipment 50 or other storage mediums.These data are deposited Storage module 132 can store many tracks record, MIDI file, wav file, audio data sample and have discussed above Other data multiple of any one form and/or data form or input melody data.Data memory module 132 can also store The information of the various abilities of descriptive system 100, when request or in response to particular event etc., this information can be such as logical The part of header during letter and be sent to other equipment.Additionally, data memory module 132 can also be used with storage Social network information including address book, list of friends, another name, subscriber profile information etc..

Equipment 50 can store and optionally perform multiple different application, including the application used according to system 100.Example As, the application used according to system 100 can include audio converter module 140, record accompaniment fact circulation (RSLL) module 142, many tunes automated synthesizer (MTAC) module 144, harmony device module 146, track shared device module 148, sound searcher Module 150, type matching device module 152 and string adapter module 154.It is described in more detail below the function of these application.

Application on equipment 50 can also include message device 134 and browser 136.Message device 132 can be configured to make Initiating by any one in multiple messaging communication and manage messaging sessions, this messaging communication includes but does not limits In Email, Short Message Service (SMS), instant message (IM), multimedia information service (MMS), Internet relay chat (IRC), mIRC, RSS feed etc..Such as, in one embodiment, message device 243 can be configured to IM information receiving and transmitting should With, such as AOL instant messenger, Yahoo!Message device .NET messenger server, ICQ etc..In another embodiment, message Device 132 can be configured as client application that is comprehensive and that use multiple messaging protocol.In one embodiment, message Device 132 can interact to manage message with browser 134.Browser 134 can include being configured to using substantially any Language based on web receives and the substantially any application of realistic graphic, text, multimedia etc..In one embodiment, make to browse Device application can use handheld device markup language (HDML), wireless markup language (wml), WMLScript, JavaScript, Standard generalized markup language (SMGL), HTML(Hypertext Markup Language), extensible markup language (XML) etc. are with display and send Message.However, it is possible to use any one in other language based on web multiple, including Python, Java and third party web Insert.

Equipment 50 can also include other application 138, and such as computer executable instructions, it is by client device 100 During execution launch, receive and/or otherwise process message (such as, SMS, MMS, IM, Email and/or other disappear Breath), audio frequency, video realizing and the telecommunications of another user of another client device.Other examples of application program include day Go through, search utility, email client, IM application, SMS application, VoIP application, contact manager, task manager, generation Code converter, database program, word processing program, safety applications, spreadsheet program, game, search utility etc..Can be Each embedding on equipment 50 or alternatively downloading and perform in above-mentioned application.

Certainly, although various application discussed above is illustrated as on equipment 50 realizing, but in alternative embodiments, The one or more parts of each in these application can be implemented on one or more remote equipment or server, its In, between equipment 50 and this one or more remote equipments or server, transmit each part by one or more networks Input and output.Alternatively, it is possible to application in one or more be packaged with on ancillary equipment perform or from outward Peripheral equipment is downloaded.

Audio converter.

Audio converter 140 is configured to receive voice data and be converted into more meaningful form with in system Use in 100.Illustrate an embodiment of audio converter 140 in fig. 2.In this embodiment, audio converter 140 can To include many subsystem, these many subsystem include that track recorder 202, track zonal device 204, quantizer 206, frequency are examined Survey device 208, frequency shifter 210, musical instrument transducer 212, gain controller 214, harmonic generation device 216, specially good effect editing machine 218 and hands Dynamic adjustment controller 220.Connection with each subsystem of audio converter 140 and the various subsystems of audio converter 140 Interconnection between system has been not shown, to avoid making the present invention obscure, but, as those skilled in the art have this explanation in face of it When book, drawings and claims it will be appreciated that as, these subsystems will be electrical connection and/or logic connect.

Track recorder 202 allows users to record at least one audio tracks from voice or musical instrument.A reality Executing in example, user can record track in the case of not having any accompaniment.But, track recorder 202 can also be configured For playing audio frequency automatically or when user asks, can compare including click track (click track), musical background, user It judges his/her pitch and the initial sound of timing or the audio frequency of even precedence record." click track " refers to be intended to help User keeps periodicity click noise (clicking the noise) (cycle such as, mechanical metronome sent of consistent bat Property click noise).The time span that track recorder 202 can also allow users to record is set to event horizon (i.e., Some minute and second) or the music bar of some.It is when combining MTAC module 144 and using, as described below, Track recorder 202 can be additionally configured to indicate to graphically what the various piece with the track recorded was associated Point, to indicate when such as user gets out of tune etc..

Usually, music album is made up of multiple lyric sections.Such as, Fig. 3 illustrates a typical progress of popular song, It starts from overture section, followed by main song alternately and chorus section, and bridge section, it is last main song afterwards.Certainly, although not Illustrate but it also may use other structures, such as refrain, finale etc..Therefore, in one embodiment, track recorder 202 is also Family can be configured with and can select to want the section of song that pin is used for recorded audio tracks.It is then possible to press Any order (automatically (determination based on being carried out by type matching device module 152) or as selected by terminal use) Arrange these sections, to create complete music album.

The audio tracks recorded is divided into the subregion of separation by track zonal device 204, then can address these subregions And it is stored as individual addressable separation sound clip or file potentially.Subregion is preferably selected to be so that end-to-end Bonding segmentation causes few audio artifacts or is not resulted in audio artifacts.Such as, let as assume that audible input includes phrase “pum pa pum”.In one embodiment, the division of this audible input can identify each syllable of this audible input and incite somebody to action It divides into the sound of separation, such as " pum ", " pa " and " pum ".It will be appreciated, however, that it is short otherwise to describe this Language, and single subregion can comprise more than a syllable or word.Four are illustrated on display 75 in Figure 1A, 1B and 1C Subregion (numbered " 1 ", " 2 ", " 3 " and " 4 "), each subregion includes more than one syllable.As illustrated, subregion " 1 " Having multiple note, the plurality of note can reflect and used the mike 52 from people or musical instrument source by track recorder 202 Input record identical multiple syllables.

In order to perform the division to the subregion separated of the audible track, track zonal device 204 can utilize at processor 2902 One or more processes of upper operation.In an exemplary embodiment shown in the diagram, track zonal device 204 can include Silence detector 402, stop detector 404 and/or manual zonal device 406, each of which may be used for dividing audio tracks District is temporally aligned N number of subregion.Whenever detect mourn in silence reach special time period time, track zonal device 204 can make With silence detector 302, track is carried out subregion.Should " mourning in silence " can be defined by volume threshold so that when audio volume declines To when reaching the defined time period less than defined threshold value, the position in track is considered to mourn in silence.Volume threshold and time period The two can be configurable.

On the other hand, stop detector 404 can be configured with speech analysis (such as format analysis) and identify sound Vowel in rail and consonant.Such as, consonant (such as T, D, P, B, G, K) and rhinophonia are delimited by the obstruction of air-flow in its sounding. It is then possible to use the position of specific vowel or consonant to detect and identify the point of preferably subregion.With silence detector 402 class Seemingly, stop detector 404 utilize to identify that the vowel of subregion point and the type of consonant can be configurable.May be provided for Manual zonal device 406, allows the user to manually delimit each subregion.Such as, user can specify often simply The time span of individual subregion, so that audio tracks is divided into the many subregions being respectively provided with equal length.User can also quilt Allow to identify ad-hoc location to be created the division in audio tracks.This identification can be to combine the figure shown in Figure 1A, 1B and 1C The type of shape user interface, use pointer device (such as mouse or game console), perform to graphically.This identification is also Can be by by track recorder 202 to the audible playback of audio tracks during press the button on user input device or Key (such as keyboard 55, mouse 54 or game console 56) performs.

Certainly, although the function of silence detector 402, stop detector 304 and manual zonal device 406 is retouched respectively State, but it is envisioned that track zonal device 204 can use appointing of silence detector, stop detector and/or manual zonal device What combination by audio tracks subregion or is divided into segmentation.Those skilled in the art have this specification, accompanying drawing and right in face of it During claim it will also be appreciated that, it is also possible to use for by audio tracks subregion or the other technologies that are divided into segmentation.

Quantizer 206 is configured to quantify the subregion of the audio tracks received, and this can utilize on processor 2902 The one or more processes run.Quantify (this term as used herein) process refer to each be previously created subregion (and Therefore, the note comprised in this subregion) time shift, as in order to carry out being directed at particular beat by the sound in subregion and can As can.Preferably, quantizer 206 is configured to starting each subregion and previously determined joint in chronological order Bat is directed at.For example, it is possible to the offer rhythm, wherein, each can include 4 beats, and separate sound to will definitely To carry out relative to 1/4th pitch time increments, thus offer subregion can be aligned therewith in the bar of each four beats 16 time points.Of course, it is possible to using each (is such as, three beats for Waltz or polka effect, for waving Happy effect is two beats, etc.) and any number of increment of beat, and at any time during process, permissible Manually adjusted by user or based on specified criteria (such as, the specific style of music or type (such as, Blues, jazz, ripple Your card, pop, rock music, swing or Waltz) user's selection) automatically adjust this any number of increment.

In one embodiment, each subregion can with most closely receive it when record by quantizer 206 It is automatically aligned with incremental time.That is, if started between the sound two incremental times in beat, then will in chronological order The playback of shifting sound forward or backward is the closer increment of initial time initial with it in being timed to these increments.Can replace Change ground, can be by each sound automatic shift in time to immediately preceding each by before the relative time of original records of sound Incremental time.In another embodiment, can by each sound automatic shift in time to immediately preceding sound by original records Relative time after each incremental time.Alternatively or additionally, it is also possible to select based on for many tracks record Type affect the time shift (if how having) of each separation sound, as further below with reference to type matching device 1252 As discussion.In another embodiment, it is also possible to automatically by the sound of each sound with the precedence record in many tracks record Rail carries out time alignment, thus realizes Karaoke type effect.Additionally, the length separating sound can be more than one or more times Increment, and, the time shift of quantizer 206 can be controlled to prevent from separating sound by time shift so that separating sound Overlap in identical audio tracks.

Frequency detector 208 is configured to detection and identifies the one or more separation sound can being comprised in each subregion The pitch of sound, this can utilize the one or more processes run on processor 2902.In one embodiment, can pass through Each separation sound is converted to frequency spectrum to determine pitch.Preferably, this is to use fast Fourier transform (FFT) algorithm (all As, iZotope the FFT carried out realizes) realize.It will be appreciated, however, that any FFT can be used to realize.Can also think Arrive, it is also possible to use discrete Fourier transform (DFT) algorithm to obtain frequency spectrum.

In order to illustrate, Fig. 5 depicts and can be produced by the output of the FFT process of the part execution to the audio tracks received An example of frequency spectrum.As can be seen, frequency spectrum 400 includes corresponding with pitch at single fundamental frequency (F) place Main peak value 502, also has at 2F, 3F, 4F ... the harmonic wave of excitation at nF.There is additional harmonic in frequency spectrum, this is owing to working as When encouraging the agitator of such as vocal cords or violin string etc at single pitch, this agitator typically shakes at multiple frequencies Dynamic.

In some instances, the identification of pitch is likely to be due to additional noise and complicated.Such as, as shown in Figure 5, frequency spectrum can To include occurring from the real world agitator of such as voice or musical instrument etc and be revealed as crossing over frequency owing to audio frequency inputs The noise of the low amplitude spike composed and spread.In one embodiment, can be by the FFT less than specific noise threshold value be exported It is filtered extracting this noise.In some instances, the identification of pitch is also possible to by the existence of trill complicated.Trill is can It is applied to the deliberate frequency modulation(PFM) played, and is typically between 5.5Hz and 7.5Hz.As in the presence of noise Like that, trill can be filtered out by applying band filter in a frequency domain from FFT exports, but trill is filtered May the most undesirably.

In addition to frequency domain method discussed above, it is also contemplated that one or more time domain approachs can also be used to come really Determine the pitch of one or more sound in subregion.Such as, in one embodiment, can by measure signal zero crossing it Between distance determine pitch.Such as AMDF(average magnitude difference function can also be used), the equal difference function of ASMDF(mean square) The algorithm of auto-correlation algorithm similar with other etc.

In order to make the judgement to pitch most effective, it is also possible to the content high by accordatura to be grouped into (constant frequency) note (frequency being stably increased or decreased) glide.But, stablize the product of discrete notes or the pleasure of tune with having naturally to produce Device is different, and voice often slips into note and flickers in a continuous manner, so that becoming difficulty to the conversion of discrete notes.Cause This, frequency detector 208 can also be preferably by pitch pulse detection to the pitch separated between sound identifying in subregion In displacement or change.

Pitch pulse detection is a kind of for being formed between the voice and its perception to its voice of singer focusing on The pitch event of trajectory the controlling loop method that carries out delimiting.Usually, when singer's sounding, this singer listens after for a moment To this sound.If singer hears that pitch is incorrect, then he revises his voice immediately to the pitch being intended to.This negative feedback is returned Road can be modeled as the damped harmonic wave motion driven by recurrent pulses.Therefore, voice can be considered single agitator: sound Band.In figure 6 it can be seen that the pitch changing of the voice 602 of singer and an example illustration of arrangement.Nervous control in vocal cords Pitch processed, and this change of pitch can be built by the response of jump function (jump function 604 in such as Fig. 6) Mould.Therefore, it can converge to pitch continuous of stationary value by finding the initial of damped harmonic wave vibration in pitch observing Turning point determines the initial of new pitch event.

After pitch event in the subregion of audio tracks is determined, it can be changed and/or be stored conduct Pitch event is relative in the form of the curve chart of time.Depict an example of form (not there is subregion) in the figure 7.Cause This, form can include starting each sound, persistent period and pitch or any combination of these values or subset are carried out The information of mark.In one embodiment, form can be to have the form of MIDI data, although to may refer to pitch relative for form In any expression of time, and it is not limited to semitone or any specific rhythm.Such as, it is being incorporated herein by “Morphological Metrics” by Larry Polansky, Journal of New Music Research, volume 25, pp. 289-368, ISSN:09929-8215 describes spendable form Other such examples.

Frequency shifter 210 can be configured to shift the frequency of audible input, and this can utilize at processor 2902 One or more processes of upper operation.For example, it is possible to that automatically improves or reduce in the subregion of audible input is one or more The frequency of sound, be previously recorded separate sound or audible input fundamental frequency alignment.In one embodiment, to being to carry High or the frequency reducing audible input determination depends on immediate fundamental frequency.In other words, it is assumed that melody is in c major, that If the audio frequency captured by track recorder 202 is 270.000Hz, then frequency shifter 210 will shift downwards note and arrive 261.626Hz(central authorities C), and if the audio frequency captured by track recorder 202 is 280.000Hz, then frequency shifter 210 will upwards Displacement note 293.665Hz(or the D higher than central authorities C).Even if when audible input is mainly adjusted to immediate by frequency shifter 210 During fundamental frequency, frequency shifter 210 can also be further programmed to come close to calling (i.e., based on music tone, type and/or string Wherein, audio frequency is approximately at halfway between two notes) carry out different decision.In one embodiment, frequency shifter 210 can be with base In the control provided by type matching device 260 and/or string adapter 270, audible input is adjusted to based on music tone, type And/or string and at other the most reasonable fundamental frequencies, as discussed further below.Alternatively or additionally, in response to From the input of musical instrument transducer 212, one or more parts of one or more subregions can also be moved by frequency shifter 210 respectively Position becomes the frequency corresponding to predetermined set or semitone, such as, typically with selected musical instrument (such as piano, guitar or other string musics Device, woodwind instrument or brass instrument) those frequencies of being associated or semitone.

One or more parts that musical instrument transducer 212 can be configured to perform audible input are relevant to musical instrument to having The conversion of one or more sound of the tone color of connection.For example, it is possible to the one or more sound in audible input are converted to one One or more musical instruments of the percussion instrument (including snare drum, cattle neck bell, bass drum, angle iron etc.) of kind or number of different types Sound.In one embodiment, may include that to the conversion of the percussion instrument sound of one or more correspondences can for audible input Timing and the amplitude adapted of listening the one or more sound in input are the correspondence including idiophonic one or more sound Track, this percussion instrument sound includes and this one or more same or analogous timings of audible input sound and amplitude.For It is enabled to play other musical instruments (such as, trombone) of different note or other kinds of brass instrument, stringed musical instrument, wooden pipe pleasure Device etc., musical instrument conversion can further by one or more frequencies of audible input sound with have by the identical of instrument playing or One or more sound of similar frequencies are correlated with.Additionally, conversion can be by actually playing corresponding physics musical instrument every time Physical capability is derived and/or is limited.Such as, the frequency of the musical instrument sound generated for ALto Saxophone track can be by tradition The actual frequency scope of sound saxophone limits.In one embodiment, the audio tracks generated can include conversion after can Listen the expression of the midi format of input.The data of the various musical instruments used by musical instrument transducer 212 will be preferably stored in deposits In reservoir 2904 and from optics or magnetizing mediums, removable memorizer or can download via network.

Gain controller 214 can be configured to the volume of track based on other precedence records and automatically adjust audible defeated The relative volume entered, it is possible to utilize the one or more processes run on processor 2902.Harmonic generation device 216 can be by Being configured to be incorporated in audio tracks harmonic wave, this can utilize the one or more processes run on processor 2902.Example Such as the different additional frequency of, it may be determined that audible input signal and add it to produced audio tracks.Determine additional frequency Rate is also based on from the type of type matching device 260 or by using other predefined parameters inputted by user to arrange. Such as, if selected type is Waltz, then can have " oom-pa-pa " beatIn time from main play music and Humorous being in selects additional frequency in the main big mediation string played in following octave, as follows: fundamental tone, fundamental tone.Specially good effect editing machine 218 can be configured to add various effects to audio tracks, such as echo, echoes, preferably land productivity It is used on processor 2902 the one or more processes run.

Audio converter 140 can also include manually adjusting controller 220, allows the user to manually change by begging for above Any setting that the module of opinion automatically configures.Such as, in addition to other options, manually adjust controller 220 and can make user Audio frequency input or the frequency of its part can be changed；Allow users to change starting and the persistent period of each separation sound；Increase The gain of the little audio tracks that adds deduct；Select to be applied in the different musical instruments of musical instrument transducer 212.Such as those skilled in the art When having this specification, drawings and claims in face of it it will be appreciated that as, this manually adjusts controller 220 and can be set It is calculated as being used together with one or more graphic user interfaces.To discuss a kind of special explicitly with Figure 13 A, 13B and 13C below Determine graphic user interface.

Fig. 8 illustrates the sound being processed by audio converter 140 or otherwise downloading from another source, obtain or obtain Frequently an embodiment of the file structure of the subregion of track.It is shown that in this embodiment, file includes and file phase Metadata, the morphological data (such as, having midi format) obtained and the original audio of association (such as, have .wav lattice Formula).Metadata can include the information indicating the profile being associated with founder or the supplier of audio tracks subregion.It also may be used To include the additional information relevant with the audio signature of data, the tone being such as associated, bat and subregion with audio frequency.Metadata The possible available pitches of each note that can also include and can be applied in subregion shifts, can be applied to each note The information that the amount of time shift etc. are relevant.For example, it should be appreciated that for the audio frequency of document recording, be more than if pitch is shifted , then there is the probability of distortion in semitone.Correspondingly, in one embodiment, can be placed in live audio to prevent by constraint The displacement of more than one semitone.It is, of course, also possible to use difference to arrange and different constraint.In another embodiment, possible pitch The scope of displacement, time shift etc. can also have essence by the founder of audio tracks subregion or in this audio tracks subregion Any individual (such as manager, partner etc.) of right changes or sets up.

Record accompaniment fact circulation.

Record accompaniment fact circulation (RSLL) module 142 realizes Digital Audio Workstation, this Digital Audio Workstation and sound Frequently transducer 140 combines and realizes the record of audible input, the generation of separating audio track and the establishment of many tracks record.Cause This, RSLL module 1422 can make any recorded audio tracks (that say, that chant or otherwise carry out) energy Enough and precedence record track is combined creating many tracks record.As discussed further below, RSLL module 142 It is also preferably configured to circulate many tracks record of precedence record at least one for repeating playback.Can be the most audible Input is being recorded or RSLL module 142 the most otherwise receives the finger for current ongoing record accompaniment Perform this while order and repeat playback.Thus, RSLL module 142 allows user track same playing and listening to precedence record Shi Jixu edits and composite music track.As will understand from discussed below, when being preferably completed this process, The continuously circulation of the track of precedence record further minimizes user to can be by being applied to the audio frequency sound that user is currently recording The perception of any waiting time that the process of rail causes.

Fig. 9 illustrates and is totally shown with RSLL module 142 and combines with audio converter 140 and to create many tracks record The logical flow chart of one embodiment of general introduction process.Generally, the operation of Fig. 9 typicallys represent record accompaniment.Whenever user adopts During by system 100 and such as RSLL module 142, can be newly created and complete this accompaniment.Alternatively, it is possible to continue previously Accompaniment, and also can load and apply its element-specific, many tracks record or other users of such as precedence record specify note Record parameter.

In any one is arranged, after starting frame, process 900 starts from decision box 910, and wherein, user determines whether Many tracks record of current record to be played back.The mistake of current many tracks record is played back while enabling other actions to be performed Journey is generally known as " live circulation " in this article.In the case of the most explicitly repeating, the many tracks record the most played back The content of part and the persistent period be referred to as " live circulation ".During playing back, many tracks record can be attended by beat sound Rail, this click track generally comprises the separating audio track not stored together with many tracks record, and this separating audio track provides This system is audibly indicated to be presently configured to the speed of track and a series of reference voices at equal intervals of trifle or the joint of record Clap.

In the original execution of process 900, may not yet generate audio tracks.In such state, can be in frame 910 The playback of empty many tracks record emulate, and, click track can provide to be played and only have sound to user.So And, in one embodiment, user can select to make click track weaken, as discussed further below with reference to frame 964. Audio frequency playback can be combined during recording visual cues is supplied to user.Even if when audio tracks is not recorded and beat When track is weakened, it is also possible to the instruction of emulation playback and present playback position is only limitted to these visual cues, and it can wrap Include the display (see for example Figure 12 A, 12B and 12C) of the change of such as progress bar, pointer or the instruction of certain other figure.

In decision box 910, many tracks record of the live circulation of playback can include the one or more sounds being previously recorded Frequently track.This many tracks record can include overall length and the length played back as fact circulation.The length of live circulation Degree can be selected to be less than the overall length of many tracks record, thus allows user to be layered the difference of many tracks record discretely Bar.Can be manually selected by user or be alternatively based on the audible input received automatically determine live circulation relative to many The length of track record overall length.In at least one embodiment, the overall length of many tracks record and live circulation is permissible Identical.Such as, the length of live circulation and many tracks record can be wall scroll music.

When many tracks record is chosen so as to playback at decision box 910, can be with the pin at least including many tracks record Audio frequency playback to the live circulation of the part of user's playback synchronously provides additional visual clue, the most one or more tracks Visual representation.While many tracks record is played, process 900 continues at decision box 920, wherein, by terminal use It is made whether to generate the determination of the audio tracks of many tracks record.(such as, terminal can use based on receiving audible input The voice audible input that family generates) initiate record.In one embodiment, the amplitude detected of audible input can trigger The sampling of the audible input signal received within system 100 and storage.In alternative embodiments, can be by by system 100 receive be manually entered initialize this track generate.Additionally, generate new audio tracks may need detect can Listen input (such as from mike) and manually both instructions.If generating new audio tracks, then process and continue at frame 922 Continuous.If not initiating the generation of audio tracks, then process 900 continues at decision box 940.

At frame 922, the track recorder 202 of audio converter 140 receive audible input, and this audible input is deposited In storage memorizer 2904 in one or more data memory modules 132.As used herein, " audible " refer to The attribute of the input of equipment 50, wherein, when this input is provided, its can simultaneously, naturally and directly by least one User is not amplifying or is hearing in the case of other electron process.In one embodiment, can be based on receive first can Amount remaining time in live circulation when listening input determines the length of recorded audible input.I.e., it is possible to follow in fact The record of audible input is terminated, regardless of whether the most receiving audible input after the length of the time at the ending of ring Detectable amount.Such as, if the length of circulation is that when every four beat is long, and in the beginning of the second beat Place detects or triggers the reception of audible input first, then can record corresponding with second, third and the 4th beat of this article Three beats being equivalent to audible input, and therefore, will many tracks record playback of continuous processing in frame 910 circulate These second, third and the 4th beat.In this arrangement, can as many tracks record another separate track basis, Any audible input that record and process receive after the ending of single bar.Can will separate this additional treatments of track It is expressed as the separation iteration by least frame 910,920 and 922.

In at least one alternative embodiment, can move based on the length of the audible input received at frame 922 State adjusts the length of playback cycle.That is, audible input may automatically lead to the current sound of many tracks record of playback in frame 910 The extension of the length of rail.Such as, if being played in the current live length circulated and having received additional audible input afterwards, then Can record and maintain this longer audible input to export as new audio tracks further.In this arrangement, can be follow-up The previous audio track of many tracks record is repeated, with the length of the audible input that coupling receives in live circulation.An embodiment In, the repetition integer number of times of shorter previous many tracks record can be performed.The repeating of this integer number of times maintains precedence record Relation between multiple of shorter many tracks record, if any.In this way it is possible to dynamically change many tracks record Circulation point with fact circulation.

Similarly, the length of the track received at frame 922 can be (that is, longer at four than currently playing live circulation Live circulation playback during receive the audible input of only one bar) length shorter.In this arrangement, when at least threshold Not yet receive additional after the scheduled time (such as, the second of selected number) after the reception of the audible input of value volume and record During audible input, the ending of audible input can be detected.In one embodiment, this detection mourned in silence can be based on higher than working as The disappearance of the input of the threshold volume of front live circulation.Alternatively or additionally, can the reception of manually signal send out The ending of signalisation audible input.Can determine for there is the number of the bar recording equal number of beat with many tracks The correlation length of this shorter audible input.In one embodiment, this number of bar is selected as the length of current live circulation Factor.At each occurrence, being once converted into track at frame 924, audible input just can be manually or automatically choosing The number of times that the length of the many tracks record selecting to repeat to be enough to and currently playing back matches.

In frame 924, by audio converter 140, the audible input received can be converted to audio tracks.As above institute Discuss, this audio frequency transformation process can include various operation, it include subregion, quantization, frequency detecting and displacement, musical instrument conversion, Gain control, harmonic generation, interpolation specially good effect and manually adjust.The order of each in the conversion operation of these audio frequency can be by more Change, and can be configured by terminal use at least one embodiment.Furthermore, it is possible to optionally apply these operation in every One, be enable to utilize as required more than or as required the additional treatments of minimum by audible input conversion For audio tracks.For example, it may be possible to do not select musical instrument to change, thus allow the one or more original sound bases from audible input It is included in basis in the audio tracks generated with its Multisound.In frame 924, echo cancellation process can be applied To filter out the audio frequency of other tracks play during the live circulation of the audio tracks from actively record.An enforcement In example, this can be realized by operations described below: identifies the audio signal play during fact circulates；Determine output sound Frequently any delay between signal and input audio signal；It is similar to input audio frequency letter with postponing into by the filtering of output audio signal Number；And deduct output audio signal from input audio signal.The preferred echo cancellation process of spendable one is by iZotope The process realized, although other embodiments can also be used.Can apply or remove the process of frame 924 subsequently, as closed herein As frame 942 is discussed further.After audible input being converted to generated audio tracks at frame 924, process 900 Continue at frame 926.

At frame 926, the audio tracks generated from frame 924 can be added to many tracks record in real time.This can To be the many tracks initiated, or alternatively, this can be to have the audio tracks included as its first track New many tracks.After frame 926, process 900 can begin again at decision box 910, wherein it is possible to utilize included The audio tracks being newly generated to play back multitone rail.Perform although operation 922,924 and 926 is illustrated as serial in fig .9, but It is to can also be for each these steps of audible input executed in parallel received, in order to realize audible input signal further Real time record and playback.During each audible input, can such as from each separation sound of audible input identification, Perform this parallel processing, although alternative embodiment can include other different size of parts of audible input signal.

At decision box 940, it is made whether to revise the determination of the one or more audio tracks in many tracks record.Example As, the desired input of terminal use indicating the audio tracks to one or more precedence records to modify can be received.? In one embodiment, can manually input and receive instruction.As mentioned above, it is also possible to the many tracks in current record are remembered Perform this amendment during the playback of record, thus allow the evaluation immediately of the current state of the many tracks record for terminal use. In one embodiment, this instruction can include one or more tracks of many tracks record that adjustment is applied to by expectation.This A little tracks can also include manually being added to the one or more new track of many tracks record.If receiving track amendment Instruction, then process 900 continues at frame 942；Otherwise, process 900 continues at decision box 960.

At frame 942, receive the parameter of the track of one or more previous conversion, it is possible to inputted adjustment by terminal use After parameter.The parameter of amendment can include any adjustment that the process of audio converter 140 can be used to complete, except other show Outside example, this process can include making track weaken or solo, removes the strike speed of whole track, the musical instrument adjusted in track Spend, adjust the bat of the playback of the audio volume level of track, all tracks adjusted during fact circulates, add or remove from track Selected incremental time separate sound, adjust fact circulation length and/or the overall length of many tracks record.Adjust fact The length of circulation may include that the starting and ending point changing the circulation about overall many tracks record, and/or can also include The track repeated in current live circulation, the precedence record adding and/or adding many tracks record is added to by more a plurality of Bar (wherein, at least subset of track is previously associated with these) or from many tracks record delete bar.New track Add and the various aspects of this new track may be needed to be inputted by end user manual.At this external frame 942, can be by use sound Sound searcher module 150 scans for for additional track, to promote terminal use's reusing the audio tracks of precedence record.

At frame 944, the parameter after adjusting is applied at the one or more tracks indicated at decision box 940.Should The form of the one or more tracks compatibility after being by the Parameters Transformation that can include after adjusting and adjust.For example, it is possible to will One or more numerical parameters are adjusted to corresponding with the one or more values being applicable to MIDI or other protocol formats.At frame After 944, process 900 can begin again at decision box 910, wherein it is possible to the one or more amendments included by Li Yonging After audio tracks play back the part corresponding with fact circulation of at least many tracks record.

At decision box 960, it is made whether to revise the determination that record is arranged.For example, it is possible to whether receive instruction user Expect the input of one or more aspects of amendment record setting.Can also manually input and receive this instruction.This instruction One or more parameters that record to be adjusted is arranged can be advanced to arrange.If terminal use expects to revise recording step, Then process 900 continues at frame 962；Otherwise, process 900 continues at decision box 980.

At frame 962, can be with calibration record system.Especially, can calibrate include at least audio input source, audio frequency output Source and the writing circuit of audio tracks processing component, determine the waiting time of system 100, it is preferable that such with bonding apparatus 50 The time for the treatment of is to play back sound by audio output source and received between audible input with measurement in thousands of seconds by audio input source 's.Such as, if writing circuit includes earphone and mike, then can be determined that waiting time is audible to improve by RSLL 142 The reception of input and conversion, especially, the phase between beat and the audible input received of the many tracks record played back Determination to timing.After calibration (if any) at frame 962, process 900 proceeds to frame 964.

At frame 964, thus it is possible to vary other record system parameter setting.For example, it is possible to be turned on and off click track Playback.Furthermore, it is possible to revise new track or the default setting of new many tracks record, such as, it is provided that the audible input of frame 924 Default bat and default conversion set.The time signature of current many tracks record can also be changed at frame 964.May be provided for Digital Audio Workstation be associated other arrange so that these other arrange and can be revised by terminal use, such as this area skill When art personnel have this specification, drawings and claims in face of it it will be appreciated that as.After frame 964, process 900 can To be back to decision box 910, wherein it is possible to audio tracks follow-up that the adjustment of record system will be applied to many tracks record Record and amendment.

At frame 980, it is made whether to terminate the determination of record accompaniment.For example, it is possible to from being manually entered reception instruction companion The input of the end played.Alternatively, if such as data storage 132 is full, then equipment 50 can initiate the end of accompaniment. If receiving accompaniment termination instruction, then can store for additional operations and/or transmit many tracks record.For example, it is possible to will Many tracks record is stored in data storage 132, for future initial creation many tracks record accompaniment continue or Retrieval in new accompaniment, check and revise.By network, many tracks record can also be transmitted to another equipment 50 from equipment 50, Store at least one remote data storage being associated with user account.Can also be come by the webserver Share, with Online Music community, the many tracks record transmitted, or institute can be shared in the game by webserver trustship Many tracks record of transmission.

If record accompaniment does not terminates, then process 900 returns again to decision box 910.This sequence of events can represent User is determining which (if any) additional track is to be generated or other amendment (if any) to be performed same Time listening to period of live circulation.When those skilled in the art have this specification, drawings and claims in face of it The combination of the frame in (or otherwise) and flow chart illustration can it will be appreciated that each frame of flow chart illustration in Fig. 9 To be realized by computer program instructions.These programmed instruction can be provided to processor to produce machine so that manages in this place The instruction performed on device creates the device of the action specified in one or more flow chart box for realization.Computer program refers to Order can be performed by processor, so that sequence of operations step is performed by this processor, realizes process producing computer so that The instruction performed on the processor provides the step of the action specified in one or more flow chart box for realization.Calculate Machine programmed instruction can also make at least some in the operating procedure shown in the frame of flow chart be executed in parallel.Additionally, also may be used Perform some in step crossing over more than one processor, such as in multiprocessor computer system contingent that Sample.Additionally, one or more frames or frame combination in flow chart illustration can also be combined with other frames or frame and be performed simultaneously, or Even performing by from illustrated different order without departing from the scope or spirit of the invention.Correspondingly, flow chart The frame support of diagram is for performing the combination of the device of required movement, for performing the combination of the step of required movement and being used for holding The program instruction means of row required movement.It will also be understood that the frame combination in each frame of flow chart illustration and flow chart illustration Can be realized or by specialized hardware and computer instruction by the special hardware based system performing required movement or step Combination realize.

Now by about the various screens can being associated with the user interface realizing audio converter 140 and RSSL module 142 Curtain display describes the operation of certain aspects of the present disclosure.Shown embodiment is can be associated with the operation of system 100 The non-limiting non-exclusive example user interface that ground uses.Various screen displays can include more perhaps than shown parts Parts that are many or that reduce a lot.Additionally, the layout of parts is not limited in the layout shown in these display, and also it is contemplated that Other are arranged, including the setting on different interfaces of the various parts.But, shown parts are not enough to open for implementing this The illustrative embodiment of invention.

Figure 10,10A and 10B together illustrate the aspect realizing RSLL 142 and audio converter 140 and with record and repair Change a user interface of the track of many tracks record.The overall display at interface 1000 can be considered " control space ".Permissible Based on being manually entered (such as, by using mouse 54, touch screen 80, pressing plate or being arranged in response to and pass from user Reach the equipment of physical control) operate each control of display on interface.It is shown that interface 1000 display record companion The various aspects of the many tracks record played and generate as a part for this accompaniment.File menu 1010 includes for creating new The operation of many tracks record of many tracks record or loading precedence record, as those skilled in the art have this explanation in face of it When book, drawings and claims it will be appreciated that as.

Bat control 1012 shows the bat of many tracks record with beat per minute.Bat control 1012 can be by user Directly manual modification.Bar control 1014 shows the bar number of many tracks record.Bar control 1014 can be display configured in reality Condition circulation during when preceding article number, overall bar number or alternatively may be used for selecting the specific bar of many tracks record Number is for being further illustrated in interface 1000.

Beat control 1016 shows the beat number of many tracks record.Beat control 1016 can be display configured to each The sum of the beat of bar, or alternatively show the current beat number during the playback of many tracks record.Time control The time of 1018 display many tracks records.This time control 1018 can be display configured to many tracks record overall time, The time span of the current live circulation selected, during fact circulates definitely or relative time or may be used for jumping to The specific absolute time of many tracks record.Can change in the frame 964 of Fig. 9 interface 1000 control (such as, control 1012, 1014,1016,1018 and 1021-1026) operation.Control 1020 and frame 942 and 962 sound discussed further about Fig. 9 It is corresponding that rail arranges adjustment with record.

Add track control 1021 and allow users to be added manually to track many tracks record.Selecting control 1021 Time, new track is added to many tracks record, and is updated to include the additional controls for the track added by this interface 1040-1054, its operation is discussed below.Present WAV control 1022 and generate and store at least from many tracks record The wav file divided.The part of the many tracks record presented in this wav file and other storage parameters can be by user in choosings Select and input further when presenting WAV control 1022.Additionally, in addition to WAV, other audio file formats can also pass through such as control The control of 1022 etc and can use.

Click track control 1023 switches the playback of click track.Equipment control 1024 is switched on and off the note of RSLL 142 The ability of the record audible input of record parts and equipment.Equipment control 1024 enables terminal use to talk with other users, Implementation voice inputs, and creates other sub-audible sound during record accompaniment and do not make these sound be converted to by RSLL 142 and enter The audible input that one step processes.

Circuit parameter control 1025 allows users to calibration record circuit parameter, as about discussed further that of Figure 11 Sample.The volume that slide block 1026 enables many tracks record to play back is controlled.Playback controls 1030 realizes returning many tracks record Put.This playback is to carry out collaboratively with the recording parameters shown further by control 1012-1018 and control.Such as, return Put control 1030 can initiate to enter from the position indicated via control 1014-1018 and with the bat of display in control 1012 The playback of many tracks record of row.As mentioned above, this control 1030 also realizes another sound for generating many tracks record Frequently the record of the additional audible input of track.Position control 1032 can be also used for controlling the current playback position of many tracks record Put.Such as, control 1032 can make playback in the absolute beginning of many tracks record or alternatively in current live circulation Beginning be initiated.

Grid 1050 in user interface 1000 represents the separation sound in one or more tracks of many tracks record Playback and timing, wherein, often row represents individual track, and each column express time increment.Often row can such as include single bar In the frame of each incremental time.Alternatively, often row can include that enough frames are to represent when totally continuing of live circulation Between incremental time.The frame (such as frame 1052) with the first shade or color in grid 1050 can represent in fact circulation The relative timing of the position of period playback sound, and each instruction in other frames (such as frame 1054) does not play back separation sound Incremental time in the track of sound.The track added via manual control 1021 initially includes the frame of such as frame 1054 etc.Frame The selection of (such as frame 1052 or frame 1054) can be added at the incremental time being associated with selected frame or remove from track Sound.The sound added via being manually entered of frame in grid 1050 can include the musical instrument selected for track Default sound, or alternatively include the copy of at least one sound quantified from the audible input of track.For grid This manual operation of 1050 enables audible input to generate one or more sound of track, but the manual choosing in this track The one or more copy in these sound is added in the position selected.

Progress bar 1056 visually indicates the incremental time of the present playback position of many tracks record.In grid 1050 Each track is associated with the set of track control 1040,1042,1044,1046 and 1048.Remove track control 1040 to make Track can be removed, it is possible to be configured to optionally remove from one or more of many tracks record from many tracks record Track.

Musical instrument selects control 1042 to realize in the audio tracks generated and the sound of audible input is changed pleasure extremely The selection of device.As shown in FIG. 10A, can manually select from drop-down menu and include percussion instrument or other kinds of non-percussion music The multiple musical instrument of device.Alternatively, it is possible to automatically select or predefine default musical instrument for each given audio tracks or lack Province's musical instrument progress.When non-selected musical instrument, each sound in the audio tracks generated can correspond essentially to initially The sound of the original audible input that the tone color of audible input includes together.In one embodiment, can be based on training RSLL 142 select musical instrument, the specific sound in audible sound are automatically changed with frequency tape sorting based on the most each specific sound Musical instrument sound for association.

Weaken/solo control 1044 make the track of association weaken or make in addition to the track being associated with control 1044 all Other tracks weaken.Speed control 1046 realizes the initial start to the musical instrument sound generated for the audio tracks after conversion (attack) or the adjustment of Beating Strength, this may each musical instrument sound of generating for associated audio track of impact peak value, Persistent period, release and overall amplitude shape.Can be manually entered or be alternatively based on and generate one or more pleasures from it The audible input tone quality of device sound extracts this speed.It is each that volume control 1048 realizes in many tracks record The individual control of the playback volume of track.

Figure 11 illustrates an embodiment at the interface 1100 for calibration record circuit.Interface 1100 can represent can be Control 1025(is shown in Figure 10 A) example of screen display pop-up window etc. that occurs when being chosen.In one embodiment, boundary Face 1100 includes achieving a butt joint the microphone gain control 1110 of adjustment of amplitude of the audible input received.Upper control 1120 He Lower control 1130 and half-life control 1140 offer are entered for system 100 for the signal received is identified as audible input The additional control of one step process and confirmation.Calibration circuit is initiated predetermined tempo track and can guide user in audible input Signal replicates this click track.In alternative embodiments, the click track for calibration can be by such as mike etc Audio input device directly receive as audible input, and audibly replicate click track without user.Based on click track In the generation of sound and the reception of sound in audible input between relative timing poor, it may be determined that system latency time 1160.Waiting time value can be used further by RSLL 142, to improve quantization and many tracks record of audible input Playback with the audible input received for the follow-up derivation of the supplemental audio track to many tracks record to be added between Detected relative timing.

Therefore, as illustrated, interface 1100 and 1110 to user present enthusiasm and not do not threaten, powerful and one Causing but control space in terms of study intuitively, this is to not being professional happy person or being otherwise unfamiliar with DAB works Particular importance for the layman user of instrument.

Figure 12 A, 12B and 12C together illustrate and can be associated with the record of the audio tracks in many tracks record and amendment The another Exemplary Visual display that ground uses.In this example, provide to graphically audio frequency (actual and form (by The rear frequency displacement that frequency shifter 210 is carried out)), subregion, quantization and tempo information, experience the most intuitively to provide the user with.Example As, turn first to Figure 12 A, it is provided that for the Graph Control space 1200 of fact circulation.This control space includes identified track In subregion (or music measures) (in the case of Figure 12 A-C, it is shown that trifle 1 to 4) in the multiple subregions of each refer to Show symbol 1204.In one embodiment of the graphic user interface shown in Figure 12 A-C, vertical line 1206 illustrates each trifle Interior beat, wherein, the vertical line number of every trifle preferably corresponds to the useful word of time signature.Such as, if melody is chosen Wrirting music for using 3/4 time signature, the most each trifle will include three vertical lines, have three with instruction in this trifle or subregion Beat.In the identical embodiment of the user interface shown in Figure 12 A-C, horizontal line 1208 can also identify to be wanted with audible input The fundamental frequency that the selected musical instrument being converted to is associated.As diagram further in the embodiment of Figure 12 A-C, it is also possible to provide Musical instrument icon 1210 is with the selected musical instrument of instruction, guitar selected in such as Figure 12 A-C.

In embodiment shown in Figure 12 A-C, solid line 1212 represents such as terminal use's voice or uses musical instrument record The audio volume control of a track；And multiple horizontal bar 1214 represents by quantizer 206 and the frequency shifter of audio converter 140 The form of 210 notes generated from audio volume control.As depicted, each note of the form generated is by the time Upper displacement is to be directed at and corresponding with one of fundamental frequency with selected musical instrument in frequency upper shift position with the beat of each subregion.

As describe by Figure 12 A and Figure 12 B and Figure 12 C is compared, it is also possible to playback bar 1216 is provided With the current live specific part circulated play by track recorder 202 that mark is relevant with the process of Fig. 9.Therefore, When fact circulation is played, playback bar 1216 is from moving left the right side.When arriving the ending of the 4th trifle, playback bar is back to The beginning of trifle 1 the most sequentially repetitive cycling.Terminal use can be by recording adventitious sound at appropriate point in the circulating cycle Frequency to provide at any point in fact circulates supplemental audio input.Although not shown in Figure 12 A-C, but each additional Record is provided for new track (or note set) to describe in circulating in fact.Can be by adding additional musical instrument icon Separation track is associated by 1210 from different musical instruments.

Figure 13 A, 13B and 13C together illustrate for manually changing the note that is previously generated via the interface of Figure 12 A-C One example of process.As shown in FIG. 13A, terminal use can use pointer 1304 to select a particular note 1302. As shown in Figure 13 B, then terminal use can vertically pull note with another horizontal line 1208, the sound pulled with change The pitch of symbol.In this example, note 1302 is illustrated as moving to higher fundamental frequency.It is contemplated that note can also be moved to Frequency between the fundamental frequency of musical instrument.As shown in figure 13 c, it is also possible to by selecting the ending and then of the aspect delineation of note Flatly pull this note to change the timing of this note.In Figure 13 C, the persistent period of note 1304 has been extended.With Describing in sample such as Figure 13 C, the result extending note 1304 is to be shortened the automatic of note 1306 by quantizer 206, to maintain Beat and avoiding by single instrument playing overlap note.As those skilled in the art have this specification, accompanying drawing and power in face of it Profit claim time it will be appreciated that as, it is possible to use same or analogous method shortens the persistent period of selected note, thus Cause automatically prolonging of another adjacent note, and it is possible to further illustrate with the afterbody about amendment aspect delineation Same way changes the persistent period of note from the beginning of this description.Those skilled in the art also should understand similarly, can To use next note or the copy note deleted from track of same procedure to insert at other parts of track.

Figure 14 A, 14B and 14C illustrate the another Exemplary Visual display being used together with system 100.In this example In, this visual displays allows users to record and revises the many tracks record being associated with percussion instrument.Turn first to figure 14A, controls space 1400 and includes that grid 1402, grid 1402 represent the sound that separates in one or more percussion instrument track Playback and timing.As in the diagram of Figure 12 A-C, depicting subregion 1-4 in the example of Figure 14 A-C, each subregion has Four beats.Such as, in Figure 14 A, the first row of grid 1402 represent the sound being associated with the first bass drum playback and Regularly, the second row of grid 1402 represents playback and the timing of the sound being associated with snare drum, the 3rd and the of grid 1402 Four row represent playback and the timing of the sound being associated with big cymbals, and the fifth line of grid 1402 represents and is associated with Floor Tom Sound playback and timing.As managed when those skilled in the art have this specification, drawings and claims in face of it As solution, these specific percussion instruments and the order on grid 1402 thereof are meant only to diagram design, and are not construed as Design is limited to this particular example.

Each frame in grid represents the timed increase of the sound being associated to relevant percussion instrument, wherein, non-shadow frame Instruction do not have sound will be played at this incremental time, and dash box indicate at this incremental time sound to be play (with Relevant idiophonic tone color is associated).Therefore, Figure 14 A illustrates the example not having sound to be played, and Figure 14 B illustrates To play the example of sound of bass drum in time of being indicated by dash box, and Figure 14 C illustrates and to be referred to by dash box The example of the sound of symbol and bass drum is play at the time shown.For each percussion instrument track, can in every way by The sound being associated with specific percussion instrument adds the track to musical instrument.Such as, as shown in Figure 14 B or 14C, it is provided that return Put bar 1404, visually to indicate the incremental time of the present playback position of many tracks record during fact circulates.Therefore, In Figure 14 B, the first beat of playback article instruction the 3rd trifle is the most played.It is then possible to allow users to pass through When playing back bar 1404 and being on the frame being associated with particular beat, record sound adds and specific percussion music with particular beat The sound that device is associated.In one embodiment, sound wants musical instrument track associated therewith by selecting or can tap suitably User's manual identification of musical instrument.In this case, user the particular characteristics of the sound made and pitch may be inessential, to the greatest extent Pipe is it is contemplated that the volume of the sound made by user may affect the increasing of the associated sound generated for percussion instrument track Benefit.Alternatively, user the sound made may indicate that sound wants percussion instrument associated therewith.Such as, user is permissible Send sound " boom ", " tsk " or " ka ", to indicate respectively bass drum, symbol or cylinder drum beat.In another embodiment, may be used Allow the user to by clicking on or select the frame in grid 1402 add simply or remove the sound from track.

Many tunes are automatically synthesized module.

MTAC module 144(Figure 1A) it is configured to combine audio converter 140 and carry out optionally in combination with RSLL 142 Operation, to realize the automatic making to single " most preferably " tune derived from a series of tunes.Illustrate MTAC mould in fig .15 One embodiment of block 144.In this embodiment, MTAC module 144 includes for each song from the audio frequency recorded The subregion of section carries out the subregion scoring device 1702 given a mark and for gathering based on the score identified by subregion scoring device 1702 The synthesizer 1704 of single " most preferably " tune.

Subregion scoring device 1702 can be configured to give a mark subregion based on one or more criterions, and this can be in order to It is used on processor 2902 the one or more processes run.For example, it is possible to based on the sound selected relative to overall melody Subregion is given a mark by the tone of the subregion adjusted.Generally, player may sing the note that gets out of tune in the case of ignorant.Cause This, it is also possible to the note in this subregion is given a mark by the difference between tone based on note and the proper pitch of subregion.

But, in many cases, novice end users may be unaware that he wants to sing what music tone.Therefore, divide District's scoring device 1702 can be additionally configured to automatically identify tone, and this can be referred to as " automatic pitch detection ".Utilize " automatic sound Adjust detection ", subregion scoring device 1702 may determine that the immediate tone of tone of the audio performance recorded with terminal use. System 50 can highlight any note got out of tune from the tone automatically detected, it is possible to further by automatic for these notes Adjust to the fundamental frequency being in the key signature automatically determined.

Depict a kind of illustrative process for determining music tone in figure 16.As shown in the first frame, this process Utilize weight that each fundamental frequency in tone is provided, for 12 music tones (C, C#/Db, D#/Eb, E, F, F#/Gb, G, G#/Ab, A, A#/Bb, B) in each whole track is given a mark.Such as, the tone weight array of certain arbitrarily large tune can Can look like so [1 ,-1,1 ,-1,1,1 ,-1,1 ,-1,1 ,-1,1], this gives Do and starts and continue with Re Each in continuous etc. 12 notes in scale assigns weight.To each note (or carrying out the interval of autonomic tone) appointing authority Heavily it is applicable to any kind of tone.The note got out of tune is presented negative weight.Although the value of weight is the most important, but It is that they can be adjusted to individual consumer's taste or adjust based on the input from type matching device module 152.Such as, More euphonic sounds for this tone the most decisive, therefore the value of its weight may be higher.Additionally, not at tone On other sounds of some signal to noise ratios more commonly；It can remain burden and have small amount value.Therefore, it would be possible to, Yong Huhuo System 100(is based on such as from the input of type matching device module 152) the big keyWeights(tone more improved adjusted of exploitation Weight) array, it can be [1 ,-1 .5 ,-.5 .8 .9 ,-1,1 ,-.8 .9 ,-.2 .5].12 big tune In each will be associated with weight array.As those skilled in the art have this specification, accompanying drawing and right to want in face of it When seeking book it will be appreciated that as, can count with reference to illustrating any document of the note relative position in tone by selecting and The weight of each array of the sound in tone adapts to ditty (or any other tone).

As shown in the 3rd frame of Figure 16, by relatively holding of the persistent period to overall paragraph (or subregion) of each note The continuous time is multiplied by " weight " of the pitch grade of the note in the tone currently analyzed for circulation, every with determine in paragraph The score of individual note.Section start at each paragraph so that point zero, then by each note of such as comparing with current pitch Score is added each other, until there is not more note in paragraph, and process loops back to start to come about next tone Analyze paragraph.The result of the major cycle of this process is each tone of the total of all scores of each note in reflection paragraph Single tone score.In last frame of the process of Figure 16, the tone with top score will be selected as BestKey (optimal tone) (that is, the most suitable for paragraph).As the skilled person will appreciate, different tones may break into Draw or there is the most similar score substantially to tie.

In one embodiment, it is possible to use following formula determines the pitch grade of the note in tone, by Figure 17 Value " index(index) " represent: index :=(note.pitch key+12) % 12, wherein, note.pitch table Show the numerical value that the specific pitch with musical instrument is associated, wherein it is preferred to, this numerical value is to assign by the order increasing pitch.Lift As a example by piano, it has 88 tones, and each tone can be associated at interior numerical value containing 1 and 88 with between 1 and 88.Such as, Tone 1 can be that A0 is double steps on A, and tone 88 can be the 8th octave of C8, and tone 40 can be central authorities C.

It is expected that improve the precision that music tone determines compared with the precision utilizing aforementioned manner to realize.Expecting this Kind improve precision in the case of, subregion scoring device 1702(or alternatively, harmony device 146(is discussed below)) may determine that Whether each in the most probable tone in 4, top (being determined that method (being described above) determines by initial key) have one or Multiple big tune or ditty pattern.When those skilled in the art have this specification in face of it it will be appreciated that as, may sound Under number the biggest then process demand this understanding the biggest adjusted, it may be determined that any number of the big of possible tone is adjusted or ditty pattern To realize the improvement in key signature precision.

Music source 2404 can be played by main by being fed to subregion scoring device 1702(or in certain embodiments Be fed into harmony device 146) note perform interval distribution and carry out following determining: whether each in tone may have one Individual or multiple big tune or ditty pattern.As shown in fig. 16,12x12 matrix is used to perform the distribution of this interval, each to reflect Possible pitch grade.Initially, the value in this matrix is set to 0.Then, for each note in this series of note to sound Symbol transfer, is added to the meansigma methods of the persistent period of two notes by pitchClass(pitch grade) first note: Any matrix value being pre-existing in that the position of pitchClass the second note definitions preserves.If it is therefoie, for example, this one is Row note is:

Note	E	D	C	D	E	E
							Persistent period	1	0.5	2	1	0.5	1

This will obtain the matrix value described in Figure 16 A.Then, it is distributed (such as following institute in conjunction with the distribution of big tuning journey and ditty interval Discuss) use this matrix, to calculate little mediation and to be in harmonious proportion greatly.Each being in harmonious proportion in the distribution of ditty interval big is 12x12 square Gust, it comprises each possible pitch grade as the matrix of Figure 16 A, and wherein, each index of matrix has between-2 and 2 Integer value, be weighted with the value to the various pitches in each tone.As the skilled person will appreciate, sound Value in journey distribution can be configured so that integer-valued different sets, to realize different tone distribution.Show in fig. 16b One of the value of big tuning journey distribution may set, and in Figure 16 C, show that one of the value that ditty interval be distributed may collect Close.

It is then possible to calculate little mediation and be in harmonious proportion greatly as follows:

1. little mediation and big mediation are initialized as 0；

2., for each index in note transfer array, integer value is multiplied by its correspondence in ditty interval distribution matrix Value in position；

3. each product is added to existing (running) little mediation；

4., for each index in note transfer array, the value stored is multiplied by it in big tuning journey distribution matrix Correspondence position；And

5. product is added to existing big mediation.

After completing these product read group total for each index in matrix, will be in harmonious proportion greatly and the value of little mediation Compare with the score of multiple most probable tones being assigned to be determined by initial key symbol, and carry out about which Individual tone/mode combinations is optimal determination.After completing these product read group total for each index in matrix, will The value of big mediation and little mediation is multiplied by its index of homography in each interval is distributed.Subsequently, these sum of products structures The final of probability becoming the note of given set to be in this pattern is evaluated.Interval is for the example illustrated in Figure 16 A, right In c major pattern (Figure 16 B), we will have: (1.25 * 1.15)+(1.5 * .08)+(.75 * .91)+ (.75 * .47) + (.75 * -.74) = 1.4375 + .12 + .6825 + .3525 + (-.555) = 2.0375。 Therefore, for c major, example melody will obtain the score of 2.0375.

But, then, in order to determine that whether this pattern is the value of ditty, it would be desirable to by ditty interval distribution shifts to phase To in ditty.Reason for doing so is that: interval distribution is set with by the keynote of this pattern (not being the fundamental tone of key signature) It is considered as our first row and the first row.What we can be interpreted as by checking that potential music understands this is genuine. Any given key signature can be big tune or ditty.Such as, compatible with the key signature of c major big mode transfer formula is that C is big Mode transfer formula.The ditty pattern compatible with the key signature of c major is that A(is natural) ditty pattern.Due to when considering C ditty pattern Time, the transfer from C to C of the upper left corner numeric representation in our ditty interval, all indexes therefore compared will be shifted 3 Step-length (or more specifically, 3 arranging and downward 3 row to the right), this is due to the keynote/fundamental tone relative to big tone character number, little tone character Number downward 3 semitones of keynote/fundamental tone.Once it is shifted 3 step-lengths, the left side in A ditty pattern, in our interval distribution Upper angle numeric representation transfer from A to A.Figure 16 A example using us reaches the numeral (situation of the matrix after this displacement Under): (1.25 * .67)+(1.5 *-.08)+(.75 * .91)+(.75 * .67)+(.75 * 1.61)= .8375 + (-.12) + .6825 + .5025 + 1.2075 = 3.11.Then, in order to two model results are compared Relatively, it would be desirable to normalization the two interval matrix.For doing so, we simply for each matrix by all matrix values Be added together and divided by and value.It was found that adjust greatly matrix to have substantially 1.10 ratios of accumulation sum, interval, we are by us Ditty mode value be multiplied by this amount, with two model results of normalization.Interval, will is that note from our result of example Exemplary collection most probable is in A ditty pattern, and this is due to 3.11 * 1.10=3.421, and it is more than the big mode transfer of 2.0375( The result of formula).

Above-mentioned identical process will be applicable to any key signature, as long as the initial matrix of note transfer is relative to being considered Note.Therefore, using Figure 16 A as reference, if in different example compositions, the key signature considered is that F is big Adjust, then initial matrix row and column and represented by Figure 16 B and Figure 16 C interval distribution row and column will with F and with E tie Restraint rather than start with C and terminate (as shown in fig. 16) with B.

Knowing that they are desired to be within another embodiment of which music tone terminal use, user can identify this sound Adjust, in this case, will only be for a tone being selected by terminal use rather than indicated 12 tones come The process of Figure 16.In this way it is possible to judge for the single pre-tone selected with ways discussed above by user Each in subregion.

In another embodiment, it is also possible to judge subregion for string constraint.String sequence is can to wish record companion user The music constraint used when playing.Typically, the arpeggiation of the symbol that accompaniment is considered in string track, and can also include String self.Certainly, the note playing de-string is admissible, but typically, it is necessary on its musical qualities, it is sentenced Disconnected.

Figure 17,17A and 17B depict a kind of for carrying out beating to the quality of the harmony of subregion based on string sequence constraints The illustrative process divided.During Figure 17, according to this selected string by the given subregion (or trifle) with audio tracks Harmony is good much gives a mark to a selected string for each path.The string score of each note be reward and multiplier it With.In the second frame of process 1700, for each note in paragraph, variable is reset to 0.Then, by the pitch of note Relation compares with currently selected string.If note is in selected string, then multiplier is set in the of process 1700 The value of the chordNoteMultiplier arranged in one frame.If note be chord fundamental tone (such as, C be c major chord and String fundamental tone) the tri-tone music interval of three whole sounds (that is, cross over), then multiplier is set to tritoneMultiplier Value (as shown in figure 17 a, it is negative, thus indicate note the most preferably with selected string harmony).If note is above base One of sound or eight semitones (or in the case of ditty chord, higher than four semitones of fundamental tone), then multiplier is set to The value of nonKeyMultiplier (as shown in figure 17 a, it is similarly negative, thus indicate note the most preferably with selected string and Sound).Do not fall within the note in aforementioned categories and be assigned with zero multiplier, and therefore string score is not affected.Such as institute in Figure 17 B Showing, multiplier is scalable by the segment durations of the paragraph shared by current note.If note is in the beginning of paragraph, or If note is the fundamental tone of the current string selected for analysis, then award is added to string score.String score about this paragraph It it is the accumulation of this calculating for each note.Once selected by first, string is analyzed, and system 50 just can reuse process 1700 analyze string selected by other (next).Can by from the string score by each path of process 1700 each other than Relatively, and, top score will determine the string of this paragraph that is chosen so as to accompany for being best suited for this paragraph.Such as people in the art When member has this specification, drawings and claims in face of it it will be appreciated that as, two or more strings may be found Having the identical score about selected paragraph, in this case, system 50 can be come between these strings based on various selections Determine, these types selecting to include but not limited to music track.Those skilled in the art have this specification, accompanying drawing in face of it It is also understood that during with claims that the marking being set forth above is to music class prevailing in foreign music to a certain extent The problem of design alternative optimal for type.Correspondingly it is contemplated that the choosing of multiplier can be changed for different genres of music Select criterion, and/or the multiplier value of the various multiplier selection criterions being assigned in fig. 17 can be changed, with without departing from this Different musical taste is reflected in the case of bright spirit.

In another embodiment, (such as, subregion scoring device 1702 can also be for a series of specific allowed pitch value Such as semitone typical in foreign music) judge subregion.Similarly, however it is contemplated that other traditions of music (such as, Middle East Culture tradition of music) quarter step.

In another embodiment, it is also possible to based on the transfer mass between each pitch in subregion, this subregion is carried out Marking.Such as, as discussed above, it is possible to use pitch pulse detection identifies the change in pitch.In one embodiment, phase Same pitch pulse detection can be also used for identifying the quality of the pitch transfer in subregion.In one approach, system can be in order to The design being commonly understood by with the damped harmonic wave following equation of agitator general satisfaction:

Wherein,It is the non-drag angle frequency of agitator, andIt is known as the system of damping ratio to be correlated with constant.(for There is the quality on the spring of spring constant k and damped coefficient c,And.) should be appreciated that damping ratioValue determine critically damping system behavior (such as, overdamp, critical damping (=1) or underdamping).In critical damping In system, system is back to balance in the case of not vibration as quickly as possible.Usually, professional singer can be with critical resistance The response of Buddhist nun changes his/her pitch.By using pitch pulse analysis, it may be determined that pitch changing event true initial and Both quality of pitch changing.Especially, pitch changing event is inferred jump function, and the quality of pitch changing by Value determines.Such as, Figure 19 depicts damped harmonic wave agitator for three valuesStep response.Usually, value> 1 expression is relatively The voice of difference controls, and wherein, singer " searches " target pitch.Therefore,Value the biggest, then the pitch being attributed to subregion shifts It is the poorest to divide.

Figure 20 illustrates the another exemplary method given a mark for the quality that pitch is shifted.In this embodiment In, the marking of subregion may include that reception audio frequency input (process 2002)；Be converted to illustrate between pitch changing by audio frequency input The form (process 2004) of pitch event of real oscillation；The form using pitch event constructs to be had between pitch event There is the waveform (process 2006) of critical damping pitch changing；Calculate between pitch and the original audio waveform in the waveform constructed Difference (process 2008)；And calculate score (process 2010) based on this difference.In one embodiment, score can be with base The root-mean-square error having symbol between " filtered pitch " and " pitch after reconstruct ".In simple terms, terminal can be given User indicates this pitch to deviate from the how far this calculating of " preferable " pitch, this so that pitch transfer score can be become.

Above-mentioned scoring method can be utilized subregion to be given a mark for explicit reference or implicit expression reference.Explicit reference can To be existing or pre-recorded melody tracks, music tone, string sequence or note scope.Typically, when player is with another When one track as one man records, use explicit situation.Explicit situation can be analogized for judging Karaoke, wherein, there is music Reference, and it is currently in use in itself previously known melody as a reference to analyze track.On the other hand, implicit expression reference can be according to The tune of the multiple precedence records being saved in data storage 132 by track recorder 202 and calculate " target " melody (that is, system best-guess at the note that player is being intended to making).Typically, the master of song is being recorded as user Play melody and without reference to when can use (such as, the ignorant original compositions of subregion scoring device 1702 or song) during it, make Use implicit expression situation.

In the case of with reference to being implicit expression, reference can be calculated according to tune.Typically, this is to be determined by each elder generation The barycenter of the form of each in N number of subregion of the track of front record realizes.In one embodiment, form set The neomorph that barycenter is simply the average average pitch by obtaining each event in form and persistent period and constructs.This Repeat for n=1 to N.Then, obtained barycenter will be considered the implicit expression form with reference to track.Depict in figure 18 One diagram of the barycenter determined for single note by this way, wherein dotted line depicts obtained barycenter.Permissible Expect, it is possible to use additive method calculates barycenter.It is, for example possible to use the mode meansigma methods of the form set of each tune is come Replacement average is average.In either approach, calculating averagely or before average, any remote value can abandoned.This area skill It will be appreciated that can be former based on illustrate in the description when art personnel have this specification, drawings and claims in face of it Reason is developed for determining the additional option of tune barycenter, without carrying out excessive experiment.

When those skilled in the art have this specification, drawings and claims in face of it it will be appreciated that as, can So that any number of aforementioned independent solution being used for giving a mark subregion is combined, to provide the wider set considered Analysis.Each score can be provided identical or different weight.If score is given different weight, then it can be based on Particular type such as the melody that type matching device module 152 determines.Such as, in certain music type, can be played Place in individual aspect relative to the higher value of another aspect.The selection being employed which scoring method can also be by automatically Select or manually selected by user.

As shown in Figure 23, can from multiple recorded tracks any one select musical performance subregion.Synthesis Device 1704 is configured to be combined the subregion from multiple recorded tracks creating preferable track.This selection can be led to Cross graphic user interface and manually carry out, in this graphic user interface, user can check each version for subregion and The score of mark, carries out audition to each version of subregion, and a version is chosen as " most preferably " track.Alternatively or attached Add ground, can be by selecting the version with each track subregion of top score to come automatically based on marking design presented hereinbefore Perform the combination of subregion.

Figure 21 illustrates for using MTAC module 144 to combine with audio converter 140 single from the offer of a series of tunes Individual " most preferably " tune.In step 2102, user setup configures.Such as, user can select to be intended to for explicit reference still Implicit expression is with reference to giving a mark subregion.User can also select one or more criterion (that is, tone, melody, string, target etc.) with For subregion is given a mark, and/or provide for identifying the associated weight of each criterion or the grade of importance.Then, exist Step 2104 records tune, tune is carried out subregion by step 2106, and uses said process to incite somebody to action in step 2108 Tune is converted to form.If using RSSL module 142, then as it has been described above, at the ending of tune, track can be automatic It is circulated back to initiate, thus allows another tune of user record.Additionally, during recording, user can select to hear beat sound Rail, the track of precedence record, the MIDI version of any single track or the " mesh as described above for explicitly or implicitly reference discussion Mark " the MIDI version (see Figure 18,19,20 and 21) of track.This allows user to listen to him can to make next for it and (be hopeful to change Enter) reference of tune.

In one embodiment, terminal use can select the reference should given a mark the tune recorded for it And/or one or more method, step 2110.Such as, may indicate that should be for tone, melody, string, basis in the configuration of user Subregion is given a mark by the barycenter of one or more tracks and target morphology or any other method discussed above of constructing. Pathfinder selection can manually be carried out by user or be automatically configured by system.

The subregion of tune is given a mark by step 2112, and in step 2114, tune can be indicated to user In the instruction of marking of each subregion.This can be of value to terminal use by operations described below: provides eventually to terminal use The pitch of end subscriber or the instruction of timing sideslip wherein so that terminal use can improve in following tune.At Figure 22 In illustrate the diagram that the figure of the score for illustrating subregion shows.Especially, the vertical bar of Figure 22 depict as from The audio volume control of audio-source record, black solid line (mainly level) depicts the ideal waveform that audio-source is try to imitate, And arrow represents that how different the pitch of audio-source (such as, singer) have from ideal waveform (being referred to as explicit reference).

In step 2116, end user manual determines whether to record another tune.User desire to another tune, then This process is back to step 2104.Once terminal use has recorded all multiple tunes of track, then this process proceeds to step Rapid 2118.

In step 2118, may provide the user with about being intended to the most automatically accumulate from all tunes The selection of " most preferably " overall track.If user selects to create manual melody, then user can be the most right in step 2120 First subregion of the first tune carries out audition, next the first subregion of the second tune is carried out audition, until candidate first point Each in district is by till audition.Figure 23 illustrates the audition between each tune for promoting subregion and selection An interface, wherein, terminal use use pointer device (such as mouse) click on each subregion obtain each sound Rail is to point out the playback of this track, and subsequently, user is then by such as double-clicking expectation track and/or click and pulling expectation One of these candidate's subregions are chosen as the optimal performance of this subregion by the track 2310 that track finally collects to bottom.User's pin This process is repeated in second, third and subsequent partitions, until he reaches the ending of track.Then, in step 2124, it is System is by constructing " most preferably " track by the most bonding for selected subregion for single new track.Then, in step 2126, user is also May determine whether that recording other track plays to improve it.If user selects automatically to collect " most preferably " track, then in step In rapid 2122, score based on each subregion in each tune (preferably, use for each subregion obtain the highest Point) new track is bonded together.

The most also illustrate one of virtual " most preferably " track that the subregion from physical record track bonds together Example.In this example, last album track 2310 includes the first subregion 2302 from tune 1, from track 5 second point District 2304, the 3rd subregion 2306 from tune 3 and the 4th subregion 2308 from track 2, wherein do not use from track 4 Subregion.

Harmony device.

Harmony device module 146 realizes for being carried out with the main music tone playing source and/or string by the note from accompaniment source The process of harmony, the main source of playing can be that voice input, musical instrument (true or virtual) or user may be selectable pre-recorded Melody.One exemplary embodiment of this harmony process in accompaniment source is described in conjunction with Figure 24 and 25.Each in these figures Individual it is illustrated as data flow diagram (DFD).The figure of " stream " that these figures provide the data by information system represents, wherein, Data items flow to internal data memory or external number via internal procedure from external data source or internal data memory According to place.These figures are not intended to provide relevant with the timing of process or sequence or will be that sequentially or concurrently operation has with process The information closed.The control signal and the process that are changed to output control stream additionally, input control circulated are indicated by dotted line generally.

Figure 24 depicts harmony device module 146 typically can include that conversion note module 2402, master play music source 2404, companion Play source 2406, string/tone selector 2408 and controller 2410.It is shown that conversion note module can receive from The main master playing music source 2404 plays music input and the accompaniment music from accompaniment source 2406 inputs.Master plays equal with accompaniment music Can be made up of live audio or previously stored audio frequency.In one embodiment, harmony device module 146 can be additionally configured to Accompaniment music input is generated based on the main melody playing music input.

Conversion note module 2402 can also receive music tone and/or selected string from string/tone selector 2408.Come From the control signal of controller 2410 give conversion note module 2402 indicate music output whether should based on main play music input, Accompaniment music input and/or from music tone or the string of string/tone selector 2408 and how this conversion should be processed.Example As, as set forth above, it is possible to play melody or accompaniment source or even from manually selecting of being indicated by string/tone selector 2408 from main Tone or string derive music tone and string.

Based on control signal, main music Input transformation of playing can be and string or sound alternatively by conversion note module 2402 The note of musical sound tuning sum, thus produce the output note of harmony.In one embodiment, the harmonious tone pre-build is used Input note is mapped to harmonious note by amount.In the embodiment being discussed in more detail below, control signal can be additionally configured to Indicate whether in the case of the conversion not carried out by conversion note module 2402, in accompaniment music inputs, to allow one Individual or multiple " blue note ".

Figure 25 illustrates and generally illustrates and can selected note to play sound with main by the conversion note module 2402 of Figure 24 The data flow diagram in greater detail of the process performed during happy source 2404 " harmony ".It is shown that receive at process 2502 Main music of playing inputs, wherein it is determined that the main note playing melody.In one embodiment, it is possible to use described technology is (all As, by main play music input be converted to identify its start, persistent period and pitch or its any subset or the form of combination) it One determines the main note playing melody.Certainly, in face of it, have this specification, drawings and claims such as those skilled in the art During book it will be appreciated that as, it is possible to use determine the additive method of the note independently playing melody.Such as, if main to play music defeated Enter already at midi format, it is determined that note can include extracting note from MIDI stream simply.Determining that master plays melody During note, this note is stored in main playing in music buffer 2510.At process 2504 from accompaniment source 2406(such as Figure 24 institute Show) receive the accompaniment music input proposed.Process 2504 determines the note of accompaniment and can extract MIDI note from MIDI stream (when available), music input is converted to identify its start, persistent period and pitch or its any subset or the shape of combination State, or when using those skilled in the art to have this specification, drawings and claims in face of it it will be appreciated that another kind Method.

At process 2506, the main string playing melody can be determined from the main note found music buffer 2516 of playing. Note can be analyzed or by using those skilled in the art by the same way to illustrate explicitly with Figure 17 above Another kind of method (the chord of the hidden Markov model such as, using string adapter 154 as described herein below to perform understood It is analyzed) determine the main string playing melody.Hidden Markov model can be based on herein with based on whole tone scale harmony theory The string harmony algorithm that string probability transfer matrix is discussed explicitly is to determine most probable string sequence.In the method, will be to tuning up It is multiplied by the probability from previous string to the transfer of current string with the probability of the trifle of melody correctly harmony, and then finds optimal Path.Timing and the note self (except other may consider in addition to (such as type)) of note can be analyzed, to determine master Play the current string of melody.Once this string is determined, is just transferred to its note convert note 2510 to wait by control signal From controlling the possible selection that harmonic tone 2514 is carried out.

At the process 2508 of Figure 25, it may be determined that the main music tone playing melody.In one embodiment, above with reference to The process that Figure 16 describes is determined for the main tone playing melody.In other embodiments, it is possible to use include hidden Ma Erke The statistical technique of the use of husband's model etc. determines independently plays the music tone of the note of storage in music buffer.Such as ability When field technique personnel have this specification, drawings and claims in face of it it will be appreciated that as, similarly it is contemplated that really Determine the additive method of music tone, include but not limited to the combination of the use of process 1600 and statistical technique.Process 2508 defeated Go out is to one of many inputs converting note 2510.

Process 2510(Figure 25) " conversion " be used as accompaniment note.The change of the accompaniment music note input in process 2510 Change and determined by the output of (discussing the most in considerable detail) control harmonic tone 2514.Output based on control harmonic tone 2514, Conversion note process 2510 can following every between select: note that (a) inputs from process 2504 (its in fig. 24 It is illustrated as receiving accompaniment music input from accompaniment source 2406)；(b) from string one or more notes (its in fig. 24 by It is shown as being received from string/tone selector 2408)；(c) from the note of selected music tone (from string/tone selector 2408(is as shown in Figure 24) receive tone mark)；D () carrys out one or more notes of the string since process 2506 input (it is illustrated as playing, based on from main, note and the music tone that the note in music buffer 2516 determines)；Or (e) by mistake Journey 2508 plays, from main, the music tone that the note music buffer 2516 determines.

At process 2512, can be by the note of the note of amendment accompaniment music input and amendment accompaniment music input Timing presents the note after conversion.In one embodiment, the note presented audibly is play.Additionally or replaceable Ground, it is also possible to visually present the note after conversion.

Control harmonic tone 2514 and represent that this process is based on from controlling by converting the choosing that note is made by note process 2510 One or more inputs in the one or more sources selected and a series of decisions of making.Control harmonic tone 2514 from controller 2410 (see Figure 24) receives multiple input control signal, and it can input directly from user and (may be from graphical user's input or pre- Put configuration), from harmony device module 146, type matching device module 152 or another external procedure.Can by control harmonic tone It is to need to export note to have the user of following state and input that 2514 possible the users considered input central: (a) is limited to Figure 24 is seen via string/tone selector 2408() string that selects；B () is limited to see figure via string/tone selector 2408( 24) tone selected；(c) with seen Figure 24 by 2408() string that selects or tone harmony；D () is limited to be determined by process 2506 String；E () is limited to the tone determined by process 2508；F () plays, with from main, string or the tone harmony that note determines；(g) quilt In the range of being limited in specific sound (such as less than central authorities C, be in central authorities C two octaves in etc.)；And/or (h) is limited Make in specific sound selects (i.e. ditty, repeating etc.).

In one approach, control harmonic tone 2514 to may further include for finding that " bad sounding " note is (based on institute Chord is selected to carry out) and (snap) logic to immediate string sound of being alignd." bad sounding " note will be in correct tone In, but it is by worse for sounding on the string played.Note is classified as 3 relevant from the string of musical notes thereon different Set.This set is defined as " chordTones(string sound) ", " nonChordTones(non-string sound) " and " badTones(is bad Sound) ".All notes will be in correct tone, but they have many " bad " by having its sounding on the string played In various degree；ChordTones sounding is best, and nonChordTones sounding is the best, and badTones sounding is worse.This Outward, " stringency " variable can be defined, wherein, should have based on note and many strictly depend on string note is sorted out. These " stringency " ranks may include that StrictnessLow(stringency is low), in StrictnessMedium(stringency) and StrictnessHigh(stringency is high).For each " stringency " rank, three set chordTones, NonChordTones and badTones changes.Additionally, for each " stringency " rank, these three set all the time with following this The mode of sample is relative to each other: chordTones is the sound constituting string all the time, and badTones is by this stringency level sounding The sound of " worse ", and nonChordTones be not arbitrary set fall into a trap and remaining whole tone scale sound.Owing to string is variable , therefore can turn specifically to each stringency rank and badTones is sorted out, and can be when given specific string pair Other two set are sorted out.In one embodiment, it is used for identifying that the rule of " bad sounding " note is static, as follows:

StrictnessLow(badTones):

The big 4(being in harmonious proportion on string such as, the F on c major)；

The big liter 4(being in harmonious proportion on string such as, the F# on c major)；

Little 6(on ditty chord such as, the G# on C ditty)；

Big 6(on ditty chord such as, the A on C ditty)；And

Little 2(on any chord such as, the C# on C ditty or c major)

StrictnessMedium(badTones):

Little 6(on ditty chord such as, the G# on C ditty)；

Big 6(on ditty chord such as, the A on C ditty)；And

Little 2(on any chord such as, the C# on C ditty or c major)；

The big big 7(being in harmonious proportion on string such as, the B on C)

StrictnessHigh(badTones):

Do not fall within any note on chord (not being chordTone).

Become " bad " note and be individually not likely to be the sole basis of correction, it is possible to use be based on classical melody theory basic Counter-point logic identifies those worse for sounding within a context notes.Can also for above-mentioned stringency rank dynamically Define whether that note is aligned to the rule of chordTone.Each rank can be on the stringency level of its correspondence uses State note set definition, it is possible to determined for " stepTones(stepping sound) " further.StepTone is defined For: fall any note before chordTone and away from chordTone 2 or less semitone in time；And Fall on time after chordTone and also any note away from chordTone 2 or less semitone.Additionally, it is each Rank can apply following ad hoc rule:

StrictnessLow: for StrictnessLow, expands to away from 2 notes of chordTone by stepTones so that To or be also considered as from any note of another note (this another note to or from chordTone stepping) stepping stepTone.Additionally, any note of the badTone defined as such as StrictnessLow is snapped to chordTone( Close chordTone will be all the time at most 2 semitones of whole tone scale framework middle-range), unless note is stepTone.

StrictnessMedium: for StrictnessMedium, stepTones is not expanded in time away from The note of 2 notes of chordTones, owing to it is in StrictnessLow.To determine as such as StrictnessMedium Any note of the badTone of justice snaps to chordTone.Additionally, the heavy beat (down beat) of strong beat also will be fallen On any nonChordTone snap to string sound.Heavy beat be defined as before the later half of any beat start appoint What note or any note lasting in whole the first half of any beat.Strong beat can be defined as foloows:

For have can the rhythm of beat number (3/4,6/8,9/4) of three equal deciles, every 3rd beat after the first beat And first beat be strong beat (in 9/4,1,4 and 7)；

For can not three equal deciles and can the rhythm of two equal deciles, strong beat is the first beat and every Section 2 hereafter is clapped (in 4/4: 1 and 3；In 10/4: 1,3,5,7,9)；

For can not two or three equal deciles and the most not there is the rhythm of 5 beats (5 is special circumstances), the first beat and Hereafter every second beat in addition to beat second from the bottom is considered as strong beat (in 7/4: 1,3,5)；

If the rhythm has every 5 beats, then strong beat is considered as 1 and 4.

StrictnessHigh: any note being defined as badTone by StrictnessHigh is snapped to chordTone.But, if note is aligned to chordTone, then it will not be aligned to the 3rd sound of this string.Such as, as Fruit is alignment D on string C, then note can be aligned to C(fundamental tone) rather than E(the 3rd sound).

Being that harmonic tone is measured to another input controlling harmonic tone 2514, it substantially carrys out transformation into itself's note process 2510 Feedback path.First, " harmonic tone " is generally defined as being conducive to the sound of melodious harmony about certain basic sound.Harmonic tone May be considered as the antithing of dissonance (it includes any sound freely used, even if they are discord).Therefore, If terminal use has made control signal be restricted to via string/sound via the output note of transformation into itself's note process in future 2510 Adjust selector 2408 and the string or the controller 2410 of tone that manually select and be fed to control in harmonic tone 2514, then can Can, in output note one or more to main play music buffer 2516 for be discord.Output note is discordant Instruction (that is, harmonic tone tolerance) will be ultimately fed back to control harmonic tone 2514.Although control harmonic tone 2514 be designed to by Inherent latency in feedback and programing system and return to being forced by the conversion output note audio track that generates of note 2510 Harmonious with main music of playing, but during multiple note that is discord is expected to allow by inputting to music.It is true that allow at least one The slight crack that is discord being discord in note and the music that even made by system a bit should be easy to system 50 and makes melody relatively The most mechanical sounding form, this is that inventor is desired.

In one embodiment, it is possible to be imported into another control signal controlled in harmonic tone 2514 and indicate whether at sound Happy output allows one or more " blue note ".As mentioned above, for the purpose this specification, term " blue note " It is given and is allowed in the case of not converting as being not in correct music tone or string in Blues than it The commonly used broader implication of the note played.Except utilize the waiting time of system provide " blue note " certain Outside little insertion, it is possible to use one or more Blues accumulators (preferably, Software Coding rather than rigid line) provide blue Certain additional convolution of color note.It is therefoie, for example, an accumulator may be used for limiting the number of the blue note in single subregion Mesh, another accumulator may be used for limiting the number of the blue note in adjacent partition, and another accumulator may be used for limiting often The number of the blue note of some predetermined time intervals or the sum of note.In other words, the control via harmonic tone tolerance is humorous Following any one or more can be counted with sound: the number of blue note in the time of passage, music output, sound The number of total note in happy output, the number etc. of the blue note of every subregion.Predetermined, that automatically determine and the most true The maximum of fixed/adjustment can be preset/predetermined value by real-time programming.These values can also be by the type shadow of current melody Ring.

In one embodiment, system 100 could be included for providing the super keyboard in accompaniment music source.Super keyboard Can be physical hardware devices or generated by calculating equipment and the figure that shows represents.In any embodiment, super keyboard It is considered being manually entered of string/tune selector 2408 of Figure 24.Super keyboard preferably includes dynamic mapping everywhere Input key on the keyboard about the note in the most melodic music tone and/or string (that is, a part for string) is at least A line.Super keyboard can also include the row of input key discordant with existing melody.But, it is then possible to will be at super key On dish, the input key dynamic mapping that is discord of pressing is to the note in the music tone being in existing melody or as existing rotation The note of the string note of rule.

Illustrate an embodiment of the super keyboard according to the present invention in fig. 26.Note about standard piano illustrates Embodiment shown in Figure 26, although it is understood that, super keyboard may be used for any musical instrument.Embodiment shown in fig. 26 In, the top line 2602 of the input key of super keyboard is mapped on standard piano note；Center row 2604 is mapped to and is in existing rotation On note in the music tone of rule；And bottom row 2606 is mapped on the note being in current string.More particularly, top line is sudden and violent Having revealed 12 notes of every octave as in rule piano, center row exposes 8 notes of every octave, and the end Row exposes 3 notes of every octave.In one embodiment, the color of each input key in center row may rely on The current music tone of melody.Thus, when the music tone of melody changes, the input key of display it is chosen so as in center row Also change.In one embodiment, if musical tones of being discord is inputted from top line by user, the most super keyboard can also be instead of To be configured to automatic Playing harmonious note.By this way, player can be to reduce the most limited of his selected row Mode play music accompany to main.However, it is also contemplated that other are arranged.

Figure 27 A illustrates an embodiment of the string selector according to the present invention.In this embodiment, string selector is permissible Graphic user interface including string wheel 2700.String wheel 2700 is depicted at about the string in the most melodic music tone.? In one embodiment, the string that string wheel 2700 display is derived from the current music tone selected.In one embodiment, currently select Music tone determined by melody, as discussed above.Additionally or alternatively, string wheel outermost concentric circular provide for Select the mechanism of music tone.In one embodiment, user can be by from string wheel 2700 selection string, via string/tone choosing Select device 2408 to input string.

In one embodiment, string wheel 2700 depicts seven relevant to the music tone currently selected string: three big Mediation string, three ditty chords and a diminished.In this embodiment, diminished is positioned at the center of string wheel；Three ditties Chord is around diminished；And three big mediation strings are around three ditty chords.In one embodiment, player is enable to make Selecting music tone with outermost concentric circular, wherein, string wheel each in seven strings described is by selected music tone Determine.

Figure 27 B illustrates another of the string selector at the particular moment during the operation of system 50 according to the present invention can Can embodiment.In this embodiment, this string selector can include that string spends 2750.As string wheel 2700, string spends 2750 descriptions At least subset at the string fallen musically in the current music tone of current audio track.Further, string spends 2750 also to indicate The string currently played.In example shown in Figure 27 B, tone is that c major is (as can be from petal and in center Including the big mark being in harmonious proportion string and ditty chord determine), and the string currently played is by the string instruction described in center, This string is c major in illustrated playback duration.String spend 2750 be arranged to provide about any described string immediately The visual cues of the probability after the current string played.As described in Figure 27 B, most probable chord is carried out from currently drilling The c major played is to the big tune of G, and the most most probable carrying out will be the big tune of F, and then probability is A ditty.In the sense that, Any string by the tight probability that the probability following another is not in mathematical meaning, but specific in specific music type and The general design of the frequency that string is carried out.If those skilled in the art are when it is in front by this specification, drawings and claims As it will be appreciated that, when master plays the calculating that track obtains different string, then string spends 2750 will change.Such as, for example, master plays Next subregion of music track by actual be defined as with fall the big phase modulation of B corresponding, then the center of this flower has flat by illustrating Capitalization B.And then, it is during this is carried out that another string found in the tone of c major " will rotate " to indicating any specific string around fall B Next relative possibility layout in.

Track shared device module.

The figure of the system 100 being back in Figure 1A, track shared device module 148 can realize the track of system 100 or many The transmitting of track record and reception.In one embodiment, can be from remote equipment or server transmission or receive this track. The shared relevant management that track shared device module 148 can also carry out to track operates, and such as realizes paying and accounting information Account Logon and exchange.

Sound searcher module.

Sound searcher module 150(illustrates the most in figure ia) can realize and find the track of precedence record or many tracks The operation that record is relevant.Such as, based on audible input, sound searcher module 150 may search for the similar track of precedence record And/or many tracks record.Particular device 50 or other networked devices or server can be performed this search.It is then possible to The result of this search is presented via this equipment, and can be with subsequent access, purchase or otherwise obtain track or multitone Rail record is to be used on equipment 50 or to be otherwise used in system 100.

Type matching device module.

Type matching device module 152(illustrates the most in figure ia) it is configured to identify string sequence public for music type Row and beat are distributed.That is, user can input or select particular type or have the class associated with type matching device module 152 The exemplary band of type.It is then possible to had of the indicated type of each generated audio tracks by application Or multiple feature performs the process for each recorded track.Such as, if " jazz " is designated as expectation by user Type, then can apply the quantization of recorded audible input so that the timing of beat can trend towards being split.Additionally, from The obtained string that audible input generates can include the one or more strings being associated traditionally with jazz music.Additionally, The number of " blue note " can be higher than the number that will allow in for example classical section.

String adapter module.

String adapter 154 provides pitch chord related service.Such as, string adapter 154 can perform monophonic track Intelligent sound height corrects.This track can be derived from audible input, and pitch correction can include the frequency of amendment input Rate is to be directed at the pitch of audible input with certain predetermined frequency.String adapter 154 can also build and improve previously remembering The existing melodic accompaniment that many tracks record of record includes.

In one embodiment, the string that string adapter 154 can be additionally configured to based on previously playing carrys out Dynamic Recognition sound Frequently the probability of the most following string of track.Especially, in one embodiment, string adapter 142 can include the data of music Storehouse.Then, use hidden Markov model to combine with this data base, can come really based on the previous string occurred in audio tracks The probability that fixed following chord is carried out.

Network environment.

As discussed above, equipment 50 can be any equipment being able to carry out said process, and need not be networked to any its His equipment.But, Figure 28 is shown in which to implement the parts of a possible embodiment of the network environment of the present invention.It is not All parts are all to implement required for the present invention, and without departing from the spirit or scope of the present invention, Ke Yizuo Go out the modification in the layout of parts and type.

It is shown that the system 2800 of Figure 28 includes LAN (" LAN ")/wide area network (" WAN ") (network) 2806, wireless network 2810, client device 2801-2805, music network equipment (MND) 2803 and peripheral input/output (I/ O) equipment 2811-2813.Any one or more in client device 2801-2805 can be by equipment 100 as above Composition.Certainly, although illustrating some examples of client device, but it is to be understood that the network disclosed in Figure 28 upper Hereinafter, client device 2801-2805 may be configured to process audio signal and by network (such as network 2805, nothing Gauze network 2810 etc.) send audio frequency related data substantially any calculating equipment.Client device 2803-2805 can also include It is configured to portable equipment.Therefore, client device 283-2805 may be configured to be connected to another calculating equipment also The substantially any portable computing device of reception information.This equipment includes such as cell phone, smart phone, display paging Machine, radio frequency (RF) equipment, infrared (IR) equipment, PDA(Personal Digital Assistant), handheld computer, laptop computer, wearable Computer, tablet PC, by the portable set of the one or more integrated equipments being combined in aforementioned device etc.. Thus, typically, client device 2803-2805 is extensively varied for ability and feature.Such as, cell phone can have There is numeric keypad and can only show several row of monochrome LCD display of text thereon.In another example, there is web ability Mobile device can have multiple point touching sensitivity screen, stylus and the color LCD of both text and figure can be shown wherein The several rows of display.

Client device 2801-2805 can also include can by network communicate with send and reception include track Information and social network information are at interior information, the substantially any calculating equipment that performs audible generation track search inquiry etc.. The set of this equipment can include typically using such as personal computer, multicomputer system, based on microprocessor or The equipment that the wired or wireless communication medium of programmable consumer electronics device, network PC etc. is attached.An enforcement In example, at least some in client device 2803-2805 can be operated by wiredly and/or wirelessly network.

The client device having web ability can also include being configured to receive and transmit webpage, message based on web etc. Browser application.Browser application can be configured to employing and include the substantially any of WAP message (WAP) etc. Language based on web receives and shows figure, text, multimedia etc..In one embodiment, browser application is enable to adopt With handheld device markup language (HDML), wireless markup language (wml), WMLScript, JavaScript, Standard Generalized 25 Markup language (SMGL), HTML(Hypertext Markup Language), extensible markup language (XML) etc. show and send various interior Hold.In one embodiment, the user of client device can use browser application to come and messaging clients (such as literary composition This messaging clients, email client etc.) interact to send and/or receive message.

Client device 2801-2805 can also include being configured to receiving at least one of content from another calculating equipment Other client application.This client application can include the energy providing and receiving content of text, graphical content, audio content etc. Power.This client application can further provide for identifying the information of himself, including type, ability, title etc..An enforcement In example 2, client device 3001-3005 can be by including telephone number, mobile logo number (MIN), Electronic Serial Number (ESN) Or any one in the number of mechanisms of other Mobile Equipment Identifier uniquely identifies himself.This information also can indicate that and makes shifting The content format that dynamic equipment can use.MND 108 can be sent to or other calculate in the network packet etc. of equipment and carry For this information.

Client device 2801-2805 can be configured to include enabling terminal use to sign in can be by another Client application in the user account that calculating equipment (such as MND 2808 etc.) manages.This user account such as can be joined Be set to enable terminal use to participate in one or more social networking activities, such as submit to track or many tracks record, search with Track or record, download track or record that audible input is similar and participate in Online Music community, particularly with to made Track and the sharing, comment on and discuss of many tracks record centered by Online Music community.However, it is also possible to without logging into arriving The participation to various network activitys is performed in the case of in user account.

In one embodiment, the music including melody inputs and can be passed through network by client device 2801-2805 2806 or 2810 from MND 3008 or from any other equipment based on the processor reception that can launch the input of this music.Bag Music input containing melody can the pre-recorded or live capture by MND 2808 or other this equipment based on processor.Attached Add ground or alternatively, melody can be by client device 2801-2805 captured in real time.Such as, melody generation equipment can be given birth to Become melody, and the mike communicated with one of client device 2801-2805 can capture generated melody.If music Input is captured by fact, and the most typically, system found at least one music before the music tone calculating melody and string.This Similar with the happy person played in band, wherein, accompanying music person can typically listen at least one melody to determine in contribution The music tone played before any additional music and string.

In one embodiment, happy person can interact with client device 2801-2805, to accompany melody Play, client device is considered as virtual musical instrument.Additionally or alternatively, happy person melody accompanied can sing and/ Or play an instrument (musical instrument that such as user is played) is to accompany to melody.

Wireless network 2810 is configured to couple client device 2803-2805 and parts thereof with network 2806.Wireless Network 2810 can include covering further any one in the multiple wireless subnetworks of independent self-organizing network etc., to provide The connection towards base structure of client device 2803-2805.This seed network can include mesh network, WLAN (WLAN) network, cellular network etc..Wireless network 2810 may further include connected by wireless radio links etc. terminal, The autonomous system of gateway, router etc..These adapters can be configured to freely and at random move and arbitrarily organize himself, The topology making wireless network 2810 can quickly change.

Wireless network 2810 can use for cellular system, WLAN, wireless router (WR) netted etc. many further Plant access technology, access including 2nd generation (2G), the 3rd generation (3G), the 4th generation (4G) radio.Such as 2G, 3G, 4G and following access The access technology of net etc can realize (such as, having various degrees of ambulant client device for mobile device Wide area 2803-2805) covers.Such as, wireless network 2810 can be by such as global system for mobile communications (GSM), general The radio of packet radio service (GPRS), enhanced data gsm environment (EDGE), WCDMA (WCDMA) etc. Network insertion realizes dedicated radio link.Substantially, wireless network 2810 can include that information can be so as at client device Mutual any wireless communication mechanism that 2803-2805 and another calculating are propagated between equipment, network etc..

Network 2806 is configured to the network equipment and other meters including MND 2808, client device 2801-2802 Calculation equipment couples, and coupled to client device 2803-2805 by wireless network 2810.Make network 2806 can use use It is sent to any type of computer-readable medium of another electronic equipment from an electronic equipment in impassioned information.Additionally, net Network 106 can include the Internet, and Local Area Network, wide area network (WAN), is directly connected to (such as pass through USB (universal serial bus) (USB) port), the computer-readable medium of other forms or its any combination.Include based on different frameworks and agreement LAN closes at interior lan interconnection collection, and router serves as the link between LAN, enables message to send to another from a LAN LAN.Additionally, typically, the communication link in LAN includes twisted-pair feeder or coaxial cable, and the communication link between network is permissible Utilize analog phone line, include the whole of T1, T2, T3 and T4 or fragment special digital circuit, Integrated Service Digital Network(ISDN) (ISDN), DSL (DSL), include satellite link wireless link or well known by persons skilled in the art other Communication link.Additionally, remote computer and other associated electronic devices can be remote via modem and temporary telephone link It is connected to LAN or WAN to journey.Substantially, network 2806 includes that information can be so as to any communication propagated between computing devices Method.

In one embodiment, client device 2801-2805 can such as use equity configuration directly to communicate.

Additionally, typically, communication media embodies computer-readable instruction, data structure, program module or other transmission Mechanism also includes any information delivery media.As example, communication media include wire medium (such as twisted-pair feeder, coaxial cable, Optical fiber, waveguide and other wire mediums) and wireless medium (such as sound, RF, infrared and other wireless mediums).

Various ancillary equipment including I/O equipment 2811-2813 can be attached to client device 2801-2805.Multiple spot Touch pressing plate 2813 to be physically entered from user's reception and distribute as USB peripheral device, while not limited to USB, and And other interface protocols can also be used, include but not limited to ZIGBEE, BLUETOOTH etc..Outside by pressing plate 2813 The data of such as midi format can be included, although other can also be transmitted by this connection with the data of interface protocol transmission The data of form.Similar pressing plate 2809 can alternatively with client device (such as mobile device 2805) entity set Become.Earphone 2812 can be attached to audio port or other wired or wireless I/O interface of client device, it is provided that exemplary Arrange playback cycle and other audible output of system listening to recorded track for user.Mike 2811 can also It is attached to client device 2801-2805 via audio input port or other connections.Alternatively or except earphone 2812 and wheat Outside gram wind 2811, other speakers one or more and/or mike can be integrated into client device 2801-2805 or its In one or more in he ancillary equipment 2811-2813.Additionally, ancillary equipment can be connected to pressing plate 2813 and/or visitor Family end equipment 101-105, sample sound, waveform, signal or the input of other music that can be reproduced by external control with offer External source.This external equipment can be MIDI equipment, and client device 2803 and/or pressing plate 2813 can be to this MIDI Equipment route midi event or other data, to trigger the playback of the audio frequency from external equipment 2814.But, in addition to MIDI Form can be used by this external equipment.

Figure 30 shows an embodiment of the network equipment 3000 according to an embodiment.The network equipment 3000 can wrap Include than the shown many many of parts or the parts that reduce a lot.But, shown parts be enough to open for implementing the present invention Illustrative embodiment.The network equipment 3000 can represent the MND 2808 of such as Figure 28.In short, the network equipment 3000 is permissible Allow the user to send and receive between different accounts appointing of track and track information including network 2806 can be connected to What calculates equipment.In one embodiment, between different client devices, also perform the distribution of this track or share, these visitors Family end equipment can be managed by different user, system manager, commercial entity etc..Additionally or alternatively, the network equipment 3000 so that made tune can be shared with client device 2810-2805, including melody and harmony.At one In embodiment, also performing this melody or tune distribution between different client devices or share, these client devices can To be managed by different user, system manager, commercial entity etc..In one embodiment, the network equipment 3000 also operates with pin Melody from a series of music tones and/or string is automatically provided similar " most preferably " music tone and/or string.

The various network equipment can be included as the equipment that the network equipment 3000 carries out operating, include but not limited to individual calculus Machine, desk computer, multicomputer system, based on microprocessor or programmable consumer electronics device, network PC, service Device, network apparatus etc..As shown in Figure 30, the network equipment 3000 includes processing unit 3012, video display adapter 3014 and Mass storage, all communicates with one another via bus 3022.Mass storage generally comprises RAM 3016, ROM 3032 and Individual or multiple permanent mass storage device, such as hard disk drive 3028, tape drive, CD-ROM driver and/or disk drive Device.Mass storage storage is for controlling the operating system 3020 of the operation of the network equipment 3000.Can use any general Operating system.Additionally provide the basic input/output (" BIOS ") of low-level operation for controlling the network equipment 3000 3018.As shown in Figure 30, the network equipment 3000 can also lead to the Internet or certain via NIU 3010 Communication network communicates, and NIU 3010 is configured to together with the various communication protocols including ICP/IP protocol make With.NIU 3010 sometimes referred to as transceiver, transceiver or NIC (NIC).

Mass storage as above illustrates another type of computer-readable medium, i.e. computer-readable Storage medium.Computer-readable recording medium can be included in any method or technology and realize for storing such as computer The volatibility of the information of instructions, data structure, program module or other data etc, non-volatile, removable and can not Removal medium.The example of computer-readable recording medium includes RAM, ROM, EEPROM, flash memory or other memory technologies, CD- ROM, digital versatile disc (DVD) or other optical memories, cartridge, tape, disk memory or other magnetic storage apparatus or Person can be used for any other medium storing expectation information and can being accessed by calculating equipment.

It is shown that data storage 3052 can include data base, text, electrical form, file, file Deng, it can be configured to maintain and storage user account identifier, e-mail address, IM address and/or other networks ground Location；Group identifier information；The track being associated with each user account or many tracks record；For sharing track and/or record Rule, accounting information；Etc..In one embodiment, at least some in data storage 3052 is also possible to be stored in On another parts of the network equipment 3000, include but not limited to cd-rom/dvd-rom 3026, hard disk drive 3028 etc..

Mass storage also stores program code and data.One or more application 3050 are loaded into massive store Run in device and in operating system 3020.The example of application program can include code converter, scheduler, schedule, number According to library, word processing program, HTTP program, customizable user interface program, IPSec application, encipheror, safe journey Sequence, SMS message server, IM message server, e-mail server, account manager etc..Web server 3057 and sound Happy service 3056 is also used as applying the application program in 3050 to be included.

Web server 3057 represents that be configured to network is supplied to another calculating equipment by the content including message Any one in multiple service.Therefore, web server 3057 includes such as web server, FTP (FTP) service Device, database server, content server etc..Web server 3057 can use include but not limited to WAP, HDML, WML, In the multiple format of SMGL, HTML, XML, cHTML, xHTML etc. any one, the content including message is provided by network. In one embodiment, web server 3057 can be configured with family and be able to access that and manage user account and shared sound Rail and many tracks record.

Music service 3056 can provide the various functions relevant to realizing Online Music community, it is possible to farther includes Music adapter 3054, rights manager 3058 and melody data.Music adapter 3054 can mate similar track with many Track record, including those stored in data storage 3052.In one embodiment, this coupling can be set by client Standby upper sound searcher or MTAC request, this sound searcher or MTAC can such as provide audible input to be mated, sound Rail or many tracks.Rights manager 3058 enables the user being associated with account to upload track and many tracks record.This sound Rail and many tracks record can be stored in one or more data storage 3052.Rights manager 3058 can be further Allow users to provide for the track provided and the control of the distribution of many tracks record, such as based in Online Music community Relation or the restriction that uses of the expection of member identities, payment or track or many tracks record.Use rights manager 3058, User, it is also possible that there is right to access to be limited to stored track or many tracks record, is enable to believe user In the case of not having community comments, the record being not fully complete or other ongoing work is stored before it is ready.

Music service 3056 can with trustship single or multiplayer or otherwise make single or multiplayer energy Enough by each member of Online Music community and play between these members.For example, it is possible to set in musical recording industry Put by multi-user's RPG (Role-playing game) of music service 3056 trustship.User can select its personage typical for this industry Role.Then, game user can with validity period client device 50 and such as RSLL 142 and MTAC 144, pass through music Creation make its personage progressive.

Messaging server 3056 can include being configured and disposed to forwarding from message user agent and/or other The message of message server or substantially any one or more calculating units of delivery message.Therefore, messaging server 3056 can include that message transmits manager, and this message transmits manager for using any one in multiple messaging protocol Transmit message, these messaging protocol include but not limited to SMS message, IM, MMS, IRC, RSS feed, mIRC, multiple literary composition Any one in any one or other type of messages multiple in this messaging protocol.In one embodiment, message is received Send out server 3056 can allow the user to initiate and/or otherwise carry out chat sessions, VOIP session, text message receipts Send out session etc..

Although it should be noted that, the network equipment 3000 is illustrated as single network equipment, but the invention is not restricted to this.Example As, in another embodiment, the music service etc. of the network equipment 3000 may reside in a network equipment, and the number associated May reside in another network equipment according to memorizer.In another embodiment, various music and/or message forward operation possible Reside in the one or more client devices operated with equity configuration etc..

Game environment.

In order to promote creation and the synthesis of music further, Figure 31-37 illustrates provides interface as right wherein The user interface of above-mentioned music album instrument.By this way, it is believed that user interface is bound to arouse fear less, more user is friendly Good, in order to minimize any interference of creative music process with terminal use.As will from discussed below apparent As, interface provides the visual cues and labelling being associated with said one or multiple function aspects, with simplification, essence Letter and excitation music album process.This makes terminal use's (about this embodiment, also referred to as " player ") can utilize specialty matter Professional quality music created by amount instrument, has music theory or the operating aspect of musical composition instrument without these users Any Professional knowledge.

Turn first to Figure 31, it is provided that an exemplary embodiment of the first display interface 3100.In this interface, permissible To player's offer from operating room's view of the angle of the music producers being sitting in after audio mixing plate.In the embodiment of Figure 31, so After, in the background room, three different operating rooms is visualized: master plays voice/musical instrument room 3102, percussion instrument room 3104 and accompaniment room 3106.As managed when those skilled in the art have this specification, drawings and claims in face of it As solution, the number in room can be greater or lesser, can segment by different way the function that provides in each room and/ Or additional option can be provided in a room.Each in three rooms described in Figure 31 can include one or more Happy person " incarnation ", this happy person " incarnation " provide illustrate the character in this room and/or the visual cues of purpose and provide about by " incarnation " and the type of music, style and/or the nuance of multiple instrument playing that are utilizing the other clue of performance. Such as, in the embodiment shown in Figure 31, main voice/musical instrument room 3102 of playing includes female pop singer, room 3104 of accompanying Including rock and roll drummer, and room 3106 of accompanying includes rural area violinist, rock and roll bass player and Chinese musical telling key shelf Instrumentalist.As will be discussed in more detail below, in conjunction with other aspects at game environment interface, the selection of happy person's incarnation Providing visual interface easy to understand, by this interface, above-mentioned various instruments can be easily by most of novice end User realizes.

For the music that begins creation process, player can select one of these rooms.In one embodiment, user can be direct Mouse or other input equipments is used to simply choose room.Alternatively, it is possible to provide relative with room, various operating room The one or more buttons answered.Such as, in the embodiment shown in Figure 31, the main selection playing room buttons 3110 can be by player Being transferred to master and play voice/musical instrument room 3102, player can be transferred to percussion instrument by the selection of percussion instrument room buttons 3108 Room 3104；And player can be transferred to room 3106 of accompanying by the selection of room buttons 3112 of accompanying.

As shown in Figure 31, it is also possible to other optional buttons are provided.For example, it is possible to provide record button 3116 and stop Button 3118 is to start and to stop by the terminal use in room, operating room 3100 via the live loop module 142 of record accompaniment (Figure 1A) record of any music made.Can provide settings button 3120 to allow player to change various setting, all as scheduled Type, bat and rhythm, the volume etc. hoped.Search button 3122 can be provided to allow the user to initiate sound searcher Module 150.Can be provided for preserving the button of the melody of (3124) and deletion (3126) player.

Figure 32 presents the main exemplary embodiment playing voice/musical instrument room 3102.In this embodiment, this work The interface in room, room has been configured as enabling terminal use to create and records one or more masters of music album playing voice And/or musical instrument track.Master plays the control spatial class that voice/musical instrument room 3102 can include that Figure 12-13 above in conjunction describes As control space 3202.Therefore, as it has been described above, control space 3202 to may include that each subregion in identified track Multiple sector indicator 3204 of (such as, music measures)；The vertical line 3206 of beat in each trifle is shown；Mark and institute Select the guitar that musical instrument (such as, by shown in instrument selector 3214(Figure 32) indicates) horizontal line of each fundamental frequency that is associated 3208；And for identifying the playback bar of the specific part of the live circulation being currently played.

In example shown in Figure 32, this interface illustrates the audio volume control 3210 of a most recorded track, greatly Generally the early stage of in the accompaniment of player, but, user can also combine sound search module 150(such as search button especially 3122(is shown in Figure 31) called) audio tracks being pre-existing in of stopping suddenly.In example shown in Figure 32, the sound recorded Frequently waveform 3210 also has been translated into the note 3212 corresponding with the fundamental frequency of guitar (as indicated by instrument selector 3214) Its form.The most like that, use and can be dragged to control the various instrument selector icons on space 3202, play Family may can select other musical instruments one or more, and this will make original audio waveform be converted into and the newly selected or additional selection The different shape of the corresponding note of the fundamental frequency of musical instrument.Player can also change the number of trifle or the number of the beat of every trifle Mesh, then, this can also make audio volume control by (quantizer 206(is shown in Fig. 2)) quantify and right with the timing of new change in time Accurate.Although it is also understood that audio volume control is converted to the form of the note being associated with musical instrument by the possible selection of player, but play Family need not do so so that can be substantially comprised in from one or more original sounds of audible input, to have it former In the audio tracks generated of beginning tone color.

As shown in Figure 32, it is also possible to the incarnation 3220 of singer is provided in the background.In one embodiment, this incarnation can With provide previously the most the specific music type defined in type matching device module 152 it can easily be understood that visually indicate.Example As, in Figure 32, singer is illustrated as pop singer.In such a case, it is possible to be associated with pop music by application One or more features perform the process of recorded track 3210.In other examples, singer can be illustrated as growing up Male, young men or girl, barbershop quartet, opera or Broadway songstress, rural area western star, rap music person, English Human relations invasion rock player, balladeer etc., have obtained by people are generally understood as being associated with each type of singer Pitch, rhythm, pattern, music quality, tone color, apparent mass, harmony etc..In one embodiment, in order to provide additional amusement Value, singer's incarnation 3220 can be programmed to as even synchronously related to this incarnation in record accompaniment with music track Dance like that and otherwise take action.

Master plays voice/interface, musical instrument room 3102 and may further include track selector 3216.Track selector 3216 Allow users to record or create multiple master play tune and select in these tunes one or more to be included in music album In.Such as, in Figure 32, it is illustrated that by three track windows that label is " 1 ", " 2 " and " 3 ", each of which shows right Answer the miniature expression of the audio volume control of track, to provide the visual cues about the audio frequency being associated with each track.Each sound Track in rail window can represent the audio frequency tune recorded discretely.It should again be understood, however, that audio tracks can be created Copy, in this case, each track window can represent the different instances of single audio volume control.Such as, track window " 1 " Can represent the voice version do not changed of audio volume control, track window " 2 " can represent such as to be converted into and is associated with guitar The audio volume control of form of note, and track window " 3 " can represent and be such as converted into the note that is associated with piano The identical audio volume control of form.As managed when those skilled in the art have this specification, drawings and claims in face of it As solution, it is not necessary to there is the specific restriction of number to the track that can keep on track selector 3216.

Provide track selection window 3218 enable players to by such as select in three track windows one or Multiple and to be dragged to selection window 3218 one or more to be included in music album to select in track.At one In embodiment, it is single to generate from multiple tunes " 1 ", " 2 " and " 3 " that selection window 3218 can be also used for engaging MTAC module 144 Individual optimal tune.

Main voice/interface, musical instrument room 3102 of playing could be included for realizing playing voice or musical instrument track is associated with leading Multiple buttons of one or more functions.Button 3222 is minimized to allow user to minimize grid for example, it is possible to provide 3202；Can provide sound mute that audio button 3224 allows the user to make to be associated with one or more audio tracks or Non-mute, it is provided that solo button 3226 is to make by appointing that system 100 generates based on audio volume control 3210 or its form What audio accompaniment is quiet, in order to allows player to be absorbed in and plays, with main, the problem that audio frequency is associated, it is provided that new track button 3228 allow the user to start to record new master plays track；Form button 3230 swashs on the audio volume control in controlling space 3202 Frequency detector alive and the operation of frequency shifter 208 and 210.May be provided for set of buttons allow the user to arrange with reference to sound with Help to provide voice track.Therefore, switching sound button 3232 can enable and disable with reference to sound, and sound upwards button 3234 can carry The frequency of high reference sound, and sound down button 3236 can reduce the pitch with reference to sound.

Figure 33 illustrates an exemplary embodiment in percussion instrument room 3104.The interface in this room is configured to make object for appreciation Family can create and record one or more percussion instrument tracks of music album.Interface, percussion instrument room 3104 includes with upper Face controls space as combining the control spatial class that Figure 14 describes.Therefore, this control space may include that grid 3302, represents The playback separating sound in one or more percussion instrument tracks and timing；Playback bar 3304, is used for identifying and currently broadcasts The specific part of the live circulation put；And multiple subregion (1-4), it is divided into multiple beat, the wherein each frame in grid 3306 represent that (wherein, non-shadow frame indicates does not has the sound will be at this for the timed increase of the sound being associated to relevant percussion instrument It is played at incremental time, and dash box instruction to be play at this incremental time and to be associated to relevant idiophonic tone color Sound).

May be provided for percussion instrument segment selector 3308, enable players to create and select multiple percussion instrument to divide Section.In example shown in fig. 33, illustrate only the subregion of single percussion instrument segmentation " A ".But, by selecting percussion music Device segment selector 3308, can create additional segments and identify as segmentation " B ", " C " etc..Then, player can be often Different percussion instrument sequence is created in each subregion of individual different segmentation.It is then possible to arrange that created divides in any order Section, in order to create percussion instrument track with a greater variety to be used in music album.Such as, player is it may be desirable to create by following suitable The different percussion instrument tracks that sequence repeats playing: " A ", " A ", " B ", " C ", " B ", although any number of segmentation can be created also And any order can be used.In order to promote inspection and the establishment of multiple percussion instrument segmentation, it is provided that segmentation playback instruction Device 3310, visually to indicate the percussion instrument segmentation being currently played and/or editing and playing and/or editing The part of segmentation.

As diagram further in Figure 33, it is also possible to the incarnation 3320 of drummer is provided in the background.Play with combining master Player's incarnation that voice/musical instrument room 3102 describes is similar to, and drummer's incarnation 3320 can provide with previously in type Specific music type that type defined in orchestration module 152 is corresponding and playing style it can easily be understood that visually indicate. Such as, in fig. 33, drummer is illustrated as rock and roll drummer.In such a case, it is possible to be associated with rock music by application The feature of idiophonic one or more previous definition perform, for each percussion instrument, the percussion instrument sound that created The process of rail.In one embodiment, in order to provide additional amusement value, drummer's incarnation 3320 can be programmed to as may be very Dance like that to synchronously relating to this incarnation in record accompaniment with music track and otherwise take action.

Interface, percussion instrument room 3104 could be included for realizing the establishment with one or more percussion instrument tracks Multiple buttons of the one or more functions being associated.For example, it is possible to offer minimizes button 3312 and allows the user to minimum Change grid 3302, it is provided that audio button 3314 allows the user to the sound making to be associated with one or more audio tracks Quiet or non-mute, it is provided that solo button 3316 allows the user to switch between quiet and non-mute, in order to stop The playback of other audio tracks, therefore, player can focus on percussion instrument track and not divert one's attention, additional percussion instrument button 3318 add the additional consonant rail corresponding with the percussion instrument that can be selected by player, and swaying button 3320 allows user to shake Pendulum (that is, cutting) note.

Figure 34 A-C presents an exemplary embodiment at accompaniment interface, room 3106.The interface quilt in this room, operating room Being configured to player and provide music pallet, user can select and create one or more companions of music album from this music pallet Play track.Such as, as shown in Figure 34 A, musical instrument ranking selector bar 3402 can be provided to player, enable players to select For playing voice and/or the grade of musical instrument that music track is accompanied to main.In the illustrated embodiment, for selecting figure Three Estate bass 3404, keyboard instrument 3406 and guitar 3408 are shown.If those skilled in the art are in face of it When having this specification, a drawings and claims it will be appreciated that as, it is provided that any number of musical instrument grade, including multiple Musical instrument, it includes brass instrument, woodwind instrument and stringed musical instrument.

For diagrammatic purposes, let as assume that player has selected the bass grade 3404 in Figure 34 A.In this feelings Under condition, then, in the middle of one or more happy person's incarnation, carry out selecting to play the option of musical instrument accompaniment to player's offer.Example As, as shown in Figure 34 B, can provide rural happy person 3410, between rock music person 3412 and rap music person 3414 to player Carrying out the option selected, player may then pass through and clicks directly on expectation incarnation to carry out this selection.Certainly, although illustrating three Individual incarnation, but player can be allowed to select between more or less selection.May be provided for arrow 3416, so that playing Family can roll through incarnation and select, especially in the case of providing the selection of more incarnation.

After happy person's incarnation in have selected Figure 34 B, then can provide the option selecting particular instrument to player.Example As, let us currently assumes that player has selected rural happy person.As shown in Figure 34 C, then player can be given at electricity low Carrying out the option selected in the middle of sound guitar 3418, upright bass 3420 or acoustical bass guitar 3422, player is the most permissible This selection is carried out by clicking directly on expectation musical instrument.May be provided for arrow 3424 to enable players to roll through musical instrument choosing Select, when those skilled in the art have this specification, drawings and claims in face of it it will be appreciated that as, this musical instrument selects Select the bass that may be not limited to only three types.Certainly, although in above-mentioned sequence, selected before selecting happy person's incarnation Musical instrument grade, but it is envisioned that the option selecting happy person's incarnation before selecting musical instrument grade can be provided to player.Similar Ground, it is also contemplated that the option selecting particular instrument before selecting happy person's incarnation can be provided to player.

After player has selected happy person's incarnation and musical instrument, system 100 creates suitable accompaniment tone by operations described below Rail: the most main play the one or more masters play in voice/musical instrument room 3102 based on current and play track and generate accompaniment tone symbol Set (even if other rooms are muted), these notes are turned by use pattern adapter module 152 and harmony device module 146 Be changed to suitable type, tone color and the music style for selected happy person and musical instrument, with one or more masters are played track carry out and Sound.Therefore, according to the musical instrument selected by player and happy person's incarnation, the accompaniment track of particular instrument can have different sound, Regularly, harmony, blue note content etc..

Accompaniment interface, room 3106 is additionally configured to enable a player to respectively in multiple happy person's incarnation and/or multiple musical instrument Each carry out audition, to help to select preferably to accompany track.Thus, once musical instrument and incarnation have been easily selected by a user and Through the accompaniment track of correspondence created as described above, just combine during live playback cycle other tracks being previously created (main play, Percussion instrument or accompaniment) automatically play accompaniment track so that and it is the best that player can evaluate new accompaniment track in nearly real time Applicable thing.Then player can select to keep this accompaniment track, selects the most happy together person's incarnation for identical musical instrument, for identical Happy person's incarnation selects different musical instrument, selects completely new incarnation and musical instrument, or deletes this accompaniment track completely.Player can also be led to Cross repeat the above steps to create multiple accompaniment track.

Figure 35 illustrates a possibility of the graphical interfaces that the chord describing to play as leading the accompaniment playing music is carried out Embodiment.In one embodiment, this figure can be started by the colored button shown in pressing Figure 34 A, 34B and 34C to use Interface, family.Especially, this interface shows that the chord being typically forced to accompany in the multiple accompaniment incarnation in room 3106 is carried out, Be limited by incarnation may be building up to its association configuration file in blue note allow (due to above with Figure 25 explicitly The type discussed and other problems).Each incarnation be also possible to that there are type or other attributes based on incarnation due to incarnation and The specific arpeggio technology (that is, the arpeggio played with sequence) being associated with incarnation.As the example of Figure 35 is described, chord Carry out be " G " big tunes, " A " ditty, " C " adjust greatly, " A " ditty, the most each string according to respectively with accompany in room 3106 Technology that each accompaniment incarnation is associated, play for whole subregion.As those skilled in the art have this theory in face of it When bright book, drawings and claims it will be appreciated that as, chord carries out can changing in single subregion string repeatedly or can To keep identical string on multiple subregions.

One of the part that Figure 36 illustrates the melody that player can create so as to identifying this player to expect or edit exemplary Interface.Such as, in the exemplary interfaces shown in Figure 36, it is provided that option clamping structure 3600, wherein, player can find pleasure in Select between bent overture section, main song section and chorus section.Of course it is to be understood that other parts of melody can also be used, Such as bridge section, finale etc..Be available to the user in specific melody editor part can be predetermined, manually selected by player Or automatically arrange based on selected music type.Similarly, various parts finally by do not know for formed melody order Can be predetermined, manually selected by player or automatically arrange based on selected music type.If it is it is therefoie, for example, new Hands user selects to create popular song, it is possible to use the expectation unit of pop is usually pre-charged with option clamping structure 3600, This expectation element generally comprises guiding, one or more main song, chorus, bridge section and final result.It is then possible to warning terminal user wound Make the music being associated with the first aspect of this overall melody.After completing the first aspect of overall melody, can be by terminal For creation on the other hand user guides.If the tone of adjacent element is different, then can respectively and/or jointly each aspect be entered Row marking is to alert terminal use.As those skilled in the art will when it has this specification, drawings and claims in front As understanding, use Standard graphical user interface manipulation technology, the part of melody, moving partially into melody can be deleted Other parts of melody, the part of copy melody and the part of subsequent modification melody etc..

As shown in Figure 36, the tab of each part of music album can also include optional icon, so that player Being capable of identify that and edit the audio tracks being associated with this part, wherein, the first row can illustrate master and play track, and the second row is permissible Illustrate accompaniment track, and the third line can illustrate percussion instrument track.In illustrated example, overture section is illustrated as bag Include: keyboard instrument and guitar master play track (respectively, 3602 and 3604)；Guitar, keyboard instrument and bass accompaniment track (respectively, 3606,3608 and 3610)；And percussion instrument track 3612.May be provided for string selector icon 3614, its The interface (such as in Figure 27 or Figure 35) of the string allowing player's change to be associated with accompaniment track is provided to player when being chosen.

Figure 37 A and 37B illustrates may be provided in and utilizes in above-mentioned graphical interfaces and the spy of storage in data storage 132 Determine an embodiment of the file structure of visual cues.Turn first to Figure 37 A, can select in graphical interfaces for player Each happy person's incarnation provide file 3700, music assets also called herein.Such as, in Figure 37 A, illustrated top Music assets are used for rap music person.In this embodiment, music assets can include that perceptual property 3704, perceptual property 3704 are marked The graphical appearance of the incarnation that knowledge to be associated with music assets.Music assets can also include being associated with music assets and by Player selects to be applied to during music assets one or more functional attributes of audio tracks or album.Functional attributes can be deposited Storage is in music assets and/or provides another file, object or the pointer of process (such as type matching device 152) or calls. Functional attributes can be configured to affect above-mentioned various setting or select in any one, include but not limited to track rhythm or The characteristic of transfer between bat, the restriction to string to be used or tone, the restriction to available musical instrument, note, music album Structure or progress etc..In one embodiment, these function assets can be based on general by relevant to the visual representation of happy person The music type of connection.Thering is provided in perceptual property in the example of expression of specific happy person, functional attributes is also based on this specific pleasure The music style of person.

Figure 37 B illustrates another set of the music assets 3706 can being associated, this musical instrument with each selectable musical instrument Can be the musical instrument (that is, guitar) of general type or concrete brand and/or musical instrument (that is, the Fender of model Stratocaster, Rhodes Electric Piano, Wurlitzer Organ).It is similar to corresponding with happy person's incarnation Music assets 3700, each music assets 3706 of musical instrument may include that perceptual property 3708, and mark is relevant to music assets The graphical appearance of the musical instrument of connection；And one or more functional attributes 3710 of this musical instrument.As above, functional attributes 3710 can be by It is configured to any one in affecting above-mentioned various setting or selecting.For musical instrument, these arrange or select to include available base Frequently, the characteristic etc. of the transfer between note.

Using the graphical tool shown in Figure 31-37 and dynamic action based on game, novice users will more easily can Enough creation specialty sounding melodies, user will be ready that sharing this specialty sounding melody with other users may listen to for player The almost identical mode of the music that business makes carries out oneself and enjoys and even entertain.Music works system in this manual The figure normal form provided in the context of system will about multiple creative plan with make great efforts be suitable for equally, the plan of this creativeness with Making great efforts typically to be performed by professional, this is owing to the most necessary skill level of the most dull product of making will be the highest And for ordinary people inaccessible.But, can also the most easily make by simplifying routine tasks, even novice users Become specialty rank plan.

Present cache.

In one embodiment, the present invention can be realized in cloud, wherein, utilize in client-server normal form State system and method.By unloading on server by specific function, the disposal ability needed for client device reduces.This increases The present invention can be deployed in both number and the type of equipment thereon, and it is mutual that this allows with mass viewer audiences.Certainly, with visitor The degree that family end is performed function by server relatively can change.Such as, in one embodiment, it is possible to use server is deposited Storage and offer related audio sample, and perform process in the client.In alternative embodiments, server can both store phase Close audio sample before audio frequency is supplied to client, performs again particular procedure.

In one embodiment, it is also possible to via operate on a client device and be configured to server communication only Vertical should being used for performs client side operations.Alternatively, user is possible can be via http browser (such as Internet Explorer, Netscape, Chrome, Firefox, Safari, Opera etc.) access that system concurrency rises with server logical Letter.In some instances, this may need to install browser plug-in.

According to the present invention it is possible to by using audio frequency to present the spy that cache performs and/or strengthens system and method Determine aspect.More specifically, as described in more detail hereinbelow, present cache achieve to ask or identify The improvement identification of the audio parsing that note is associated, process and retrieve.As will understand from the following description, when with such as When upper described client-server normal form utilizes said system and method together, audio frequency presents cache to be had particularly Function.Especially, in this normal form, audio frequency presents cache and will be preferably stored on client-side to improve wait Time also reduces server cost, although as described below, presenting cache can also be stored remotely.

Preferably, presenting cache and be organized as n dimension array, wherein, n represents and the audio frequency phase presented in cache Associate and for organizing multiple attributes of the audio frequency presented in cache.Figure 38 illustrates and presents height according to the present invention One exemplary embodiment of speed caching 3800.In this embodiment, cache 3800 is organized as 4 dimension arrays, wherein, is somebody's turn to do 4 axles of array represent: the instrument type that (1) is associated with musical tones；(2) persistent period of note；(3) pitch；And (4) speed of note.It is, of course, also possible to use other or adeditive attribute.

Instrument type can represent corresponding MIDI channel, and pitch can represent the integer index of corresponding semitone, and speed can To represent the intensity that note is played, and the persistent period can represent the persistent period of note with millisecond.Can based on this four The entry 3802 presented in cache 3800 is stored in array structure by individual attribute, and each entry 3802 can include Pointer to the memorizer distributed comprising the audio sample that cache presents.Each cache entries can also include Time (time that such as, entry is write first, its time finally accessed and/or bar that mark is associated with this entry The mesh overdue time) indicator.This permission removes the entry not accessed after the paragraph of special time period from cache. Preferably, present cache be also maintained to finite duration resolution (such as the 16th note) and consolidated in size Fixed, to allow quick braiding to index.

It is, of course, also possible to use other structures.Such as, present cache and can be maintained at different finite resolving power Place, or the most can not fixed in the case of quick braiding index is unnecessary.Can also use more or less than 4 Attribute identifies audio frequency, thus needs the array with more or less axle.Such as, it not 4 dimension arrays, but can also will scheme Entry in 38 is organized as multiple 3-dimensional array, wherein has single array for each instrument type.

Although it is also understood that array is described as presenting the preferred embodiment of cache, it is also possible to use it His memorizer is traditional.Such as, in one embodiment, each audio entry presented in cache can be expressed as based on The hashed value that relating attribute value generates.May be utilized the example system quilt using the method to promote cache systems Cache stores.By expressing audio frequency by this way, the number of relating attribute can be increased or decreased, and without to association Significantly changing of code is searched for cache entries and is identified.

Figure 39 illustrates the example data flow process utilizing this cache.As shown in Figure 39, process 3904 Execution cache controls.Process 3904 receives the request for note from client 3902, and retrieves as response and be somebody's turn to do The cache audio parsing that note is corresponding.Note request can be any request for particular note.Such as, note please Asking can be by user's note by any one identification in above-mentioned interface, the note by harmony device module identification or next From the note in any other source.It not to identify particular note, but note request can also identify and expect what note was associated Multiple attributes.Although typically mentioning with odd number, but it is to be understood that note request can relate to a series of or one group of note, its Can be stored in single cache entries.

In one exemplary embodiment, note can be appointed as MIDI " the note unlatching with the given persistent period (note on) ", return the audio sample that audio frequency encodes as pulse code modulated (PCM) simultaneously.It will be appreciated, however, that can make With any one or more attributes and to include that any labelling method of MIDI, XML etc. expresses note.Can also compress or solve The audio sample that compression is retrieved.

As shown in Figure 39, process 3904 and process 3906, process 3908 and present cache 3800 and communicate.Process 3906 be configured to identify the attributes (such as musical instrument, note unlatching, persistent period, pitch, speed etc.) of note asked and Audio available Sample Storehouse 3910 is used to present the audio frequency of correspondence.To be presented in response to the note asked by process 3906 Audio frequency is communicated back to process 3904, and audio frequency is supplied to client 3902 by process 3904, and it is also possible that the audio frequency presented is write Enter to presenting cache 3800.If the similar note of subsequent request, and the audio frequency corresponding with the note that this is asked Available in presenting cache, then process 3904 can retrieve audio frequency from presenting cache 3800, and without presenting New audio parsing.According to the present invention, and as described in more detail hereinbelow, it is also possible to be never asked note Accurately the cache of coupling presents retrieval audio sample.The audio sample that this is retrieved can be supplied to process 3908, mistake Note is reconstructed into and corresponds essentially to the note that the audio sample of asked note is substantially similar by journey 3908.Due to from Typically ratio is for presenting the process 3906 of new audio frequency faster for the process of cache retrieval and reconstruct audio frequency, and therefore this process is notable Improve the performance of system.It is also understood that can on the equipment identical with client, with client away from service Operate each element shown in Figure 39 on device or on any other equipment, including process 3904,3906 and 3908 and Present cache 3800 and Sample Storehouse 3910；And in single embodiment, various elements can be distributed in various equipment and work as In.

Figure 40 describes a kind of illustrative methods that can be used for being controlled the note that 3904 process are asked by cache.False Use 4 dimension caches as determining as shown in Figure 38, describe this illustrative methods.But, those skilled in the art are at it Can easily be adapted for the method being used together with different cache structure when having this specification in front.

In step 4002, receive the note asked from client 3902.In step 4004, determine to present and delay at a high speed Deposit whether 3800 comprise the entry corresponding with specific asked note.This can be by identifying that the note asked will be with The musical instrument (i.e. guitar, piano, saxophone, violin etc.) being associated and the persistent period of note, pitch and speed and Then determine whether to have what the cache entries accurately mated with each in these parameters realized.If it does, Then in step 4006, retrieve this audio frequency from cache and this audio frequency is supplied to client.If there is no accurately coupling, Then this process continues to 4008.

In step 4008, it is determined whether there is time enough and present new audio sample for the note asked. Such as, in one embodiment, can be configured to identify will be so as to providing the special time of audio frequency of note for client.Borrow To provide the time of audio frequency can be the preset time amount after request is made.In the embodiment using fact circulation, as above Described, to be also based on until loop ends and/or until will be in ensuing circulation so as to providing the time of audio frequency Time (or bar number) till period playback audio frequency.

In order to evaluate whether to provide in event horizon audio frequency, identify the estimating of time quantum presenting and sending note It is also compared by meter with special time boundary.This estimation can be based on many factors, including to the place generated needed for audio frequency The predetermined estimation of reason time, any overstocked or length of process queue existed when request and/or client device and offer Bandwidth between the equipment of audio frequency connects.In order to carry out this step, it can also be advantageous that, by client and cache control The system clock that system 3904 operates in equipment thereon synchronizes.If it is determined that there is time enough to present note, Then in step 4016, note is sent to presenting note process 3906, wherein, presents the audio frequency for the note asked. Once audio frequency is presented, just can also in step 4018 by audio storage in cache 3800.

However, if it is determined that there is not time enough to present note, then this process continues to 4010.In step In rapid 4010, it is determined whether " close to hit " entry can be used.For the purpose of this description, " close to hit " is following any sound Symbol: this note is substantially similar with the note asked, to such an extent as to one or more treatment technologies can be used to be reconstructed into Substantially similar with the audio sample that will present for the note asked audio sample.Can be by the note that will be asked Instrument type, pitch, speed and/or persistent period and the instrument type of the most cached note, pitch, speed and/ Or the persistent period is compared to determine " close to hit ".Owing to different musical instruments show by different way, therefore it should be understood that can The taste of putting of the entry being considered " close to hit " will be different for each musical instrument.

In a preferred embodiment, the first time search to " close to hit " entry can be along presenting cache " persistent period " axle is searched close to cache entries (that is, having the entry of identical instrument type, pitch and speed).Even more Preferably, this search (will be in and is confirmed as given musical instrument for having the persistent period more longer than the note asked In saying acceptable scope) entry, this is to generally produce ratio and add the more preferable result of long note owing to shortening note.Replaceable Ground, if or there is not acceptable entry along persistent period axle, second time search can be searched along " pitch axle " and be connect Nearly cache entries, i.e. the entry in the particular range of semitone.

In another alternative, if or there is not acceptable entry on persistent period or pitch axle, Third time search can along speed axle seeking scope close to cache entries.In some cases, in friction speed Tolerance interval may rely on the specific software for performing audio reconstruction and algorithm.Most of audio sample devices are for one Note uses the some samples being mapped to friction speed scope, and this is owing to how to be placed by force according to note, and great majority are true Real musical instrument has significant tone color difference in produced sound.It is therefore preferred that " close to hit " along speed axle will be Only different from the note asked in amplitude audio samples.

In another alternative, if or there is not acceptable entry on persistent period, pitch or speed axle, Then the 4th time search can along musical instrument axle seeking scope close to cache entries.Of course it is to be understood that this strategy may It is only limitted to produce the certain types of musical instrument of the sound similar with other musical instruments.

It is also understood that although it is preferred that identify that only different on single attribute " close to hit " entries is (to limit The amount of the process needed for system reconstruct audio sample), but " close to hit " entry can also be in persistent period, pitch, speed And/or different entry on two or more in musical instrument attribute.If additionally, multiple " close to hit " entry can be used, then Can based on any one or more in multiple factors select audio sample to be used, the plurality of factor include such as with The expectation distance (such as, being determined by the shortest Euclidean distance in " n " dimension space) of note, immediate base in array (such as, different on audio frequency audio frequency ratios is in speed in the weighting of the priority of each axle in the hashed value, array of attribute Different audio frequency is preferred, and audio frequency different in the speed audio frequency more different than on pitch is preferred, audio frequency different on pitch More preferred than audio frequency different on musical instrument) and/or speed when processing audio sample.

In another embodiment, it is possible to use composite index method identifies close to hit.In this embodiment, at a high speed Each dimension in caching folds.In one approach, this can be by the certain number of bit to each dimension Carry out folding and realize.Such as, if minimum two bits of pitch dimension are folded, then all pitch map can be arrived One of 32 values.Similarly, 3, the bottom of persistent period dimension bit can be folded.Thus, it is possible to by all persistent period It is mapped in one of 16 values.Other dimensions can be similarly processed.In another approach, it is possible to use non-linear Foldable square Method, wherein, assigns the similar sounding musical instrument with identical folding dimension values to musical instrument dimension.It is then possible to dimension will be folded Value connects to composite index, and can be stored in by cache entries in the table by composite index sequence.When note is asked When asking, associative cache entry can be identified by lookup based on composite index.In such a case, it is possible to will be with multiple All results that conjunction index matches are identified as " close to hit " entry.

If being defined as can use by " close to hit " entry in step 4010, then this process continues to 4012, its In, (by reconstruct note process 3908) reconstruct " close to hit " entry is substantially corresponding with the note asked to generate Audio sample.As shown in Figure 40, reconstruct can be performed in a number of ways.Technology described below is to provide as example , and it is to be understood that other reconfiguration techniques can also be used.Additionally, technology described below is typically known in the art Sampling and manipulation for audio frequency.Correspondingly, notwithstanding combining the present invention use to this technology, but do not describe in detail For realizing special algorithm and the function of this technology.

Reconfiguration technique described below can also be performed at any equipment in systems.Such as, in one embodiment, Reconfiguration technique can be employed or answered by the remote equipment coupleding to this cache server at cache server With, wherein, then the note of reconstruct is supplied to client device.But, in another embodiment, can be by cache sound Symbol self transmission is to client device, and then can perform reconstruct at client.In this case it is also possible to will mark Know the information of note and/or transmit to client together with cache note for performing the instruction of reconstruct.

Go to the first technology, let as assume that such as " close to hit " entry only on the persistent period with the note asked Different.If the audio sample of " close to hit " is longer than the audio sample asked, then can use " re-forming envelope " skill Art reconstructs audio sample, in this technology that " re-forms envelope ", new shorter envelope is applied to audio sample.

If the note ratio asked " close to hit " entry is long, then can stretch the non-neutralizable fraction of envelope to obtain expectation Persistent period.It is generally considered to be owing to starting (attack) and decay (decay) musical instrument is given the thing of its acoustic wave character, Therefore lasting manipulation can be stretched the persistent period in the case of having no significant effect " color " of note.This is referred to as " envelope stretching ".Alternatively, it is possible to application " circulation " technology.In the art, replace the non-neutralizable fraction of stretching audio sample, Can be with the section of circulation continuous section, to add the persistent period of long note.It should be noted, however, that randomly choose the sustained segment to be circulated Part may cause clock in audio frequency and occur suddenly.In one embodiment, this can by from a loop ends to The cross compound turbine that subsequent cycle initiates overcomes.In order to alleviate adding of any impact that can be caused and various impact by process Add, it is also preferred that cache entries is original sample, and perform at any additional digital signal after completing reconstruct Reason, the most on a client device.

If the note asked has and " close to the hit " pitch that entry is different, then can be to cache audio frequency sample Originally pitch shift is carried out to obtain suitable pitch.In one embodiment, it is possible to use FFT performs this point in a frequency domain.? In another embodiment, it is possible to use auto-correlation performs pitch shift in the time domain.It is that octave is higher at the note asked Or in the lower scene of octave, it is also possible to stretch simply or shorten cache note to obtain suitable pitch.This structure Think similar with faster or slower broadcasting magnetic tape recorder.That is, if cache entries is shortened and plays soon with twice, then The pitch of the material recorded becomes twice as height or exceeds octave.If cache entries is stretched and slowly broadcasts with half Put, then the pitch of the material recorded be halved or low go out octave.Preferably, it is applied to this technology to be in and is asked Cache entries in substantially two semitones of note, this is owing to stretching or shortening may make more than the audio sample of this amount Audio sample loses acoustic wave character.

If the note asked has and " close to the hit " speed that entry is different, then can shift in amplitude at a high speed Cache entries is to be matched with new speed.Such as, if the note asked has fair speed, then can be by cache entries Amplitude improve corresponding speed difference.If the note asked has relatively low velocity, then can be by cache bar purpose width Degree reduces corresponding speed difference.

The note asked could also belong to difference but similar musical instrument.Such as, the note asked can be at weight The particular note played on metal guitar, and cache can only include the note of crude metal guitar.In this case, may be used So that one or more DSP effects are applied to cache note, draw the note from heavy metal guitar with approximation.

After one or more in having used above-mentioned technology reconstruct " close to hit " entry, can be sent to Return to client.Instruction can also be supplied to user, have been provided with informing the user the note of reconstruct.Such as, all In the interface at interface as shown in fig. 12 etc, let as assume that note 1214 is reconstructed.In order to inform the user From this note of other audio reconstructions, this note can be illustrated in the way of different from the note presented.For example, it is possible to with its The different color of his note, hollow (with real form and aspect to) instruction of note or any other type illustrates reconstructed sound Symbol.If presenting the audio frequency (as discussed below) of note subsequently, then can change the visual representation of note with instruction audio frequency The version presented is received.

If there is not " close to hit " cache entries in step 4010, then can retrieve immediate available sound Frequently sample (as determined based on musical instrument, pitch, persistent period and Speed attribute).In one embodiment, can be from the most slow Deposit this audio sample of 3800 retrievals.Alternatively, client device can be additionally configured to store one in local storage and is Arrange general note be used in presented note and " close to hit " note of being reconstructed the most unavailable time situation in.All right This audio sample performs additional treatments, the most above-mentioned process.User interface in client can be additionally configured to Family provides following visually indicating: provide neither the audio frequency presented is not the audio frequency sample of " close to the hit " that reconstructed This.

In step 4016, to present note process 3906 make use Sample Storehouse 3910 present for the note asked The request of video.Once note is presented, and audio frequency is just back to cache and controls 3904, and cache controls 3904 by institute The audio frequency presented is supplied to client 3902, and is written to present cache by the audio frequency presented in step 4018 3800。

Figure 41 shows the embodiment for realizing presenting the framework of cache according to the present invention.As directed Like that, it is provided that server 4102, server 4102 include for the audio frequency presenting audio frequency as mentioned above present engine 4104 with And server cache 4106.Server 4102 can be configured to via communication network 4118 and multiple different clients Equipment 4108,4110 and 4112 communicates.Communication network 4118 can be to include appointing of the Internet, cellular network, wi-fi etc. What network.

In example embodiment shown in Figure 41, equipment 4108 is Fat Client, and equipment 4110 is thin-client, and Equipment 4112 is mobile client.Fat Client (the such as complete desk-top or kneetop computer characterized) typically has a large amount of available Memorizer.Thus, in one embodiment, internal hard disk drive at Fat Client (client can be illustrated as completely Cache 4114) upper maintenance presents cache.Thin-client usually has setting of the memory space fewer than Fat Client Standby.Correspondingly, can be at local hard drive (being illustrated as client cache 4116) and server cache Split thin-client between 4106 presents cache.In one embodiment, most frequently used note can be local On a hard disk drive, and the note less frequently used can be cached on server cache.Mobile client End (such as cell phone or smart phone) typically has the memorizer less than Fat Client or thin-client.Therefore, it can Entirely maintain mobile client on server cache 4106 presents cache.Certainly, these clients are as showing Example and provide, and it is to be understood that any one in above-mentioned configuration may be used for any kind of client device.

Figure 42 shows another embodiment for realizing presenting the framework of cache according to the present invention.In this example In, multiple edge cache server 4102-4106 can be provided and position to serve various geographical position.Each visitor Family end equipment 4108,4110 and 4112 then can with closest to its geographical position edge cache server 4102, 4104 and 4106 communicate, to reduce the transmission time needed for obtaining the audio sample of cache.In this embodiment, as Really client device requests be not previously cached in the note of the audio frequency on client device, then carry out about respective edges Whether cache server includes the audio frequency for the note asked or the determination of " close to hit " for this note.As Really it includes, obtains and/or reconstructs audio sample the most respectively, and this audio sample is supplied to client.If this high speed Cache entries is unavailable, then audio sample, server 4102(can be asked to retouch explicitly according to Figure 40 from server 4102 The process stated) cache entries (accurately coupling or " close to hit ") can be provided or present note.

Figure 43 illustrates a reality of the signal sequence between the client from Figure 42, server and edge cache Execute example.Although Figure 43 relates to client 4108(i.e., Fat Client) and edge cache 4202, but it is to be understood that this letter Number sequence can be similarly applicable for the edge cache 4204 and 4206 in thin-client 4110 and 4112 and Figure 42.? In Figure 43, signal 4302 represents the communication between server 4102 and edge cache 4202.Especially, server 4102 will Voice data transmission is to edge cache 4202, to send with audio content and in edge cache prestrain audio frequency Hold.This can independently carry out or carry out in response to from the presenting request of client.Signal 4304 represents for from client End 4108 sends the request of the audio content to server 4102.In one embodiment, it is possible to use HTML (Hypertext Markup Language) (http) form of this request of layout is carried out, although other language or form can also be used.In response to this request, server 4102 Send a response back to client, be illustrated as signal 4306.Response signal 4306 provides to cache to client 4108 The redirection (such as, in edge cache 4202) of position.Server 4102 may be provided for including cache The inventory quoted of the list of content.This list can identify all cache contents, although preferably, this list will only be marked Know the cache content relevant to the audio frequency asked.Such as, if client 4108 requests for central authorities' C violin Audio frequency, then server can identify all cache contents of violin note.This inventory can also include accessing relevant height Any encryption key needed for speed cache contents and the life span (TTL) that can be associated with each cache entries.

After receiving response from server 4102, client 4108 sends based on this clear to edge cache 4202 The request of the suitable cache entries of information identification (whether for particular association audio frequency, " close to hit " etc.) in list (is schemed It is shown as signal 4310).Again, it is possible to use http carrys out the form of this request of layout, although can also use other language or Form.In one embodiment, client 4108 performs the determination to suitable cache entries, although can also be high at edge Remotely perform this at speed caching 4202 to determine.Signal 4310 represents the bag of 4108 from edge cache server to client Include identified cache bar purpose response.But, if this request identifies the cache entries being in outside its TLL Or this request is the most unavailable, then this response will include the failed instruction of this request.This may make client 4108 retry its request to server 4102.If response 4310 contains asked audio entry really, the most then it can To be deciphered by client 4108 and/or to be decompressed when needed.If cache entries is " close to hit ", then can also make With said process or its equivalent, this cache entries is reconstructed.

Figure 44 illustrates from client, server and the edge cache with Figure 42 disclosed embodiment explicitly Between the alternative embodiment of signal sequence.In this embodiment, in the communication between client 4108 and 4202 and Figure 43 The communication described is similar to, and exception is: replaces client 4108 and contacts server 4102 to obtain position and the height of cache The inventory of speed cache contents, client 4108 directly sends the request for audio content 4308 to edge cache 4202.

Figure 45-47 illustrates and may be used for optimizing for asking in response to the request from client and retrieving audio frequency Three kinds of technology of process.Can server, edge cache or in response to asked note storage audio content and Audio content is supplied at any other equipment of client use these technology.These technology all can also be alone applied Or combine apply each other.

Turn first to Figure 45, describe a kind of illustrative methods, be used for what enables the client to quickly and efficiently identify Time Shortcomings to provide the time of audio frequency from remote server or cache.In frame 4502, at client, generate sound Frequency request.Audio request can be the request for cache audio frequency or the request for audio frequency to be presented.At frame 4504 In, it is also possible to before including losing efficacy identification request and arriving it together with audio request, audio frequency is by the time (quilt needed for client It is referred to as " deadline ").Before invalidation request can be included in deadline, audio frequency can not be provided to the situation of client Lower identification is the arguement stopping also to be to continue with audio request.Preferably, the deadline provided in audio request is instantaneous value. In this case it is necessary to synchronize server/cache and the client of the request that receives in time.Such as this area skill When art personnel have this specification, drawings and claims in face of it it will be appreciated that as, it is also possible to use and cut for identifying The only additive method of time.Preferably, identification request of losing efficacy was included in the header of audio request, although can with deadline Them are transmitted in any other part in request or as the signal separated.

In frame 4506, audio request is launched to relevant server or cache from client.Server or height Speed is buffered in frame 4508 reception audio request and determines that in frame 4510 received audio request includes invalidation request, by taking Business device or cache receive.At frame 4512, the server being received or cache determine that asked audio frequency is to cut-off Whether client can be provided to before time.Preferably, this is based on for identifying and obtain cache audio frequency, presenting Note and/or note is transferred back into client planned or the previously determined time determines.Note is transmitted back to Time needed for client was also based between the time that transmission time and the audio request of audio request are received The waiting time identified.

If it is determined that audio frequency can be provided before deadline, then in frame 4514, audio frequency is placed in queue, and And continue as described above for identifying, position and/or present the method for audio frequency.If it is determined that before deadline not It is provided that audio frequency, then before client notification audio frequency to deadline, disabled message will be sent back in frame 4516 Client.In one embodiment, this notice can be transmitted, although can also use any as http 412 error message Extended formatting.Then, in frame 4518, client can take any necessary operation for obtaining and provide alternate audio. This can be by client identification and audio frequency as the audio class needed for the note asked of local cache and/ Maybe it is applied to process to be previously stored or the audio frequency of cache draws what asked note realized with approximation.

In frame 4520, server/cache inspection is lost in the case of not being provided that audio frequency before deadline It is to stop also to be to continue with that effect request has identified.If invalidation request is arranged to stop, then abandon in frame 4522 Audio request, and do not take further action.If invalidation request is arranged to continue, then please by audio frequency in frame 4514 Ask and be placed in queue for process.In this case, then, once complete, it is possible to audio frequency is supplied to client, and And use this audio frequency to replace the alternate audio obtained by client.

Figure 46 illustrates the example process for the audio request in queue carries out priorization sequence.In conjunction with above-mentioned note Record accompaniment fact circulation realizes, and this process is particularly useful, and this is owing to it is of value to by user in following live circulation accompaniment Any change of making of note: this fact circulation accompaniment is that next playback being expected to live circulation plays back this sound all over time period Realize before symbol.In frame 4602, client generate audio request for the note to use in current live circulation. In frame 4604, will be included in audio request with the timing information of live circular correlation.In one embodiment, timing information The persistent period (being referred to as length of the cycle) of circulation can be identified.In another embodiment, timing information can also include: mark The information (being referred to as note initial time) of note position in circulation；And the current portions of the circulation played back, as Can be by the playback bar in above-mentioned interface or the station location marker (being referred to as the playback head time) of playback head.(in Figure 48, illustrate this Relative timing information described in Duan and the exemplary embodiment of live circulation).

It is back to Figure 46, in frame 4606, audio request is sent to server or cache together with timing information. In one embodiment, it is also possible to include the timestamp indicating message when to be sent together with message.

In frame 4608, receive audio request, and determine service time in frame 4610.Such as, an embodiment In, if audio request only includes the information relevant with the persistent period of circulation, then can be by only circulating continuancing time being divided Carry out " calculating " service time into two.This provides and plays back fact circulation at client and will arrive the sound that audio frequency is asked The statistical approximation of the time span that may need before the position of symbol.

In another embodiment, if note initial time and playback head temporal information are included in audio request, then Service time can be calculated with higher precision.Such as, in such a case, it is possible to first determine note initial time more than playing The head time (that is, the position that playback bar when the ratio during note is in circulation makes audio request is more late).If note initiates Between bigger, then can calculate service time as follows: time_to_service=note_start_time play_head_ Time(service time=note initial time-playback head time).If the playback head time is more than note initial time (that is, note The ratio being in circulation makes the playback bar position earlier during audio request), then can calculate service time as follows: time_ To_service=(loop_length-play_head_time)+note_start_time(service time=(circulation Length-playback head time)+note initial time).In another embodiment, the calculating of service time can also include plus sound Frequency evidence returns to the waiting time planned needed for the transmission of client.Can be by identifying what when audio request was sent Timestamp and calculate between the time that this timestamp and audio request are received by server or cache identify flow The time died determines waiting time.

After service time, value was determined, based on its service time, audio request is placed in queue.Thus, have The pre-treatment of the audio request of longer service time has the audio request of shorter service time, thus increases in fact circulates Association note next time playback before will process audio request probability.

Figure 47 illustrates the example process for assembling the repetition audio request relevant to identical note.At frame 4702 In, client generate audio request.In frame 4704, include together with audio request track ID, note ID, initial time and End time.Track ID identifies and makes the music track of audio request for it, and note ID identifies note.Excellent Selection of land, track ID is globally unique ID, and note ID is unique for each note in track.Initial time and at the end of Between identify the starting and ending that note is initial relative to track respectively till.In frame 4706, by audio request and association Track ID, note ID, initial time and end time launch to server and/or cache.

As shown in Figure 47, in this embodiment, server and/or cache have and include multiple track queue 4722 Queue 4720.Each track queue 4722 includes the independent queue for processing the audio request for individual track.At frame In 4708, server or cache receive audio request, and based on the track ID being associated with audio request in frame 4710 Identify the track queue 4722 in queue 4720.In frame 4712, search track queue is to identify having identical note ID's The audio request of any previous queuing.If the audio request with identical ID is positioned, then from track queue in frame 4714 4722 remove this request.

Then, new audio request is navigated in the corresponding track queue in multiple track queue 4722.This is permissible Realize one of in a number of ways.Preferably, if the preceding audio request with identical note ID has been positioned and has abandoned, newly Audio request can replace the request abandoned in track queue 4720.Alternatively, in another embodiment, can be based on New audio request is positioned in track queue by the initial time of audio request.More specifically, in queue than having later The note of time beginning earlier places the note with the time of being initiated early.

Due to the method described in Figure 47, from queue, eliminate audio request that is out-of-date or that be replaced, thus at saving Reason ability.When individual note is made many during fact circulation accompaniment by one or more users and continuous print changes, this Particularly useful, this is quickly and efficiently to process and provide most recently requested note and avoided no longer needing owing to which increasing system Want or the ability of process of the most desired note.

Effect chain processes.

Figure 49-52 illustrate may be used for based on by user select particular for above-mentioned game environment with one or many A series of multiple effects are applied to the mistake of these music tracks by virtual happy person, musical instrument and the producer that individual music track is associated Journey.As will understand from the following description, by these processes, the track that user creates can be processed with more Represent well or imitate the style of available happy person, musical instrument and producer, nuance and the trend represented in game environment.By This, single track can have dramatically different sound based on being chosen so as to the happy person, musical instrument and the producer that are associated with track Sound.

Turn first to Figure 49, it is illustrated that for effect being applied to the example of one or more music tracks of music album Property effect chain.It is shown that for each musical instrument track, can be based on the selected musical instrument being associated with this track The effect 4902,4904 and 4906 of body application First Series.These effects are herein referred to as happy person role's effect.So After, based on selected producer's incarnation, the effect 4904 of second series can be applied to each musical instrument track.These are at this Literary composition is referred to as producer role's effect.Although will be described below now the concrete example of applied effect, but should Work as understanding, it is possible to use various effects, and the effect that can apply for each happy person and producer role can be changed Number and order.

Figure 50 shows an exemplary embodiment of the happy person role's effect that can be applied to track.In this embodiment In, track 5002 is imported into distortion/kit and selects module 5004, distortion/kit to select module 5004 to be correlated with Digital Signal Processing be applied to music track, in order to substantially re-create can with by the virtual pleasure selected by interface The sound type that the actual life musical instrument that device represents is associated.Such as, if track 5002 is guitar track, then can be by one Or multiple effect is applied to basic electronics or acoustic guitars track 5002, to imitate and to re-create the sound wind of specific guitar Lattice, including the most roundabout, chorus, distortion, echo, envelope, echo, wah and even result in pseudo-classic, metal, Blues or rubbish The complex combination of the effect that rock and roll " is felt ".In another example, automatically effect can be applied to basic key shelf track 5002, to imitate the keyboard instrument type of such as Rhodes Piano or Wurlitzer Electric Organ etc.If Track 5002 is basic tympanitic resonance rail, then can apply, based on selected drum set, the tum sound being pre-configured with via effect chain Kit.Correspondingly, can by user desirably add or revise one or more effect, by system by kit It is applied to basic track or a combination thereof to control effect chain 5004.

After applying distortion effect and/or kit selection, preferably track is transmitted to equalizer module 5006, the set that equalizer is arranged is applied to track by equalizer module 5006.Then, it is preferable that by track transmission to compression Module 5008, at compression module 5008, the set of applied compression effect.Preferably, it is pre-configured with for each music incarnation Equalizer to be applied and compression are arranged, and arrange with compression although this equalizer can also be manually set or adjusted.By application The effect above, can process music track, with represent the virtual happy person selected by user and the style of musical instrument, sound and Music trend.

Apply happy person role's effect, just apply a series of producer role's effect, as shown in Figure 51 and 52. Turning first to Figure 51, split track 5102 between three parallel signal paths, wherein, single rank controls 5104a-c quilt It is applied to each path.Isolation level for each path controls to be desired, and this is owing to each path can have not Same dynamic action.Applied minimised concurrently in this chain compound and undesirably or unsuitable effect.For all Such as the musical instrument of drum (it can include playing drum, snare drum, cap, big cymbals etc.) etc, with accustomed sounds such as each drum, cap, big cymbals Frequency is considered as single track, and wherein, each in these tracks is divided into three signal paths for process.

As shown in Figure 51, each then single effect being applied in three signal paths.First path quilt Being supplied to practical function module 5106, one or more practical settings are applied to track by practical function module 5106.Practicality sets The example put includes but not limited to that such as equalizer arranges and compresses the effect of setting etc.Second path is sent to postpone effect Really module 5108, one or more delay settings are applied to track by carryover effects module 5108, to shift determining of various note Time.3rd path is sent to reverberation effect module 5110, and the set arranged of echoing is applied to sound by reverberation effect module 5110 Rail.Although not shown, it is also possible to apply multiple echo or postpone arrange.Preferably, for selecting via interface Each virtual producer is pre-configured with for the setting of each in practical, delay and reverberation effect, although these are arranged also Can manually adjust.Once applying practicality, delay and reverberation effect, three signal paths are just mixed device 5,112 1 Play mixing to return in single path.

As shown in Figure 52, the track corresponding with each musical instrument in single melody is fed into blender 5202, At blender 5202, these tracks are mixed into single album track.By this way, user can configure all parts (i.e., Musical instrument) relative volume, it can be adjusted to highlight a musical instrument relative to another musical instrument each other.Each making Person can also be associated with unique mixing setting.Such as, Chinese musical telling style producer can with cause louder mixed of bass Conjunction setting is associated, and rock and roll producer can be associated with the mixing setting causing guitar louder.Once it is mixed, album Track is sent to equalizer module 5204, compression module 5206 and limiter block 4708, wherein, is set by equalizer respectively Put, compress setting and limiter arrange be applied to album track.Preferably, selectable at user option User avatar Each virtual producer is pre-configured with these and arranges, and arranges although these can also be manually set or adjusted.

In one embodiment, each virtual happy person and producer can also be assigned with indicating its ability affecting melody " impact " value.It is then possible to use these values to determine the mode of application the effect above.Such as, happy person or the " shadow of producer Ring " value is the strongest, then its to arrange the impact can having music the biggest.It is then also possible to for producer role's effect application class Like scene.For the effect (such as equalizer and compression are arranged) of application in both happy person and producer role, " impact " value Can be also used for determining how the difference being in harmonious proportion between effect setting.Such as, in one embodiment, can be based on " impact " value In difference application effect arrange weighted average.As example, let as assume that " impact " value can be the number from 1 to 10 Word.If selected happy person has " impact " value 10 and is working together with having the producer of " impact " value 1, then can be with it The institute that overall applicability is associated with this selected happy person is effective.If selected happy person have " impact " value 5 and with there is " shadow Ring " producer of value 5 works together, then can by may random but by the way of the most predetermined by any applied happy person The effect arranged is combined with the setting of producer.Can be by if selected happy person has " impact " value 1, the most only minimum influence Application.If selected happy person has " impact " value 1, the most minimum effect can be employed.In another embodiment, can only base In virtual happy person, there is with which in producer the effect setting that relatively big " impact " value selects to associate.

Can also effect described in application drawing 49-52 on any equipment in systems.Such as, at clothes as described In business device-client configuration, can arrange by treatment effect at server or client.In one embodiment, it is also possible to base Ability in client is dynamically determined the identification processed effect wherein.Such as, if client is confirmed as Most of effects the most preferably can be processed at server by smart phone, and if client is desk computer, The most preferably at client, most of effects can be processed.

The present invention is only explained and illustrated to description and accompanying drawing above, and the invention is not restricted to this.Although with specific reality Execute mode or embodiment describes description relatively, but elaborate many details for purposes of illustration.Therefore, in aforementioned Hold the principle only illustrating the present invention.Such as, in the case of without departing from the spirit or essential characteristics of the present invention, the present invention is permissible There is other concrete forms.Described layout is illustrative and be not restrictive.It will be understood by those skilled in the art that not In the case of departing from the ultimate principle of the present invention, the present invention can accept in Additional embodiments or embodiment, and the application and retouches These specific detail stated can significantly change.Although therefore it will be appreciated that those skilled in the art can design at this Wen Zhongwei is explicitly described or illustrates but embody the principle of the invention and the various layouts being therefore in its scope and spirit.

Claims

1. for the method that audio frequency effect is applied to one or more tracks of music album, including:

Identify that the first virtual happy person selected by user is to be associated with the first musical instrument track；

Identify that the first virtual producer selected by user is to be associated with described first musical instrument track；

First Series effect is applied to described first musical instrument track, and described First Series effect depends on described first virtual pleasure Person；And

Second series effect is applied to described first musical instrument track, and described second series effect depends on described first virtual system Author.

Method the most according to claim 1, wherein, application First Series effect includes one or more distortion effect, its In, the one or more distortion effect is based on the virtual musical instrument being associated with described first virtual happy person.

Method the most according to claim 2, wherein, application First Series effect includes to described first musical instrument track Individual or multiple equalizer are arranged.

Method the most according to claim 2, wherein, application First Series effect includes: compression setting be applied to described First musical instrument track.

Method the most according to claim 1, wherein, application second series effect includes: delay setting be applied to described First musical instrument track.

Method the most according to claim 1, wherein, application second series effect includes: setting of echoing is applied to described First musical instrument track.

Method the most according to claim 1, farther includes:

Identify that the second virtual happy person is to be associated with the second musical instrument track；

3rd variety of effects is applied to described second musical instrument track, and described 3rd variety of effects depends on described second virtual pleasure Person；

Described second series effect is applied to described second musical instrument track, and it is empty that described second series effect depends on described first Draw up author.

Method the most according to claim 7, wherein, application second series effect farther includes: will at least the first and the Two musical instrument tracks are mixed into album track.

Method the most according to claim 8, wherein, application second series effect includes: is arranged by equalizer and is applied to institute State album track.

Method the most according to claim 8, wherein, application second series effect includes: compression setting be applied to described Album track.

11. methods according to claim 1, wherein, described first virtual happy person is associated with the first influence value, and institute State the first virtual producer to be associated with the second influence value.

12. methods according to claim 11, wherein, the first and second variety of effects are based on the first and second influence values Apply.

13. methods according to claim 12, wherein, the first and second variety of effects are based on the first and second influence values Weighted average apply.