CN106409282A - Audio frequency synthesis system and method, electronic device therefor and cloud server therefor - Google Patents
Audio frequency synthesis system and method, electronic device therefor and cloud server therefor Download PDFInfo
- Publication number
- CN106409282A CN106409282A CN201610785900.0A CN201610785900A CN106409282A CN 106409282 A CN106409282 A CN 106409282A CN 201610785900 A CN201610785900 A CN 201610785900A CN 106409282 A CN106409282 A CN 106409282A
- Authority
- CN
- China
- Prior art keywords
- performance
- file
- tone color
- information
- playing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000015572 biosynthetic process Effects 0.000 title claims abstract description 92
- 238000003786 synthesis reaction Methods 0.000 title claims abstract description 92
- 238000000034 method Methods 0.000 title claims abstract description 52
- 239000000284 extract Substances 0.000 claims description 37
- 230000008569 process Effects 0.000 claims description 37
- 238000010189 synthetic method Methods 0.000 claims description 36
- 230000006835 compression Effects 0.000 claims description 32
- 238000007906 compression Methods 0.000 claims description 32
- 238000005070 sampling Methods 0.000 claims description 31
- 238000000605 extraction Methods 0.000 claims description 28
- 239000002131 composite material Substances 0.000 claims description 17
- 239000000203 mixture Substances 0.000 claims description 17
- 238000012546 transfer Methods 0.000 claims description 11
- 230000001360 synchronised effect Effects 0.000 claims description 7
- 238000012545 processing Methods 0.000 claims description 6
- 230000002194 synthesizing effect Effects 0.000 claims description 6
- 238000005553 drilling Methods 0.000 claims description 4
- 230000029058 respiratory gaseous exchange Effects 0.000 claims 1
- 230000000694 effects Effects 0.000 description 10
- 238000009527 percussion Methods 0.000 description 9
- 238000013461 design Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 6
- 230000004048 modification Effects 0.000 description 6
- 238000012986 modification Methods 0.000 description 6
- 230000008859 change Effects 0.000 description 5
- 239000011435 rock Substances 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 3
- 238000006243 chemical reaction Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 230000000712 assembly Effects 0.000 description 2
- 238000000429 assembly Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 230000000052 comparative effect Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000001627 detrimental effect Effects 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 210000001503 joint Anatomy 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000010079 rubber tapping Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H1/00—Details of electrophonic musical instruments
- G10H1/0033—Recording/reproducing or transmission of music for electrophonic musical instruments
- G10H1/0041—Recording/reproducing or transmission of music for electrophonic musical instruments in coded form
- G10H1/0058—Transmission between separate instruments or between individual components of a musical system
- G10H1/0066—Transmission between separate instruments or between individual components of a musical system using a MIDI interface
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L13/00—Speech synthesis; Text to speech systems
- G10L13/02—Methods for producing synthetic speech; Speech synthesisers
- G10L13/04—Details of speech synthesis systems, e.g. synthesiser structure or memory management
- G10L13/047—Architecture of speech synthesisers
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
- G10H2240/00—Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
- G10H2240/011—Files or data streams containing coded musical information, e.g. for transmission
- G10H2240/016—File editing, i.e. modifying musical data files or streams as such
- G10H2240/021—File editing, i.e. modifying musical data files or streams as such for MIDI-like files or data streams
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Electrophonic Musical Instruments (AREA)
- Auxiliary Devices For Music (AREA)
Abstract
The invention provides an audio frequency synthesis system and method, an electronic device therefor and a cloud server therefor. The audio frequency synthesis system comprises the electronic device and the cloud server, the electronic device is used for choosing performance information, performance events that are obtained in real time are uploaded to the cloud server or a plurality of performance events are combined into a performance event file which is then uploaded to the cloud server, and the performance events comprise relations between music performance notes and performance time under music performance repertoire information. The cloud server is connected with the electronic device via a network and is used for receiving the performance information and performance events/performance event file; tone color samples corresponding to the performance event are synthesized into an audio frequency stream according to the performance events or the performance information and the performance events/performance event file; audio frequency samples corresponding to the performance event file are synthesized and compressed into an audio frequency file; the tone color sample is relative to tone color information and the performance events/performance event file. Via the audio frequency synthesis system and method, the electronic device therefor and the cloud server therefor, audio synthesis time is reduced, network uploading time is reduced, audio tracks of musical instruments for performance can be highlighted, and tone color distortion can be prevented.
Description
Technical field
The present invention relates to a kind of processing method of audio file, more particularly to one kind are converted to sound by playing incident file
The audio synthesis system of frequency file, method and its electronic equipment and Cloud Server.
Background technology
At present, be applied to the performance class of mobile terminal (mobile phone, PAD etc.) with sing class shared software increasingly
For well known greatly, for example, the program such as sing.It passes through in electronic equipment Composite tone file, and audio file is utilized friend
Sharing of audio file realized by the interactive class software such as circle or QQ.
Under normal circumstances, it is similar to and the software of " singing " is that (Application, should by being arranged on the APP of client
With) carry out the recording of user's performance, and the performance result recorded and background music are synthesized, generate after client synthesis the most at last
Audio file upload onto the server.Using this kind of software, audio file aggregate velocity is slow, takes longer.Wherein audio file
Aggregate velocity closely bound up with hardware computation performance.Because the CPU of the hardware carrier of mobile terminal and memory configurations are limited, sound
, in building-up process, memory usage is very high for frequency file, even leads to the APP program crashing of mobile terminal.Therefore, mobile
The configuration of terminal leverages time and the stability of audio file synthesis.And, it uploads onto the server by audio file
When time-consuming can be long.The volume of audio file is larger, typically all with MByte level calculation, along with network line transmission
Unstability, therefore, before sharing, need to upload two links through audio frequency synthesis and network, under prior art, need to wait relatively
The long time, affect the experience shared.
Additionally, also there are some multi-functional musical instruments, it possesses a kind of inside recording function, and its support is same in instruments sound
When, directly audio file is uploaded onto the server.Because this kind of musical instrument generates audio file while playing, which save conjunction
Become the time of audio file, but similarly, then when audio file is uploaded onto the server, network uplink time equally occurs
Long problem.
Content of the invention
The shortcoming of prior art in view of the above, it is an object of the invention to provide a kind of audio synthesis system, method
And its electronic equipment and Cloud Server, for solve prior art sound intermediate frequency file synthesis, upload share when, take long and not
Stable problem.
For achieving the above object and other related purposes, the present invention provides a kind of audio synthesis system, described audio frequency synthesis
System includes：Electronic equipment and Cloud Server；Wherein, described electronic equipment, for selecting playing information, and according to playing information
Obtain performance event in real time, and playing information and the real-time performance event obtaining are uploaded to Cloud Server；Wherein, playing information
Including performance song information and timbre information；Performance event includes the pass of musical notes and playing time under playing song information
System；Described Cloud Server passes through network connection with described electronic equipment, for real-time reception playing information and performance event, and will
Performance event and corresponding tone color sample synthesize audio stream in real time；Wherein, tone color sample is and performance event and timbre information
Related.
In one embodiment of the invention, described electronic equipment is additionally operable to save as the multiple performance composition of matter obtaining
Play incident file, and incident file will be played and send to described Cloud Server；Described Cloud Server is additionally operable to receive plays thing
Corresponding tone color sample is synthesized audio file according to playing information and performance incident file by part file.
In one embodiment of the invention, performance event is MIDI message；Performance incident file is MIDI file.
In one embodiment of the invention, prestore in described Cloud Server music score of Chinese operas information bank and tone color sampling rate；And it is described
Preserve in music score of Chinese operas information bank：Play song information and play the music score of Chinese operas；Preserve in described tone color sampling rate：Timbre information and sound
Colo(u)r atlas.
In one embodiment of the invention, described Cloud Server real-time reception plays event and playing information；According to performance
Event and timbre information, extract corresponding tone color sample in described tone color sampling rate, and the tone color sample of extraction are closed in real time
Become audio stream.
In one embodiment of the invention, described cloud server playing information and play incident file；Parsing is played
Incident file；According to performance incident file and the timbre information of parsing, described tone color sampling rate is extracted corresponding tone color sample
This, and simultaneously compression coding is audio file by corresponding for the tone color sample extracting synthesis.
In one embodiment of the invention, in the described music score of Chinese operas information bank of described Cloud Server, also preserve background music,
Described background music is related to described performance song information.
In one embodiment of the invention, described Cloud Server real-time reception plays event and playing information；Extract and correspond to
Background music；Synchronous performance event and background music；According to the event of performance and timbre information, carry in described tone color sampling rate
Take corresponding tone color sample, and the tone color sample of extraction and background music are synthesized audio stream in real time.
In one embodiment of the invention, described cloud server plays incident file and playing information；Extract and correspond to
Background music；Incident file is played in parsing, and synchronizes with background music；According to parsing described performance incident file and
Described timbre information, extracts corresponding tone color sample in described tone color sampling rate, and by the background music extracting and tone color sample
Simultaneously compression coding is audio file to the synthesis of this correspondence.
The invention also discloses a kind of audio frequency synthetic method, it is applied to the cloud service by network connection with electronic equipment
Device；Described audio frequency synthetic method includes：Receive the playing information from described electronic equipment；Wherein, playing information includes playing
Song information and timbre information；Real-time reception is played event or is played incident file, wherein, plays incident file by playing event
Composition, performance event includes the relation of musical notes and playing time under playing song information；Tone color sampling rate is extracted
Corresponding tone color sample；According to performance event, the tone color sample of extraction is synthesized audio stream in real time；Or according to the event of performance literary composition
By the tone color sample extracting synthesis and compression coding is audio file to part.
In one embodiment of the invention, the tone color sample of extraction is synthesized audio frequency by described foundation performance event in real time
Stream；Or by the tone color sample synthesis of extraction, simultaneously compression coding also includes for the step of audio file according to playing incident file：Drill
Play volume to process and prevent distorsion from processing.
In one embodiment of the invention, described real-time reception play event or play incident file step in, when connecing
Receive for play incident file when, to play incident file parse.
In one embodiment of the invention, the step extracting corresponding tone color sample in the described sampling rate in tone color is also wrapped
Include：Extract corresponding background music according to playing information.
In one embodiment of the invention, the tone color sample of extraction is synthesized audio frequency by described foundation performance event in real time
Stream；Or by the tone color sample synthesis of extraction, simultaneously compression coding includes for the step of audio file according to playing incident file：To drill
Play event or play incident file and background music synchronization：With respect to the absolute time point of background music, obtain performance event or
Play the performance characteristic value of incident file；According to performance event, the tone color sample of extraction and background music are synthesized audio frequency in real time
Stream；Or the tone color sample extracting and background music are synthesized by incident file and compression coding is audio file according to playing.
In one embodiment of the invention, described background music is MP3 format, then the synthesis compression coding of audio file
Including：Background music is split according to MP3 frame；For each MP3 frame, according to this MP3 frame corresponding performance characteristic value
Extract tone color sample with timbre information；Tone color sample and this MP3 frame of background music that synthesis is extracted；Background music is all
After MP3 frame and the whole synthesis of corresponding tone color sample, and compression coding obtains described audio file.
In one embodiment of the invention, the tone color sample of extraction and background music are closed by described foundation performance event in real time
Become audio stream；Or the tone color sample extracting and background music are synthesized by incident file and compression coding is audio frequency literary composition according to playing
The step of part also includes：Relative volume adjusts, plays volume process and prevent distorsion from processing.
In one embodiment of the invention, described performance event is MIDI message；Described performance incident file is MIDI literary composition
Part.
In one embodiment of the invention, described audio frequency synthetic method also includes：Send conjunction to described electronic equipment in real time
The audio stream becoming or audio file.
The invention also discloses a kind of Cloud Server, it passes through network connection with electronic equipment, and described Cloud Server includes：
Transport module, for realizing the data transfer and described electronic equipment between；Wherein, described data transfer includes：Receive described
The playing information that electronic equipment uploads, the performance event that electronic equipment described in real-time reception uploads or performance incident file, and
Send to described electronic equipment and play the music score of Chinese operas and audio stream/audio file；Wherein, playing information includes playing song information and sound
Color information；Play incident file to be made up of the event of performance, performance event includes musical notes and performance under playing song information
The relation of time；Memory module, for preserving music score of Chinese operas information bank, tone color sampling rate；Extraction module, in described memory module
Extract and play the music score of Chinese operas and tone color sample；Synthesis module, for synthesizing sound according to performance event in real time by the tone color sample of extraction
Frequency flows；Or by the tone color sample extracting synthesis, simultaneously compression coding is audio file according to playing incident file.
In one embodiment of the invention, described transport module also includes analyzing sub-module, for the performance thing receiving
Part file is parsed.
In one embodiment of the invention, described extraction module also includes carrying from described memory module according to playing information
Take background music；Described synthesis module is used for, according to performance event, the tone color sample of extraction and background music are synthesized sound in real time
Frequency flows；Or the tone color sample extracting and background are synthesized by incident file and compression coding is audio file according to playing.
The invention also discloses a kind of audio frequency synthetic method, it is applied to set by the electronics of network connection with Cloud Server
Standby；Described audio frequency synthetic method includes：Select playing information；Wherein, playing information includes playing song information and timbre information；
Obtain performance event according to playing information in real time；Wherein, performance event includes musical notes and performance under playing song information
The relation of time；Performance event and playing information are uploaded to described Cloud Server in real time.
In one embodiment of the invention, described audio frequency synthetic method also includes：Download playing music from described Cloud Server
Spectrum；Wherein, playing the music score of Chinese operas is to download from the music score of Chinese operas information bank of described Cloud Server according to performance song information to obtain.
In one embodiment of the invention, described audio frequency synthetic method also includes：By the real-time multiple performance events obtaining
Combination is formed plays incident file；Performance incident file and playing information are uploaded to described Cloud Server.
The invention also discloses a kind of electronic equipment, pass through network connection with Cloud Server, described electronic equipment includes：Choosing
Select module, for selecting playing information to be performed, wherein, playing information includes playing song information and timbre information；Obtain
Module, obtains performance event in real time according to playing information；Wherein, performance event include play song information under musical notes and
The relation of playing time；Transport module, for realizing the data transfer and described Cloud Server between；Wherein, described data passes
Defeated inclusion：Download from described Cloud Server and play the song information corresponding performance music score of Chinese operas, and drill to the upload of described Cloud Server
Play information and performance event.
In one embodiment of the invention, described electronic equipment also includes：Composite module, for the multiple performances that will obtain
Event composition plays incident file；Described transport module is additionally operable to upload to described Cloud Server plays incident file.
As described above, a kind of audio synthesis system of the present invention, method and its electronic equipment and Cloud Server, electronic equipment
Directly the real-time MIDI message (performance event) played is uploaded to Cloud Server, or multiple MIDI message are saved as MIDI literary composition
Part (performance incident file), and MIDI file is uploaded to Cloud Server using network, in real time MIDI is disappeared using Cloud Server
Breath synthesizes audio stream, or MIDI file is carried out parsing, synthesizes and compression coding generates final audio file.The present invention
A kind of audio synthesis system, method and its electronic equipment and Cloud Server there are following Advantageous Effects：
1) MIDI message is directly uploaded to Cloud Server by the electronic equipment of the present invention in real time；And Cloud Server is according to reception
MIDI message it is synthesized in real time audio stream, it is achieved thereby that the real-time sharing of the performance event of electronic equipment；
2) electronic equipment of the present invention also can by the MIDI files passe being made up of MIDI message to Cloud Server, compared to
Directly upload audio-frequency information and greatly save network uplink time；
3) synthesis of MIDI message or MIDI file is processed and carry out in Cloud Server, reduce to as transmission
The system resource of the mobile terminal (electronic equipment) of unit requires, and improves stability；And, the configuration one due to Cloud Server
As all higher, disposal ability is stronger, for MIDI message or MIDI file synthesize process speed also relatively fast, shorten
Audio frequency conversion time；And, the resource of Cloud Server can also be made full use of by electronic equipment；
4) tone color sampling rate and effect banks are provided in the Cloud Server of the present invention so that Timbre Synthesis more personalized and many
Sample；
5) Cloud Server of the present invention, when audio frequency synthesizes, is rationally arranged and raw with the volume played by background music
Become the mode of independent musical instrument track, reach the prominent track that plays an instrument, and prevent the purpose of audio-frequency harmonic distortion；
6) Cloud Server of the present invention is also recordable and preserves the data file that user plays, and increased game and amusement unit
Element is it is also possible to for musical instrument teaching, its range of application is more extensive.
Brief description
Fig. 1 is shown as a kind of structural representation of audio synthesis system disclosed in the embodiment of the present invention.
The flow process that Fig. 2 is shown as a kind of audio frequency synthetic method being applied to Cloud Server disclosed in the embodiment of the present invention is illustrated
Figure.
Fig. 3 is shown as a kind of flow process of the audio frequency synthetic method being applied to Cloud Server disclosed in another embodiment of the present invention
Schematic diagram.
Fig. 4 is shown as a kind of principle schematic of Cloud Server disclosed in the embodiment of the present invention.
The flow process that Fig. 5 is shown as a kind of audio frequency synthetic method being applied to electronic equipment disclosed in the embodiment of the present invention is illustrated
Figure.
Fig. 6 is shown as the principle schematic of a kind of electronic equipment disclosed in the embodiment of the present invention.
Component label instructions
100 audio synthesis systems
110 electronic equipments
120 Cloud Servers
410 transport modules
411 analyzing sub-module
420 memory modules
430 extraction modules
440 synthesis modules
441 relative volume adjust submodule
442 play volume processes submodule
443 slicing submodules
610 selecting modules
620 acquisition modules
630 composite modules
640 transport modules
S21～S25, S31～S34, step
S51～S54
Specific embodiment
Below by way of specific instantiation, embodiments of the present invention are described, those skilled in the art can be by this specification
Disclosed content understands other advantages and effect of the present invention easily.The present invention can also be by addition different concrete realities
The mode of applying is carried out or applies, and the every details in this specification can also be based on different viewpoints and application, without departing from
Carry out various modifications and changes under the spirit of the present invention.It should be noted that, in the case of not conflicting, following examples and enforcement
Feature in example can be mutually combined.
Refer to accompanying drawing.It should be noted that the diagram provided in following examples only illustrates this in a schematic way
Bright basic conception, then in schema only display and relevant assembly in the present invention rather than according to component count during actual enforcement,
Shape and size are drawn, and during its actual enforcement, the kenel of each assembly, quantity and ratio can be a kind of random change, and its assembly
Layout kenel is likely to increasingly complex.
A kind of audio synthesis system of the present invention, method and its electronic equipment and Cloud Server, real by event will be played
When be uploaded to Cloud Server, or by performance event synthesis save as performance incident file, by play incident file be uploaded to cloud
Server, compared to directly uploading audio-frequency information, greatly reduces the time-consuming of network upload, thus when reaching minimizing user's wait
Between, reach the experience lifting of real-time sharing.And, the present invention according to playing event real-time Composite tone stream, or according to performance
Incident file Composite tone file is all carried out in Cloud Server side, greatly reduces the system resource of electronic equipment, lifting
The stability of a system of electronic equipment, and, also greatly accelerate the aggregate velocity of audio frequency.
Embodiment 1
Present embodiment discloses a kind of audio synthesis system 100, as shown in figure 1, include：Electronic equipment 110 and cloud service
Device 120.
Electronic equipment 110 is used for selecting playing information, and obtains performance event in real time according to playing information, and will play letter
Breath and the real-time performance event obtaining send to Cloud Server 120.
Further, electronic equipment 110 is additionally operable to select playing information, and obtains by performance event group according to playing information
The performance incident file becoming, and send playing information to Cloud Server 120 and play incident file.
Wherein, playing information includes but is not limited to user's performance song information to be performed and timbre information.Wherein, play
Song information is used for uniquely identifying performance song, for example, playing music purpose title.Timbre information is used for describing user wishes to use
Which kind of sound is playing.For example, if the electronic musical instrument of use is percussion instrument, then timbre information describes user wishes
Drum group style name, for example：First set rock and roll rouses group, second set of popular drum group etc..
For the selection of playing information, electronic equipment 110 can select by corresponding selection interface to obtain.Further
Ground, user's performance music score of Chinese operas to be performed is stored in the music score of Chinese operas information bank of Cloud Server 120, before user plays, permissible
The corresponding performance music score of Chinese operas is downloaded according to selection playing information from Cloud Server 120 by electronic equipment 110.
For different playing informations (playing song information), performance event is formed by playing characteristic value, wherein, plays special
Value indicative includes but is not limited to musical notes, playing strength and note duration, can be obtained musical notes and be drilled by performance event
Play the relation between the time.
And play incident file and be made up of performance event.Multiple performance events are combined protecting by electronic equipment 110
Deposit thus obtaining playing incident file.
Preferably, play event and adopt MIDI message, play incident file and adopt MIDI file.Certainly, the drilling of the present invention
The event of playing is not limited in a kind of this form of MIDI message, as long as can explicitly identify musical notes and playing time it
Between relation performance event or play instruction, all within the scope of the present invention.For convenience of description, in enforcement below
All performance event is represented with MIDI message, MIDI representation of file plays incident file in example.
MIDI (Musical Instrument Digital Interface, musical instrument digital interface) is an industrial standard
Electronic communication protocol, MIDI transmits note, the instruction of the non-acoustic signal such as control parameter, for indicating MIDI equipment
Interaction between operation and control MIDI equipment.
MIDI file is typically the command file with .mid for ending, when these instructions can include the beginning of certain note
Between, the information such as end time.Under normal circumstances, the MIDI file of standard is substantially made up of two parts：Head block and track block,
Head block consumption describes the essential information of whole MIDI file；Track block then comprises a series of MIDI number being made up of MIDI message
According to stream.MIDI is international technical norms (The Complete MIDI 1.0Detailed Specification), by " MIDI
Device fabrication NAB National Association 0f Broadcasters " issue.The occupation mode of MIDI message and MIDI file is all on the books in handbook, therefore in this reality
Apply in example and repeat no more.As long as can by MIDI message save as MIDI file mode all within the scope of the present invention.
In the present embodiment, electronic equipment 110 can obtain performance event in the following way or play incident file：
First, electronic equipment 110 is an intelligent terminal, it passes through APP mounted thereto, according to playing the music score of Chinese operas, directly
Obtain corresponding performance event in real time；Or the multiple performance composition of matter obtaining are saved as performance incident file.
Wherein, intelligent terminal include memory, Memory Controller, one or more processors (CPU), interface circuit,
RF (radio frequency) circuit, voicefrequency circuit, loudspeaker, microphone, input/output (I/O) subsystem, touch display screen, other outputs
Or control device, and outside port.These assemblies are communicated by one or more communication bus or holding wire.Equipment can
To be any portable electric appts, including but not limited to notebook computer, panel computer, smart mobile phone, multimedia player,
Personal digital assistant (PDA) etc. is it is also possible to include wherein two or multinomial combination.It should be appreciated that enumerating in the present embodiment
Equipment be intelligent terminal an example, the assembly of this equipment can have more or less of group than provide in diagram
Part, or there are different component Configurations.Various assemblies shown in figure can be with the combination of hardware, software or software and hardware Lai real
Existing, including one or more signal transacting and/or special IC.
For the APP being arranged on intelligent terminal, have a lot, for example at present：APP under ios platform：BAND4U-
TREE-PIANO-Drums-Guitar-All in one, here just no longer repeats one by one.
Second, electronic equipment 110 passes through electronic musical instrument and intelligent terminal cooperation is realized：Electronic musical instrument is to support performance event
The Multifunctional musical instrument of output, it can be become playing signal identification performance event and be exported by inductor；Intelligent terminal with
Electronic musical instrument is associated, for selecting playing information, the performance event of real-time reception electronic musical instrument output；Or, by receive
Multiple performance composition of matter save as performance incident file.
Intelligent terminal is associated with electronic musical instrument, specifically refers to intelligent terminal and is connected with each other with electronic musical instrument, is capable of
Reading identification to the signal of electronic musical instrument output.Wherein, intelligent terminal both can be carried out by way of wired with electronic musical instrument
Connect, also can wirelessly be attached.
Further, the intelligent terminal that is associated with electronic musical instrument is it may even go so far that the drilling of the musical instrument output of the receipts that achieve a butt joint
The event of playing carry out corresponding output (by display image display or play in the form of audio frequency), what is more,
Mistake is passed judgment on to the corresponding musical notes of performance event can also be realized.
Third, electronic equipment directly adopts electronic musical instrument：Electronic musical instrument is directly and Cloud Server 120 passes through network connection.
Playing information can be directly selected by electronic musical instrument, the performance event of performance is sent directly to Cloud Server 120, or will be many
Individual performance composition of matter saves as performance incident file, and will play incident file and send to Cloud Server 120.
Later it is preferable that electronic musical instrument is using the many work(supporting MIDI OUT in the mode of two kinds of acquisition performance events
Energy musical instrument, can be become playing signal identification MIDI message and be exported by inductor.Under normal circumstances, electronic musical instrument all has
There is MIDI OUT interface.And, when electronic musical instrument is connected with Cloud Server 120 network, it also supports the synthesis of MIDI file.
Cloud Server 120 passes through network connection with electronic equipment 110, for Composite tone stream or audio file.Cloud service
Music score of Chinese operas information bank, tone color sampling rate and effect banks have been pre-saved in device 120.In music score of Chinese operas information bank preserve content include but not
It is limited to：Playing song information, play the music score of Chinese operas and background music etc., and play song information, the performance music score of Chinese operas and background music is
Mutually corresponding.The content that tone color sampling rate preserves includes but is not limited to：Timbre information and its corresponding tone color sample, and sound
Color information and tone color sample are also be mutually matched.And, in the background music and tone color sampling rate preserving in music score of Chinese operas information bank
The tone color sample preserving is the file of MP3 format.
Receive when Cloud Server 120 is MIDI message, then MIDI message is carried out audio mixing by Cloud Server 120 in real time
Process, Composite tone stream：Cloud Server 120 real-time reception playing information and MIDI message；Then according to the sound in playing information
Color information and MIDI message, extract corresponding tone color sample from tone color sampling rate；Finally, the sound that will extract according to MIDI message
Colo(u)r atlas synthesizes audio stream in real time.
Receive when Cloud Server 120 is MIDI file, then MIDI file is parsed and mixed by Cloud Server 120
Sound is processed, and synthesis compressed encoding generates audio file：Cloud Server 120 receives playing information and the MIDI being made up of MIDI message
File；Then parse MIDI file；According to the MIDI file of the timbre information in playing information and parsing, from tone color sampling rate
Extract corresponding tone color sample；Finally, the tone color sample extracting synthesis compressed encoding is audio frequency by the MIDI file according to parsing
File.
Further, Cloud Server 120 is in addition to can carrying out tone color sample synthesis by MIDI message or MIDI file,
MIDI message or MIDI file can also be carried out the synthesis of tone color sample and background music.
Cloud Server 120 real-time reception playing information and MIDI message；According to playing information, extract from music score of Chinese operas information bank
Corresponding background music, and by background music and MIDI message synchronization；Then extract corresponding tone color sample from tone color sampling rate
This；Finally, according to MIDI message, the tone color sample of extraction and background music are synthesized audio stream in real time.
Cloud Server 120 receives playing information and MIDI file；Extract correspondence according to playing information from music score of Chinese operas information bank
Background music；Parsing MIDI file, and the MIDI file of parsing is synchronous with background music；Then conciliate according to playing information
The MIDI file of analysis, extracts corresponding tone color sample from tone color sampling rate；Finally, according to parsing MIDI file by extract
Tone color sample and background music synthesis compressed encoding are audio file.
In the present embodiment, the audio frequency for MIDI file synthesizes, and the synthesis of its background music and tone color sample, compression are compiled
Code synchronously completes or is synthesized background music and tone color sample, then is compressed encoding and obtains
Audio file.Because Cloud Server 120 is in the building-up process to background music and tone color sample, it is all according to the parsing of MP3 frame
Synthesized for WAV formatted data, therefore, the result of its synthesis is also WAV form.But, also because same the reason, WAV
The file of form relatively also ratio larger, be highly detrimental to broadcasting and the transmission of network.Therefore, in the present embodiment, Cloud Server
120 conversions that also result of synthesis can be carried out with audio format, that is, carry out audio compression decoding process, generate audio file.?
In the present embodiment, the composite result of WAV form is compressed decoding by Cloud Server 120, generates the audio frequency literary composition of MP3 format
Part.Specifically the audio file that the composite result of WAV form is converted into MP3 format by compression coding is by Cloud Server 120
The technology of comparative maturity, be can achieve using corresponding Open-Source Tools and licensing.
Further, in order to ensure the result of broadcast of the audio stream after synthesizing or audio file, Cloud Server 120 is being carried out
In the building-up process of the building-up process of tone color sample or tone color sample and background music, also can carry out following process：Sound relatively
Amount adjusts, plays volume process and prevent distorsion from processing.
And, Cloud Server 120 is while synthesizing MIDI file with background music, also can generate portion and only comprise to use
The audio file of background accompaniment is played, is not comprised at family.
Additionally, electronic equipment that the audio stream of Cloud Server 120 synthesis or audio file are available for being attached thereto (and not only limit
In electronic equipment 110, can also be other electronic equipments with Cloud Server 120 network connection) downloaded in real time and listened to.
And when electronic equipment 110 uploads MIDI message in real time, during Cloud Server 120 real-time Composite tone stream, with Cloud Server 120 network
Connected electronic equipment can be with real time inspection and listening to audio composite result.
Embodiment 2
Present embodiment discloses a kind of audio frequency synthetic method being applied to Cloud Server, Cloud Server is passed through with electronic equipment
Network connection.As shown in Fig. 2 audio frequency synthetic method includes：
Step S21, receives playing information；
Playing information includes but is not limited to：Play song information and timbre information.Wherein, play song information to be used for uniquely
Ground mark playing music mesh, for example, playing music purpose title.Timbre information is used for describing user wishes to be played with which kind of sound.
For example, if the electronic musical instrument of use is percussion instrument, then timbre information describes the drum group style name that user wishes
Claim, for example：First set rock and roll rouses group, second set of popular drum group etc..
And, playing information is that user carries out selecting input by electronic equipment.
Step S22, receives MIDI file；
Wherein, MIDI file is that MIDI Message merging preserves and obtains.MIDI file is typically with .mid for ending
Command file, these instructions can include the information such as time started of certain note, end time, note characteristic information, is used for
Indicate the operation of MIDI equipment and control the interaction between MIDI equipment.
Step S23, parses described MIDI file：
Parsing obtains MIDI file, including but not limited to plays characteristic value and playing time point etc. in MIDI file.Its
In, play characteristic value and include but is not limited to playing strength, musical notes, note duration etc..
Step S24, according to the described MIDI file of parsing, extracts corresponding tone color sample：
Play characteristic value to can be used for identifying tone color sample.According to timbre information, playing characteristic value is and tone color sample
This is corresponding.Therefore, corresponding tone color sample can be obtained in tone color sampling rate according to performance characteristic value and timbre information.
Step S25, by the tone color sample extracting synthesis, simultaneously compression coding is audio file.
Further, the audio frequency synthetic method of the present embodiment also background music can be blended in audio file, specifically：
In the step s 21, also include：Extract corresponding background music according to described playing information：
According to the performance song information in playing information, music score of Chinese operas information bank selects corresponding background music.
In step S23, in addition to parsing MIDI file, also need to enter the result of the MIDI file of parsing with background music
Row is synchronous：
Parsing MIDI file, obtains corresponding performance characteristic value on each time point, calculates this time point corresponding
The absolute time point of background music.
In step s 25, synthesize compression coding for audio file by corresponding with tone color sample for the background music extracting：
When background music is for MP3 format, background music is split according to MP3 frame；
For each MP3 frame of background music, by the corresponding tone color sample played corresponding to characteristic value and background sound
Pleasure is synthesized, and the composite result of a MP3 frame is preserved as a part for audio file.When owning of background music
After MP3 frame is all synthesized with corresponding tone color sample, the result of synthesis is compressed decoding and is formed for audio file.
With regard to the compression coding of audio frequency, it is the technology of comparative maturity at present, here just repeats no more.As long as can be right
Audio file is compressed the method decoding, all within the scope of the present invention.
Below so that the MIDI message being exported by electroacoustic frame drum preserves the MIDI file obtaining as a example, to further illustrate
The parsing of MIDI file and the synthesis of background music and tone color sample.
Because MIDI file is that therefore MIDI file just describes under different time points with respect to electroacoustic frame drum,
The corresponding drum triggered by percussion, and tap the dynamics used by this drum.
Parse this MIDI file, obtain playing time point, the drum tapping, dynamics of percussion etc..According to background music, can
To obtain the absolute time point of the background music with respect to MP3 format and to play characteristic value, this performance characteristic value is corresponding percussion
Drum and tap dynamics.
Then according to the MIDI file of parsing, extract corresponding tone color sample, and the priority of the MP3 frame according to background music
Sequentially, the tympanitic note rail of synchronous decoding background music track and electroacoustic frame drum, and background music and corresponding tone color sample are entered
Row synthesis：
For the current MP3 frame of background music, can be known by the MIDI file parsing, the current MP3 of background music
Drum whether is had to be tapped at absolute time point corresponding to frame；And in the case of having drum to be tapped, be one or many
Individual drum is tapped simultaneously：
In the case of there is no drum sounding, then directly parse the current MP3 frame of the corresponding background music of this time point,
The data obtaining after parsing is WAV form, the data of WAV form is preserved or is compressed encoding by WAV formatted data
Preserved；
In the case that a drum is tapped, then when the timbre information selecting is drum group style " rock and roll style 1 ",
The inevitable tone color sample uniquely corresponding to a MP3 format of army's drum being tapped；The synchronous parsing corresponding background sound of this time point
Happy MP3 frame and the first frame of tone color sample, the data after parsing is WAV form；Background music and tone color sample will be parsed
The data obtaining is carried out plus computing, and by plus the result of computing is preserved or the result adding computing is compressed coding and given
Preserve；
In the case of having multiple drums to be tapped at the same time, then organize style " rock and roll wind in the timbre information selecting for drum
During lattice 1 ", obtain the tone color sample of the army's drum being tapped and the MP3 format corresponding to small cymbals piece respectively；Synchronous this time point pair of parsing
The MP3 frame of the background music answered and the first frame of the multiple tone color samples obtaining, the data after parsing is WAV form；To solve
The data of analysis background music and the acquisition of multiple tone color sample is carried out plus computing, and the result adding computing is preserved or will add fortune
The result calculated is compressed coding and is preserved；
The next frame MP3 frame being directed to background music again carries out background music and the conjunction of tone color sample according to above step
Become；Until the tone color sample corresponding to background music and its corresponding MIDI file is all synthesized.The knot of final synthesis
Fruit shape becomes complete audio file.
Additionally, in order to ensure the effect synthesizing, in the building-up process of background music and tone color sample, also can carry out relatively
Volume adjusting, performance volume process and prevent distorsion process etc..Wherein,
Relative volume adjusts and refers to automatically adjust background music volume and tone color sample according to the volume intensity of background music
The proportioning of volume.Thus realizing background music volume and the volume of tone color sample can proportionally be increased and decreased.In this enforcement
In example, the method that it is adjusted is before the Data Synthesis of each MP3 frame, the data to the background music parsing and tone color sample
Carry out linear operation respectively.Relatively common is that the data of the background music of parsing and tone color sample is multiplied by corresponding ratio respectively
Example parameter.
Play volume and process the broadcast sound volume to adjust tone color sample for the playing strength referring to foundation player.For electroacoustic
For frame drum, percussion dynamics can affect the broadcast sound volume of final tone color sample.In the present embodiment, for the dynamics of percussion
Processing Algorithm is：Percussion power angle value according to record in MIDI file：0-127, the number to the tone color sample corresponding to present frame
According to linearly being calculated accordingly.
The data that distorsion process is to each frame after synthesis is prevented to be made whether to exceed the process of threshold value, if it exceeds threshold
Value, then directly play and arise that distorsion.In this case slicing process is carried out to this frame data exceeding threshold value, thus
Effectively prevent the appearance of distorsion.
Additionally, Cloud Server, while synthesis comprises the audio file of background music, also can generate one and only wrap simultaneously
The audio file of background music played, comprise containing user.And, after generating these audio files, can automatically give birth to
An ID is become to feed back to transmitting element；User shares this No. ID, can automatically link to the URL (Uniform of the audio file of synthesis
Resource Locator, URL), thus realizing user to play sharing of result.And, provide bag simultaneously
Audio file containing background accompaniment and and do not comprise the audio file of background music, improve the diversity of sharing contents, make
The page must be shared and both can play the effect that many musical instruments play together it is also possible to that sound of playing an instrument of independent listening player
Rail.
Further, Cloud Server also can send generating audio file to the electronic equipment being attached thereto, so that
User can inquire about the effect of audio frequency synthesis by electronic equipment.
The step of above method divides, and is intended merely to describe clear, can merge into a step or to certain when realizing
A little steps are split, and are decomposed into multiple steps, as long as comprising identical logical relation, all in the protection domain of this patent；
To adding inessential modification in algorithm or in flow process or introducing inessential design, but do not change its algorithm and stream
The core design of journey is all in the protection domain of this patent.
Embodiment 3
Present embodiment discloses a kind of audio frequency synthetic method being applied to Cloud Server, Cloud Server is passed through with electronic equipment
Network connection.As shown in figure 3, audio frequency synthetic method includes：
Step S31, receives playing information；
Playing information includes but is not limited to：Play song information and timbre information.Wherein, play song information to be used for uniquely
Ground mark playing music mesh, for example, playing music purpose title.Timbre information is used for describing user wishes to be played with which kind of sound.
For example, if the electronic musical instrument of use is percussion instrument, then timbre information describes the drum group style name that user wishes
Claim, for example：First set rock and roll rouses group, second set of popular drum group etc..
And, playing information is that user carries out selecting input by electronic equipment.
Step S32, real-time reception MIDI message；
Wherein, MIDI message is formed by playing characteristic value, wherein, plays characteristic value and includes but is not limited to musical notes, drills
Play dynamics and note duration, the relation between musical notes and playing time can be obtained by MIDI message.
Step S33, according to MIDI message, extracts corresponding tone color sample in tone color sampling rate：
Play characteristic value to can be used for identifying tone color sample.According to timbre information, playing characteristic value is and tone color sample
This is corresponding.Therefore, corresponding tone color sample can be obtained in tone color sampling rate according to performance characteristic value and timbre information.
Step S34, according to MIDI message, the tone color sample of extraction is synthesized audio stream in real time.
Further, the audio frequency synthetic method of the present embodiment also background music can be blended in audio stream, specifically：
In step S31, also include：Extract corresponding background music according to described playing information：
According to the performance song information in playing information, music score of Chinese operas information bank selects corresponding background music.
In step s 32, after have received MIDI message, also need to synchronize MIDI message and background music：
MIDI message is corresponding performance characteristic value on some time point in fact, calculates the corresponding back of the body of this time point
The absolute time point of scape music.
In step S33, synthesize audio stream by corresponding with tone color sample for the background music of extraction：
When background music is for MP3 format, background music is split according to MP3 frame；
For each MP3 frame of background music, enter playing characteristic value with corresponding tone color sample and background music
Row synthesis, and the composite result of a MP3 frame is as an audio stream.
According to MIDI message, by the building-up process of the background music extracting and tone color sample and the mistake disclosed in embodiment 2
Cheng Xiangtong, here just repeats no more.
And, it is identical with the audio frequency synthetic method of MIDI file, in the building-up process of background music and tone color sample, also
Relative volume regulation can be carried out, play volume process and prevent distorsion from processing etc..Relative volume adjusts, plays volume process
And prevent the process that distorsion is processed also identical with the process disclosed in embodiment 2.
Further, the audio stream of synthesis also can be supplied to the electronic equipment being attached thereto and be looked into online by Cloud Server
Ask or audition, so that user's real-time listening to audio composite result.
The step of above method divides, and is intended merely to describe clear, can merge into a step or to certain when realizing
A little steps are split, and are decomposed into multiple steps, as long as comprising identical logical relation, all in the protection domain of this patent；
To adding inessential modification in algorithm or in flow process or introducing inessential design, but do not change its algorithm and stream
The core design of journey is all in the protection domain of this patent.
Embodiment 4
Present embodiment discloses a kind of Cloud Server for Composite tone file, and Cloud Server 120 and electronic equipment
120 pass through network connection.As shown in figure 4, Cloud Server 120 includes：
Transport module 410, for realizing the data transfer and electronic equipment 110 between；Wherein, data transfer includes：Connect
Receive the playing information that electronic equipment 110 uploads, MIDI message or MIDI file that real-time reception electronic equipment 110 uploads, and
Send to electronic equipment 110 and play the music score of Chinese operas and audio stream/audio file；Wherein, described playing information includes playing song information
And timbre information；
Analyzing sub-module 411 is also included, for parsing MIDI file in transport module 410.
Memory module 420, for preserving music score of Chinese operas information bank, tone color sampling rate and effect banks；Wherein, protect in music score of Chinese operas information bank
The content deposited includes but is not limited to：Play song information, play the music score of Chinese operas and background music etc..The content that tone color sampling rate preserves
Including but not limited to：Timbre information and its corresponding tone color sample.
Extraction module 430, plays the music score of Chinese operas and tone color sample for extracting from described memory module；Believe according to playing song
Breath, extracts from music score of Chinese operas information bank and plays the music score of Chinese operas；According to timbre information and MIDI message, or the MIDI of timbre information and parsing
File, extracts corresponding tone color sample.
Synthesis module 440, for synthesizing audio stream according to MIDI message in real time by extracting tone color sample, or according to parsing
MIDI file by extract tone color sample synthesis and compression coding be audio file.
Further, extraction module 430 is additionally operable to, according to playing song information, extract background sound from music score of Chinese operas information bank
Happy；
Synthesis module 440 is additionally operable to background music and MIDI message synchronization, then will extract tone color sample according to MIDI message
This and background music synthesize audio stream in real time；Or, by the MIDI file synchronization of background music and parsing, then according to parsing
MIDI file synthesizes the tone color sample extracting and background music and compression coding is audio file.
Wherein, synthesis module 440 also includes：
Relative volume adjusts submodule 441, for adjusting the volume of figure viewed from behind music and tone color sample in proportion；
Play volume and process submodule 442, adjust for the playing strength in the MIDI file according to MIDI message or parsing
The performance volume of section tone color sample；
Slicing submodule 443, for carrying out slicing process to data distorsion.
It should be noted that for the innovative part projecting the present invention, will not be with the solution present invention in the present embodiment
The less close module of the technical problem relation that proposed introduces, but this is not intended that in the present embodiment there are not other moulds
Block.
It is seen that, the present embodiment is the system embodiment corresponding with second embodiment or 3rd embodiment, this reality
Apply example to work in coordination enforcement with second embodiment or 3rd embodiment.Mention in second embodiment or 3rd embodiment
Relevant technical details are still effective in the present embodiment, in order to reduce repetition, repeat no more here.Correspondingly, in the present embodiment
The relevant technical details mentioned are also applicable in second embodiment or 3rd embodiment.
Embodiment 5
Present embodiment discloses a kind of audio frequency synthetic method, it is applied to set by the electronics of network connection with Cloud Server
Standby.
As shown in figure 5, the audio frequency synthetic method of the present embodiment includes：
Step S51, selects playing information；Wherein, playing information includes playing song information and timbre information.
Step S52, obtains MIDI message in real time according to playing information；The MIDI file of composition：
Wherein, MIDI message is formed by playing characteristic value, wherein, plays characteristic value and includes but is not limited to musical notes, drills
Play dynamics and note duration, the relation between musical notes and playing time can be obtained by MIDI message.
And, do not limit the mode (referring to embodiment 1) that electronic equipment obtains MIDI message in the present embodiment.
Step S53, MIDI message and playing information is uploaded to Cloud Server in real time, so that Cloud Server realizes foundation
The real-time synthesis of the audio stream of MIDI message.
Step S54, downloads audio stream from Cloud Server and/or plays the music score of Chinese operas.Wherein, audio stream is Cloud Server foundation
MIDI message carries out audio frequency synthesis and obtains, and playing the music score of Chinese operas is according to the performance music score of Chinese operas information bank from Cloud Server for the song information
Middle download obtains.
Additionally, also including in step S52：The multiple MIDI message combinations obtaining are saved as MIDI file.MIDI is disappeared
The technology that breath saves as MIDI file is prior art, will not be described here.
Corresponding, step S53 also includes, by MIDI files passe to Cloud Server.Cloud Server can foundation
MIDI file carries out the synthesis of audio file.
So, in step S54, the data downloaded from Cloud Server also includes audio file.
The step of above method divides, and is intended merely to describe clear, can merge into a step or to certain when realizing
A little steps are split, and are decomposed into multiple steps, as long as comprising identical logical relation, all in the protection domain of this patent；
To adding inessential modification in algorithm or in flow process or introducing inessential design, but do not change its algorithm and stream
The core design of journey is all in the protection domain of this patent.
Embodiment 6
Present embodiment discloses a kind of electronic equipment 110, electronic equipment 110 and Cloud Server 120 are by network connection.
As shown in fig. 6, electronic equipment 110 includes：
Selecting module 610, for selecting playing information to be performed, wherein, playing information includes but is not limited to playing music
Mesh information and timbre information.
Acquisition module 620, obtains MIDI message in real time according to described playing information；Acquisition is made up of MIDI message
MIDI file.
Composite module 630, for saving as MIDI file by the multiple MIDI message combinations obtaining.
Transport module 640, for realizing the data transfer and described Cloud Server between；Wherein, described data transfer bag
Include：Download the described performance song information corresponding performance music score of Chinese operas, audio file or audio stream from described Cloud Server, and to institute
State Cloud Server and upload playing information, MIDI message/MIDI file in real time；Wherein, audio stream is that Cloud Server disappears according to MIDI
Breath carries out real-time audio synthesis and obtains；During audio file, Cloud Server carries out audio frequency synthesis and obtains according to MIDI file.
Additionally, this electronic equipment also can coordinate the auxiliary inquiry learning carrying out musical instrument：
The performance music score of Chinese operas of the audio file of synthesis and standard is compared by electronic equipment, can easily judge performance
Accuracy.Further, the related data of performance accuracy can also be will determine that, for example：Play total score, maximum double hit number, drill
Play the data of correct note and quantity of performance error note etc. and be uploaded to Cloud Server, be used for sharing.
It should be noted that for the innovative part projecting the present invention, will not be with the solution present invention in the present embodiment
The less close module of the technical problem relation that proposed introduces, but this is not intended that in the present embodiment there are not other moulds
Block.
It is seen that, the present embodiment is the system embodiment corresponding with the 5th embodiment, and the present embodiment can be real with the 5th
Apply example to work in coordination enforcement.The relevant technical details mentioned in 5th embodiment are still effective in the present embodiment, in order to reduce
Repeat, repeat no more here.Correspondingly, the relevant technical details mentioned in the present embodiment are also applicable in the 5th embodiment.
In sum, a kind of audio synthesis system of the present invention, method and its electronic equipment and Cloud Server, electronic equipment
Directly the real-time MIDI message (performance event) played is uploaded to Cloud Server, or multiple MIDI message are saved as MIDI literary composition
Part (performance incident file), and MIDI file is uploaded to Cloud Server using network, in real time MIDI is disappeared using Cloud Server
Breath synthesizes audio stream, or MIDI file is carried out parsing, synthesizes and compression coding generates final audio file.The present invention
Directly MIDI message is uploaded to Cloud Server in real time；And it is synthesized sound according to the MIDI message receiving by Cloud Server in real time
Frequency flows, it is achieved thereby that the real-time sharing of the performance event of electronic equipment；The electronic equipment of the present invention also can be by by MIDI message
The MIDI files passe of composition, to Cloud Server, greatlys save network uplink time compared to the direct audio-frequency information that uploads；Right
Synthesis process in MIDI message or MIDI file is carried out in Cloud Server, reduces to the mobile end as transmitting element
The system resource at end (electronic equipment) requires, and improves stability；And, because the configuration of Cloud Server is typically all higher,
Disposal ability is stronger, and speed MIDI message or MIDI file being synthesized to process is also relatively fast, shortens audio frequency conversion
Time；And, the resource of Cloud Server can also be made full use of by electronic equipment；Tone color is provided to adopt in the Cloud Server of the present invention
Sample storehouse and effect banks are so that Timbre Synthesis more personalized and variation；The Cloud Server of the present invention, when audio frequency synthesizes, passes through
Background music and the volume played rationally arrange and generate the mode of independent musical instrument track, reach the prominent track that plays an instrument,
And prevent the purpose of audio-frequency harmonic distortion；The Cloud Server of the present invention is also recordable and preserves the data file that user plays, and increased
Game and element of entertainment are it is also possible to for musical instrument teaching, its range of application is more extensive.So, the present invention effectively overcomes existing
The various shortcoming in technology is had to have high industrial utilization.
Above-described embodiment only principle of the illustrative present invention and its effect, not for the restriction present invention.Any ripe
The personage knowing this technology all can carry out modifications and changes without prejudice under the spirit and the scope of the present invention to above-described embodiment.Cause
This, those of ordinary skill in the art is complete with institute under technological thought without departing from disclosed spirit such as
All equivalent modifications becoming or change, must be covered by the claim of the present invention.
Claims (26)
1. a kind of audio synthesis system is it is characterised in that described audio synthesis system includes：Electronic equipment and Cloud Server；Its
In,
Described electronic equipment, for selecting playing information, and obtains performance event in real time according to playing information, and by playing information
Upload to Cloud Server with the real-time performance event obtaining；Wherein, playing information includes playing song information and timbre information；Drill
The event of playing includes the relation of musical notes and playing time under playing song information；
Described Cloud Server passes through network connection with described electronic equipment, for real-time reception playing information and performance event, and
Performance event and corresponding tone color sample are synthesized audio stream in real time；Wherein, tone color sample is and performance event and tone color letter
Manner of breathing closes.
2. audio synthesis system according to claim 1 it is characterised in that：
Described electronic equipment is additionally operable to for the multiple performance composition of matter obtaining to save as performance incident file, and will play event
File sends to described Cloud Server；
Described Cloud Server is additionally operable to receive plays incident file, will be corresponding according to playing information and performance incident file
Tone color sample synthesizes audio file.
3. audio synthesis system according to claim 1 it is characterised in that：Performance event is MIDI message；Performance event
File is MIDI file.
4. audio synthesis system according to claim 2 it is characterised in that：Prestore in described Cloud Server music score of Chinese operas information bank
With tone color sampling rate；And preserve in described music score of Chinese operas information bank：Play song information and play the music score of Chinese operas；In described tone color sampling rate
Preserve：Timbre information and tone color sample.
5. audio synthesis system according to claim 4 it is characterised in that：Described Cloud Server real-time reception plays event
And playing information；According to the event of performance and timbre information, extract corresponding tone color sample in described tone color sampling rate, and will carry
The tone color sample taking synthesizes audio stream in real time.
6. audio synthesis system according to claim 4 it is characterised in that：Described cloud server playing information and drilling
Play incident file；Incident file is played in parsing；According to performance incident file and the timbre information of parsing, in described tone color sampling rate
The corresponding tone color sample of middle extraction, and simultaneously compression coding is audio file by corresponding for the tone color sample extracting synthesis.
7. audio synthesis system according to claim 4 it is characterised in that：The described music score of Chinese operas information bank of described Cloud Server
In also preserve background music, described background music to described performance song information related.
8. audio synthesis system according to claim 7 it is characterised in that：Described Cloud Server real-time reception plays event
And playing information；Extract corresponding background music；Synchronous performance event and background music；According to the event of performance and timbre information,
Extract corresponding tone color sample in described tone color sampling rate, and the tone color sample of extraction and background music are synthesized sound in real time
Frequency flows.
9. audio synthesis system according to claim 7 it is characterised in that：Described cloud server plays incident file
And playing information；Extract corresponding background music；Incident file is played in parsing, and synchronizes with background music；According to parsing
Described performance incident file and described timbre information, extract corresponding tone color sample in described tone color sampling rate, and will carry
Simultaneously compression coding is audio file for the background music taking synthesis corresponding with tone color sample.
10. a kind of audio frequency synthetic method it is characterised in that：It is applied to the Cloud Server by network connection with electronic equipment；Institute
State audio frequency synthetic method to include：
Receive the playing information from described electronic equipment；Wherein, playing information includes playing song information and timbre information；
Real-time reception is played event or is played incident file, wherein, plays incident file and is made up of the event of performance, play event package
Include the relation of musical notes and playing time under playing song information；
Corresponding tone color sample is extracted in tone color sampling rate；
According to performance event, the tone color sample of extraction is synthesized audio stream in real time；Or the sound that foundation performance incident file will extract
Simultaneously compression coding is audio file for colo(u)r atlas synthesis.
11. audio frequency synthetic methods according to claim 10 it is characterised in that：The described sound that will extract according to the event of performance
Colo(u)r atlas synthesizes audio stream in real time；Or by the tone color sample extracting synthesis, simultaneously compression coding is audio frequency according to playing incident file
The step of file also includes：Play volume to process and prevent distorsion from processing.
12. audio frequency synthetic methods according to claim 10 it is characterised in that：Described real-time reception plays event or performance
In the step of incident file, when receiving as playing incident file, to parse to playing incident file.
13. audio frequency synthetic methods according to claim 10 it is characterised in that：Extract in the described sampling rate in tone color and correspond to
The step of tone color sample also include：Extract corresponding background music according to playing information.
14. audio frequency synthetic methods according to claim 13 it is characterised in that：The described sound that will extract according to the event of performance
Colo(u)r atlas synthesizes audio stream in real time；Or by the tone color sample extracting synthesis, simultaneously compression coding is audio frequency according to playing incident file
The step of file includes：
Event will be played or play incident file and background music synchronization：With respect to the absolute time point of background music, acquisition is drilled
The performance characteristic value played event or play incident file；
According to performance event, the tone color sample of extraction and background music are synthesized audio stream in real time；Or according to performance incident file
The tone color sample extracting and background music are synthesized and compression coding is audio file.
15. audio frequency synthetic methods according to claim 14 it is characterised in that：Described background music is MP3 format, then
The synthesis compression coding of audio file includes：
Background music is split according to MP3 frame；
For each MP3 frame, play characteristic value and timbre information extraction tone color sample according to this MP3 frame is corresponding；Synthesis carries
The tone color sample taking and this MP3 frame of background music；
After all MP3 frames of background music and corresponding tone color sample are all synthesized, and compression coding obtains described audio frequency literary composition
Part.
16. audio frequency synthetic methods according to claim 14 it is characterised in that：The described sound that will extract according to the event of performance
Colo(u)r atlas and background music synthesize audio stream in real time；Or according to play incident file by extract tone color sample and background music
Simultaneously compression coding also includes for the step of audio file for synthesis：Relative volume adjusts, plays volume process and prevent at distorsion
Reason.
17. audio frequency synthetic methods according to claim 10 it is characterised in that：Described performance event is MIDI message；Institute
Stating performance incident file is MIDI file.
18. audio frequency synthetic methods according to claim 10 it is characterised in that：Described audio frequency synthetic method also includes：To
Described electronic equipment sends audio stream or the audio file of synthesis in real time.
A kind of 19. Cloud Servers it is characterised in that：It passes through network connection with electronic equipment, and described Cloud Server includes：
Transport module, for realizing the data transfer and described electronic equipment between；Wherein, described data transfer includes：Receive
The playing information that described electronic equipment uploads, the performance event that electronic equipment described in real-time reception uploads or performance incident file,
And send the performance music score of Chinese operas and audio stream/audio file to described electronic equipment；Wherein, playing information includes playing song information
And timbre information；Play incident file be made up of the event of performance, performance event include play song information under musical notes and
The relation of playing time；
Memory module, for preserving music score of Chinese operas information bank, tone color sampling rate；
Extraction module, plays the music score of Chinese operas and tone color sample for extracting in described memory module；
Synthesis module, for synthesizing audio stream according to performance event in real time by the tone color sample of extraction；Or according to the event of performance
By the tone color sample extracting synthesis and compression coding is audio file to file.
20. Cloud Servers according to claim 19 it is characterised in that：Described transport module also includes analyzing sub-module,
For parsing to the performance incident file receiving.
21. Cloud Servers according to claim 19 it is characterised in that：
Described extraction module also includes extracting background music from described memory module according to playing information；
Described synthesis module is used for, according to performance event, the tone color sample of extraction and background music are synthesized audio stream in real time；Or
According to playing, the tone color sample extracting and background are synthesized by incident file and compression coding is audio file.
A kind of 22. audio frequency synthetic methods it is characterised in that：It is applied to the electronic equipment by network connection with Cloud Server；Institute
State audio frequency synthetic method to include：
Select playing information；Wherein, playing information includes playing song information and timbre information；
Obtain performance event according to playing information in real time；Wherein, performance event include play song information under musical notes and
The relation of playing time；
Performance event and playing information are uploaded to described Cloud Server in real time.
23. audio frequency synthetic methods according to claim 22 it is characterised in that：Described audio frequency synthetic method also includes：From
Described Cloud Server is downloaded and is played the music score of Chinese operas；Wherein, playing the music score of Chinese operas is according to the performance music score of Chinese operas from described Cloud Server for the song information
Acquisition is downloaded in information bank.
24. audio frequency synthetic methods according to claim 22 it is characterised in that：Described audio frequency synthetic method also includes：
The real-time multiple performance composition of matter obtaining are formed and plays incident file；
Performance incident file and playing information are uploaded to described Cloud Server.
25. a kind of electronic equipments it is characterised in that：Pass through network connection with Cloud Server, described electronic equipment includes：
Selecting module, for selecting playing information to be performed, wherein, playing information includes playing song information and tone color letter
Breath；
Acquisition module, obtains performance event in real time according to playing information；Wherein, performance event includes drilling under playing song information
Play the relation of note and playing time；
Transport module, for realizing the data transfer and described Cloud Server between；Wherein, described data transfer includes：From institute
State Cloud Server and download the performance song information corresponding performance music score of Chinese operas, and upload playing information and performance to described Cloud Server
Event.
26. electronic equipments according to claim 25 it is characterised in that：Described electronic equipment also includes：Composite module, uses
Play incident files in forming the multiple performance events obtaining；Described transport module is additionally operable to upload to described Cloud Server and drills
Play incident file.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610785900.0A CN106409282B (en) | 2016-08-31 | 2016-08-31 | Audio synthesis system and method, electronic equipment and cloud server thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610785900.0A CN106409282B (en) | 2016-08-31 | 2016-08-31 | Audio synthesis system and method, electronic equipment and cloud server thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106409282A true CN106409282A (en) | 2017-02-15 |
| CN106409282B CN106409282B (en) | 2020-06-16 |
Family
ID=58002095
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610785900.0A Active CN106409282B (en) | 2016-08-31 | 2016-08-31 | Audio synthesis system and method, electronic equipment and cloud server thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106409282B (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107863093A (en) * | 2017-11-03 | 2018-03-30 | 得理电子(上海)有限公司 | Pronunciation management method, apparatus, electronic musical instrument and storage medium |
| CN108665747A (en) * | 2017-04-01 | 2018-10-16 | 上海伍韵钢琴有限公司 | A kind of online piano training mate system and application method |
| US10311844B1 (en) | 2018-05-04 | 2019-06-04 | Peter T. Godart | Musical instrument recording system |
| CN110428798A (en) * | 2019-08-02 | 2019-11-08 | 湖南国声声学科技股份有限公司深圳分公司 | Voice and accompaniment synchronous method, bluetooth equipment, terminal and storage medium |
| CN112346698A (en) * | 2020-10-14 | 2021-02-09 | 维沃移动通信有限公司 | Audio processing method and device |
| CN113096621A (en) * | 2021-03-26 | 2021-07-09 | 平安科技（深圳）有限公司 | Music generation method, device and equipment based on specific style and storage medium |
| WO2023061330A1 (en) * | 2021-10-12 | 2023-04-20 | 腾讯音乐娱乐科技（深圳）有限公司 | Audio synthesis method and apparatus, and device and computer-readable storage medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1431648A (en) * | 2002-01-11 | 2003-07-23 | 雅马哈株式会社 | Performance data transmitting control appts. and electronic musical instrument able to obtain such performance data |
| US20040011187A1 (en) * | 2000-06-08 | 2004-01-22 | Park Kyu Jin | Method and system for group-composition in internet, and business method therefor |
| CN1495627A (en) * | 2002-09-24 | 2004-05-12 | ������������ʽ���� | Electronic musical system and electronic music play method |
| CN1737901A (en) * | 2004-08-16 | 2006-02-22 | 华为技术有限公司 | System for realizing voice service to syncretize background music and its method |
| CN1892812A (en) * | 2005-07-04 | 2007-01-10 | 雅马哈株式会社 | Tone synthesis apparatus and method |
| CN101662507A (en) * | 2009-09-15 | 2010-03-03 | 宇龙计算机通信科技(深圳)有限公司 | Method, system, server and electronic device for storing and downloading songs |
| CN102208203A (en) * | 2010-03-31 | 2011-10-05 | 雅马哈株式会社 | Content data reproduction apparatus, content data reproduction method and sound processing system |
| CN102568471A (en) * | 2011-12-16 | 2012-07-11 | 安徽科大讯飞信息科技股份有限公司 | Voice synthesis method, device and system |
| CN103503015A (en) * | 2011-04-28 | 2014-01-08 | 天锦丝有限公司 | System for creating musical content using a client terminal |
| CN105869614A (en) * | 2016-03-29 | 2016-08-17 | 北京精奇互动科技有限公司 | Audio file export method and device |
-
2016
- 2016-08-31 CN CN201610785900.0A patent/CN106409282B/en active Active
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040011187A1 (en) * | 2000-06-08 | 2004-01-22 | Park Kyu Jin | Method and system for group-composition in internet, and business method therefor |
| CN1431648A (en) * | 2002-01-11 | 2003-07-23 | 雅马哈株式会社 | Performance data transmitting control appts. and electronic musical instrument able to obtain such performance data |
| CN1495627A (en) * | 2002-09-24 | 2004-05-12 | ������������ʽ���� | Electronic musical system and electronic music play method |
| CN1737901A (en) * | 2004-08-16 | 2006-02-22 | 华为技术有限公司 | System for realizing voice service to syncretize background music and its method |
| CN1892812A (en) * | 2005-07-04 | 2007-01-10 | 雅马哈株式会社 | Tone synthesis apparatus and method |
| CN101662507A (en) * | 2009-09-15 | 2010-03-03 | 宇龙计算机通信科技(深圳)有限公司 | Method, system, server and electronic device for storing and downloading songs |
| CN102208203A (en) * | 2010-03-31 | 2011-10-05 | 雅马哈株式会社 | Content data reproduction apparatus, content data reproduction method and sound processing system |
| CN103503015A (en) * | 2011-04-28 | 2014-01-08 | 天锦丝有限公司 | System for creating musical content using a client terminal |
| CN102568471A (en) * | 2011-12-16 | 2012-07-11 | 安徽科大讯飞信息科技股份有限公司 | Voice synthesis method, device and system |
| CN105869614A (en) * | 2016-03-29 | 2016-08-17 | 北京精奇互动科技有限公司 | Audio file export method and device |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108665747A (en) * | 2017-04-01 | 2018-10-16 | 上海伍韵钢琴有限公司 | A kind of online piano training mate system and application method |
| CN107863093A (en) * | 2017-11-03 | 2018-03-30 | 得理电子(上海)有限公司 | Pronunciation management method, apparatus, electronic musical instrument and storage medium |
| CN107863093B (en) * | 2017-11-03 | 2022-01-07 | 得理电子(上海)有限公司 | Pronunciation management method, pronunciation management device, electronic musical instrument, and storage medium |
| US10311844B1 (en) | 2018-05-04 | 2019-06-04 | Peter T. Godart | Musical instrument recording system |
| CN110428798A (en) * | 2019-08-02 | 2019-11-08 | 湖南国声声学科技股份有限公司深圳分公司 | Voice and accompaniment synchronous method, bluetooth equipment, terminal and storage medium |
| CN110428798B (en) * | 2019-08-02 | 2021-08-10 | 湖南国声声学科技股份有限公司深圳分公司 | Method for synchronizing voice and accompaniment, Bluetooth device, terminal and storage medium |
| CN112346698A (en) * | 2020-10-14 | 2021-02-09 | 维沃移动通信有限公司 | Audio processing method and device |
| CN113096621A (en) * | 2021-03-26 | 2021-07-09 | 平安科技（深圳）有限公司 | Music generation method, device and equipment based on specific style and storage medium |
| CN113096621B (en) * | 2021-03-26 | 2024-05-28 | 平安科技（深圳）有限公司 | Music generation method, device, equipment and storage medium based on specific style |
| WO2023061330A1 (en) * | 2021-10-12 | 2023-04-20 | 腾讯音乐娱乐科技（深圳）有限公司 | Audio synthesis method and apparatus, and device and computer-readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106409282B (en) | 2020-06-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106409282A (en) | Audio frequency synthesis system and method, electronic device therefor and cloud server therefor | |
| US11138960B2 (en) | System and method for a networked virtual musical instrument | |
| CN104834642B (en) | Change the method, device and equipment of music deduction style | |
| CN103021401B (en) | Internet-based multi-people asynchronous chorus mixed sound synthesizing method and synthesizing system | |
| CN103607678B (en) | A kind of wireless synchronization audio amplifier | |
| CN101116136B (en) | Sound synthesis | |
| KR20160018710A (en) | Sound processing method and terminal device | |
| CN101131816B (en) | Audio file generation method, device and digital player | |
| CN107331378A (en) | Microphone | |
| CN107665703A (en) | The audio synthetic method and system and remote server of a kind of multi-user | |
| US20210082380A1 (en) | Enhanced System, Method, and Devices for Capturing Inaudible Tones Associated with Content | |
| CN107948623A (en) | Projecting apparatus and its music related information display methods | |
| CN107770628A (en) | One kind Karaoke realization method and system, intelligent household terminal | |
| CN104038774B (en) | Generate the method and device of ring signal file | |
| CN107438961A (en) | Data are transmitted using audible harmony | |
| JP2016507949A (en) | Track import and transfer | |
| CN102394860A (en) | Signal transmission system, method, computer program product and computer readable storage media | |
| CN105491302A (en) | Audio signal output method and device, terminal, and system | |
| WO2015055888A1 (en) | Network server for audio tracks | |
| CN111445742B (en) | Vocal music teaching system based on distance education system | |
| CN105869614B (en) | Audio file deriving method and device | |
| JP2021129127A (en) | Reception device, transmission device, reception method, transmission method, and program | |
| US20210367987A1 (en) | Live Broadcast Network Using Musical Encoding to Deliver Solo, Group or Collaborative Performances | |
| KR100928152B1 (en) | Karaoke system using karaoke mic having vibration function and method there of | |
| CN104269174B (en) | A kind of processing method and processing device of audio signal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CB03 | Change of inventor or designer information | ||
| CB03 | Change of inventor or designer information |
Inventor after: Zhang Guangzhong Inventor after: Cai Zhikang Inventor after: Zheng Wenjun Inventor after: Zhang Guowen Inventor before: Cai Zhikang |