CN105280170A

CN105280170A - Method and device for playing music score

Info

Publication number: CN105280170A
Application number: CN201510654129.9A
Authority: CN
Inventors: 李领昌; 苏治中
Original assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Current assignee: Beijing Baidu Netcom Science and Technology Co Ltd
Priority date: 2015-10-10
Filing date: 2015-10-10
Publication date: 2016-01-27

Abstract

The invention provides a method and a device for playing a music score. The method comprises the following steps: the music score provided by a user is obtained and identified; a corresponding music description file is generated; a corresponding music playing file is generated according to the music description file; matching search is carried out according to the name of the music score and a corresponding search result is obtained; if the search result comprises at least one playing version corresponding to the music score, the device selects one version from the music playing file or the at least one playing version and carries out playing; and if the search result does not comprise the playing version, the device plays the music playing file. Compared with the prior art, the method and the device can not only play the music playing file generated according to the music score, but also play the playing version corresponding to the name of the music score discovered through searching. The identified music score can be played with a plurality of musical instruments, so that the user experience is improved.

Description

The method and apparatus that a kind of music score is played

Technical field

The present invention relates to field of computer technology, especially, relate to mobile device technical field, particularly relate to the method and apparatus that a kind of music score is played.

Background technology

Improving constantly of the level of living along with people, more and more pay attention to self and follow-on interests fostering, wherein, music has become a kind of very general selection.The musical competence only played back better goes to know from experience enjoyment wherein and connotation, but there is no enough music knowledges when most of adult and child's learning music, be difficult to directly be reacted into music from patterned music score, therefore to identifying that the demand of the technology that music score is also played is more and more general.

But the music that the scheme that existing identification music score is also played is play can only be all synthesis version, can not search for the famous expert's classics playing correspondence and play version, this single musical performance form obviously can not meet the user's request that user promotes day by day.

Therefore, how to provide one can not only play synthesis version, can also search for and play classical music score playing method and the device of playing version, become one of those skilled in the art's problem needing solution badly.

Summary of the invention

The object of this invention is to provide a kind of method and apparatus played for music score.

According to an aspect of the present invention, provide a kind of method played for music score, wherein, the method comprises the following steps:

A. the music score that user provides is obtained;

B. identify described music score, generate corresponding music description document;

C. corresponding music playing file is generated according to described music description document;

D. carry out match search according to the music score title of described music score, obtain corresponding Search Results;

If the described Search Results of e comprises at least one corresponding with described music score play version, in described music playing file or at least one performance version described, a version is selected to play; If described Search Results does not comprise described performance version, play described music playing file.

According to another aspect of the present invention, additionally provide a kind of device played for music score, wherein, this device comprises with lower device:

First acquisition device, for obtaining the music score that user provides;

Recognition device, for identifying described music score, generates corresponding music description document;

Generating apparatus, for generating corresponding music playing file according to described music description document;

Searcher, carries out match search for the music score title according to described music score, obtains corresponding Search Results;

Music performance apparatus, if comprise at least one corresponding with described music score for described Search Results to play version, selects a version to play in described music playing file or at least one performance version described; If described Search Results does not comprise described performance version, play described music playing file.

Compared with prior art, the present invention has the following advantages:

1) user can not only play the music playing file generated according to music score identification, can also play the performance version corresponding with music score title searched, provide the diversity of Consumer's Experience;

2) multiple musical instrument can be used to play the music score identified, not only can be specified by user, and can play according to the musical instrument of music score characteristic matching one acquiescence, meet the demand of user learning with the same music score of different instrument playing, improve the experience of user;

3) when playing music score can the note that displays the play of animation in the position of music score, and the position of finger place keyboards for musical instruments, for Consumer's Experience provides better intuitive.

4) the performance version searched carries out correction feedback to the music description document generated and music playing file, improves the accuracy of music description document and music playing file, prevents from causing misleading to user, improve the experience of user further.

The present invention's typical application scenarios is as follows: during parental counseling child, music-book on pianoforte mobile phone is carried out taking pictures uploading, start OCR recognition function, pick out each note, clef and stave, then music description document is changed into, classical performance version is found by match search, or generate music playing file by music synthesis, finally, this performance version or music playing file are passed through handset earphone, loudspeaker plays back, while broadcasting music, mobile phone screen can demonstrate by animation form the note play, and the key position of musical instrument, thus help user learning music foundation knowledge, assisted user study is played, user's Step By Step is made to practise music, know from experience music enjoyment.

Accompanying drawing explanation

By reading the detailed description done non-limiting example done with reference to the following drawings, other features, objects and advantages of the present invention will become more obvious:

Fig. 1 illustrates the schematic diagram of the music score music performance apparatus according to one aspect of the invention;

Fig. 2 illustrates the schematic diagram of music score music performance apparatus in accordance with a preferred embodiment of the present invention;

Fig. 3 illustrates the animation effect figure of the performance display interface of music score music performance apparatus in accordance with a preferred embodiment of the present invention;

Fig. 4 illustrates the schematic flow sheet that music score is according to a further aspect of the present invention played;

Fig. 5 illustrates the schematic flow sheet that music score is in accordance with a preferred embodiment of the present invention played.

In accompanying drawing, same or analogous Reference numeral represents same or analogous parts.

Embodiment

Before in further detail exemplary embodiment being discussed, it should be mentioned that some exemplary embodiments are described as the process or method described as process flow diagram.Although operations is described as the process of order by process flow diagram, many operations wherein can be implemented concurrently, concomitantly or simultaneously.In addition, the order of operations can be rearranged.Described process can be terminated when its operations are completed, but can also have the additional step do not comprised in the accompanying drawings.Described process can correspond to method, function, code, subroutine, subroutine etc.

Within a context alleged " computer equipment ", also referred to as " computer ", refer to the intelligent electronic device that can be performed the predetermined process such as numerical evaluation and/or logical calculated process by operation preset program or instruction, it can comprise processor and storer, the survival instruction that prestores in memory is performed to perform predetermined process process by processor, or perform predetermined process process by the hardware such as ASIC, FPGA, DSP, or combined by said two devices and realize.Computer equipment includes but not limited to server, PC, notebook computer, panel computer, smart mobile phone etc.

Described computer equipment comprises subscriber equipment and the network equipment.Wherein, described subscriber equipment includes but not limited to computer, smart mobile phone, PDA etc.; The described network equipment includes but not limited to the server group that single network server, multiple webserver form or the cloud be made up of a large amount of computing machine or the webserver based on cloud computing (CloudComputing), wherein, cloud computing is the one of Distributed Calculation, the super virtual machine be made up of a group loosely-coupled computing machine collection.Wherein, described computer equipment isolated operation can realize the present invention, also accessible network by realizing the present invention with the interactive operation of other computer equipments in network.Wherein, the network residing for described computer equipment includes but not limited to internet, wide area network, Metropolitan Area Network (MAN), LAN (Local Area Network), VPN etc.

It should be noted that; described subscriber equipment, the network equipment and network etc. are only citing; other computer equipments that are existing or that may occur from now on or network, as being applicable to the present invention, within also should being included in scope, and are contained in this with way of reference.

Method (some of them are illustrated by process flow diagram) discussed below can be implemented by hardware, software, firmware, middleware, microcode, hardware description language or its combination in any.When implementing by software, firmware, middleware or microcode, program code or code segment in order to implement necessary task can be stored in machine or computer-readable medium (such as storage medium).(one or more) processor can implement necessary task.

Concrete structure disclosed herein and function detail are only representational, and are the objects for describing exemplary embodiment of the present invention.But the present invention can carry out specific implementation by many replacement forms, and should not be construed as only being limited to the embodiments set forth herein.

Should be understood that, although may have been used term " first ", " second " etc. here to describe unit, these unit should not limit by these terms.These terms are used to be only used to a unit and another unit to distinguish.For example, when not deviating from the scope of exemplary embodiment, first module can be called as second unit, and second unit can be called as first module similarly.Here used term "and/or" comprise one of them or more any and all combinations of listed associated item.

Should be understood that, when a unit is called as " connection " or " coupling " to another unit, it can directly connect or be coupled to another unit described, or can there is temporary location.On the other hand, " when being directly connected " or " directly coupled " to another unit, then there is not temporary location when a unit is called as.Should explain in a comparable manner the relation be used between description unit other words (such as " and be in ... between " compared to " and be directly in ... between ", " with ... contiguous " compared to " and with ... be directly close to " etc.).

Here used term is only used to describe specific embodiment and be not intended to limit exemplary embodiment.Unless context refers else clearly, otherwise singulative used here " ", " one " are also intended to comprise plural number.It is to be further understood that, the existence of the feature that term used here " comprises " and/or " comprising " specifies to state, integer, step, operation, unit and/or assembly, and do not get rid of and there is or add other features one or more, integer, step, operation, unit, assembly and/or its combination.

Also it should be mentioned that and to replace in implementation at some, the function/action mentioned can according to being different from occurring in sequence of indicating in accompanying drawing.For example, depend on involved function/action, in fact the two width figure in succession illustrated can perform simultaneously or sometimes can perform according to contrary order substantially.

Below in conjunction with accompanying drawing, the present invention is described in further detail.

Fig. 1 illustrates the schematic diagram of the music score music performance apparatus according to one aspect of the invention.Music score music performance apparatus 1 comprises the first acquisition device 101, recognition device 102, generating apparatus 103, searcher 104 and music performance apparatus 105.

At this, music score music performance apparatus 1 such as can be arranged in computer equipment, and described computer equipment comprises subscriber equipment and the network equipment.When this music score music performance apparatus 1 is positioned at the network equipment, intercomed mutually by network between its with subscriber equipment, obtain the music score that user provides, identify described music score, generate corresponding music description document, corresponding music playing file is generated according to described music description document, and carry out match search according to the music score title of described music score, if search obtains at least one corresponding with described music score and plays version, a version is selected in described music playing file or at least one performance version described, return this subscriber equipment to play, described performance version is obtained if do not search for, this music description document is returned this subscriber equipment play.Be arranged in subscriber equipment for this music score music performance apparatus 1 to be below described in detail.

Wherein, the first acquisition device 101 obtains the music score that user provides.Particularly, the mode that described first acquisition device 101 obtains the music score that user provides includes but not limited to:

1) music score existed in a user device is obtained.Such as, this music score, by clicking in this subscriber equipment with the music score that the form such as picture stores, is provided to this first acquisition device 101 by user.

2) music score searched from network is obtained.Such as, user, by logging in the website of some search music score, selects the music score wanting to learn to play, is downloaded by this music score and be provided to this first acquisition device 101.

3) obtain and start the camera of subscriber equipment or other audio-visual input equipments and to take pictures the music score obtained.

4) music score obtained is scanned by scanister.

At this, the kind of described music score includes but not limited to: staff, six line spectrums, numbered musical notation.At this, the form of described music score can be printing music score, also can be the hand-written music score of user.

Those skilled in the art will be understood that the above-mentioned mode of acquisition music score, the kind of music score and form are only citing; other mode of acquisition music score that is existing or that may occur from now on, the kind of music score or forms are as being applicable to the present invention; also within scope should being included in, and this is contained at this with way of reference.

Recognition device 102 identifies described music score, generates corresponding music description document.Particularly, recognition device 102 identifies the music score obtained by the first acquisition device 101, to parse the word on each music element or music score that music score comprises, such as, parse the sound implication that each note, clef, stave in this music score comprise, thus generate music description document corresponding to music score.Preferably, recognition device 102 can carry out OCR (OpticalCharacterRecognition, optical character identification) identification to the music score got by the first acquisition device 101.Such as, recognition device 102 carries out pre-service, conversion chromatic image to steps such as black and white two-value picture, denoising, slant correction, element segments, element position judgement, elemental recognitions to the music score that the first acquisition device 101 gets, and generates the music description document that music score is corresponding after identifying music element.

At this, described OCR identifying can carry out in this locality also can carrying out beyond the clouds.

Preferably, recognition device 102 judges that the position of music element in described music score is to identify described music score, generates described music description document.Particularly, recognition device 102 uses the position of text detection systems axiol-ogy to each element in music score of improvement, and is detected by spectral line, judges the music elements such as note are between which spectral line, to identify described music score, generates described music description document.

Preferably, recognition device 102 utilizes element training pattern, determines the classification of described music element; Judge the position of described music element in described music score, in conjunction with described classification, identify described music score, and generate described music description document.Particularly, the music element that music score comprises by recognition device 102 builds storehouse, gather the sample of each music element some, by described sample training, such as, convolutional neural networks is utilized to train, subsequently, the element training pattern utilizing this to train, determines that it is classified after obtaining the good music element of single segmentation; And then, judge the position of described music element in described music score, such as, detected by spectral line, judge the music elements such as note are between which spectral line, then in conjunction with the classification of these music elements, identify described music score, and generate described music description document.

At this, the classification of music element includes but not limited to: five lines, note, G clef, F clef, C clef, mark of changing voice, slur, rest, trifle.

Preferably, recognition device 102, to described music element mark timestamp, generates described music description document.Such as, the music elements such as each note, syllable, pitch, liaison identify and mark timestamp by recognition device 102, this timestamp such as marks the time migration of length (duration) and relative this section of music reference position of this music element playing this music element, thus generates described music description document.

Preferably, recognition device 102 is according to the musical instrument feature of music score, and mark acquiescence musical instrument, generates the described music description document corresponding with described acquiescence musical instrument.Particularly, each music score such as can have the musical instrument feature of its correspondence, if piano is duplicate rows spectrum, violin is high music, and violoncello is low music etc., recognition device 102 identifies the musical instrument feature of this music score, and according to the musical instrument feature of this music score, mark acquiescence musical instrument, identifies music score and generates the music description document corresponding with this acquiescence musical instrument, such as, in the specific fields of this music description document, this acquiescence musical instrument is write.

Preferably, recognition device 102 obtains the appointment musical instrument specified by described user, according to described appointment musical instrument, generates the music description document corresponding with described appointment musical instrument.Particularly, except the musical instrument feature according to music score marks musical instrument, user also oneself can specify its appointment musical instrument wanted, and such as, music score music performance apparatus 1 is by forms such as comboboxs, the instrument type can selected for user is supplied to this user, user is by the mode such as clicking, and have selected the appointment musical instrument that it is wanted, recognition device 102 obtains the appointment musical instrument that this user specifies, according to this appointment musical instrument, generate the music description document corresponding with this appointment musical instrument.Such as, the appointment musical instrument specified by user is piano, then recognition device 102 is regular according to the music of this appointment musical instrument and correspondence thereof, identifies music score and generates the music description document corresponding with piano.

At this, if user specifies the musical instrument of broadcasting at the very start, after recognition device 102 obtains the selection of user, according to the feature of described appointment musical instrument, directly generate the music description document of specifying musical instrument corresponding; User can also specify the musical instrument play when playing.

Those skilled in the art will be understood that the mode of above-mentioned identification music score generation music description document is only citing; other identification music score that are existing or that may occur from now on generate the mode of music description document as being applicable to the present invention; also within scope should being included in, and this is contained at this with way of reference.Those skilled in the art will be understood that the above-mentioned music score to getting carries out OCR identification and is only citing; other recognition method that are existing or that may occur from now on are as being applicable to the present invention; also should be included in scope, and be contained in this at this with way of reference.Those skilled in the art also will be understood that the kind of above-mentioned music element is only citing; the kind of other music elements that are existing or that may occur from now on is as being applicable to the present invention; also should be included in scope, and be contained in this at this with way of reference.

Generating apparatus 103 generates corresponding music playing file according to described music description document.Particularly, position based on the music element of recognition device 102 judgement, the classification to music element or the timestamp to music element mark, the music description document of the correspondence that recognition device 102 generates according to the appointment musical instrument that the acquiescence musical instrument of mark or user are specified is changed into corresponding music playing file by generating apparatus 103.Such as, the timestamp of instrument type, music element and each music element that generating apparatus 103 inputs according to described music description document, converts described music description document to standard MIDI format file.

At this, when subscriber equipment does not carry sound source or its sound source carried does not satisfy the demands, generating apparatus 103 can adopt wave table file.All sound (comprising each range, tone etc.) that various real instrument can send by described wave table file carry out sampling, storing and the library obtained.When playing, the musical instrument that playout software needs according to music playing file and tone color, search corresponding wave table file, when the wave table file that this subscriber equipment carries is undesirable, can also download the complete wave table file of correspondence from server.Such as, generating apparatus 103 can use wave table file when generating described standard MIDI format file, and during broadcasting, the musical composition information according to the record of midi format file sends instruction to wave table file, from " form ", find out corresponding acoustic information one by one, after synthesis, processing, playback out.If do not specially not required audio, wave table library can be generated specially, and the music description document generated by recognition device 102 being directly changed into standard MIDI file, adopting when playing music score equipment to carry sound source.

Those skilled in the art will be understood that the above-mentioned mode generating the music playing file of correspondence according to described music description document is only citing; other are existing or may occur that the method generating music playing file is as being applicable to the present invention from now on; also should be included in scope, and be contained in this at this with way of reference.Those skilled in the art also will be understood that the music playing file of above-mentioned generation is that the situation of standard MIDI format file is only citing; other file layouts that are existing or that may occur from now on are as being applicable to the present invention; also should be included in scope, and be contained in this at this with way of reference.

Searcher 104 carries out match search according to the music score title of described music score, obtains corresponding Search Results.Particularly, the determination of music score title includes but not limited to: 1) user uploads music score title; 2) music score there is the word representing music score title, by text detection and recognition system identification music score title; 3) according to the music score title that the identification of music score figure obtains; 4) music score title is determined according to music playing file coupling; Searcher 104 carries out match search in a network or in this locality according to the music score title of described music score, obtains corresponding Search Results, such as, obtains at least one corresponding with described music score and play version, provide selection to user.

Preferably, searcher 104, according to the fingerprint of described music playing file, carries out matching inquiry in melody fingerprint base, determines described music score title.Particularly, searcher 104, according to the fingerprint of described music playing file, such as utilizes Hash table principle to carry out matching inquiry, determines described music score title in melody fingerprint base.

At this, described fingerprint includes but not limited to: temporal information, sound frequency, intensity of sound.Temporal information such as can be understood as X-coordinate, the time migration of relative this section of music reference position of this point; Sound frequency such as can be understood as Y-coordinate, is the sound frequency of this point; Intensity of sound such as can be understood as Z coordinate, is the size of the acoustic energy of this point.

Such as, searcher 104 passes through discrete Fourier transformation, extract the information such as the temporal information of this music playing file, sound frequency, intensity of sound, thus form the fingerprint of this music playing file, then, according to this fingerprint, in melody fingerprint base, carry out matching inquiry, determine this music score title, and then, carry out match search according to this music score title, obtain corresponding Search Results.

Preferably, music score music performance apparatus 1 also comprises the second acquisition device (not shown) and updating device (not shown).This second acquisition device obtains the fingerprint of melody; This updating device, according to the mapping relations between described fingerprint and the title of described melody, is set up or upgrades described melody fingerprint base.Particularly, for each melody being used for building storehouse, it has title that is known, that determine, second acquisition device such as utilizes discrete Fourier transformation, extract the fingerprint of these melodies, as extracted the information such as temporal information, sound frequency, intensity of sound of these melodies respectively, thus form the fingerprint of these melodies respectively; Updating device by the mapping relations between the fingerprint of these melodies and title stored in this melody fingerprint base, thus set up or upgrade described melody fingerprint base, this melody fingerprint base comprises the fingerprint of even more melodies up to a million.

Those skilled in the art will be understood that and above-mentionedly determine that the method for music score title is only citing; the method of other generation music playing file that are existing or that may occur from now on is as being applicable to the present invention; also should be included in scope, and be contained in this at this with way of reference.Those skilled in the art also will be understood that the method for the performance version that above-mentioned search is corresponding with music score title is only citing; the method of the performance version that other search that are existing or that may occur from now on are corresponding with music score title is as being applicable to the present invention; also should be included in scope, and be contained in this at this with way of reference.

If the described Search Results of music performance apparatus 105 comprises at least one corresponding with described music score play version, in described music playing file or at least one performance version described, a version is selected to play; If described Search Results does not comprise described performance version, play described music playing file.Particularly, when at least one corresponding with this music score of searcher 104 search acquisition plays version, at least one performance version described that the described music playing file that music performance apparatus 105 self-generating device 103 generates or this searcher 104 search, a version is selected to play.This selection can be random, also can determine according to the selection of user.User can select the music playing file synthesized to play, and also can play by option one from the performance version searched.Such as, when user selects broadcasting one to play version, music performance apparatus 105 automatically links to corresponding resource according to the selection of user and plays this performance version; When user selects the music playing file playing synthesis, there are at least following two kinds of situations: the musical instrument that 1) user does not specify musical instrument or user to specify is just in time the acquiescence musical instrument that recognition device 102 marks, then play according to the music playing file that the acquiescence musical instrument of mark is corresponding; 2) musical instrument that user specifies is non-default musical instrument, music performance apparatus 105 obtains the musical instrument that user specifies, again described music description document is write according to appointment musical instrument, generate the music description document of specifying musical instrument corresponding, and play according to the music playing file that this music description document generates appointment musical instrument corresponding.

When searcher 104 do not search for obtain corresponding with this music score performance version time, music performance apparatus 105 plays the music playing file of this synthesis, there is situation as above equally in its process played, repeats no more herein, and be contained in this by way of reference.

Preferably, music score music performance apparatus 1 also comprises correcting device 106 (not shown).If the described Search Results of this correcting device 106 comprises at least one corresponding with described music score play version, according at least one performance version described, reverse correction is carried out to described music description document, described music playing file.Particularly, when at least one corresponding with this music score of searcher 104 match search acquisition plays version, correcting device 106 is according at least one performance version described, the audio files of its correspondence is converted to music playing file, and then, backstepping is carried out according to this music playing file, determine each music element, thus reverse correction is carried out to the music description document that recognition device 102 generates, such as revise the position judgment error of music element in described music score, the error to music element classification and marking timestamp.Such as, when at least one corresponding with this music score of searcher 104 match search acquisition plays version, according to this, at least one plays one in version to correcting device 106, according to the audio files of this performance version, this audio files is converted to midi format, and then determine the musical instrument played, and the music element such as note, syllable, tone, pitch, stop element adds the timestamp of each music element, the music description document that such backstepping goes out go to revise before music description document.

Those skilled in the art will be understood that above-mentioned correcting mode is only citing, and other correcting modes that are existing or that may occur from now on, as being applicable to the present invention, also should being included in scope, and being contained in this at this with way of reference.

At this, after music score music performance apparatus 1 plays version according at least one corresponding with described music score of music score name-matches search acquisition, feedback modifiers can be carried out to described music description document and music playing file according to the performance version searched, make described music description document and music playing file more accurately good, reduce the performance error of synthesis version, improve the experience of user.

Preferably, music score music performance apparatus 1 also comprises device 107 (not shown) of rearranging.This device 107 of rearranging obtains described user to specify the selection of music playing file described in instrument playing; According to described appointment musical instrument, again write described music description document, generate the music description document corresponding with described appointment musical instrument; According to described music description document, generate described music playing file with described appointment musical instrument; Music performance apparatus 105 plays this music playing file.Particularly, when user selects to specify music playing file described in instrument playing, device 107 of rearranging is write the music description document that recognition device 102 generates again according to music rule, generate the music description document corresponding with described appointment musical instrument, more described music description document is generated described music playing file.Such as, the music score that first acquisition device 101 obtains is staff, the musical instrument of acquiescence is piano, music description document and music playing file are all the generate rule according to piano, and user specifies musical instrument guitar to play, staff corresponding for piano is first changed into numbered musical notation by device 107 of then rearranging, staff corresponding to guitar is changed into by numbered musical notation, the staff corresponding to guitar is written as new music description document again, generates music playing file corresponding to guitar according to described new music description document.Subsequently, music performance apparatus 105 play this rearrange after music playing file.

Those skilled in the art will be understood that and above-mentionedly determine to play version and the mode that plays an instrument is only citing; other determinations that are existing or that may occur from now on play version with the mode played an instrument as being applicable to the present invention; also should be included in scope, and be contained in this at this with way of reference.

At this, music score music performance apparatus 1 obtains the music score that user provides, identify described music score, generate corresponding music description document, corresponding music playing file is generated according to described music description document, music score title according to described music score carries out match search, obtain corresponding Search Results, if described Search Results comprises at least one corresponding with described music score play version, in described music playing file or at least one performance version described, select a version to play, if described Search Results does not comprise described performance version, play described music playing file, user both can play synthesis version can also play famous expert's classics performance version, achieve the different demands of user, improve the experience of user.

Further, user both can use acquiescence musical instrument to carry out playing and musical instrument can also be specified to play according to the demand of oneself and hobby, achieved the individual demand of user, improved the experience of user further.

Fig. 2 illustrates the schematic diagram of music score music performance apparatus in accordance with a preferred embodiment of the present invention.Music score music performance apparatus 1 also comprises display device 208.Be described in detail the preferred embodiment below: particularly, the first acquisition device 201 obtains the music score that user provides; Recognition device 202 identifies described music score, generates corresponding music description document; Generating apparatus 203 generates corresponding music playing file according to described music description document; Searcher 204 carries out match search according to the music score title of described music score, obtains corresponding Search Results; If the described Search Results of music performance apparatus 205 comprises at least one corresponding with described music score play version, in described music playing file or at least one performance version described, select a version to play, if described Search Results does not comprise described performance version, play described music playing file; Correcting device 206, according at least one performance version described, carries out reverse correction to described music description document and described music playing file; Device 207 of rearranging obtains described user to specify the selection of music playing file described in instrument playing; According to described appointment musical instrument, again write described music description document, generate the music description document corresponding with described appointment musical instrument; According to described music description document, generate described music playing file with described appointment musical instrument; Music performance apparatus 205 plays this music playing file.The version played is shown in animation form and plays interface by display device 208; Wherein, with the following at least any one of described animation form display: the note 1) played is in the position of described music score; 2) finger is in the position of the musical instrument corresponding with described version.Wherein, first acquisition device 201, recognition device 202, generating apparatus 203, searcher 204, music performance apparatus 205, correcting device 206 are identical with corresponding intrument shown in Fig. 1 with device 207 of rearranging or substantially identical, so place repeats no more, and be contained in this by way of reference.

The version played is shown in animation form and plays interface by display device 208; Wherein, with the following at least any one of described animation form display: the note 1) played is in the position of described music score; 2) finger is in the position of the musical instrument corresponding with described version.Particularly, the version played is shown in animation form and plays interface by display device 208, wherein formed like this with the note played of described animation form display in the position of described music score: the information such as the music element position judgment extracted from the music description document that recognition device 202 generates and music element classification, correspond to these information on music score and form animation; Formed like this with the finger of described animation form display in the position of musical instrument corresponding to described version: from the music description document that recognition device 202 generates, extract the information such as necessary music element and time, these information are corresponded on keyboards for musical instruments and forms animation.

Those skilled in the art will be understood that above-mentioned animation display mode is only citing, and other animation display modes that are existing or that may occur from now on, as being applicable to the present invention, also should being included in scope, and being contained in this at this with way of reference.

At this, music score music performance apparatus 1 has animation display interface when playing music score, not only can the note that displays the play of animation in the position of music score, can also animation display point in the position of keyboards for musical instruments, improve user and appreciate the intuitive of music score and the convenience of study music score, improve the experience of user further.

Below be described in detail with the operation of an embodiment to said apparatus, Fig. 3 illustrates the animation effect figure of the performance display interface of music score music performance apparatus in accordance with a preferred embodiment of the present invention.

Such as, the first acquisition device 201 passes through camera or other audio-visual input method acquisition block letter or the handwritten form staff image of subscriber equipment;

Subsequently, recognition device 202 carries out pre-service to this staff image, conversion chromatic image is to black and white two-value picture, denoising, slant correction, carry out music element segmentation, detect the position of each music element in this staff, and by the detection of spectral line, judge the music elements such as note are between which spectral line, then each music element that described staff comprises, as five lines, note, G clef, F clef, C clef, to change voice mark, slur, rest, trifle and other marks etc. build storehouse, and gather the sample of each music element some, train with such as convolutional neural networks, the model trained just can be classified after obtaining the good music element of single segmentation, timestamp is marked by after music element Classification and Identification, composition music description document, according to music score signature acquiescence musical instrument.Also can specifying musical instrument before generation music description document, generating corresponding music description document according to specifying musical instrument.Now for duplicate rows spectrum, mark acquiescence musical instrument is piano.

Then, generating apparatus 203 is piano according to the instrument type that described music description document inputs, according to the timestamp of each music element and each music element in the music description document identified, described music description document is converted to the such as standard MIDI format file that can play.Wherein, adopt the mode of midi format file, need all sound (comprising each range, tone) that can be sent by various real instrument to sample, be stored as a wave table file.This wave table file can use when generating midi format file as the storehouse of a standard; If to the not special requirement of audio, wave table file can being generated specially, directly convert midi format file to from described music description document, adopting subscriber equipment to carry sound source when playing staff melody.

Then, when melody searched for by searcher 204, such as Fourier transform is utilized to extract the fingerprint of the music playing file generated by generating apparatus 203, then in melody fingerprint base, utilize such as Hash table principle to carry out retrieval coupling, determine corresponding melody title according to matching degree, and then in network, search each performance version.Corresponding information is returned to user, selects for it.Described fingerprint is that described melody fingerprint base can comprise the fingerprint of melody up to a million by the information structure such as a series of temporal informations, sound frequency, intensity of sound extracted.Music score music performance apparatus 1 is played version according at least one searching and is carried out feedback modifiers to described music description document and music playing file, such as, the audio files playing version is converted to music playing file, and then carry out backstepping according to this music playing file, the error brought when each music element in music description document being carried out to the operations such as position judgment, Classification and Identification and mark timestamp carries out feedback modifiers.

Finally, user selects a version in described music playing file or at least one performance version described, and music performance apparatus 205 is played after obtaining the selection of user, and the version played is shown in performance interface with animation form.If user selects to play certain famous expert and plays version, music performance apparatus 205 can automatically link to corresponding resource according to the selection of user and play this melody.If user selects to play composite music version, 1) if user does not operate further, acquiescence musical instrument-piano that music performance apparatus 205 uses recognition device 202 to mark is played; 2) if user selects acquiescence, musical instrument is played, then recognition device 205 uses piano to play.3) if user selects non-default musical instrument, rearrange device 207 first according to music rule, the music description document that recognition device 202 generates is write again, generates music description document 2.Because the tone color of different musical instrument and range have certain difference, the staff being suitable for different musical instrument understands some difference.Staff corresponding for piano is first changed into numbered musical notation by device 207 of rearranging during conversion, the staff of specifying musical instrument corresponding is changed into by numbered musical notation, device 207 of rearranging is written as new music description document again to specifying staff corresponding to musical instrument, and then generates the music playing file of specifying musical instrument corresponding according to described new music description document.

The version played is shown in the form of animation and plays interface by display device 208, the note that part display is being play is in the position of staff, the position of another part display finger place keyboards for musical instruments, wherein, the animation display pointed in the position of keyboards for musical instruments information such as extracting necessary music element and time in the music description document generated from recognition device 202 is corresponded to keyboards for musical instruments formed.As described in piano performance during version, interface cartoon display effect as shown in Figure 3.

Fig. 4 illustrates the schematic flow sheet that music score is according to a further aspect of the present invention played.

At this, music score music performance apparatus 1 such as can be arranged in computer equipment, and described computer equipment comprises subscriber equipment and the network equipment.When this music score music performance apparatus 1 is positioned at the network equipment, intercomed mutually by network between its with subscriber equipment, obtain the music score that user provides, identify described music score, generate corresponding music description document, corresponding music playing file is generated according to described music description document, and carry out match search according to the music score title of described music score, if search obtains at least one corresponding with described music score and plays version, a version is selected in described music playing file or at least one performance version described, return this subscriber equipment to play, described performance version is obtained if do not search for, this music description document is returned this subscriber equipment play.

Be arranged in subscriber equipment for this music score music performance apparatus 1 to be below described in detail.

In step 401, music score music performance apparatus 1 obtains the music score that user provides.Particularly, in step 401, the mode that music score music performance apparatus 1 obtains the music score that user provides includes but not limited to:

1) music score existed in a user device is obtained.Such as, this music score, by clicking in this subscriber equipment with the music score that the form such as picture stores, is provided to music score music performance apparatus 1 by user.

2) music score searched from network is obtained; Such as, user, by logging in the website of some search music score, selects the music score wanting to learn to play, is downloaded by this music score and be provided to music score music performance apparatus 1.

4) music score obtained is scanned by scanister.

In step 402, music score music performance apparatus 1 identifies described music score, generates corresponding music description document.Particularly, in step 402, music score music performance apparatus 1 identifies the music score obtained in step 401, to parse the word on each music element or music score that music score comprises, such as, parse the sound implication that each note, clef, stave in this music score comprise, thus generate music description document corresponding to music score.Preferably, in step 402, music score music performance apparatus 1 can carry out OCR (OpticalCharacterRecognition, optical character identification) identification to the music score got in step 401.Such as, in step 402, music score music performance apparatus 1 carries out pre-service, conversion chromatic image to steps such as black and white two-value picture, denoising, slant correction, element segments, element position judgement, elemental recognitions to the music score got in step 401, generates the music description document that music score is corresponding after identifying music element.

Preferably, in step 402, music score music performance apparatus 1 judges that the position of music element in described music score is to identify described music score, generates described music description document.Particularly, in step 402, music score music performance apparatus 1 uses the position of text detection systems axiol-ogy to each element in music score of improvement, and detected by spectral line, judge the music elements such as note are between which spectral line, to identify described music score, generate described music description document.

Preferably, in step 402, music score music performance apparatus 1 utilizes element training pattern, determines the classification of described music element; Judge the position of described music element in described music score, in conjunction with described classification, identify described music score, and generate described music description document.Particularly, in step 402, the music element that music score comprises by music score music performance apparatus 1 builds storehouse, gather the sample of each music element some, by described sample training, such as, convolutional neural networks is utilized to train, subsequently, the element training pattern utilizing this to train, determines that it is classified after obtaining the good music element of single segmentation; And then, judge the position of described music element in described music score, such as, detected by spectral line, judge the music elements such as note are between which spectral line, then in conjunction with the classification of these music elements, identify described music score, and generate described music description document.

Preferably, in step 402, music score music performance apparatus 1, to described music element mark timestamp, generates described music description document.Such as, in step 402, the music elements such as each note, syllable, pitch, liaison identify and mark timestamp by music score music performance apparatus 1, this timestamp such as marks the time migration of length (duration) and relative this section of music reference position of this music element playing this music element, thus generates described music description document.

Preferably, in step 402, music score music performance apparatus 1 is according to the musical instrument feature of music score, and mark acquiescence musical instrument, generates the described music description document corresponding with described acquiescence musical instrument.Particularly, each music score such as can have the musical instrument feature of its correspondence, and if piano is duplicate rows spectrum, violin is high music, violoncello is low music etc., in step 402, music score music performance apparatus 1 identifies the musical instrument feature of this music score, and according to the musical instrument feature of this music score, mark acquiescence musical instrument, identify music score and generate the music description document corresponding with this acquiescence musical instrument, such as, in the specific fields of this music description document, writing this acquiescence musical instrument.

Preferably, in step 402, music score music performance apparatus 1 obtains the appointment musical instrument specified by described user, according to described appointment musical instrument, generates the music description document corresponding with described appointment musical instrument.Particularly, except the musical instrument feature according to music score marks musical instrument, user also oneself can specify its appointment musical instrument wanted, such as, music score music performance apparatus 1 is by forms such as comboboxs, the instrument type can selected for user be supplied to this user, and user, by the mode such as clicking, have selected the appointment musical instrument that it is wanted, in step 402, music score music performance apparatus 1 obtains the appointment musical instrument that this user specifies, and according to this appointment musical instrument, generates the music description document corresponding with this appointment musical instrument.Such as, the appointment musical instrument specified by user is piano, then in step 402, music score music performance apparatus 1 is regular according to the music of this appointment musical instrument and correspondence thereof, identifies music score and generates the music description document corresponding with piano.

At this, if user specifies the musical instrument of broadcasting at the very start, in step 402, after music score music performance apparatus 1 obtains the selection of user, according to the feature of described appointment musical instrument, directly generate the music description document of specifying musical instrument corresponding; User can also specify the musical instrument play when playing.

In step 403, music score music performance apparatus 1 generates corresponding music playing file according to described music description document.Particularly, position based on the music element judged in step 402, the classification to music element or the timestamp to music element mark, in step 403, the music description document of the correspondence of the appointment musical instrument of specifying according to the acquiescence musical instrument marked or user in step 402 generation is changed into corresponding music playing file by music score music performance apparatus 1.Such as, in step 403, the timestamp of instrument type, music element and each music element that music score music performance apparatus 1 inputs according to described music description document, converts described music description document to standard MIDI format file.

At this, when subscriber equipment does not carry sound source or its sound source carried does not satisfy the demands, in step 403, music score music performance apparatus 1 can adopt wave table file.All sound (comprising each range, tone etc.) that various real instrument can send by described wave table file carry out sampling, storing and obtain a library.When playing, the musical instrument that playout software needs according to music playing file and tone color, search corresponding wave table file, when the wave table file that this subscriber equipment carries is undesirable, can also download the complete wave table file of correspondence from server.Such as, in step 403, music score music performance apparatus 1 can use wave table file when generating described standard MIDI format file, during broadcasting, musical composition information according to the record of midi format file sends instruction to wave table file, from " form ", find out corresponding acoustic information one by one, after synthesis, processing, playback out.If do not specially not required audio, wave table library can being generated specially, and the music description document generated in step 402 is directly changed into standard MIDI file, adopting when playing music score equipment to carry sound source.

In step 404, music score music performance apparatus 1 carries out match search according to the music score title of described music score, obtains corresponding Search Results.Particularly, the determination of music score title includes but not limited to: 1) user uploads music score title; 2) music score there is the word representing music score title, by text detection and recognition system identification music score title; 3) according to the music score title that the identification of music score figure obtains; 4) music score title is determined according to music playing file coupling; In step 404, music score music performance apparatus 1 carries out match search in a network or in this locality according to the music score title of described music score, obtains corresponding Search Results, such as, obtains at least one corresponding with described music score and play version, provide selection to user.

Preferably, in step 404, music score music performance apparatus 1, according to the fingerprint of described music playing file, carries out matching inquiry in melody fingerprint base, determines described music score title.Particularly, in step 404, music score music performance apparatus 1, according to the fingerprint of described music playing file, such as utilizes Hash table principle to carry out matching inquiry, determines described music score title in melody fingerprint base.

Such as, in step 404, music score music performance apparatus 1, by discrete Fourier transformation, extracts the information such as the temporal information of this music playing file, sound frequency, intensity of sound, thus form the fingerprint of this music playing file, then, according to this fingerprint, in melody fingerprint base, matching inquiry is carried out, determine this music score title, and then, carry out match search according to this music score title, obtain corresponding Search Results.

Preferably, music score music performance apparatus 1 can also obtain the fingerprint of melody, according to the mapping relations between described fingerprint and the title of described melody, sets up or upgrades described melody fingerprint base.Particularly, for each melody being used for building storehouse, it has title that is known, that determine, music score music performance apparatus 1 such as utilizes discrete Fourier transformation, extract the fingerprint of these melodies, as extracted the information such as temporal information, sound frequency, intensity of sound of these melodies respectively, thus form the fingerprint of these melodies respectively; Music score music performance apparatus 1 by the mapping relations between the fingerprint of these melodies and title stored in this melody fingerprint base, thus set up or upgrade described melody fingerprint base, this melody fingerprint base comprises the fingerprint of even more melodies up to a million.

In step 405, if the described Search Results of music score music performance apparatus 1 comprises at least one corresponding with described music score play version, in described music playing file or at least one performance version described, a version is selected to play; If described Search Results does not comprise described performance version, play described music playing file.Particularly, when in step 405, when at least one corresponding with this music score of music score music performance apparatus 1 search acquisition plays version, at least one performance version described that the described music playing file generated in step 403 or this search in step 404, a version is selected to play.This selection can be random, also can determine according to the selection of user.User can select the music playing file synthesized to play, and also can select one from the performance version searched and play.Such as, when user selects broadcasting one to play version, in step 405, music score music performance apparatus 1 automatically links to corresponding resource according to the selection of user and plays this performance version; When user selects the music playing file playing synthesis, there are at least following two kinds of situations: the musical instrument that 1) user does not specify musical instrument or user to specify is just in time the acquiescence musical instrument marked in step 402, then play according to the music playing file that the acquiescence musical instrument of mark is corresponding; 2) musical instrument that user specifies is non-default musical instrument, in step 405, music score music performance apparatus 1 obtains the musical instrument that user specifies, again described music description document is write according to appointment musical instrument, generate the music description document of specifying musical instrument corresponding, and play according to the music playing file that this music description document generates appointment musical instrument corresponding.

When in step 404, when music score music performance apparatus 1 is not searched for and is obtained the performance version corresponding with this music score, in step 405, music score music performance apparatus 1 plays the music playing file of this synthesis, there is situation as above equally in its process played, repeat no more herein, and be contained in this by way of reference.

Preferably, the method that music score is played also comprises step 406 (not shown).In a step 406, if described Search Results comprises at least one corresponding with described music score play version, music score music performance apparatus 1, according at least one performance version described, carries out reverse correction to described music description document, described music playing file.Particularly, when in step 404 can match search obtain at least one corresponding with this music score play version time, in a step 406, music score music performance apparatus 1 is according at least one performance version described, the audio files of its correspondence is converted to music playing file, and then, backstepping is carried out according to this music playing file, determine each music element, thus reverse correction is carried out to the music description document generated in step 402, such as revise the position judgment error of music element in described music score, the error to music element classification and marking timestamp.Such as, when at least one corresponding with this music score of match search acquisition plays version in step 404, in this step 406, according to this, at least one plays one in version to music score music performance apparatus 1, according to the audio files of this performance version, this audio files is converted to midi format, and then determine the musical instrument of performance, and the music element such as note, syllable, tone, pitch, stop element adds the timestamp of each music element, the music description document that such backstepping goes out go to revise before music description document.

Preferably, the method that music score is played also comprises step 407 (not shown).In step 407, music score music performance apparatus 1 obtains described user to specify the selection of music playing file described in instrument playing; According to described appointment musical instrument, again write described music description document, generate the music description document corresponding with described appointment musical instrument; According to described music description document, generate described music playing file with described appointment musical instrument; In step 405, music score music performance apparatus 1 plays this music playing file.Particularly, when user selects to specify music playing file described in instrument playing, in step 407, music score music performance apparatus 1 is write the music description document generated in step 402 again according to music rule, generate the music description document corresponding with described appointment musical instrument, more described music description document is generated described music playing file.Such as, in step 401, the music score that music score music performance apparatus 1 obtains is staff, the musical instrument of acquiescence is piano, music description document and music playing file are all the generate rule according to piano, and user specifies musical instrument guitar to play, then in step 407, staff corresponding for piano is first changed into numbered musical notation by music score music performance apparatus 1, staff corresponding to guitar is changed into by numbered musical notation, the staff corresponding to guitar is written as new music description document again, generates music playing file corresponding to guitar according to described new music description document.Subsequently, in step 405, music score music performance apparatus 1 play this rearrange after music playing file.

Fig. 5 illustrates the schematic flow sheet that music score is in accordance with a preferred embodiment of the present invention played.Particularly, in step 501, music score music performance apparatus 1 obtains the music score that user provides; In step 502, music score music performance apparatus 1 identifies described music score, generates corresponding music description document; In step 503, music score music performance apparatus 1 generates corresponding music playing file according to described music description document; In step 504, music score music performance apparatus 1 carries out match search according to the music score title of described music score, obtains corresponding Search Results; In step 505, if the described Search Results of music score music performance apparatus 1 comprises at least one corresponding with described music score play version, in described music playing file or at least one performance version described, select a version to play, if described Search Results does not comprise described performance version, play described music playing file; In step 506, music score music performance apparatus 1, according at least one performance version described, carries out reverse correction to described music description document and described music playing file; In step 507, music score music performance apparatus 1 is for obtaining described user to specify the selection of music playing file described in instrument playing; According to described appointment musical instrument, again write described music description document, generate the music description document corresponding with described appointment musical instrument; According to described music description document, generate described music playing file with described appointment musical instrument; This music playing file is played by music score music performance apparatus 1.In step 508, the version played is shown in animation form and plays interface by music score music performance apparatus 1; Wherein, with the following at least any one of described animation form display: the note 1) played is in the position of described music score; 2) finger is in the position of the musical instrument corresponding with described version.Wherein, corresponding step shown in step 501 to step 507 with Fig. 4 is identical or substantially identical, so place repeats no more, and is contained in this by way of reference.

Wherein, in step 508, the version played is shown in animation form and plays interface by music score music performance apparatus 1; Wherein, with the following at least any one of described animation form display: the note 1) played is in the position of described music score; 2) finger is in the position of the musical instrument corresponding with described version.Particularly, in step 508, the version played is shown in animation form and plays interface by music score music performance apparatus 1, wherein formed like this with the note played of described animation form display in the position of described music score: the information such as the music element position judgment extracted from the music description document generated in step 502 and music element classification, correspond to these information on music score and form animation; Formed like this with the finger of described animation form display in the position of musical instrument corresponding to described version: extract the information such as necessary music element and time in the music description document generated from step 502, these information are corresponded on keyboards for musical instruments and forms animation.

Below be described in detail with the operation of an embodiment to above-mentioned steps.

Such as, in step 501, music score music performance apparatus 1 passes through camera or other audio-visual input method acquisition block letter or the handwritten form staff image of subscriber equipment;

Subsequently, in step 502, music score music performance apparatus 1 carries out pre-service to this staff image, conversion chromatic image is to black and white two-value picture, denoising, slant correction, carry out music element segmentation, detect the position of each music element in this staff, and by the detection of spectral line, judge the music elements such as note are between which spectral line, then each music element that described staff comprises, as five lines, note, G clef, F clef, C clef, to change voice mark, slur, rest, trifle and other marks etc. build storehouse, and gather the sample of each music element some, train with such as convolutional neural networks, the model trained just can be classified after obtaining the good music element of single segmentation, timestamp is marked by after music element Classification and Identification, composition music description document, according to music score signature acquiescence musical instrument.Also can specifying musical instrument before generation music description document, generating corresponding music description document according to specifying musical instrument.Now for duplicate rows spectrum, mark acquiescence musical instrument is piano.

Then, in step 503, music score music performance apparatus 1 is piano according to the instrument type that described music description document inputs, according to the timestamp of each music element and each music element in the music description document identified, described music description document is converted to the such as standard MIDI format file that can play.Wherein, adopt the mode of midi format file, need all sound (comprising each range, tone) that can be sent by various real instrument to sample, be stored as a wave table file.This wave table file can use when generating midi format file as the storehouse of a standard; If to the not special requirement of audio, wave table file can being generated specially, directly convert midi format file to from described music description document, adopting subscriber equipment to carry sound source when playing staff melody.

Then, in step 504, when music score music performance apparatus 1 searches for melody, such as Fourier transform is utilized to extract the fingerprint of the music playing file generated in step 503, then in melody fingerprint base, utilize such as Hash table principle to carry out retrieval coupling, determine corresponding melody title according to matching degree, and then in network, search each performance version.Corresponding information is returned to user, selects for it.Described fingerprint is that described melody fingerprint base can comprise the fingerprint of melody up to a million by the information structure such as a series of temporal informations, sound frequency, intensity of sound extracted.Music score music performance apparatus 1 is played version according at least one searching and is carried out feedback modifiers to described music description document and music playing file, such as, the audio files playing version is converted to music playing file, and then carry out backstepping according to this music playing file, the error brought when each music element in music description document being carried out to the operations such as position judgment, Classification and Identification and mark timestamp carries out feedback modifiers.

Finally, user selects a version in described music playing file or at least one performance version described, in step 505, music score music performance apparatus 1 is played after obtaining the selection of user, and the version played is shown in performance interface with animation form.If user selects to play certain famous expert and plays version, in step 505, music score music performance apparatus 1 can automatically link to corresponding resource according to the selection of user and play this melody.If user selects to play composite music version, 1) if user does not operate further, in step 505, acquiescence musical instrument-piano that music score music performance apparatus 1 is used in mark in step 502 is played; 2) if user selects acquiescence, musical instrument is played, then in step 505, music score music performance apparatus 1 uses piano to play.3) if user selects non-default musical instrument, in step 507, first music score music performance apparatus 1 according to music rule, is write the music description document generated in step 502 again, generates music description document 2.Because the tone color of different musical instrument and range have certain difference, the staff being suitable for different musical instrument understands some difference.During conversion, in step 507, staff corresponding for piano is first changed into numbered musical notation by music score music performance apparatus 1, the staff of specifying musical instrument corresponding is changed into by numbered musical notation, then to specifying staff corresponding to musical instrument to be again written as new music description document, and then the music playing file of specifying musical instrument corresponding is generated according to described new music description document.

In step display 508, the version played is shown in the form of animation and plays interface by music score music performance apparatus 1, the note that part display is being play is in the position of staff, the position of another part display finger place keyboards for musical instruments, wherein, the animation display pointed in the position of keyboards for musical instruments information such as extracting necessary music element and time from the music description document generated in step 502 is corresponded to keyboards for musical instruments formed.As described in piano performance during version, interface cartoon display effect as shown in Figure 3.

It should be noted that the present invention can be implemented in the assembly of software and/or software restraint, such as, each device of the present invention can adopt special IC (ASIC) or any other similar hardware device to realize.In one embodiment, software program of the present invention can perform to realize step mentioned above or function by processor.Similarly, software program of the present invention (comprising relevant data structure) can be stored in computer readable recording medium storing program for performing, such as, and RAM storer, magnetic or CD-ROM driver or flexible plastic disc and similar devices.In addition, steps more of the present invention or function can adopt hardware to realize, such as, as coordinating with processor thus performing the circuit of each step or function.

To those skilled in the art, obviously the invention is not restricted to the details of above-mentioned one exemplary embodiment, and when not deviating from spirit of the present invention or essential characteristic, the present invention can be realized in other specific forms.Therefore, no matter from which point, all should embodiment be regarded as exemplary, and be nonrestrictive, scope of the present invention is limited by claims instead of above-mentioned explanation, and all changes be therefore intended in the implication of the equivalency by dropping on claim and scope are included in the present invention.Any Reference numeral in claim should be considered as the claim involved by limiting.In addition, obviously " comprising " one word do not get rid of other unit or step, odd number does not get rid of plural number.Multiple unit of stating in system claims or device also can be realized by software or hardware by a unit or device.First, second word such as grade is used for representing title, and does not represent any specific order.

Although show and describe exemplary embodiment especially above, it will be appreciated by those skilled in the art that when the spirit and scope of not Departure clause book, can change to some extent in its form and details.Here sought protection is set forth in appended clause book.Define in following numbering clause each embodiment these and other in:

1., for the method that music score is played, wherein, the method comprises the following steps:

A. the music score that user provides is obtained;

2. the method according to clause 1, wherein, described step b comprises:

-judge the position of music element in described music score, to identify described music score, and generate described music description document.

3. the method according to clause 2, wherein, described step b comprises:

-utilize element training pattern, determine the classification of described music element;

-judge the position of described music element in described music score, in conjunction with described classification, identify described music score, and generate described music description document.

4. the method according to clause 2 or 3, wherein, described step b also comprises:

-to described music element mark timestamp, generate described music description document.

5. the method according to clause 1, wherein, described step b also comprises:

-according to the musical instrument feature of described music score, mark acquiescence musical instrument, generates the described music description document corresponding with described acquiescence musical instrument;

Wherein, described step c comprises:

-according to described music description document, generate described music playing file with described acquiescence musical instrument.

6. the method according to clause 1, wherein, described step b also comprises:

-obtain appointment musical instrument specified by described user;

-according to described appointment musical instrument, generate the music description document corresponding with described appointment musical instrument.

7. the method according to clause 1, wherein, described steps d also comprises:

-according to the fingerprint of described music playing file, in melody fingerprint base, carry out matching inquiry, determine described music score title.

8. the method according to clause 7, wherein, the method also comprises:

The fingerprint of-acquisition melody;

-according to the mapping relations between described fingerprint and the title of described melody, set up or upgrade described melody fingerprint base.

9. the method according to clause 7 or 8, wherein, described fingerprint comprises following at least any one:

-temporal information;

-sound frequency;

-intensity of sound.

10. the method according to clause 1, wherein, the method also comprises:

Search Results described in-Ruo comprises at least one corresponding with described music score and plays version, according at least one performance version described, carries out reverse correction to described music description document and described music playing file.

11. methods according to clause 1, wherein, the method also comprises:

-obtain described user to specify the selection of music playing file described in instrument playing;

-according to described appointment musical instrument, again write described music description document, generate the music description document corresponding with described appointment musical instrument;

-according to described music description document, generate described music playing file with described appointment musical instrument;

Wherein, described step e comprises:

-play described music playing file.

12. methods according to clause 1, wherein, the method also comprises:

-version played is shown in performance interface with animation form;

Wherein, with the following at least any one of described animation form display:

-the note played is in the position of described music score;

-point in the position of the musical instrument corresponding with described version.

13. 1 kinds of music score music performance apparatus played for music score, wherein, this music score music performance apparatus comprises:

First acquisition device, for obtaining the music score that user provides;

14. music score music performance apparatus according to clause 13, wherein, described recognition device is used for:

15. music score music performance apparatus according to clause 14, wherein, described recognition device is used for:

16. music score music performance apparatus according to clause 14 or 15, wherein, described recognition device also for:

17. music score music performance apparatus according to clause 13, wherein, described recognition device also for:

Wherein, described generating apparatus is used for:

18. music score music performance apparatus according to clause 13, wherein, described recognition device also for:

-obtain appointment musical instrument specified by described user;

19. music score music performance apparatus according to clause 13, wherein, described searcher also for:

20. music score music performance apparatus according to clause 19, wherein, this music score music performance apparatus also comprises:

Second acquisition device, for obtaining the fingerprint of melody;

Updating device, for according to the mapping relations between described fingerprint and the title of described melody, sets up or upgrades described melody fingerprint base.

21. music score music performance apparatus according to clause 19 or 20, wherein, described fingerprint comprises following at least any one:

-the time;

-sound frequency;

-intensity.

22. music score music performance apparatus according to clause 13, wherein, this music score music performance apparatus also comprises:

Correcting device, for according at least one performance version described, carries out reverse correction to described music description document and described music playing file.

23. music score music performance apparatus according to clause 13, wherein, this music score music performance apparatus also comprises device of rearranging, for:

Wherein, described music performance apparatus is used for:

-play described music playing file.

24. music score music performance apparatus according to clause 13, wherein, this music score music performance apparatus also comprises:

Display device, plays interface for being shown in animation form by the version played;

-the note played is in the position of described music score;

Claims

A. the music score that user provides is obtained;

2. method according to claim 1, wherein, described step b comprises:

3. method according to claim 2, wherein, described step b comprises:

4. according to the method in claim 2 or 3, wherein, described step b also comprises:

5. method according to claim 1, wherein, described step b also comprises:

Wherein, described step c comprises:

6. method according to claim 1, wherein, described step b also comprises:

-obtain appointment musical instrument specified by described user;

7. method according to claim 1, wherein, described steps d also comprises:

8. method according to claim 1, wherein, the method also comprises:

9. method according to claim 1, wherein, the method also comprises:

Wherein, described step e comprises:

-play described music playing file.

10. method according to claim 1, wherein, the method also comprises:

-version played is shown in performance interface with animation form;

-the note played is in the position of described music score;

11. 1 kinds of music score music performance apparatus played for music score, wherein, this music score music performance apparatus comprises:

First acquisition device, for obtaining the music score that user provides;

12. music score music performance apparatus according to claim 11, wherein, described recognition device is used for:

13. music score music performance apparatus according to claim 12, wherein, described recognition device is used for:

14. music score music performance apparatus according to claim 12 or 13, wherein, described recognition device also for:

15. music score music performance apparatus according to claim 11, wherein, described recognition device also for:

Wherein, described generating apparatus is used for:

16. music score music performance apparatus according to claim 11, wherein, described recognition device also for:

-obtain appointment musical instrument specified by described user;

17. music score music performance apparatus according to claim 11, wherein, described searcher also for:

18. music score music performance apparatus according to claim 11, wherein, this music score music performance apparatus also comprises:

19. music score music performance apparatus according to claim 11, wherein, this music score music performance apparatus also comprises device of rearranging, for:

Wherein, described music performance apparatus is used for:

-play described music playing file.

20. music score music performance apparatus according to claim 11, wherein, this music score music performance apparatus also comprises:

-the note played is in the position of described music score;