CN106649811A - Music score library establishing method and device - Google Patents

Music score library establishing method and device Download PDF

Info

Publication number
CN106649811A
CN106649811A CN201611243896.1A CN201611243896A CN106649811A CN 106649811 A CN106649811 A CN 106649811A CN 201611243896 A CN201611243896 A CN 201611243896A CN 106649811 A CN106649811 A CN 106649811A
Authority
CN
China
Prior art keywords
music score
multimedia file
mark
multimedia
similarity
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201611243896.1A
Other languages
Chinese (zh)
Inventor
刘卓
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Kugou Computer Technology Co Ltd
Original Assignee
Guangzhou Kugou Computer Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Kugou Computer Technology Co Ltd filed Critical Guangzhou Kugou Computer Technology Co Ltd
Priority to CN201611243896.1A priority Critical patent/CN106649811A/en
Publication of CN106649811A publication Critical patent/CN106649811A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/951Indexing; Web crawling techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/40Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The invention discloses a music score library establishing method and device and belongs to the technical field of network communication. The method comprises the steps that a music score is crawled from a target website, and an identifier of a multi-media file corresponding to the music score is crawled from the target website; according to the identifier of the multi-media file, the multi-media file is obtained; according to the music score and the multi-media file, whether the music score is matched with the multi-media file or not is verified; if the music score is matched with the multi-media file, the corresponding relation of the music score and the identifier of the multi-media file is added to a music score library. The device comprises a first crawling module, a second crawling module, a first obtaining module, a verifying module and a first adding module. The corresponding relation of the matched music score and the identifier of the multi-media file is added to the music score library by verifying whether the music score is matched with the multi-media file or not, and the music score library establishing accuracy of a multi-media server is improved.

Description

The method and apparatus for building music score storehouse
Technical field
The present invention relates to network communication technology field, more particularly to a kind of method and apparatus for building music score storehouse.
Background technology
With the development of the network communications technology, the function of multimedia server is stronger and stronger;Multimedia server is to end Hold when song is sent, song not only can be sent to terminal, additionally it is possible to the music score of song is sent to terminal, so that terminal is being broadcast Sing song while, the music score of song is shown on currently playing interface.Therefore, multimedia server sends song to terminal Before music score, need to build music score storehouse.
At present, when music score storehouse is built, multimedia server first obtains the targeted website for providing music score to multimedia server Network address, according to the network address of the targeted website, the image comprising music score is crawled from targeted website.This is usually contained in the image The title of the song of music score;Then the title of the song of the music score is manually identified from the image.Multimedia server should The title of song and the image corresponding relation comprising the music score are added in music score storehouse.
During the present invention is realized, inventor has found that prior art at least has problems with:
Often uploaded for user due to the image comprising music score in targeted website, the pleasure of mistake may be included in the image Spectrum, the standard in music score storehouse is built so as to cause multimedia server to build in music score storehouse comprising the music score of mistake, namely said method Really property is poor.
The content of the invention
In order to solve problem of the prior art, the invention provides a kind of method and apparatus for building music score storehouse.Technical side Case is as follows:
In a first aspect, embodiments providing a kind of method in structure music score storehouse, methods described includes:
Music score is crawled from targeted website, and, the corresponding multimedia text of the music score is crawled from the targeted website The mark of part;
According to the mark of the multimedia file, the multimedia file is obtained;
According to the music score and the multimedia file, verify whether the music score matches with the multimedia file;
If the music score is matched with the multimedia file, by the right of the mark of the music score and the multimedia file Should be related to and be added in music score storehouse.
Optionally, it is described according to the music score and the multimedia file, verify the music score and the multimedia file Whether match, including:
According to the music score and the multimedia file, by presetting similarity algorithm, the music score and described many is determined Similarity between media file;
If the similarity exceedes predetermined threshold value, determine that the music score is matched with the multimedia file.
Optionally, it is described according to the music score and the multimedia file, by presetting similarity algorithm, determine the pleasure Before similarity between spectrum and the multimedia file, methods described also includes:
Preset number sample music score, each corresponding multimedia file of sample music score are obtained, and, described each sample Similarity between music score and each multimedia file;
According to described each sample music score, described each corresponding multimedia file of sample music score, and, described each sample Similarity between this music score and each multimedia file, by iterative algorithm, is optimized to the default similarity algorithm.
Optionally, the corresponding relation by the music score and the mark of the multimedia file is added in music score storehouse it Before, methods described also includes:
Specified markup information is added in the music score, the specified markup information is used to mark multimedia server.
Optionally, the corresponding relation by the music score and the mark of the multimedia file is added in music score storehouse it Afterwards, methods described also includes:
Receiving terminal send feedback information, the feedback information include note identifications to be corrected in the music score with Note after correction;
According to the note identifications, note to be corrected in the music score is revised as into the note after the correction.
Optionally, it is described according to the note identifications, note to be corrected in the music score is revised as after the correction Note before, methods described also includes:
Statistics receives the reception number of times of the feedback information;
If the reception number of times exceedes preset times, execution is described according to the note identifications, will treat in the music score The step of note of correction is revised as the note after the correction.
Optionally, it is described that music score is crawled from targeted website, including:
The mark of the targeted website is obtained, according to the mark of the targeted website, music score in the targeted website is obtained The positional information at place;
According to the mark and the positional information of the targeted website, the positional information is determined in the targeted website It is corresponding to crawl region;
Crawl in region the music score from described crawling.
Optionally, it is described crawl in region the music score from described crawling, including:
The image comprising the music score is crawled in region from described crawling;
The sequence of notes and beat mark of the music score is identified from described image, by the sequence of notes and the section Clap the mark composition music score.
Optionally, the mark that the corresponding multimedia file of the music score is crawled from the targeted website, including:
Word message is crawled from the targeted website, the corresponding multimedia of the music score is extracted from the Word message The mark of file.
Optionally, if the mark not crawled from the targeted website to the multimedia file, methods described is also Including:
According to the music score, the multimedia file matched with the music score is selected from multimedia file storehouse;
The corresponding relation of the music score and the mark of the multimedia file for selecting is added in music score storehouse.
Optionally, it is described according to the music score, the multimedia text matched with the music score is selected from multimedia file storehouse Part, including:
Obtain each multimedia file in the multimedia file storehouse;
According to the music score and described each multimedia file, by presetting similarity algorithm, the music score and institute are determined State the similarity between each multimedia file;
According to the similarity between the music score and described each multimedia file, select from the multimedia file storehouse Similarity meets pre-conditioned multimedia file;
The multimedia file that the multimedia file of selection is defined as being matched with the music score.
Second aspect, embodiments provides a kind of device in structure music score storehouse, and described device includes:
First crawls module, for crawling music score from targeted website;
Second crawls module, for crawling the mark of the corresponding multimedia file of the music score from the targeted website.
First acquisition module, for according to the mark of the multimedia file, obtaining the multimedia file.
Authentication module, for according to the music score and the multimedia file, verifying the music score with multimedia text Whether part matches.
First add module, if matched with the multimedia file for the music score, by the music score and described many The corresponding relation of the mark of media file is added in music score storehouse.
Optionally, the authentication module, including:
First determining unit, for according to the music score and the multimedia file, by presetting similarity algorithm, it is determined that Similarity between the music score and the multimedia file;
Second determining unit, if exceeding predetermined threshold value for the similarity, determines the music score with the multimedia File is matched.
Optionally, described device also includes:
Second acquisition module, for obtaining preset number sample music score, each corresponding multimedia file of sample music score, And, the similarity between described each sample music score and each multimedia file;
Optimization module, for according to described each sample music score, described each corresponding multimedia file of sample music score, with And, the similarity between described each sample music score and each multimedia file, by iterative algorithm, to the default similarity Algorithm is optimized.
Optionally, described device also includes:
Second add module, for specified markup information to be added in the music score, the specified markup information is used for Mark multimedia server.
Optionally, described device also includes:
Receiver module, for the feedback information that receiving terminal sends, the feedback information includes treating school in the music score Note after positive note identifications and correction;
Modified module, for according to the note identifications, note to be corrected in the music score being revised as into the correction Note afterwards.
Optionally, described device also includes:
Statistical module, for the reception number of times that statistics receives the feedback information;
The modified module, if being additionally operable to the reception number of times exceedes preset times, performs described according to the note Mark, by note to be corrected in the music score note after the correction is revised as.
Optionally, described first module is crawled, including:
First acquisition unit, for obtaining the mark of the targeted website, according to the mark of the targeted website, obtains institute State the positional information that music score is located in targeted website;
3rd determining unit, for according to the mark of the targeted website and the positional information, in the targeted website It is middle to determine that the positional information is corresponding and crawl region;
Unit is crawled, for crawl in region the music score from described crawling.
Optionally, it is described to crawl unit, it is additionally operable to that the image comprising the music score is crawled in region from described crawling;From institute The sequence of notes and beat mark that the music score is identified in image is stated, by the sequence of notes and beat mark composition institute State music score.
Optionally, described second module is crawled, is additionally operable to crawl Word message from the targeted website, from the word The mark of the corresponding multimedia file of the music score is extracted in information.
Optionally, if the mark not crawled from the targeted website to the multimedia file, described device is also Including:
Selecting module, for according to the music score, the multimedia matched with the music score being selected from multimedia file storehouse File;
3rd add module, for the corresponding relation of the music score and the mark of the multimedia file for selecting to be added to into pleasure In spectrum storehouse.
Optionally, the selecting module, including:
Second acquisition unit, for obtaining the multimedia file storehouse in each multimedia file;
4th determining unit, for according to the music score and described each multimedia file, by presetting similarity algorithm, Determine the similarity between the music score and described each multimedia file;
Select unit, for according to the similarity between the music score and described each multimedia file, from many matchmakers Similarity is selected to meet pre-conditioned multimedia file in body library;
5th determining unit, for the multimedia file for being defined as being matched with the music score by the multimedia file of selection.
In the embodiment of the present invention, multimedia server crawls music score and the corresponding multimedia text of the music score from targeted website The mark of part, obtains the corresponding multimedia file of the music score, and by verifying whether the music score matches with the multimedia file, such as Really the music score is matched with the multimedia file, just the corresponding relation of the music score and the mark of the multimedia file is added to into music score In storehouse so that each music score multimedia file matching corresponding with the music score in the music score storehouse that multimedia server builds, carry High multimedia server builds the accuracy in music score storehouse.
Description of the drawings
Fig. 1 is a kind of method flow diagram for building music score storehouse provided in an embodiment of the present invention;
Fig. 2 is a kind of method flow diagram for building music score storehouse provided in an embodiment of the present invention;
Fig. 3 is a kind of apparatus structure schematic diagram for building music score storehouse provided in an embodiment of the present invention;
Fig. 4 is a kind of apparatus structure schematic diagram for building music score storehouse provided in an embodiment of the present invention.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with accompanying drawing to embodiment party of the present invention Formula is described in further detail.
A kind of method in structure music score storehouse is embodiments provided, the executive agent of the method can take for multimedia Business device, the multimedia server can be audio server or video server etc., and referring to Fig. 1, the method includes:
Step 101:Music score is crawled from targeted website, and, the corresponding multimedia of the music score is crawled from targeted website The mark of file.
Step 102:According to the mark of multimedia file, the multimedia file is obtained.
Step 103:According to the music score and the multimedia file, verify whether the music score matches with the multimedia file.
Step 104:If the music score is matched with the multimedia file, by the right of the mark of the music score and the multimedia file Should be related to and be added in music score storehouse.
Optionally, according to the music score and the multimedia file, verify whether the music score matches with the multimedia file, wrap Include:
According to the music score and the multimedia file, by presetting similarity algorithm, the music score and the multimedia file are determined Between similarity;
If the similarity exceedes predetermined threshold value, determine that the music score is matched with the multimedia file.
Optionally, according to the music score and the multimedia file, by presetting similarity algorithm, the music score and many matchmakers are determined Before similarity between body file, the method also includes:
Sample music score, each corresponding multimedia file of sample music score of preset number are obtained, and, each sample music score And the similarity between each multimedia file;
According to each sample music score, each corresponding multimedia file of sample music score, and, each sample music score and each Similarity between multimedia file, by iterative algorithm, is optimized to the default similarity algorithm.
Optionally, before the corresponding relation of the music score and the mark of the multimedia file is added in music score storehouse, the party Method also includes:
Specified markup information is added in the music score, the specified markup information is used to mark multimedia server.
Optionally, after the corresponding relation of the music score and the mark of the multimedia file is added in music score storehouse, the party Method also includes:
The feedback information that receiving terminal sends, the feedback information includes note identifications to be corrected in the music score and correction Note afterwards;
According to the note identifications, note to be corrected in the music score is revised as into the note after the correction.
Optionally, according to the note identifications, before the note that note to be corrected in the music score is revised as after the correction, The method also includes:
Statistics receives the reception number of times of the feedback information;
If the reception number of times exceedes preset times, perform according to the note identifications, by note to be corrected in the music score The step of note being revised as after the correction.
Optionally, music score is crawled from targeted website, including:
The mark of targeted website is obtained, according to the mark of targeted website, the position that music score is located in the targeted website is obtained Information;
According to the mark and the positional information of the targeted website, determine that the positional information is corresponding in the targeted website and climb Take region;
Crawl from this and crawl in region music score.
Optionally, crawl from this and crawl in region music score, including:
Crawl from this and the image comprising the music score is crawled in region;
The sequence of notes and beat mark of the music score is identified from the image, by the sequence of notes and the beat mark group Into the music score.
Optionally, the mark of the corresponding multimedia file of the music score is crawled from targeted website, including:
Designated area from targeted website crawls Word message, and the corresponding many matchmakers of the music score are extracted from the Word message The mark of body file.
Optionally, if the mark not crawled from targeted website to the multimedia file, the method also includes:
According to the music score, the multimedia file matched with the music score is selected from multimedia file storehouse;
The corresponding relation of the music score and the mark of the multimedia file for selecting is added in music score storehouse.
Optionally, according to the music score, the multimedia file matched with the music score is selected from multimedia file storehouse, including:
Obtain the multimedia file of each multimedia file in multimedia file storehouse;
According to the music score and the multimedia file of each multimedia file, by presetting similarity algorithm, the pleasure is determined Similarity between spectrum and each multimedia file;
According to the similarity between the music score and each multimedia file, from the multimedia file storehouse similarity is selected Meet pre-conditioned multimedia file;
The multimedia file that the multimedia file of selection is defined as being matched with the music score.
In the embodiment of the present invention, multimedia server crawls music score and the corresponding multimedia text of the music score from targeted website The mark of part, obtains the corresponding multimedia file of the music score, and by verifying whether the music score matches with the multimedia file, such as Really the music score is matched with the multimedia file, just the corresponding relation of the music score and the mark of the multimedia file is added to into music score In storehouse so that each music score multimedia file matching corresponding with the music score in the music score storehouse that multimedia server builds, carry High multimedia server builds the accuracy in music score storehouse.
A kind of method in structure music score storehouse is embodiments provided, the executive agent of the method can take for multimedia Business device, referring to Fig. 2, the method includes:
Step 201:Multimedia server crawls music score from targeted website, and, the music score is crawled from targeted website The mark of corresponding multimedia file.
This step can be realized by following steps 2011-2014, including:
Step 2011:Multimedia server obtains the mark of targeted website, according to the mark of targeted website, obtains the target The positional information that music score is located in website.
A website logo list is previously stored in multimedia server, the website logo list includes at least one net The mark stood;In this step, multimedia server obtains the mark of a website as target from the website logo list The mark of website.If it should be noted that when the website logo list included the mark of multiple websites, multimedia server The mark of multiple websites can also be obtained from the website logo list, using the mark identified as targeted website of each website Know.
In this step, there is at least one music score in the targeted website, multimedia server has prestored the targeted website In the positional information that is located of at least one music score and the targeted website mark corresponding relation, therefore, multimedia server According to the mark of targeted website, can be the step of obtain the positional information that music score is located in the targeted website:
Multimedia server is located according to the mark of the targeted website from the mark and at least one music score of targeted website Positional information corresponding relation in, determine the positional information that at least one music score in the targeted website is located.
Wherein, the mark of the targeted website can be the address of the targeted website.The positional information that the music score is located can be with The concrete field location for being music score in the webpage of the targeted website.
In the embodiment of the present invention, the positional information storage that multimedia server can be located music score is to positional information list In.Multimedia server regularly updates the website logo list and the positional information list.
Step 2012:Multimedia server according to the mark and the positional information of the targeted website, in the targeted website Determine that the positional information is corresponding and crawl region.
Multimedia server determines the targeted website according to the mark of the targeted website;According to the positional information, in the mesh Determine that the positional information is corresponding in mark website and crawl region.
Step 2013:Multimedia server is crawled from this and crawl in region music score.
In the embodiment of the present invention, it is a figure comprising the music score that multimedia server crawls crawl in region from this Picture, multimedia server can not directly read out sequence of notes and the beat mark that the music score in the image is included, multimedia Server also needs to further process the image, can just obtain the pleasure that the multimedia server can read and recognize Spectrum, therefore, this step can be:Multimedia server crawls from this and the image comprising the music score is crawled in region;Multimedia takes Business device identifies the sequence of notes and beat mark of the music score from the image, should by the sequence of notes and the beat mark composition Music score.
In this step, multimedia server crawls region and crawls to after the image comprising the music score from this, multimedia service Device can identify each note position in the images in the music score by default recognizer, and the music score Beat is identified, and according to each note position in the images in the music score, multiple notes that the music score is included are combined as Sequence of notes, and the sequence of notes and the beat mark are constituted into music score.
Wherein, the music score of the sequence of notes and the beat mark composition can be electronic music, and multimedia server is stored The acoustic feature of sequence of notes, such as corresponding pitch of the sequence of notes, melody etc. in the electronic music;The default identification Algorithm can need to arrange and change according to user, and the embodiment of the present invention is not specifically limited to this.For example, the default identification Algorithm can be to be known automatically with note frequency spectrum based on OCR (Optical Character Recognition, optical character identification) Other algorithm.
Step 2014:Multimedia server crawls the mark of the corresponding multimedia file of the music score from targeted website.
In the embodiment of the present invention, Word message can also be included in targeted website, the music score is stored in the Word message The mark of corresponding multimedia file, multimedia server to crawl the Word message from the targeted website, and then can be obtained The corresponding multimedia mark of the music score.Accordingly, this step can be:
Multimedia server designated area from targeted website crawls Word message, and the music score is extracted from the Word message The mark of corresponding multimedia file.
In this step, the designated area can be the peripheral region of the positional information that the music score is located in the targeted website, For example, the designated area be in the web page address that the music score is located the previous row field of the present field that the music score is located or after A line field etc..
The multimedia server has prestored the mark of the designated area of the targeted website, and multimedia server is obtained should The mark of designated area, according to the mark of the designated area, from the specified area of the corresponding targeted website of mark of the designated area In domain, the Word message is obtained.
Wherein, the mark of the designated area can need to arrange and change according to user, and the embodiment of the present invention is not made to this Concrete to limit, for example, the mark of the designated area can be address and the word of the designated area in webpage of the targeted website Section.
Step 202:Multimedia server obtains the multimedia file according to the mark of multimedia file.
In the embodiment of the present invention, the mark and multimedia file of multiple multimedia files is stored in multimedia server Corresponding relation, multimedia server according to the mark of the multimedia file for crawling, from the mark and multimedia of multimedia file In the corresponding relation of file, the corresponding multimedia file of mark of the multimedia file is determined.
Wherein, the mark of the multimedia file can according to user need arrange and change, the embodiment of the present invention to this not Make concrete restriction.For example, the mark of the multimedia file can be the corresponding song title of the multimedia file.
In a kind of possible design provided in an embodiment of the present invention, if multimedia server is not climbed from targeted website The mark of the multimedia file is got, multimedia server cannot obtain the multimedia file according to the mark of multimedia file, Corresponding, multimedia server obtains the multimedia file storehouse stored in multimedia server, obtains from the multimedia file storehouse Take multiple multimedia files.
Step 203:Multimedia server verifies the music score and the multimedia file according to the music score and the multimedia file Whether match.
In this step, multimedia server is obtained after music score and the corresponding multimedia file of the music score, in order to improve structure The accuracy of the corresponding music score of each multimedia file in the music score storehouse built, multimedia server can also verify the music score with Whether the multimedia file matches, wherein, multimedia server can calculate the music score and this be more by presetting similarity algorithm Similarity between media file, and then verify whether the music score matches with the multimedia file, specifically, this step can lead to Cross the realization of following steps 2031-2032.
Step 2031:Multimedia server according to the music score and the multimedia file, by presetting similarity algorithm, it is determined that Similarity between the music score and the multimedia file.
In the embodiment of the present invention, the default similarity algorithm can need to arrange and change according to user, and the present invention is implemented Example is not especially limited to this, and for example, the default similarity algorithm can be that the curling based on chromaticity and dynamic time is calculated Method.
Wherein, multimedia server is calculated between the music score and the multimedia file according to the default similarity algorithm Before similarity, in order to improve the accuracy of the similarity calculated according to the default similarity algorithm, multimedia server is also First the default similarity algorithm can be optimized, specifically, multimedia server carries out excellent to the default similarity algorithm The step of change can be:Multimedia server obtains the corresponding multimedia text of the sample music score of preset number, each sample music score Part, and, the similarity between each sample music score and each multimedia file;Multimedia server is according to each sample pleasure Spectrum, each corresponding multimedia file of sample music score, and, it is similar between each sample music score and each multimedia file Degree, by iterative algorithm, is optimized to the default similarity algorithm.
It should be noted that multimedia server has prestored the plurality of sample music score and each sample music score is corresponding Similarity between multimedia file, when multimedia server is optimized to the default similarity algorithm, multimedia server From the plurality of sample music score, preset number sample music score is obtained, and obtain each sample music score correspondence multimedia file, it is many The plurality of sample music score and each corresponding multimedia file of sample music score are updated to this by media server by iterative algorithm In default similarity algorithm, the similarity between the sample music score and the multimedia file is calculated, according to the similarity and many matchmakers Similarity between the sample music score stored in body server and the multimedia file, is carried out excellent to the default similarity algorithm Change.
Wherein, multimedia server is according to the sample music score and many matchmakers stored in the similarity and multimedia server Similarity between body file, can be the step of be optimized to the default similarity algorithm:
Multimedia server obtains the phase between the sample music score and the multimedia file stored in multimedia server Like spending, the similarity is compared with the similarity of storage in multimedia server, according to the similarity and multimedia clothes The similarity stored in business device, adjusts the parameter of the default similarity algorithm, determines so that the similarity and the multimedia clothes The similarity of business device storage closest to when parameter, and will be in the parameter read-in default similarity algorithm and then default to this Similarity algorithm is optimized.
Then, multimedia server is according to the music score and the multimedia file, the default similarity algorithm after optimization, Determine the similarity between the music score and the multimedia file.
Wherein, when multimedia server calculates the similarity of the music score and the multimedia file, multimedia server passes through The audio signal of the multimedia file, according to the music score and the audio signal, determines between the music score and the multimedia file Similarity, therefore, this step can be:
Multimedia server extracts the audio signal that the multimedia file includes, according to the audio signal and the music score, The music score and the audio signal are substituted into into the default similarity algorithm after the optimization, is calculated between the music score and the audio signal Similarity, and then determine the similarity between the music score and the multimedia file.
Step 2032:If the similarity exceedes predetermined threshold value, multimedia server determines the music score with the multimedia text Part is matched.
In this step, multimedia server determines the music score according to the similarity between the music score and the multimedia file Whether match with the multimedia file:If the similarity exceedes predetermined threshold value, multimedia server determines that the music score is more with this Media file is matched;If the similarity is less than predetermined threshold value, multimedia server determines the music score and the multimedia file Mismatch.
Wherein, the predetermined threshold value can need to arrange and change according to user, and the embodiment of the present invention does not do concrete limit to this Fixed, for example, the predetermined threshold value can be with 90%, 95% etc..
If the music score is matched with the multimedia file, execution step 204;If the music score and the multimedia file are not Match somebody with somebody, abandon the music score.
Step 204:If the music score is matched with the multimedia file, multimedia server is literary by the music score and the multimedia The corresponding relation of the mark of part is added in music score storehouse.
In this step, if the music score is matched with the multimedia file, multimedia server is by the music score and the multimedia Before the corresponding relation of the mark of file is added in music score, multimedia server can be taken with adding multimedia in the music score The copyright ownership of business device is identified, and detailed process can be:Multimedia server is added to specified markup information in the music score, should Specified markup information is used to mark the multimedia server.
In this step, the specified markup information can according to user need arrange and change, the embodiment of the present invention to this not It is specifically limited, for example, the specified markup information can be the address of the multimedia server or the multimedia server Title etc..
Then, the addition is specified the music score after markup information and the mark of the multimedia file by multimedia server again Corresponding relation is added in the music score storehouse.
So, multimedia server builds the multimedia file storehouse correspondence according to the corresponding music score of each multimedia file Music score storehouse.
In a kind of possible design provided in an embodiment of the present invention, if multimedia server is not climbed from targeted website The mark of the multimedia file is got, multimedia server obtains the multimedia file storehouse stored in multimedia server, from this Multiple multimedia files are obtained in multimedia file storehouse, and then is selected from the plurality of multimedia file many with what the music score was matched Media file, detailed process can be:
Multimedia server obtains each multimedia file in multimedia file storehouse;Multimedia server is according to the music score With each multimedia file, by presetting similarity algorithm, determine similar between the music score and this each multimedia file Degree;Multimedia server is selected according to the similarity between the music score and each multimedia file from the multimedia file storehouse Select similarity and meet pre-conditioned multimedia file;Multimedia server is defined as the multimedia file of selection and the music score The multimedia file of matching.
Further, the corresponding relation of the music score and the mark of the multimedia file for selecting is added to music score by multimedia server In storehouse.
In this step, multimedia server determines the realization side of the similarity between the music score and each multimedia file Formula is consistent with the implementation of step 203, no longer repeats one by one herein.
Wherein, this it is pre-conditioned can be needed arrange and change according to user, the embodiment of the present invention does not do concrete limit to this It is fixed.For example, this it is pre-conditioned can be similarity highest and to reach predetermined threshold value.
In a kind of possible design provided in an embodiment of the present invention, the music score is entered into the music score storehouse by multimedia server In after, multimedia server according to the feedback information that terminal sends, can enter advance by following steps 205 to the music score The optimization of one step.
Step 205:The feedback information that multimedia server receiving terminal sends, the feedback information includes being treated in the music score Note after the note identifications of correction and correction;Multimedia server according to the note identifications, by sound to be corrected in the music score Symbol is revised as the note after the correction.
In the embodiment of the present invention, multimedia server can provide the terminal with one feedback entrance of terminal, and terminal is to user When showing music score, terminal provides feedback button in current interface, when user checks the music score, if it find that exist in the music score treating The note of correction, can trigger the feedback button, in the feed back input frame input feedback information for ejecting, when terminal detects user During the feedback information being input in feed back input frame, terminal obtains the feedback information, and by the feedback entrance, to multimedia clothes Business device sends the feedback information.
Wherein, the note after note identifications to be corrected in music score, and correction is at least included in the feedback information, is easy to Note to be corrected in music score is revised as the note after correcting by multimedia server according to the note identifications to be corrected.
In this step, multimedia server changes note to be corrected in music score according to the note identifications to be corrected For note after correction the step of before, in order to improve the accuracy of correction, for each music score, when multimedia server is received When the reception number of times of feedback information exceedes preset times, multimedia server is just corrected to the music score, therefore,
This step can be:Multimedia server statistics receives the reception number of times of the feedback information;If the reception number of times More than preset times, multimedia server is performed according to the note identifications, and note to be corrected in the music score is revised as into the school The step of note after just.
Wherein, the preset times can need to arrange and change according to user, and the embodiment of the present invention does not do concrete limit to this It is fixed, for example, the preset times can with 10 times, it is 35 inferior.
In a kind of possible design provided in an embodiment of the present invention, removing in the feedback information includes note to be corrected in music score Beyond note after mark, and correction, the feedback information can also include review information of the user to the music score, for example, should Review information can be user the thumb up of the music score is commented on or user input text reviews etc..Multimedia server may be used also According to the review information of user, further to be corrected to the music score.
In the embodiment of the present invention, multimedia server crawls music score and the corresponding multimedia text of the music score from targeted website The mark of part, obtains the corresponding multimedia file of the music score, and by verifying whether the music score matches with the multimedia file, such as Really the music score is matched with the multimedia file, just the corresponding relation of the music score and the mark of the multimedia file is added to into music score In storehouse so that each music score multimedia file matching corresponding with the music score in the music score storehouse that multimedia server builds, carry High multimedia server builds the accuracy in music score storehouse.
A kind of device in structure music score storehouse is embodiments provided, the device can be applicable on multimedia server, Referring to Fig. 3, the device crawls module 301 including first, and second crawls module 302, the first acquisition module 303, authentication module 304 With the first add module 305.
This first crawls module 301, for crawling music score from targeted website;
This second crawls module 302, for crawling the mark of the corresponding multimedia file of the music score from the targeted website;
First acquisition module 303, for according to the mark of the multimedia file, obtaining the multimedia file;
The authentication module 304, for according to the music score and the multimedia file, verifying that the music score is with the multimedia file No matching;
First add module 305, if matched with the multimedia file for the music score, by the music score and the multimedia The corresponding relation of the mark of file is added in music score storehouse.
Optionally, the authentication module 304, including:
First determining unit, for according to the music score and the multimedia file, by presetting similarity algorithm, determining the pleasure Similarity between spectrum and the multimedia file;
Second determining unit, if exceeding predetermined threshold value for the similarity, determines the music score and the multimedia file Match somebody with somebody.
Optionally, the device also includes:
Second acquisition module, for obtaining preset number sample music score, each corresponding multimedia file of sample music score, And, the similarity between each sample music score and each multimedia file;
Optimization module, for according to each sample music score, each corresponding multimedia file of sample music score, and, Similarity between each sample music score and each multimedia file, by iterative algorithm, enters to the default similarity algorithm Row optimization.
Optionally, the device also includes:
Second add module, for specified markup information to be added in the music score, the specified markup information is used to mark Note multimedia server.
Optionally, the device also includes:
Receiver module, for the feedback information that receiving terminal sends, the feedback information includes to be corrected in the music score Note after note identifications and correction;
Modified module, for according to the note identifications, note to be corrected in the music score being revised as into the sound after the correction Symbol.
Optionally, the device also includes:
Statistical module, for the reception number of times that statistics receives the feedback information;
The modified module, if being additionally operable to the reception number of times more than preset times, performs this according to the note identifications, by this Note to be corrected is revised as the note after the correction in music score.
Optionally, this first crawls module 301, including:
First acquisition unit, for obtaining the mark of the targeted website, according to the mark of the targeted website, obtains the target The positional information that music score is located in website;
3rd determining unit, for according to the mark of the targeted website and the positional information, determining in the targeted website The positional information is corresponding to crawl region;
Unit is crawled, crawl in region the music score for crawling from this.
Optionally, this crawls unit, is additionally operable to from this crawl crawl the image comprising the music score in region;From the image The sequence of notes and beat mark of the music score is identified, the sequence of notes and the beat mark are constituted into the music score.
Optionally, this second crawls module 302, is additionally operable to crawl Word message from the targeted website, from word letter The mark of the corresponding multimedia file of the music score is extracted in breath.
Optionally, if the mark not crawled from the targeted website to the multimedia file, the device also includes:
Selecting module, for according to the music score, the multimedia file matched with the music score being selected from multimedia file storehouse;
3rd add module, for the corresponding relation of the music score and the mark of the multimedia file for selecting to be added to into music score In storehouse.
Optionally, the selecting module, including:
Second acquisition unit, for obtaining the multimedia file storehouse in each multimedia file;
4th determining unit, for according to the music score and each multimedia file, by presetting similarity algorithm, it is determined that Similarity between the music score and each multimedia file;
Select unit, for according to the similarity between the music score and each multimedia file, from the multimedia file Similarity is selected to meet pre-conditioned multimedia file in storehouse;
5th determining unit, for the multimedia file for being defined as being matched with the music score by the multimedia file of selection.
In the embodiment of the present invention, multimedia server crawls music score and the corresponding multimedia text of the music score from targeted website The mark of part, obtains the corresponding multimedia file of the music score, and by verifying whether the music score matches with the multimedia file, such as Really the music score is matched with the multimedia file, just the corresponding relation of the music score and the mark of the multimedia file is added to into music score In storehouse so that each music score multimedia file matching corresponding with the music score in the music score storehouse that multimedia server builds, carry High multimedia server builds the accuracy in music score storehouse.
It should be noted that:The structure music score storehouse device that above-described embodiment is provided when music score storehouse is built, only with above-mentioned each The division of functional module is illustrated, and in practical application, as desired can distribute above-mentioned functions by different work( Can module complete, will the internal structure of device be divided into different functional modules, to complete whole described above or portion Divide function.In addition, above-described embodiment device for building music score storehouse for providing and the embodiment of the method for building music score storehouse belong to same Design, it implements process and refers to embodiment of the method, repeats no more here.
Fig. 4 is a kind of structural representation of multimedia server provided in an embodiment of the present invention;The multimedia server 400 Can include one or more central processing units (central because of configuration or performance is different and the larger difference of producing ratio Processing units, CPU) 422 (for example, one or more processors) and memory 432, one or more The storage medium 430 (such as one or more mass memory units) of storage application program 442 or data 444.Wherein, deposit Reservoir 432 and storage medium 430 can be of short duration storage or persistently storage.Being stored in the program of storage medium 430 can include One or more modules (diagram is not marked), each module can include grasping the series of instructions in multimedia server Make.Further, central processing unit 422 could be arranged to be communicated with storage medium 430, hold in abnormal injected system 400 Series of instructions operation in row storage medium 430.
Abnormal injected system 400 can also include one or more power supplys 426, one or more wired or nothings Wired network interface 450, one or more input/output interfaces 454, one or more keyboards 456, and/or, one Or more than one operating system 441, such as Windows ServerTM, Mac OS XTM, UnixTM,LinuxTM, FreeBSDTMDeng Deng.
The multimedia server 400 can be used for performing multimedia in the method for building music score storehouse that above-described embodiment is provided Step performed by server.
One of ordinary skill in the art will appreciate that realizing all or part of step of above-described embodiment can pass through hardware To complete, it is also possible to which the hardware that correlation is instructed by program is completed, and described program can be stored in a kind of computer-readable In storage medium, storage medium mentioned above can be read-only storage, disk or CD etc..
The foregoing is only presently preferred embodiments of the present invention, not to limit the present invention, all spirit in the present invention and Within principle, any modification, equivalent substitution and improvements made etc. should be included within the scope of the present invention.

Claims (22)

1. a kind of method for building music score storehouse, it is characterised in that methods described includes:
Music score is crawled from targeted website, and, the corresponding multimedia file of the music score is crawled from the targeted website Mark;
According to the mark of the multimedia file, the multimedia file is obtained;
According to the music score and the multimedia file, verify whether the music score matches with the multimedia file;
If the music score is matched with the multimedia file, the correspondence of the mark of the music score and the multimedia file is closed System is added in music score storehouse.
2. method according to claim 1, it is characterised in that described according to the music score and the multimedia file, tests Demonstrate,prove whether the music score matches with the multimedia file, including:
According to the music score and the multimedia file, by presetting similarity algorithm, the music score and the multimedia are determined Similarity between file;
If the similarity exceedes predetermined threshold value, determine that the music score is matched with the multimedia file.
3. method according to claim 2, it is characterised in that described according to the music score and the multimedia file, leads to Default similarity algorithm is crossed, before determining the similarity between the music score and the multimedia file, methods described also includes:
Sample music score, each corresponding multimedia file of sample music score of preset number are obtained, and, described each sample music score And the similarity between each multimedia file;
According to described each sample music score, described each corresponding multimedia file of sample music score, and, described each sample pleasure Similarity between spectrum and each multimedia file, by iterative algorithm, is optimized to the default similarity algorithm.
4. method according to claim 1, it is characterised in that described by the music score and the mark of the multimedia file Corresponding relation be added in music score storehouse before, methods described also includes:
Specified markup information is added in the music score, the specified markup information is used to mark multimedia server.
5. method according to claim 1, it is characterised in that described by the music score and the mark of the multimedia file Corresponding relation be added in music score storehouse after, methods described also includes:
The feedback information that receiving terminal sends, the feedback information includes note identifications to be corrected in the music score and correction Note afterwards;
According to the note identifications, note to be corrected in the music score is revised as into the note after the correction.
6. method according to claim 5, it is characterised in that described according to the note identifications, will treat in the music score The note of correction is revised as before the note after the correction, and methods described also includes:
Statistics receives the reception number of times of the feedback information;
If the reception number of times exceedes preset times, execution is described according to the note identifications, will be to be corrected in the music score Note the step of be revised as the note after the correction.
7. method according to claim 1, it is characterised in that described that music score is crawled from targeted website, including:
The mark of the targeted website is obtained, according to the mark of the targeted website, music score in the targeted website is obtained and is located Positional information;
According to the mark and the positional information of the targeted website, the positional information correspondence is determined in the targeted website Crawl region;
Crawl in region the music score from described crawling.
8. method according to claim 7, it is characterised in that described crawl in region the music score from described crawling, bag Include:
The image comprising the music score is crawled in region from described crawling;
The sequence of notes and beat mark of the music score is identified from described image, by the sequence of notes and the beat mark Know the composition music score.
9. method according to claim 1, it is characterised in that described that the music score correspondence is crawled from the targeted website Multimedia file mark, including:
Designated area from the targeted website crawls Word message, the music score is extracted from the Word message corresponding The mark of multimedia file.
10. method according to claim 1, it is characterised in that if do not crawled from the targeted website to described The mark of multimedia file, methods described also includes:
According to the music score, the multimedia file matched with the music score is selected from multimedia file storehouse;
The corresponding relation of the music score and the mark of the multimedia file for selecting is added in music score storehouse.
11. methods according to claim 10, it is characterised in that described according to the music score, from multimedia file storehouse The multimedia file that selection is matched with the music score, including:
Obtain each multimedia file in the multimedia file storehouse;
According to the music score and described each multimedia file, by presetting similarity algorithm, determine that the music score is every with described Similarity between individual multimedia file;
According to the similarity between the music score and described each multimedia file, select similar from the multimedia file storehouse Degree meets pre-conditioned multimedia file;
The multimedia file that the multimedia file of selection is defined as being matched with the music score.
12. a kind of devices for building music score storehouse, it is characterised in that described device includes:
First crawls module, for crawling music score from targeted website;
Second crawls module, for crawling the mark of the corresponding multimedia file of the music score from the targeted website;
First acquisition module, for according to the mark of the multimedia file, obtaining the multimedia file;
Authentication module, for according to the music score and the multimedia file, verifying that the music score is with the multimedia file No matching;
First add module, if matched with the multimedia file for the music score, by the music score and the multimedia The corresponding relation of the mark of file is added in music score storehouse.
13. devices according to claim 12, it is characterised in that the authentication module, including:
First determining unit, for according to the music score and the multimedia file, by presetting similarity algorithm, it is determined that described Similarity between music score and the multimedia file;
Second determining unit, if exceeding predetermined threshold value for the similarity, determines the music score with the multimedia file Matching.
14. devices according to claim 13, it is characterised in that described device also includes:
Second acquisition module, for obtaining sample music score, each corresponding multimedia file of sample music score of preset number, with And, the similarity between described each sample music score and each multimedia file;
Optimization module, for according to described each sample music score, described each corresponding multimedia file of sample music score, and, Similarity between described each sample music score and each multimedia file, by iterative algorithm, to the default similarity operator Method is optimized.
15. devices according to claim 12, it is characterised in that described device also includes:
Second add module, for specified markup information to be added in the music score, the specified markup information is used to mark Multimedia server.
16. devices according to claim 12, it is characterised in that described device also includes:
Receiver module, for the feedback information that receiving terminal sends, the feedback information includes to be corrected in the music score Note after note identifications and correction;
Modified module, for according to the note identifications, note to be corrected in the music score being revised as after the correction Note.
17. devices according to claim 16, it is characterised in that described device also includes:
Statistical module, for the reception number of times that statistics receives the feedback information;
The modified module, if being additionally operable to the reception number of times exceedes preset times, execution is described according to the note identifications, Note to be corrected in the music score is revised as into the note after the correction.
18. devices according to claim 12, it is characterised in that described first crawls module, including:
First acquisition unit, for obtaining the mark of the targeted website, according to the mark of the targeted website, obtains the mesh The positional information that music score is located in mark website;
3rd determining unit, it is true in the targeted website for according to the mark of the targeted website and the positional information Calmly the positional information is corresponding crawls region;
Unit is crawled, for crawl in region the music score from described crawling.
19. devices according to claim 18, it is characterised in that
It is described to crawl unit, it is additionally operable to that the image comprising the music score is crawled in region from described crawling;Know from described image Do not go out the sequence of notes and beat mark of the music score, by the sequence of notes and the beat mark composition music score.
20. devices according to claim 12, it is characterised in that
Described second crawls module, and the designated area being additionally operable to from the targeted website crawls Word message, from the word The mark of the corresponding multimedia file of the music score is extracted in information.
21. devices according to claim 12, it is characterised in that if do not crawled from the targeted website to described The mark of multimedia file, described device also includes:
Selecting module, for according to the music score, the multimedia file matched with the music score being selected from multimedia file storehouse;
3rd add module, for the corresponding relation of the music score and the mark of the multimedia file for selecting to be added to into music score storehouse In.
22. devices according to claim 21, it is characterised in that the selecting module, including:
Second acquisition unit, for obtaining the multimedia file storehouse in each multimedia file;
4th determining unit, for according to the music score and described each multimedia file, by presetting similarity algorithm, it is determined that Similarity between the music score and described each multimedia file;
Select unit, for according to the similarity between the music score and described each multimedia file, from multimedia text Similarity is selected to meet pre-conditioned multimedia file in part storehouse;
5th determining unit, for the multimedia file for being defined as being matched with the music score by the multimedia file of selection.
CN201611243896.1A 2016-12-29 2016-12-29 Music score library establishing method and device Pending CN106649811A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611243896.1A CN106649811A (en) 2016-12-29 2016-12-29 Music score library establishing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611243896.1A CN106649811A (en) 2016-12-29 2016-12-29 Music score library establishing method and device

Publications (1)

Publication Number Publication Date
CN106649811A true CN106649811A (en) 2017-05-10

Family

ID=58835575

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611243896.1A Pending CN106649811A (en) 2016-12-29 2016-12-29 Music score library establishing method and device

Country Status (1)

Country Link
CN (1) CN106649811A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107704631A (en) * 2017-10-30 2018-02-16 西华大学 Crowdsourcing-based music annotation atom library construction method
CN111159516A (en) * 2019-12-09 2020-05-15 青岛聚看云科技有限公司 Media information processing method and device
CN115329105A (en) * 2022-10-12 2022-11-11 杭州网易云音乐科技有限公司 Multimedia data matching method and device, storage medium and electronic equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1744197A (en) * 2005-10-10 2006-03-08 周大为 Computer music expanding method
CN101178738A (en) * 2007-12-07 2008-05-14 深圳市迅雷网络技术有限公司 Music information searching method, system, service terminal and customer terminal
CN105280170A (en) * 2015-10-10 2016-01-27 北京百度网讯科技有限公司 Method and device for playing music score
CN105355115A (en) * 2015-11-12 2016-02-24 郑州大学西亚斯国际学院 Music teaching system and method
CN106157973A (en) * 2016-07-22 2016-11-23 南京理工大学 Music detection and recognition methods

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1744197A (en) * 2005-10-10 2006-03-08 周大为 Computer music expanding method
CN101178738A (en) * 2007-12-07 2008-05-14 深圳市迅雷网络技术有限公司 Music information searching method, system, service terminal and customer terminal
CN105280170A (en) * 2015-10-10 2016-01-27 北京百度网讯科技有限公司 Method and device for playing music score
CN105355115A (en) * 2015-11-12 2016-02-24 郑州大学西亚斯国际学院 Music teaching system and method
CN106157973A (en) * 2016-07-22 2016-11-23 南京理工大学 Music detection and recognition methods

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107704631A (en) * 2017-10-30 2018-02-16 西华大学 Crowdsourcing-based music annotation atom library construction method
CN107704631B (en) * 2017-10-30 2020-12-01 西华大学 Crowdsourcing-based music annotation atom library construction method
CN111159516A (en) * 2019-12-09 2020-05-15 青岛聚看云科技有限公司 Media information processing method and device
CN111159516B (en) * 2019-12-09 2023-10-13 青岛聚看云科技有限公司 Media information processing method and device
CN115329105A (en) * 2022-10-12 2022-11-11 杭州网易云音乐科技有限公司 Multimedia data matching method and device, storage medium and electronic equipment

Similar Documents

Publication Publication Date Title
CN104933363B (en) Method and device for detecting malicious file
CN104156454B (en) The error correction method and device of search term
CN108495185B (en) Video title generation method and device
WO2017088415A1 (en) Method, apparatus and electronic device for video content retrieval
US8768744B2 (en) Method and apparatus for automated user review of media content in a mobile communication device
CN106649811A (en) Music score library establishing method and device
CN110609957B (en) Global searching method, terminal and server
CN1983253A (en) Method, apparatus and system for supplying musically searching service
CN108366278A (en) A kind of user in video playing interacts implementation method and device
CN109948122B (en) Error correction method and device for input text and electronic equipment
CN101984422A (en) Fault-tolerant text query method and equipment
CN103678560A (en) Multimedia resource error correction searching method and system and multimedia resource server
CN103841464A (en) Video information pushing method and device
CN103812906B (en) Website recommendation method and device and communication system
US20080045205A1 (en) Method and apparatus for constructing database in mobile communication terminal
CN104751847A (en) Data acquisition method and system based on overprint recognition
EP2423837B1 (en) Method and system for viewing web page and computer program product thereof
CN110233821B (en) Detection and safety scanning system and method for network space of intelligent equipment
CN102436458B (en) A kind of method of command analysis and system thereof
CN105991403A (en) Instant messaging (IM) based multimedia sharing method and apparatus
CN105635753B (en) The method for down loading and device of media data
CN110140144B (en) Image processing system for validating rendered data
CN111385360A (en) Terminal equipment identification method and device and computer readable storage medium
CN111460181A (en) Multimedia resource recommendation method, electronic device and storage medium
CN107657026B (en) User interface unit testing method and device, readable storage medium and equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: 510660 Guangzhou City, Guangzhou, Guangdong, Whampoa Avenue, No. 315, self - made 1-17

Applicant after: Guangzhou KuGou Networks Co., Ltd.

Address before: 510000 B1, building, No. 16, rhyme Road, Guangzhou, Guangdong, China 13F

Applicant before: Guangzhou KuGou Networks Co., Ltd.

RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20170510