CN101673262A - Method for searching audio content - Google Patents
Method for searching audio content Download PDFInfo
- Publication number
- CN101673262A CN101673262A CN200810042853A CN200810042853A CN101673262A CN 101673262 A CN101673262 A CN 101673262A CN 200810042853 A CN200810042853 A CN 200810042853A CN 200810042853 A CN200810042853 A CN 200810042853A CN 101673262 A CN101673262 A CN 101673262A
- Authority
- CN
- China
- Prior art keywords
- audio
- frequency fingerprint
- search
- index
- fingerprint
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 31
- 230000011218 segmentation Effects 0.000 claims abstract description 18
- 238000000605 extraction Methods 0.000 claims abstract description 5
- 239000000284 extract Substances 0.000 claims description 6
- 239000012634 fragment Substances 0.000 claims description 4
- 238000005516 engineering process Methods 0.000 description 3
- 239000000463 material Substances 0.000 description 2
- 230000018109 developmental process Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a method for searching an audio content, which comprises:1) an audio fingerprint extraction step, which is to extract audio fingerprints of a plurality of audio files; 2) an audio fingerprint segmentation step, which is to segment the audio fingerprints extracted by the step 1); 3) an index generation step, which is to generate an audio fingerprint index according to the result of the segmentation in the step 2); and 4) a searching step, which is to search a matched audio file by using the audio fingerprint index. In the method, a segmentation technique in a text searchengine is used to perform segmentation processing of the audio fingerprint files first, then an index technique in the field of text search is used to perform the index processing of the audio fingerprints, and finally, after the index processing is completed, the search engine can search an audio segment input by a user. Thus, the method facilitates the search of the user and improves search efficiency.
Description
Technical field
The present invention relates to the searching method of audio content.
Background technology
Along with Internet development, search engine becomes people's one of necessary tool of surfing the Net.Traditional search engine all is based on text search (Text Search), and being called is text search engine.Its principle is: search engine server is collected a large amount of webpages; And according to the text in the existing Rule Extraction webpage and do participle (Word Segmentation) and handle, common segmenting method, for example: based on the segmenting method of string matching, based on the segmenting method of understanding with based on the segmenting method of statistics; Text search engine utilizes the text dictionary to index and shows to be used for quick search.The user is input to server with text when searching for, server is searched for according to concordance list, then return results after the text is carried out word segmentation processing fast.
At present, search engine all is based on text, searches for even the search engine of some search pictures or audio frequency also is text messages such as title, explanation, introduction, label by picture or audio program.Search engine does not also have directly to search for by the signal content of audio frequency.
Audio-frequency fingerprint (audio fingerprinting) just is being suggested a long time ago, for example, Jaap Haitsma and TonKalke have delivered " a kind of audio fingerprint system of high reliability " (A Highly Robust AudioFingerprinting System) on music searching in 2002 makes progress international conference (Proceedings of International Conference on MusicInformation Retrieval).This system passes through method for processing signals, with the sound signal of (for example 11.6ms) at set intervals in the audio file, be converted into the fingerprint (fingerprint) of one 32 bit (bit) size, an audio file just can be converted into a file fingerprint by this method.System just can carry out fast audio-frequency fingerprint and retrieve behind table that all audio-frequency fingerprint files are indexed.
Under audio-frequency fingerprint number of files less (for example 10,000 s') situation, all file fingerprints can be deposited in the calculator memory, carry out index after, can retrieve fast easily.Above-mentioned " a kind of audio fingerprint system of high reliability " promptly provided the detailed step of this method.Yet under actual conditions, the number of audio file will be considerably beyond 10,000 number.For example, the number of audio files that occurs on the internet surpasses 10,000,000 numbers at present, and quantity is in continuous growth.Therefore adopt this method to be difficult to make practical search engine.
Summary of the invention
In order to solve the problems of the technologies described above, the invention provides a kind of searching method of audio content, it is audio-frequency fingerprint search engine (audio fingerprint search engine) that this search engine is called.
The present invention adopts following technical scheme:
A kind of searching method of audio content comprises:
1) audio-frequency fingerprint extraction step extracts the audio-frequency fingerprint of a plurality of audio files;
2) audio-frequency fingerprint participle step, the audio-frequency fingerprint that step 1) is extracted carries out participle;
3) index generates step, according to step 2) word segmentation result generate the audio-frequency fingerprint index;
4) search step, the audio file that utilizes this audio-frequency fingerprint indexed search to mate.
Wherein, described step 4) specifically may further comprise the steps:
According to audio file or the audio file fragment that the needs of input are retrieved, extract its audio-frequency fingerprint, this audio-frequency fingerprint is carried out participle, according to the audio file of word segmentation result search matched in described audio-frequency fingerprint index.
Wherein, further comprising the steps of before the described step 4) after the described step 3):
Storing step, store audio fingerprints, described audio-frequency fingerprint index and corresponding audio files thereof.
The present invention is by adopting the participle technique in the text search engine, on the audio-frequency fingerprint file, carry out word segmentation processing, adopt the index technology in the text search field that audio-frequency fingerprint is carried out index process then, after index process was finished, search engine can be searched for the audio fragment of user's input.Not only make things convenient for user's search, and improved the efficient of search.
Further specify the present invention below in conjunction with drawings and Examples.
Description of drawings
Fig. 1 is the searching method embodiment schematic flow sheet of audio content of the present invention.
Embodiment
As shown in Figure 1, a kind of searching method of audio content comprises:
1) audio-frequency fingerprint extraction step extracts the audio-frequency fingerprint of a plurality of audio files;
2) audio-frequency fingerprint participle step, the audio-frequency fingerprint that step 1) is extracted carries out participle;
3) index generates step, according to step 2) word segmentation result generate the audio-frequency fingerprint index;
4) search step, the audio file that utilizes this audio-frequency fingerprint indexed search to mate.
Wherein, described step 4) specifically may further comprise the steps:
According to audio file or the audio file fragment that the needs of input are retrieved, extract its audio-frequency fingerprint, this audio-frequency fingerprint is carried out participle, according to the audio file of word segmentation result search matched in described audio-frequency fingerprint index.
Wherein, further comprising the steps of before the described step 4) after the described step 3):
Storing step, store audio fingerprints, described audio-frequency fingerprint index and corresponding audio files thereof.
Participle mode in the foregoing description can adopt multiple mode to realize, below enumerates several modes and illustrates respectively.
Mode one
Employing is carried out word segmentation processing based on the Chinese word segmentation method of statistics to audio-frequency fingerprint.At first with the method generation width fixing file fingerprint of 15000 audio files by above-mentioned Jaap Haitsma and Ton Kalke, its width can be 32 bits or 16 bits, and each file fingerprint that obtains on average is made up of the fixing fingerprint of about 10000 width.The data of each 32 bit or 16 bits are counted as a word in the Chinese.It is 15000 pieces " articles " that all 15000 file fingerprints that comprise " word " are taken as, and these " articles " then carry out participle as the language material of Chinese word segmentation.In statistic processes, the frequency of the combination of each " word " of adjacent co-occurrence in the audio frequency language material is added up.The combination that the co-occurrence frequency is high is considered to a speech, is called " fingerprint speech ".For example, the combination of the fingerprint of 7 continuous scale-of-two " 00000000000000000000000000000000 " that frequency is higher, with the combination of the fingerprint of 5 continuous scale-of-two " 11111111111111111111111111111111 " be the higher fingerprint combination of frequency by statistics, they are used as " fingerprint speech ".
Mode two
Adopting the fingerprint width is the audio-frequency fingerprint extracting method of 16 bits.Specifically be to be that the fingerprint of 32 bits carries out the fingerprint that interval sampling obtains 16 bits with width in the mode one.Adopt the Chinese word segmentation method based on add up identical to carry out the word segmentation processing of audio-frequency fingerprint then with mode one.
Claims (3)
1, a kind of searching method of audio content is characterized in that comprising:
1) audio-frequency fingerprint extraction step extracts the audio-frequency fingerprint of a plurality of audio files;
2) audio-frequency fingerprint participle step, the audio-frequency fingerprint that step 1) is extracted carries out participle;
3) index generates step, according to step 2) word segmentation result generate the audio-frequency fingerprint index;
4) search step, the audio file that utilizes this audio-frequency fingerprint indexed search to mate.
2, the searching method of audio content according to claim 1 is characterized in that, described step 4) specifically may further comprise the steps:
According to audio file or the audio file fragment that the needs of input are retrieved, extract its audio-frequency fingerprint, this audio-frequency fingerprint is carried out participle, according to the audio file of word segmentation result search matched in described audio-frequency fingerprint index.
3, the searching method of audio content according to claim 1 and 2 is characterized in that, and is further comprising the steps of before the described step 4) after the described step 3):
Storing step, store audio fingerprints, described audio-frequency fingerprint index and corresponding audio files thereof.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200810042853A CN101673262B (en) | 2008-09-12 | 2008-09-12 | Method for searching audio content |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200810042853A CN101673262B (en) | 2008-09-12 | 2008-09-12 | Method for searching audio content |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101673262A true CN101673262A (en) | 2010-03-17 |
| CN101673262B CN101673262B (en) | 2012-10-10 |
Family
ID=42020491
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200810042853A Expired - Fee Related CN101673262B (en) | 2008-09-12 | 2008-09-12 | Method for searching audio content |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101673262B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102663112A (en) * | 2012-04-18 | 2012-09-12 | 上海大学 | Music retrieval system based on mobile embedded device |
| WO2012163013A1 (en) * | 2011-10-19 | 2012-12-06 | 华为技术有限公司 | Music query method and apparatus |
| CN103294696A (en) * | 2012-02-27 | 2013-09-11 | 盛乐信息技术（上海）有限公司 | Audio and video content retrieval method and system |
| CN103999473A (en) * | 2011-12-20 | 2014-08-20 | 雅虎公司 | Audio fingerprint for content identification |
| CN103995890A (en) * | 2014-05-30 | 2014-08-20 | 杭州智屏软件有限公司 | Method for updating and searching for data of real-time audio fingerprint search library |
| CN105825850A (en) * | 2016-04-29 | 2016-08-03 | 腾讯科技（深圳）有限公司 | Audio processing method and device |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7013301B2 (en) * | 2003-09-23 | 2006-03-14 | Predixis Corporation | Audio fingerprinting system and method |
| US6990453B2 (en) * | 2000-07-31 | 2006-01-24 | Landmark Digital Services Llc | System and methods for recognizing sound and music signals in high noise and distortion |
| JP2006506659A (en) * | 2002-11-01 | 2006-02-23 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Fingerprint search and improvements |
| US7382905B2 (en) * | 2004-02-11 | 2008-06-03 | Microsoft Corporation | Desynchronized fingerprinting method and system for digital multimedia data |
-
2008
- 2008-09-12 CN CN200810042853A patent/CN101673262B/en not_active Expired - Fee Related
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012163013A1 (en) * | 2011-10-19 | 2012-12-06 | 华为技术有限公司 | Music query method and apparatus |
| CN103999473A (en) * | 2011-12-20 | 2014-08-20 | 雅虎公司 | Audio fingerprint for content identification |
| EP2795913B1 (en) * | 2011-12-20 | 2019-11-27 | Oath Inc. | Audio fingerprint for content identification |
| CN103294696A (en) * | 2012-02-27 | 2013-09-11 | 盛乐信息技术（上海）有限公司 | Audio and video content retrieval method and system |
| CN103294696B (en) * | 2012-02-27 | 2018-01-19 | 上海果壳电子有限公司 | Audio-video frequency content search method and system |
| CN102663112A (en) * | 2012-04-18 | 2012-09-12 | 上海大学 | Music retrieval system based on mobile embedded device |
| CN103995890A (en) * | 2014-05-30 | 2014-08-20 | 杭州智屏软件有限公司 | Method for updating and searching for data of real-time audio fingerprint search library |
| CN105825850A (en) * | 2016-04-29 | 2016-08-03 | 腾讯科技（深圳）有限公司 | Audio processing method and device |
| CN105825850B (en) * | 2016-04-29 | 2021-08-24 | 腾讯科技（深圳）有限公司 | Audio processing method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101673262B (en) | 2012-10-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101673266B (en) | Method for searching audio and video contents | |
| CN100405371C (en) | Method and system for abstracting new word | |
| CN101673262B (en) | Method for searching audio content | |
| CN102053991B (en) | Method and system for multi-language document retrieval | |
| CN104881458B (en) | A kind of mask method and device of Web page subject | |
| CN101593200A (en) | Chinese Web page classification method based on the keyword frequency analysis | |
| CN104199972A (en) | Named entity relation extraction and construction method based on deep learning | |
| CN102411578A (en) | Multimedia playing system and method | |
| CN102262625A (en) | Method and device for extracting keywords of page | |
| CN102253930A (en) | Method and device for translating text | |
| CN103324626A (en) | Method for setting multi-granularity dictionary and segmenting words and device thereof | |
| CN101673263B (en) | Method for searching video content | |
| CN102789464A (en) | Natural language processing method, device and system based on semanteme recognition | |
| CN109101491B (en) | Author information extraction method and device, computer device and computer readable storage medium | |
| CN102375863A (en) | Method and device for keyword extraction in geographic information field | |
| CN101673267B (en) | Method for searching audio and video content | |
| CN106372083B (en) | A kind of method and system that controversial news clue is found automatically | |
| WO2015024429A1 (en) | Method and device for acquiring movie and television subject from webpage | |
| CN105574004B (en) | A kind of removing duplicate webpages method and apparatus | |
| CN111325019A (en) | Word bank updating method and device and electronic equipment | |
| CN109472020A (en) | A kind of feature alignment Chinese word cutting method | |
| CN101751403B (en) | Method for transforming hypertext tag language file to text file | |
| CN105608137A (en) | Method and device for extracting identity label | |
| CN101673264B (en) | Audio content searching device | |
| CN102737017B (en) | Method and apparatus for extracting page theme |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| ASS | Succession or assignment of patent right |
Owner name: TRANSMISSION LINE NETWORK TECHNOLOGY (SHANGHAI) CO Free format text: FORMER OWNER: WEIXU NETWORK TECHNOLOGY (SHANGHAI) CO., LTD. Effective date: 20140409 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| COR | Change of bibliographic data |
Free format text: CORRECT: ADDRESS; FROM: 200003 HUANGPU, SHANGHAI TO: 200241 MINHANG, SHANGHAI |
|
| TR01 | Transfer of patent right |
Effective date of registration: 20140409 Address after: 200241 Shanghai City, Dongchuan Road, No. 555, floor floor, room f, F, F, F, F, No. 02, Minhang District Patentee after: WEIXU NETWORK TECHNOLOGY (SHANGHAI) CO., LTD. Address before: 200003 gate 1305, 6 South Suzhou Road, Shanghai Patentee before: Weixu Network Technology (Shanghai) Co., Ltd. |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20171227 Address after: 100080 Beijing Haidian District city Haidian street A Sinosteel International Plaza No. 8 block 5 layer A, C Patentee after: Youku network technology (Beijing) Co., Ltd. Address before: 200241 Shanghai City, Dongchuan Road, No. 555, floor floor, room f, F, F, F, F, No. 02, Minhang District Patentee before: WEIXU NETWORK TECHNOLOGY (SHANGHAI) CO., LTD. |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20200710 Address after: 310052 room 508, floor 5, building 4, No. 699, Wangshang Road, Changhe street, Binjiang District, Hangzhou City, Zhejiang Province Patentee after: Alibaba (China) Co.,Ltd. Address before: 100080 Beijing Haidian District city Haidian street A Sinosteel International Plaza No. 8 block 5 layer A, C Patentee before: Youku network technology (Beijing) Co.,Ltd. |
|
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20121010 Termination date: 20200912 |