WO2007129250A1 - Method and electronic device for aligning a song with its lyrics - Google Patents

Method and electronic device for aligning a song with its lyrics Download PDF

Info

Publication number
WO2007129250A1
WO2007129250A1 PCT/IB2007/051566 IB2007051566W WO2007129250A1 WO 2007129250 A1 WO2007129250 A1 WO 2007129250A1 IB 2007051566 W IB2007051566 W IB 2007051566W WO 2007129250 A1 WO2007129250 A1 WO 2007129250A1
Authority
WO
WIPO (PCT)
Prior art keywords
lyrics
fragments
song
audio
fragment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IB2007/051566
Other languages
English (en)
French (fr)
Inventor
Johannes H. M. Korst
Gijs Geleijnse
Steffen C. Pauws
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips Electronics NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics NV filed Critical Koninklijke Philips Electronics NV
Priority to US12/300,151 priority Critical patent/US7915511B2/en
Priority to EP07735683A priority patent/EP2024965A1/en
Priority to JP2009508589A priority patent/JP2009536368A/ja
Publication of WO2007129250A1 publication Critical patent/WO2007129250A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/0008—Associated control or indicating means
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/031—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal
    • G10H2210/061—Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal for extraction of musical phrases, isolation of musically relevant segments, e.g. musical thumbnail generation, or for temporal structure analysis of a musical piece, e.g. determination of the movement sequence of a musical work
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/005—Non-interactive screen display of musical or status data
    • G10H2220/011—Lyrics displays, e.g. for karaoke applications
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2240/00—Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
    • G10H2240/325—Synchronizing two or more audio tracks or files according to musical features or musical timings

Definitions

  • the invention also relates to a computer program product comprising software for enabling a programmable device to perform a method of aligning a song with its lyrics.
  • the second object is realized in that the method comprises the steps of aligning each lyrics fragment of a group of similar lyrics fragments in the lyrics of the song with an audio fragment of a group of similar audio fragments of the song and aligning each lyrics fragment of a further group of similar lyrics fragments in the lyrics of the song with an audio fragment of a further group of similar audio fragments of the song.
  • the group and/or the further group of similar lyrics fragments have been determined by comparing an amount of syllables per lyrics fragment, an amount of syllables per line and/or a rhyme scheme of lyrics fragments in the lyrics of the song.
  • the group and/or the further group of similar audio fragments may have been determined by means of harmonic progression analysis.
  • Fig. 1 is a flow diagram of the method of the invention
  • Fig. 2 is a flow diagram of an embodiment of the method of the invention
  • Fig. 3 is an example of a mapping created by means of the method of the invention.
  • step 15 the problem of automatic alignment of lyrics fragments (LF) and audio fragments (AF) is solved by means of the following method.
  • LF lyrics fragments
  • AF audio fragments
  • the invention can be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer.
  • 'Computer program product' is to be understood to mean any software product stored on a computer-readable medium, such as a floppy disk, downloadable via a network, such as the Internet, or marketable in any other manner.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Electrophonic Musical Instruments (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
PCT/IB2007/051566 2006-05-08 2007-04-27 Method and electronic device for aligning a song with its lyrics Ceased WO2007129250A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
US12/300,151 US7915511B2 (en) 2006-05-08 2007-04-27 Method and electronic device for aligning a song with its lyrics
EP07735683A EP2024965A1 (en) 2006-05-08 2007-04-27 Method and electronic device for aligning a song with its lyrics
JP2009508589A JP2009536368A (ja) 2006-05-08 2007-04-27 歌曲を歌詞と並べる方法及び電気デバイス

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP06113628.9 2006-05-08
EP06113628 2006-05-08

Publications (1)

Publication Number Publication Date
WO2007129250A1 true WO2007129250A1 (en) 2007-11-15

Family

ID=38421563

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2007/051566 Ceased WO2007129250A1 (en) 2006-05-08 2007-04-27 Method and electronic device for aligning a song with its lyrics

Country Status (5)

Country Link
US (1) US7915511B2 (enExample)
EP (1) EP2024965A1 (enExample)
JP (1) JP2009536368A (enExample)
CN (1) CN101438342A (enExample)
WO (1) WO2007129250A1 (enExample)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107993637A (zh) * 2017-11-03 2018-05-04 厦门快商通信息技术有限公司 一种卡拉ok歌词分词方法与系统

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7915511B2 (en) * 2006-05-08 2011-03-29 Koninklijke Philips Electronics N.V. Method and electronic device for aligning a song with its lyrics
US8143508B2 (en) * 2008-08-29 2012-03-27 At&T Intellectual Property I, L.P. System for providing lyrics with streaming music
JP5974473B2 (ja) * 2011-12-15 2016-08-23 ヤマハ株式会社 曲編集装置、曲編集方法及びプログラム
CN106653037B (zh) * 2015-11-03 2020-02-14 广州酷狗计算机科技有限公司 音频数据处理方法和装置
JP6497404B2 (ja) * 2017-03-23 2019-04-10 カシオ計算機株式会社 電子楽器、その電子楽器の制御方法及びその電子楽器用のプログラム
US10468050B2 (en) 2017-03-29 2019-11-05 Microsoft Technology Licensing, Llc Voice synthesized participatory rhyming chat bot
US11200881B2 (en) * 2019-07-26 2021-12-14 International Business Machines Corporation Automatic translation using deep learning
CN111210850B (zh) * 2020-01-10 2021-06-25 腾讯音乐娱乐科技（深圳）有限公司 歌词对齐方法及相关产品
CN114064964B (zh) * 2020-07-30 2025-03-11 花瓣云科技有限公司 文本的时间标注方法、装置、电子设备和可读存储介质
CN112037764B (zh) * 2020-08-06 2024-07-19 杭州网易云音乐科技有限公司 一种音乐结构的确定方法、装置、设备及介质

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6582235B1 (en) * 1999-11-26 2003-06-24 Yamaha Corporation Method and apparatus for displaying music piece data such as lyrics and chord data
US20040266337A1 (en) * 2003-06-25 2004-12-30 Microsoft Corporation Method and apparatus for synchronizing lyrics

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2925754B2 (ja) 1991-01-01 1999-07-28 株式会社リコス カラオケ装置
CA2206922A1 (en) 1997-06-02 1998-12-02 Mitac Inc. Method and apparatus for generating musical accompaniment signals at a lower storage space requirement
US20010042145A1 (en) 1998-04-27 2001-11-15 Jennifer Frommer Method for combining multimedia data with audio data from a compact disk
DE10058811A1 (de) 2000-11-27 2002-06-13 Philips Corp Intellectual Pty Verfahren zur Identifizierung von Musikstücken
US20040011188A1 (en) 2002-03-07 2004-01-22 Smith Larry W. Karaoke keyboard synthesized lyric maker
JP2003280670A (ja) * 2002-03-27 2003-10-02 Sanyo Electric Co Ltd データ作成装置およびデータ作成方法
EP1616275A1 (en) * 2003-04-14 2006-01-18 Koninklijke Philips Electronics N.V. Method and apparatus for summarizing a music video using content analysis
FR2856817A1 (fr) * 2003-06-25 2004-12-31 France Telecom Procede de traitement d'une sequence sonore, telle qu'un morceau musical
KR100541215B1 (ko) 2003-11-24 2006-01-10 (주)테일러테크놀로지 디지탈 오디오파일의 가사제공시스템
JP4298612B2 (ja) * 2004-09-01 2009-07-22 株式会社フュートレック 音楽データ加工方法、音楽データ加工装置、音楽データ加工システム及びコンピュータプログラム
US20060112812A1 (en) * 2004-11-30 2006-06-01 Anand Venkataraman Method and apparatus for adapting original musical tracks for karaoke use
KR100658869B1 (ko) * 2005-12-21 2006-12-15 엘지전자 주식회사 음악생성장치 및 그 운용방법
KR20070081368A (ko) * 2006-02-10 2007-08-16 삼성전자주식회사 노래 가사의 반복 패턴을 기초로 가사 구조를 추출하는장치, 시스템, 및 그 방법
US7915511B2 (en) * 2006-05-08 2011-03-29 Koninklijke Philips Electronics N.V. Method and electronic device for aligning a song with its lyrics
US7977562B2 (en) * 2008-06-20 2011-07-12 Microsoft Corporation Synthesized singing voice waveform generator

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6582235B1 (en) * 1999-11-26 2003-06-24 Yamaha Corporation Method and apparatus for displaying music piece data such as lyrics and chord data
US20040266337A1 (en) * 2003-06-25 2004-12-30 Microsoft Corporation Method and apparatus for synchronizing lyrics

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
GOTO ET AL.: "Automatic synchronization between lyrics and music CD recordings based on Viterbi alignment of segregated vocal signals", 2006 8TH IEEE INTERNATIONAL SYMPOSIUM ON MULTIMEDIA 11-13 DEC. 2006 SAN DIEGO, CA, USA, 13 December 2006 (2006-12-13), 2006 8th IEEE International Symposium on Multimedia IEEE Computer Society Los Alamitos, CA, USA, pages 8 pp., XP002449039, ISBN: 0-7695-2746-9 *
KAI CHEN , SHENG GAO, YONGWEI ZHU, QUIBIN SUN: "Popular Song and Lyrics Synchronization and Its Application to Music Information Retrieval", PROCEEDINGS OF SPIE-IS&T, vol. 6071, 2005, XP002449036 *
KORST, J. AND GELEIJNSE, G.: "Efficient Lyrics Retrieval and Alignment", PROCEEDINGS OF THE THIRD PHILIPS SYMPOSIUM ON INTELLIGENT ALGORITHMS (SOIA 2006), 7 December 2006 (2006-12-07), EINDHOVEN, THE NETHERLANDS, XP002449037 *
PETER KNEES ET AL: "multiple lyrics alignment: automatic retrieval of song lyrics", PROCEEDINGS ANNUAL INTERNATIONAL SYMPOSIUM ON MUSIC INFORMATION RETRIEVAL, XX, XX, 30 September 2005 (2005-09-30), pages 564 - 569, XP002423234 *
WANG ET AL.: "LyricAlly: Automatic Synchronization of Acoustic Musical Signals and Textual Lyrics", PROCEEDINGS OF ACM MULTIMEDIA 2004 MM'04, 10 October 2004 (2004-10-10) - 15 October 2004 (2004-10-15), New York, USA, XP002449035 *
YE WANG ET AL.: "LyricAlly: Automatic Synchronization of Acoustic Musical Signals and Textual Lyrics", ACM MM'04, 10 October 2004 (2004-10-10)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107993637A (zh) * 2017-11-03 2018-05-04 厦门快商通信息技术有限公司 一种卡拉ok歌词分词方法与系统

Also Published As

Publication number Publication date
US7915511B2 (en) 2011-03-29
US20090120269A1 (en) 2009-05-14
JP2009536368A (ja) 2009-10-08
EP2024965A1 (en) 2009-02-18
CN101438342A (zh) 2009-05-20

Similar Documents

Publication Publication Date Title
US7915511B2 (en) Method and electronic device for aligning a song with its lyrics
US5963957A (en) Bibliographic music data base with normalized musical themes
US6633845B1 (en) Music summarization system and method
Gómez et al. Towards computer-assisted flamenco transcription: An experimental comparison of automatic transcription algorithms as applied to a cappella singing
Su et al. Sparse Cepstral, Phase Codes for Guitar Playing Technique Classification.
Hung et al. Frame-level instrument recognition by timbre and pitch
US10235982B2 (en) Music generation tool
US8892565B2 (en) Method and apparatus for accessing an audio file from a collection of audio files using tonal matching
KR20060132607A (ko) 멜로디 데이터베이스에서 검색하는 방법
CN108268530B (zh) 一种歌词的配乐生成方法和相关装置
GB2430073A (en) Analysis and transcription of music
CN111326171B (zh) 一种基于简谱识别和基频提取的人声旋律提取方法及系统
CN101226526A (zh) 一种基于音乐片段信息查询的音乐搜索方法
CN109841203A (zh) 一种电子乐器音乐和声确定方法及系统
KR20030067377A (ko) 멜로디 기반 음악 검색방법과 장치
Heydarian Automatic recognition of Persian musical modes in audio musical signals
KR20060019096A (ko) 허밍 기반의 음원 질의/검색 시스템 및 그 방법
JPH11272274A (ja) 歌声による曲検索法
CN111863030A (zh) 音频检测方法及装置
CN114550676B (zh) 一种唱歌检测方法、装置、设备及存储介质
CN112634841B (zh) 一种基于声音识别的吉他谱自动生成方法
CN115329125A (zh) 一种歌曲串烧拼接方法和装置
CN111354325A (zh) 自动词曲创作系统及其方法
Müller Content-based audio retrieval
CN114882859B (zh) 一种旋律与歌词对齐方法、装置、电子设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07735683

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2007735683

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2009508589

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 200780016586.9

Country of ref document: CN

Ref document number: 6071/CHENP/2008

Country of ref document: IN

WWE Wipo information: entry into national phase

Ref document number: 12300151

Country of ref document: US

NENP Non-entry into the national phase

Ref country code: DE