WO2001099413A2 - Systeme karaoke - Google Patents

Systeme karaoke Download PDF

Info

Publication number
WO2001099413A2
WO2001099413A2 PCT/EP2001/006884 EP0106884W WO0199413A2 WO 2001099413 A2 WO2001099413 A2 WO 2001099413A2 EP 0106884 W EP0106884 W EP 0106884W WO 0199413 A2 WO0199413 A2 WO 0199413A2
Authority
WO
WIPO (PCT)
Prior art keywords
video
user
image
karaoke
audio
Prior art date
Application number
PCT/EP2001/006884
Other languages
English (en)
Other versions
WO2001099413A3 (fr
Inventor
Isabelle Corset
Original Assignee
Koninklijke Philips Electronics N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics N.V. filed Critical Koninklijke Philips Electronics N.V.
Priority to KR1020027002209A priority Critical patent/KR20020026374A/ko
Priority to EP01960328A priority patent/EP1297692A2/fr
Priority to JP2002504133A priority patent/JP2004501576A/ja
Publication of WO2001099413A2 publication Critical patent/WO2001099413A2/fr
Publication of WO2001099413A3 publication Critical patent/WO2001099413A3/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/272—Means for inserting a foreground image in a background image, i.e. inlay, outlay
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B31/00—Arrangements for the associated working of recording or reproducing apparatus with related apparatus
    • G11B31/02—Arrangements for the associated working of recording or reproducing apparatus with related apparatus with automatic musical instruments
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/36—Accompaniment arrangements
    • G10H1/361—Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems
    • G10H1/368—Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems displaying animated or moving pictures synchronized with the music or audio part
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/005—Non-interactive screen display of musical or status data
    • G10H2220/011—Lyrics displays, e.g. for karaoke applications
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00—Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155—User input interfaces for electrophonic musical instruments
    • G10H2220/441—Image sensing, i.e. capturing images or optical patterns for musical purposes or musical control purposes
    • G10H2220/455—Camera input, e.g. analyzing pictures from a video camera and using the analysis results as control data

Definitions

  • the present invention relates to a karaoke system for singing during a sequence such as a video clip or a movie.
  • a karaoke system such as described for instance in the European patent application EP 0782338, music, lyrics or any kind of audio data are transmitted from a transmission station to a distribution station.
  • Music control means of a main module of the system airs music through a built-in speaker of a monitor and voice from an unshown microphone through said speaker.
  • Image control means display a background image (such as a video image or a still image extracted from background image storage means) on the monitor, and lyrics control means display lyrics by superimposing them upon the background image.
  • An image pickup device such as a CCD camera picks up an image of a singer and superimposes it on the screen of the monitor through video image control means as a superimposed image.
  • Such a system defines what may be called "video mixing" in the concept of karaoke.
  • the system relates to a karaoke system for singing during a sequence such a video clip or movie and comprising in series a pickup device, for picking up an image and the voice of an user, an analysis and processing device, for separating at least a part of the user from the background, a mixing and rendering device, for combining the ouput signal of said analysis and processing device and a pre-recorded material, and a displaying device, for displaying the combination signal.
  • Fig.1 is a block diagram of a karaoke system according to the invention ;
  • Fig.2 illustrates another implementation of a karaoke system according to the invention.
  • the different sub-systems necessary to implement the karaoke system according to the invention are mainly an analysis and processing device 11 and a mixing and rendering device 12.
  • the analysis and processing device 11 that receives the image and voice of the user (the person shown in black) picked up by a pickup device 10, consists of a segmentation circuit, provided for separating for instance the face of the user from the background and thus defining an alpha plane (such a circuit can be based for example on the chroma key technique, if the user is put on stage, in front of a blue screen).
  • the mixing and rendering device 12 is a circuit using the shape information analyzed in the device 11 for composing the user with a background pre-recorded video or audio-video delivered by a medium 13 (said pre-recorded material is shown at the left side of the medium).
  • This composition completes the audio one, provided for mixing the voice of said user with the background pre-recorded music from the song.
  • a displaying device 14 such as a monitor is finally used for displaying the final result (i.e. the combination of the pre-recorded material and of what belongs specifically to the user).
  • the analysis implemented in the device 11 can produce 8-bit alpha plane, which enables a better mixing on the fronteer of the incrusted object. It may also be noted that the system can replace either only the head of the user or his/her whole body.
  • the two audio/video sources are not compressed : this option may be used for instance in a karaoke restaurant, when the whole body of a singer is incrusted in the clip/movie (the pre-recorded data can be stored on a tape, and the fortuitous singer video can be analyzed and transmitted directly to the video mixer) ;
  • one or the two sources are compressed : one adapted framework for such a case is then the newly developed MPEG-4 standard, that enables to encode the shape and alpha plane of an object - here the face of the fortuitous user - (MPEG-4 has defined a whole system framework enabling the composition of audio and video objects).
  • Fig.2 shows a system similar to the implementation of Fig.1 but including an additional recording device 25 ;
  • the karaoke system will work on line : the pre-recorded clips are then stored on a database (on the Internet for instance), and the user is recording his/her performance at home and wants to produce the combination karaoke clip and put it on his/her homepage (the use of compression techniques is particularly useful in such a case and, more generally, in all the applications that are run in a bandwidth constrained environment) ;
  • the user may want to only put his/her head in place of the original singer's head, which induces further processing in the mixing and rendering device 12, since it is needed that the position of the head of the user and the orientation and posture of the body of the original singer match up.

Abstract

Le concept de chant karaoke repose exclusivement sur des techniques audio. L'invention consiste à développer le concept d'immersion vidéo : l'utilisateur verra sa propre image insérée dans un vidéoclip ou un film à la place de son/sa chanteur/chanteuse ou musicien/musicienne favorit(e) et pourra donc jouer le clip/chanson sur bande vidéo et remplacer une star célèbre. L'invention concerne en particulier un système karaoke dans lequel on trouve des moyens successifs permettant de sélectionner une image de l'utilisateur et sa voix, d'analyser et de traiter les signaux obtenus, d'associer les signaux audio/vidéo ainsi analysés et traités à un matériel préenregistré et enfin, d'afficher les signaux de combinaison ainsi obtenus.
PCT/EP2001/006884 2000-06-20 2001-06-15 Systeme karaoke WO2001099413A2 (fr)

Priority Applications (3)

Application Number Priority Date Filing Date Title
KR1020027002209A KR20020026374A (ko) 2000-06-20 2001-06-15 가라오케 시스템
EP01960328A EP1297692A2 (fr) 2000-06-20 2001-06-15 Systeme karaoke
JP2002504133A JP2004501576A (ja) 2000-06-20 2001-06-15 カラオケシステム

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP00401758 2000-06-20
EP00401758.8 2000-06-20

Publications (2)

Publication Number Publication Date
WO2001099413A2 true WO2001099413A2 (fr) 2001-12-27
WO2001099413A3 WO2001099413A3 (fr) 2002-03-07

Family

ID=8173734

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2001/006884 WO2001099413A2 (fr) 2000-06-20 2001-06-15 Systeme karaoke

Country Status (6)

Country Link
US (1) US20020007718A1 (fr)
EP (1) EP1297692A2 (fr)
JP (1) JP2004501576A (fr)
KR (1) KR20020026374A (fr)
CN (1) CN1383543A (fr)
WO (1) WO2001099413A2 (fr)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2389221A (en) * 2002-05-15 2003-12-03 Stuart Arnold Recording to provide a rock star experience
JP2006527529A (ja) * 2003-05-02 2006-11-30 アラン ロバート ステイカー、 ビデオ合成のための対話型システムおよび方法
WO2007071954A1 (fr) * 2005-12-19 2007-06-28 Landesberg, Andrew Appareil et méthode de spectacle en direct
EP2141689A1 (fr) * 2008-07-04 2010-01-06 Koninklijke KPN N.V. Génération d'un flux à contenu interactif
CN102231272A (zh) * 2011-01-21 2011-11-02 辜进荣 网络视频音频合成方法及装置
CN102496359A (zh) * 2011-11-28 2012-06-13 华为终端有限公司 实现多方远程卡拉ok的方法及其装置
EP2805483A4 (fr) * 2012-01-20 2016-03-02 Karaoke Reality Video Inc Procédé et système audio/vidéo interactif
US10332560B2 (en) 2013-05-06 2019-06-25 Noo Inc. Audio-video compositing and effects

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7053915B1 (en) * 2002-07-30 2006-05-30 Advanced Interfaces, Inc Method and system for enhancing virtual stage experience
US7734070B1 (en) * 2002-12-31 2010-06-08 Rajeev Sharma Method and system for immersing face images into a video sequence
CA2542329A1 (fr) * 2003-10-16 2005-04-28 Chiron Corporation Quinoxalines, quinolines, isoquinolines et quinazolines 2,6-bisubstituees servant d'inhibiteurs a la kinase raf pour le traitement du cancer
US7517219B2 (en) * 2004-02-20 2009-04-14 Mcdonald Michael Method of providing specialized dance videos
US20050206751A1 (en) * 2004-03-19 2005-09-22 East Kodak Company Digital video system for assembling video sequences
CN1312912C (zh) * 2004-10-21 2007-04-25 上海交通大学 视频实时合成和记录的娱乐系统
WO2006052666A2 (fr) * 2004-11-04 2006-05-18 Allan Robert Staker Dispositif et procede de codage de donnees pour composition video
KR20060127459A (ko) * 2005-06-07 2006-12-13 엘지전자 주식회사 디지털방송 콘텐츠 변환 기능을 갖는 디지털방송용 단말기및 그 방법
US8172638B2 (en) * 2005-08-06 2012-05-08 Parental Media LLC Method and apparatus for education and entertainment
US20070122786A1 (en) * 2005-11-29 2007-05-31 Broadcom Corporation Video karaoke system
JP2007228343A (ja) * 2006-02-24 2007-09-06 Orion Denki Kk デジタル放送受信装置
US8572642B2 (en) 2007-01-10 2013-10-29 Steven Schraga Customized program insertion system
US20080276792A1 (en) * 2007-05-07 2008-11-13 Bennetts Christopher L Lyrics superimposed on video feed
TW201005583A (en) 2008-07-01 2010-02-01 Yoostar Entertainment Group Inc Interactive systems and methods for video compositing
JP5457092B2 (ja) * 2009-07-03 2014-04-02 オリンパスイメージング株式会社 デジタルカメラ及びデジタルカメラの合成画像表示方法
CN102742261A (zh) * 2010-05-24 2012-10-17 联发科技（新加坡）私人有限公司 用于产生待显示于显示装置上的多媒体数据的方法及相关多媒体播放装置
CN104424624B (zh) * 2013-08-28 2018-04-10 中兴通讯股份有限公司 一种图像合成的优化方法及装置
US20190018572A1 (en) * 2015-01-13 2019-01-17 Google Inc. Content item players with voice-over on top of existing media functionality
CN104967900B (zh) * 2015-05-04 2018-08-07 腾讯科技（深圳）有限公司 一种生成视频的方法和装置
CN110164242B (zh) * 2019-06-04 2020-12-08 平顶山学院 一种声乐演唱模拟训练平台

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000209500A (ja) * 1999-01-14 2000-07-28 Daiichikosho Co Ltd 記録済みの背景映像に別途撮影された人物映像を合成して表示出力する方法およびその方法を採用したカラオケ装置

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10282975A (ja) * 1997-04-04 1998-10-23 Amtex Kk カラオケシステム
US6514083B1 (en) * 1998-01-07 2003-02-04 Electric Planet, Inc. Method and apparatus for providing interactive karaoke entertainment

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000209500A (ja) * 1999-01-14 2000-07-28 Daiichikosho Co Ltd 記録済みの背景映像に別途撮影された人物映像を合成して表示出力する方法およびその方法を採用したカラオケ装置

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
PATENT ABSTRACTS OF JAPAN vol. 1999, no. 01, 29 January 1999 (1999-01-29) -& JP 10 282975 A (AMTEX KK), 23 October 1998 (1998-10-23) *
PATENT ABSTRACTS OF JAPAN vol. 2000, no. 10, 17 November 2000 (2000-11-17) -& JP 2000 209500 A (DAIICHIKOSHO CO LTD), 28 July 2000 (2000-07-28) *

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2389221A (en) * 2002-05-15 2003-12-03 Stuart Arnold Recording to provide a rock star experience
JP2006527529A (ja) * 2003-05-02 2006-11-30 アラン ロバート ステイカー、 ビデオ合成のための対話型システムおよび方法
WO2007071954A1 (fr) * 2005-12-19 2007-06-28 Landesberg, Andrew Appareil et méthode de spectacle en direct
US8931025B2 (en) 2008-04-07 2015-01-06 Koninklijke Kpn N.V. Generating a stream comprising synchronized content
EP2141689A1 (fr) * 2008-07-04 2010-01-06 Koninklijke KPN N.V. Génération d'un flux à contenu interactif
US8296815B2 (en) 2008-07-04 2012-10-23 Koninklijke Kpn N.V. Generating a stream comprising synchronized content
US9076422B2 (en) 2008-07-04 2015-07-07 Koninklijke Kpn N.V. Generating a stream comprising synchronized content
US9538212B2 (en) 2008-07-04 2017-01-03 Koninklijke Kpn N.V. Generating a stream comprising synchronized content
CN102231272A (zh) * 2011-01-21 2011-11-02 辜进荣 网络视频音频合成方法及装置
CN102496359A (zh) * 2011-11-28 2012-06-13 华为终端有限公司 实现多方远程卡拉ok的方法及其装置
EP2805483A4 (fr) * 2012-01-20 2016-03-02 Karaoke Reality Video Inc Procédé et système audio/vidéo interactif
US10332560B2 (en) 2013-05-06 2019-06-25 Noo Inc. Audio-video compositing and effects

Also Published As

Publication number Publication date
CN1383543A (zh) 2002-12-04
WO2001099413A3 (fr) 2002-03-07
US20020007718A1 (en) 2002-01-24
EP1297692A2 (fr) 2003-04-02
JP2004501576A (ja) 2004-01-15
KR20020026374A (ko) 2002-04-09

Similar Documents

Publication Publication Date Title
US20020007718A1 (en) Karaoke system
US9736552B2 (en) Authoring system for IPTV network
JP4548297B2 (ja) 情報処理装置及び情報処理方法
EP1347455A2 (fr) Appareil d'enregistrement/reproduction des matières et procédé d'édition des matières
CN1981525B (zh) 信息处理设备和信息处理方法
JP2000126463A (ja) コンピュ―タゲ―ム装置
US20110009988A1 (en) Content reproduction apparatus and content reproduction method
USRE40688E1 (en) System for producing personalized video recordings
WO2005013618A1 (fr) Procede de diffusion video continue directe, dispositif de diffusion de video continue directe, systeme de diffusion de video continue directe, programme, support d'enregistrement, procede de diffusion, et dispositif de diffusion
JPH0965300A (ja) 情報送受信システムとこのシステムに用いられる送信情報生成装置及び受信情報再生装置
US7489853B2 (en) Auxiliary information generation method, auxiliary information generation apparatus, video data generation method, video data playback method, video data playback apparatus, and data storage medium
JP4513667B2 (ja) 映像情報入力・表示方法及び装置及びプログラム及びプログラムを格納した記憶媒体
JP2008227860A (ja) コンテンツ撮影装置
US7557838B2 (en) Imaging method and imaging apparatus
JP2004259375A (ja) メッセージ記録および再生装置および方法
JP3766280B2 (ja) コンテンツ仲介装置およびコンテンツ仲介処理方法
JP2007184674A (ja) ダイジェスト作成装置
TW201040837A (en) System and method for processing multimedia data using an audio-video link
JP2006119178A (ja) コンテンツ処理方法およびコンテンツ処理装置
JP2003186484A (ja) カラオケ装置用カラースーパーインポーザー
KR200354858Y1 (ko) 다기능 노래방 시스템
JPH10282976A (ja) カラオケシステム
JP2010050712A (ja) 動画像配信装置、動画像配信方法ならびにそのプログラム
JP2006080637A (ja) 画像記録再生装置、音声再生方法、及びプログラム
JP2001086471A (ja) マルチメディアコンテンツ制作装置

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): CN JP KR

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR

WWE Wipo information: entry into national phase

Ref document number: 2001960328

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 018017231

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 1020027002209

Country of ref document: KR

AK Designated states

Kind code of ref document: A3

Designated state(s): CN JP KR

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR

WWP Wipo information: published in national office

Ref document number: 1020027002209

Country of ref document: KR

WWP Wipo information: published in national office

Ref document number: 2001960328

Country of ref document: EP

WWW Wipo information: withdrawn in national office

Ref document number: 2001960328

Country of ref document: EP