CN1383543A - Karaoka system - Google Patents

Karaoka system Download PDF

Info

Publication number
CN1383543A
CN1383543A CN 01801723 CN01801723A CN1383543A CN 1383543 A CN1383543 A CN 1383543A CN 01801723 CN01801723 CN 01801723 CN 01801723 A CN01801723 A CN 01801723A CN 1383543 A CN1383543 A CN 1383543A
Authority
CN
Grant status
Application
Patent type
Prior art keywords
karaoka
system
karaoka system
Prior art date
Application number
CN 01801723
Other languages
Chinese (zh)
Inventor
I·科尔塞特
Original Assignee
皇家菲利浦电子有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment ; Cameras comprising an electronic image sensor, e.g. digital cameras, video cameras, TV cameras, video cameras, camcorders, webcams, camera modules for embedding in other devices, e.g. mobile phones, computers or vehicles
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/272Means for inserting a foreground image in a background image, i.e. inlay, outlay
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/36Accompaniment arrangements
    • G10H1/361Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems
    • G10H1/368Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems displaying animated or moving pictures synchronized with the music or audio part
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS
    • G10H2220/00Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/005Non-interactive screen display of musical or status data
    • G10H2220/011Lyrics displays, e.g. for karaoke applications
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS
    • G10H2220/00Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155User input interfaces for electrophonic musical instruments
    • G10H2220/441Image sensing, i.e. capturing images or optical patterns for musical purposes or musical control purposes
    • G10H2220/455Camera input, e.g. analyzing pictures from a video camera and using the analysis results as control data

Abstract

演唱卡拉OK的概念只依赖于基于音频的技术。 The concept singing karaoke OK rely only on audio-based technology. 本发明包括对视频插入概念的发展:使用者将看到他的(她的)图象被插入到视频剪辑或影片中他最喜欢的舞蹈者、演唱者或表演者的位置,以及所以将能够播放录象带上的剪辑/歌曲,且能替换任何明星。 The present invention includes the development of a video insert concept: the user will see his (her) image is inserted where the video clip or movie of his favorite dancer, singer or performer, and so will be able to play a video tape clip / song, and can replace any star. 更确切地,本发明涉及一种卡拉OK系统,其中提供有连续的装置,用于拾取使用者的图象和他/她的声音,分析和处理所得的信号,把因此分析和处理的音频或视频信号与预先录制的材料混合,并显示因而得到的组合信号。 More specifically, the present invention relates to a karaoke system OK, which is provided with a continuous means, for picking up an image of the user and his / her voice, and the resulting signal analysis processing, and the thus processed audio analysis or the video signal is mixed with the prerecorded material, and displaying the combined signal thus obtained.

Description

一种卡拉OK系统 One kind of Kara OK system

本发明涉及一种卡拉OK系统,其用于一个如视频剪辑(videoclip)或影片的序列中的演唱。 OK The present invention relates to a karaoke system for a sequence of video clips such as (videoclip) or in concert video.

如例如欧洲专利申请EP0782338中所描述的卡拉OK系统中,音乐、歌词或任何种类的音频数据由传输站传输到分配站。 OK karaoke system as for example in European Patent Application EP0782338 described, the music, the lyrics or any kind of audio data transmitted by the transmission station to the dispensing station. 系统的主模块的音乐控制装置把音乐通过监视器的内设扬声器播出,且把声音从一个未示出的麦克风通过所述的扬声器播出。 Music control apparatus main module system offers the music through a speaker of the monitor broadcast, and the sound from a microphone (not shown) of the broadcast by a speaker. 图象控制装置将背景图象(如视频图像或从背景图象存储装置中提取的静态图象)显示在监视器上,而歌词控制装置通过把歌词叠加于背景图象上来显示歌词。 Image control device background image (e.g., video images or extracted from the background image storage means still picture) displayed on the monitor, the control means while the lyrics by the lyrics superimposed on the background image for display on the lyrics. 图象拾取设备,如一个CCD摄像机,拾取演唱者的图像,并将其通过视频图象控制装置叠加于监视器屏幕上作为叠加的图像。 An image pickup device such as a CCD camera, picks up an image of the singer, and means superimposed on the monitor screen as an overlay image which is controlled by the video image. 这样的系统,可定义为卡拉OK概念中所谓的“视频混合”。 Such a system, defined as Kara OK concept of so-called "video mixing."

本发明的目的是提出另一类型的具备额外功能的卡拉OK系统。 Object of the present invention is to propose another type provided with additional functionality karaoke OK system.

为了这一目的,该系统涉及一种用于在如视频剪辑或影片的序列过程中演唱的卡拉OK系统,并包括一系列用于拾取使用者的图象和声音的拾取设备,一个用于把使用者的至少一部分与背景分离的分析与处理设备,一个用于把所述分析与处理设备的输出信号与预先录制的材料组合起来的混合与再现(rendering)设备,和一个用于显示该组合信号的显示设备。 For this purpose, the system according to the concert in the process, such as a video clip or sequence of video for a karaoke system OK, and comprising a pickup device for picking up a series of user images and sound, for the at least a portion of the user's background separation processing and analysis apparatus, mixed with a reproduction output signal of the analysis and processing device with a prerecorded material for combining (Rendering) device, and a display for the combination a signal display apparatus.

时至今日,唱卡拉OK的概念只依赖于基于音频的技术,其只提供有限的功能且不可能把使用者真正插入到视频虚拟世界中。 Today, the concept of singing karaoke OK depends only on the audio-based technology, which provides only limited functionality and user really can not put into the video the virtual world. 所建议的引入了视频混合(video mixing)的概念的解决方案,允许将这一卡拉OK概念扩展到视频中,并一般地,允许发展完全音频-视频插入概念:根据所述概念,在歌曲的视频剪辑中的声音和面孔可由偶然(fortuitous)演唱者的声音和面孔代替(此后也称使用者,因为他或她事实上可以是演唱者、表演者、舞蹈者等…)。 The proposed introduction of the concept of video mixing solutions (video mixing), allowing to extend this concept to Kara OK video, and generally, allow the development of complete audio - video insert concept: based on the concept of the song sound and video clips and sound may face faces instead of accidental (fortuitous) singer (hereafter also referred to the user as he or she may in fact be the singer, performer, dancer, etc. ...). 同样建议的技术可在其它环境中发现相似的应用,例如电子商务领域或用于预先录制内容的视频编辑。 Also proposed technique can be found in similar applications in other environments, such as e-commerce or video editing for pre-recorded content.

下面将参考附图,通过实例来描述本发明,其中:图1:根据本发明的卡拉OK系统的方框图。 Below with reference to the accompanying drawings, the present invention will be described by way of example, wherein: Figure 1: a block diagram of the karaoke OK system according to the invention.

图2:根据本发明的卡拉OK系统的另一实施方案。 Figure 2: Another embodiment of karaoke OK system according to the invention.

如图1所示,实现根据本发明的卡拉OK系统所必需的不同的子系统主要是一个分析与处理设备11和一个混合与再现设备12。 As shown in FIG. 1, implemented according to different subsystems OK karaoke system of the invention is primarily necessary analysis and a processing apparatus and a reproducing apparatus 11 and 12 mix.

用于接收由拾取设备10拾取到的使用者(黑色示出的人)的图象和声音的分析与处理设备11包括一个分割电路,其用于把例如使用者的面孔与背景分离,从而限定一个阿尔法(alpha)平面(如果使用者被置于舞台上,这样的电路可基于例如蓝色屏幕前的色度键技术)。 A user (the person shown in black) for receiving a picked up by the pickup device 10 to the video and audio analysis and processing device comprises a division circuit 11, for example, the face of a user and background separation, so as to define a alpha (alpha) plane (if the user is placed on the stage, such a circuit may be based, for example, a blue chroma key in front of screen technology). 混合与再现设备12是一个利用设备11中分析的形状信息把使用者与预先录制的由媒体13传送的视频或音频-视频背景合成起来的电路(所述的预先录制的材料在媒体左侧示出)。 12 is mixed with the reproducing apparatus using a shape information analyzing device 11 and the user prerecorded video or audio transmitted by the media 13 - Video circuits are synthesized background (pre-recorded material of the medium is shown on the left out). 这一合成完成了用于把所述使用者的声音与来自歌曲的预先录制的音乐背景混合的音频合成。 The completion of the synthesis audio synthesis for converting the user's voice and background music pre-recorded songs from the mix. 然后,利用由设备11限定的阿尔法平面,根据下述类型的关系式,容易地把两个来源组合起来:[(视频1×阿尔法)+(视频2×(255-阿尔法))]/255=最终视频。 Then, the apparatus 11 is defined by the alpha plane according to the following relation of the type easily combine the two sources: [(1 × Video alpha) + (video 2 × (255- alpha))] / 255 = The final video. 最后,一个如监视器的显示设备14,用于最后显示最终结果(即预先录制的材料和特别属于使用者的之组合)。 Finally, a display device such as a monitor 14 for displaying the final result of the final (i.e., pre-recorded material and the particular combination belonging to a user).

显然,为提高质量,在设备11中完成的分析可产生8比特阿尔法平面,其能在被镶饰的对象边缘(fronteer)有较好的混合。 Obviously, in order to improve the quality of the analysis performed in device 11 may generate an 8-bit alpha plane, which can (FRONTEER) were mixed in a better veneered edge of the object. 另外,还指出的是系统可以只替换使用者的头部或他或她的整个身体。 In addition, also pointed out that the system can only replace the user's head or his or her entire body.

相对于音频-视频来源的类型,可考虑不同的情况:(a)两个音频/视频来源没有被压缩:这一选择可用于例如卡拉OK餐馆,演唱者的全部身体被镶饰在剪辑/影片中时(预先录制的数据可存储在磁带上,且偶然演唱者视频可被分析并直接传输到视频混合器中);(b)一个或两个来源被压缩:对这一情况的一个适配的架构(framework)是新近发展起来MPEG-4标准,其能对对象的形状和阿尔法平面—这里是偶然使用者的面孔进行编码-(MPEG-4标准已定义了一个能使音频和视频对象合成的整个系统架构)。 With respect to audio - video source type, consider different situations: (a) two audio / video source is not compressed: This option can be used, for example whole body Kara OK restaurant, veneered singer in the clip / movie when the (pre-recorded data may be stored on a magnetic tape, video and occasional singer can be analyzed and transmitted directly to the video mixer); (B) one or two sources are compressed: an adapter for this situation architecture (Framework) is a newly developed MPEG-4 standard, the shape of the object which can alpha plane and - where a user accidentally encoding faces - (MPEG-4 has defined a standard audio and video objects can synthesis the entire system architecture).

也可考虑本发明应用的不同情况:(a)使用者可能想记录混合操作的结果,这在图2中示出,图2示出了与图1实施方案相似的系统,只是包括了一个额外的录制设备25; Also contemplated applications of the present invention is different from the case of: (a) the user may want to record the result of the mixing operation, which is illustrated in FIG. 2, FIG. 2 shows an embodiment similar to the embodiment of FIG. 1 system, but includes an additional the recording device 25;

(b)在一些情况下,卡拉OK系统可在线工作:则预先录制的剪辑可存储于数据库(例如互联网)上,并且使用者在家中录制他或她的表演并打算产生卡拉OK剪辑的组合并将其放到他或她的个人主页上(在这一情况下,压缩技术的使用尤其有用,而且更普遍地,在所有应用中它都运行于带宽所限的环境中);(c)另外,在一些情况下,使用者可能打算只把他或她的头部放在原唱的头部的位置,其包括在混合与再现设备12中的进一步处理,因为使用者头部的位置需要与原唱身体的取向和姿势匹配。 (B) In some cases, Kara OK system can work online: the pre-recorded clips can be stored in a database (such as the Internet) on, and the user to record his or her performance at home and intend to produce a combined clip and Kara OK place it on his or her profile (in this case, the use of compression technology is particularly useful, and more generally, it runs on all applications in limited bandwidth environments); (c) in addition in some cases, the user may intend only to his or her head in the position of the head of the original music, which process further comprises mixing with the reproducing apparatus 12, since the position of the user's head needs original music to match the body's posture and orientation.

Claims (1)

  1. 1.一种卡拉OK系统,其用于在一个如视频剪辑或影片的序列过程中演唱,并包括一系列用于拾取使用者的图象和声音的拾取设备,一个用于把使用者的至少一部分与背景分离的分析与处理设备,一个用于把所述分析与处理设备的输出信号与预先录制的材料组合起来的混合与再现设备,以及一个用于显示该组合信号的显示设备。 A karaoke system is OK, for a concert in a process sequence such as a video clip or video and include a series of pick-up apparatus for picking up images and sounds to a user, the user for at least a separated from the background portion of the analysis and processing apparatus, a reproducing apparatus for mixing with the output signal of the analysis and processing device with a prerecorded material are combined, and a display device for displaying the combined signal.
CN 01801723 2000-06-20 2001-06-15 Karaoka system CN1383543A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP00401758 2000-06-20

Publications (1)

Publication Number Publication Date
CN1383543A true true CN1383543A (en) 2002-12-04

Family

ID=8173734

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 01801723 CN1383543A (en) 2000-06-20 2001-06-15 Karaoka system

Country Status (6)

Country Link
US (1) US20020007718A1 (en)
EP (1) EP1297692A2 (en)
JP (1) JP2004501576A (en)
KR (1) KR20020026374A (en)
CN (1) CN1383543A (en)
WO (1) WO2001099413A3 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1312912C (en) * 2004-10-21 2007-04-25 上海交通大学 Entertainment system for video frequency real time synthesizing and recording
CN101945216A (en) * 2009-07-03 2011-01-12 奥林巴斯映像株式会社 Camera device and reproduction method of dynamic image
WO2014169653A1 (en) * 2013-08-28 2014-10-23 中兴通讯股份有限公司 Method and device for optimizing image synthesis
WO2016177296A1 (en) * 2015-05-04 2016-11-10 腾讯科技(深圳)有限公司 Video generation method and apparatus

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB0211066D0 (en) * 2002-05-15 2002-06-26 Arnold Stuart U rock
US7053915B1 (en) * 2002-07-30 2006-05-30 Advanced Interfaces, Inc Method and system for enhancing virtual stage experience
US7734070B1 (en) * 2002-12-31 2010-06-08 Rajeev Sharma Method and system for immersing face images into a video sequence
EP1621010A1 (en) * 2003-05-02 2006-02-01 Allan Robert Staker Interactive system and method for video compositing
KR20070029110A (en) * 2003-10-16 2007-03-13 노바티스 백신즈 앤드 다이아그노스틱스 인코포레이티드 2,6-disubstituted quinazolines, quinoxalines, quinolines and isoquinolines as inhibitors of raf kinase for treatment of cancer
US7517219B2 (en) * 2004-02-20 2009-04-14 Mcdonald Michael Method of providing specialized dance videos
US20050206751A1 (en) * 2004-03-19 2005-09-22 East Kodak Company Digital video system for assembling video sequences
US20060136979A1 (en) * 2004-11-04 2006-06-22 Staker Allan R Apparatus and methods for encoding data for video compositing
US8172638B2 (en) * 2005-08-06 2012-05-08 Parental Media LLC Method and apparatus for education and entertainment
US20070122786A1 (en) * 2005-11-29 2007-05-31 Broadcom Corporation Video karaoke system
GB0525789D0 (en) * 2005-12-19 2006-01-25 Landesburg Andrew Live performance entertainment apparatus and method
JP2007228343A (en) * 2006-02-24 2007-09-06 Orion Denki Kk Digital broadcast receiver
US8572642B2 (en) * 2007-01-10 2013-10-29 Steven Schraga Customized program insertion system
US20080276792A1 (en) * 2007-05-07 2008-11-13 Bennetts Christopher L Lyrics superimposed on video feed
US20100031149A1 (en) * 2008-07-01 2010-02-04 Yoostar Entertainment Group, Inc. Content preparation systems and methods for interactive video systems
EP2141689A1 (en) * 2008-07-04 2010-01-06 Koninklijke KPN N.V. Generating a stream comprising interactive content
US20110285878A1 (en) * 2010-05-24 2011-11-24 Yunshu Zhang Method for generating multimedia data to be displayed on display apparatus and associated multimedia player
CN102231272A (en) * 2011-01-21 2011-11-02 辜进荣 Method and device for synthesizing network videos and audios
CN102496359A (en) * 2011-11-28 2012-06-13 华为终端有限公司 Method and device for realizing multi-party remote karaoke
WO2013106916A1 (en) * 2012-01-20 2013-07-25 Karaoke Reality Video Inc. Interactive audio/video system and method

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10282975A (en) * 1997-04-04 1998-10-23 Amtex Kk Karaoke system
US6514083B1 (en) * 1998-01-07 2003-02-04 Electric Planet, Inc. Method and apparatus for providing interactive karaoke entertainment
JP2000209500A (en) * 1999-01-14 2000-07-28 Daiichikosho Co Ltd Method for synthesizing portrait image separately photographed with recorded background video image and for outputting the synthesized image for display and karaoke machine adopting this method

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1312912C (en) * 2004-10-21 2007-04-25 上海交通大学 Entertainment system for video frequency real time synthesizing and recording
CN101945216A (en) * 2009-07-03 2011-01-12 奥林巴斯映像株式会社 Camera device and reproduction method of dynamic image
CN101945216B (en) * 2009-07-03 2016-04-13 奥林巴斯株式会社 The imaging apparatus and the moving picture reproducing method
WO2014169653A1 (en) * 2013-08-28 2014-10-23 中兴通讯股份有限公司 Method and device for optimizing image synthesis
WO2016177296A1 (en) * 2015-05-04 2016-11-10 腾讯科技(深圳)有限公司 Video generation method and apparatus

Also Published As

Publication number Publication date Type
US20020007718A1 (en) 2002-01-24 application
EP1297692A2 (en) 2003-04-02 application
WO2001099413A3 (en) 2002-03-07 application
JP2004501576A (en) 2004-01-15 application
WO2001099413A2 (en) 2001-12-27 application
KR20020026374A (en) 2002-04-09 application

Similar Documents

Publication Publication Date Title
US5544228A (en) Method and apparatus for transmission of full frequency digital audio
US20090087161A1 (en) Synthesizing a presentation of a multimedia event
US20050038661A1 (en) Closed caption control apparatus and method therefor
US20040111171A1 (en) Object-based three-dimensional audio system and method of controlling the same
US5062097A (en) Automatic musical instrument playback from a digital music or video source
US7119267B2 (en) Portable mixing recorder and method and program for controlling the same
US20070287141A1 (en) Internet based client server to provide multi-user interactive online Karaoke singing
US5131311A (en) Music reproducing method and apparatus which mixes voice input from a microphone and music data
US6514083B1 (en) Method and apparatus for providing interactive karaoke entertainment
US20030228135A1 (en) Dynamic replacement of the face of an actor in a video movie
US20090079833A1 (en) Technique for allowing the modification of the audio characteristics of items appearing in an interactive video using rfid tags
US20040151471A1 (en) Method and apparatus for controlling editing image display
US20030236581A1 (en) Method for recording live performances as two or more tracks
US20030001948A1 (en) Content distribution system and distribution method
US20020188772A1 (en) Media production methods and systems
JP2003076380A (en) Method of displaying videos of users' own making as karaoke sing-along background videos with karaoke sing- along machines scattered in various places
US20080259745A1 (en) Document Recording Medium, Recording Apparatus, Recording Method, Data Output Apparatus, Data Output Method and Data Delivery/Distribution System
US4419920A (en) Apparatus for recording and reproducing musical performance
US20130011111A1 (en) Modifying audio in an interactive video using rfid tags
JP2004212473A (en) Karaoke machine and karaoke reproducing method
JPH1124686A (en) Musical sound playback system
WO2005098854A1 (en) Audio reproducing apparatus, audio reproducing method, and program
US6971882B1 (en) Method and apparatus for providing interactive karaoke entertainment
US6335768B1 (en) Method and system for broadcasting digital audio and video to an analog wireless device
JP2001134613A (en) Audio retrieval processing method, audio information retrieving device, audio information storing method, audio information storage device and audio video retrieval processing method, audio video information retrieving device, and method and device for storing audio video information

Legal Events

Date Code Title Description
C06 Publication
C10 Request of examination as to substance
C02 Deemed withdrawal of patent application after publication (patent law 2001)