CN101652808A - Modifying audiovisual output in a karaoke system based on performance context - Google Patents

Modifying audiovisual output in a karaoke system based on performance context Download PDF

Info

Publication number
CN101652808A
CN101652808A CN200780052706.0A CN200780052706A CN101652808A CN 101652808 A CN101652808 A CN 101652808A CN 200780052706 A CN200780052706 A CN 200780052706A CN 101652808 A CN101652808 A CN 101652808A
Authority
CN
China
Prior art keywords
context information
karaoke
equipment
lyrics
performance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN200780052706.0A
Other languages
Chinese (zh)
Inventor
J·阿拉斯武奥里
T·科索南
A·勒蒂涅米
A·埃罗南
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nokia Oyj
Original Assignee
Nokia Oyj
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nokia Oyj filed Critical Nokia Oyj
Publication of CN101652808A publication Critical patent/CN101652808A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/36Accompaniment arrangements
    • G10H1/361Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems
    • G10H1/368Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems displaying animated or moving pictures synchronized with the music or audio part
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/26Speech to text systems
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/031Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal
    • G10H2210/046Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal for differentiation between music and non-music signals, based on the identification of musical parameters, e.g. based on tempo detection
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/005Non-interactive screen display of musical or status data
    • G10H2220/011Lyrics displays, e.g. for karaoke applications

Abstract

The invention allows a performer and an audience to interact with a karaoke system in order to control or modify audio-visual output of a karaoke performance. Context information related to a currentkaraoke performance is obtained. In response, at least one audiovisual output aspect of the current karaoke performance is modified based on the obtained context information.

Description

Export based on the audiovisual that performance context is revised in the karaoke OK system
Technical field
The present invention mainly relates to multimedia entertainment system.Particularly, the present invention relates to karaoke OK system.
Background technology
Karaoke is a kind of entertainment form that comes from Japan, one or more singer who wherein is generally the amateur on microphone along with recording musical is sung.This music usually is the popular or known song that first no original singer person's speech or original singer person's speech volume reduce.The lyrics also are shown to one or more performing artist (for example on music video) usually and sing to instruct.
Conventional karaoke OK system comprises at least one microphone, loudspeaker, note amplifier and/or mixer, this mixer is equipped with the effect unit that is used for for example creating the effect that echoes, the video display that is used for the performing artist and certain audiovisual playback system alternatively, as for example video playback system or have the local or long-range computer based system of video playback capability.Conventional karaoke OK system also can comprise a plurality of video screens that are used for spectators and be used for showing performing artist's video camera on video screen.
Usually, except showing the lyrics, karaoke OK system also has the video display (and sometimes also at spectators' video screen) that is used for the performing artist and shows at given instant and should sing the visual method which words of the lyrics is sung down with further guidance.These visual method for example comprise with playback of music synchronously change the lyrics color and with playback of music synchronously above current words the spring ball.
Usually with multiple road form recording musical, this form comprises the discrete track of the musical instrument that for example has it separately.Musical works can be the musical instrument version.Replace, musical works also can comprise and has the track of singing sound, wherein sing sound the singer sing in by noise reduction or inhibition.In other words, Kara OK songs or musical works comprise several tracks, and wherein most or all tracks are musical instrument background music tracks.Except musical instrument background music track, Kara OK songs or musical works can comprise that background is sung the sound track and the leading singer sings the sound track.Musical instrument background music track can be the track that writes down in advance, and as for example DAB track, perhaps musical instrument background music track can be synthetic track, as for example MIDI (musical instrument digital interface) track.
Yet the karaoke OK system of prior art provides in order to the mutual so that control of karaoke OK system or revise very limited (if any) option of the audiovisual output of Karaoke performance for singer and spectators.For example, although the performing artist can sing any song that he selects, the former lyrics are shown on video display and screen still.That is to say that prior art does not have instruction or proposes the adaptive shown lyrics on the basis in place one by one.Similarly, prior art does not have instruction or proposes alternatively to revise musical instrument background music track based on sight or circumstances around the current Karaoke performance.
Summary of the invention
A first aspect of the present invention is a kind of method that wherein obtains the context information relevant with current Karaoke performance.In response, revise at least one audiovisual output facet of current Karaoke performance based on the context information that obtains.
A second aspect of the present invention is a kind of equipment, and this equipment comprises: context information obtains device, is configured to obtain and the relevant context information of current Karaoke performance.The equipment of second aspect also comprises: Karaoke output modifications device is configured to revise at least one audiovisual output facet that current Karaoke is performed based on the context information that obtains.
A third aspect of the present invention is a kind of equipment, and this equipment comprises: context information obtains device, is used to obtain and the relevant context information of current Karaoke performance.The device of the third aspect also comprises: Karaoke output modifications device is used for revising at least one audiovisual output facet that current Karaoke is performed based on the context information that obtains.
A fourth aspect of the present invention be a kind of on computer-readable medium embodied computer program, this computer program control data is handled and is carried out following operation:
Obtain and the relevant context information of current Karaoke performance, and
Revise at least one audiovisual output facet of current Karaoke performance based on the context information that obtains.
A fifth aspect of the present invention is a kind of system, and this system comprises: at least one microphone is configured to receive at least one the Karaoke performing artist's who carries out current Karaoke performance generation.The system of the 5th aspect also comprises: karaoke equipment is configured to produce the Karaoke signal that comprises video section and audio-frequency unit and mixes sounding and the audio-frequency unit that microphone receives.The system of the 5th aspect also comprises: at least one loudspeaker is configured to export the audio-frequency unit of mixing; And display, be configured to the output video part.The system of the 5th aspect also comprises: context information obtains device, is configured to obtain and the relevant context information of current Karaoke performance.The system of the 5th aspect also comprises: Karaoke output modifications device is configured to revise at least one part in the audio-frequency unit of video section and mixing based on the context information that obtains.
In an embodiment of the invention, the method for first aspect is undertaken by data processing equipment, and this data processing equipment is controlled by embodied computer program on computer-readable medium.
In an embodiment of the invention, the words to the Karaoke performing artist sounding that carries out current Karaoke performance carries out speech recognition.
In an embodiment of the invention, obtain context information by the indication that receives the predetermined keyword that comprises in the words to sounding and speech recognition.
In an embodiment of the invention, will be scheduled to the speech recognition of lyrics part for partly coming the indication of sounding to obtain context information by receiving with replacing the lyrics.
In an embodiment of the invention, obtain outer input data as context information.
In an embodiment of the invention, obtain outer input data as context information from external unit.
In an embodiment of the invention, obtain outside performance sensing data as context information.
In an embodiment of the invention, obtain the personal information manager data related as context information with at least one participant of current Karaoke performance.
In an embodiment of the invention, by revising at least one audiovisual output facet based at least one track of the adaptive current Karaoke performance of the context information that obtains.
In an embodiment of the invention, partly revise at least one audiovisual output facet by at least one predetermined lyrics of when show next time, replacing current Karaoke performance based on the context information that obtains.
With understand can in any combination each other, use the invention described above aspect and embodiment.Several aspects and embodiment can be combined and form more embodiments of the present invention.At least one embodiment that comprises the invention described above as method, equipment, system or the computer program of one aspect of the invention.
The present invention allows performing artist and spectators and karaoke OK system mutual so that the audiovisual output of control or modification Karaoke performance.For example, the present invention allows to revise the shown lyrics on the basis in place one by one.As another example, the present invention allows alternatively to revise musical instrument background music track based on sight or circumstances around the current Karaoke performance.
Description of drawings
Contained being used to provide illustrates embodiments of the present invention and helps to illustrate principle of the present invention with instructions further understanding of the present invention and the accompanying drawing that constitutes this instructions some people.In the accompanying drawings:
Fig. 1 is the block diagram that illustrates according to the karaoke OK system of one embodiment of the present invention, and
Fig. 2 a-2e is the process flow diagram that illustrates according to the whole bag of tricks of embodiment of the present invention.
Embodiment
Now will be concrete with reference to the embodiment of the present invention that illustrates its example in the accompanying drawings.
Fig. 1 is the block diagram that illustrates according to the karaoke OK system of one embodiment of the present invention.
System shown in Fig. 1 comprises microphone 1540, and this microphone is configured to receive the Karaoke performing artist's who carries out current Karaoke performance sounding.System shown in Fig. 1 also comprises the karaoke equipment 1500 that is connected to microphone 1540.
Karaoke equipment 1500 can comprise the audio/video playback part, this part is configured to the Kara OK songs of record in advance that playback comprises a plurality of tracks, and these tracks comprise musical instrument background music track at least and comprise that alternatively background is sung the sound track and/or the leading singer sings the sound track.Alternatively, Ji Lu Kara OK songs can comprise figure in advance, and these figures comprise the lyrics of the song of current performance.Karaoke equipment 1500 can also comprise amplifier section, and this part is configured to amplify them before the track of playback outputs to loudspeaker 1521 and 1522.Karaoke equipment 1500 can also comprise the mixer part, and this part is configured to mix sounding and the audio-frequency unit from the singer of microphone 1540 receptions.Ji Lu Kara OK songs can be stored in the karaoke equipment 1500 in advance, and perhaps they can be stored in the other places in the system and offer karaoke equipment 1500 for playback with need.
Can be integrated mutually with the various parts of understanding system shown in Fig. 1.For example in an embodiment of the invention, microphone 1540 can be integrated to allow one or more participant that their mobile device microphone (not shown in Fig. 1) is combined utilization rather than utilizes dedicated microphone with the Karaoke performance with at least one mobile device in the mobile device 1610,1620,1630.
Karaoke equipment 1500 can be conventional karaoke machine, such as the karaoke machine of the prior art of generally using in Karaoke and Karaoke box.As an alternative, karaoke equipment 1500 can be the game console with the suitable software/hardware that is used to realize above-mentioned feature.In another alternative, karaoke equipment 1500 can be the personal computer with the suitable software/hardware that is used to realize above-mentioned feature.In another alternative, karaoke equipment 1500 can be the mobile computing device with the suitable software/hardware that is used to realize above-mentioned feature, as for example smart phone.
System shown in Fig. 1 also comprises the sound signal that is configured to export mixing, the loudspeaker 1521 and 1522 that is connected to karaoke equipment 1500.Yet from speech, number of loudspeakers is not limited to two.The loudspeaker that in fact any number can be arranged.System shown in Fig. 1 also comprises display 1510, and such as video monitor or screen, this display is configured to show that the lyrics of song of current performance are so that instruct the performing artist to sing down.Except the set display 1510 that is used for the performing artist, can be useful on spectators' additional display (not shown in Fig. 1).System shown in Fig. 1 also comprises the video camera 1530 that can be used for writing down current performing artist, and this record for example can be shown on spectators' display in live telecast in performing artist's performance.To understand video camera 1530 for optional rather than essential to the invention.System also can comprise several video cameras that are configured to show current active Karaoke participant separately.
In an embodiment of the invention, display 1510 or at least one additional display can be respectively with mobile device 1610,1620,1630 at least one mobile device integrated to allow one or more participant that their mobile device display (not shown in Fig. 1) combine utilization rather than utilizes dedicated display with the Karaoke performance.
Similarly, in an embodiment of the invention, video camera 1530 can be integrated to allow one or more participant that their mobile device video camera (not shown in Fig. 1) is combined utilization rather than utilizes dedicated video camera with the Karaoke performance with at least one mobile device in the mobile device 1610,1620,1630.
System shown in Fig. 1 also comprises personal computer 1000.In embodiments of the present invention shown in Fig. 1, personal computer 1000 comprises the more specifically described below a plurality of features that constitute a part of the present invention.Can use another suitable equipment rather than personal computer 1000 yet will understand.Personal computer 1000 can for example be replaced by game console or mobile computing device.In another embodiment, personal computer 1000 and karaoke equipment 1500 can be integrated in the individual equipment.
In embodiments of the present invention shown in Fig. 1, personal computer 1000 comprises according to equipment 1100 of the present invention, this equipment comprises that context information obtains device 1110, Karaoke output modifications device 1120 and speech recognition device 1130, and this recognizer is configured to the Karaoke performing artist that carries out current Karaoke performance is carried out speech recognition via the words of microphone 1540 sounding.
Context information obtains device 1110 and is configured to obtain and the relevant context information of current Karaoke performance.In an embodiment of the invention, context information acquisition device 1110 is configured to by comprising the words that is received in sounding and speech recognition from speech recognition device 1130 that this indication of predetermined keyword obtains context information.In another embodiment of the present invention, context information obtain device 1110 be configured to by receive from speech recognition device 1130 will be scheduled to lyrics part by speech recognition for partly coming this indication of sounding to obtain context information with the replacement lyrics.In another embodiment of the invention, context information obtains device 1110 and is configured to obtain outer input data as context information.
In one embodiment, for example can receive this outer input data via keyboard, mouse or another input equipment (not shown in Fig. 1) related with personal computer 1000.In another embodiment, for example can receive this outer input data as the Internet or LAN (Local Area Network) via the communication network that is connected to personal computer 100 (not shown in Fig. 1).In another embodiment, can be for example from external unit, receive this outer input data such as sensor component 1300, the mobile device 1610 related or with at least one mobile device the related mobile device 1620 and 1630 of spectators participant with the performing artist.For example can comprise the related personal information correlator data of at least one participant (performing artist or spectators) of performing from mobile device 1610,1620 and/or 1630 outer input datas that receive with current Karaoke.Outer input data also can comprise the information about the media file at least one participant's the equipment.Outer input data also can comprise at least one participant to he/her voice data of microphone input (singing or speech) of mobile phone.The outer input data that receives from sensor component 1300 for example can be outside performance sensing data.To understand term " outside " and be used to refer to generation " beyond conventional karaoke OK system " here.These variety of options that are used to obtain context information are more specifically described with reference to Fig. 2 a-2e.
In an embodiment of the invention, the personal information manager data related with at least one participant can comprise calendar data, contact list data and have in the service data at least one.As known in the art, term " existence service " refers to a kind of the maintenance and the free information service that communicates relevant status information of user.The free state that communicates of given user can be via existing service to distribute at other users or issue.The user can with need upgrade he she dummy status (availability status) arranged.Here will understand term " exist service " also contain for example XMPP standard foundation in August, 2006 disclosed in protocol groups XEP-0119 and XEP-0163 " expansion exists " ( Http:// www.xmpp.org/xsf/).
Karaoke output amplifier 1120 is configured to revise based on the context information that obtains at least one video output facet of current Karaoke performance.In an embodiment of the invention, Karaoke output amplifier 1120 can comprise track adapter 1121, and this adapter is configured to come based on the context information that obtains at least one track of adaptive current Karaoke performance.To understand term " track " in this article and comprise that the track (such as music track) of record and the vocal accompaniment of singing sound and spectators member's performance that actual Karaoke performing artist sings are sung sound in advance during the Karaoke performance.
In addition, Karaoke output amplifier 1120 can also comprise lyrics adapter 1122, and this adapter is configured to replace when show next time based on the context information that obtains at least one predetermined lyrics part of current Karaoke performance.These variety of options of the audiovisual output facet that is used to revise current Karaoke performance are more specifically described with reference to Fig. 2 a-2e equally.
In embodiments of the present invention shown in Fig. 1, personal computer 1000 also comprises track reservoir 1210, lyrics reservoir 1220, regular reservoir 1230, voice commands reservoir 1240 and can revise words reservoir 1250.To understand these reservoirs need not to be arranged in the personal computer 1000.In fact, can provide at least one reservoir among the reservoir 1210-1250 in another appropriate location in conjunction with karaoke OK system.In addition, at least two reservoirs in these reservoirs can be integrated mutually.
Fig. 2 a is the process flow diagram that illustrates according to the method for one embodiment of the present invention.Obtain and the relevant context information of current Karaoke performance in step 200.Revise at least one audiovisual output facet of current Karaoke performance then based on the context information that obtains in step 201.
Can implement embodiments of the present invention shown in Fig. 2 a with several means.Fig. 2 b-2e illustrates the example of such embodiment.In embodiment shown in Fig. 2 b, the words of the Karaoke performing artist sounding that carries out current Karaoke performance is carried out speech recognition, step 210.Determine in the words of sounding and speech recognition so far, whether to comprise one or more predetermined keyword in step 211.If do not comprise, then this method turns back to the step 210 that wherein continues speech recognition.If comprise, then come at least one track of adaptive current Karaoke performance, step 212 based on the key word of identification.
As known in the art, term " speech recognition " refers to words or this field of phrase of discerning user's speech or sing by computer program.Relevant with field of speech recognition is speech control field, and the latter refers to and utilizes computer system to realize the order related with the words of discerning.At Rabiner, Juang has described the various forms of speech recognition systems that for example are used to discern isolated words in " the Fundamentals of Speech Recognition " that published by Prentice-Hall in 1993.For make speech recognition system for form for more sane for the input of singing, can use and sing the acoustic model that generally uses in the training speech recognition system.Replace or in addition, for example can also use as Hosoya, Suzuki, Ito, the maximum likelihood degree linear regression method that Makino describes in the journal of London the 6th International Conference onMusic Information Retrieval (11-15 day in September, 2005) carries out singing the adaptive of data at the acoustic model that utilizes voice training.In addition, several constraints can be used for improving recognition performance, such as to can be as the understanding of the song lyrics of identification grammer, in order to the understanding of the current song position that shows current words and be used for may key word and/or the alternative limited vocabulary table of words.
As mentioned above, Kara OK songs or musical works can comprise a plurality of tracks, and these tracks comprise that musical instrument background music track and optional background are sung the sound track and/or optional leading singer sings the sound track.Yet musical works is musical instrument version or removed and sung sound normally.Musical works for example can be MIDI (musical instrument digital interface) or multiple road digital audio format.That is to say that musical works can comprise the discrete track that has its oneself musical instrument separately.
According to the present invention, track adapter 1121 can be revised the playback of musical works at least with the following methods step 212 (perhaps Fig. 2 d step 231): with track and therefore with the musical instrument noise reduction or remove noise reduction; Melody is changed into another school (for example jazz) from a school (for example grunge); Playback is changed into another song portions (in order to help this change, for example marking the starting position of song portions such as introduction, chapters and sections, chorus and coda in the metadata section of the digital audio file that can more specifically describe hereinafter) from a song portions; Add or removal effect, such as distortion or echo; Increase or reduce the level of effect such as distortion or echo; Increase or reduce playback speed or bat; And increase or reduce the volume that pronunciation is compared with background song.
In addition according to the present invention, can comprise according to context information the modification of the musical works that will use in the Karaoke performance and to select suitably to accompany track.Several versions that each musical works that each personal different music style plays for example, can be arranged.When obtaining context information such as performing artist occupation, can select the accompaniment track of related style.For example, can select the accompaniment track of synthetic popular style at the performing artist who with slip-stick artist is occupation.
In addition according to the present invention, for example can in voice commands reservoir 1240, provide one group of voice commands that limits in advance, as for example " more tums ", " still less copper pipe ", " being with me ", " performing faster " and " partners have again (one more time boys) " to chorus.Can for example on display 1510, voice commands be shown so that allow the performing artist to learn them.
During Karaoke performance, equipment 1100 of the present invention observes-sings or the words or the phrase of speech via the speech recognition of being undertaken by speech recognition device 1130 (step 210)-performing artist.When context information obtained device 1110 and detects (step 211) performing artist and be given in the voice commands that comprises in above-mentioned one group of voice commands that limits in advance, track adapter 1121 was carried out the predetermined action related with detected voice commands.For example, when the user called out " more tums ", track adapter 1121 can be removed noise reduction with the track with additional tum.As another example, when the performing artist shouted " being with me to arrive chorus ", playback can jump to the beginning of the chorus part of current musical works.For example can be provided for revising the rule of playback in regular reservoir 1230, these rules for example can be the data files in the hard-drive (not shown in Fig. 1) that is arranged in personal computer 1000.These rules can limit by certain track that activates corresponding MIDI or multiple road digital audio file and carry out voice commands " more tums ".
In addition, equipment 1100 also can have in order to for example to forget the ability of supporting the singer under the situation of song melody the singer.The voice commands that limits in advance that is used for this function for example can be " seeking help ".When activating this order, track adapter 1121 for example can be play the melody as musical instrument or pronunciation version.
In addition, have in voice commands under the situation of the words similar to the lyrics of musical works, equipment 1100 can compare the words of the words that comprises in the lyrics and identification to help avoid the non-required modification to playback.
Alternatively, dedicated button or other such equipment that can provide the user when sending voice commands, to activate.Like this, the user can show that clearly the words of speaking in the pressing button represents voice commands rather than normal the performance to equipment 1100.This can improve performance, because equipment 1100 need not the input of recording of voice constantly and relatively its with the key word vocabulary but in fact clearly indication of the reception key word of speaking.Similarly, this a kind of button or other such equipment can be used for alternatively showing that the user wishes when to revise the words in the lyrics.Therefore, therefore, the user can be before sing replacing the lyrics part activator button.
In embodiment shown in Fig. 2 c, the words of the Karaoke performing artist sounding that carries out current Karaoke performance is carried out speech recognition, step 220.Determine whether the predetermined lyrics partly are identified as with replacing the lyrics in step 221 and partly come sounding.If not, then this method turns back to the step 220 that wherein continues speech recognition.If then when show next time, partly replace at least one predetermined lyrics part that current OK a karaoke club 0K performs, step 222 with the replacement lyrics of sounding.
Embodiments of the present invention shown in Fig. 2 c allow the Karaoke performing artist change-still perform simultaneously the former lyrics that illustrate on current song knowledge-display 1510 to small part.In one embodiment, the performing artist can change the words of predetermine class.For example, the lyrics of many songs comprise name and place name.The Karaoke performing artist for example can change name or the place name of mentioning in musical works.
Words that can be by allowing some classification such as name and place name are replaced by other words implements this point.Can implement speech recognition (step 220) that this point makes equipment 1100 of the present invention be carried out via speech recognition device 1130 and discern that the performing artist sings or words, these words of comparison and the former lyrics (step 221) of speech, if and (in those words that are allowed to change) some words differences, then as long as this words is replaced their (steps 222) in the lyrics that occur once more during the Karaoke performance just illustrating on screen.
Equipment 1100 can be configured to present on display 1510 and for example be allowed to the words that replaced by the special character color.
Alternatively, system can provide substituting of predetermined number at each words that can replace.Can implement this point with restriction will speech recognition alternative words quantity and for example in noisy environment, increase the robustness of speech recognition.In this case, system is arranged to the words that may substitute identification sounding the words from limited a group.Can use the context information of collection to obtain to be used for substituting of words: for example, can provide from the substituting of the name in performing artist's the contacts list as the name that is used for the lyrics, the place name conduct that can provide the performing artist to visit is used for substituting of place name, or the like.Can illustrate alternatively to the performing artist, the performing artist can will one of substitute (one of words of former words or change) sounding then.When words appeared in the lyrics next time, it was replaced by the version of user's sounding.
For example can be provided for the lyrics of various songs in lyrics reservoir 1220, these lyrics can for example be the texts in the hard disk (not shown in Fig. 1) that is arranged in personal computer 1000.In lyrics reservoir 1220, can be with suitable mode mark name and place name.Can be useful on the mark of all kinds of words that are allowed to replace.In addition, can provide the words the revised reservoir 1250 that comprises following words (for example proper data storehouse), these words are the replacements that are allowed to.For example can organize these words based on above-mentioned mark.
Alternatively, equipment 1100 can be configured to identification when replace with Irene on the sounding male sex's name (perhaps opposite) and thereby the lyrics that showing in " she " replace he (perhaps opposite).
In embodiment shown in Fig. 2 d, get and read or receive outer input data to be used for using step 230 as performance context information.In response, based on getting at least one track that the outer input data of reading or receiving comes adaptive current Karaoke performance, step 231.
In other words, equipment of the present invention 1100 use context information obtain devices 1110 obtain to play Karaoka around the performance place sight (being circumstances and condition) (step 230) and use track adapter 1121 to come adaptive background music track (step 231) based on the character of detected performance context.
As mentioned above, for example can be via keyboard, mouse or another input equipment (not shown in Fig. 1) related with personal computer 1000; Perhaps via the communication network that is connected to personal computer 1000 (not shown in Fig. 1) (such as the Internet or LAN (Local Area Network)); Perhaps for example from external unit (such as sensor component 1300, the mobile device 610 related with the performing artist or with the related mobile device 1620 and 1630 of spectators participant at least one mobile device) receive outer input data as this context information.
Operable sensor component 1300 for example comprises microphone, video camera, positioning equipment (for example GPS equipment) and illumination, humidity, temperature, blood pressure and cardiotach ometer.These sensor components offer context information with data and obtain device 1110, and this acquisitions device can be determined the sight character of playing Karaoka and performing then.Context information obtains device 1110 and also for example can obtain the personal information manager data (comprise as mentioned above and have service data, calendar data and contact list data) on Karaoke performing artist's mobile device 1610 and spectators participant's the mobile device 1620-1630 and use these data to determine performance context via bluetooth.Context information obtains device 1110 also can visit other personal data (such as some pictures of taking the participant time position) for example to determine up-to-date Reiseziel.Context information obtains device 1110 also can visit information about the media file on performing artist and participant's the mobile device 1610-1630, such as their favorite song, artist and/or musical genre.Context information obtains device 1110 also for example can obtain context information by inquiring about with the GPS position from external server.As an example, external server can be provided by near their the style information relevant with school of music that has inhabited (for example in same city) current location or had the music artist of a certain other relation and band with ad-hoc location and provide and will use when adaptive music performance.
Every other day/moon/year when the character of performance context for example can comprise, participate in Karaoke performance or personnel out front, number, Karaoke performing artist's physiological status, personnel's background (for example their sex, they the same day just as what, they be familiar with who etc.) and their position of having travelled recently.This information can be used for revising the character of music then.
Sensor can be attached to equipment 1100 or be attached to the remote equipment (such as mobile device 1610-1630) that data is sent to equipment 1100.For example, some can have the heart rate member in their watch, and equipment 1100 can be directly or via the heart rate data of mobile device visit from watch.
For example can provide one group of rule in regular reservoir 1230, how these rules comes adaptive music based on the character of sight if limiting.Generally speaking, can revise the playback of background music with the similar mode of above describing of mode in conjunction with the step 212 of Fig. 2 b.
Particularly, for example can come the playback of adaptive background music with the following methods based on the character of detected performance context:
Sight character Musical features that can be adaptive
The position of Karaoke performance Select the different melodies of musical works, some artistical styles that for example make melody follow to inhabit ad-hoc location.Replace, system can propose will be from being used for the Karaoke performance with the artist of this location association or the song of band.
Karaoke performing artist or one or more spectators participants' up-to-date travelling position. For example, can select melody or a certain music element to follow common style in the travelling position.For example, if the singer just spends a holiday in Hawaii, then selected melody can have the element common with traditional mele, and some melodies can be replaced by the Hawaii musical instrument.
The time of Karaoke performance For example, if performance comes across the late into the night, then can increase the volume of performance automatically so that performance has more audibility.Accordingly, if performance betides daytime, then more appropriate audio volume level may be enough.As another example, one week may influence the style of performance one day: on Monday can begin the worker's of its work sensation with reflection with ditty and/or with slower bat played songs, and can use the faster bat of big mediation in Friday with at weekend.
Performing artist's age Change bat (for example, if the performing artist is very older, then can be) in slower bat playing back music.Performing artist's age also can limit music style for example to be matched with the style from performing artist's nonage.Except the style of melody, music style can also relate to musical instrument and the sound of use from given period.
Performing artist's blood pressure and/or heart rate and/or mood. Change bat: for example, can use slower bat playing back music for having hypertensive performing artist.For anxious performing artist with high heart rate, can be in slower bat playing back music so that his calmness.
Performing artist's occupation (for example can according to the user he/digital business card on her mobile device detects) or hobby. Given occupation can be mapped to given music style.For example, slip-stick artist=synthetic-popular; Farmer=country music.Given hobby can be mapped to some music style, such as slide plate=hip hop or punk; Computer game=techno.
The most general occupation or hobby between spectators participant. For example be similar to the situation of performing artist's occupation.
Weather around the Karaoke performance position. Generate new ending to musical works, thereby happy ending replaces (under the situation at cloudy day) or opposite (under the situation of fine day) by the sadness ending.
The clauses and subclauses average number of calendar quantity that is used in performing artist's the calendar performing day or all participants' calendar. For example, if performing artist (perhaps spectators' member) is useful on many clauses and subclauses on the same day in his calendar, may mean that then it is extremely busy during the same day.In this case, can be with slower bat playing back music so that he and spectators are tranquil or replace with faster bat playing back music to reflect his or spectators' sensation better.
Performing artist or participant like or the artist/special edition/songs/music school of frequent broadcast most. Musical composition be can revise and the song or the school that loves music most liked most to be similar to.For example, the solo part in the melody can be replaced by the solo part of liking song most from the performing artist, and what perhaps melody can be followed performing artist or most participants likes style jointly most.Replace, can advise user or spectators' the track that loves music most is used for the Karaoke performance.Replace, system's performance of can advising playing Karaoka is made of performing artist's the collection of choice specimens of liking song most; In this case, system plays in seamless sequence, play performing artist or spectators the part of liking song most, promptly occur without interruption at a first Kara OK songs and the transition between next.Alternatively, it likes the Karaoke participant of song to sing this song most can to ask current broadcast.
Alternatively, system can ask a plurality of Karaoke participants (spectators' members) to participate in the Karaoke performance.For example, one or more spectators member can partly participate in by the chorus that gives song recitals.Spectators member can sing the chorus part to their microphone of portable terminal, and this part is mixed into Karaoke performing artist's accompaniment and performance then.Utilize same principle, spectators member also can sing main Karaoke performing artist and provide the vocal accompaniment sound in leading singer's melody.Can use such as the such effect of pitch-shift and handle the vocal accompaniment sound so that create complicated chorus sound.In addition, can differently handle each background singer's the sound of singing.For example, women's sound of accompanying can tone moves down octave and has more masculinity so that they sound.
Relevant with the last example in the last table, system can construct the Karaoke playlist according to Karaoke participant's the song of liking most.Playlist can be made of whole songs, perhaps replace, system can play the collection of choice specimens of full songs, thereby it is with seamless way cascade participant's the part of liking song most (for example chorus or chapters and sections), and the transition between the song occurs without interruption.Can also ask each participant to sing his song of liking most in turn.In this case, during performing, change the Karaoke performing artist.When participant X like that song begins to play most the time, karaoke OK system can activate the mobile device of participant X microphone, begin that the audio frequency input from the microphone of participant X is mixed into musical background and with previous participant's microphone noise reduction.Alternatively, system can send to the portable terminal of participant X in order to allow him know and take turns to the indication that he sings.This indication for example can be visual indication (such as the literal on the screen of the portable terminal of participant X) or for example be vibration alarming.
Alternatively, system also can illustrate literal on main Karaoke screen, such as " Mr. X plays your song of liking most now, please begin to sing ".When participant X noticed that taking turns to him sings, system can circulate preceding several trifles of current song until participant's several phrases before microphone is sung of request.
Alternatively, karaoke equipment can have many vigilance to give a mark to them based on the participant: the Karaoke playlist is become under Karaoke participant's the situation of the collection of choice specimens of liking song most, and the participant can receive score according to the speed that they begin to sing.Best score and/or response time can be shown to reward the participant of tool alertness (fastest response) on video screen.
Alternatively, system can illustrate the current participant's of enlivening video pictures on the main screen of Karaoke performance.When changing Kara OK songs and performing artist without interruption, use video flowing from current performing artist's mobile device.When several participants sang the chorus part, system can illustrate the video flowing from all singers' that sing chorus mobile device.
In addition, system also can illustrate following video, wherein the main video on the background illustrate the performance music track former music performers, but the part of former music video is replaced by the video flowing from participant's mobile device.For example, the head of the main singer in the former music video can be replaced by the video flowing of the head that the Karaoke performing artist is shown.When several participants sang the chorus part, chorus singer's head can be replaced by the video flowing of the Karaoke participant's that current performance chorus is shown face.Replace, can on former Karaoke video, describe to represent Karaoke participant's still frame in performing artist's above-head.
In embodiment shown in Fig. 2 e, get and read or receive outer input data to be used for using step 240 as performance context information.In response, when show next time, replace at least one predetermined lyrics part of current Karaoke performance, step 241 based on getting the outside input input of reading or receiving.
In other words, equipment of the present invention 1100 uses context information to obtain devices 1100 to detect the sight (being circumstances and condition) (step 240) around the Karaoke performance place and use lyrics adapter 1122 to come the adaptive lyrics (step 241) based on the character of detected performance context.
Equally, above the various device of describing in conjunction with the step 230 of Fig. 2 d can be used for obtaining performance context in the step 240 of Fig. 2 e.Context information itself also can be similar to the context information that is used in combination with the embodiment of Fig. 2 d.Yet at this moment it be used for adaptive or revise the shown lyrics.
Equally, can provide and be allowed to the words classification that in the lyrics of musical works, changes.Such classification for example can comprise name and place name.
For example can come the adaptive lyrics based on the character of detected sight with the following methods.
Sight character But the adaptation feature in the lyrics
Performing artist's sex " he " is replaced by " she " or is opposite
The people of performing artist's understanding Name in the lyrics is replaced by the name of performing artist understanding (for example being stored in the name in performing artist's the book applications)
The position of Karaoke performance Location name in the lyrics such as city name are replaced by the title or near the place of performance position.
Performing artist's age Can be such as some project names that vehicle model, accessory etc. comes across in the lyrics by replacing in the popular at an early age project of performing artist.For example, if the performing artist is very older, then vehicle can be changed into T model Ford, and mobile phone can be changed into phone, or the like.Accordingly, for young performing artist, the title of old accessory can be changed into up-to-date corresponding title, changes into mobile phone such as phone.
Performing artist's occupation The personage of specific occupation can be changed in some words of deputy activity
The usually activity of carrying out.For example, if the performing artist is the slip-stick artist, then the words " RUN " can be changed into " programming ", if but the performing artist is the dentist, then it can change into " boring ", if perhaps the performing artist is the pilot of airline, then it can change into " flight ".
Performing artist's background When Karaoke performing artist's background (for example the age comes wherefrom with him) was understood by system, some words for example can be replaced by corresponding slang words.
Short range infinite system (for example bluetooth, wireless local area (WLAN), ultra broadband (UWB) or Wibree) neighborhood Name in the Karaoke performance place can be used for replacing the name in the lyrics.
Performing artist's previous Karaoke is historical Individual's the historical result that may influence in the new Kara OK songs of previous Karaoke: for example, if the user had before repeatedly sung same song, then it can have the new more radical change of song.
The performing artist loves music or other media content most When loving music most of performing artist or other media content (for example poem, books, film) are understood by system, can be with some lyrics that change from the phrase of liking most media piece in the Kara OK songs.
Alternatively, spectators for example can influence the shown lyrics by via bluetooth or Short Message Service (SMS) words being sent to equipment 1100 from mobile device 1620-1630.For example, spectators can influence the lyrics content in the Karaoke performance with the following methods: some words in the mark Karaoke lyrics makes and can change them.Certain that for example can be when making the Karaoke content has a bit been carried out this mark in advance.For example suppose now that some or all noun in the mark lyrics replaces allowing, spectators for example can send the words that they want to comprise by the mobile device 1620-1630 via them and participate in the Karaoke performance in the Karaoke performance then.For example in this case, people send to equipment 1100 with noun.Equipment 1100 is safeguarded the tabulation of the noun that receives from spectators and is replaced noun the lyrics along with Karaoke performance progress with the noun that spectators provide.Alternatively, can to travel through the noun tabulation that spectators provide and select will be this type of the new words that rhymes to equipment 1100.
Yet, also can replace other words classification, such as verb and proper noun from speech.Which can have in order to allow spectators to belong to the option of classification (such as noun, verb, proper noun) by select word from the selection of menu.Also may be in the lyrics the corresponding words classification of mark.In this case, equipment 1100 will replace the lyrics words in the identical category with the words that spectators provide in given classification.For example, each proper noun (such as name) is replaced by the name that spectators provide.In this case, also can from participant's contacts list is used, obtain name, thereby each name for example in the lyrics is replaced by the total a certain participant's of Karaoke spectators name.
Equipment 1100 also can be configured to from the lyrics and the automatic identifier word word class of words of people's transmission.In this case, equipment 1100 can be selected words automatically to replace the words in the lyrics from correct words classification.
In addition, when reception was used for a plurality of suggestion of words replacement, equipment 1100 can be selected words at random at sight, allows viewer polls select best solution or select the optimum matching words.Incident organizer for example can determine which method in these methods is to be used for the method for optimizing that words is selected.
In addition, spectators can slave unit 100 receive relevant with the words that can change or the relevant information with changing the words classification.Equipment 1100 for example can be sent this information via Short Message Service, bluetooth or via web browser.For example, equipment 1100 can return the tabulation of the words that can change or return whole lyrics that the changeable lyrics are shown with special color.As another example, equipment 1100 can send spectators should send to equipment 1100 these spectators' information with noun or verb now.
If spectators understand the lyrics or the equipment 1100 of song this information is sent to spectators, then spectators can control and replace which words.For example, spectators' member can send order " replace cat->beer " and replaces the words cat to force clearly with words beer.Replace, the webpage (wherein writing the words part that the lyrics and text box can change) that spectators' member for example can equipment 1100 provides, will substitute words and be written to text box, as form web page information be submitted to equipment 1100 then.
In addition, except regulating such as echo, distortion, delay, chorus etc. from allowing spectators to realize the balance of music performance the parameter of different musical instrument tracks.
Can implement practical adjustments makes spectators member can be for example enumerate the available parameter that can revise by utilizing be connected with the bluetooth of host computer.When selecting parameter when revising, suitable user interface or UI are sent to user's mobile device (perhaps computing machine).UI for example can comprise the slide block that is used to control the distortion quantity that is used for the musical instrument track.Can apply modification at once, thereby the user can hear the result of his action immediately.The balance that changes the music performance works is worked in a similar manner: the mobile device that UI is sent to the user.UI comprises the volume slide that is used for each selected music track.In addition, spectators member can have simple and easy instruction realizes music performance as " more basses " or " still less echo " balance by transmission.
In addition, system can change from user's microphone alternatively and go to the sound signal of loudspeaker.For example, when the user sang " Bill ", sound signal can be revised by system made spectators can mention " Jill " from loudspeaker.Spectators can be used to specify the identical mode of the shown lyrics and specify which words of change by the equipment of their system that is connected to.System can synthesize the performance of the words that spectators limit and it is mixed into and replaces singer's output in the output, and perhaps it can filter singer's output so that change some phoneme so that sing the words of sound as spectators' appointment.
Can carry out above-mentioned leading singer corresponding to the request that receives from spectators member and sing sound and vocal accompaniment sound.
Example embodiment for example can comprise any suitable server, workstation, game console, personal computer, karaoke equipment, mobile device of the process that can carry out example embodiment etc.The equipment of example embodiment can use any suitable agreement to intercom mutually with subsystem and can use the computer system of one or more programming or equipment to implement.
One or more interface mechanism can use with example embodiment, and these interface mechanisms for example comprise that the Internet inserts, the telecommunication of any appropriate format (for example speech, modulator-demodular unit etc.), wireless communication medium etc.For example, used communication network or link can comprise one or more cordless communication network, cellular communications networks, 3G communication network, PSTN (PSTN), packet data network (PDN), the Internet, in-house network and combination thereof etc.
To understand example embodiment and be used for the example purpose, because it is possible being used for many variations of particular hardware of exemplifying embodiment embodiment, this will be that the technician of hardware and/or software field will be understood that.For example, can implement the function of one or more example embodiment via one or more hardware and/or software equipment.
Example embodiment can be stored and the relevant information of various processes described herein.This information can be stored in such as in one or more storeies such as hard disk, CD, magneto-optic disk, RAM.One or more database can be stored the information that is used for implementing example embodiment of the present invention.Can use the data structure that comprises in the storer enumerated or the memory device (for example write down, table, array, field, figure, tree, tabulation etc.) to come tissue database here.The process of describing with reference to example embodiment can comprise and being used in the equipment of one or more database storage by example embodiment and the proper data structure of the process of the subsystem data collecting and/or generate.
As the technician of computing machine and/or software field will understand, can use one or more general processor that the instruction of the example embodiment according to the present invention programmes, microprocessor, digital signal processor, microcontroller exemplifying embodiment embodiment all or part of expediently.As the technician of software field will understand, the programmer of common skill can easily prepare suitable software based on the instruction of example embodiment.In addition, can be on WWW the exemplifying embodiment embodiment.In addition, as the technician of electrical domain will understand, can come the exemplifying embodiment embodiment by preparation special IC or the suitable network by interconnection conventional components circuit.Therefore, example embodiment is not limited to any concrete combination of hardware and/or software.
Example embodiment of the present invention can comprise the following software of storing on arbitrary medium in the computer-readable medium or the combination of media, this software be used to control example embodiment parts, be used to drive example embodiment parts, be used to make the parts of example embodiment can be mutual etc. with human user.Such software can include but not limited to device driver, firmware, operating system, developing instrument, application software etc.Such computer-readable medium can also comprise the computer program of one embodiment of the present invention, and this product is used for all or part of (if being treated to distributed) of the meticulous processing of carrying out when enforcement is of the present invention.The computer code devices of example embodiment of the present invention can comprise any suitably soluble or executable code is machine-processed, and this code mechanism includes but not limited to script, interpretable programs, dynamic link library (DLL), java class and applet, complete executable program, common object request broker framework (CORBA) object etc.In addition, the part of the processing of example embodiment of the present invention can be distributed in the hope of more best performance, reliability, cost etc.
As above say, the parts of example embodiment can comprise computer-readable medium or storer, and these media or storer are used to keep the instruction that instruction according to the present invention programmes and are used to keep data structure described herein, table, record and/or other data.Computer-readable medium can comprise any suitable following medium, and this medium participates in instruction is offered processor for execution.Such medium can adopt any form that includes but not limited to non-volatile media, Volatile media, transmission medium etc.Non-volatile media for example can comprise CD or disk, magneto-optic disk etc.Volatile media can comprise dynamic storage etc.Transmission medium can comprise coaxial cable, copper cash, optical fiber etc.Transmission medium also can adopt forms such as acoustics, optics, electromagnetic wave, such as forms such as the acoustics that generates during radio communication (RF), infrared ray (IR) data communication etc., optics, electromagnetic waves.General computer-readable medium form for example can comprise floppy disk, flexible disk, hard disk, tape, any other suitable magnetic medium, CD-ROM, CDR, CD-RW, DVD, DVD-ROM, DVD ± RW, DVD ± R, any other suitable optical medium, punched card, paper tape, the optical markings sheet, any other suitable physical medium with sectional hole patterns or other optics recognizable mark, RAM, PROM, EPROM, quick EPROM, any other suitable memory chip or tape, carrier wave or computing machine can be from its any other suitable media that reads.
Although describe the present invention, the invention is not restricted to this and in fact cover various modifications and equivalent arrangements in the scope fall into the protection claim in conjunction with a plurality of example embodiment and embodiment.

Claims (38)

1. method comprises:
Obtain and the relevant context information of current Karaoke performance, and
Revise at least one audiovisual output facet of described current Karaoke performance based on the context information of described acquisition.
2. method according to claim 1 also comprises:
Words to the Karaoke performing artist sounding that carries out described current Karaoke performance carries out speech recognition.
3. method according to claim 2, the described context information of wherein said acquisition comprise that also the indication by receiving predetermined keyword included in the words to described sounding and speech recognition obtains described context information.
4. method according to claim 2 wherein obtains described context information and comprises that also will be scheduled to the speech recognition of lyrics part by reception is partly to come the indication of sounding to obtain described context information with replacing the lyrics.
5. according to the described method of arbitrary claim among the claim 1-4, the described context information of wherein said acquisition comprises that also the acquisition outer input data is as described context information.
6. method according to claim 5, the described outer input data of wherein said acquisition also comprise from external unit as described context information and obtain described outer input data as described context information.
7. method according to claim 6 wherein obtains described outer input data from described external unit and comprises also that as described context information obtaining the outside performs sensing data as described context information.
8. according to claim 6 or 7 described methods, wherein obtain described outer input data and comprise also that as described context information the acquisition personal information manager data related with at least one participant of described current Karaoke performance is as described context information from described external unit.
9. according to the described method of arbitrary claim among the claim 1-8, described at least one the audiovisual output facet of wherein said modification also comprises at least one track that comes adaptive described current Karaoke performance based on the context information of described acquisition.
1O. according to the described method of arbitrary claim among the claim 1-9, described at least one the audiovisual output facet of wherein said modification also comprises at least one predetermined lyrics part of replacing described current Karaoke performance based on the context information of described acquisition when show next time.
11. according to the described method of arbitrary claim among the claim 1-1O, wherein said method is undertaken by data processing equipment, described data processing equipment is by embodied computer program control on the computer-readable medium.
12. an equipment comprises:
Context information obtains device, is configured to obtain and the relevant context information of current Karaoke performance, and
Karaoke output modifications device is configured to revise at least one audiovisual output facet that described current Karaoke is performed based on the context information of described acquisition.
13. equipment according to claim 12 also comprises:
Speech recognition device is configured to the words of the Karaoke performing artist sounding that carries out described current Karaoke performance is carried out speech recognition.
14. obtaining device, equipment according to claim 13, wherein said context information also is configured to obtain described context information by the indication that receives predetermined keyword included in the words to described sounding and speech recognition.
15. obtaining device, equipment according to claim 13, wherein said context information also is configured to be scheduled to the speech recognition of lyrics part for partly coming the indication of sounding to obtain described context information with replacing the lyrics by receiving.
16. according to the described equipment of arbitrary claim among the claim 12-15, wherein said context information obtains device and also is configured to obtain outer input data as described context information.
17. equipment according to claim 16, wherein said context information obtain device and also are configured to obtain described outer input data as described context information from external unit.
18. obtaining device, equipment according to claim 17, wherein said context information also is configured to obtain outside performance sensing data as described context information from outside performance sensor component.
19. according to claim 17 or 18 described equipment, wherein said context information obtains device and also is configured to obtain the personal information manager data related with at least one participant of described current Karaoke performance as described context information.
20. according to the described equipment of arbitrary claim among the claim 12-19, wherein said Karaoke output modifications device also comprises: the track adapter is configured at least one track that comes adaptive described current Karaoke to perform based on the context information of described acquisition.
21. according to the described equipment of arbitrary claim among the claim 12-20, wherein said Karaoke output modifications device also comprises: lyrics adapter is configured to replace at least one predetermined lyrics part that described current Karaoke is performed based on the context information of described acquisition when show next time.
22. an equipment comprises:
Context information obtains device, is used to obtain and the relevant context information of current Karaoke performance, and
Karaoke output modifications device is used for revising at least one audiovisual output facet that described current Karaoke is performed based on the context information of described acquisition.
23. equipment according to claim 22 also comprises:
Speech recognition equipment is used for the words of the Karaoke performing artist sounding that carries out described current Karaoke performance is carried out speech recognition.
24. equipment according to claim 23, the indication that wherein said context information acquisition device also is adapted to pass through the predetermined keyword that comprises in the words of reception to described sounding and speech recognition obtains described context information.
25. also being adapted to pass through reception, equipment according to claim 23, wherein said context information acquisition device will be scheduled to the speech recognition of lyrics part for partly coming the indication of sounding to obtain described context information with replacing the lyrics.
26. according to the described equipment of arbitrary claim among the claim 22-25, wherein said context information obtains device and also is suitable for obtaining outer input data as described context information.
27. equipment according to claim 26, wherein said context information obtain device and also are suitable for obtaining described outer input data as described context information from external unit.
28. obtaining device, equipment according to claim 27, wherein said context information also is suitable for obtaining outside performance sensing data as described context information from outside performance sensor component.
29. according to claim 27 or 28 described equipment, wherein said context information obtains device and also is suitable for obtaining the personal information manager data related with at least one participant of described current Karaoke performance as described context information.
30. according to the described equipment of arbitrary claim among the claim 22-29, wherein said Karaoke output modifications device also comprises: the track adaptive device is used at least one track that comes adaptive described current Karaoke to perform based on the context information of described acquisition.
31. according to the described equipment of arbitrary claim among the claim 22-30, wherein said Karaoke output modifications device also comprises: lyrics adaptive device is used for replacing at least one predetermined lyrics part that described current Karaoke is performed based on the context information of described acquisition when show next time.
32. an embodied computer program on computer-readable medium, described computer program control data treatment facility is to carry out following operation:
Obtain and the relevant context information of current Karaoke performance, and
Revise at least one audiovisual output facet of described current Karaoke performance based on the context information of described acquisition.
33. computer program according to claim 32 is also controlled described data processing equipment to carry out following operation:
Words to the Karaoke performing artist sounding that carries out described current Karaoke performance carries out speech recognition.
34. computer program according to claim 33 is also controlled described data processing equipment and is obtained described context information with the indication of carrying out by receiving the predetermined keyword that comprises in the words to described sounding and speech recognition.
35. computer program according to claim 33 is also controlled described data processing equipment and will be scheduled to the speech recognition of lyrics part for partly coming the indication of sounding to obtain described context information with replacing the lyrics to carry out by receiving.
36., also control described data processing equipment to carry out obtaining described context information as described context information by obtaining outer input data according to the described computer program of arbitrary claim among the claim 32-35.
37., also control described data processing equipment to carry out by revising described at least one audiovisual output facet based at least one track of the adaptive described current Karaoke performance of the context information of described acquisition according to the described computer program of arbitrary claim among the claim 32-36.
38., also control described data processing equipment to carry out partly revising described at least one audiovisual output facet by at least one predetermined lyrics of when show next time, replacing described current Karaoke performance based on the context information of described acquisition according to the described computer program of arbitrary claim among the claim 32-37.
39. a karaoke OK system comprises:
Microphone is configured to receive the Karaoke performing artist's who carries out current Karaoke performance sounding,
Karaoke equipment is configured to produce the Karaoke signal that comprises video section and audio-frequency unit and mixes described sounding and the described audio-frequency unit that described microphone receives,
Loudspeaker is configured to export the audio-frequency unit of described mixing,
Display is configured to export described video section,
Context information obtains device, is configured to obtain and the relevant context information of described current Karaoke performance, and
Karaoke output modifications device is configured to revise at least one part in the audio-frequency unit of described video section and described mixing based on the context information of described acquisition.
CN200780052706.0A 2007-04-27 2007-04-27 Modifying audiovisual output in a karaoke system based on performance context Pending CN101652808A (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/FI2007/000113 WO2008132265A1 (en) 2007-04-27 2007-04-27 Modifying audiovisual output in a karaoke system based on performance context

Publications (1)

Publication Number Publication Date
CN101652808A true CN101652808A (en) 2010-02-17

Family

ID=39925229

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200780052706.0A Pending CN101652808A (en) 2007-04-27 2007-04-27 Modifying audiovisual output in a karaoke system based on performance context

Country Status (2)

Country Link
CN (1) CN101652808A (en)
WO (1) WO2008132265A1 (en)

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103916433A (en) * 2013-01-04 2014-07-09 中兴通讯股份有限公司 Karaoke data processing method and device, service platform of internet of things and terminals of internet of things
CN103941717A (en) * 2014-05-14 2014-07-23 福建星网视易信息系统有限公司 External connection device control system and method
CN104219556A (en) * 2014-09-12 2014-12-17 北京阳光视翰科技有限公司 Use method of four-soundtrack karaoke identification playing system
CN106463104A (en) * 2014-03-17 2017-02-22 新贡公司 Method of providing a user with feedback on performance of a karaoke song
CN107533806A (en) * 2015-02-02 2018-01-02 Gn 股份有限公司 It is configured as realizing framework, the apparatus and method of the transmission to the interaction skill training content including the content with multiple selectable expertise changes
CN108491464A (en) * 2018-03-05 2018-09-04 广东小天才科技有限公司 A kind of content delivery method and system based on personal recognition
CN109963092A (en) * 2017-12-26 2019-07-02 深圳市优必选科技有限公司 A kind of processing method of subtitle, device and terminal
CN110632898A (en) * 2018-06-22 2019-12-31 广州艾美网络科技有限公司 Deduction system
US10806982B2 (en) 2015-02-02 2020-10-20 Rlt Ip Ltd Frameworks, devices and methodologies configured to provide of interactive skills training content, including delivery of adaptive training programs based on analysis of performance sensor data
US10942968B2 (en) 2015-05-08 2021-03-09 Rlt Ip Ltd Frameworks, devices and methodologies configured to enable automated categorisation and/or searching of media data based on user performance attributes derived from performance sensor units
US11074826B2 (en) 2015-12-10 2021-07-27 Rlt Ip Ltd Frameworks and methodologies configured to enable real-time adaptive delivery of skills training data based on monitoring of user performance via performance monitoring hardware
US11417319B2 (en) * 2017-09-21 2022-08-16 Kabushiki Kaisha Toshiba Dialogue system, dialogue method, and storage medium

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103916521A (en) * 2013-01-05 2014-07-09 浪潮乐金数字移动通信有限公司 Mobile communication terminal
JP6944365B2 (en) * 2017-12-27 2021-10-06 株式会社第一興商 Karaoke equipment
JP7041534B2 (en) * 2018-01-31 2022-03-24 株式会社第一興商 Karaoke equipment
US20230186937A1 (en) * 2020-05-29 2023-06-15 Sony Group Corporation Audio source separation and audio dubbing
JP7423164B2 (en) 2020-07-29 2024-01-29 株式会社第一興商 karaoke equipment

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10282970A (en) * 1997-04-01 1998-10-23 Brother Ind Ltd Voice information display device
JP4789227B2 (en) * 2001-04-04 2011-10-12 Necディスプレイソリューションズ株式会社 Video display device with built-in voice recognition function
JP2002351473A (en) * 2001-05-24 2002-12-06 Mitsubishi Electric Corp Music distribution system

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103916433B (en) * 2013-01-04 2017-08-01 中兴通讯股份有限公司 A kind of karaoke data processing method, device, Internet of Things service platform and terminal
CN103916433A (en) * 2013-01-04 2014-07-09 中兴通讯股份有限公司 Karaoke data processing method and device, service platform of internet of things and terminals of internet of things
CN106463104A (en) * 2014-03-17 2017-02-22 新贡公司 Method of providing a user with feedback on performance of a karaoke song
CN103941717A (en) * 2014-05-14 2014-07-23 福建星网视易信息系统有限公司 External connection device control system and method
CN104219556A (en) * 2014-09-12 2014-12-17 北京阳光视翰科技有限公司 Use method of four-soundtrack karaoke identification playing system
US10806982B2 (en) 2015-02-02 2020-10-20 Rlt Ip Ltd Frameworks, devices and methodologies configured to provide of interactive skills training content, including delivery of adaptive training programs based on analysis of performance sensor data
CN107533806A (en) * 2015-02-02 2018-01-02 Gn 股份有限公司 It is configured as realizing framework, the apparatus and method of the transmission to the interaction skill training content including the content with multiple selectable expertise changes
US10918924B2 (en) 2015-02-02 2021-02-16 RLT IP Ltd. Frameworks, devices and methodologies configured to enable delivery of interactive skills training content, including content with multiple selectable expert knowledge variations
CN107533806B (en) * 2015-02-02 2020-11-06 Gn 股份有限公司 Framework, apparatus and method configured to enable delivery of interactive skills training content including content having a plurality of selectable expert knowledge variations
US10942968B2 (en) 2015-05-08 2021-03-09 Rlt Ip Ltd Frameworks, devices and methodologies configured to enable automated categorisation and/or searching of media data based on user performance attributes derived from performance sensor units
US11074826B2 (en) 2015-12-10 2021-07-27 Rlt Ip Ltd Frameworks and methodologies configured to enable real-time adaptive delivery of skills training data based on monitoring of user performance via performance monitoring hardware
US11417319B2 (en) * 2017-09-21 2022-08-16 Kabushiki Kaisha Toshiba Dialogue system, dialogue method, and storage medium
CN109963092A (en) * 2017-12-26 2019-07-02 深圳市优必选科技有限公司 A kind of processing method of subtitle, device and terminal
CN109963092B (en) * 2017-12-26 2021-12-17 深圳市优必选科技有限公司 Subtitle processing method and device and terminal
CN108491464A (en) * 2018-03-05 2018-09-04 广东小天才科技有限公司 A kind of content delivery method and system based on personal recognition
CN110632898A (en) * 2018-06-22 2019-12-31 广州艾美网络科技有限公司 Deduction system

Also Published As

Publication number Publication date
WO2008132265A1 (en) 2008-11-06

Similar Documents

Publication Publication Date Title
CN101652808A (en) Modifying audiovisual output in a karaoke system based on performance context
US9817551B2 (en) System and method for recording and sharing music
Starkey Radio in context
Turino Music as social life: The politics of participation
Waksman Instruments of desire
US11580941B2 (en) Music compilation systems and related methods
Gopinath Ringtones, or the auditory logic of globalization
Dunaway The forgotten 1979 MOMA sound art exhibition
JPH1063281A (en) Acoustic video device, and method for arranging musical piece by using the same
KR20150137117A (en) Music session management method and music session management device
Howlett The record producer as nexus: Creative inspiration, technology and the recording industry
Galloway Curating the aural cultures of the Battery: Soundwalking, auditory tourism and interactive locative media sound art
WO2021246104A1 (en) Control method and control system
JP5457791B2 (en) Karaoke scoring system
JP2007188175A (en) Server device, terminal device, and program
JP2007121550A (en) Karaoke contest system capable of reproducing and hearing singing voice of high order prizewinner, karaoke system, and contest server
KR100726756B1 (en) System and method for public singer tranining
Chimbudzi et al. The evolution of music recording technologies in Zimbabwe
JP5551983B2 (en) Karaoke performance control system
JP5823313B2 (en) Karaoke equipment
Armstrong Hot collecting off the record: ralph J. Gleason’s start in music journalism
JP2012194316A (en) Karaoke device
JP2002041063A (en) Karaoke system and recording medium
TW200416667A (en) Music composition system, method for controlling music composition system, program, information storage medium and music composition method
Masse Record producer: how has the profession changed over the years?

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C02 Deemed withdrawal of patent application after publication (patent law 2001)
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20100217