CN104170006A - Performance evaluation device, karaoke device, and server device - Google Patents

Performance evaluation device, karaoke device, and server device Download PDF

Info

Publication number
CN104170006A
CN104170006A CN201380015347.7A CN201380015347A CN104170006A CN 104170006 A CN104170006 A CN 104170006A CN 201380015347 A CN201380015347 A CN 201380015347A CN 104170006 A CN104170006 A CN 104170006A
Authority
CN
China
Prior art keywords
expression
data
performance
played
melody
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201380015347.7A
Other languages
Chinese (zh)
Other versions
CN104170006B (en
Inventor
松本秀一
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yamaha Corp
Original Assignee
Yamaha Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yamaha Corp filed Critical Yamaha Corp
Publication of CN104170006A publication Critical patent/CN104170006A/en
Application granted granted Critical
Publication of CN104170006B publication Critical patent/CN104170006B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10KSOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K15/00Acoustics not otherwise provided for
    • G10K15/04Sound-producing devices
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B15/00Teaching music
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/36Accompaniment arrangements
    • G10H1/361Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/48Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
    • G10L25/51Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/90Pitch determination of speech signals
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/031Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal
    • G10H2210/091Musical analysis, i.e. isolation, extraction or identification of musical elements or musical parameters from a raw acoustic signal or from an encoded audio signal for performance evaluation, i.e. judging, grading or scoring the musical qualities or faithfulness of a performance, e.g. with respect to pitch, tempo or other timings of a reference performance
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2220/00Input/output interfacing specifically adapted for electrophonic musical tools or instruments
    • G10H2220/155User input interfaces for electrophonic musical instruments
    • G10H2220/441Image sensing, i.e. capturing images or optical patterns for musical purposes or musical control purposes
    • G10H2220/455Camera input, e.g. analyzing pictures from a video camera and using the analysis results as control data

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Signal Processing (AREA)
  • Computational Linguistics (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Auxiliary Devices For Music (AREA)
  • Reverberation, Karaoke And Other Acoustics (AREA)
  • Electrophonic Musical Instruments (AREA)

Abstract

A performance evaluation device is provided with: an expressiveness reference data acquisition means that acquires expressiveness reference data that shows expressiveness that should be achieved during the performance of a piece of music and timing at which the expressiveness should be achieved for that piece of music with utterance start timing for notes or note groups included in the piece of music as a standard; a pitch and volume data generating means that generates pitch and volume data showing the pitch and volume of the performance sound from the performance sound of the piece of music by a performer; and a performance evaluation means that improves evaluation of the performance of the piece of music by the performer when at least one of the characteristics of pitch and volume shown by the pitch and volume data generated by the pitch and volume data generating means exhibits expressiveness characteristics that should be achieved according to the expressiveness reference data within a prescribed time range shown by the expressiveness reference data for the piece of music.

Description

Play evaluating apparatus, Caraok device and server unit
Technical field
The present invention relates to the technology that the quality of music playing is evaluated.
Background technology
For example, proposed various about possessing the technology of the Caraok device of singing use (following, unless otherwise specified, just referred to as " Caraok device ") of the scoring function that chanteur's the quality of singing performance is marked.As the document that discloses this technology, there is patent documentation 1.The disclosed Caraok device of the document according to sing each bent note calculate from user sing tone that sound extracts with from as guiding melody and the tone that pre-prepd data are extracted poor calculated basic score based on this difference.And, this Caraok device in the situation that used trill, on singing of the skill and technique such as glide calculate the award corresponding with carrying out this number of times of singing and divide.This Caraok device is pointed out as final evaluation result basic score and the total points that award divides to user.According to this technology, so high singing of skill and technique of difficulty such as having used trill or upper glide can be reflected in evaluation result.
In addition, as for example disclosing, according to representing that the waveform of singing sound detects the document that has carried out using the technology of singing this situation of the skill and technique such as trill, upper glide, has patent documentation 2 to 6.
Patent documentation
Patent documentation 1: the JP 2005-107334 of Japan communique
Patent documentation 2: the JP 2005-107330 of Japan communique
Patent documentation 3: the JP 2005-107087 of Japan communique
Patent documentation 4: the JP 2008-268370 of Japan communique
Patent documentation 5: the JP 2005-107336 of Japan communique
Patent documentation 6: the JP 2008-225115 of Japan communique
Summary of the invention
The problem that invention will solve
Yet, in the situation that the technology of patent documentation 1, even in the situation that to originally preferably do not used trill or on the position of singing of singing of the skill and technique such as glide carried out such singing, also add award minute.Therefore the score that, existence is pointed out as evaluation result deviates from such problem with the score that the sensitivity by the mankind produces.
The present invention makes in view of such problem, and object is in the evaluation of the music playing sung etc. in Karaoke, to point out the evaluation result of the score that the more approaching sensitivity by the mankind produces.
For solving the scheme of problem
In order to solve above-mentioned problem, the invention provides a kind of performance evaluating apparatus, possess: expression is played reference data acquiring unit, obtain take and pronunciation zero hour of the note that comprises in melody or note groups represent that the expression that should carry out is played and this expression is played the expression performance reference data on the opportunity that should carry out in described melody as benchmark in the performance of described melody; Tonal volume data generating unit, the performance sound of playing described melody according to player generates the expression tone of this performance sound and the tonal volume data of volume; And performance evaluation unit, in at least one party's of the represented tone of the described tonal volume data that generated by described tonal volume data generating unit and volume characteristic, represent in the situation that the characteristic that expression that reference data carries out is played is played in being played by described expression within the scope of the schedule time that reference data represents according to described expression in described melody, to improve the evaluation of the performance of the described melody that described player is carried out.
In addition, the invention provides a kind of Caraok device, possess: above-mentioned performance evaluating apparatus; Accompaniment data acquiring unit, obtains the accompaniment data that the accompaniment of melody is indicated; And voice signal output unit, according to the indication of described accompaniment data, export the voice signal of the musical sound that represents accompaniment, described tonal volume data generating unit is according to the voice signal from described voice signal output unit output, according to the accompaniment of emitting from loudspeaker, the tone of performance sound and the tonal volume data of volume of the described melody that generation expression is undertaken by described player.
In addition, a kind of server unit of the present invention, possess: expression is played and occurred data capture unit, for the performance sound of the playing music of player arbitrarily of any amount, obtain to be respectively illustrated in take and opportunity that pronunciation zero hour of the note that comprises in described melody or note groups is benchmark occurred that expression that an expression is played this situation is played and occur data, expression is played reference data generation unit, based on being played by described expression, occur that data appear in the expression performance of any amount that data capture unit obtains, for the note comprising in described melody or note groups, determine respectively which of take that pronunciation zero hour of this note or note groups is benchmark on the opportunity, which frequency is which expression play with occurs, the information of determining according to this, generation be take and pronunciation zero hour of the note that comprises in described melody or note groups represented that the expression that should carry out is played and this expression is played the expression performance reference data on the opportunity that should carry out in described melody as benchmark in the performance of described melody, and transmitting element, the expression of being played the generation of reference data generation unit by described expression is played to reference data and to playing evaluating apparatus, send.
In addition, the invention provides a kind of evaluation system of singing, possess: expression is played reference data acquiring unit, obtain take and pronunciation zero hour of the note that comprises in melody or note groups represent that the expression that should carry out is played and this expression is played the first expression performance reference data on the opportunity that should carry out in described melody as benchmark in the performance of described melody, tonal volume data generating unit, the performance sound of playing described melody according to player generates the expression tone of this performance sound and the tonal volume data of volume, play evaluation unit, in at least one party's of the represented tone of the described tonal volume data that generated by described tonal volume data generating unit and volume characteristic, represent in the situation that the characteristic that expression that reference data carries out is played is played in being played by described the first expression within the scope of the schedule time that reference data represents according to described the first expression in described melody, to improve the evaluation of the performance of the described melody that described player is carried out, expression is played and is occurred data capture unit, for the performance sound of the playing music of player arbitrarily of any amount, obtain to be respectively illustrated in take and opportunity that pronunciation zero hour of the note that comprises in the described melody that described player arbitrarily plays or note groups is benchmark occurred that expression that an expression is played this situation is played and occur data, and expression is played reference data generation unit, based on being played by described expression, occur that data appear in the expression performance of any amount that data capture unit obtains, the note or the note groups that in the melody of playing for described player arbitrarily, comprise, determine respectively which of take that pronunciation zero hour of this note or note groups is benchmark on the opportunity, which frequency is which expression play with occurs, the information of determining according to this, generation be take and pronunciation zero hour of the note that comprises in the melody that described player arbitrarily plays or note groups represented that the expression that should carry out is played and this expression is played the second expression performance reference data on the opportunity that carry out in the melody that should play described player arbitrarily as benchmark in the performance of the described playing music of player arbitrarily.
In addition, the invention provides a kind of performance evaluation method, obtain take and pronunciation zero hour of the note that comprises in melody or note groups represent that the expression that should carry out is played and this expression is played the expression performance reference data on the opportunity that should carry out in described melody as benchmark in the performance of described melody, the performance sound of playing described melody according to player generates the expression tone of this performance sound and the tonal volume data of volume, in at least one party's of the tone by described tonal volume data representation and volume characteristic, representing should be in the situation that the characteristic that expression that reference data carries out is played be played in being played by described expression within the scope of the schedule time that reference data represents according to described expression in described melody, the evaluation of the performance of the described melody that raising is carried out described player.
In addition, the invention provides the program that a kind of computing machine can be carried out, described computing machine is carried out: expression is played reference data and obtained processing, obtained take and pronunciation zero hour of the note that comprises in melody or note groups represent that the expression that should carry out is played and this expression is played the expression performance reference data on the opportunity that should carry out in described melody as benchmark in the performance of described melody; Tonal volume data generate to be processed, and the performance sound of playing described melody according to player generates the expression tone of this performance sound and the tonal volume data of volume; And play to evaluate and process, in at least one party's of the represented tone of the described tonal volume data that generated by described tonal volume data generating unit and volume characteristic, represent in the situation that the characteristic that expression that reference data carries out is played is played in being played by described expression within the scope of the schedule time that reference data represents according to described expression in described melody, to improve the evaluation of the performance of the described melody that described player is carried out.
Invention effect
According to the present invention, realize a kind of performance evaluating apparatus, in the performance of each melody, when the expression of wishing on the opportunity of hope is played, to player, give high evaluation.Consequently, by player, carried out expression play in the situation that, carrying out the few evaluation that deviates from the mankind's sensitivity.
Accompanying drawing explanation
Fig. 1 means the figure of the structure of singing evaluation system of one embodiment of the present invention.
Fig. 2 means the figure of the waveform of singing sound of pause sound.
Fig. 3 means the figure of the waveform of singing sound of trill.
Fig. 4 means the figure of the waveform of singing sound of florid ornamentation in Chinese opera singing.
Fig. 5 means the figure of the waveform of singing sound of glide.
Fig. 6 means the figure of the waveform of singing sound of lower glide.
Fig. 7 means the process flow diagram of the action of singing evaluation system of one embodiment of the present invention.
Fig. 8 is an example of the statistics that generates about pause sound.
Fig. 9 is an example of the statistics that generates about trill.
Figure 10 is an example of the statistics that generates about florid ornamentation in Chinese opera singing.
Figure 11 is an example of the statistics that generates about upper glide.
Figure 12 is an example of the statistics that generates about lower glide.
Figure 13 means the block diagram of performance evaluating apparatus of the present invention.
Embodiment
Below, with reference to accompanying drawing, embodiments of the present invention are described.
Fig. 1 means the figure of the structure of singing evaluation system 1 of one embodiment of the present invention.This is sung evaluation system 1 and has Caraok device 10-m (m=1,2 ... M:M is the sum of Caraok device) and server unit 30.Caraok device 10-m respectively arranges one or more in each Karaoke shop.Server unit 30 is arranged in system operation centre.Caraok device 10-m is connected with network 90 with server unit 30, mutually can receive and dispatch various data.
Caraok device 10-m is the device that carries out the good and bad evaluation of singing of singing performance, user of the playback of accompaniment song by singing of user supported and the demonstration of the lyrics.At this, Caraok device 10-m is in the good and bad evaluation of singing, carry out take the whether good evaluation as evaluation object that user's the tone of singing sound and the whether good evaluation as evaluation object of volume, the 5 kinds of expressions shown below of take are sung, and be that score is pointed out to user together with comment message by the evaluation result of 2 evaluations.
A1. pause sound
This is that the expression of singing out intentional delay that makes to sing the specific sound in song is sung.As shown in Figure 2, carrying out this sing in the situation that, the moment of the tone that makes to sing sound from previous sound to this change of tune postpones some time a little than the changing moment of corresponding 2 notes of two sounds (note) music score (singing of model).
B1. trill
This is to keep the expression of the tone of outward appearance and fine vibrations to sing the specific sound of singing in song.As shown in Figure 3, carrying out this sing in the situation that, the tone of singing sound periodically changes across the height of the corresponding note of this sound in music score.
C1. florid ornamentation in Chinese opera singing
This expression that is the sensual pleasure that makes to sing the specific sound in song changes in the mode of shouting out in pronunciation is midway sung.As shown in Figure 4, carrying out this sing in the situation that, quickly the rising of this sound corresponding note of the tone of singing sound in music score midway.
D1. go up glide
This is that the specific sound that makes to sing in song approaches the gimmick of singing of original height afterwards with the low sound pronunciation of the height than original.As shown in Figure 5, carrying out this sing in the situation that, the height of singing the corresponding note of this sound in the pitch ratio music score of pronunciation zero hour of sound is low.And this tone of singing sound rises gently and reaches the height roughly the same with the height of note after pronunciation starts.
E1. descend glide
This is that the specific sound that makes to sing in song approaches the gimmick of singing of original height afterwards with the high sound pronunciation of the height than original.As shown in Figure 6, carrying out this sing in the situation that, the height of singing the corresponding note of this sound in the pitch ratio music score of pronunciation zero hour of sound is high.And this tone of singing sound gently declines and reaches the height roughly the same with the height of note after pronunciation starts.
Turn back to Fig. 1, proceed to sing the explanation of evaluation system 1 integral body.Caraok device 10-m has sound source 11, loudspeaker 12, microphone 13, display part 14, communication interface 15, voice adapter 16, CPU17, RAM18, ROM19, hard disk 20, sequencer 21.The sound source 11 output voice signal S corresponding with the various message of MIDI (Musical Instrument Digital Interface) a.Loudspeaker 12 is emitted the signal being provided as sound.Microphone 13 receives sound and exports reception signals S m.Display part 14 shows and picture signal S icorresponding image.Communication interface 15 is at it and be connected in transceiving data between the device of network 90.
Voice adapter 16 is measured voice signal S mtone and volume, and generate to represent the tonal volume data of variation of their timeliness.Particularly, voice adapter 16 is every time T s(for example, T s=30 milliseconds) the voice signal S provide from microphone 13 is provided mtone, and using this testing result as signal S pand export.And voice adapter 16 is every time T sthe voice signal S that detection provides from microphone 13 mvolume, and using this testing result as signal S land export.
CPU17 utilizes RAM18 as perform region and carries out the program that is stored in ROM19 or hard disk 20.The details of the action of this CPU17 are described below.In ROM19, store IPL (Initial Program Loader) etc.In hard disk 20, store and variously sing bent song data MD-n (n=1~N) (N is the sum of singing bent kind), reference database DBRK and sing assessment process VPG.Respectively sing bent song data MD-n and be to record with SMF (Standard MIDI File) form and sing bent accompaniment content, sing the bent lyrics and sing the data of singing content of bent model.
Particularly, as shown in the frame of Fig. 1, song data MD-n has title HD, accompaniment track TR aC, lyrics track TR lY, model sings with reference to track TR nR.In title HD, record song number, song name, kind, playing time, time information such as base (ticktock (tick) number suitable with the time of 4 dieresis) etc.
At accompaniment track TR aCin, with the order of sequential, record the event EV (i) of pronunciation that the sound of each note NT (i) (i represents the order of counting from the note NT (1) of the beginning of the corresponding part of music score) in the accompaniment part of bent music score is sung in indication oNevent EV (i) with its noise reduction of indication oFFand the Delta Time DT of the execution time poor (ticktock number) of the event before and after representing to be close to.
At lyrics track TR lYin, with the order of sequential, record each data D that represents to sing the bent lyrics lY, the demonstration Delta Time DT of (more specifically, the mistiming (ticktock number) of the demonstration of each lyrics constantly and between the demonstration constantly of the lyrics above of these each lyrics) constantly that represents each lyrics.
In model, sing with reference to track TR nRin, with the order of sequential, record the event EV (i) of pronunciation of sound that each note NT (i) that sings part of bent music score is sung in indication oN, indicate the event EV (i) of its noise reduction oFFand the Delta Time DT of the execution time poor (ticktock number) of the event before and after representing to be close to.
At reference database DBRK, store 5 kinds of expressions and sing reference data DD a1, DD a2, DD a3, DD a4, DD a5.Expression is sung reference data DD a1be reference point t the pronunciation zero hour that means to sing the note NT (i) comprising in song bStime shaft on each constantly t evaluation when t has carried out based on the singing of pause sound constantly at these each right data of dividing VSR (t).Expression is sung reference data DD a2be reference point t the pronunciation zero hour that means to sing the note NT (i) comprising in song bStime shaft on each constantly t evaluation when t has carried out based on the singing of trill constantly at these each right data of dividing VSR (t).Expression is sung reference data DD a3be reference point t the pronunciation zero hour that means to sing the note NT (i) comprising in song bStime shaft on each constantly t evaluation when t has carried out based on the singing of florid ornamentation in Chinese opera singing constantly at these each right data of dividing VSR (t).Expression is sung reference data DD a4be reference point t the pronunciation zero hour that means to sing the note NT (i) comprising in song bStime shaft on each constantly t with these constantly t carried out based on evaluation during the singing of glide each right data of dividing VSR (t).Expression is sung reference data DD a5be reference point t the pronunciation zero hour that means to sing the note NT (i) comprising in song bStime shaft on each constantly t evaluation when t has carried out based on the singing of lower glide constantly at these each right data of dividing VSR (t).Below, 5 kinds of expressions are not being sung to reference data DD a1, DD a2, DD a3, DD a4, DD a5in situation about distinguishing, be designated as expression and sing reference data DD.
Sing assessment process VPG and there are 3 following functions.
A2. standard evaluation function
This is following function: the output signal S to voice adapter 16 land S ptone and the volume representing and singing with reference to track TR by model nRinterior each event EV (i) oNand EV (i) oFFthe model tone PCH of each note NT (i) determining rEFand model volume LV rEFcompare, and the quality sung of the result evaluation based on this comparison.
B2. expression is sung Function of Evaluation
This is following function: whenever the output signal S at voice adapter 16 pwhile there is signature waveform that expression sings in the tone waveform representing, be reference point t pronunciation zero hour of obtaining to become the note NT (i) of the object that expression sings bStime shaft on the going out now of the signature waveform sung of expression, each that sing reference data DD from the corresponding expression in reference database DBRK evaluated and selected to go out evaluation corresponding to now with this among minute VSR (t) and divide VSR (t), and divides a VSR (t) to evaluate the quality of singing based on this evaluation.
C2. evaluation result prompt facility
This is following function: according to the evaluation result of the evaluation of the evaluation result of the evaluation of a2 and b2, calculate score, this score is presented to display part 14 together with comment message.
In the situation that the song data MD-n of corresponding song is sent to RAM18 from hard disk 20 with telepilot (not shown) to singing bent singing to start to be operating as opportunity, sequencer 21 is by the event EV (i) in this song data MD-n oN, EV (i) oFFand data D lYto device, each portion supplies with.Particularly, when storing song data MD-n in RAM18, the time base and decide the time of 1 ticktock long by the bat of telepilot (not shown) appointment of describing in the title HD of sequencer 21 based on this song data MD-n, counts dripping according to long process of this time and carries out 3 following processing.
In the first processing, whenever the count value dripping and accompaniment track TR aCwhen interior Delta Time DT is consistent, sequencer 21 is by its follow-up event EV (i) oN(or EV (i) oFF) read and supply with to sound source 11.Sound source 11 is when being supplied to event EV (i) from sequencer 21 oNtime, by this event EV (i) oNthe voice signal S of appointment ato loudspeaker 12, supply with, when be supplied to event EV (i) from sequencer 21 oFFtime, stop supplying with voice signal S to loudspeaker 12 a.
In the second processing, whenever the count value and the lyrics track TR that drip lYwhen interior Delta Time DT is consistent, sequencer 21 is by its follow-up data D lYread and supply with to display part 14.Display part 14 is when being supplied to data D from sequencer 21 lYtime, by these data D lYconvert the image of the reflective captions of the lyrics to, and this image is presented to display (not shown).
By sequencer 21 carry out this first and second process, and carry out the demonstration to display from the playback of the accompaniment tone of loudspeaker 12 and the lyrics.User listens to the accompaniment tone of emitting from loudspeaker 12 and towards microphone 13, sings the lyrics that are shown in display.User, during microphone 13 is sung, microphone 13 is exported users' the reception signals S that sings sound m, voice adapter 16 outputs represent this signal S mtone and the signal S of volume pand S l.
In the 3rd processes, whenever the count value and the model that drip are sung with reference to track TR nRwhen interior Delta Time DT is consistent, sequencer 21 is by its follow-up event EV (i) oN(or EV (i) oFF) read and supply with to CPU17.CPU17 is used the event EV (i) supplying with from sequencer 21 oNand EV (i) oFF, voice adapter 16 output signal S pand S l, evaluate user's the quality of singing.Details are described below.
Server unit 30 is the devices that the effect of supporting is provided that play the service in Karaoke shop.Server unit 30 has communication interface 35, CPU37, RAM38, ROM39, hard disk 40.Communication interface 35 is at it and be connected in transceiving data between the device of network 90.CPU37 utilizes RAM38 as perform region, and carries out the various programs that are stored in ROM39 or hard disk 40.The details of the action of this CPU37 are described below.In ROM39, store IPL etc.
In hard disk 40, store and sing sampling database DBS, reference database DBRS and sing routine analyzer APG.Store separately respectively with 1 and sing the bent corresponding sampled data DS group of singing singing sampling database DBS.Sing sampled data DS and be the tone waveform of singing sound when having recorded the people with the power of singing more than certain level and singing singing Qu Jinhang and the data of volume waveform.At reference database DBRS, store the up-to-date expression that should store in the reference database DBRK of each Caraok device 10-m and sing reference data DD.
Sing routine analyzer APG and there are 3 following functions.
A3. accumulate function
This is following function: from Caraok device 10-m mono-bent obtain and respectively sing the bent sampled data DS that sings, and the sampled data DS that sings obtaining is accumulated in singing sampling database DBS.
B3. rewrite function
This is following function: for being accumulated in to sing, in sampling database DBS, sing sampled data DS, from this, sing the signature waveform that in the waveform that sampled data DS represents, search list love song is sung respectively, according to this Search Results, be reference point t the pronunciation zero hour that generate to represent take to become the note NT (i) of the object that expression sings bStime shaft on each constantly t and these appearance that expression of t is sung constantly count the statistics of the relation of Num, the content based on statistics is rewritten evaluation corresponding with each moment t that the expression in reference database DBR sings in reference data DD and is divided VSR (t).
C3. sending function
This is following function: according to the requirement from Caraok device 10-m, will sing reference data DD by the revised expression of rewriting function and send to Caraok device 10-m.
Next, the action of present embodiment is described.Fig. 7 means the process flow diagram of the action of present embodiment.In Fig. 7, in the situation that carried out singing bent singing, start operation (S100 is "Yes"), the CPU17 of Caraok device 10-m supplies with control signal S to sequencer 21 oand make sequencer 21 start to process (the first~three above-mentioned processing) (S120).When the processing based on sequencer 21 starts, CPU17 carries out standard to be sung and evaluate to process (S130) and expression and sing and evaluate processing (S140) these two processing.These two processing are described in Details as Follows.
A4. standard is sung to evaluate and is processed (S130)
In this is processed, CPU17 will be supplied to event EV (i) from sequencer 21 oNplay and be supplied to next event EV (i) oFFtill time be made as the tone period T of the sound that is equivalent to first note NT (i) nT(i).CPU17 obtains tone period T nT(i) the output signal S of the voice adapter 16 during pthe tone representing with to event EV (i) oNthe note label model tone PCH that carried out conversion rEFdifference PCH dEF, and the signal S during this pthe volume representing with to event EV (i) oNthe speed model volume LV that carried out conversion rEFdifference LV dEF, at this poor PCH dEFand poor LV dEFconverge in the situation of preset range, be judged to be singing of note NT (i) qualified.CPU17 from user sing start till playing end during carry out this note judgement, the number of whole note TN (i) of the finish time of singing is multiplied by 100 divided by the resulting value of number that is judged to be qualified note NT (i), and using resulting value as basic score SR bASE.
In addition, in this is processed, CPU17 judges the output signal S at voice adapter 16 pin the tone waveform representing, whether there is the signature waveform that any expression in pause sound, trill, florid ornamentation in Chinese opera singing, upper glide, lower glide is sung.At this, the details of the judgement gimmick of the signature waveform of pause sound are with reference to patent documentation 2, the details of the judgement gimmick of the signature waveform of trill are with reference to patent documentation 3, the details of the judgement gimmick of the signature waveform of florid ornamentation in Chinese opera singing are with reference to patent documentation 4, the details of the judgement gimmick of the signature waveform of upper glide are with reference to patent documentation 5, and the details of the judgement gimmick of the signature waveform of lower glide are with reference to patent documentation 6.CPU17 user sing start till playing end during carry out this signature waveform judgement, the appearance number that the expression of the finish time of singing is sung is multiplied by the resulting value of predetermined coefficient as adding point counting SR aDD.And, in this is processed, by basic score SR bASEwith add point counting SR aDDtotal as standard score SR nOR.
B4. expression is sung to evaluate and is processed (S140)
In this is processed, CPU17 will be from sound source event EV (i) oNoutput play next event EV (i) oFFoutput till time as the tone period T that is equivalent to the sound of first note NT (i) nT(i).And, at tone period T nT(i) the output signal S of the voice adapter 16 during pin the tone waveform representing, occurred that in the situation of the signature waveform that expression is sung, CPU17 obtains tone period T nT(i) kind that the expression that goes out now and appearance that the expression in is sung is sung.The kind that the expression that CPU17 generation expression is so determined is sung and the expression that goes out now are sung and are occurred data.
And CPU17 sings from expression a series of evaluation that reference data DD represents and divides and select among VSR (t) to sing and to occur that the expression shown in data is sung and gone out evaluation corresponding to now and divide VSR (t) with the expression of generation.CPU user sing start till playing end during carry out such evaluation and divide the VSR selection of (t), divide the mean value of VSR (t) as expression score SR the evaluation of the finish time of singing eX.
When bent the singing of singing of user finishes, CPU17 carries out evaluation result prompting and processes (S150).In evaluation result prompting is processed, CPU17 selects to sing to evaluate by standard to process the standard score SR marking nORprocess with singing by expression to evaluate the expression score SR marking eXin a high side's score.And, selecting standard score SR nORsituation under, CPU17 is by this score SR nORfor example " really extremely wonderful and exquisite song " such with score SR nORcorresponding comment message is presented at display part 14.And, selecting expression score SR eXsituation under, CPU17 is by this score SR eXfor example " to be really rich in human interest " such and expression score SR eXcorresponding comment message is presented at display part 14.
Then, the CPU17 transmission processing (S160) of sampling.In sampling transmission processing, CPU17 from sing bent sing start to tailend by the signal S of voice adapter 16 outputs pand S las this, sing the bent sampled data DS that sings, by the basic score SR that comprises this and sing sampled data DS and obtain in step S130 bASEthe message MS1 of (singing evaluating data) sends to server unit 30.
The CPU37 of server unit 30 is (S200 is "Yes") when obtaining message MS1 from Caraok device 10-m, from this message MS1, takes out and sings sampled data DS and basic score SR bASE, by this basic score SR bASEwith distinguish first-class person and be not first-class person's benchmark score SR tH(for example 80 minutes) compare (S220).At basic score SR bASEhigher than benchmark score SR tHsituation under (S220 is "Yes"), the sampled data DS that sings that CPU37 will take out from message MS1 accumulates in singing sampling database DBS (S230).
Then, CPU37 rewrites processing (S240).In rewriting processing, CPU37 carries out 5 following processing.In the first processing, CPU37 respectively sings from accumulating in what sing sampling database DBS the signature waveform of searching for pause sound in the tone waveform that sampled data DS represents, generates the expression that represents this Search Results and sings and occur that (be reference point t the pronunciation zero hour that represents to take note NT (i) that pause sound occurs to data bStime shaft on each data of t constantly).Then, the expression of CPU37 based on generating about pause sound sung and occurred data, generate to represent to take that be reference point t pronunciation zero hour of note NT (i) bStime shaft on each constantly t and these appearance that expression of t is sung " pause sound " constantly count the statistics of the relation of Num, and the content based on this statistics is rewritten to express one's feelings and is sung reference data DD a1divide VSR (t) with each evaluation that constantly t is corresponding.
Fig. 8 means the figure about an example of the statistics of pause sound.In the statistics of this example, than reference point t bSpre-set time T1 a1moment t1 a1with than reference point t bStime delay T4 a1moment t4 a1between be distributed with the appearance sung of expression and count Num.And, in the statistics of this example, at reference point t and then bSmoment t2 afterwards a1show the peak-peak that occurs number Num, than moment t2 a1the moment t3 in evening a1show second peak value that occurs number Num.Thus, in the revised expression of the statistics of this example, sing reference data DD a1in, moment t2 a1evaluation divide VSR (t2 a1) for the highest, moment t3 a1evaluation divide VSR (t3 a1) be the second height.
In the second processing, CPU37 respectively sings from accumulating in what sing sampling database DBS the signature waveform of searching for trill in the tone waveform that sampled data DS represents, generates the expression that represents this Search Results and sings and occur that (be reference point t the pronunciation zero hour that represents to take note NT (i) that trill occurs to data bStime shaft on each data of t constantly).Then, the expression of CPU37 based on generating about trill sung and occurred data, generate to represent to take that be reference point t pronunciation zero hour of note NT (i) bStime shaft on each constantly t and these appearance that expression of t is sung constantly count the statistics of the relation of Num, and the content based on this statistics is rewritten to express one's feelings and is sung reference data DD a2divide VSR (t) with each evaluation that constantly t is corresponding.
Fig. 9 means the figure about an example of the statistics of trill.In the statistics of this example, at reference point t bSwith than reference point t bStime delay T2 a2moment t2 a2between be distributed with the appearance sung of expression and count Num.And, in the statistics of this example, than reference point t bStime delay T1 a2moment t1 a2show the peak-peak that occurs number Num.Thus, in the revised expression of the statistics of this example, sing reference data DD a2in, moment t1 a2evaluation divide VSR (t1 a2) for the highest.
In the 3rd processes, CPU37 respectively sings from accumulating in what sing sampling database DBS the signature waveform of searching for florid ornamentation in Chinese opera singing in the tone waveform that sampled data DS represents, generates the expression that represents this Search Results and sings and occur that (be reference point t the pronunciation zero hour that represents to take note NT (i) that florid ornamentation in Chinese opera singing occurs to data bStime shaft on each data of t constantly).Then, the expression of CPU37 based on generating about florid ornamentation in Chinese opera singing sung and occurred data, generate to represent to take that be reference point t pronunciation zero hour of note NT (i) bStime shaft on each constantly t and these appearance that expression of t is sung constantly count the statistics of the relation of Num, and the content based on this statistics is rewritten to express one's feelings and is sung reference data DD a3divide VSR (t) with each evaluation that constantly t is corresponding.
Figure 10 means the figure about an example of the statistics of florid ornamentation in Chinese opera singing.In the statistics of this example, at reference point t bSwith than reference point t bStime delay T2 a3moment t2 a3between be distributed with the appearance sung of expression and count Num.And, in the statistics of this example, than reference point t bStime delay T1 a3moment t1 a3show the peak-peak that occurs number Num.Thus, in the revised expression of the statistics of this example, sing reference data DD a3in, moment t1 a3evaluation divide VSR (t1 a3) for the highest.
In the 4th processes, CPU37 be take the expression that represents this Search Results and is sung and occur that (be reference point t the pronunciation zero hour that represents the note NT (i) of above glide appearance to data from accumulating in the signature waveform of respectively singing the glide of search in the tone waveform that sampled data DS represents of singing sampling database DBS, generating bStime shaft on each data of t constantly).Then, the expression of CPU37 based on generating about upper glide sung and occurred data, generate to represent to take that be reference point t pronunciation zero hour of note NT (i) bStime shaft on each constantly t and these appearance that expression of t is sung constantly count the statistics of the relation of Num, and the content based on this statistics is rewritten to express one's feelings and is sung reference data DD a4divide VSR (t) with each evaluation that constantly t is corresponding.
Figure 11 means the figure about an example of the statistics of upper glide.In the statistics of this example, at reference point t bSwith than reference point t bStime delay T2 a4moment t2 a4between be distributed with the appearance sung of expression and count Num.And, in the statistics of this example, at reference point t bSshow the peak-peak that occurs number Num, than reference point t bSpostponed time T 1 a4moment t1 a4show second peak value that occurs number Num.Thus, in the revised expression of the statistics of this example, sing reference data DD a4in, moment t bSevaluation divide VSR (t bS) for the highest, moment t1 a4evaluation divide VSR (t1 a4) be the second height.
In the 5th processes, CPU37 sings and occurs that (be reference point t the pronunciation zero hour that represents the note NT (i) of following glide appearance to data from accumulating in the signature waveform of respectively singing the glide of search in the tone waveform that sampled data DS represents of singing sampling database DBS, generate the expression that represents this Search Results bStime shaft on each data of t constantly).Then, the expression of CPU37 based on generating about lower glide sung and occurred data, generate to represent to take that be reference point t pronunciation zero hour of note NT (i) bStime shaft on each constantly t and these appearance that expression of t is sung constantly count the statistics of the relation of Num, and the content based on this statistics is rewritten to express one's feelings and is sung reference data DD a5divide VSR (t) with each constantly corresponding evaluation.
Figure 12 means the figure about an example of the statistics of lower glide.In the statistics of this example, than reference point t bStime delay T1 a5moment t1 a5with from moment t bStime delay T2 a5moment t2 a5between be distributed with the appearance sung of expression and count Num.And, in the statistics of this example, at moment t2 a5show the peak-peak that occurs number Num.Thus, in the revised expression of the statistics of this example, sing reference data DD a5in, moment t2 a5evaluation divide VSR (t2 a5) for the highest.
In Fig. 7, when the inquiry of predetermining arrives constantly (S110 is "Yes"), the CPU17 of Caraok device 10-m carries out query processing (S170).In this query processing, CPU17 will require the message MS2 of the transmission of latest data to send (S170) to server unit 30.The CPU37 of server unit 30 is (S210 is "Yes") when receiving message MS2 from Caraok device 10-m, by the time of reception of the message MS2 from last time till the time of reception of this message MS2 during rewritten content expression sing reference data DD and send (S250) to the Caraok device 10-m of the transmission source of message M2.The CPU17 of Caraok device 10-m, when receiving expression from server unit 30 while singing reference data DD, sings reference data DD by this expression and covers and its content is upgraded to (S180) to reference database DBRK.
More than the details of the structure of present embodiment.According to present embodiment, can obtain following effect.
First, singing of band expression in present embodiment evaluated in processing, while occurring expressing one's feelings the signature waveform of singing in the waveform of the output signal at voice adapter 16, going out now of the signature waveform that expression on the time shaft that be reference point pronunciation zero hour of obtaining to become the note NT (i) of the object that expression sings is sung, from singing each in reference data DD, evaluate and to select going out evaluation corresponding to now with this among minute VSR (t) and divide VSR (t), the evaluation based on this selection divides VSR (t) to evaluate the quality of singing.Thus, according to present embodiment, even if user has carried out expression, sing, if its opportunity is inappropriate, also cannot obtain good evaluation.Therefore,, according to present embodiment, can point out out the evaluation result of the sensitivity that more approaches people.
Second, in the present embodiment, for the expression of accumulating in singing sampling database DBS, sing reference data DD, the signature waveform that in the waveform representing from these data DD respectively, search list love song is sung, according to this Search Results, the statistics of the relation of the appearance number that each on the time shaft that be reference point the pronunciation zero hour that generate to represent take to become the note NT (i) of the object that expression sings sung with these expressions constantly constantly, and the content based on statistics rewrite sing reference data DD divide VSR (t) with each constantly corresponding evaluation.Thus, according to present embodiment, the variation of having sung the tendency of the singing method of singing bent first-class persons can be reflected in evaluation result.
Above, one embodiment of the present invention has been described, but the present invention also can comprise other embodiments.For example, as described below.
(1) in the above-described embodiment, CPU17 is from the output signal S of voice adapter 16 pin detect pause sound, trill, florid ornamentation in Chinese opera singing, upper glide, these 5 kinds of expressions of lower glide and sing.Yet, also can detect these 5 kinds expressions in addition and sing.For example, can detect and be with accentual singing.
(2) in the above-described embodiment, CPU17 is used the output signal S of voice adapter 16 pand S lthis two side carries out standard and sings evaluation processing, and only uses the output signal S of voice adapter 16 pand S lin the signal S of expression tone pexpress one's feelings to sing to evaluate and process.Yet CPU17 also can only be used signal S pand S lin a side carry out standard and sing and evaluate to process.And CPU17 also can be used signal S pand S lthis two side expresses one's feelings to sing to evaluate and processes.
(3) in the expression of above-mentioned embodiment is sung and evaluate to be processed, the going out now of signature waveform of singing based on expression and evaluated the quality of singing.Yet, also can add the evaluation that key element beyond now (for example, length separately of pause sound, trill, florid ornamentation in Chinese opera singing, upper glide, lower glide, the degree of depth etc.) of signature waveform that expression sings.
(4) in the expression of above-mentioned embodiment, sing and evaluate in processing, adopt to detect that the note that comprises is corresponding separately sings the structure that the expression that occurs in sound is sung in singing song, but also can adopt, detect that a series of a plurality of notes (note groups) that comprise are corresponding sings the structure that the expression that occurs in sound is sung in singing song.For example, it is that the expression of carrying out in the singing of a series of a plurality of notes is sung that the such expression of crescendo/diminuendo is sung, so the determination and evaluation sung of these expressions preferably be take note groups and carried out as unit.Therefore, singing relevant expression to such expression sings reference data DD and also preferably note groups unit, consists of.
(5) in the above-described embodiment, adopt following structure: from 10 pairs of server units of Caraok device 30, send to be included in and sing bent starting to the signal S of 16 outputs of voice adapter tailend of singing pand S lsing sampled data DS (tonal volume data), in server unit 30, according to singing sampled data DS, carry out definite processing on the opportunity of detection that each expression sings and appearance thereof.Also can replace, adopt following structure: the voice signal S of the sound of being received by microphone 13 from the 30 transmission expressions of 10 pairs of server units of Caraok device m(the sound waveform data of sound are sung in expression) carries out according to voice signal S in server unit 30 mgenerate signal S pand signal S lprocessing (processing that the voice adapter 16 of above-mentioned embodiment carries out).And, also can adopt following structure: from 10 pairs of server units 30 of Caraok device, be sent according to singing expression that assessment process VPG carries out and sing the data (expression is sung and occurred data) on the opportunity of evaluating classification that the expression expression determined while processing (S140) sings and appearance thereof, in server unit 30, the express one's feelings Check processing sung and expression based on sending from Caraok device 10 are sung and occurred that data are expressed one's feelings and sing the renewal processing of reference data DD.
(6) in the above-described embodiment, server unit 30 carries out the generation of statistics and the rewriting that the expression based on this generation is sung reference data DD.Yet, also each Caraok device 10-m self can be generated in the past or from other Caraok devices 10-m directly or the expression of obtaining via server unit 30 sing the voice signal S of sound m, according to these voice signals S mthe signal S generating pand signal S l, or use the data (expression is sung and occurred data) on the opportunity of classification that expression expression that these signals determine sings and appearance thereof to be stored in hard disk 20, CPU17 reads them and uses, and carries out the same processing of the processing carried out with server unit 30 in S240, is the generation of statistics and the rewriting that the expression based on this generation is sung reference data DD.
(7) evaluation method of singing in above-mentioned embodiment and evaluation result can be carried out various changes to the form of chanteur's prompting.For example, in the above-described embodiment, adopt standard sing evaluate the occurrence number of singing based on expression is calculated in processing (S130) add point counting SR aDDwith basic score SR bASEbe added, calculate thus standard score SR nORstructure, but also can adopt in standard, sing and do not consider the appearance that expression is sung in evaluate processing and only calculate basic score SR bASEstructure.And, in the above-described embodiment, for chanteur, shown to sing to evaluate by standard and processed the standard score SR marking nORprocess with singing by expression to evaluate the expression score SR marking eXin a high side's score, but also can show this two side, the gross score that shows them etc. carries out the prompting to chanteur's evaluation result in other forms.
(8), when updating form love song is sung reference data DD, adopt basic score SR in the above-described embodiment, bASEthan benchmark score SR tHhigh chanteur as first-class person and only uses relevant to first-class person the express one's feelings structure of the renewal of singing reference data DD of sampled data DS of singing.The renewal system of selection of singing sampled data DS used that expression is sung reference data DD is not limited to this.For example, also can replace basic score SR bASEand use basic score SR bASEadd point counting SR aDDresulting standard score SR nORthe benchmark of inferring as first-class person.And, in order to express one's feelings completely, sing and basic score SR bASEfor the first-class person of high score forecloses, also can adopt following structure: except threshold value (the benchmark score SR of downside tH) outside, the threshold value of upside, the basic score SR higher than the threshold value of upside are also set bASEthe chanteur's of (or other scores) the sampled data DS that sings is not used in the renewal that expression is sung reference data DD.And, also can replace and as described above chanteur is divided into first-class person and the first-class person situation of this two class in addition, for example, by basic score SR bASEthe singing the additional large weight of sampled data DS of high chanteur and sing the renewal of reference data DD for expressing one's feelings.
(9) in the above-described embodiment, as an example of evaluating the performance evaluating apparatus of music playing, show to be located at and sing the Caraok device of use and evaluate the performance evaluating apparatus of singing performance, but performance evaluating apparatus of the present invention is not defined in the evaluation of singing performance, has gone for using the evaluation of the music playing of various musical instruments yet.That is " the singing " of, using in the above-described embodiment such language is replaced by " performance " such language more generally.In addition, in evaluating the performance evaluating apparatus of instrumental music playing, carry out playing relevant evaluation such as the string etc. of pushing away of guitar to the corresponding expression of each musical instrument.And in the situation that melody is not to sing song but melody that musical instrument is used, the Caraok device that instrument playing is used is substituted by lyrics track TR by song data MD lYfor example comprise represent the data of music score, each interval that represents music score (for example, the piece of 2 trifles or 4 trifles etc.) data that demonstration Delta Time is constantly recorded successively with sequential are music score track, sequencer 21 and display part 14 be according to music score track, is accompanied by the progress of melody and will represents that the picture signal with music score corresponding to position of accompanying exports to display.In addition, in singing the Caraok device of use and Caraok device that instrument playing is used, in the situation that do not need the demonstration of the lyrics or music score, can not carry out the output of sequencer 21 and 14 pairs of picture signals of display part and process.
(10) known according to above illustration, the performance evaluating apparatus of preferred configuration of the present invention is as Figure 13 illustration, show to comprising property as possessing expression and play reference data acquiring unit 101, the device of tonal volume data generating unit 102 and performance evaluation unit 103, having or not of other key elements, the concrete form of other key elements is any, this expression is played reference data acquiring unit 101 and is obtained take and pronunciation zero hour of the note that comprises in melody or note groups represent that the expression that should carry out is played and this expression is played the expression performance reference data on the opportunity that should carry out in described melody as benchmark in the performance of described melody, the performance sound that this tonal volume data generating unit 102 is played described melody according to player generates the expression tone of this performance sound and the tonal volume data of volume, this performance evaluation unit 103 represents at least one party's of the represented tone of the described tonal volume data that generated by described tonal volume data generating unit 102 and volume characteristic should be in the situation that the characteristic that expression that reference data carries out is played be played in being played by described expression within the scope of the schedule time that reference data represents according to described expression in described melody, the evaluation of the performance of the described melody that raising is carried out described player.
(11) in the above-described embodiment, show the example that is provided with performance evaluating apparatus of the present invention at the Caraok device as so-called special machine, but performance evaluating apparatus of the present invention is not limited to special machine.For example, also can adopt by making the various devices such as personal computer, portable information terminal (such as portable telephone or smart phone) or game device carry out realizing according to the processing of program the structure of performance evaluating apparatus of the present invention.And this program can be stored in the recording mediums such as CD-ROM and issue, or also can utilize the electrical communication lines such as internet to issue.
The application is willing to 2012-094853 based on the Japanese patent application laid that on April 18th, 2012 proposes, and is incorporated into herein its content as reference.
Industrial applicibility
According to the present invention, by player, carried out expression play in the situation that, can carry out the few evaluation that deviates from the mankind's sensitivity.
Description of reference numerals
1 ... sing evaluation system, 10 ... Caraok device, 11 ... sound source, 12 ... loudspeaker, 13 ... microphone, 14 ... display part, 15 ... communication interface, 16 ... voice adapter, 17 ... CPU, 18 ... RAM, 19 ... ROM, 20 ... hard disk, 21 ... sequencer, 30 ... server unit, 35 ... communication interface, 37 ... CPU, 38 ... RAM, 39 ... ROM, 40 ... hard disk, 90 ... network

Claims (12)

1. play an evaluating apparatus, possess:
Expression is played reference data acquiring unit, obtains take pronunciation zero hour of the note that comprises in melody or note groups to represent that the expression that should carry out is played and this expression is played the expression performance reference data on the opportunity that should carry out in described melody as benchmark in the performance of described melody;
Tonal volume data generating unit, the performance sound of playing described melody according to player generates the expression tone of this performance sound and the tonal volume data of volume; And
Play evaluation unit, in at least one party's of the represented tone of the described tonal volume data that generated by described tonal volume data generating unit and volume characteristic, represent in the situation that the characteristic that expression that reference data carries out is played is played in being played by described expression within the scope of the schedule time that reference data represents according to described expression in described melody, to improve the evaluation of the performance of the described melody that described player is carried out.
2. performance evaluating apparatus according to claim 1, wherein, possesses:
Tonal volume data capture unit, for the performance sound of the playing music of player arbitrarily of any amount, obtains respectively and represents the tone of this performance sound and the tonal volume data of volume;
Expression is played and is occurred data generating unit, in the situation that at least one party's of the represented tone of the volume tone data being obtained by described tonal volume data capture unit and volume property list is shown in a characteristic in the characteristic that the more than one expression predetermined the opportunity arbitrarily in described melody plays, generates and represent that this expression plays and take the right expression performance on this opportunity that pronunciation zero hour of the note that comprises in described melody or note groups is benchmark and occur data; And
Expression is played reference data generation unit, expression based on played any amount that occurs that data generating unit generates by described expression is played and is occurred data, for the note comprising in described melody or note groups, determine respectively on which of take that pronunciation zero hour of this note or note groups is benchmark on the opportunity, which frequency is which expression play with occurs, and the information of determining according to this generates expression and plays reference data.
3. performance evaluating apparatus according to claim 2, wherein,
Described performance evaluating apparatus possesses the expression performance reference data storage unit that storage expression is played reference data,
Described expression based on played the generation of reference data generation unit by described expression is played reference data, rewrites the described expression being stored in described expression performance reference data storage unit and plays reference data.
4. according to the performance evaluating apparatus described in any one in claim 1~3, wherein,
Described performance evaluating apparatus possesses the model of the model performance reference data of obtaining the tone being a model worker that represents described melody and plays reference data acquiring unit,
The represented tone of the tonal volume data of described performance evaluation unit based on being generated by described tonal volume data generating unit with by described model, played the comparative result of the represented tone of reference data, carry out the evaluation of the performance of described melody that described player is carried out.
5. performance evaluating apparatus according to claim 2, wherein,
Described performance evaluating apparatus possesses the model of the model performance reference data of obtaining the tone being a model worker that represents described melody and plays reference data acquiring unit,
The represented tone of the tonal volume data of described performance evaluation unit based on being generated by described tonal volume data generating unit with by described model, played the comparative result of the represented tone of reference data, carry out the evaluation of the performance of described melody that described player is carried out
The tonal volume data of being obtained by described tonal volume data capture unit are with playing evaluating data, this performance evaluating data represents to use described model to play reference data and the result of the evaluation carried out or used the result of the evaluation of playing the same data of reference data with described model and carrying out by other equipment that possess the unit same with described performance evaluation unit by described performance evaluation unit
Described expression play reference data generation unit use in the tonal volume data of being obtained by described tonal volume data capture unit with the tonal volume data that meet the performance evaluating data of predetermined condition, based on being played by described expression, occur that data appear in the expression performance that data generating unit generates, and generate described expression and play reference data.
6. a Caraok device, possesses:
Performance evaluating apparatus in claim 1~5 described in any one;
Accompaniment data acquiring unit, obtains the accompaniment data that the accompaniment of melody is indicated; And
Voice signal output unit, exports the voice signal of the musical sound that represents accompaniment according to the indication of described accompaniment data,
Described tonal volume data generating unit is according to the voice signal from the output of described voice signal output unit, according to the accompaniment of emitting from loudspeaker, generates the tone of performance sound and the tonal volume data of volume that represent the described melody that undertaken by described player.
7. Caraok device according to claim 6, wherein,
Described melody is to sing song,
Described Caraok device possesses:
Lyrics data acquiring unit, obtains the lyrics data of singing the bent lyrics described in expression; And
Image signal output unit, output image signal, the lyrics that this picture signal represents to be represented by described lyrics data, the lyrics of being sung together with should the accompaniment represented with the voice signal by the current output of described voice signal output unit.
8. Caraok device according to claim 6, wherein,
Described melody is the melody by instrument playing,
Described Caraok device possesses:
Music data acquiring unit, obtains the music data of the music score that represents described melody, and
Image signal output unit, output image signal, the music score of the performance that the music score that this picture signal represents to be represented by described music data, i.e. indication carry out together with should the accompaniment represented with the voice signal by the current output of described voice signal output unit.
9. a server unit, possesses:
Expression is played and is occurred data capture unit, for the performance sound of the playing music of player arbitrarily of any amount, obtain to be respectively illustrated in take and opportunity that pronunciation zero hour of the note that comprises in described melody or note groups is benchmark occurred that expression that an expression is played this situation is played and occur data;
Expression is played reference data generation unit, based on being played by described expression, occur that data appear in the expression performance of any amount that data capture unit obtains, for the note comprising in described melody or note groups, determine respectively which of take that pronunciation zero hour of this note or note groups is benchmark on the opportunity, which frequency is which expression play with occurs, the information of determining according to this, generation be take and pronunciation zero hour of the note that comprises in described melody or note groups represented that the expression that should carry out is played and this expression is played the expression performance reference data on the opportunity that should carry out in described melody as benchmark in the performance of described melody, and
Transmitting element, plays reference data by the expression of being played the generation of reference data generation unit by described expression and sends to playing evaluating apparatus.
10. sing an evaluation system, possess:
Expression is played reference data acquiring unit, obtains take pronunciation zero hour of the note that comprises in melody or note groups to represent that the expression that should carry out is played and this expression is played the first expression performance reference data on the opportunity that should carry out in described melody as benchmark in the performance of described melody;
Tonal volume data generating unit, the performance sound of playing described melody according to player generates the expression tone of this performance sound and the tonal volume data of volume;
Play evaluation unit, in at least one party's of the represented tone of the described tonal volume data that generated by described tonal volume data generating unit and volume characteristic, represent in the situation that the characteristic that expression that reference data carries out is played is played in being played by described the first expression within the scope of the schedule time that reference data represents according to described the first expression in described melody, to improve the evaluation of the performance of the described melody that described player is carried out;
Expression is played and is occurred data capture unit, for the performance sound of the playing music of player arbitrarily of any amount, obtain to be respectively illustrated in take and opportunity that pronunciation zero hour of the note that comprises in the described melody that described player arbitrarily plays or note groups is benchmark occurred that expression that an expression is played this situation is played and occur data; And
Expression is played reference data generation unit, based on being played by described expression, occur that data appear in the expression performance of any amount that data capture unit obtains, the note or the note groups that in the melody of playing for described player arbitrarily, comprise, determine respectively which of take that pronunciation zero hour of this note or note groups is benchmark on the opportunity, which frequency is which expression play with occurs, the information of determining according to this, generation be take and pronunciation zero hour of the note that comprises in the melody that described player arbitrarily plays or note groups represented that the expression that should carry out is played and this expression is played the second expression performance reference data on the opportunity that carry out in the melody that should play described player arbitrarily as benchmark in the performance of the described playing music of player arbitrarily.
Play evaluation method for 11. 1 kinds,
Obtain take and pronunciation zero hour of the note that comprises in melody or note groups represent that the expression that should carry out is played and this expression is played the expression performance reference data on the opportunity that should carry out in described melody as benchmark in the performance of described melody,
The performance sound of playing described melody according to player generates the expression tone of this performance sound and the tonal volume data of volume,
In at least one party's of the tone by described tonal volume data representation and volume characteristic, represent in the situation that the characteristic that expression that reference data carries out is played is played in being played by described expression within the scope of the schedule time that reference data represents according to described expression in described melody, to improve the evaluation of the performance of the described melody that described player is carried out.
12. 1 kinds of programs, are the programs that computing machine can be carried out, and described computing machine is carried out:
Expression is played reference data and is obtained processing, obtains take pronunciation zero hour of the note that comprises in melody or note groups to represent that the expression that should carry out is played and this expression is played the expression performance reference data on the opportunity that should carry out in described melody as benchmark in the performance of described melody;
Tonal volume data generate to be processed, and the performance sound of playing described melody according to player generates the expression tone of this performance sound and the tonal volume data of volume; And
Play to evaluate and process, in at least one party's of the represented tone of the described tonal volume data that generated by described tonal volume data generating unit and volume characteristic, represent in the situation that the characteristic that expression that reference data carries out is played is played in being played by described expression within the scope of the schedule time that reference data represents according to described expression in described melody, to improve the evaluation of the performance of the described melody that described player is carried out.
CN201380015347.7A 2012-04-18 2013-04-18 Performance evaluation device, karaoke device, and server device Expired - Fee Related CN104170006B (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2012-094853 2012-04-18
JP2012094853A JP5958041B2 (en) 2012-04-18 2012-04-18 Expression performance reference data generation device, performance evaluation device, karaoke device and device
PCT/JP2013/061488 WO2013157602A1 (en) 2012-04-18 2013-04-18 Performance evaluation device, karaoke device, and server device

Publications (2)

Publication Number Publication Date
CN104170006A true CN104170006A (en) 2014-11-26
CN104170006B CN104170006B (en) 2017-05-17

Family

ID=49383554

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201380015347.7A Expired - Fee Related CN104170006B (en) 2012-04-18 2013-04-18 Performance evaluation device, karaoke device, and server device

Country Status (5)

Country Link
JP (1) JP5958041B2 (en)
KR (1) KR101666535B1 (en)
CN (1) CN104170006B (en)
TW (1) TWI497484B (en)
WO (1) WO2013157602A1 (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104392731A (en) * 2014-11-30 2015-03-04 陆俊 Singing practicing method and system
CN105938429A (en) * 2015-03-04 2016-09-14 国际商业机器公司 Rapid cognitive mobile application review method and system
CN106210941A (en) * 2015-07-15 2016-12-07 株式会社万代 Singing ability evaluating apparatus and storage device
CN108665747A (en) * 2017-04-01 2018-10-16 上海伍韵钢琴有限公司 A kind of online piano training mate system and application method
CN108694384A (en) * 2018-05-14 2018-10-23 芜湖岭上信息科技有限公司 A kind of viewer satisfaction investigation apparatus and method based on image and sound
CN109478399A (en) * 2016-07-22 2019-03-15 雅马哈株式会社 Play analysis method, automatic Playing method and automatic playing system
CN109804427A (en) * 2016-10-11 2019-05-24 雅马哈株式会社 It plays control method and plays control device
CN109887524A (en) * 2019-01-17 2019-06-14 深圳壹账通智能科技有限公司 A kind of singing marking method, device, computer equipment and storage medium
CN109903778A (en) * 2019-01-08 2019-06-18 北京雷石天地电子技术有限公司 The method and system of real-time singing marking
CN110083772A (en) * 2019-04-29 2019-08-02 北京小唱科技有限公司 Singer's recommended method and device based on singing skills
CN110120216A (en) * 2019-04-29 2019-08-13 北京小唱科技有限公司 For singing the audio data processing method and device of evaluation
CN110959172A (en) * 2017-07-25 2020-04-03 雅马哈株式会社 Musical performance analysis method and program
CN112037609A (en) * 2020-08-26 2020-12-04 钮小静 Music teaching device based on thing networking

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101459324B1 (en) * 2013-08-28 2014-11-07 이성호 Evaluation method of sound source and Apparatus for evaluating sound using it
JP6428066B2 (en) * 2014-09-05 2018-11-28 オムロン株式会社 Scoring device and scoring method
JP6352164B2 (en) * 2014-11-28 2018-07-04 株式会社第一興商 Karaoke scoring system considering listener evaluation
CN104485090B (en) * 2014-12-12 2020-01-17 上海斐讯数据通信技术有限公司 Music score generation method and device and mobile terminal
JP5715296B1 (en) * 2014-12-16 2015-05-07 行秘 大田 Akatsuki communication karaoke server and a karaoke communication karaoke system
JP6701864B2 (en) * 2016-03-25 2020-05-27 ヤマハ株式会社 Sound evaluation device and sound evaluation method
JP6867900B2 (en) * 2017-07-03 2021-05-12 株式会社第一興商 Karaoke equipment
JP7232654B2 (en) * 2019-01-31 2023-03-03 株式会社第一興商 karaoke equipment
JP7232653B2 (en) * 2019-01-31 2023-03-03 株式会社第一興商 karaoke device
JP7169243B2 (en) * 2019-03-29 2022-11-10 株式会社第一興商 karaoke device

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1173008A (en) * 1996-08-06 1998-02-11 雅马哈株式会社 Karaoke scoring apparatus analyzing singing voice relative to melody data
CN1178357A (en) * 1996-08-30 1998-04-08 雅马哈株式会社 Karaoke apparatus with individual scoring of duet singers
CN1380642A (en) * 2001-04-11 2002-11-20 华邦电子股份有限公司 Single-following learning scoring device and method
JP2003058155A (en) * 2001-08-13 2003-02-28 Casio Comput Co Ltd Musical performance practicing device and program for musical performance practicing process
CN1423808A (en) * 2000-01-13 2003-06-11 雅马哈株式会社 Portable telephone and portable telephone system
JP2005241848A (en) * 2004-02-25 2005-09-08 Daiichikosho Co Ltd Model vocal offer system of contribution work editing type in online karaoke system
JP2007271977A (en) * 2006-03-31 2007-10-18 Yamaha Corp Evaluation standard decision device, control method, and program
JP2007334364A (en) * 2007-08-06 2007-12-27 Yamaha Corp Karaoke machine
JP2008139426A (en) * 2006-11-30 2008-06-19 Yamaha Corp Data structure of data for evaluation, karaoke machine, and recording medium

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2915773B2 (en) * 1993-12-25 1999-07-05 日本コロムビア株式会社 Karaoke equipment
JP4209751B2 (en) * 2003-09-30 2009-01-14 ヤマハ株式会社 Karaoke equipment
JP4222915B2 (en) * 2003-09-30 2009-02-12 ヤマハ株式会社 Singing voice evaluation device, karaoke scoring device and programs thereof
JP4204941B2 (en) 2003-09-30 2009-01-07 ヤマハ株式会社 Karaoke equipment
JP4163584B2 (en) 2003-09-30 2008-10-08 ヤマハ株式会社 Karaoke equipment
TWI232430B (en) * 2004-03-19 2005-05-11 Sunplus Technology Co Ltd Automatic grading method and device for audio source
JP2007256617A (en) * 2006-03-23 2007-10-04 Yamaha Corp Musical piece practice device and musical piece practice system
JP2008015388A (en) * 2006-07-10 2008-01-24 Dds:Kk Singing skill evaluation method and karaoke machine
JP2008026622A (en) * 2006-07-21 2008-02-07 Yamaha Corp Evaluation apparatus
JP4865607B2 (en) 2007-03-13 2012-02-01 ヤマハ株式会社 Karaoke apparatus, singing evaluation method and program
JP4910854B2 (en) 2007-04-17 2012-04-04 ヤマハ株式会社 Fist detection device, fist detection method and program
TWI394141B (en) * 2009-03-04 2013-04-21 Wen Hsin Lin Karaoke song accompaniment automatic scoring method
JP5244738B2 (en) * 2009-08-24 2013-07-24 株式会社エクシング Singing evaluation device, singing evaluation method, and computer program

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1173008A (en) * 1996-08-06 1998-02-11 雅马哈株式会社 Karaoke scoring apparatus analyzing singing voice relative to melody data
CN1178357A (en) * 1996-08-30 1998-04-08 雅马哈株式会社 Karaoke apparatus with individual scoring of duet singers
CN1423808A (en) * 2000-01-13 2003-06-11 雅马哈株式会社 Portable telephone and portable telephone system
CN1380642A (en) * 2001-04-11 2002-11-20 华邦电子股份有限公司 Single-following learning scoring device and method
JP2003058155A (en) * 2001-08-13 2003-02-28 Casio Comput Co Ltd Musical performance practicing device and program for musical performance practicing process
JP2005241848A (en) * 2004-02-25 2005-09-08 Daiichikosho Co Ltd Model vocal offer system of contribution work editing type in online karaoke system
JP2007271977A (en) * 2006-03-31 2007-10-18 Yamaha Corp Evaluation standard decision device, control method, and program
JP2008139426A (en) * 2006-11-30 2008-06-19 Yamaha Corp Data structure of data for evaluation, karaoke machine, and recording medium
JP2007334364A (en) * 2007-08-06 2007-12-27 Yamaha Corp Karaoke machine

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104392731A (en) * 2014-11-30 2015-03-04 陆俊 Singing practicing method and system
US10373213B2 (en) 2015-03-04 2019-08-06 International Business Machines Corporation Rapid cognitive mobile application review
CN105938429A (en) * 2015-03-04 2016-09-14 国际商业机器公司 Rapid cognitive mobile application review method and system
US10380657B2 (en) 2015-03-04 2019-08-13 International Business Machines Corporation Rapid cognitive mobile application review
CN106210941A (en) * 2015-07-15 2016-12-07 株式会社万代 Singing ability evaluating apparatus and storage device
CN109478399A (en) * 2016-07-22 2019-03-15 雅马哈株式会社 Play analysis method, automatic Playing method and automatic playing system
CN109804427A (en) * 2016-10-11 2019-05-24 雅马哈株式会社 It plays control method and plays control device
CN108665747A (en) * 2017-04-01 2018-10-16 上海伍韵钢琴有限公司 A kind of online piano training mate system and application method
CN110959172B (en) * 2017-07-25 2023-10-31 雅马哈株式会社 Performance analysis method, performance analysis device, and storage medium
CN110959172A (en) * 2017-07-25 2020-04-03 雅马哈株式会社 Musical performance analysis method and program
CN108694384A (en) * 2018-05-14 2018-10-23 芜湖岭上信息科技有限公司 A kind of viewer satisfaction investigation apparatus and method based on image and sound
CN109903778A (en) * 2019-01-08 2019-06-18 北京雷石天地电子技术有限公司 The method and system of real-time singing marking
CN109903778B (en) * 2019-01-08 2020-09-25 北京雷石天地电子技术有限公司 Method and system for scoring singing in real time
CN109887524A (en) * 2019-01-17 2019-06-14 深圳壹账通智能科技有限公司 A kind of singing marking method, device, computer equipment and storage medium
CN110120216A (en) * 2019-04-29 2019-08-13 北京小唱科技有限公司 For singing the audio data processing method and device of evaluation
CN110083772A (en) * 2019-04-29 2019-08-02 北京小唱科技有限公司 Singer's recommended method and device based on singing skills
CN112037609A (en) * 2020-08-26 2020-12-04 钮小静 Music teaching device based on thing networking

Also Published As

Publication number Publication date
TWI497484B (en) 2015-08-21
KR101666535B1 (en) 2016-10-14
TW201407602A (en) 2014-02-16
CN104170006B (en) 2017-05-17
JP5958041B2 (en) 2016-07-27
WO2013157602A1 (en) 2013-10-24
JP2013222140A (en) 2013-10-28
KR20140124843A (en) 2014-10-27

Similar Documents

Publication Publication Date Title
CN104170006A (en) Performance evaluation device, karaoke device, and server device
US9928835B1 (en) Systems and methods for determining content preferences based on vocal utterances and/or movement by a user
CN101313477A (en) Music generating device and operating method thereof
JP5799966B2 (en) Scoring device and program
JP6060867B2 (en) Information processing apparatus, data generation method, and program
KR101931087B1 (en) Method for providing a melody recording based on user humming melody and apparatus for the same
JP4163584B2 (en) Karaoke equipment
JP6288197B2 (en) Evaluation apparatus and program
JP6102076B2 (en) Evaluation device
JP2007140165A (en) Karaoke device and program for karaoke device
JP2019101148A (en) Communication karaoke system
JP4395493B2 (en) Karaoke equipment
JP2015060200A (en) Musical performance data file adjustment device, method, and program
JP6459162B2 (en) Performance data and audio data synchronization apparatus, method, and program
JP5994343B2 (en) Performance evaluation device and karaoke device
JP6365483B2 (en) Karaoke device, karaoke system, and program
JP2008040258A (en) Musical piece practice assisting device, dynamic time warping module, and program
JP6074835B2 (en) Music practice support device
JP6011506B2 (en) Information processing apparatus, data generation method, and program
JP6144593B2 (en) Singing scoring system
JP6144592B2 (en) Singing scoring system
JP5551983B2 (en) Karaoke performance control system
KR102077269B1 (en) Method for analyzing song and apparatus using the same
JP2015060177A (en) Musical performance data file retrieval method, system, program, terminal and server device
KR20110005653A (en) Data collection and distribution system, communication karaoke system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20170517

CF01 Termination of patent right due to non-payment of annual fee