JP2001128959A - Calorie consumption measuring device in musical performance - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a calorie consumption measuring device in musical perfor mance capable of measuring the calorie consumption by player's performance operation and singing. SOLUTION: Performance sounds (including singing voice) inputted from a microphone 10 are converted to performance information such as MIDI data by a converting part 11. According to the performance information, a computing part calculates the consumption calorie of the performance by operation on required calorie for generating the sound of that sound level and that sound intensity. The computed result is integrated by an integrating part 14, and an integrated value is displayed on a display part 15. Thus, the calorie consumption amount by the performance operation of a musical instrument and singing is integrated to be noticed to a player.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a performance calorie consumption measuring device capable of measuring a calorie consumption by a player's performance operation or singing action based on an input performance sound.

[0002]

2. Description of the Related Art The act of playing and singing a musical instrument uses a considerable amount of physical energy.
If you measure this energy consumption objectively, it can be an index of how much you practiced, and if you want to balance the performance of the instrument and the diet, how much calories are consumed by playing the instrument If you can find out, you can refer to it and proceed with your diet.

Conventionally, there has been no dedicated device for measuring the amount of calories consumed by playing a musical instrument. For example, if a pedometer for measuring the number of walking steps is attached to an arm and a keyboard instrument is played, it is not possible to measure the number of times of keying. It was not impossible.

[0004]

However, when the pedometer is attached to the arm, it is possible to measure only the number of times of keying, but not to measure the strength of keying, the pitch, etc. In addition, there has been a disadvantage that the operation other than the keying is detected and the accuracy is low. Further, a vibration sensor such as a pedometer can measure only some types of musical instruments such as keyboard instruments, and cannot measure calorie consumption of wind instruments and singing.

It is an object of the present invention to provide a performance calorie consumption measuring device capable of measuring a calorie consumption by a player's performance.

[0006]

According to a first aspect of the present invention, there is provided an input unit for inputting a performance sound, a performance information extracting unit for extracting performance information from the input performance sound, and a performance information extracting unit. Calculating means for calculating the calorie consumption by a performance operation for generating the performance sound.

In the present invention, the performance sound is a concept including a singing voice sung by a singer as well as a musical tone generated by playing a musical instrument. Therefore, in the karaoke apparatus, the singing voice sung along with the karaoke performance is also included in the performance sound of the present invention. The input means is generally realized by a microphone for inputting an audio signal, but may be constituted by a contact microphone (vibration sensor) for detecting vibration of a body of a stringed instrument or a frame of a piano. This input means inputs the performance sound and supplies it to the performance information extraction means. The performance information extracting means extracts performance information such as pitch and velocity (intensity information at note-on) from the performance sound. The calculating means calculates calories consumed (calorie consumption) in a performance operation for generating the performance sound based on the performance information extracted from the performance sound. The relationship between performance information and calorie consumption is, for example, in the case of a keyboard instrument, the greater the velocity, the greater the calorie consumption. The calorie consumption is calculated based on rules such as the larger the jump, the larger the calorie consumption. In addition, in the case of singing, in addition to the rules for the keyboard instrument, a rule is established that the higher the pitch, the larger the calorie consumption. Here, the calorie consumption generally represents the energy consumption by the player's performance operation, and the unit of calculation is calorie (Ca).
It is not limited to l). For example, it may be represented by the number of grams of food having the same calorie as joule or consumption.

According to a second aspect of the present invention, in the first aspect of the present invention, the calculating means includes a reference database storing calorie consumption corresponding to the performance information extracted by the performance information extracting means. The means is characterized in that the reference database is searched with the performance information extracted by the means to determine the calorie consumption.

In the present invention, the reference database stores not only the calorie consumption amount corresponding to one piece of performance information such as the intensity (velocity) of the performance operation, the pitch of the sound instructed to produce (pitch), but also the interval of the performance operation. It also stores the calorie consumption corresponding to multiple pieces of performance information such as pitches and pitch jumps. As described above, the calorie consumption corresponding to the performance information is as follows. As the velocity is higher, the calorie consumption is larger. The larger the calorie consumption, the higher the pitch, the greater the calorie consumption.
The reference database is a quantification of these rules. When the performance information is input from the performance information extracting means, the computing means searches the reference database with the performance information and determines the corresponding calorie consumption.

According to a third aspect of the present invention, in the second aspect, a plurality of the reference databases are provided corresponding to a plurality of types of musical instruments or singing, respectively, and one of the plurality of reference databases is selected. The information processing apparatus further comprises a selection unit that supplies the calculation unit.

In the present invention, the input means is constituted by a microphone or the like, and the player can freely input the performance sound of a musical instrument (including singing and singing: the same applies hereinafter) from the input means. Therefore, a reference database of a plurality of types of musical instruments and singing is stored in the storage unit, and one is selected according to the type of performance sound input from the input unit. Thus, even when the performance sound of any musical instrument is input, the calorie consumption in accordance with the sounding operation of the musical instrument can be accurately determined.

According to a fourth aspect of the present invention, in the second and third aspects of the invention, there is provided an integrating means for integrating the calorie consumption determined by the calculating means.

In the present invention, the operation of calculating the calorie consumption amount is performed every time the performance information is generated. By integrating the operations, it is possible to know how much calorie has been consumed during the performance of the music or the practice of the music. Can be.

According to a fifth aspect of the present invention, in accordance with the first to third aspects of the present invention, there is provided storage means for storing phrase calorie data describing a standard calorie consumption for each predetermined section of the song, and the arithmetic means comprises: It is a means for calculating the calorie consumption for each predetermined section of the music based on the performance information generated by the performance means, and outputting a result of comparison with the phrase calorie data.

In the present invention, the standard calorie consumption may be, for example, the calorie consumption when a skilled player normally plays, and the calculated actual calorie consumption and the standard calorie consumption are used. By outputting the result of comparison with the calorie consumption, it is possible to know how much the performer deviates from the standard level. That is, the performance can be evaluated based on the calorie consumption.

[0016]

FIG. 1 is a block diagram of a performance calorie consumption measuring device according to an embodiment of the present invention. This apparatus has a microphone 10 and inputs the performance sound of an instrument played by the player from the microphone 10 and measures how much calories the player has consumed to generate the performance sound. It is a device to do. And it is a device for integrating and displaying the calorie consumption. The sound input from the microphone 10 is not limited to the performance sound of the musical instrument, but may be a singing voice of a singer. In the description of this embodiment, it is assumed that the performing person includes the singing voice and the performing sound includes the singing voice. explain.

In FIG. 1, a performance sound signal input from the microphone 10 is input to a converter 11. Converter 11
Then, performance information is extracted from the performance sound signal. The conversion unit 11 includes a function unit that detects a volume and a frequency spectrum of a performance sound at a predetermined sampling cycle, and performs note-on (start of sound generation) based on the detected volume and a frequency spectrum.
Determines performance information such as note-off (silence), note pitch, and note-on velocity. This conversion unit 11 is, for example, a DSP (Digital SignalPrcss).
or). The determined performance information is input to the calculation unit 12. The calculation unit 12 searches the reference database with the performance information input from the conversion unit 11 to determine the calorie consumption. That is, the amount of calories consumed for generating the performance sound is determined. Reference database is storage unit 1
3, a plurality of types are stored. Each reference database corresponds to a different instrument (including singing). When a player inputs which instrument to play from the operation unit 16, the reference database corresponding to the instrument is calculated by the operation unit. It is set to 12. The calorie consumption value calculated by the calculating unit 12 is calculated by the integrating unit 14.
Is input to The accumulator 14 has a storage area such as a calorie consumption accumulation area, and accumulates the calorie consumption input from the calculator 12. This integrated value is displayed on the display unit 15.

Thus, when the player plays a tune or practices a musical instrument, it is possible to display on the display unit 15 how much calories have been consumed by the performance or practice. Although the integrated value of the integrating unit 14 is only displayed on the display unit 15 in this embodiment, an output interface may be provided so that the integrated value can be externally output as data.

The calorie consumption accumulation area is reset (cleared) by operating the operation unit 16. The operation unit 16 includes a musical instrument selection switch and a calorie consumption integrated area clear switch corresponding to the selecting means of the present invention for selecting the musical instrument. When the calorie consumption accumulation area clear switch is turned on, the calorie consumption accumulation area is cleared at that point and the display on the display unit 15 is reset. When a new musical instrument is selected by the musical instrument selection switch, the calorie consumption accumulation area up to that point is similarly cleared and the display on the display unit 15 is reset. The calorie consumption accumulation area may not be cleared even when a new musical instrument is selected by the musical instrument selection switch.

The arithmetic unit 12 and the integrating unit 14 can be constituted by hardware circuits, but can also be constituted by software using a CPU and a memory. Further, as the microphone 10 corresponding to the input means of the present invention, a contact microphone used for pickup of a guitar or an electromagnetic microphone of an electric guitar may be used instead of a general microphone. The contact microphone can be attached to the body of the musical instrument or the frame of the piano to cancel external noise and detect only the sound of the musical instrument. Also,
When picking up a singer's song, a bone conduction microphone may be used.

FIG. 2A is a diagram showing a configuration example of the reference database. In this embodiment, the reference database is a performance calorie consumption database. A plurality of performance calorie consumption databases are stored in the storage unit 13 corresponding to the types of musical instruments. One of them is shown in FIG. This database stores, based on performance information, calories consumed by a player by a performance operation for generating the performance information, and a note-on including pitch information as a performance mode for calculating the calorie consumption. Information, note-off information, and other independent performance information, as well as the pitch spacing between two notes,
A performance mode including a plurality of performance information such as a note-on interval and a frequency (the number of note-on per unit time) is stored, and when a player plays in the performance mode corresponding to each performance mode. The calorie consumption that will be consumed is stored.

The calorie consumption may be stored as a specific numerical value, or may be stored as a function. For example, at the time of sound generation, since the calorie consumption differs depending on the pitch and velocity, it is stored as a function using the pitch and velocity as variables. The pitch interval is stored as a function using the interval (the number of semitones) as a variable. The sounding interval is stored as a function using the time between two consecutive sounds as a variable. The frequency of pronunciation is stored as a function using the number of pronunciations per unit time as a variable. These functions are such that the larger the velocity, the larger the calorie consumption, the higher the pitch, the larger the calorie consumption, the larger the interval (jump) between two consecutive pitches, the larger the calorie consumption, A function that stores a function such as a rule that the calorie consumption is larger as the sound interval is shorter and the calorie consumption is larger as the number of times of sounding per unit time is larger is stored.

It should be noted that the calorie consumption may be obtained by sampling the actual calorie consumption at that time by causing a skilled player to actually perform.

FIG. 3 is a flowchart showing the operation of the performance calorie consumption measuring device. FIG. 7A is a flowchart showing the operation in the normal performance mode. When a player inputs a performance sound from the microphone 10 (s1), the conversion unit 11 extracts performance information from the performance sound (s2).
Then, by searching the performance calorie consumption database with the performance information (and the performance information before that), the corresponding calorie consumption is read out (that is, the corresponding function is read out and this function is calculated by a given variable). Then, the calorie consumption by the performance operation is calculated (s3). The calculated calorie consumption is integrated into the accumulator 1
The total is accumulated in the calorie consumption accumulation area of No. 4 (s4). Then, the display of the calorie consumption on the display unit 15 is updated (s
5) Return to s1. The display unit 15 may display the integrated value accumulated in the calorie consumption accumulation area, and may display the instantaneous value of the calorie consumption by the performance operation each time the performance information is input.

FIG. 2B is a flowchart showing the operation when the musical instrument selection switch of the operation unit 16 is operated. When the musical instrument selection switch of the operation unit 16 is operated to select a musical instrument (s6), a performance calorie consumption database corresponding to the musical instrument is selected and set in the calculation unit 12 (s7). Then, the performance calorie consumption accumulation area is reset (s8), and the display on the display unit 15 is updated to 0 (s9).

FIG. 3C is a flowchart showing the operation when the reset switch is turned on. When the reset switch 16a is turned on (s10), the performance calorie consumption integration area is reset (s11), and the display of the integrated value on the display unit 17 is changed to 0 (s12).

FIG. 4 is a block diagram of a karaoke apparatus incorporating the above-mentioned performance calorie consumption measuring apparatus. In this figure, the same components as those of the performance calorie consumption measuring device of FIG. This karaoke apparatus plays a karaoke song in the same manner as a normal karaoke apparatus, and inputs a singing voice of a singer from a microphone 10, mixes them, and outputs them from a speaker.
Further, the karaoke apparatus converts the singing voice input from the microphone 10 into performance information, scores a pitch (pitch), a pitch, and a timing based on the performance information, and calculates the calorie consumption of the singing. Measure. Further, by comparing the calorie consumption with the standard calorie consumption stored together with the song data of the karaoke song, the skill of the singing is determined based on the calorie consumption.

Here, the configuration of the music data stored in the storage 21 will be described with reference to FIG.
The music data shown in the figure is stored in the storage unit 21 of the karaoke apparatus. The song data includes a performance data track for performing karaoke songs, a phrase calorie track in which standard calorie consumption for each phrase by singing is written, a lyrics track in which lyrics display data for displaying lyrics are written, It is composed of a control track or the like in which phrase mark data or the like indicating a phrase break is written.

The performance data track is a track in which sequence data for so-called automatic performance is written, and includes a track of a plurality of musical instrument parts, a guide melody track for generating a guide melody for karaoke singing, and the like. Each track is composed of event data such as key-on / key-off and timing data indicating the timing of each event data. The key-on data and the key-off data include velocity information and pitch information. The event data of the control track is
This is phrase mark data indicating a break between phrases of a song.

The phrase calorie track stores standard calorie data for each phrase in the order of the phrases. A phrase is a section divided by the phrase mark data. The standard calorie data is data indicating the standard calorie consumption for each phrase, and indicates the calories consumed in the performance of this section when a skilled player plays this song. The standard calorie data of the phrase calorie track may be obtained by sampling the actual calorie consumption at that time by causing a skilled player to actually perform.

In FIG. 4, the storage 21 stores a plurality of music data. The control unit 20 includes the operation unit 2
One piece of music data is selected in accordance with the operation 2 and read out from the storage 21 and supplied to the sound source 23. The storage 21 can be composed of, for example, a DVD, a CD, a hard disk, or the like. The operation unit 22 may be constituted by a group of switches provided on a panel of the apparatus, or may be constituted by a remote controller communicating with infrared rays or the like. The sound source 23 generates a musical tone according to the music data supplied from the control unit 20. The musical sound of the karaoke tune generated by the sound source 23 is input to the mixing amplifier 24. A singing voice of a karaoke song is input from the microphone 10, and the singing voice is also input to the mixing amplifier 24. Mixing amplifier 24
Mixes the input musical sound and the singing voice and outputs the result from the speaker 25.

On the other hand, the control unit 20 transmits the music data to the sound source 23
In parallel with the supply to the lyrics section, the lyrics telop is pattern-expanded based on the lyrics display data of the lyrics track and displayed on the display unit 3.
2 as well as guide melody track data and phrase calorie data. In the karaoke apparatus, the voice input from the microphone 10 is determined to be a singing voice.
The reference database used by 0 only needs to be used for singing, and may be incorporated in the arithmetic unit 30.

The singing voice input from the microphone 10 is input to the mixing amplifier 24 and the
, And is converted into performance information in the conversion unit 11. This performance information is input to the arithmetic unit 30. The calculation unit 30 compares the input performance information with the data of the guide melody track, determines the accuracy of the pitch, volume and timing of the singing, calculates points, and performs singing based on the performance information. Calculate calorie consumption. Then, the calculated calorie consumption is compared with the phrase calorie data, the skill of the singing is determined based on the degree of coincidence, and points are calculated. The two types of points calculated in this way are input to the accumulating unit 31 and accumulated and stored. When the music is completed, the total points obtained by adding these points are displayed on the display unit 32 as points. In addition to the score, the display unit 32 displays a screen of lyrics + background video during the performance of the song, and inputs and displays the instantaneous points and calorie consumption at each predetermined timing from the calculation unit 30.

In this embodiment, the conversion unit 11
Can be constituted by a DSP, the control unit 20, the arithmetic unit 3
0, the integrating unit 31 can be realized by a computer and software of a CPU and a memory.

FIGS. 5 and 6 are flowcharts showing the operation of the karaoke apparatus with the singing calorie consumption measuring apparatus. FIG. 5 is a flowchart showing the switch operation.
When the music selection switch of the operation unit 22 is operated (s13),
The control unit 20 reads out the music data corresponding to the music selection operation from the storage 21 (s14), clears the singing calorie consumption accumulation area, the point accumulation area, and the like (s15), and starts playing the karaoke music ( s1
6). The performance of a karaoke song is an operation of outputting event data of each track to a corresponding function unit in accordance with the timing data.

FIG. 6 is a flowchart showing a scoring operation during a performance. When a singing voice is input from the microphone 10 (s21), the singing voice is converted into performance information (s2).
2). This performance information is buffered in the temporary storage memory (s23). Then, the event data generated this time is compared with the data of the guide melody track (s2
4), determine the point of singing accuracy (s25).
The points are accumulated and stored in the point storage area of the accumulating unit 31 (s26).

The search for the event data corresponding to the performance information is made on the basis of the place where the performance is currently performed on the guide melody track. However, not only the performance information this time but also the performance information generated so far is comprehensively determined. To decide. When the corresponding event data is searched,
The event data may be compared with the performance information generated this time, and the points may be calculated by evaluating the pitch match / mismatch, the velocity match degree, the timing shift, and the like.

Next, the performance calorie consumption database is searched with the performance information (and performance information before that),
By reading out the corresponding calorie consumption, that is, by reading out the corresponding function and calculating this function with the given variable, the calorie consumption by the performance operation is calculated (s26). The calculated calorie consumption is accumulated in the phrase calorie consumption accumulation area of the accumulation unit 31 (s27). The operations of s21 to s27 are repeatedly executed until the end of the phrase or the end of the music (s28).

When the phrase mark data is read to determine that it is a phrase break, (s
28) The calorie consumption of the phrase that has just been completed is displayed on the display unit 32 (s30), and standard calorie data corresponding to the phrase is read from the phrase calorie track (s31), and the integrated calorie consumption and the standard calorie data are read. The points are compared with the calorie data, and points are calculated based on the comparison result (s32). That is,
Points are calculated based on the rule that the higher the proficiency level, the more the player's calorie consumption approaches the standard calorie data.
That is, here, the calorie consumption is used for evaluation of the performance operation which is comprehensively determined from the strength of the keying and the like.
Then, the calculated points are accumulated in the point accumulation area (s33). The points may be added together with the points calculated based on the degree of coincidence between the performance information and the event data, or may be added separately. Then, the calorie consumption of this phrase is transferred to the calorie consumption accumulation area for accumulating the calorie consumption of the entire song,
After clearing the phrase calorie consumption accumulation area (s34), the process returns to s21.

On the other hand, when the end of the music is determined based on the input of the performance information or the end of the music data (s35), first, the phrase processing is executed (s36). This phrase processing is executed at the end of the phrase.
The processing is the same as that of s34. Thereafter, the total calorie consumption amount accumulated in the calorie consumption accumulation area is displayed (s37), the points accumulated in the point accumulation area are displayed as a total score (s38), and the operation is terminated.

As described above, in the karaoke apparatus, when the singer sings into the microphone 10, it is possible to determine how well the singer has sung the song based on the pitch, volume and timing. It is possible to measure and display how much calories are consumed by playing. In addition, since the standard calorie consumption is stored for each phrase, and this is compared with the actual consumption, it is possible to more accurately determine not only the skill but also the skill of the performance.

In the above embodiment, the integrated value of the calorie consumption is only displayed by a numerical value. However, when the integrated value reaches a predetermined value, a character or the like is displayed so that the predetermined value is reached. I can clearly understand this and encourage my players. Further, the instantaneous value and the integrated value of the calorie consumption may be displayed as a graph instead of a numerical value.

Further, the integrated value of the calorie consumption may be graphically displayed in association with the food actually having the calorie.

[0044]

As described above, according to the present invention, it is possible to know how much calories a player (singer) has consumed by performing a performance (singing), so that he can know the degree of musical instrument practice. It is possible to balance the practice of the instrument and the diet. In addition, even if there is a feeling of fatigue due to the practice, the calorie consumption can be objectively understood, so that satisfaction can be obtained.

[Brief description of the drawings]

FIG. 1 is a block diagram of a performance calorie consumption measuring device according to an embodiment of the present invention;

FIG. 2 is a diagram showing a configuration of a performance calorie consumption database and music data of the electronic musical instrument.

FIG. 3 is a flowchart showing the operation of the electronic musical instrument.

FIG. 4 is a block diagram of a karaoke device with a singing calorie consumption measuring device according to another embodiment of the present invention;

FIG. 5 is a flowchart showing the operation of the karaoke apparatus.

FIG. 6 is a flowchart showing the operation of the karaoke apparatus.

[Explanation of symbols]

Reference Signs List 10 microphone, 11 conversion unit, 12 calculation unit, 13 storage unit, 14 accumulation unit, 15 display unit, 16 operation unit, 2
0: control unit, 21: storage, 22: operation unit, 23:
Sound source, 24: mixing amplifier, 25: speaker, 30
... Calculator, 31 ... Integrator, 32 ... Display

Claims (5)

[Claims] An input unit for inputting a performance sound; a performance information extracting unit for extracting performance information from the input performance sound; and a calorie consumption for generating the performance sound based on the extracted performance information. A calculation device for calculating the amount, and a performance calorie consumption measuring device comprising: 2. A reference database storing a calorie consumption amount corresponding to performance information extracted by the performance information extracting means, wherein the calculating means searches the reference database with the extracted performance information to calculate calories. The performance calorie consumption measuring device according to claim 1, wherein the consumption is calculated. 3. A plurality of reference databases corresponding to a plurality of types of musical instruments or singing, respectively, and a selection means for selecting one of the plurality of reference databases and supplying the selected reference database to the arithmetic means. Item 3. A performance calorie consumption measuring device according to item 2. 4. An integrating means for integrating the calorie consumption determined by said calculating means.
2. The performance calorie consumption measuring device according to 1. 5. A storage means for storing phrase calorie data, which is a standard calorie consumption amount for each predetermined section of a specific song, wherein said calculating means is based on performance information extracted by said performance information extracting means. 5. A means for calculating a calorie consumption amount for each predetermined section of the specific song and outputting a result of comparison with the phrase calorie data.
The performance calorie consumption measuring device according to any one of the above.