JP4232299B2 - Performance calorie consumption measuring device - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a performance calorie consumption measuring apparatus capable of measuring a calorie consumption due to a player's performance operation or singing action based on an input performance sound.
[0002]
[Prior art]
The act of playing an instrument or singing uses a considerable amount of physical energy. Objectively measuring this energy consumption can be an indicator of how much you have practiced, and for those who want to balance playing instrument and diet, how much calorie is consumed by playing instrument If you know that, you can go on a diet referring to that.
[0003]
Conventionally, there was no dedicated device to measure calorie consumption by playing musical instruments, but it is impossible to measure the number of keystrokes if you play a keyboard instrument with a pedometer that measures the number of steps taken, for example, on your arm There wasn't.
[0004]
[Problems to be solved by the invention]
However, with the above pedometer on the arm, it is only possible to measure the number of keystrokes, not to measure the strength or pitch of the keystrokes, and to detect actions other than keystrokes. There was a drawback that it was not accurate. In addition, a vibration sensor such as a pedometer can measure only some types of musical instruments such as keyboard instruments, and cannot measure the calorie consumption of wind instruments and singing.
[0005]
An object of this invention is to provide the performance calorie consumption measuring apparatus which can measure the calorie consumption by the performance action of a performer.
[0006]
[Means for Solving the Problems]
According to the first aspect of the present invention, there is provided input means for inputting a performance sound, and the input performance sound. According to Performance information extracting means for extracting performance information, and calculation means for calculating a calorie consumption amount for generating the performance sound based on the extracted performance information are provided.
[0007]
In the present invention, the performance sound is a concept including a singing voice sung by a singer, as well as a musical sound generated by the performance of an instrument. Therefore, in the karaoke apparatus, the singing voice sung in accordance with the karaoke performance is also included in the performance sound of the present invention. The input means is generally realized by a microphone for inputting an audio signal, but can also be constituted by a contact microphone (vibration sensor) for detecting vibration of a stringed instrument body or a piano frame. This input means inputs the performance sound and supplies it to the performance information extraction means. The performance information extracting means extracts performance information such as pitch and velocity (intensity information at the time of note-on) from the performance sound. The calculation means calculates the calories (calorie consumption) consumed by the performance operation for generating the performance sound based on the performance information extracted from the performance sound. The relationship between performance information and calorie consumption is, for example, in the case of keyboard instruments, the greater the velocity, the greater the calorie consumption, and the shorter the keystroke interval, the greater the calorie consumption, even with the same number of keystrokes. Calorie consumption is calculated based on a rule such that the greater the jump, the greater the calorie consumption. In the case of singing, in addition to the rules for the keyboard instrument, a rule is established that the higher the pitch, the greater the calorie consumption. Here, the calorie consumption generally represents the energy consumption by the performance operation of the performer, and the unit of calculation is not limited to calories (Cal). For example, it may be expressed by the number of grams of food having joules or calories equivalent to consumption.
[0008]
According to a second aspect of the present invention, in the first aspect of the invention, the calculation means includes a reference database storing calorie consumption corresponding to the performance information extracted by the performance information extraction means, and the performance information extraction means extracts the performance information. The reference database is searched with the performance information, and calorie consumption is determined.
[0009]
In the present invention, the reference database includes the interval of the performance operation and the pitch in addition to the calorie consumption corresponding to one piece of performance information such as the strength (velocity) of the performance operation and the pitch (pitch) of the sound instruction. The calorie consumption corresponding to a plurality of pieces of performance information such as jumps is also stored. As described above, the calorie consumption corresponding to this performance information is such that the greater the velocity, the greater the calorie consumption, and the shorter the keystroke interval, the greater the calorie consumption, even with the same number of keystrokes. The larger the calorie consumption, the larger the calorie consumption, and the higher the pitch, the greater the calorie consumption. The reference database is a quantification of these rules. When performance information is input from the performance information extraction means, the calculation means searches the reference database with this performance information and calculates the corresponding calorie consumption.
[0010]
The invention according to claim 3 is the invention according to claim 2, wherein a plurality of the reference databases are provided corresponding to each of a plurality of types of musical instruments or singing, and one of the plurality of reference databases is selected and the computing means is selected. It is characterized by comprising selection means for supplying to the device.
[0011]
In the present invention, the input means is composed of a microphone or the like, and what kind of musical instrument (including singing singing: the same applies hereinafter) to which the performer inputs the performance sound from the input means is arbitrary. Therefore, a plurality of types of musical instruments and singing reference databases are stored in the storage unit, and one is selected according to the type of performance sound input from the input unit. This makes it possible to accurately calculate the calorie consumption in accordance with the sounding operation of any musical instrument, regardless of the musical instrument's performance sound.
[0012]
According to a fourth aspect of the present invention, in the second or third aspect of the present invention, the apparatus further comprises an integrating unit that integrates the calorie consumption determined by the calculating unit.
[0013]
In the present invention, an operation of calculating the calorie consumption is executed every time performance information is generated. By accumulating these, it is possible to know how much calories are consumed through the performance of the music or the practice of the music.
[0014]
The invention of claim 5 comprises the storage means storing phrase calorie data describing the standard calorie consumption for each predetermined section of the music in the inventions of claims 1 to 3, wherein the computing means is the performance means The calorie consumption for each predetermined section of the music is calculated based on the performance information in which the music is generated, and a comparison result with the phrase calorie data is output.
[0015]
In the present invention, the standard calorie consumption can be, for example, the calorie consumption when a skilled performer performs normally, and the actual calorie consumption calculated and the standard calorie consumption. By outputting the comparison result with the amount, it is possible to know how much the performer deviates from the standard level. That is, the performance can be evaluated based on the calorie consumption.
[0016]
DETAILED DESCRIPTION OF THE INVENTION
FIG. 1 is a block diagram of a performance calorie consumption measuring apparatus according to an embodiment of the present invention. This apparatus is provided with a microphone 10, and the performance sound of the musical instrument performed by the performer is input from the microphone 10, and the calorie consumed by the performer to generate the performance sound is measured. It is a device to do. And it is an apparatus which displays the calorie consumption by integration. The sound input from the microphone 10 is not limited to the performance sound of the musical instrument, but may be a singer's singing sound. However, in the description of this embodiment, it is assumed that the player includes the singer and the performance sound includes the singing sound. explain.
[0017]
In the figure, the performance sound signal input from the microphone 10 is input to the converter 11. The conversion unit 11 extracts performance information from the performance sound signal. The conversion unit 11 includes a function unit that detects the volume and frequency spectrum of the performance sound at a predetermined sampling period, and based on the detected volume and frequency spectrum, note-on (sounding start), note-off (mute), and sounding sound Determining performance information such as high and velocity at note-on. The conversion unit 11 can be configured by, for example, a DSP (Digital Signal Prcsors). The calculated performance information is input to the calculation unit 12. The calculation unit 12 searches the reference database with the performance information input from the conversion unit 11 to determine the calorie consumption. That is, how many calories are consumed to generate the performance sound is determined. A plurality of types of reference databases are stored in the storage unit 13. Each reference database corresponds to a different musical instrument (including singing), and when the performer inputs which musical instrument to play from the operation unit 16, the reference database corresponding to the musical instrument is calculated by the arithmetic unit. 12 is set. The calorie consumption value calculated by the calculation unit 12 is input to the integration unit 14. The integration unit 14 has a storage area such as a calorie consumption integration area, and integrates the calorie consumption input from the calculation unit 12. This integrated value is displayed on the display unit 15.
[0018]
Thus, when the performer performs a song or practices a musical instrument, the display unit 15 can display how much calories have been consumed by the performance or practice. In this embodiment, the integrated value of the integrating unit 14 is only displayed on the display unit 15, but an output interface may be provided so that it can be output to the outside as data.
[0019]
The calorie consumption integration area is reset (cleared) by operating the operation unit 16. The operation unit 16 includes a musical instrument selection switch and a calorie consumption integration area clear switch corresponding to the selection means of the present invention for selecting the musical instrument. When the calorie consumption integration area clear switch is turned on, the calorie consumption integration area is cleared at that time, and the display on the display unit 15 is reset. When a new musical instrument is selected with the musical instrument selection switch, the previous calorie consumption integration area is cleared and the display on the display unit 15 is reset. The calorie consumption integration area may not be cleared even when a new instrument is selected by the instrument selection switch.
[0020]
The arithmetic unit 12 and the integrating unit 14 can be configured by a hardware circuit, but can also be configured by software using a CPU and a memory. The microphone 10 corresponding to the input means of the present invention may be a contact microphone used for guitar pickup or the like, or an electromagnetic guitar electromagnetic microphone instead of a general microphone. The contact microphone can be attached to the body of a musical instrument or a piano frame to cancel external noise and detect only the sound of the musical instrument. Moreover, when picking up a song of a singer, a bone conduction microphone may be used.
[0021]
FIG. 2A is a diagram illustrating a configuration example of the reference database. In this embodiment, the reference database is a performance calorie consumption database. A plurality of performance calorie consumption databases are stored in the storage unit 13 corresponding to the types of musical instruments. One of them is shown in FIG. This database stores the calories consumed by the performer by the performance operation for generating the performance information based on the performance information, and note-on information including pitch information as a performance mode for determining the calorie consumption. In addition to single performance information such as information and note-off information, a performance mode consisting of a plurality of performance information such as pitch interval between two sounds, note-on interval and frequency (note-on count per unit time) is stored. Corresponding to each performance mode, a calorie consumption amount that will be consumed when the performer performs in the performance mode is stored.
[0022]
The calorie consumption may be stored as a specific numerical value, but may be stored as a function. For example, at the time of pronunciation, since the calorie consumption varies depending on the pitch and velocity, it is stored as a function with the pitch and velocity as variables. The pitch interval is stored as a function with the interval (number of semitones) as a variable. The pronunciation interval is stored as a function with the time between two consecutive sounds as a variable. The pronunciation frequency is stored as a function with the number of pronunciations per unit time as a variable. In these functions, the calorie consumption increases as the velocity increases, the calorie consumption increases as the pitch increases, and the calorie consumption increases as the interval between two consecutive pitches (jump) increases. It stores a functionalized rule such that the calorie consumption is larger as the sound interval is shorter, and the calorie consumption is larger as the number of pronunciations per unit time is larger.
[0023]
The calorie consumption may be a value obtained by actually playing a skilled player and sampling the actual calorie consumption at that time.
[0024]
FIG. 3 is a flowchart showing the operation of the performance calorie consumption measuring apparatus. FIG. 2A is a flowchart showing the operation in the normal performance mode. When the performer inputs a performance sound from the microphone 10 (s1), the conversion unit 11 extracts performance information from the performance sound (s2). Then, the performance calorie consumption database is searched with this performance information (and previous performance information), and the corresponding calorie consumption is read (that is, the corresponding function is read and this function is calculated with the given variables). The calorie consumption by the performance operation is calculated (s3). The calculated calorie consumption is integrated in the calorie consumption integration area of the integration unit 14 (s4). And the display of the calorie consumption of the display part 15 is updated (s5), and it returns to s1. The display unit 15 may display an integrated value integrated in the calorie consumption integration area, and may display an instantaneous value of the calorie consumption by the performance operation every time performance information is input.
[0025]
FIG. 5B is a flowchart showing the operation when the instrument selection switch of the operation unit 16 is operated. When a musical instrument selection switch of the operation unit 16 is operated to select a musical instrument (s6), a performance calorie consumption database corresponding to this musical instrument is selected and set in the calculation unit 12 (s7). Then, the performance calorie consumption accumulation area is reset (s8), and the display on the display unit 15 is updated to 0 (s9).
[0026]
FIG. 3C is a flowchart showing the operation when the reset switch is turned on. When the reset switch 16a is turned on (s10), the performance calorie consumption integration area is reset (s11), and the display of the integrated value on the display unit 17 is changed to 0 (s12).
[0027]
FIG. 4 is a block diagram of a karaoke apparatus incorporating the performance calorie consumption measuring apparatus. In this figure, the same components as those in the performance calorie consumption measuring apparatus in FIG. This karaoke apparatus plays karaoke music like a normal karaoke apparatus, inputs the singing voice of the singer from the microphone 10, mixes them, and outputs them from the speaker. Furthermore, this karaoke device converts the singing voice input from the microphone 10 into performance information, and scores the pitch (pitch), pitch, and timing based on this performance information, and calculates the calorie consumption of this singing. taking measurement. Furthermore, the skill of singing is determined based on the calorie consumption by comparing this calorie consumption with the standard calorie consumption stored together with the song data of the karaoke song.
[0028]
Here, with reference to FIG. 2 (B), the composition of the song data stored in the storage 21 will be described. The song data shown in the figure is stored in the storage unit 21 of the karaoke apparatus. The song data includes a performance data track for playing karaoke songs, a phrase calorie track in which standard calorie consumption for each phrase by singing is written, a lyrics track in which lyrics display data for displaying lyrics is written, It consists of a control track in which phrase mark data indicating phrase delimiters is written.
[0029]
The performance data track is a track in which sequence data for so-called automatic performance is written, and includes a track for a plurality of instrument parts, a guide melody track for generating a guide melody for karaoke singing, and the like. Each track includes event data such as key-on and key-off, and timing data indicating the timing of each event data. The key-on data and key-off data include velocity information and pitch information. Further, the event data of the control track is phrase mark data indicating a break of a song phrase.
[0030]
The phrase calorie track stores standard calorie data for each phrase in phrase order. A phrase is a section delimited by the phrase mark data. The standard calorie data is data indicating a standard calorie consumption amount in each phrase, and indicates a calorie consumed by the performance of this section when a skilled player plays this song. Note that the standard calorie data of the phrase calorie track may be obtained by actually playing a skilled player and sampling the actual calorie consumption at that time.
[0031]
In FIG. 4, the storage 21 stores a plurality of song data. The control unit 20 selects one piece of music data according to the operation of the operation unit 22, reads this from the storage 21, and supplies it to the sound source 23. The storage 21 can be composed of, for example, a DVD, CD, hard disk or the like. The operation unit 22 may be composed of a switch group provided on the panel of the apparatus, or may be composed of a remote controller that communicates with infrared rays or the like. The sound source 23 generates a musical sound according to the music data supplied from the control unit 20. The musical tone of the karaoke song generated by the sound source 23 is input to the mixing amplifier 24. Further, the singing voice of the karaoke song is input from the microphone 10, and this singing voice is also input to the mixing amplifier 24. The mixing amplifier 24 mixes the input musical sound and singing voice and outputs them from the speaker 25.
[0032]
On the other hand, in parallel with supplying the song data to the sound source 23, the control unit 20 develops a pattern of lyrics telop based on the lyrics display data of the lyrics track and supplies it to the display unit 32, and also guides the calculation unit 30. Provides melody track data and phrase calorie data. In the karaoke apparatus, since the voice input from the microphone 10 is determined to be the singing voice, the reference database used by the calculation unit 30 may be only for singing. Good.
[0033]
The singing voice input from the microphone 10 is input to the mixing amplifier 24 and input to the conversion unit 11, and is converted into performance information by the conversion unit 11. The performance information is input to the arithmetic unit 30. The calculation unit 30 compares the input performance information with the data of the guide melody track, determines the accuracy of the singing pitch, volume, and timing to calculate points, and based on the performance information, Calculate calorie consumption. Then, the calculated calorie consumption is compared with the phrase calorie data, the skill of singing is determined based on the degree of coincidence, and points are determined. The two types of points calculated in this way are input to the integration unit 31 and stored, and when the music is finished, a total point obtained by adding them is displayed on the display unit 32 as a score. In addition to this score, the display unit 32 displays a screen of lyrics + background video during the performance of the song, and inputs and displays instantaneous points and calorie consumption at every predetermined timing from the calculation unit 30.
[0034]
In this embodiment, the conversion unit 11 can be configured by a DSP, and the control unit 20, the calculation unit 30, and the integration unit 31 can be realized by a CPU and a memory computer and software.
[0035]
5 and 6 are flowcharts showing the operation of the karaoke apparatus with the singing calorie consumption measuring apparatus. FIG. 5 is a flowchart showing the switch operation. When the song selection switch of the operation unit 22 is operated (s13), the control unit 20 reads the song data corresponding to the song selection operation from the storage 21 (s14), and displays the singing calorie consumption accumulation area, the point accumulation area, and the like. After clearing (s15), the performance of the karaoke song is started (s16). The performance of the karaoke song is an operation of outputting event data of each track to a corresponding functional unit in accordance with the timing data.
[0036]
FIG. 6 is a flowchart showing the scoring operation during performance. When a singing voice is input from the microphone 10 (s21), the singing voice is converted into performance information (s22). The performance information is buffered in the temporary storage memory (s23). Then, the event data generated this time is compared with the data of the guide melody track (s24), and the point of singing accuracy is determined (s25). The points are accumulated and stored in the point storage area of the accumulation unit 31 (s26).
[0037]
The search for the event data corresponding to the performance information is based on the current performance location on the guide melody track, but it is determined by comprehensively determining not only the current performance information but also the performance information generated so far. To do. When the corresponding event data is searched, the event data is compared with the performance information generated this time, and points are calculated by evaluating pitch match / mismatch, velocity match, timing shift, etc. That's fine.
[0038]
Next, the performance calorie consumption database is searched with this performance information (and previous performance information), and the corresponding calorie consumption is read out, that is, the corresponding function is read and this function is calculated with the given variable. As a result, the calorie consumption by the performance operation is calculated (s26). The calculated calorie consumption is integrated in the phrase calorie consumption integration area of the integration unit 31 (s27). The operations from s21 to s27 are repeated until the phrase is separated or the song is finished (s28).
[0039]
When it is determined that the phrase is separated by reading the phrase mark data (s28), the calorie consumption of the phrase just completed is displayed on the display unit 32 (s30), and the standard calorie corresponding to this phrase is displayed. Data is read from the phrase calorie track (s31), the accumulated calorie consumption is compared with the standard calorie data, and points are calculated based on the comparison result (s32). That is, the points are calculated based on the rule that the higher the proficiency level is, the closer the player's calorie consumption is to the standard calorie data. That is, here, the calorie consumption is used for evaluation of a performance action comprehensively determined from the strength of keystrokes and the like. Then, the calculated points are integrated in the point integration area (s33). This point may be accumulated together with the points calculated based on the degree of coincidence between the performance information and the event data, or may be accumulated separately. Then, the calorie consumption of this phrase is transferred to the calorie consumption integration area for integrating the calorie consumption of the entire song, and after the phrase calorie consumption integration area is cleared (s34), the process returns to s21.
[0040]
On the other hand, if the end of the song is determined by the end of the input performance information or song data (s35), the phrase processing is first executed (s36). This phrase process is a process executed at the end of the phrase, and is the same process as s30 to s34. After that, the total calorie consumption accumulated in the calorie consumption accumulation area is displayed (s37), the points accumulated in the point accumulation area are displayed as a total score (s38), and the operation is terminated.
[0041]
Thus, in this karaoke apparatus, if a singer sings into the microphone 10, it can be judged how well the song was sung based on the pitch, volume, and timing, and the calorie can be determined by the performance. It is possible to measure and display how much is consumed. Further, since the standard calorie consumption is stored for each phrase and compared with the actual consumption, it is possible to judge not only the skill but also the skill of the performance more accurately.
[0042]
In the above embodiment, the integrated value of calorie consumption is only displayed as a numerical value. However, when the integrated value reaches a predetermined value, it is clear that the character has reached the predetermined value by displaying a character or the like. I can understand and encourage the performers. Further, the instantaneous value and integrated value of the calorie consumption may be displayed as a graph instead of a numerical value.
[0043]
Further, the integrated value of the calorie consumption may be displayed graphically in correspondence with food having actually that many calories.
[0044]
【The invention's effect】
As described above, according to the present invention, since the player (singer) can know how much calories are consumed by the performance operation (singing), it is possible to know the degree of practice of the instrument with it, It is also possible to balance the practice of the instrument and the diet. Also, even if you feel fatigue due to practice, you can get a sense of satisfaction because you know the calorie consumption objectively.
[Brief description of the drawings]
FIG. 1 is a block diagram of a performance calorie consumption measuring apparatus according to an embodiment of the present invention.
FIG. 2 is a diagram showing a configuration of a performance calorie consumption database and song data of the electronic musical instrument
FIG. 3 is a flowchart showing the operation of the electronic musical instrument.
FIG. 4 is a block diagram of a karaoke apparatus with a singing calorie consumption measuring apparatus according to another embodiment of the present invention.
FIG. 5 is a flowchart showing the operation of the karaoke apparatus.
FIG. 6 is a flowchart showing the operation of the karaoke apparatus.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 10 ... Microphone, 11 ... Conversion part, 12 ... Calculation part, 13 ... Memory | storage part, 14 ... Accumulation part, 15 ... Display part, 16 ... Operation part,
DESCRIPTION OF SYMBOLS 20 ... Control part, 21 ... Storage, 22 ... Operation part, 23 ... Sound source, 24 ... Mixing amplifier, 25 ... Speaker, 30 ... Calculation part, 31 ... Integration part, 32 ... Display part

Claims (5)

Input means for inputting performance sound;
Performance information extracting means for extracting performance information corresponding to the input performance sound;
A calculation means for calculating a calorie consumption for generating the performance sound based on the extracted performance information;
Performance calorie consumption measuring device equipped with. A reference database storing calorie consumption corresponding to the performance information extracted by the performance information extraction means;
The performance calorie consumption measuring device according to claim 1, wherein the calculation means calculates the calorie consumption by searching the reference database with the extracted performance information. A plurality of the reference databases corresponding to each of a plurality of types of instruments or singing,
3. The performance calorie consumption measuring apparatus according to claim 2, further comprising a selection unit that selects one of the plurality of reference databases and supplies the selected selection database to the calculation unit.   The performance calorie consumption measuring apparatus according to claim 2 or 3, further comprising an integration unit that integrates the calorie consumption calculated by the calculation unit. A storage means for storing phrase calorie data, which is a standard calorie consumption for each predetermined section of a specific song,
2. The calculation means is means for determining a calorie consumption amount for each predetermined section of the specific music based on performance information extracted by the performance information extraction means and outputting a comparison result with the phrase calorie data. The performance calorie consumption measuring device according to any one of claims 1 to 4.

Images