JP4702071B2 - Music playback control device and music playback device - Google Patents

Description

  The present invention relates to a music playback control apparatus suitable for a user to listen to music while performing repetitive exercises such as walking and jogging, and a music playback apparatus using the music playback control apparatus.

When a user listens to music while walking, a music playback device that detects a walking pitch (walking tempo) and changes the music tempo according to the walking tempo to obtain a sense of unity between the user's movement and music is known. (See Patent Document 1).
In addition, the speed of music is changed so that the difference is reduced by a few percent only when the speed of music used (music tempo) and the average step speed (walking tempo) are more than a certain distance. Known (see Patent Document 2)

However, a predetermined music is reproduced by changing the music tempo. Therefore, when music is played back at a music tempo that deviates from the original tempo, the user listens to unnatural music that is far from the intention of the performance.
Moreover, simply changing the music tempo does not change your mood, so you get tired of music and lose your willingness to continue exercising.
In addition, if the data is recorded in the waveform data format, the pitch will change unless special signal processing is performed when the music tempo is changed, which causes a sense of incongruity. If recorded in a performance data format such as MIDI (Musical Instrument Digital Interface) data, the pitch does not change, but it lacks musical richness compared to the waveform data format.

On the other hand, a running pacemaker is known (conventional technique described in Patent Document 3).
The user sets the upper and lower limits of the allowable pulse rate and the desired pace (running pitch), and when the pulse rate exceeds the upper limit, the output pace of the electronic sound output from the variable frequency oscillation circuit decreases. When the pulse rate falls below the lower limit value, the output pace of the electronic sound increases.
Furthermore, it is also known to use music data instead of electronic sound and change the tempo (music tempo) using a sensor that detects an exercise tempo (running tempo) (see Patent Document 3).
The target pulse time function is generated according to the user settings, and the value obtained by multiplying the difference between the user's pulse rate and the target pulse rate ΔH (t) by the tempo and coefficient A and the exercise tempo by coefficient D The tempo after the change is added to. As a result, the exercise support device controls the user's pulse rate. If the coefficient A = 0, the music tempo is changed in accordance with the running tempo.

It also measures the heart rate, changes the music speed (music tempo) when the difference from the ideal heart rate derived from the user's information exceeds a certain level, and induces the user's heart rate to the ideal value A music playback device is also known (see Patent Document 4).
However, these technologies also reproduce predetermined music data by changing the music tempo.

In addition, the pulse is detected, the exercise load factor is calculated from the detected pulse, and the tempo coefficient P = 1.0 to 0.7 is indicated in accordance with the exercise load ratio of 70% or less to 100% or more, respectively. There is known an automatic performance device that selects and reproduces automatic performance data having an original tempo stored in correspondence with the tempo coefficient P and having a down tempo in the order of the tempo coefficient P (see the second embodiment of Patent Document 5).
As a result, a song whose playback tempo (music tempo) decreases as the exercise load factor increases is selected, and the user decreases the jogging pace accordingly.
In addition, every time the tempo coefficient P is changed, the music being played is stopped and the newly selected music is played from the beginning of the song. In addition, the music being played and the newly selected music are It is described that the music is switched by crossfading, or that the music being played is automatically played to the end in a more natural manner, and the newly selected music is started to play after completion.

Therefore, in this automatic performance device, the automatic performance data is switched according to the exercise load factor and reproduced at the original tempo.
However, the user simply knows the current exercise load factor corresponding to the music tempo, and the walking pitch is not induced so as to obtain the optimum exercise load factor.
In other words, the playback tempo does not necessarily match the user's walking tempo, so if the user continues to listen to such performance while exercising, the user will feel uncomfortable. If the user's exercise load rate does not change, the tempo coefficient P is not changed. Therefore, when the music being played is played to the end of the song, the automatic performance ends.

In addition, every time the user walks a certain distance, the elapsed time TC from the start of exercise, exercise intensity m, heart rate S, walking tempo T is sent to the distribution site. 2. Description of the Related Art A distribution device that searches and distributes music data (music tempo) and reproduces the music data with a sound source of a terminal device is known (see Patent Document 6).
The load heart rate F corresponding to the exercise intensity m is read from the heart rate history table TBL1, and the walking tempo T is multiplied by the tempo increase / decrease coefficient C corresponding to the difference Δd between the load heart rate F and the user's heart rate S to load Tempo TMP is calculated, and music data having a tempo that substantially matches the load tempo TMP is retrieved from the database and distributed.

As a result, with this conventional technique, music data having a tempo that substantially matches the walking tempo that gives the optimal exercise load can be reproduced.
However, since the music data is downloaded by accessing the distribution site, the processing delay required for switching the music data becomes long.
The user's heart rate measurement interval and the music data switching unit interval are both times for the user to walk a certain distance. Therefore, in order to promptly respond to changes in the heart rate, the above-mentioned fixed distance must be shortened. Then, in a period in which there is no change in heart rate, the same music is repeatedly started to be reproduced from the beginning of the music in a short time.
Further, the switching unit interval changes depending on the walking tempo. Furthermore, a sensor for measuring the walking tempo T is required. On the other hand, the distribution site has not studied how to store music data and how to search for music data having a tempo that substantially matches the load tempo TMP.

In addition, when the instantaneous heart rate when exercising is lower than the lower limit heart rate of the target exercise range, music with a faster rhythm (beat from the lower limit heart rate to the average heart rate of the target exercise range) than the current instantaneous heart rate It is known that the user is made to recognize and promotes exercise in a direction in which the heart rate naturally increases by performing exercise according to music having a rhythm faster than the current heart rate (see Patent Document 7). ).
However, the rhythm (beat) of music merely informs the user that the instantaneous heart rate is lower than the lower limit heart rate of the target exercise range. That is, the music beat (music tempo) is not changed in relation to the walking tempo or the like. The beat of music does not match the user's walking tempo.

JP 2003-85888 A JP 2003-177749 A JP 2001-299980 A JP 2003-177750 A Japanese Patent Laid-Open No. 10-63265 JP 2003-108154 A JP 2005-87731 A

  The present invention has been made to solve the above-described problems, and a music playback control device, a music playback device, and a music playback device for playing back music that can be exercised at a target exercise intensity or target heart rate of a user who performs repetitive exercises. And it aims at providing a music reproduction control program.

According to the present invention, in the music playback control device, the heart rate detecting means for detecting the heart rate when the user is performing repetitive exercise , the music tempo and the target heart rate are set. The setting means and the music tempo set by the setting means as an initial value, and the heart rate detected by the heart rate detecting means exceeds a first predetermined range from the target heart rate set by the setting means when, as the difference between the heart rate and the target heart rate is reduced, actually new instructed value of the music tempo based on the value of the music tempo with the music data being played, the currently playing When the music data playback section is over, the heart rate is within the first predetermined range from the target heart rate, and is within the first predetermined range from the target heart rate. A certain first When the music tempo value exceeds the predetermined range, the music tempo value is determined based on the music tempo value of the music data currently being reproduced so that the difference between the heart rate and the target heart rate becomes small. A newly instructed music tempo instructing means, and when a music tempo is newly instructed by the music tempo instructing means, and when the playback section of the music data currently being played ends, the music tempo instructing the music data having a music tempo value corresponding to the music tempo which is instructed by means music data selected from among a plurality of music data saved with the data of the music tempo of the music data in the data storage means, and selected A reproduction control means for starting the reproduction of the video.
Therefore, the music tempo is changed from the set initial value so that the heart rate approaches the target heart rate, and the heart rate is related to the exercise intensity. You will be able to exercise. As a result, it is possible to exercise suitable for the user's exercise purpose.

Even if the repetitive tempo of the repetitive exercise is not detected, the user can perform repetitive exercise with the exercise intensity of the target heart rate by changing his / her repetitive tempo so as to match the music tempo. Since the repeated tempo includes noise and slight fluctuations in the measurement result, it is not necessary to be affected by these noises and minor fluctuations by not detecting the repeated tempo.
If a plurality of music data stored in the data storage means described above is recorded in the waveform data format, it is possible to reproduce musically rich music.

The reproduction control means described above is configured such that when one or a plurality of music data having a music tempo within a predetermined range from the value of the music tempo designated by the music tempo designation means is stored in the data storage means. One music data may be selected from the one or more music data.
In this case, alternative music data can be selected even if music data having the music tempo is not stored for all music tempos that may be specified in the data storage means described above. As a result, the degree of freedom of the music data stored in the data storage means is large, so that it is suitable for the user to acquire favorite music data and store it in the data storage means.

At this time, when a plurality of music data having a music tempo within a predetermined range from the value of the music tempo specified by the music tempo specifying means is stored in the data storage means, the plurality of music data Music data may be selected at random from the list.
Alternatively, when a plurality of music data having a music tempo within a predetermined range from the value of the music tempo specified by the music tempo instruction means described above is stored in the data storage means, the plurality of music data The music data having the music tempo closest to the designated music tempo value (including the case where the designated music tempo value is matched) may be preferentially selected.
In these cases, music data can be selected even if a plurality of music data having the same music tempo is stored in the data storage means described above. As a result, the degree of freedom of the music data stored in the data storage means is large, so that it is suitable for the user to acquire favorite music data and store it in the data storage means.

The plurality of music data stored in the data storage means described above are a plurality of music data recorded in a waveform data format and at least one music data recorded in a performance data format. The means selects and selects the music data in the performance data format when the music data in the waveform data format having a music tempo within a predetermined range from the value of the instructed music tempo is not stored in the data storage means described above The music data in the performance data format may be played back at the designated music tempo.
In this case, even if the music data in the waveform data format having the music tempo within the predetermined range from the instructed music tempo value is not stored in the data storage means described above, the music data in the performance data format is used instead. Can be used. As a result, the degree of freedom of the music data stored in the data storage means is large, so that it is suitable for the user to acquire favorite music data and store it in the data storage means.

The music tempo instructing means described above indicates the music tempo value to be instructed when the heart rate detected by the heart rate detecting means is out of the predetermined range from the target heart rate set by the setting means. so that the difference between the number and the target heart rate is reduced, to change relative to the value of the music tempo with the music data being played.
In this case, it is possible to prevent the music data from being frequently switched by a slight change in the heart rate, and becoming unpleasant or uncomfortable.

Furthermore, the above-described music tempo instruction means, when the heart rate exceeds the first predetermined range from the target heart rate, sets the musical tempo value to be indicated so that the difference between the heart rate and the target heart rate becomes small. Is changed based on the music tempo value of the music data being played back, and the playback control means described above selects music data having a music tempo value corresponding to the instructed music tempo, and played back. When the music data playback section ends, if the heart rate exceeds a second predetermined range that is within the first predetermined range from the target heart rate, So that the difference between the number and the target heart rate becomes small, and the music tempo value of the music data being played back is changed as a reference, and the playback control means End of playback section After, Ru to select the music data having a music tempo value corresponding to the instruction music tempo.
In this case, when the heart rate greatly deviates from the target heart rate, the music tempo to be instructed is changed and the music data is switched, so that the user is guided so that the heart rate approaches the target heart rate. On the other hand, when the heart rate is slightly different from the target heart rate, the heart rate is guided to approach the target heart rate, but is changed after the playback section of the music data being played ends. Therefore, it is possible to prevent the music data from being frequently switched and becoming unpleasant or uncomfortable.
As a result, it is possible to satisfy both the necessity of guiding the heart rate to the target heart rate (particularly when the heart rate exceeds the target heart rate is dangerous) and exercise while enjoying music.

Music tempo change instructing means for instructing to change the value of the music tempo according to the user's operation during the repetitive exercise, and the music tempo instructing means described above changes the instructed music tempo value to the value instructed to change. And the above-described reproduction control means selects music data having a music tempo having a value corresponding to the designated music tempo, and the target heart rate set by the setting means is set to the music tempo change instruction described above. It may be changed according to the value of the music tempo instructed to change by the means.
In this case, during exercise, when the music tempo is too fast or too slow and it becomes difficult to match the repetitive tempo, the music tempo can be changed if the user instructs to change the value of the music tempo. At that time, since the target heart rate is also changed according to the value of the music tempo instructed to be changed, the effect of the change instruction during exercise is reflected even during the subsequent exercise.

The music reproduction control means described above may start the reproduction of music data to be reproduced from a position after the end of the prelude part.
In the prelude part of the music data, the tone of the music is different from that after that, and the start of the song is often felt or a silent section is included. Therefore, there is less risk of losing the willingness of repetitive exercise if the prelude part is not reproduced.

When the playback section of the selected music data ends, the playback control means described above receives a plurality of music data stored in the data storage means as music data having a music tempo corresponding to the instructed music tempo. select from among the, Ru to start the playback of music data that you selected.
In this case, for example, the playback section of the selected music data ends because the predetermined playback time set for the selected music data ends or the playback of the selected music data has been played to the end. In this case, playback of the newly selected music data starts.
As a result, music playback can be automatically continued even if the playback section of the selected music data ends during exercise.

The playback control means described above may further end the playback of the selected music data before the succeeding portion of the selected music data is played back.
In many cases, when the music data becomes a follower, the tone of the music changes greatly, and the end of the music is felt. Therefore, the person who does not play the follower does not feel the end of the music and does not disturb the repetitive movement.
To set the playback time or the minimum playback time or maximum playback time for the selected music data, set the playback time from the beginning of the song or set the playback time from the end of the song. That's fine. In any case, it is desirable to set the playback time excluding the prelude part and the follower part. At this time, the prelude part and the follower part may be determined by analyzing the music data, but may be determined uniformly by determining a predetermined time.

Here, the above-described reproduction control means may be adapted to reproduce the succeeding portion of the selected music data when receiving an instruction to end the reproduction of the music data.
In this case, by receiving the instruction to end the reproduction of the music data by detecting the end of the repetitive movement or detecting the operation of the playback stop switch, the user may feel the end of the movement. it can.
If the exercise time, that is, the reproduction time is preset, the instruction to end the reproduction of the music data described above is a point in time at the latest from the end of the preset reproduction time before the time to reproduce the follower part It should be done in. At this time, the subsequent playback section is determined retroactively from the end position of the follower.

The reproduction control means described above, when starting the reproduction of the newly selected music data, reproduces the music data for connection before switching from the currently reproduced music data to the newly selected music data. It may be.
If the music data for connection is music data in the performance data format, the music tempo from the value of the music tempo of the currently played music data to the value of the music tempo of the newly selected music data, It can be varied over multiple stages. As a result, the music listened to by the user can be transferred smoothly. At that time, if the music data currently being played is switched from the music data for connection to the music data for connection, and the switching from the music data for connection to the newly selected music data is performed by crossfading, a smoother transition can be made. Become.

According to a second aspect of the present invention, in the music reproduction control device according to the first aspect, the apparatus has a repetitive timing detecting means for detecting a repetitive timing of a repetitive motion when a user is performing a repetitive motion, The control means reproduces the selected music data so that the first beat timing in the reproduction section of the music data is synchronized with the repetition timing detected by the repetition timing detection means when the reproduction of the music data is started. Is to start.
Therefore, when music data is selected at the beginning or after that and reproduction of this music data is started, the user's repetition timing coincides with the first beat timing of the reproduction section, and the music data is switched. In contrast, since the user does not feel uncomfortable, a sense of unity with music can be obtained.
Note that the data of the first beat timing in the reproduction section of the music data or the data for estimating the beat timing may be stored in advance in the data storage means described above together with the music data.
The means for detecting the repetition timing and the means for detecting the repetition tempo can be realized by using the output of the same sensor.

According to a third aspect of the present invention, in the music reproduction control device according to the first aspect, when the beat sound generation setting means and the generation of the beat sound are set, the music tempo possessed by the music data being reproduced is set. Beat sound generation control means for generating the beat sound with the value of.
Therefore, when it is difficult for the user to recognize the music tempo, and the repetition tempo cannot be changed to match the music tempo, a beat sound is generated with the music tempo value of the music data being reproduced . Thus, the music tempo can be easily recognized.
At that time, the music data is also played back at the same time, but the playback output of the music data may not be output (mute).

According to a fourth aspect of the present invention, in the music playback control device according to the first aspect, a repetitive tempo detecting means for detecting a repetitive tempo when the user is making repetitive movements, and a detection by the repetitive tempo detecting means. and repeatable tempo, wherein when the outside a predetermined range from the music tempo indicated by the music tempo specifying means, beat sound is generated values Devi over treble the music tempo with the music data being played generated It has a control means.
Therefore, by generating a beat sound with the music tempo value of the music data being played back , the music tempo can be easily recognized, and the user can be notified that the repeat tempo value is off.
At that time, the music data is also played back at the same time, but the playback output of the music data may not be output (mute).
The beat sound generation control means in claims 3 and 4 described above may generate a beat sound in which at least the first beat position is synchronized with the beat position of the music data being reproduced.

The setting means described above sets the music tempo at the exercise start stage, and the music tempo instruction means may instruct the set music tempo value at the exercise start stage at the exercise start stage. Good.
At the start of exercise, the heart rate gradually increases, so the heart rate is not stable. Therefore, there is little need to change the value of the music tempo to be instructed so that the difference between the heart rate and the target heart rate becomes small. Therefore, the music tempo value is set to the set value.
The music tempo at the exercise start stage may be a fixed value or a value that changes with the passage of time at the exercise start stage.

The setting means described above sets the music tempo at the exercise end stage, and the music tempo instruction means may instruct the set music tempo value at the exercise end stage at the exercise end stage. Good.
At the end of exercise, the heart rate does not stabilize because the heart rate decreases. Therefore, there is little need to change the value of the music tempo to be instructed so that the difference between the heart rate and the target heart rate becomes small. Therefore, the music tempo value is set to the set value.
The music tempo at the end of exercise may be a fixed value or a value that changes with the passage of time at the end of exercise.

In the exercise end stage, the music tempo instructing means described above has a repeat tempo detected before entering the exercise end stage by the above-described repeat tempo detection means, and a set exercise end stage. The value of the music tempo is compared, and a value obtained by changing the value of the music tempo at the set exercise end stage is indicated according to the comparison result.
Therefore, the value of the music tempo at the end of exercise can be corrected according to the actual value of the user's repeated tempo before entering the end of exercise.

  According to a fifth aspect of the present invention, in the music reproduction control device according to the first aspect, the setting means for setting the music tempo at the exercise start stage of the repetitive movement and the music tempo at the movement end stage of the repetitive movement. The data storage means stores music tone data representing the degree to which each music data feels fast and slow music tempo, together with the plurality of music data, and the music tempo instruction means In the exercise start stage, the value of the music tempo in the exercise start stage set by the setting means is instructed. In the exercise end stage, the music tempo in the exercise end stage set by the setting means is indicated. The reproduction control means is stored in the data storage means in the exercise start stage. The music tempo having a value corresponding to the music tempo designated by the music tempo instructing means is retrieved from one or a plurality of music data having a music tone that makes the music tempo feel faster by searching the music tone data of a plurality of music data. The music data is selected, and in the exercise ending stage, the music tone data of a plurality of music data stored in the data storage means is searched, and one or a plurality of music data having a tone that makes the music tempo feel slower Among them, music data having a music tempo having a value corresponding to the music tempo designated by the music tempo designating means is selected.

The data storage means described above stores a plurality of music data and music tone data representing the degree to which each music data feels a fast and slow music tempo. When the tempo instruction means instructs the music tempo to be accelerated from the music tempo value of the music data being played back, the music tone data of the plurality of music data stored in the data storage means described above is retrieved and played back. Music data having a music tempo value corresponding to the instructed music tempo is selected from one or a plurality of music data having a tone that makes it feel faster than the music data being received, When a music tempo that is delayed from the music tempo value of the music data being played back is designated, it is stored in the data storage means described above. The music tempo data of the plurality of music data is retrieved, and the music tempo having a value corresponding to the instructed music tempo is selected from one or a plurality of music data having a music tone that feels slower than the music data being reproduced. The music data to have may be selected.
In this case, not only the music tempo is changed according to the repetitive tempo, but also the music tone changes according to the change direction according to the change of the music tempo, so that the user can feel a sense of unity between the repetitive motion and the music. I can feel more.

According to a sixth aspect of the present invention, in addition to the music reproduction control device according to any one of the first to fifth aspects, the music reproduction device is selected according to the data storage means and the user's selection operation. Music data acquisition means for storing the music data together with the music tempo data of the music data in the data storage means, and music data playback means for playing back the music data selected by the music playback control device.
Therefore, music data can be stored and reproduced alone without an external data storage device and music data playback device.

  The invention described in claim 7 is a music playback control program capable of realizing the music playback control apparatus according to claim 1 by using a computer.

The invention according to claim 8 is the music playback control device, when the mode setting means for setting the music playback control function to the free mode or the assist mode according to the user's selection operation, and at least when the free mode is set, A repetitive tempo detecting means for detecting a repetitive tempo when the user is repetitively exercising, and a heart rate for detecting a heart rate when the user is repetitively exercising at least when the assist mode is set. A detecting means; a setting means for setting a music tempo and a target heart rate when the assist mode is set; and a repetitive tempo detected by the repetitive tempo detecting means when the free mode is set. When the assist mode is set and the music tempo of the value corresponding to the Music tempo which is an initial value, the heart rate detected by said heart rate detecting means, when exceeding a first predetermined range from the target heart rate set by the setting means, the heart rate and the target The music tempo value is newly instructed based on the music tempo value of the music data currently being played back so that the difference from the heart rate is small, and the playback section of the music data being played back is When finished, the heart rate is within the first predetermined range from the target heart rate and exceeds a second predetermined range from the target heart rate within the first predetermined range. A music tempo that newly designates the value of the music tempo based on the value of the music tempo of the music data that is currently being reproduced so that the difference between the heart rate and the target heart rate is small. finger And means, when the music tempo by the music tempo specifying means is instructed newly is and the fact when the reproduction section of the music data being played is finished, the music tempo instructed by the music tempo specifying means Reproduction control for selecting music data having a music tempo corresponding to the value from a plurality of music data stored in the data storage means together with the music tempo data of each music data, and starting reproduction of the selected music data It has a means.
Therefore, in the free mode, it is possible to select music data having a music tempo that follows a change in repetitive tempo, and reproduce the selected music data at the music tempo (original tempo). As a result, it is possible to listen to music while performing repetitive exercises without the music tempo of the music data being reproduced affecting the repetitive tempo of the repetitive exercise.
On the other hand, in the assist mode, the music tempo is changed from the set initial value so that the heart rate approaches the target heart rate as in the first aspect of the invention. , You will be able to exercise at the target intensity.
Even if the repetitive tempo of the repetitive exercise is not detected, the user can perform repetitive exercise with the exercise intensity of the target heart rate by changing his / her repetitive tempo so as to match the music tempo. Since the repeated tempo includes noise and slight fluctuations in the measurement result, it is not necessary to be affected by these noises and minor fluctuations by not detecting the repeated tempo.

According to a ninth aspect of the present invention, in the music playback device, in addition to the music playback control device according to the eighth aspect, the data storage means and music data selected in accordance with a user's selection operation are stored in the music. Music data acquisition means for storing the data in the data storage means together with the music tempo data, and music data reproduction means for reproducing the music data selected by the music reproduction control device.
Therefore, music data can be stored and reproduced alone without an external data storage device and music data playback device.

According to the present invention, when the user consciously adjusts the repetitive tempo to match the music tempo of the music data to be reproduced during repetitive exercise such as walking or jogging, the target heart rate (target exercise intensity) is obtained. Therefore, there is an effect that it is possible to exercise according to the user and to avoid danger such as excessive exercise.
Since the music data is changed, the user feels different and never gets tired of listening to music. In addition, since the music data is reproduced at the original tempo, there is no sense of incongruity.
When the user wants to switch the music data being played back to a different one, it is possible to change the heart rate consciously without operating the control.

FIG. 1 is a functional configuration diagram of an embodiment of the present invention.
The present invention is used when a user listens to music while performing repetitive exercises. Below, the case where a user jogs, runs, etc. is demonstrated as a specific example of repetitive exercise | movement.
The present invention is roughly divided into two modes, a free (free use) mode and an assist (exercise support) mode, as the music selection function, and the free mode or the assist mode is set according to the user's selection operation.
FIG. 1A is a block diagram in the free mode, and FIG. 1B is a block diagram in the assist mode.
The free mode is a mode in which the user listens to music without disturbing the walking tempo while freely walking or running at a walking tempo or running tempo (hereinafter collectively referred to as a walking tempo).

In FIG. 1A, reference numeral 1 denotes a music data acquisition unit that acquires desired music data selected according to a user's selection operation from a database that stores a large number of music data, or a CD (Compact Disk). Or obtained from a large number of music data recorded on a recording medium such as the like, and written in the data storage unit 2.
At that time, if the music data to be acquired contains the original music tempo data, it is simultaneously imported. If not, the music data is analyzed, the original music tempo is extracted, and the music data is extracted. The data and the original music tempo are written into the data storage unit 2. Therefore, the data storage unit 2 stores a plurality of music data together with the original music tempo data of each music data. At the time of playback, it plays at the original music tempo.

The music data described above is preferably in a waveform data format.
However, it may be in a performance data format recorded with performance data representing the pitch and pitch of notes such as MIDI data. In this case, it is assumed that the data has original music tempo data at the time of performance, and at the time of reproduction, reproduction is performed at the original music tempo.
As will be described later, the music data to be saved is in a waveform data format in principle, but a part of the music data may be in a performance data format.

  Reference numeral 3 denotes a walking tempo detection unit that detects the walking tempo when the user is walking or running. It is detected how many times a step (one step) without distinguishing between the right foot and the left foot occurs per unit time (eg, 1 minute). The output of the walking tempo detection unit 3 may be output after ignoring a temporarily fluctuating value, taking a moving average value over several steps, or performing processing combining both conditions.

Reference numeral 4 denotes a music tempo instructing unit for instructing a music tempo corresponding to the walking tempo detected by the walking tempo detecting unit 3.
A reproduction control unit 5 selects music data having a music tempo designated by the music tempo designating unit 4 from a plurality of music data stored in the data storage unit 2, and selects the selected music data as music. The data is reproduced by the data reproducing unit 6.
Reference numeral 6 denotes a music data reproduction unit which reproduces music data selected by the reproduction control unit 5.

The music tempo instruction unit 4 instructs a music tempo value corresponding to the walking tempo detected by the walking tempo detection unit 3.
More specifically, the music tempo instructing unit 4 determines the value of the walking tempo detected by the walking tempo detecting unit 3 from the value of the music tempo included in the music data reproduced by the music data reproducing unit 6 described later. When out of the range, the music tempo having a value matching the walking tempo value is indicated.

The above-mentioned predetermined range is a range of ± predetermined difference from the music tempo value of the music data being played back, but the ± predetermined ratio of this music tempo value from the value of the music tempo of the music data being played back It is good also as the range.
When the value of the repeat tempo is compared with the value of the music tempo, it may be determined that the value is outside the predetermined range from the value of the music tempo specified by the music tempo specifying unit 4. However, the music tempo that the user is listening to is the value of the music tempo of the music data currently being played back, and this does not necessarily match the value of the music tempo currently instructed. Therefore, a more reasonable comparison can be made by comparing with the music tempo value of the music data currently being reproduced.

The reproduction control unit 5 selects music data having a music tempo having a value corresponding to the music tempo designated by the music tempo designating unit 4 from among a plurality of music data stored in the data storage unit 2 and selects the music data. Start playing music data.
The music data playback unit 6 plays back the music data selected by the playback control unit 5.
However, music data having the same music tempo value as the designated music tempo value is not always stored in the data storage unit 2. Conversely, music data having the same music tempo value is stored in the data storage unit 2. Many may be stored.

Therefore, when one or a plurality of music data having a music tempo within a predetermined range from the instructed music tempo value is stored, the reproduction control unit 5 One music data may be selected (initial selection).
At this time, when a plurality of music data having a music tempo within a predetermined range from the value of the music tempo specified by the music tempo specifying unit 4 is stored in the data storage unit 2, the plurality of music data are stored. Music data may be selected at random from the data.
It should be noted that if there is only one having the music tempo within the above-mentioned predetermined range, this is selected, but in this case as well, it can be said that music data is selected at random.

  Thereafter, when the music tempo having the same value is designated again, the music tempo is selected at random from those except for the music data that has already been randomly selected. After that, when all the music data whose music tempo is within the predetermined range described above are selected, the process returns to the initial selection and the same processing is repeated. Therefore, the history of music data selected corresponding to the designated music tempo value is stored in the data storage unit 2.

  Alternatively, when a plurality of music data having a music tempo within a predetermined range from the value of the music tempo specified by the music tempo specifying unit 4 is stored in the data storage unit 2, the plurality of music data The music data having the music tempo closest to the designated music tempo value (including the case where it matches the designated music tempo value) may be preferentially selected. In addition, when there is only one having a music tempo within the above-described predetermined range, this is selected. In this case as well, it can be said that music data having the closest music tempo is selected.

Thereafter, when a music tempo having the same value is designated again, priority is given to music data having a music tempo value closest to the designated music tempo value from among the music data already selected. select. Thereafter, when all the music data whose music tempo is within the predetermined range described above are selected, the process returns to the initial selection and the same processing is repeated.
However, when there are a plurality of music data having the same music tempo value, one of them may be selected from the plurality of music data by the same method as the above-described random selection.

The playback control unit 5 described above stores a selection history of music data (a selection history that is not distinguished by which value of music tempo is specified), and the value of the music tempo specified by the music tempo instruction unit 4 When one or a plurality of music data having a music tempo within a predetermined range is stored, music data with a small number of selections is selected from the one or a plurality of music data according to the music data selection history. May be selected with priority, and music data to be reproduced may be switched.
Even if the same or close music tempo is instructed consecutively or again after a while by the various selection methods described above, different music data is selected, so the music will not get tired. Can continue to listen.

When the music data in the waveform data format having the music tempo within the predetermined range from the designated music tempo value is not stored in the data storage unit 2, the reproduction control unit 5 will be described later with reference to FIG. The music data in the performance data format is selected, and the music data playback unit 6 described later starts playback of the music data in the selected performance data format at the instructed music tempo.
As music data in the performance data format, music data whose original music tempo is unknown may be stored. When a plurality of music data having different original music tempos are stored as music data in the performance data format, the music data tempo closest to the instructed music tempo may be selected and reproduced at the instructed music tempo.

When the music data acquisition unit 1 shown in FIG. 1 acquires music data from a database or the like, the music data of the song is acquired from the beginning to the end, and the entire music is stored in the data storage unit 2. In this case, the playback time varies depending on the music piece. However, it is possible to set a predetermined playback time from the beginning of the song or to set a predetermined playback time that goes back from the end of the song.
When the music data acquisition unit 1 acquires music data from a database or the like, only an arbitrary section such as an intermediate section of a song or a section excluding a prelude section and a follower section to be described later is operated by the user. May be saved.

FIG. 2 is an explanatory diagram showing an example of data stored in the data storage unit 2 shown in FIG.
As music data, there are a waveform data format and a performance data format, both of which are filed for each piece of music, for example.
As a music data file in the waveform data format, for example, MP3 (MPEG-1 Audio Layer-III), etc., as long as it can be played back by the WAV format (uncompressed waveform data format) or the music data playback unit 6, The waveform data file may be compressed by various compression methods.
The music data file in the performance data format includes an SMF (Standard MIDI File) format in which a MIDI message and event timing data are recorded as a pair.
The music data in the performance data format can be used in the same manner as the music data in the waveform data format. However, in the normal embodiment, as described above, this is used when the music data in the waveform data format having the music tempo corresponding to the designated music tempo is not stored.
In addition, as will be described later with reference to FIGS. 6 and 9, there is a case where short-time music data is used in the performance data format for the connection music data when the music data to be reproduced is switched.

FIG. 2A is an explanatory diagram showing a data structure in the memory. A plurality of music data files are stored in the data storage unit 2, and the plurality of music data files are managed by music management data stored in the same data storage unit 2. In this figure, the storage area is divided into the waveform data format and the performance data format, but they may be mixed.
FIG. 2B to FIG. 2E are explanatory views illustrating the contents of music data stored in the data storage unit 2 according to the music data time length. For example, the music data file has a music data area following the header area. Here, the music data area is schematically illustrated.

Music data generally involves a prelude and a follower.
The introduction part is an introductory part that is played before entering the subject, but in the present specification, it simply means the first part of the song. In the prelude part, there is a case where the music tone is different from the following parts in the composition method, and it is a music tone that feels the start of the music. Also, it may start from a silent period or play only with accompaniment.
The ending part (ending) is a part after the subject ends, but in this specification, it simply means the end part of the music. In the follower, there is a case where the tone of music changes greatly due to the composition method and the end of the song is felt. It may be an accompaniment performance or it may end in a silent period.

Therefore, in the embodiment of the present invention, with respect to the music data stored in the data storage unit 2, in principle, the music data playback unit 6 plays back the section between the prelude part and the follower part. Like that. However, when the music reproduction is terminated with the end of the exercise, it is better to reproduce the music including the follower part.
The prelude part and the follower part may be detected by automatic analysis of music data, or may be identified by a music expert, but may be simply divided by time length. For example, the prelude part is determined as 20 seconds from the start position of the music data, and the follower part is determined as 60 seconds after the end position of the music data.

The music data shown in FIG. 2B has a music data reproduction time of a predetermined less than one minute, for example. If the playback time length is too short, the music data is frequently switched and it becomes difficult to hear, so in the embodiment of the present invention, it is not a playback target.
The music data shown in FIG. 2 (c) has a predetermined reproduction time of music data, for example, from 1 minute to 3 minutes, and is to be reproduced.
The music data shown in FIG. 2 (d) has a reproduction time of the music data of a predetermined over 3 minutes, for example, and is set as a reproduction target within a predetermined 3 minutes. In the illustrated example, the playback section is determined retroactively from the start position of the follower part. Instead of this, the playback section may be determined from the position after the prelude section.
When one piece of music is played back for a long time, it is easy to get tired, so such a playback time length is limited.
However, when the number of music data pieces is small at a certain tempo value and in the vicinity thereof, it is better to listen to one piece of music data as long as possible. Therefore, at any time or when the number of music data pieces is small as described above, the maximum section excluding the prelude part and the follower part may be set as the playback section without setting an upper limit on the playback time length.

  The examples shown in FIGS. 2B to 2D are based on the assumption that the music tempo is almost constant in the music data. On the other hand, FIG. 2 (e) shows that the music tempo exceeds the predetermined allowable range (for example, ± 5% or ± 3BPM) for determining that the music tempo has changed at least once in the song. It is an example that is changing. In this case, each playback section having a substantially constant music tempo is used as independent music data having a different music tempo. However, each reproduction time is on condition that it is predetermined, for example, not less than 1 minute and not more than 3 minutes, as in FIGS. 2 (c) to 2 (e).

The music management data portion shown in FIG. 2A is a database for managing the above-described plurality of music data files.
It also includes management data that is required only when a specific function is realized.
FIG. 2F shows an example of management data for one music data file in the waveform data format in the music management data section.

The management number is a number for specifying a music data file. In the case of FIG. 2E, different management numbers are assigned to the first and second playback sections.
The music data start address (start address of the music data file) and the music data length (data length of the music data file) specify an area in the data storage unit 2 where each music data file is stored. The same area is designated in the first half management data and the second half management data in FIG.
When the storage area of the music data file can be referred to by the music data file number attached thereto, the music data file number may be described instead of the start address and the data length.

The type data is data indicating whether it is a waveform data format or a performance data format.
The music tempo is the original music tempo. The management data of the first half playback section in FIG. 2 (e) is the first music tempo, and the management data of the second playback section is the second music tempo.
The melody is data representing the degree of feeling that the music tempo of the music data is fast and slow. The value of the music tempo is used because it may be different from the feeling of the music tempo received by the user, but it is not essential to the present invention.
The reproduction start position represents the reproduction start position shown in FIGS. 2C to 2E in units of time or clock from the beginning position of the music data. In the case of management data in the latter half of the playback section in FIG. 2E, the tempo change position is indicated.
The reproduction end position represents the reproduction end position shown in FIGS. 2B to 2E in units of time or clock from the beginning position of the music data.

In general, the beat position data includes a plurality of beat position data (1), (2), (3),...
The beat position (1) represents the position of the first beat from the beginning of the music data in units of time or clock. In the same way for the subsequent beat positions (2), (3), etc., the position of the subsequent beat is expressed by the difference from the position of the previous beat or the position of the previous beat until the end of the song. is there.
However, if all beat positions in a song are described, the amount of data increases. Therefore, the beat position may be described by thinning out once every measure or once every few beats. The thinned beat positions are estimated by interpolation processing. When the prelude part and the follower part are not reproduced, only the beat position of the reproduction section may be described. However, if the length of the prelude part and the follower part is arbitrarily changed, or if the prelude part and the follower part are played back, it is better to describe the entire song.
In the case of management data for the first half of the playback section in FIG. 2 (e), the first half beat position up to the music tempo change position is described. In the case of the management data for the second half of the playback section in FIG. Describes the beat position from the changed position.

FIG. 2G shows an example of management data for a music data file in the performance data format in the music management data section.
The management number, music data (file) start address, music data (file) length, music tempo, tune, playback start position, and playback end position are the same as those of the waveform data shown in FIG. . The type data indicates a performance data format. In the performance data format, since the beat position can be determined or estimated from the event timing of the note data, the beat position data need not be particularly described.

In the above description, when the music management data area is provided in the data storage unit 2 and the music data is read, first, the music data satisfying the condition is identified with reference to the management table, and the start address thereof is specified. The music data is read with reference to the data length.
Therefore, when the music data acquisition unit 1 newly writes music data to the data storage unit 2, the music data acquisition unit 1 acquires management data such as type data and music tempo from an external device and imports the management data together with the music data. If the data cannot be obtained, the management data is acquired by analyzing the music data and written in the music management data area.

Here, the beat position data can also be referred to as a kind of performance data. Therefore, a beat position data file can be stored separately from the music data file, and data referring to the area of the beat position data file can be described as the music management data.
Further, instead of using the music management data described above, management data such as type data, music tempo, and music tone may be described in the header area of each music data file. When reading out music data, each music file is directly accessed to specify music data that satisfies the conditions.

Returning to FIG. 1A, the description of the free mode will be continued.
When the walking tempo is stable, the value of the music tempo indicated by the music tempo indication unit 4 is not changed. Therefore, the playback control unit 5 causes the music data playback unit 6 to play back the selected music data until the playback time of the music data ends, that is, until it becomes a follower.
When the playback section of the selected music data ends, the playback control unit 5 automatically continues music playback by starting playback of the newly selected music data. Therefore, music data having a music tempo corresponding to the instructed music tempo is selected from a plurality of music data stored in the data storage unit 2 before the end of the playback section.
At this time, if the music tempo designated by the music tempo designation unit 4 has not been changed, the next music data having the same music tempo is selected.

When the reproduction control unit 5 receives an instruction to end reproduction of the music data by detecting the end of walking or running or detecting the operation of the reproduction stop switch, the reproduction control unit 5 The player who plays to the later part fits the end of the exercise.
For example, a repetitive motion end detection unit (not shown) is provided, and a stop switch operated by the user according to the detection output of the walking tempo detection unit 3 (the state where the walking tempo becomes zero continues for a predetermined time or more) The end of the repetitive motion is detected according to the operation.

The walking tempo detection unit 3 described above detects the step (start) timing of walking (start timing of advancing one step) in real time every time when the user is walking or running, and immediately outputs this. May be.
The reproduction control unit 5 synchronizes the first beat timing of the reproduction section of the music data with the step (start) timing detected by the walking tempo detection unit 3 when the reproduction of the music data is started first or thereafter. Thus, the reproduction of the music data is started.
Therefore, when music data is selected and the reproduction of the music data is started, the user step (start) timing coincides with the first beat timing after the reproduction starts.
As shown in FIGS. 2C to 2E, the predetermined playback start time is not necessarily the first beat timing of the playback section. Therefore, the predetermined reproduction start time is a time before the first beat timing.
Note that the playback start time may be set to the position of the first beat timing in the playback section described above, instead of the predetermined playback start time.
At that time, in any of the synchronized playback start methods, the music playback can be prevented from being interrupted by continuing the playback of the previous music data until the playback of new music data is started.

The first beat timing of the music data reproduction section described above is the reproduction start position data stored in the data storage unit 2 together with the music data, and the beat position data shown in FIG. You can get based on. If the beat position data is described for each beat, it is the first beat position after the playback start position, but if it is not described for each beat, it occurs first after the playback start position. The beat position is estimated by interpolation processing.
The beat position data shown in FIG. 2 (f) is premised on use in beat sound reproduction in the assist mode described later. In the free mode, it is only necessary to store data that indicates the first beat position after the reproduction start position.

In addition, the user may stop suddenly. At this time, the walking tempo value output from the walking tempo detection unit 3 rapidly decreases, and the music tempo value indicated by the music tempo instruction unit 4 decreases rapidly.
The state in which the value of the walking tempo rapidly decreases can be determined indirectly by the value of the music tempo instructed by the music tempo instruction means in addition to the value of the walking tempo being directly determined.
When the walking tempo value rapidly decreases, the playback control unit 5 temporarily stops the music data playback by the music data playback unit 6 until the walking tempo value is restored. Alternatively, the music data currently being played may be continuously played until the walking tempo value is restored.
In the above description, the playback control unit 5 specifies the music tempo according to the walking tempo, but may control other musical sound characteristics according to the walking tempo. For example, the playback volume is increased as the walking tempo increases. Depending on the walking tempo, other musical sound characteristics may be controlled together with the music tempo.

By the way, in the management data shown in FIGS. 2 (f) and 2 (g), data indicating "musical tone" representing the degree to which each music data feels fast and slow music tempo is stored.
Even if the music tempo value is the same, it is known that if people listen to it, the music tempo will sound as if there is a difference in the music tempo. “Rhythmic songs”, “Bright songs”, “Sounding songs” "Belongs to" up-tempo music ".
On the other hand, “relaxing songs” or “relaxing songs” relatively belong to “downtempo songs”.
Therefore, for example, music tone data in which “5” is set as the one that makes the music tempo feel the fastest and “1” is set as the piece that makes the music tempo feel the slowest is added to the music data.

  When the music data is analyzed by the external device, or when the music data acquisition unit 1 acquires the music data from the external device, the result of determining the tune by the user is written as the tune data. Alternatively, the music data may be automatically analyzed to determine whether the above-described sensual music tempo is felt fast or slow.

The above-mentioned “musical tone” data is used as a condition when the reproduction control unit 5 shown in FIG. 1 selects music data when adding an exercise end stage to repetitive exercise, so that the music tone suitable for the exercise end stage is used. Music data can be selected.
More specifically, the music tempo at the end of exercise is forcibly set by a setting unit not shown in FIG. The music tempo instruction unit 4 instructs the value of the music tempo at the set exercise end stage.

  The reproduction control unit 5 searches the music tone data of a plurality of music data stored in the data storage unit 2 and selects the music tempo instruction unit 4 from one or more music data having a music tone that makes the music tempo feel slower. The music data having a music tempo having a value corresponding to the music tempo designated by the above is selected. Alternatively, the music tempo may be prioritized, and when there are a plurality of music data having a music tempo having a value corresponding to the instructed music tempo, the music data satisfying the music tone condition may be selected.

The “musical tone” data described above can be used as a condition when the reproduction control unit 5 shown in FIG. 1 selects music data even before the exercise end stage.
For example, the reproduction control unit 5 searches the music tone data of a plurality of music data stored in the data storage unit 2 before the exercise end stage, and stores one or a plurality of music data having a music tone that does not make the music tempo feel slow. Music data having a music tempo having a value corresponding to the music tempo designated by the music tempo designation unit 4 is selected.

Alternatively, the playback control unit 5 corresponds to the music tempo instructed by the music tempo instructing unit 4 and provides music data that gives a change in tune according to the direction of change in the music tempo instructed by the music tempo instructing unit 4. You may make it select from several music data preserve | saved at the data storage part 2. FIG.
That is, when the music tempo instruction unit 4 instructs the music tempo to be accelerated from the music tempo value of the music data currently being reproduced by the music data reproduction unit 6 (pace up), the reproduction control unit 5 A search is made for music tone data of a plurality of music data stored in the data storage unit 2 and is instructed from one or a plurality of music data having a higher-tempo music tone that makes it feel faster than the music data being reproduced. Music data having a music tempo value corresponding to the music tempo selected is selected.

The reproduction control unit 5 is also instructed by the music tempo instruction unit 3 to specify a music tempo that is delayed from the music tempo value of the currently reproduced music data by the music data reproduction unit 6 (pace down). The music tone data of a plurality of music data stored in the data storage unit 2 is retrieved, and an instruction is given from one or a plurality of music data having a down-tempo music tone that makes the music data feel slower than the music data being reproduced. Music data having a music tempo with a value corresponding to the set music tempo is selected.
Here, the music tempo may be prioritized, and when there are a plurality of music data having a music tempo having a value corresponding to the instructed music tempo, the music data satisfying the music tone condition may be selected.

Next, the “assist mode” will be described with reference to FIG. In this specification, the assist mode is a walking tempo that matches the music tempo of the music data to be played back, and is a mode that supports music playback so that if the user walks or runs, the user can perform an optimal exercise. .
In FIG. 1B, the same parts as those in FIG.
Reference numeral 7 denotes a setting unit that sets a music tempo and a target heart rate suitable for the user by inputting various data unique to the user and a desired exercise mode, which will be described later with reference to FIG.
The target value may be set by using the heart rate (unit: [times / minute], for example), but the target exercise intensity (unit is, for example, [ % HR Reserve], a percentage of the predicted maximum heart rate reserve). In the latter case, the heart rate detected by the heart rate detector 8 is converted into a target exercise intensity and compared.

Accordingly, in the present specification, when the target heart rate and the heart rate are referred to, these include the case of conversion into an index such as the target exercise intensity.
About the target heart rate mentioned above, the same value is set over the whole period of a walk or running, or the whole period of a predetermined exercise stage, or the value which changes as time passes is set. The set value of the music tempo described above is a set value at the start of walking or running, or a set value at the start of a predetermined exercise stage.

Reference numeral 8 denotes a heart rate detection unit that detects a heart rate when the user is walking or running. Since the heart rate and the pulse rate have the same value, the terminology is unified with the heart rate in the embodiment of the present invention. The heart rate detection unit 8 may output a heart rate after taking a moving average without noise.
Reference numeral 9 denotes a music tempo designating unit, which uses the music tempo set by the setting unit 7 as an initial value, and the difference between the heart rate detected by the heart rate detecting unit 8 and the target heart rate set by the setting unit 7 is small. For example, the music tempo value is instructed based on the music tempo value of the currently reproduced music data. The value of the music tempo of the music data to be reproduced is a target for the user to match the walking tempo.
A reproduction control unit 10 is a plurality of music data having a music tempo value corresponding to the music tempo designated by the music tempo designating unit 9 and stored in the data storage unit 2 together with the music tempo data of each music data. The music data is selected from the selected music data and playback of the selected music data is started.

More specifically, the music tempo instruction unit 9 described above indicates the music tempo to be instructed when the heart rate detected by the heart rate detection unit 8 is out of the predetermined range from the target heart rate set by the setting unit 7. Is changed with reference to the value of the music tempo of the music data being reproduced so that the difference between the heart rate and the target heart rate is small.
Here, as a setting method of the predetermined range, a range of ± predetermined difference from the target heart rate is used, but a range of ± predetermined ratio of the target heart rate to the target heart rate may be used. On the other hand, the music tempo value to be instructed is a value of ± predetermined ratio of the music tempo value based on the value of the music tempo of the music data being reproduced, but may be a value of ± predetermined difference. .

Note that the music tempo instruction unit 9 may change the value of the music tempo to be instructed based on the value of the music tempo currently instructed.
However, the music tempo being listened to by the user is the value of the music tempo of the music data currently being played back, and this does not necessarily match the value of the music tempo currently instructed. Therefore, it is possible to make a reasonable change if the change is made based on the value of the music tempo of the music data currently being played back.

When a new music tempo is instructed by the music tempo instruction unit 9, the reproduction control unit 10 selects music data having a new music tempo from a plurality of music data stored in the data storage unit 2, The music data playback unit 6 may be subjected to processing for starting playback of the selected music data.
However, in this embodiment, since it is assumed that the user's walking tempo is matched with the music tempo, it is not desirable to frequently change the music tempo because it places a burden on the user. On the other hand, when the heart rate changes suddenly, particularly when the heart rate increases, it is necessary to lower the walking tempo even during playback so as not to give excessive exercise intensity. In order to satisfy the conflicting specifications, the following configuration is adopted.

When the heart rate detected by the heart rate detection unit 8 exceeds the first predetermined range from the target heart rate described above, the music tempo instruction unit 9 sets the indicated music tempo value to the heart rate described above. The music is changed based on the music tempo value of the music data being played back so as to reduce the difference from the target heart rate described above, and the music corresponding to the music tempo instructed to the playback control unit 10 Music data having a tempo is selected, and the music data reproduction unit 6 is caused to start reproducing the selected music data.
On the other hand, the music tempo instructing unit 9 has a second predetermined range in which the heart rate described above is within the first predetermined range from the target heart rate described above when the playback section of the music data being played ends. If exceeded, the music tempo value to be instructed is changed on the basis of the music tempo value of the music data being reproduced so that the difference between the heart rate and the target heart rate is reduced, and Then, after the playback section of the music data being played ends, the playback control unit 10 selects music data having a music tempo value corresponding to the instructed music tempo and causes the music data playback unit 6 to play it back.

The above-mentioned first and second predetermined ranges are a range of ± first predetermined difference and a range of ± second predetermined difference from the target heart rate, respectively. The range may be a range of ± first predetermined ratio and a range of ± second predetermined ratio.
On the other hand, the music tempo value to be designated is a value of ± a predetermined ratio of the music tempo value based on the music tempo value of the music data being reproduced. It may be a value of ± predetermined difference.
At this time, when the first predetermined range is exceeded from the target heart rate, the absolute value of the predetermined ratio and the absolute value of the predetermined difference are larger than when the second predetermined range within the first predetermined range is exceeded. The value may be increased.

By the way, if the user keeps exercising at a walking tempo that matches the music tempo of the music data being played back, the initial value of the music tempo and the target heart rate setting may not be appropriate. Or driving | running | working may become difficult, and conversely, there may be too much room.
In order to deal with such a case, while the user is walking or running, a music tempo change instruction operator, for example, a “pace-down button” that is pressed when exercise is difficult, and a “pace-up button” that is pressed when exercise is available Is provided in the music playback control device.
A music tempo change instruction section (not shown) is provided to detect that the above-described button has been pressed, and to instruct the change of the music tempo value.

  The music tempo instructing unit 9 immediately changes the value of the instructed music tempo to the value instructed to change, and causes the reproduction control unit 10 to select music data having a music tempo having a value corresponding to the instructed music tempo. At the same time, the target heart rate set by the setting unit 7 is changed according to the value of the music tempo specified by the music tempo change instruction unit.

As a result, when the “pace down button” is pressed, the music tempo is slowed down, the music data corresponding to that is selected, the music data to be played is switched, and the target heart rate is lowered. Even if the detected heart rate is low, the music tempo is not as fast as before.
On the other hand, when the “pace-up button” is pressed, the music tempo is made fast, the music data corresponding to that is selected, the music data to be played is switched, and the target heart rate is increased. Even with a high heart rate, the music tempo will not be as slow as before.
The switching of the music data to be played when the above button is pressed may change the music tempo quickly by omitting the reproduction of the crossfade and connecting music data.

  Further, the music tempo and target heart rate set by the setting unit 7 are changed according to the value of the music tempo instructed to be changed by the music tempo change instructing unit, and stored as a new set value even when the power is turned off. By doing so, the effect of the change instruction during exercise is reflected in the subsequent reuse. That is, at the time of walking or running that will be started in the future, using the initial music tempo value and the target heart rate that reflect the pressing of the “pace down button” and “pace up button” in the past, more appropriate exercise by the user Can help.

The music data selection function in the playback control unit 10 is the same as that in the playback control unit 5 in the free mode of FIG.
When the playback section of the selected music data ends, the playback control unit 10 may change the music tempo specified by the music tempo specifying unit 9 as described above. When the change is made, the reproduction control unit 10 selects music data having a music tempo having a value corresponding to the changed music tempo from the plurality of music data stored in the data storage unit 2.

Also in the assist mode of FIG. 1B, when the user is walking or running using the walking tempo detection unit 3 shown in FIG. 1A, the step timing of walking or running (step start timing) By providing the function for detecting the music data, the playback control unit 10 synchronizes the first beat timing of the music data playback section with the detected step timing when the music data playback is started first or thereafter. As described above, the reproduction of the music data can be started.
If the user is walking or running so that the step timing matches the beat timing of the currently reproduced music data, the music data that is newly started to be reproduced at the beat timing of the currently reproduced music data. It is only necessary to synchronize the beat timing, and it is not necessary to add a means for synchronizing the beat timing with the step timing described above.

Furthermore, the music data reproduction unit 6 described above may include a beat sound generation unit.
A beat sound is a sound that is generated for a short time at the timing of the beat. It can also be realized by reproduction.
When the music data already described is reproduced, it may be difficult to grasp the music tempo depending on the music piece. However, if it cannot be grasped, the user cannot change to a walking tempo that matches the music tempo.

Accordingly, a beat sound generation setting unit (not shown) that sets whether or not to generate the above-described beat sound according to a user's selection operation is provided, and the beat sound generation unit is set to generate a beat sound. The beat tempo is generated at the music tempo designated by the music tempo designation unit 9.
Since the beat sound is easier to grasp the music tempo than the music data, the user can easily change to a walking tempo that matches the music tempo. At that time, the music data playback unit 6 plays back the music data at the same time, but may not output the music data playback output (mute).

Here, the beat sound generation unit generates a beat sound with the value of the music tempo of the music data being played back, and the beat timing (beat position) of the music data being played and the first beat timing of the beat sound. It is preferable to synchronize (beat position).
The music tempo of the music data to be played does not take a strictly constant value. Therefore, as playback progresses, there may be a large phase shift between the beat position of the music data and the beat position of the beat sound. Therefore, even during playback after the start of playback, It is desirable to synchronize the beat position with the beat position of the beat sound.
Therefore, it is necessary to continuously detect the beat position of the music data being reproduced, not only at the beginning.

For example, if the music data being reproduced is in a waveform data format, the beat position is detected by automatically analyzing the music data.
Alternatively, the beat position data may be stored in the data storage unit 2 together with the music data. That is, as shown in FIG. 2 (f), in the music management data for the music data file in the waveform data format, the beat position data in at least a predetermined playback section in the music is represented by the beat positions (1), (2). , (3), ...
If the music data being played is in the performance data format, the music data is analyzed, and the beat position itself can be easily detected or estimated based on the event timing of the note data. Can do. Therefore, as shown in FIG. 2G, it is not always necessary to store the beat position data as the music management data.

In FIG. 1B, the following functions can be provided by adding the above-described beat sound generating unit and the walking tempo detecting unit 3 of FIG.
When the walking tempo detected by the walking tempo detection unit 3 is out of a predetermined range from the music tempo specified by the music tempo instruction unit 9, a beat sound is generated with the music tempo value of the music data being reproduced. I will let you.
In this case, similarly, it is desirable to synchronize the phase of the beat position of the music data being reproduced and at least the first beat position of the beat sound.
The music data playback unit 6 plays back music data at the same time, but may not play back music data (mute).
Note that the above-described beat sound generator may generate the above-described beat sound alone or with music data even in the free mode shown in FIG.
Further, the “musical tone” data described with reference to FIG. 2 can be used in the assist mode as well as in the free mode.

FIG. 3 is a hardware configuration diagram for realizing the embodiment of the present invention shown in FIG.
As a specific example, a case of realizing as a portable music player with a built-in acceleration sensor is shown. It is suitable for a user to jog or run outdoors with the apparatus attached to his / her waist or arm. The functions of this portable music player can be incorporated into a cellular phone terminal or PDA (Personal Digital Assistant).

In the figure, 21 is a CPU (Central Processing Unit), 22 is a flash ROM (Read Only Memory)
, 23 is a RAM (Random Access Memory).
The CPU 21 implements the functions of the present invention using a control program stored in the flash ROM 22. The RAM 23 is used not only as a temporary data storage area necessary for the CPU 21 to perform processing, but also as a music data cache memory.
The flash ROM 22 is used as the data storage unit 2 shown in FIG. 1, and stores a plurality of music data in a waveform data format or a performance data format. Instead of the flash ROM 22, a small and large-capacity hard magnetic disk may be used.

When the music data is selected from the music data stored in the flash ROM 22, the CPU 21 temporarily stores the selected music data in the RAM 23 as a cache memory. When reproducing the music data, the CPU 21 transfers the music data stored in the cache memory to the waveform reproducing unit 30.
An operation unit 24 is a power button on / off, push button switch for various selections and various settings, and the like. Reference numeral 25 denotes a display unit, which includes a display of setting input contents, a music playback state display, a liquid crystal display for displaying results after exercise, various instruction light emitting diodes, and the like.

Reference numeral 26 denotes a walking tempo detector. Specifically, it is built into this device and is a 2-axis or 3-axis acceleration sensor or vibration sensor that detects the movement of the user's body, that is, the impact when a step is taken with the right or left foot. Therefore, a known one used for a pedometer can be used.
If the walking tempo detector 26 is the acceleration sensor itself, the CPU 21 executes an algorithm for extracting the timing of the walking step, measures the time length of one step, and calculates the walking tempo. However, these processes may be executed on the walking tempo detection unit 22 side and output to the CPU 21 including the walking tempo and, if necessary, the start timing of the walking step.
A heartbeat detector 27 is attached to the user's finger when a pulse sensor is used, and a headphone or an earphone integrated with the heart rate monitor is known when a heart rate monitor is used.

A power control circuit 28 controls power supply from the power supply 29 to the CPU 21 and the USB terminal.
The music data reproduction circuit 30 receives music data selected and switched by the CPU 21, converts it into an analog signal, amplifies it, and outputs it to headphones, earphones, speakers, and the like.
Specifically, the function to input waveform data and reproduce analog waveform data, the function to decompress if compressed waveform data such as MP3, and the input of performance data to convert analog waveform data It has a MIDI synthesizer function for playback. In either case, a function for adding effects such as reverberation and echo is provided by an effector function.

The server device 33 includes a database that stores music data.
The personal computer (PC) 32 accesses the server device 33 via the network, and the user selects and downloads desired music data from the database.
Next, when the downloaded music data does not include the music tempo data, the personal computer 32 executes the music tempo extraction program, and the personal computer (PC) 32 along with the downloaded music data. Store in the memory.
At this time, as shown in FIG. 2 (e), the tempo change position is also stored in the memory for those whose music tempo changes midway. The music analysis, beat positions (1), (2),... Are also executed and stored in the memory.

The personal computer (PC) 32 also manages the music tempo and the like described above for the desired music data captured from a recording medium such as music data stored on its own HD (Hard Disk) or CD (Compact Disc). Data may be extracted and stored with the music data.
Techniques for automatically extracting music tempo by analyzing music data in the waveform data format are well known in Japanese Patent Application Laid-Open Nos. 64-21498 and 8-201542. At that time, the beat position is detected as the timing when the volume level is increased.
When the music tone data is used for selection of music data, the personal computer 32 analyzes the music data and makes a determination by the user, or the database creator determines the music tone and registers the music tone data when it is registered in the database in advance. Save. Musical tone analysis is known in the field of automatic music selection technology for music data reproduction.

In the music data acquisition mode, the CPU 21 transfers music data having management data such as music tempo data from the memory of the personal computer 32 to the flash ROM 22 via the USB terminal and stores it.
Note that the extraction and addition of management data such as the music tempo, beat position data, and tune data described above may be realized by program processing on the CPU 21 side. Further, the music recorded by the microphone may be executed while directly recording (direct recording) on the flash ROM 22.
Further, when update firmware is prepared in the server device 33, the firmware stored in the flash ROM 22 can be updated via a personal computer.
A plurality of music data with management data such as music tempo stored in the flash ROM 22 can be stored as preset data when the apparatus is shipped from the factory.

The apparatus can also be realized in a stationary manner for indoor exercise, for example when running on a treadmill. In this case, the present apparatus can be realized by causing the personal computer to execute the application program.
The user wears a heart rate detector (pulse sensor or heart rate monitor integrated headphone, earphone) 27 and transfers data output from each to the main device via a cable or wirelessly. The reproduced music data may be output from the speaker of the main device, or may be output to headphones or earphones worn by the user via a cable or wirelessly.
This apparatus can also be used as a normal music playback apparatus. In that case, it reproduces as music data without considering the prelude part and the follower part.

The specific examples described above are all music playback devices. However, the present invention can be used as a music playback control device by providing an external device with a music playback function, a music data storage unit, and a music data writing function. It can also be realized.
Specifically, the music playback function, the music data storage function, and the music data acquisition function are realized by an existing playback device such as a multimedia player, and the existing playback device has a music playback control interface. Put on.

In addition, an apparatus having an intermediate function up to the music playback apparatus can be configured by arbitrarily adding a music playback function, a music data storage unit, and a music data writing function to the music selection apparatus described above.
If music data is preset in the flash ROM 22 and music data is not downloaded from the database, the music data acquisition function is not required.

4 to 12 are explanatory diagrams showing the embodiment of the present invention shown in FIG. 1 with a specific example. Although specific numerical values may be specified, these numerical values are examples.
FIG. 4 is a flowchart showing an operation example of the embodiment of the present invention. The CPU 21 shown in FIG. 3 executes the process of each step by executing the firmware.
The process shown in the flowchart of FIG. 4A is started by turning on the power switch.
In S41, the apparatus is initialized. When there is no input operation in S42 and the playback flag described later is ON in S43, the playback whose details are shown in FIG. The process is executed, and the process returns to S42.
If there is an input operation, in S44, the device settings shown in detail in FIG. 4B are set, and the process returns to S42.

FIG. 4B is a flowchart of the device setting process (S44 in FIG. 4A). Depending on the user's operation, it takes in music data, selects a mode, and starts / stops playback.
If the input operation is the fetching of music data in S51, writing of the music data stored in the personal computer 32 to the flash ROM 22 is started in S52. In S54, the music management data is written into the flash ROM 22. At this time, if music tempo or the like is extracted by this apparatus, the music data is analyzed.
In S55, the music data is written into the flash ROM 22.

If the input operation is mode selection in S53, the designated mode is set in S56. As will be described later with reference to FIG. 8, there is one type of free mode, but various modes are prepared for the assist mode.
If the input operation is a start button operation in S57, the reproduction flag is turned on in S58. While it is on, playback processing is executed.
In S57, if the input operation is other operation, in S59, the basic setting according to the user illustrated in FIG. 8 described later, the setting before starting the exercise, and the input operation during music playback are detected, and the corresponding processing is performed. Perform.

FIG. 4C is a flowchart of the reproduction process (S45 in FIG. 4A).
If the free mode is selected in S61, the process proceeds to S62 to acquire the user's walking tempo based on the detection output of the walking tempo detector 26, and a new music tempo is detected when a change in the walking tempo is detected in S64. (Details will be described later with reference to FIG. 5).
In S65, when the designated music tempo is changed, or when a predetermined reproduction time of the music data being reproduced ends, the process proceeds to S66 (details will be described later with reference to FIG. 7). The flash ROM 22 is searched, music data having a music tempo value corresponding to the instructed music tempo is selected, and transferred from the flash ROM 22 to the cache memory (RAM 23). In S67, the selected music data is transferred from the cache memory to the musical sound data reproduction circuit 30, and reproduction is started.

On the other hand, in the assist mode, the process proceeds from S61, S63 to S68, and the heart rate of the user is acquired based on the detection output of the heart rate detector 22 (the moving average may be calculated at that time). In S69, the music tempo is instructed according to the range of the user's heart rate from the optimum heart rate curve (details will be described later with reference to FIG. 10), and the process proceeds to S65 to change the instructed music tempo. Or when the playback time of the music data ends, the selection of the music data and the playback of the selected music data are started. However, in this embodiment, the determination conditions in S65 are different from those in the free mode.
If it is other mode, the process proceeds from S61, S63 to S70, and other processes are performed. In the mode of reproducing as a normal music player, music data is reproduced regardless of the walking tempo and heart rate.

FIG. 5 is a flowchart showing details of the process of instructing the music tempo in the free mode (FIG. 4 (c) S64). A case will be described in which the walking tempo detector 26 outputs step (start) timing in pulses for each step of walking.
In S81, the time (step time) required for one step of walking is measured, and a plurality of steps are temporarily stored in the RAM 23 or the like.
In S82, noise is removed by calculating a moving average of the step times of the remaining four steps except for one step each of the maximum value and the minimum value among the past six steps. Next, in S83, the number of steps per minute is calculated from the calculated moving average, and this is set as the walking tempo value.

Next, the music tempo is designated.
In S84, the music tempo value of the music data being played back is acquired.
In S85, whether or not the detected value of the walking tempo has continued for 6 steps (6 steps) from the value of the music tempo being played is ± 3 BPM (Beat Per Minutes) or more, , It is determined whether or not the state outside the “first predetermined range” has continued. This is equivalent to 3 seconds when the walking tempo is 120 BPM, and 2 seconds when the walking tempo is 180 BPM.

If yes, the process further proceeds to S86, and whether or not the walking tempo has continued for 6 steps within a range of ± 3 BPM from the moving average value of 6 steps, that is, the variation of the walking tempo is “second predetermined range”. It is determined whether or not a state that falls within the range continues.
If yes, in S87, “current walking tempo” is designated as a new walking tempo. Here, the “current walking tempo” may be the value of the walking tempo of the sixth step itself, or may be the moving average value of the six steps of the walking tempo.
In S88, the music tempo value to be designated is changed to a new walking tempo value.
When any determination condition is not satisfied in S85 and S86, the value of the music tempo to be instructed is not changed.

In the specific example described above, the step S82 is configured not to be affected by temporary fluctuations in every walking step. The step of S85 prevents the music tempo from being changed frequently by a slight change in the walking step. Further, by adding the step S86, a new music tempo is not instructed until the change in the walking step is stabilized, but S86 may be omitted.
As a result, it is possible to prevent the music data from being frequently switched and becoming unpleasant or restless.

The above-mentioned first predetermined range is a range of ± first predetermined difference of the music tempo value of the music data being played back, but may be a range of ± first predetermined ratio.
The above-mentioned second predetermined range is a range in which the walking tempo is ± second predetermined difference from the moving average of the walking tempo, but from the moving average of the walking tempo, ± 2 It is good also as the range of this predetermined ratio.

FIG. 6 is an explanatory diagram showing a specific example of the reproduction control operation in S65 to S67 in FIG. 4C in the free mode. The blackened part is the section of the prelude part or the follower part, and the hatched part is the crossfade section.
Numbers (a) to (e) are attached to the music data. At the start of walking, music data (a) is selected and played from the position after the end of the prelude, preferably so that the first beat timing of the playback section of music data (a) coincides with the step timing . As a result of the walking tempo changing beyond the predetermined range at the elapsed time (1), the music tempo to be instructed is changed, and music data (c) having a music tempo value corresponding to the new music tempo is selected.

Here, it is the simplest switching method with no time delay that immediately starts the reproduction of the music data (c) from the position after the end of the prelude part.
However, when the original music data ( a ) before switching is also played back for a time of about several seconds (for example, 5 seconds) and both are played back by cross-fading, the sense of music connection is improved.
In this embodiment, in addition, after the connection music data (b) is reproduced, the next music data (c) is started to be reproduced at the elapsed time (2), thereby improving the sense of connection of music. ing.

The music data (a) and the connection music data (b) are cross-faded, and only the connection music data (b) is reproduced, and then the connection music data (b) and the music data (c) are cross-faded. Thereafter, only the music data (c) is reproduced.
In the example shown in the figure, the cross fade is performed within the reproduction time from which the prelude part and the follower part are removed.
The connection music data may be waveform-format music data, but may be music data in the performance data format, for example, the performance data used for generating the beat sound described above. The performance tempo of the performance data can be easily changed.

The reproduction control unit 5 starts reproduction so that the connected music data (b) matches the music tempo and beat timing with the previous music data (a).
Next, the playback control unit 5 changes the music tempo in a plurality of stages so that the music tempo of the subsequent music data (c) becomes the music tempo of the subsequent music data (c) in the elapsed time (2) from the music tempo of the connection music data (b). be able to.
The playback control unit 5 determines the playback start timing (elapsed time (2)) and starts playback so that the first beat timing of the playback section of the subsequent music data (c) matches the step timing. Is desirable. It is desirable that the playback controller 5 further controls the beat position of the connecting music data (b) so as to coincide with the first beat timing of the playback section described above.
The playback time of the connection music data (b) described above may be a fixed time of about 5 seconds to 10 or may be an arbitrary time for crossfading with the subsequent music data (c).

When the music data (c) is reproduced until a predetermined reproduction time (in the illustrated example, before the follower part), the reproduction ends. For this reason, the playback control unit 5 advances the time when the playback section of the music data being played ends (time point after the elapsed time (3) by the crossfade time) (however, considering the processing time). The music data (d) having a music tempo having a value corresponding to the instructed music tempo is selected, and reproduction is started at the elapsed time (4). However, the music data (c) may be started to be played again.
Also in this elapsed time (3), the music data (d) is crossfade between the music data (c) and the connection music data (b), and is crossfade with the connection music data (b) in the elapsed time (4). Is preferably started so that the first beat timing of the reproduction section of the music data (d) coincides with the step timing.

Thereafter, at the elapsed time (5), it can be seen from the walking tempo value detected by the walking tempo detector 26 that the user has stopped walking, or a predetermined time before the end of the predetermined exercise time (reproduction time). A case will be described in which an instruction to end the reproduction is input due to the user operating the stop button.
In such a case, the reproduction of the current music data (d) may be stopped immediately, but the music data (d) being reproduced may be reproduced including the later playing part. For example, when the stop button is operated once, playback is performed including the follower, and when it is further operated once, playback is immediately stopped.

However, in this embodiment, instead of reproducing the music data (d) being reproduced including the later performance part, the music data (d) is shifted to the cool-down stage.
That is, a predetermined music tempo is set for cool-down playback, the music tempo instruction unit 4 instructs the set music tempo, and the playback control unit 5 has a value corresponding to the instructed music tempo. Music data (e) having a music tempo is selected, and at the elapsed time (6), the music data playback unit 6 plays back, preferably the first beat timing of the playback section of the music data (e) coincides with the step timing. And get started.
The connected music data (b) is reproduced from the elapsed time (5) to the crossfade end position after the elapsed time (6).
When the cool-down time is set, the playback start position of the music data (e) is determined on the condition that the music data (e) is played to the subsequent part, and in the elapsed time (6), Similar to the above, the reproduction of the music data (e) is started.
If the music data is selected in consideration of the music tone at the cool-down stage described above, the cool-down effect can be obtained psychologically.

FIG. 7 is a flowchart showing details of the music data selection operation (FIG. 4 (c) S66). This process is common to the free mode and assist mode. Here, unlike the specific example described with reference to FIG. 1, a specific example in which the use of music data having the same value as the instructed music tempo is given top priority will be described.
In S91, it is searched whether or not there is music data (waveform data format) having a music tempo having the same value as the designated music tempo in the flash ROM 22, and if so, the process proceeds to S92 to satisfy the condition. If there are a plurality of music data, in S93, the music data is randomly selected from the plurality of music data. The selection history is temporarily stored in the history table, and while the instructed music tempo is continued without being changed, music data is selected at random from those other than those already selected. To. If all music data satisfying the conditions is selected, the process returns to the first selection.

Once the same music tempo is instructed again after changing to a different music tempo, the music data may be subsequently selected at random. Furthermore, if the selection history is stored in the flash ROM 22, music data can be selected at random from the past even after the apparatus is turned off.
On the other hand, if there is not a plurality of music data in S92, the music data is selected in S94.

In S91 and S95, it is searched whether there is music data (waveform data format) having a music tempo that takes a value within a range of ± 3% from the instructed music tempo. Music data having a tempo value closest to the instructed music tempo value is selected.
Also in this case, the selection history is temporarily stored in the history table, and while the specified music tempo continues without being changed, the music with the closest value from the ones excluding those already selected is selected. Select data. If all music data satisfying the conditions is selected, the process returns to the first selection.
Alternatively, when the same music tempo is instructed again after changing to a different music tempo, the music data having the closest value may be selected from those other than those already selected. Good. Further, the selection history may be stored in the flash ROM 22.

  If there is no music data (waveform data format) having a music tempo that takes a value within a range of ± 3% from the instructed music tempo in S95, the music tempo closest to the instructed music tempo is selected in S97. The selected music data (performance data format) is selected, and the music tempo data instructed to the musical sound data reproduction circuit 30 is transferred. The musical sound data reproduction circuit 30 reproduces music data (performance data format) at the instructed music tempo.

In the description with reference to FIG. 1 (a), the reproduction control unit 5 determines that when one or a plurality of music data having a music tempo within a predetermined range from the instructed music tempo value is stored. Or the specific example which selects music data at random from several music data was demonstrated. This specific example corresponds to the case where the process is started from S95, and if yes, the process of S93 is executed, and if no, the process of S97 is executed.
In the flowchart shown in FIG. 7, the music data is selected in preference to the music data in the waveform data format over the music data in the performance data format. However, in S91 to S95, the two may be handled equally.

Next, after describing a specific example of setting items for the apparatus and display items after exercise, the music tempo indicating operation in the assist mode in S69 of FIG. 4C will be described.
FIG. 8 is an explanatory diagram illustrating setting items, setting contents, and display items after the end of exercise. The setting items are mainly for the assist mode.
FIG. 8A shows basic setting items and setting items before starting exercise.
The heart rate at rest is input by measuring the lowest value of the heart rate at the time of waking up with the heart rate detector 27 attached to the apparatus in advance, or the value measured with a commercially available heart rate monitor.
Similarly, when the maximum heart rate is input, but the maximum heart rate is not known, the maximum heart rate is calculated as 220−age based on the input age.

Based on the resting heart rate and the maximum heart rate, n [%] of the predicted maximum heart rate reserve, that is, the heart rate corresponding to n% HR Reserve is calculated by the following equation.
Heart rate equivalent to n% HR Reserve =
(Maximum heart rate-Resting heart rate) x n / 100 + Resting heart rate ……… (1)
Here, the predicted maximum heart rate reserve (HR Reserve) is (maximum heart rate−resting heart rate).

n [%] is exercise intensity, which is a ratio based on the predicted maximum heart rate reserve. 0 [%] when the heart rate is a resting heart rate, and 100 [%] when the heart rate reaches the maximum heart rate.
The exercise intensity n [%] is calculated by the following formula.
Exercise intensity n [%] =
(Heart rate-Resting heart rate) / (Maximum heart rate-Resting heart rate) x 100 (2)

In the setting items before the start of exercise, one is selected from the above-described free mode or a plurality of types of assist modes.
A mode for normal music playback may be provided. It may be possible to switch from the free mode and the assist mode to the normal music playback mode by operating the setting operation element during exercise.
For the mode setting, the previously set mode may be set by default. An exercise program mode may be automatically changed every day by providing a schedule management function.

In the illustrated example, the exercise time is set, but when the stop button is operated, the reproduction of the music data can be ended or the reproduction can be shifted to the cool-down stage. Therefore, it is not always necessary to set the exercise time. When the distance, calorie consumption, amount of burned fat, etc. reach predetermined values, the playback time of the music data can be automatically ended or played back in the cool-down stage.
An exercise program (exercise menu) optimum for the user is generated according to the type of assist mode and the basic setting items of each user.

FIG. 8B shows items that are specifically set by the exercise program when “jogging mode”, which is a kind of assist mode, is selected.
Warming up 1, warming up 2, jogging (main motion stage), cool down 1 and cool down 2 are set as exercise stages. In each exercise stage, execution time, music tempo initial value [BPM] optimum for user and target Exercise intensity [%] is set. Instead of the target exercise intensity n [%], the target heart rate [BPM] that is n [%] of the predicted maximum heart rate reserve may be set.

Here, the music tempo initial value [BPM] and the target exercise intensity [%] that are optimal for the user are set to default values depending on the basic setting item, the setting item before exercise, etc. You may enable it to change by operation of a pace down button. In order for this change to be reflected in subsequent exercises, the default value optimal for the user may be changed and stored.
Further, the default value may be changed based on the user's physical strength age or the like based on past exercise results.
FIG. 8C shows items displayed after exercise. The travel distance is calculated by calculating the stride from the height and multiplying it by the number of steps. The calorie consumption is calculated from the work amount. The amount of fat burning is calculated from the time when the exercise intensity was 70%.

FIG. 9A is an explanatory diagram showing the optimum exercise strength characteristic (optimum exercise strength curve) in the jogging mode which is an example of the assist mode. The horizontal axis is the exercise elapsed time [minutes], and the vertical axis is the target exercise intensity n [%]. Instead of the target exercise intensity, a target heart rate (a heart rate corresponding to n% HR Reserve) may be used. In this case, it can be said that the optimum heart rate characteristic for each mode (optimal heart rate curve for each mode).
FIG. 9B is an explanatory diagram showing music tempo setting values in the same jogging mode. The horizontal axis is the exercise elapsed time [minutes], and the vertical axis is the music tempo setting value [BPM].
Both are determined by the set values shown in FIG.

In this embodiment, the music tempo is changed according to the comparison between the user's exercise intensity (heart rate) and the range from the target exercise intensity (target heart rate), limited to “jogging” (main exercise stage). , Helping users exercise.
In “warming up 1” and “warming up 2” (exercise start stage), the set music tempo value is instructed as it is. The target exercise intensity (target heart rate) is merely a guideline for the exercise program. The set value of the music tempo may be one, but in the example shown in the figure, it is a value that changes in two stages with the passage of time in the exercise start stage.

In “jogging” (main exercise stage), the music tempo setting value is set as an initial value. The target exercise intensity (target heart rate) of the user takes a constant value, and an appropriate range from the target exercise intensity n [%] is set. In the illustrated example, this is set to n ± 5 [%] around the target exercise intensity n [%]. An appropriate range from the target exercise intensity n [%] may be set as a ratio to the target exercise intensity n [%].
In addition, a warning range is also set. In the example shown in the drawing, this is a range that is symmetrical with respect to the target exercise intensity n [%], that exceeds n + 15 [%], and that exceeds n−15 [%]. Note that the warning range from the target exercise intensity n [%] may be set as a ratio to the target exercise intensity n [%].

When the user's exercise intensity at the current elapsed time does not exceed the appropriate range from the target exercise intensity, the music tempo is not changed.
However, when the user's exercise intensity exceeds the appropriate range from the target exercise intensity and exceeds a predetermined range that is wider than the appropriate range, the difference between the user's exercise intensity and the target exercise intensity is The music tempo is changed even during the music reproduction so that the music tempo is reduced, new music data having a music tempo corresponding to the changed music tempo is selected, and reproduction of the selected music data is started.

  If the user's exercise intensity exceeds the appropriate range from the target exercise intensity and does not fall within the warning range when the playback time of the music data currently being played ends, the user's exercise intensity and the target exercise Change the music tempo so that the difference with the intensity is small, and after the playback time of the currently playing music data ends, select the next music data with the music tempo of the value according to the changed music tempo To start playback of the selected music data.

  Also in “cool down 1” and “cool down 2” (exercise end stage), the set music tempo value is instructed as it is, as in “warming up”. The target exercise intensity (target heart rate) is merely a guideline for the exercise program. The set value of the music tempo may be one, but in the example shown in the figure, it is a value that changes in two stages according to the passage of time in the exercise end stage.

Note that the music tempo setting value in “cool down 1” may be changed in consideration of the actual walking tempo of the user.
That is, by using the walking tempo detector used in the free mode, the walking tempo detected by the walking tempo detector before entering the exercise end stage and the music tempo value set in the exercise end stage are obtained. A comparison is made and a value obtained by changing the value of the music tempo set at the end of the exercise is indicated according to the comparison result.
More specifically, a value that is smaller than the walking tempo detected before entering the exercise end stage by a predetermined value is compared with the music tempo value set at the end of exercise stage, and the smaller one is specified. The music tempo value to be used.
The predetermined value described above is a predetermined ratio of the detected walking tempo, but may be a simple predetermined value.

The music tone can be reflected when selecting the music data to be reproduced at the start of exercise such as warm-up 1 and warm-up 2 and at the end of exercise such as cool-down 1 and cool-down 2.
In the warm-up stage, music data having a tune (up tempo tune) that makes the tempo of the music feel faster is selected. In the cool-down stage, music data having a musical tone (down-tempo musical tone) that makes the music feel slow is selected.

In the assist mode, the change of the music tempo instruction value and the timing of music data selection and playback switching are closely related in the main exercise period in which assistance is actually performed.
FIG. 10 is a flowchart showing details of the music tempo instruction operation (S69 in FIG. 4C) during the main exercise period in the assist mode. In FIG. 9, the operation is in jogging (main motion stage). As already noted, the numbers are examples.
In S101, the actual exercise intensity [%] is calculated from the actual heart rate (HR) detected by the heart rate detector 27 based on the equation (2). In the following steps, the actual heart rate and the target heart rate are converted into exercise intensity and compared.

In S102, if the moving average (20 seconds) of the actual exercise intensity is less than 55 (= 70-15)%, the process proceeds to S103, and the music tempo is instantaneously made 5% faster than the present.
In S104, if the moving average (20 seconds) of the actual exercise intensity exceeds 85 (= 70 + 15)%, the process proceeds to S105, and the music tempo is instantaneously delayed by 5% from the present.
In S106, if the moving average (20 seconds) of the actual exercise intensity is 55 (= 70-15)% or more and less than 65 (= 70-5)% 6 seconds before the end of the music data playback time, the process is processed in S107. The music tempo of the music data to be started next is made 5% faster than the present.
In S108, if the moving average (20 seconds) of the actual exercise intensity exceeds 75 (= 70 + 5)% and less than 85 (= 70 + 15)% 6 seconds before the end of the music data playback time, the music to be started next Decrease the music tempo of the data by 5%.

In the processing described above, the moving average is taken in order to reduce the influence of temporary fluctuations in the heart rate. The actual heart rate itself acquired in S101 also takes a moving average when measuring the cycle of the heartbeat. However, since it is still insufficient, the moving average is also taken in the above-described processing.
In S106 and S108 of the above-described processing, “6 seconds before the end of the music data playback time” is set because the determination position is advanced for 5 seconds immediately before the end of the music data playback time in order to crossfade with the connection music data. It is. In addition, the determination position is advanced for another 1 second in consideration of the delay caused by the processing after the determination in this step.

FIG. 11 is an explanatory diagram showing a specific example of the regeneration control operation in FIG. 4 (c) S65 to S67 during the main exercise period in the assist mode. FIG. 9 shows a regeneration control operation in jogging (main motion stage).
The music data is provided with codes (a) to (f), but is not related to the codes used in FIG.
At the start of the main exercise stage, music data (a) is selected and playback starts from the position after the prelude. Is done.

  As a result of the actual exercise intensity (moving average) entering the warning range at the elapsed time (1), the music tempo to be instructed is changed, and music data (c) having a music tempo with a value corresponding to the changed music tempo is obtained. Selected. Similarly to the case of the free mode shown in FIG. 6, the connection music data is inserted and the crossfade reproduction is performed. Accordingly, the music data (c) starts to be reproduced from the elapsed time (2). The connected music data (b) is such that the beat timing coincides with the preceding and succeeding music data (a), (c), and the music tempo is changed from the music tempo of the music data (a) to the music data (c). The music tempo is changed in stages. In this way, the music data to be played can be switched seamlessly.

When the music data (c) is reproduced until a predetermined reproduction time (before the follower in the illustrated example), the reproduction ends.
At that time, the actual exercise intensity (moving average) changes before (6 seconds before) the playback end position of music data (c) (5 seconds after the elapsed time (3) in the example of FIG. 10). If it is not within the warning range but outside the appropriate range, the music tempo to be instructed is changed. When searching for music data to be started next, music data having a music tempo of a value corresponding to the changed value of the designated music data is searched, and music data (d) is selected.
As a result, the playback of the connected music data (b) is started from the elapsed time (3), and is crossfade to the playback end position of the music data (c). From the elapsed time (4), the reproduction of the music data (d) is started from the position after the prelude and is crossfade with the connecting music data (b).

When the music data (d) is also played up to a predetermined playback time (before the later part), the playback ends. At that time, if the actual exercise intensity (moving average) is not out of the appropriate range before (6 seconds before) the playback end position of music data (d) (5 seconds after the elapsed time (5)), The music data to be started next is searched and the music data (e) is selected without changing the designated music tempo.
As a result, the playback of the connected music data (b) is started from the elapsed time (5), and is crossfade to the playback end position of the music data (d). From the elapsed time (6), the reproduction of the music data (e) is started from the position after the prelude and is crossfade with the connecting music data (b).

Next, at the elapsed time (7), when the end time of the main exercise stage is reached, the process is shifted to the cool-down stage, which is not shown in the flowchart of FIG.
In FIG. 1 (b), a music tempo suitable for the user is set for cool-down, and the music tempo instruction unit 9 instructs the set music tempo. The playback control unit 10 selects music data (f) having a music tempo value corresponding to the instructed music tempo, and causes the music data playback unit 6 to start playback at the elapsed time (8).
The connected music data (b) is reproduced from the elapsed time (7) to the crossfade end position of the elapsed time (8).
If the cool-down stage time is set, the playback start position of the music data (f) is determined on the condition that the succeeding part of the music data (f) is played, and the elapsed time (8) Then, playback of the music data (f) is started.

In the assist mode, as described with reference to FIG. 6, when an instruction to end the playback is input, the music data being played is also played back including the later playing section, For example, music data having a music tempo corresponding to the down music tempo may be selected and played back to the end of the later part.
9 to 11, only the appropriate range may be set and the warning range may be eliminated.
At that time, change the music tempo to be instructed when it is outside the proper range, or when the playback time of the music data being played ends (if it is outside the proper range at this point) To.

FIG. 12 is a graph showing a specific example in which playback control is performed using the optimal exercise intensity characteristic (optimal exercise intensity curve) and the set value of the music tempo in the jogging mode shown in FIG.
In the figure, the horizontal axis is the exercise elapsed time [min], the vertical axis (left scale) is the actual exercise intensity [%], the target exercise intensity [%], and the vertical axis (right scale) is the music tempo [BPM].
The time length for taking the moving average is 4 [seconds] instead of 20 [seconds] shown in FIG. The upper limit of the music data playback time is 2 [minutes] 5 [seconds] (crossfade time, eg 5 [seconds] is added). The connecting music data (b) is not inserted.

In the “warming up 1” stage, music data having a music tempo of 146 [BPM] that is closest to the set value 145 [BPM] has been stored, so that this music data is selected and reproduction of the music data is started.
After 1 [minute], “warming up 2” stage was entered, and music data having a music tempo of 156 [BPM] closest to the setting value 155 [BPM] was saved, so this music data was selected, Play music switches while crossfading for 5 seconds.
3 [minutes] later, 5 seconds before the music data playback time (2 minutes 5 seconds) and the same music tempo of 156 [BPM] as before, but different music data was saved, so this is selected The playback music switches while being crossfade for 5 seconds.
After 4 minutes, the “jogging” stage was entered, and music data having a music tempo of 161 [BPM] closest to the set value 160 [BPM] was stored. Switch while crossfading for 2 seconds.

When the actual exercise intensity [%] is compared with the predetermined range ± 5 [%] from the target exercise intensity 70 [%], the specified music tempo is switched 6 seconds before the end of the playback time. Music data having a music tempo value closest to is selected, and the playback music is switched one after another while the playback music is cross-faded 5 seconds before the end of the playback time.
In this example, the actual exercise intensity [%] did not fall outside the warning range ± 15 [%], so change the music tempo 6 seconds before the end of the playback time of the playback music. There was no.

After 12 minutes, enter the “Cool Down 1” stage. The set value of music tempo is 150 [BPM]. However, at 11 [minutes] 59 [seconds] one [second] before, the actual walking tempo was 148 [BPM], so the difference is small. For this reason, the cool-down effect cannot be obtained, so in this specific example, at the end of the main movement stage, a value (137 [BPM]) that is -7 [%] of the actual walking pitch and the "cool-down 1" stage The music tempo that is the smaller value (137 [BPM]) of the initial value (150 [BPM]) is designated.
Music data having the closest music tempo of 134 [BPM] within the range of ± 3 [%] of the instructed music tempo of 137 [BPM] was saved, so this was selected and 12 [minutes] After the elapse of time, the playback music is switched while being crossfade.

After 13 minutes, enter the “Cool Down 2” stage. The music tempo setting is 110 [BPM].
Music data with the music tempo of the nearest 108 [BPM] within the range of ± 3 [%] of the setting value 110 [BPM] has been saved, so this is selected and the playback music is played while being crossfade Switch.
When 15 minutes elapses, the exercise time ends and the music data playback ends.
In the warm-up and cool-down stages, the music tempo value of the music data to be specified is changed according to the range from the target exercise intensity (target heart rate) at each stage of exercise intensity, and the music data is switched. Thus, the user's exercise may be supported.
In addition, the target exercise intensity (target heart rate) may be a time function that changes with the passage of time instead of a constant value at each stage including the main exercise stage.

  In the above description, various parameters for which numerical values are set in advance, such as a time length for taking a moving average and a predetermined range when comparing values, are used. The values of these parameters affect the response characteristics and sensitivity. Therefore, the parameter value may be a fixed value or may be arbitrarily set by a walking tempo value, a music tempo value, a user condition setting operation, or the like. Further, it may be automatically customized to a value suitable for each user according to the past use history.

In the above description, the case where the user listens to music while jogging or running has been described as an example.
However, the present invention is applied when listening to music while performing repetitive exercise such as exercise, gymnastics, and dance using a training machine such as a bicycle type ergometer, tredmill, strength machine, etc. it can. Depending on the type of repetitive motion, an acceleration sensor may be attached to an appropriate part of the human body, an acceleration characteristic to be one step of the iteration may be determined, and an algorithm for detecting this one step of the iteration may be designed.
In this case, in the free mode, instead of the walking pitch, a repetitive tempo (the number of repetitions per unit time) determined by one step time of the repetition as a unit is detected according to each repetitive motion. In the assist mode, an initial value of the repetition tempo is set instead of the initial value of the walking pitch. The target exercise intensity (target heart rate) is set similarly.

In the above description, the music content of the musical sound data has not been described. The music content is not limited to the musical instrument performance, but may be anything that can feel a beat, such as vocals only or vocals with accompaniment. If necessary, a music genre may be set, and music data having an appropriate music tempo may be selected within the set music genre.
The above description has been made on the assumption that a plurality of music data is reproduced at the music tempo. However, in the above description, the technique for instructing the music tempo according to the walking tempo or the heart rate, the phase synchronization with the walking step at the first beat timing, the reproduction control when stopping the exercise, the warm-up stage, and the cool-down stage are performed. The technology such as providing can also be applied to a case where a conventional technology such as changing the tempo of an electronic sound or reproducing predetermined music data by changing the music tempo is premised.

It is a functional block diagram of one Embodiment of this invention. It is explanatory drawing which shows an example of the data memorize | stored in the data storage part shown in FIG. It is a hardware block diagram which implement | achieves one Embodiment of this invention shown in FIG. It is a flowchart which shows one operation example of embodiment of this invention. 5 is a flowchart showing details of music tempo instruction processing in free mode in S64 of FIG. 4C. FIG. 7 is an explanatory diagram showing a specific example of the reproduction control operation in S65 to S67 in FIG. 4C in the free mode. 6 is a flowchart showing details of a music data selection operation in S66 of FIG. 4C in the free mode and the assist mode. It is explanatory drawing which shows the setting item, the setting content, and the display item after the exercise end. It is explanatory drawing which shows the optimal exercise intensity characteristic in the jogging mode which is an example of assist mode, and a music tempo setting value. 7 is a flowchart showing details of a music tempo instruction operation in S69 of FIG. 4C during the main exercise period in the assist mode. FIG. 4C is an explanatory diagram showing a specific example of the regeneration control operation in S <b> 65 to S <b> 67 in the main exercise period in the assist mode. FIG. 10 is a graph showing a specific example in which playback control is performed using the optimal exercise intensity characteristic and the set value of the music tempo in the jogging mode shown in FIG. 9.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Music data acquisition part, 2 ... Data storage part, 3 ... Walking tempo detection part, 4, 9 ... Music tempo instruction | indication part, 5, 10 ... Playback control part, 6 ... Music data reproduction part, 7 ... Setting input part, DESCRIPTION OF SYMBOLS 8 ... Heart rate detection part, 21 ... CPU, 26 ... Walking tempo detector, 27 ... Heart rate detector, 30 ... Music data reproduction circuit, 32 ... Personal computer, 33 ... Server apparatus

Claims (9)

A heart rate detecting means for detecting a heart rate when the user performs repetitive exercises;
Setting means for setting the music tempo and target heart rate;
When the music tempo set by the setting means is set as an initial value, and the heart rate detected by the heart rate detecting means exceeds a first predetermined range from the target heart rate set by the setting means, as the difference between the heart rate and the target heart rate is reduced, music actually new instructed value of the music tempo based on the value of the music tempo with the music data being played, the is currently reproduced When the data reproduction period ends, the second heart rate is within the first predetermined range from the target heart rate, and is within the first predetermined range from the target heart rate. When the predetermined range is exceeded, the music tempo value is newly set based on the music tempo value of the music data currently being played back so that the difference between the heart rate and the target heart rate becomes small. Finger And the music tempo instruction means for,
When a music tempo is newly instructed by the music tempo instructing means, and when the playback section of the music data currently being played ends, the music tempo instructing means is in accordance with the music tempo instructed by the music tempo instructing means. Playback control means for selecting music data having a value music tempo from a plurality of music data stored in the data storage means together with the music tempo data of each music data, and starting playback of the selected music data;
A music playback control device comprising: Repetitive timing detection means for detecting repetitive timing of repetitive motion when the user is performing repetitive motion;
The reproduction control means, when starting the reproduction of music data, the selected music data so that the first beat timing of the reproduction section of the music data is synchronized with the repetition timing detected by the repetition timing detection means. Start playing,
The music reproduction control apparatus according to claim 1, wherein Beat sound generation setting means for setting whether or not to generate a beat sound,
Beat sound generation control means for generating the beat sound at the value of the music tempo of the music data being reproduced when the generation of the beat sound is set by the beat sound generation setting means;
The music playback control device according to claim 1, wherein Repetitive tempo detecting means for detecting a repetitive tempo when the user is repetitively exercising;
Repetitive tempo detected by said repetition tempo detecting means, the music tempo when outside the predetermined range from the music tempo which is instructed by the instruction means, the value Devi over preparative music tempo with the music data being played Beat sound generation control means for generating sound,
The music playback control device according to claim 1, wherein Setting means for setting a music tempo at the exercise start stage of the repetitive exercise and a music tempo at the exercise end phase of the repetitive exercise,
The data storage means stores music tone data representing the degree to which each music data feels a fast and slow music tempo together with the plurality of music data,
The music tempo instruction means includes
In the exercise start stage, the value of the music tempo in the exercise start stage set by the setting means is indicated,
In the exercise end stage, the music tempo value in the exercise end stage set by the setting means is indicated.
The reproduction control means includes
In the exercise start stage, the music tempo data of a plurality of music data stored in the data storage means is searched, and the music tempo instruction is selected from one or a plurality of music data having a music tone that makes the music tempo feel faster. Selecting music data having a music tempo value corresponding to the music tempo instructed by the means;
In the exercise ending stage, the music tempo data of a plurality of music data stored in the data storage means is searched, and the music tempo indication is selected from one or a plurality of music data having a music tone that makes the music tempo feel slower. Selecting music data having a music tempo of a value corresponding to the music tempo instructed by the means;
The music reproduction control apparatus according to claim 1, wherein In addition to the music playback control device according to any one of claims 1 to 5,
The data storage means;
Music data acquisition means for storing music data selected in accordance with a user's selection operation together with music tempo data of the music data in the data storage means;
Music data playback means for playing back the music data selected by the music playback control device;
A music playback device comprising: A heart rate detection step for detecting a heart rate when the user is exercising repeatedly;
A setting step for setting the music tempo and target heart rate;
When the music tempo set by the setting step is set as an initial value, and the heart rate detected by the heart rate detecting step exceeds the first predetermined range from the target heart rate set by the setting step, as the difference between the heart rate and the target heart rate is reduced, music actually new instructed value of the music tempo based on the value of the music tempo with the music data being played, the is currently reproduced When the data reproduction period ends, the second heart rate is within the first predetermined range from the target heart rate, and is within the first predetermined range from the target heart rate. When it exceeds the predetermined range, the music tempo value is determined based on the music tempo value of the music data currently being reproduced so that the difference between the heart rate and the target heart rate is small. And music tempo instruction step to instruct new and,
When the music tempo is newly instructed by the music tempo instructing step, and when the playback section of the music data currently being played ends, the music tempo instructing step corresponds to the music tempo instructed by the music tempo instructing step. A reproduction control step of selecting music data having a value music tempo from a plurality of music data stored in the data storage device together with the music tempo data of each music data, and starting reproduction of the selected music data;
Playback control program that causes a computer to execute. Mode setting means for setting the music playback control function to a free mode or an assist mode according to a user's selection operation;
Repetitive tempo detecting means for detecting a repetitive tempo when the user is repetitively exercising at least when the free mode is set;
Heart rate detection means for detecting a heart rate when the user is performing repetitive exercises at least when the assist mode is set;
Setting means for setting a music tempo and a target heart rate when the assist mode is set;
When the free mode is set, the music tempo having a value corresponding to the repetitive tempo detected by the repetitive tempo detecting means is indicated, and when the assist mode is set, the setting means the set music tempo as the initial value, the heart rate detected by said heart rate detecting means, when exceeding a first predetermined range from the target heart rate set by the setting means, the heart rate and the The music tempo value is newly designated on the basis of the music tempo value of the music data currently being played back so that the difference from the target heart rate is small, and the playback section of the music data currently being played back Is completed, the second heart rate is within the first predetermined range from the target heart rate, and is within the first predetermined range from the target heart rate. When the range is exceeded, the music tempo value is newly set based on the music tempo value of the music data currently being played back so that the difference between the heart rate and the target heart rate becomes small. and the music tempo instruction means for instructing,
When a music tempo is newly instructed by the music tempo instructing means, and when the playback section of the music data currently being played ends, the music tempo instructing means is in accordance with the music tempo instructed by the music tempo instructing means. Playback control means for selecting music data having a value music tempo from a plurality of music data stored in the data storage means together with the music tempo data of each music data, and starting playback of the selected music data;
A music playback control device comprising: In addition to the music playback control device according to claim 8,
The data storage means;
Music data acquisition means for storing music data selected in accordance with a user's selection operation together with music tempo data of the music data in the data storage means;
Music data playback means for playing back the music data selected by the music playback control device;
A music playback device comprising:

Images