JP2006017874A - Music reproducing device and music reproducing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a device for intuitively selecting music pieces by using a limited operation interface. <P>SOLUTION: The selection of the music pieces can be performed according to the user's intuitive operation without complicated button operations etc., by detecting the user's operation to the system by an operation detecting means, generating a reproduction control command from the detected operation, and performing the reproduction operation, such as the selection of the music according to the reproduction control command. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a music selection technique for intuitively selecting music data stored in a music playback device, and an operation interface technique for performing music selection.

  Operation buttons such as “fast forward button”, “skip button”, “song number designation button”, etc. when selecting a specific song on a device that plays back music data recorded on a medium such as a CD player or HDD audio player It is a general operation method of a conventional music playback device that is operated by a combination of user actions on groups.

On the other hand, there has been proposed a karaoke apparatus that can control the playback tempo, volume, etc., of the music piece by swinging the baton (for example, Patent Document 1). In the case of this karaoke apparatus, the playback operation of the device can be operated by the user's intuitive operation of “shaking the baton”.
JP-A-10-55174

  However, when a desired music piece is selected by the operation button group as described above, if there are a large number of music pieces recorded on the medium, it is necessary to operate the operation button group many times before reaching the desired music piece. In addition, when a sufficient space is not allocated to the operation button group such as a portable device, the music selection operation must be performed with a small number of buttons, which imposes a burden on the operation of the user.

  In addition, when controlling with the above-described method of swinging the baton, it is possible to control the device only within the limited operation mode of the baton, and an operation that cannot be associated with the baton operation, for example, Operation such as music selection could not be performed.

  The present invention solves the above-described conventional problems, and an object thereof is to provide an apparatus for intuitively selecting music using a limited operation interface.

  In order to solve the above-described conventional problems, a music playback device of the present invention includes a motion detection unit that detects a user's motion with respect to the device, and a playback control based on the user's motion detected by the motion detection unit. Command generation means for generating a command, command definition means for defining the correspondence between the operation of the motion detection means and the command generated by the command generation means, and reproduction of music data according to the command generated by the command generation means Playback control means for controlling the music, music data storage means for storing music data to be played back by the music playback device, and feature quantity extraction means for extracting feature quantities of each music data stored in the music data storage means, The attribute information of the music data stored in the music data storage means including the feature quantity extracted by the feature quantity extraction means is stored for each song. Music attribute storage means, music selection means for referring to attribute information of each music stored in the music attribute storage means, and music selection according to control from the reproduction control means, and control from the reproduction control means And music data reproducing means for acquiring and reproducing the music data of the music from the music data storage means, and according to this configuration, the music can be reproduced according to the user's operation on the apparatus.

  In addition, the feature amount extraction unit extracts a feature amount representing the impression of the song stored in the music data storage unit, the song attribute storage unit stores the feature amount representing the impression of the song for each song, and the song selection unit By selecting a music piece with reference to the feature amount representing the impression of each music stored in the music attribute storage means, the user's operation on the device can be associated with the impression of the music, and an operation button group is provided. Using a limited operation interface such as a small music playback device that cannot be installed, music can be selected intuitively.

  Further, the motion detection means detects the strength of the vibration operation of the user with respect to the device, the command definition means defines the correspondence between the strength of the vibration motion and the music selection control information, and the command generation means is a command definition means Referring to the definition, a music selection control command corresponding to the intensity of the vibration operation for the device is generated, and the music selection means uses a feature amount representing the impression of each music stored in the music attribute storage means according to the music selection control command. By selecting a song and referring to it, it is possible to specify the impression of the song to be selected according to the state of the music playback device. The music can be selected intuitively according to the action performed by the user on the apparatus.

  According to the music playback device of the present invention, music can be played back according to the user's operation on the device.

  Embodiments of the present invention will be described below with reference to the drawings.

(Embodiment 1)
FIG. 1 is a block diagram showing a configuration of a music information extraction apparatus according to Embodiment 1 of the present invention. In FIG. 1, 11 is an action detection means, 12 is a command generation means, 13 is a command definition means, 14 is a reproduction control means, 15 is a music data storage means, 16 is a feature quantity extraction means, 17 is a music attribute storage means, 18 Represents music selection means, and 19 represents music data reproduction means.

  The motion detection unit 11 is a unit that detects the movement of the music playback device, and performs operations such as “shake”, “tap”, and “grip” performed by the user with respect to the music playback device. It is detected by an element such as a sensor or pressure sensor and output as an electrical signal. An acceleration sensor will be described as an example of motion detection. FIG. 2 is an example of an output signal when a general acceleration sensor is shaken. FIG. 2 shows an example of a signal when the acceleration sensor is shaken 5 times per second, and the number of times of shaking can be detected by setting a certain threshold value and counting the number of times the output voltage exceeds the threshold value. In the example of FIG. 2, since the threshold value 21 is exceeded from time 22 to 26, it can be detected that the signal has been shaken 5 times per second.

  The command generator 12 generates a command for music playback control from the signal output from the motion detector 11. When a signal is input from the operation detection unit 11, the command generation unit 12 refers to the command definition unit 13 and selects and outputs a corresponding control command.

  The command definition means 13 holds command definition information for the command generation means 12 to generate a command for music playback control from the output of the motion detection means 11. For example, when the music selection method is defined according to the number of “shake”, the command definition means 13 holds the following definition.

(1) 1 time / second ⇒ Select music from music selection area 1 (2) 2 times / second ⇒ Select music from music selection area 2 (3) 3 times / second ⇒ Select music from music selection area 3 (4) 4 times / second ⇒ Select music area 4 (5) 5 times / second ⇒ music selection from the music selection area 5 When the operation of the “number of times of shaking” detected by the motion detection means 11 is 5 times / second, the command generation means 12 defines the above definition of the command definition means 13 From (5), the correspondence relationship “music selection from music selection area 5” is derived and output as a control command.

  FIG. 3 is an explanatory diagram of the music selection area. In FIG. 3, the points on the graph represent the impression value coordinates of each piece of music stored in the music data storage means 15. The impression value is a representation of the impression of a music by coordinates of a space (called an impression space) composed of specific factors. In the example of FIG. 3, the X coordinate is “hard-soft” and the Y coordinate is “violent”. -Represents "gentle". The music selection area represents a specific area on the impression space. For example, the area 5 is an area in which music having a large “violent” factor, that is, music having a very intense feeling exists.

  The reproduction control unit 14 controls the operations of the music selection unit 18 and the music data reproduction unit 19 in response to the control command generated by the command generation unit 12. In the case of the above example, when the command “select music from the music selection area 5” is output from the command generation means 12, the reproduction control means 14 instructs the music selection means 18 to start the music selection area and music selection. When the music selection is completed and the corresponding music selection result is output from the music selection means 18 as the music ID number, the reproduction control means 14 outputs the music ID number and the reproduction start instruction to the music data reproduction means 19.

  The music data storage means 15 stores music data to be played back by the music playback device. The music data may be either compressed (MPEG1 Layer III, Advanced Audio Codec, etc.) or uncompressed (PCM format, etc.), and stored in a medium such as an HDD or a semiconductor memory.

  The feature amount extraction unit 16 extracts the feature amount of the music data stored in the music data storage unit 15 for each data. The feature quantity to be extracted is a musical feature quantity such as the tempo and beat of the music, an impression value that quantitatively expresses the subjective impression of the music, etc. This is performed by the method of the music search data registration device of No. 1 publication.

  The music attribute storage means 17 stores the attribute information of the music data stored in the music data storage means 15 for each music piece. The attribute information to be stored is the feature amount extracted by the feature amount extraction means 16 or bibliographic information such as a song title / artist name, and can be referred to by the song ID number.

  In response to an instruction from the reproduction control unit 14, the music selection unit 18 selects a song using attribute information of each song stored in the song attribute storage unit 17, and outputs a song ID number as a song selection result. In the case of the above example, when there is an instruction of “music selection area 5”, the music selection means 18 refers to the impression value of each music stored in the music attribute storage means 17 and the music (in FIG. 2). A music piece is selected from a music group attached to the inside of the music selection area 3 by a predetermined method, and the music ID is output.

  The music data reproduction means 19 acquires the music data of the music ID number to be reproduced output from the reproduction control means 14 from the music data storage means 15 and reproduces the music by the reproduction method instructed by the reproduction control means 14. The user can listen.

  From the above example, a song is selected from the music group existing in the music selection area 5 in FIG. 2 by the operation of shaking the device relatively vigorously at 5 times / second, and as a result, a very intense music is reproduced. It becomes. Similarly, a command “music selection from music selection area 1” is generated from the command generation means 12 and the command definition means 13 by the operation of shaking the device relatively slowly, once per second, and as a result, the music selection area in FIG. 1, that is, a song with a very gentle feeling is played.

  As described above, according to the music playback device of Embodiment 1 of the present invention, playback control such as music selection can be performed according to the user's operation on the device, and the desired playback can be performed intuitively without performing any troublesome operations. Music can be played.

  In the present embodiment, the motion detection means 11 detects the operation of the music playback device main body, that is, the motion that the user causes to the music device main body. Operation may be detected.

In the present embodiment, the command generation means 12 and the command definition means 13 define and generate commands related to music selection, but commands other than music selection may be defined and generated. For example, in the command definition means 13, the correspondence between the number of shakes and the command is
(1) 1 time / second ⇒ Play (2) 2 times / second ⇒ Pause (3) 3 times / second ⇒ Proceed to the next song (4) 4 times / second ⇒ Define to return to the previous song, command The generation means 14 may generate a command related to playback control according to this definition.

(Embodiment 2)
The present embodiment is a mode in which the acceleration sensor is replaced with a vibration sensor in the motion detection unit of the first embodiment, and the command definition unit is replaced accordingly. Since other configurations and operations are the same as those of the first embodiment, description thereof is omitted.

  FIG. 4 shows an example of the output voltage of the motion detection means when a vibration sensor is used as the motion detection means 11 of FIG. When vibration due to “slap” is applied to the motion detection means 11 from the user, the vibration sensor outputs a voltage in proportion to the magnitude of the vibration. FIG. 4 shows the output voltage of the vibration sensor when the user hits the motion detection means five times per second. The threshold voltage 41 is set in advance, and the output voltage of the vibration sensor exceeds the threshold voltage 41. By counting the time, it is possible to detect the number of times the user has struck the vibration sensor. In FIG. 4, the times 42 to 46 are the times when the vibration sensor is struck, and it can be detected that the struck is 5 times per second.

  On the other hand, the command definition means 13 in FIG. 1 holds the following definitions for the number of hits and the music selection area.

(1) 1 time / second ⇒ Select music from music selection area 1 (2) 2 times / second ⇒ Select music from music selection area 2 (3) 3 times / second ⇒ Select music from music selection area 3 (4) 4 times / second ⇒ Select music area 4 (5) 5 times / second ⇒ If music is selected from the music selection area 5, the operation detecting means 11 detects that the number of times this music playback device has been hit is 5 times / second. Similarly, the command generation means refers to the command definition means, derives the correspondence relationship “music selection from the music selection area 5” from the definition of (5) above, and the music selection means 18 selects music from the area. That is, it is possible to select and play a song with a “violent feeling” according to the user's action of “slammingly” 5 times per second.

  As described above, according to the music playback device of the second embodiment of the present invention, it is possible to perform playback control such as music selection according to the user's “tap” operation on the device, and intuitively without performing any troublesome operations. Therefore, a desired music can be reproduced.

(Embodiment 3)
The present embodiment is a mode in which the acceleration sensor is replaced with a pressure sensor in the operation detection unit of the first embodiment, and the command definition unit is replaced accordingly. Since other configurations and operations are the same as those of the first embodiment, description thereof is omitted.

  FIG. 5 shows an example of the output voltage of the operation detection means when a pressure sensor is used as the operation detection means 11 of FIG. When a motion of “gripping” is applied to the motion detection means 11 from the user, the pressure sensor outputs a voltage in proportion to the magnitude of the vibration. FIG. 5 illustrates the relationship between the pressure applied to the pressure sensor and the output voltage. Further, in order to determine the degree of grip strength, threshold values are set in advance as shown in threshold values 51 to 55 in FIG. 4, and sections divided by the respective threshold values are defined as voltage areas A to E. For example, when the music player is squeezed strongly, pressure 56 is applied to the motion detection means 11 and a voltage 57 is output by the pressure sensor, and the voltage area at that time is determined as area E.

  On the other hand, the command definition means 13 in FIG. 1 holds the following definitions for the output voltage and the music selection area.

(1) Voltage area A => Select music from music selection area 1 (2) Voltage area B => Select music from music selection area 2 (3) Voltage area C => Select music from music selection area 3 (4) Voltage area D => Select music from music selection area 4 (5 ) Voltage area E => When music is selected from the music selection area 5, if the operation detection means 11 detects that the pressure with which the music player is gripped is 56, the command generation means defines the command as in the operation of the first embodiment. With reference to the means, the corresponding relationship “music selection from the music selection area E” is derived from the definition of (5) above, and the music selection means 18 selects music from the area. That is, it is possible to select and play a song with a “severe feeling” in accordance with the user's action of “holding strongly” with a pressure 56.

  As described above, according to the music playback device of the third embodiment of the present invention, it is possible to perform playback control such as music selection according to the user's operation of “gripping” on the device, and intuitively without performing any troublesome operations. Therefore, a desired music can be reproduced.

(Embodiment 4)
In the present embodiment, both the acceleration sensor and the pressure sensor are provided in the motion detection unit of the first embodiment, and the command definition corresponding to each of the acceleration sensor and the pressure sensor is held in the command definition unit. Since other configurations and operations are the same as those of the first embodiment, description thereof is omitted.

  The motion detection means of FIG. 1 includes both an acceleration sensor and a pressure sensor, and simultaneously detects “swing” and “grip” motions performed by the user on the music playback device. For example, an operation of “shake strongly while shaking strongly” is detected. On the other hand, as shown in FIG. 6, music selection areas are defined in the X and Y axis directions in the impression space, and command definition means performs command definition using the music selection areas as follows.

A (1) Voltage area A => Select music from music selection area X1 A (2) Voltage area B => Select music from music selection area X2 A (3) Voltage area C => Select music from music selection area X3 A (4) Voltage area D => Select music area X4 Tune from A (5) Voltage area E ⇒ Select music from tune selection area X5 B (1) 1 time / second ⇒ Select music from tune selection area Y1 B (2) 2 times / second ⇒ Select music from music selection area Y2 B (3) 3 times / Second ⇒ Select music from music selection area Y3 B (4) 4 times / second ⇒ Select music from music selection area Y4 B (5) 5 times / second ⇒ Select music from music selection area Y5 Here, A (1) to A (5) are pressure sensors The correspondence between the pressure and the voltage area is the same as in the third embodiment. Similarly, B (1) to B (5) are commands related to the acceleration sensor, and the correspondence between the acceleration and the number of times of shaking is the same as in the first embodiment. For example, when the music player is gripped with the pressure 56 of FIG. 5 and shaken five times per second as shown in FIG. 2, A (5) and B (5) correspond to the command definition, and FIG. The part where X5 and Y5 of the music selection area on the impression space No. 6 intersect, that is, the music selection area 61 is the object of music selection. Then, the music selection means 18 selects the music from the music selection area 61, and the music having a relatively large “hardness” and a relatively large “hardness” is selected and reproduced. In other words, “a relatively intense and hard (tight) feeling song” can be selected and reproduced by the user's operation of “strongly shaking while gripping” with respect to the present music reproducing apparatus.

  As described above, according to the music playback device of the fourth embodiment of the present invention, it is possible to perform playback control such as music selection by combining a plurality of operations of “gripping” and “shaking” with respect to the device of the user. Thus, it is possible to intuitively reproduce music having a specific sensitivity attribute from a large number of music without performing any troublesome operations.

  In the present embodiment, the combination of the acceleration sensor and the pressure sensor is used as the motion detection means. However, a combination with another sensor such as a vibration sensor or a combination of two or more sensors may be used. Further, although “violent-gentle” and “hard-soft” are used as factors constituting the impression space as shown in FIG. 6, a combination of other sensitivity factors may be used.

(Embodiment 5)
The present embodiment shows an example of the operation unit of the music playback device of the first embodiment. FIG. 7 shows the outer shape of the music reproducing apparatus of the present embodiment. In FIG. 7, reference numeral 71 denotes an outline of the music playback apparatus, 72 denotes a display unit, 73 denotes a playback button, 74 denotes a stop button, 75 denotes a skip button, and 76 denotes a rewind button. The procedure for selecting and playing back music with this music playback apparatus will be described. First, in order to select a music piece, the user shakes the music playback device according to the image of the music piece he wants to hear. For example, if you want to listen to intense music, shake it vigorously, that is, many times per second. Then, according to the intensity of the swing, the motion detection means 11, the command generation means 12, the command definition means 13, the reproduction control means 14, and the music selection means 18 described in the first embodiment select a music that feels intense, Information (song name, artist name, etc.) representing the music is displayed on the display unit 72. The user confirms the display, and when listening to the music, when the user presses the playback button 73, the music selected by the operation of the playback control means 14 and the music data playback means described in the first embodiment is played. In addition, when it is desired to select a music piece having the same impression other than the music piece displayed on the display unit 72, a similar music piece is selected by the reproduction control means 14 and the music selection means 18 by pressing the skip button 75, and information indicating the music piece is displayed. Is displayed again on the display unit 72.

  As described above, according to the music playback device of the fifth embodiment of the present invention, an operation corresponding to the image of the music to be selected is added to the music playback device without having an operation system such as buttons related to music selection. Thus, music selection can be performed, and a music piece having a desired impression can be selected and reproduced with an intuitive and simple operation in a small music reproduction apparatus in which it is difficult to arrange a plurality of buttons.

  Note that the music selection operation performed in this embodiment may be performed regardless of whether the music is being played or stopped. Moreover, you may implement not in a music reproduction apparatus main body but in the remote control device for operating a music reproduction apparatus remotely.

(Embodiment 6)
The present embodiment shows the procedure of the processing method in the music playback device of the first embodiment. 8, S11 represents an operation detection procedure, S12 represents a command generation procedure, S13 represents a music selection command determination procedure, S14 represents a music selection procedure, S15 represents a reproduction control procedure, and S16 represents a music data reproduction procedure. Note that the command definition means 13, music data storage means 15, feature quantity extraction means 16, and music attribute storage means 17 are the same as those shown in FIG. Further, the operation of each procedure in FIG. 8 is the same as each corresponding part of the music reproducing apparatus in FIG. 1, and detailed description thereof is omitted. A processing method of the music playback apparatus will be described with reference to FIG.

  First, in the motion detection procedure S11, the user's motions such as “shake”, “tap”, and “grip” with respect to the music playback device are detected. Next, in the command generation procedure S12, the operation detected in S11 is compared with the command definition defined by the command definition means 13, and a command corresponding to the operation is generated. Next, in the music selection command determination procedure, it is determined whether or not the command generated in the command generation procedure S12 is related to music selection. If the command is related to music selection, the procedure proceeds to music selection procedure S14. In the music selection procedure S14, music selection corresponding to the music selection command is performed with reference to the attribute information of each music stored in the music attribute storage means 17. It is assumed that the attribute information stored in the music attribute storage unit is extracted in advance from the acoustic signal of each music stored in the music data storage unit 15 by the feature amount extraction unit 16. Next, in the reproduction control procedure S15, a reproduction control method is determined based on the reproduction music obtained in the music selection procedure S14 and an instruction from the user or a predetermined reproduction procedure, and the music data reproduction procedure S16 is performed based on the reproduction control method. The music data stored in the data storage means 15 is reproduced.

  As described above, according to the music playback method of the sixth embodiment of the present invention, a user's operation on the music playback device is detected, a command is generated from the operation, and in the case of a music selection command, a method corresponding to the command is used. Since music selection is performed, playback is controlled according to the playback control procedure, and the music is played back according to the music data playback procedure, playback control such as music selection can be performed according to the user's operation on the device, and bothersome operations are performed. The desired music can be reproduced intuitively without any problem.

  The music playback device according to the present invention has a motion detection means for detecting a user's motion and a playback control means for controlling the playback of music such as music selection according to the detected motion, and is always portable such as a semiconductor audio player. However, the present invention is useful as a small music playback device on the premise of listening to music. Even in a stationary music playback apparatus, a small and intuitive playback operation can be performed by applying the present invention to an operation unit of a separate housing such as a remote controller.

The figure which shows the music reproducing apparatus by one Embodiment of this invention The figure which shows the example of the output voltage of the acceleration sensor used in one embodiment of this invention The figure which shows the music selection area used by one embodiment of this invention The figure which shows the output voltage example of the vibration sensor used in one embodiment of this invention The figure which shows the output voltage example of the pressure sensor used by one embodiment of this invention The figure which shows the music selection area used by one embodiment of this invention Overview of music playback apparatus according to one embodiment of the present invention The flowchart of the music reproduction method of one embodiment of this invention

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 Operation | movement detection means 12 Command generation means 13 Command definition means 14 Playback control means 15 Music data storage means 16 Feature-value extraction means 17 Music attribute storage means 18 Music selection means 19 Music data playback means 71 Music playback apparatus 72 Display part 73 Play button 74 Stop button 75 Skip button 76 Rewind button S11 Motion detection procedure S12 Command generation procedure S13 Music selection command discrimination procedure S14 Music selection procedure S15 Playback control procedure S16 Music data playback procedure

Claims (4)

An action detecting means for detecting a user's action on the device;
Command generating means for generating a command for reproduction control from the user's action detected by the action detecting means;
Command definition means for defining a correspondence between the operation of the action detection means and the command generated by the command generation means;
Reproduction control means for controlling reproduction of music data in accordance with a command generated by the command generation means;
Music data storage means for storing music data to be played back by the music playback device;
Feature quantity extraction means for extracting feature quantities of each music data stored in the music data storage means;
Music attribute storage means for storing, for each song, attribute information of music data stored in the music data storage means, including the feature quantity extracted by the feature quantity extraction means;
Referring to attribute information of each music stored in the music attribute storage means, and music selection means for selecting music according to control from the reproduction control means;
Music data reproduction means for acquiring and reproducing music data of the music from the music data storage means in response to control from the reproduction control means;
A music playback device comprising: playing back music according to a user's operation. The feature amount extraction means extracts the feature amount representing the impression of the music stored in the music data storage means,
The music attribute storage means stores the feature amount representing the impression of the music for each music,
The music selection means is configured to select a music with reference to a feature amount representing an impression of each music stored in the music attribute storage means,
The music playback device according to claim 1. The motion detection means detects the strength of the vibration operation of the user on the device,
The command definition means defines the correspondence between the vibration control strength and the music selection control information,
The command generation means refers to the definition of the command definition means to generate a music selection control command according to the strength of the vibration operation for the device,
The music selection means selects music by referring to a feature amount representing an impression of each music stored in the music attribute storage means according to the music selection control command.
The music reproducing apparatus according to claim 2. An action detection step for detecting a user action on the device;
A command generation step for generating a command for reproduction control from the user's operation detected by the operation detection step;
A command definition step for defining a correspondence between the operation of the operation detection step and the command generated in the command generation step;
A reproduction control step for controlling reproduction of music data in accordance with the command generated by the command generation step;
A music data storing step for storing music data to be played back by the music playback device;
A feature amount extracting step for extracting a feature amount of each music data stored in the music data storing step;
A music attribute storing step for storing, for each music, attribute information of music data stored in the music data storing step, including the feature amount extracted in the feature amount extracting step;
Referencing the attribute information of each song stored in the song attribute storage step, and a song selection step of selecting a song according to the control from the reproduction control step;
A music data playback step of acquiring and playing back music data of the music from the music data storage step according to control from the playback control step;
A music playback method comprising: playing music according to a user's operation.

Images