WO2019150800A1 - Information processing device, information processing method, and program - Google Patents

Information processing device, information processing method, and program Download PDF

Info

Publication number
WO2019150800A1
WO2019150800A1 PCT/JP2018/046365 JP2018046365W WO2019150800A1 WO 2019150800 A1 WO2019150800 A1 WO 2019150800A1 JP 2018046365 W JP2018046365 W JP 2018046365W WO 2019150800 A1 WO2019150800 A1 WO 2019150800A1
Authority
WO
WIPO (PCT)
Prior art keywords
tempo
music
user
movement
information processing
Prior art date
Application number
PCT/JP2018/046365
Other languages
French (fr)
Japanese (ja)
Inventor
惇一 清水
Original Assignee
ソニー株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ソニー株式会社 filed Critical ソニー株式会社
Publication of WO2019150800A1 publication Critical patent/WO2019150800A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K15/00—Acoustics not otherwise provided for
    • G10K15/04—Sound-producing devices
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10—Digital recording or reproducing
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B31/00—Arrangements for the associated working of recording or reproducing apparatus with related apparatus
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/10—Earpieces; Attachments therefor ; Earphones; Monophonic headphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones

Definitions

  • This technology relates to technology that reflects user movements in music.
  • an object of the present technology is to provide a technology that can enhance entertainment when the user is listening to music.
  • the information processing apparatus includes a control unit.
  • the control unit acquires information on the tempo of the user's movement, and dynamically changes the tempo of the music being played based on the information on the tempo of the user's movement.
  • the tempo of user movement is the number of periodic movements per unit time when the user makes periodic movements.
  • the “music tempo” is the number of beats per unit time.
  • This information processing apparatus can dynamically change the tempo of music based on the tempo of the user's movement, so that the entertainment when the user is listening to the music can be enhanced.
  • control unit determines whether a tempo of the user's movement is within a predetermined range, and when the tempo of the user's movement is within the predetermined range, You may change the tempo.
  • control unit may acquire information on the tempo of the music and set the predetermined range based on the information on the tempo of the music.
  • the predetermined range may include a range based on n times the tempo of the music (n is a positive integer other than 1).
  • the predetermined range may include a range based on 1 / n times the tempo of the music (n is a positive integer other than 1).
  • the predetermined range may include a range based on an equal magnification of the tempo of the music.
  • the control unit when the tempo of the movement of the user is within a range based on n times the tempo of the music, the control unit is configured to make the music tempo faster. May be changed.
  • the control unit when the tempo of the movement of the user is within a range based on 1 / n times the tempo of the music, the control unit is configured to slow down the tempo of the music. You may change the tempo.
  • control unit may calculate a difference d between a user's movement tempo and a music tempo, and change the music tempo based on the difference d.
  • control unit may change the tempo of the music piece by adding a value obtained by multiplying the difference d by the parameter k to the tempo of the music piece.
  • the predetermined range may include a plurality of ranges, and the control unit may use the parameter k that is different for each range.
  • the information processing method acquires user movement tempo information and dynamically changes the tempo of the music being played based on the user movement tempo information.
  • the program according to the present technology acquires information on the tempo of the user's movement and causes the computer to function as a control unit that dynamically changes the tempo of the music being played based on the information on the tempo of the user's movement.
  • an information processing apparatus capable of providing a technology that can enhance entertainment when the user is listening to music.
  • FIG. 1 is a diagram illustrating an information processing apparatus 100 according to the first embodiment of the present technology.
  • the information processing apparatus 100 includes a smartphone 20 and a headphone 10 that can communicate wirelessly with the smartphone 20.
  • FIG. 2 is a diagram showing a state when the headphones 10 are worn on the user's ear.
  • FIG. 3 is an enlarged view showing the headphones 10.
  • the headphone 10 includes a first headphone unit 1a attached to the right ear and a second headphone unit 1b attached to the left ear.
  • the first headphone unit 1a and the second headphone unit 1b are configured to be separated from each other, and configured to be able to communicate with each other wirelessly.
  • the first headphone unit 1a and the second headphone unit 1b are configured symmetrically, but basically have the same configuration. In the following description, the first headphone unit 1a and the second headphone unit 1b are referred to when the two headphone units 1 are distinguished from each other. Call.
  • the headphone unit 1 has a unit main body 2, a speaker unit 3, and a U-shaped connecting unit 4 that connects the unit main unit 2 and the speaker unit 3.
  • the unit main body 2 includes a casing 2a having a small thickness, and various electronic components (control units 4a and 4b, motion sensors 7a and 7b, which will be described later) are built in the casing 2a.
  • the speaker unit 3 includes speakers 6a and 6b (see FIG. 4) capable of outputting sound, and the speaker unit 3 is provided with an earpiece 3a.
  • the earpiece 3a is configured to be insertable into the ear canal in the user's ear.
  • the unit main body 2 is disposed at the back of the user's ear
  • the speaker unit 3 is disposed at the position of the user's ear hole
  • the connecting unit 4 is It is placed at a position that passes under the ear.
  • the headphone unit 1 can be easily removed from the ear even if the user exercises once the headphone unit 1 is attached to the user's ear due to the shape of the connecting portion 4.
  • FIG. 4 is a block diagram showing an electrical configuration of the information processing apparatus 100.
  • the first headphone unit 1a and the second headphone unit 1b include a control unit 4a, 4b, a storage unit 5a, 5b, a speaker 6a, 6b, a motion sensor 7a, 7b, and a communication unit 8a, 8b, respectively. It has.
  • the control units 4a and 4b are constituted by, for example, a CPU (Central Processing Unit) and the like, and comprehensively control each unit in the headphone units 1a and 1b.
  • a CPU Central Processing Unit
  • the storage units 5a and 5b are a nonvolatile memory in which various programs and various data necessary for the processing of the control units 4a and 4b are fixedly stored, and a volatile memory used as a work area for the control units 4a and 4b.
  • Memory used as a work area for the control units 4a and 4b.
  • the program may be read from a portable recording medium such as an optical disk or a semiconductor memory, or may be downloaded from a server device on a network.
  • Speakers 6a and 6b output sounds such as music based on the sound signals output by the control units 4a and 4b.
  • the motion sensors 7a and 7b are configured to be able to detect a user's movement.
  • the motion sensors 7a and 7b are configured by any one of an acceleration sensor, an angular velocity sensor, an angle sensor (geomagnetic sensor), or a combination of two or more of these sensors, for example.
  • the detection axes in the motion sensors 7a and 7b are typically in three orthogonal directions (acceleration in three axes, three angular velocities, three angles), but the detection axes are in one axis. It may be biaxial.
  • the communication unit 8a in the first headphone unit 1a and the communication unit 8b in the second headphone unit 1b are configured to be able to communicate with each other wirelessly.
  • the communication unit 8a in the first headphone unit 1a and the communication unit 8b in the second headphone unit 1b are configured to be able to communicate with each other with the communication unit 16 in the smartphone 20 wirelessly.
  • the smartphone 20 includes a housing 11, a control unit 12, a storage unit 13, a display unit 14, a proximity sensor 15, a communication unit 16, a microphone 17, and a speaker 18. And.
  • the housing 11 has a rectangular parallelepiped shape with a small thickness, and can be carried by the user.
  • the control part 12 is comprised by CPU etc., for example, and controls each part in the smart phone 20 centralizedly.
  • the storage unit 13 includes a nonvolatile memory in which various programs and various data necessary for the processing of the control unit 12 are fixedly stored, and a volatile memory used as a work area of the control unit 12.
  • the program may be read from a portable recording medium such as an optical disk or a semiconductor memory, or may be downloaded from a server device on a network.
  • the display unit 14 is disposed in front of the housing 11.
  • the display unit 14 displays various images on the screen under the control of the control unit 12.
  • the proximity sensor 15 is provided on the display unit 14.
  • the proximity sensor 15 detects the proximity of the user's finger to the display unit 14, and outputs a signal indicating that the user's finger is close and a signal indicating the position where the finger is close to the control unit 12.
  • the communication unit 16 is configured to be able to communicate with each other wirelessly between the communication unit 8a in the first headphone unit 1a and the communication unit 8b in the second headphone unit 1b.
  • the communication unit 16 is configured to be able to communicate with other telephones, a server device on the network, and the like.
  • the microphone 17 converts the voice of the user's call into an electrical signal and outputs this signal to the control unit 12.
  • the speaker 18 outputs voice or the like due to the other party's call in accordance with the control of the control unit 12.
  • FIG. 5 is a flowchart showing processing in the control unit 12 of the smartphone 20.
  • control unit 12 of the smartphone 20 determines whether or not music playback has started (step 101).
  • the control unit 12 of the smartphone 20 determines again whether the reproduction of the music has been started.
  • step 101 Suppose that audio data of a music is transmitted from the smartphone 20 to the headphone unit 1 and playback of the music is started (YES in step 101).
  • the control unit 12 of the smartphone 20 acquires the first detection value detected by the motion sensor 7a from the first headphone unit (step 102).
  • control unit of the smartphone acquires the second detection value detected by the motion sensor 7b from the second headphone unit (step 103).
  • control unit 12 of the smartphone 20 calculates (acquires) the tempo of the user's movement at the current time based on the first detection value and the second detection value (step 104).
  • the user's movement tempo is the number of periodic movements per unit time when the user makes periodic movements.
  • the number of times of movement of the head per minute (BPM: Beat Per Minute) when the user who listens to the music moves his / her head periodically is used as the tempo of the user's movement.
  • the user's movement tempo is calculated based on both the first detection value and the second detection value. However, based on one of the detection values, the user's movement tempo is calculated.
  • the tempo may be calculated. In this case, it is not necessary to provide a motion sensor in both the first headphone unit and the second headphone unit, and a motion sensor is provided in only one of the first headphone unit and the second headphone unit. It may be.
  • the control unit 12 of the smartphone 20 After calculating the tempo of the user's movement, the control unit 12 of the smartphone 20 next calculates (acquires) the tempo of the music at the present time (step 105).
  • the tempo of the music is the number of beats per unit time. In this embodiment, the number of beats per minute (BPM: BeatBPer Minute) is used as the tempo of the music.
  • the tempo of the music may change based on the user's movement tempo, as will be described later. Accordingly, in step 105, the tempo of the music is calculated at a necessary timing in order to determine what the tempo of the music is at the present time.
  • information on the original music tempo (the tempo of the music before being changed based on the user's movement) may be used.
  • the original tempo information for example, BPM information associated with the music in advance as meta information may be used.
  • information on the tempo of the original music may be acquired from the server device.
  • control unit 12 of the smartphone 20 sets a plurality of ranges (predetermined ranges) based on the music tempo (step 106).
  • FIG. 6 is a diagram showing a plurality of ranges to be set.
  • the vertical axis represents tempo (BPM), and the horizontal axis represents time.
  • the tempo of the music at that time is indicated by a solid line.
  • the tempo of the original music (for example, BPM represented by the meta information) may change during music playback due to tempo up, tempo down, etc., but in the example shown in FIG. It is assumed that the original music tempo is constant.
  • the plurality of ranges include ranges based on equal beats of the music tempo.
  • the plurality of ranges include ranges based on double beat, triple beat, quadruple beat,... Of the music tempo. That is, the plurality of ranges include a range based on n times the tempo of the music (n is a positive integer other than 1).
  • the plurality of ranges include ranges based on 1 ⁇ 2 times the beat, 1 / times, 1 ⁇ 4 times the tempo of the music. That is, the plurality of ranges include ranges based on 1 / n times the tempo of the music (n is a positive integer other than 1).
  • a reference range may be included. That is, the plurality of ranges may include a range based on 1 + 1 / n times the tempo of the music (n is a positive integer other than 1).
  • control unit 12 of the smartphone 20 adds a value of ⁇ ⁇ to the tempo of the current music and sets a range based on the equal beat. To do.
  • control unit 12 of the smartphone 20 sets the range based on the double beat by doubling the current music tempo and adding the value of ⁇ ⁇ to the doubled value. Similarly, the control unit 12 of the smartphone 20 sets a range based on the triple beat, quadruple beat,... Of the music tempo.
  • control unit 12 of the smartphone 20 halves the tempo of the current music, adds a value of ⁇ ⁇ to the halved value, and uses the 1 ⁇ 2 beat as a reference. Set the range. Similarly, the control unit 12 of the smartphone 20 sets a range based on 1/3 times the tempo of music and 1/4 times the beat.
  • ⁇ , ⁇ , ⁇ , etc. used for setting each range may be the same or different.
  • each range also changes accordingly.
  • the tempo of the music may change as the tempo of the original music increases or decreases, and may change according to the tempo of the user's movement, as will be described later.
  • control unit 12 of the smartphone 20 determines whether the user's movement tempo value (BPM) is a value within one of the plurality of ranges ( Step 107).
  • FIG. 7 is a diagram showing the relationship between the beat of music and the beat of user movement.
  • ⁇ indicates the beat timing of the music
  • the pulse indicates the beat timing of the user's movement.
  • the value of the user's movement tempo is within a range based on the single beat. It is determined to be a value. Note that even if the user moves at a slightly faster tempo and a slightly slower tempo than the beat of the music, the user's movement tempo value is within the range based on the beat. It is determined that there is.
  • step 107 If the user is making a movement that doubles the beat of the music, it is determined in step 107 that the value of the user's movement tempo is within a range based on the double beat. Is done. Note that even if the user moves at a tempo slightly faster and slightly slower than the double beat, the user's movement tempo value is within a range based on the double beat. It is determined that there is.
  • the value of the user's movement tempo is a value within a range based on the 1 ⁇ 2 beat. It is determined that Note that even if the user moves at a tempo that is a little faster than 1 ⁇ 2 times the beat of the music and a slightly slower tempo, the value of the user's movement tempo is within the range based on the 1 ⁇ 2 time It is determined that the value is within the range.
  • FIG. 7 shows a case where the timing of the beat of the music matches the timing of the beat of the user's movement.
  • the control unit 12 of the smartphone 20 determines only the relationship between the music tempo (BPM) and the user's movement tempo (BPM). It is not related to the timing of the user's movement beat.
  • the control unit 12 of the smartphone 20 determines the user's movement tempo (BPM) and the music tempo (BPM). Is calculated (step 108).
  • the control unit 12 of the smartphone 20 reads the parameter k in the corresponding range from the parameters k prepared for each range from the storage unit (step 109). Note that different values of the parameter k are prepared for each range, and the relationship between the parameter k and the range is tabulated in advance and stored in the storage unit. In the present embodiment, the parameter k is a positive number.
  • control unit 12 of the smartphone 20 multiplies the difference d by k (step 110). Then, the control unit 12 of the smartphone 20 adds the difference d ⁇ the value of the parameter k to the current music tempo value to update the music tempo (step 111).
  • the updated music tempo (BPM) current music tempo (BPM) + [(user movement tempo (BPM)) ⁇ (music tempo (BPM))] ⁇ k.
  • an upper limit may be set for the tempo of the music so that the tempo of the music does not become too fast with respect to the tempo of the original music (value indicated by meta information or the like).
  • a lower limit value may be set for the tempo of the music so that the tempo of the music does not become too slow with respect to the tempo of the original music (value indicated by meta information or the like).
  • the value of the parameter k is a value that determines how much the tempo of the music is changed with respect to the difference d between the user's motion tempo and the tempo of the music.
  • the value of the difference d is larger than when the user is engraving a beat near equal double beat with respect to the music. large.
  • the value of the parameter k is made different in each range.
  • the value of difference d is large. Its value is set to suppress changes in tempo.
  • the parameter k is set with an emphasis on the followability of the tempo of the music to the tempo of the user's movement. Is done.
  • the control unit 12 of the smartphone 20 adjusts the tempo of the music so as to coincide with the updated tempo of the music (step 112). At this time, the control unit 12 of the smartphone 20 adjusts the tempo of the music, for example, by adjusting the playback speed of the music.
  • the video playback speed may be adjusted accordingly.
  • step 107 when the tempo value (BPM) of the user's movement is a value that does not belong to any range (NO in step 107), the control unit maintains the current tempo of the music (currently present). The playback speed of the music is maintained) (step 113).
  • the case where the tempo value of the user's movement is a value that does not belong to any range means that, for example, in this embodiment, the user ticks the beat by 1.5 times the tempo of the song. Is the case.
  • control unit 12 of the smartphone 20 determines whether or not the reproduction of the music has ended (step 114).
  • step 114 If the reproduction of the music has not ended (NO in step 114), the control unit 12 of the smartphone 20 returns to step 102 again and executes the processing from step 102 onward. On the other hand, when the reproduction of the music ends (YES in step 114), the control unit 12 of the smartphone 20 ends the process.
  • FIG. 8 is a diagram illustrating a state in which the tempo of the music is accelerated based on the user's motion tempo
  • FIG. 9 is a diagram in which the music tempo is decreased based on the user's motion tempo. It is a figure which shows a mode. 8 and 9, it is assumed that the tempo of the original music (the BPM value indicated by the meta information or the like) is constant.
  • the tempo value of the user's movement is a value within a range based on the double beat of the music.
  • the updated music tempo current music tempo + [(user motion tempo) ⁇ (musical tempo) Tempo)] ⁇ k (the value of k is a value corresponding to a range based on the double beat) is applied.
  • the tempo of the music gradually increases from time t1.
  • the value of the parameter k is set so as to suppress a sudden change in the tempo of the music, so that the tempo of the music changes gradually and slowly.
  • Each range to be compared with the user's motion tempo is set based on the tempo of the music, so when the music tempo changes based on the user's motion tempo, each range also changes accordingly.
  • the tempo of the updated music current tempo of the music + [(tempo of the user's movement) ⁇ (song of the music Tempo)] ⁇ k (the value of k is a value corresponding to a range based on equal beats) is applied.
  • the parameter k is set with an emphasis on the follow-up of the music tempo with respect to the user's movement tempo.
  • the tempo changes.
  • the user feels the tempo of the music fast and ticks a beat of about 1/2 times the tempo of the music.
  • the tempo value of the user's movement is a value within a range based on a 1 ⁇ 2 beat of the music.
  • the tempo of the updated music the tempo of the current music + [((tempo of the user's movement) ⁇ ( Music tempo)] ⁇ k (the value of k is a value corresponding to a range based on 1 ⁇ 2 beat) is applied.
  • the tempo of the music gradually slows from the time t1.
  • the value of the parameter k is set so as to suppress a sudden change in the music tempo, so that the music tempo changes gradually and slowly.
  • the user feels the tempo of the music fast and is 1 ⁇ 2 times the tempo of the music gradually decreasing.
  • the beat around the beat is engraved. If the user has a beat that is about 1 ⁇ 2 times the tempo of the music, the tempo of the music gradually decreases unless the tempo of the music reaches the lower limit.
  • the user feels that it is easier to take the timing than engraving the music by doubling the beat, and the movement of the body is The movement is changed from a movement that ticks half a beat to a movement that ticks an equal beat.
  • the tempo of the updated music current tempo of the music + [(tempo of the user's movement) ⁇ (song of the music Tempo)] ⁇ k (the value of k is a value corresponding to a range based on equal beats) is applied.
  • ⁇ Action etc.> since the tempo of the music being played can be dynamically changed based on the tempo of the user's movement, entertainment when the user is listening to the music can be enhanced.
  • the music is played back at a tempo that matches the tempo of the body movement unconsciously from the user, it is possible to enjoy the music rather than listening to the music normally.
  • the user can consciously control the tempo of music by the tempo of body movement.
  • the user can control the tempo of the music only with the tempo of the body movement without using a dedicated device for controlling the tempo of the music.
  • the tempo of the music is changed when the tempo value of the user's movement is a value within one of the ranges.
  • the tempo value of the user's movement is a value that does not belong to any range, the tempo of the music is maintained.
  • the tempo of the music is not always changed based on the tempo of the user's movement, but the tempo of the user's movement is a value within one of the ranges. Only the tempo of the music is changed.
  • each range is set based on the tempo of the music.
  • an appropriate range can be set as a range to be compared with the user's motion tempo.
  • each range includes a range based on n times the tempo of the music (n is a positive integer other than 1).
  • Each range includes a range based on 1 / n times the tempo of the music (n is a positive integer other than 1).
  • Each range includes a range based on the same tempo of the music.
  • the music is tempoed, and it may be difficult to move the body at a slightly faster tempo than a tempo of the music.
  • the tempo of the music increases when the user's movement tempo is within a range based on n times the tempo of the music (n is a positive integer other than 1).
  • the music tempo is slow.
  • updated music tempo current music tempo + [(user movement tempo) ⁇ (music tempo)] ⁇ k.
  • a different parameter k is used for each range.
  • the speed of the music tempo can be appropriately changed for each range.
  • the user's movement tempo may be a movement tempo other than the head (for example, a tempo such as a swinging motion, a tapping motion, or a stepping motion).
  • the user's movement tempo may be a tempo when the user is exercising (for example, a walking tempo, a running tempo, a tempo when performing various sports such as dance, skiing, etc.).
  • the user's movement tempo may be a tempo such as breathing or pulse.
  • a band including a motion sensor, a pulse sensor, etc. may be attached to the neck, hand, foot, etc.
  • the user's movement tempo may be determined based on an image captured by the camera (human body recognition, bone recognition, etc.).
  • the user's movement tempo may be determined based on a value detected by a touch sensor, a pressure sensor, or the like.
  • a plurality of sensors of different types and locations may be used.
  • This technology may be used for live performances.
  • the tempo of the music changes according to the tempo of the movement of the user performing the performance.
  • information about the user's movement tempo is used to adjust the tempo of a song.
  • information on a user's movement tempo may be used as information for selecting a song.
  • music having a tempo close to the tempo of the user's movement is selected.
  • information on the tempo of the user's movement may be used for both the adjustment of the music tempo and the selection of the music.
  • the music playback may be switched to another music having a faster tempo than the music being played.
  • the music playback may be switched to another music having a slower tempo than the music being played.
  • processing other than the processing related to music playback for example, SNS (Social Network Service), e-mail, etc.
  • SNS Social Network Service
  • the change of the music tempo may be regulated for a predetermined period thereafter.
  • the adjustment of the tempo of the music may be regulated for the music.
  • the volume may be changed (for example, the volume is temporarily increased and then returned) to make the user aware of this. Sound effects may be reproduced.
  • the display on the screen of the smart phone 20 may be changed.
  • the value of the parameter k may be changed according to the type of exercise and the intensity of exercise. In this case, for example, the value of the parameter k is changed so that the tempo of the music greatly changes as the user's exercise becomes more intense.
  • the tempo of the music may be changed based on the tempo of movement of two or more users.
  • the target controlled based on the user's movement tempo is not limited to the tempo of the music.
  • the tempo of periodic external stimuli video, vibration, etc.
  • the tempo of periodic external stimuli that can be perceived by the user through visual / tactile senses may be changed based on the tempo of the user's movement.
  • control unit 12 of the smartphone 20 performs various processes.
  • various processes may be executed by the control unit of the headphone unit 1 or may be executed by a server device on the network.
  • the information processing apparatus 100 includes the headphones 10 and the smartphone 20 has been described.
  • the information processing apparatus 100 may be a single headphone 10 or a single smartphone 20.
  • the information processing apparatus 100 may be a stationary apparatus such as a stationary speaker or a desktop PC (Personal computer), a tablet PC, a laptop PC, a portable music player, a portable game machine, a cellular phone ( It may be a portable device such as a smartphone 20 (except for the smartphone 20). Further, the information processing apparatus 100 may be a wearable device such as a head mounted display or glasses-type smart glasses.
  • a stationary apparatus such as a stationary speaker or a desktop PC (Personal computer), a tablet PC, a laptop PC, a portable music player, a portable game machine, a cellular phone
  • It may be a portable device such as a smartphone 20 (except for the smartphone 20).
  • the information processing apparatus 100 may be a wearable device such as a head mounted display or glasses-type smart glasses.
  • This technology can take the following configurations.
  • An information processing apparatus comprising: a control unit that acquires information on a user's movement tempo and dynamically changes a tempo of a music being played based on the information on the user's movement tempo.
  • the control unit determines whether or not the tempo of the user's movement is within a predetermined range, and changes the tempo of the music when the tempo of the user's movement is within the predetermined range. apparatus.
  • the information processing apparatus wherein the control unit acquires tempo information of the music piece and sets the predetermined range based on the tempo information of the music piece.
  • the predetermined range includes a range based on n times the tempo of the music (n is a positive integer other than 1).
  • the predetermined range includes a range based on 1 / n times the tempo of the music (n is a positive integer other than 1).
  • the information processing apparatus according to any one of (3) to (5) above, The predetermined range includes a range based on an equal magnification of the tempo of the music.
  • the control unit changes the tempo of the music so as to increase the tempo of the music when the user's movement tempo is in a range based on n times the tempo of the music. .
  • the control unit changes the tempo of the music so as to slow down the tempo of the music when the user's movement tempo is in a range based on 1 / n times the tempo of the music. Processing equipment.
  • the control unit changes the tempo of the music piece by adding a value obtained by multiplying the difference d by a parameter k to the tempo of the music piece.
  • the information processing apparatus includes a plurality of ranges, The control unit uses the parameter k that is different for each range.
  • Acquire user movement tempo information An information processing method for dynamically changing the tempo of a music being played based on information on a user's movement tempo.
  • (12) Obtain information about the user's movement tempo, A program that causes a computer to function as a control unit that dynamically changes the tempo of the music being played based on information about the tempo of user movement.
  • Control unit of first headphone unit 4b Control unit of second headphone unit 10 ... Headphone 12 ... Control unit of smartphone 20 ... Smartphone 100 ... Information processing device

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Electrophonic Musical Instruments (AREA)

Abstract

[Problem] To provide a technology capable of enhancing enjoyment when a user listens to music. [Solution] The information processing device according to the present technology includes a control unit. The control unit obtains information on a user's movement tempo to dynamically change the music tempo being played back on the basis of the information on the user's movement tempo.

Description

情報処理装置、情報処理方法及びプログラムInformation processing apparatus, information processing method, and program
　本技術は、楽曲にユーザの動きを反映させる技術に関する。 This technology relates to technology that reflects user movements in music.
　人は、再生されている楽曲に合わせて体の全部または一部を動かす場合がある。一般的には、このように、楽曲に合わせて人が体の動きを合わせるが、逆に、人の体の動きに合わせて楽曲が再生される技術も知られている。 People may move all or part of their body according to the music being played. In general, a person adjusts the body movement according to the music as described above. On the other hand, a technique is also known in which a music is reproduced according to the movement of the human body.
　特許文献１に記載の技術では、歩行中のユーザの足の踏込タイミングや、ユーザの体の揺れ又は折り返しタイミング等が検出され、このタイミングに、再生される楽曲の拍又は小節のタイミングを合わせるように、楽曲等のコンテンツが再生される。 In the technique described in Patent Literature 1, the timing of stepping on the user's foot while walking, the timing of shaking or turning back of the user's body, and the like are detected, and the timing of the beat or measure of the music to be reproduced is adjusted to this timing. In addition, content such as music is reproduced.
特開２００６－１１４１７４号公報JP 2006-114174 A
　このような分野において、ユーザが楽曲を聞いているときの娯楽性を高めることができる技術が求められている。 In such a field, there is a demand for a technology that can enhance entertainment when the user is listening to music.
　以上のような事情に鑑み、本技術の目的は、ユーザが楽曲を聞いているときの娯楽性を高めることができる技術を提供することにある。 In view of the circumstances as described above, an object of the present technology is to provide a technology that can enhance entertainment when the user is listening to music.
　本技術に係る情報処理装置は、制御部を含む。制御部は、ユーザの動きのテンポの情報を取得し、ユーザの動きのテンポの情報に基づいて、再生されている楽曲のテンポを動的に変化させる。 The information processing apparatus according to the present technology includes a control unit. The control unit acquires information on the tempo of the user's movement, and dynamically changes the tempo of the music being played based on the information on the tempo of the user's movement.
　「ユーザの動きのテンポ」とは、ユーザが周期的な動きをしたときの単位時間当たりの周期的な動きの回数である。「楽曲のテンポ」とは、単位時間あたりの拍の回数である。 “The tempo of user movement” is the number of periodic movements per unit time when the user makes periodic movements. The “music tempo” is the number of beats per unit time.
　この情報処理装置では、ユーザの動きのテンポに基づいて、楽曲のテンポを動的に変化させることができるので、ユーザが楽曲を聞いているときの娯楽性を高めることができる。 This information processing apparatus can dynamically change the tempo of music based on the tempo of the user's movement, so that the entertainment when the user is listening to the music can be enhanced.
　上記情報処理装置において、前記制御部は、前記ユーザの動きのテンポが所定の範囲内にあるかどうかを判定し、前記ユーザの動きのテンポが前記所定の範囲内にある場合に、前記楽曲のテンポを変化させてもよい。 In the information processing apparatus, the control unit determines whether a tempo of the user's movement is within a predetermined range, and when the tempo of the user's movement is within the predetermined range, You may change the tempo.
　これにより、ユーザの意図に反してユーザの体の動きのテンポが楽曲のテンポに反映されてしまうことを防止することができる。 This can prevent the tempo of the user's body movement from being reflected in the tempo of the music against the user's intention.
　上記情報処理装置において、前記制御部は、前記楽曲のテンポの情報を取得し、前記楽曲のテンポの情報に基づいて、前記所定の範囲を設定してもよい。 In the information processing apparatus, the control unit may acquire information on the tempo of the music and set the predetermined range based on the information on the tempo of the music.
　これにより、所定の範囲として適切な範囲を設定することができる。 This makes it possible to set an appropriate range as the predetermined range.
　上記情報処理装置において、前記所定の範囲は、前記楽曲のテンポのｎ倍（ｎは、１以外の正の整数）を基準とした範囲を含んでいてもよい。 In the information processing apparatus, the predetermined range may include a range based on n times the tempo of the music (n is a positive integer other than 1).
　これにより、所定の範囲として適切な範囲を設定することができる。 This makes it possible to set an appropriate range as the predetermined range.
　上記情報処理装置において、前記所定の範囲は、前記楽曲のテンポの１／ｎ倍（ｎは、１以外の正の整数）を基準とした範囲を含んでいてもよい。 In the information processing apparatus, the predetermined range may include a range based on 1 / n times the tempo of the music (n is a positive integer other than 1).
　これにより、所定の範囲として適切な範囲を設定することができる。 This makes it possible to set an appropriate range as the predetermined range.
　上記情報処理装置において、前記所定の範囲は、前記楽曲のテンポの等倍を基準とした範囲を含んでいてもよい。 In the information processing apparatus, the predetermined range may include a range based on an equal magnification of the tempo of the music.
　これにより、所定の範囲として適切な範囲を設定することができる。 This makes it possible to set an appropriate range as the predetermined range.
　上記情報処理装置において、前記制御部は、前記ユーザの動きのテンポが、前記楽曲のテンポのｎ倍を基準とした範囲内にある場合、前記楽曲のテンポを速くするように、前記楽曲のテンポを変化させてもよい。 In the information processing apparatus, when the tempo of the movement of the user is within a range based on n times the tempo of the music, the control unit is configured to make the music tempo faster. May be changed.
　これにより、楽曲のテンポを適切に変化させることができる。 This makes it possible to change the tempo of the music appropriately.
　上記情報処理装置において、前記制御部は、前記ユーザの動きのテンポが、前記楽曲のテンポの１／ｎ倍を基準とした範囲内にある場合、前記楽曲のテンポを遅くするように、前記楽曲のテンポを変化させてもよい。 In the information processing apparatus, when the tempo of the movement of the user is within a range based on 1 / n times the tempo of the music, the control unit is configured to slow down the tempo of the music. You may change the tempo.
　これにより、楽曲のテンポを適切に変化させることができる。 This makes it possible to change the tempo of the music appropriately.
　上記情報処理装置において、前記制御部は、ユーザの動きのテンポと、楽曲のテンポとの差ｄを算出し、前記差ｄに基づいて、前記楽曲のテンポを変化させてもよい。 In the information processing apparatus, the control unit may calculate a difference d between a user's movement tempo and a music tempo, and change the music tempo based on the difference d.
　これにより、楽曲のテンポを適切に変化させることができる。 This makes it possible to change the tempo of the music appropriately.
　上記情報処理装置において、前記制御部は、前記差ｄにパラメータｋを乗算した値を、前記楽曲のテンポに加算することで、前記楽曲のテンポを変化させてもよい。 In the information processing apparatus, the control unit may change the tempo of the music piece by adding a value obtained by multiplying the difference d by the parameter k to the tempo of the music piece.
　これにより、楽曲のテンポを適切に変化させることができる。 This makes it possible to change the tempo of the music appropriately.
　上記情報処理装置において、前記所定の範囲は、複数の範囲を含み、前記制御部は、範囲毎にそれぞれ異なる前記パラメータｋを使用してもよい。 In the information processing apparatus, the predetermined range may include a plurality of ranges, and the control unit may use the parameter k that is different for each range.
　これにより、楽曲のテンポを適切に変化させることができる。 This makes it possible to change the tempo of the music appropriately.
　本技術に係る情報処理方法は、ユーザの動きのテンポの情報を取得し、ユーザの動きのテンポの情報に基づいて、再生されている楽曲のテンポを動的に変化させる。 The information processing method according to the present technology acquires user movement tempo information and dynamically changes the tempo of the music being played based on the user movement tempo information.
　本技術に係るプログラムは、ユーザの動きのテンポの情報を取得し、ユーザの動きのテンポの情報に基づいて、再生されている楽曲のテンポを動的に変化させる制御部としてコンピュータを機能させる。 The program according to the present technology acquires information on the tempo of the user's movement and causes the computer to function as a control unit that dynamically changes the tempo of the music being played based on the information on the tempo of the user's movement.
　以上のように、本技術によれば、ユーザが楽曲を聞いているときの娯楽性を高めることができる技術を提供することが可能な情報処理装置を提供することができる。 As described above, according to the present technology, it is possible to provide an information processing apparatus capable of providing a technology that can enhance entertainment when the user is listening to music.
技術の第１実施形態に係る情報処理装置を示す図である。It is a figure showing an information processor concerning a 1st embodiment of technology. ヘッドフォンがユーザの耳に装着されたときの様子を示す図である。It is a figure which shows a mode when headphones are mounted | worn with a user's ear. ヘッドフォンを示す拡大図である。It is an enlarged view which shows a headphone. 情報処理装置における電気的な構成を示すブロック図である。It is a block diagram which shows the electrical structure in information processing apparatus. スマートフォンの制御部における処理を示すフローチャートである。It is a flowchart which shows the process in the control part of a smart phone. 設定される複数の範囲を示す図である。It is a figure which shows the several range set. 楽曲の拍と、ユーザの動きの拍との関係を示す図である。It is a figure which shows the relationship between the beat of a music, and the beat of a user's movement. ユーザの動きのテンポに基づいて、楽曲のテンポが速くされるときの様子を示す図である。It is a figure which shows a mode when the tempo of a music is made quick based on the tempo of a user's movement. ユーザの動きのテンポに基づいて、楽曲のテンポが遅くされるときの様子を示す図である。It is a figure which shows a mode when the tempo of a music is made slow based on the tempo of a user's movement.
　以下、本技術に係る実施形態を、図面を参照しながら説明する。 Hereinafter, embodiments of the present technology will be described with reference to the drawings.
≪第１実施形態≫
＜全体構成及び各部の構成＞
　図１は、本技術の第１実施形態に係る情報処理装置１００を示す図である。図１に示すように、情報処理装置１００は、スマートフォン２０と、スマートフォン２０との間で無線により通信可能なヘッドフォン１０とを含む。 << First Embodiment >>
<Overall configuration and configuration of each part>
FIG. 1 is a diagram illustrating an information processing apparatus 100 according to the first embodiment of the present technology. As illustrated in FIG. 1, the information processing apparatus 100 includes a smartphone 20 and a headphone 10 that can communicate wirelessly with the smartphone 20.
　図２は、ヘッドフォン１０がユーザの耳に装着されたときの様子を示す図である。図３は、ヘッドフォン１０を示す拡大図である。 FIG. 2 is a diagram showing a state when the headphones 10 are worn on the user's ear. FIG. 3 is an enlarged view showing the headphones 10.
　ヘッドフォン１０は、右耳に装着される第１のヘッドフォンユニット１ａと、左耳に装着される第２のヘッドフォンユニット１ｂとを含む。第１のヘッドフォンユニット１ａと、第２のヘッドフォンユニット１ｂとは、互いに分離して構成されており、無線により相互に通信可能に構成されている。 The headphone 10 includes a first headphone unit 1a attached to the right ear and a second headphone unit 1b attached to the left ear. The first headphone unit 1a and the second headphone unit 1b are configured to be separated from each other, and configured to be able to communicate with each other wirelessly.
　第１のヘッドフォンユニット１ａと、第２のヘッドフォンユニット１ｂとは、左右対称に構成されているが、基本的に同様の構成である。なお、以降の説明では、２つのヘッドフォンユニット１を区別する場合に第１のヘッドフォンユニット１ａ、第２のヘッドフォンユニット１ｂと呼び、２つのヘッドフォンユニット１を区別しない場合には、単にヘッドフォンユニット１と呼ぶ。 The first headphone unit 1a and the second headphone unit 1b are configured symmetrically, but basically have the same configuration. In the following description, the first headphone unit 1a and the second headphone unit 1b are referred to when the two headphone units 1 are distinguished from each other. Call.
　ヘッドフォンユニット１は、ユニット本体２と、スピーカ部３と、ユニット本体２及びスピーカ部３を連結するＵ字状の連結部４とを有する。 The headphone unit 1 has a unit main body 2, a speaker unit 3, and a U-shaped connecting unit 4 that connects the unit main unit 2 and the speaker unit 3.
　ユニット本体２は、厚さが薄い筐体２ａを備えており、筐体２ａの内部には各種の電子部品（後述の制御部４ａ、４ｂ、モーションセンサ７ａ、７ｂ等）が内蔵される。スピーカ部３は、音を出力可能なスピーカ６ａ、６ｂ（図４参照）を内部に有しており、このスピーカ部３には、イヤーピース３ａが設けられる。イヤーピース３ａは、ユーザの耳における外耳道に挿入可能に構成されている。 The unit main body 2 includes a casing 2a having a small thickness, and various electronic components ( control units 4a and 4b, motion sensors 7a and 7b, which will be described later) are built in the casing 2a. The speaker unit 3 includes speakers 6a and 6b (see FIG. 4) capable of outputting sound, and the speaker unit 3 is provided with an earpiece 3a. The earpiece 3a is configured to be insertable into the ear canal in the user's ear.
　ヘッドフォンユニット１がユーザの耳に装着されたとき、ユニット本体２は、ユーザの耳の裏の位置に配置され、スピーカ部３は、ユーザの耳の穴の位置に配置され、連結部４は、耳の下側を通る位置に配置される。 When the headphone unit 1 is attached to the user's ear, the unit main body 2 is disposed at the back of the user's ear, the speaker unit 3 is disposed at the position of the user's ear hole, and the connecting unit 4 is It is placed at a position that passes under the ear.
　ヘッドフォンユニット１は、連結部４の形状により、ユーザの耳に一旦装着されると、ユーザが運動をしたとしても簡単には耳から外れないようになっている。 The headphone unit 1 can be easily removed from the ear even if the user exercises once the headphone unit 1 is attached to the user's ear due to the shape of the connecting portion 4.
　図４は、情報処理装置１００における電気的な構成を示すブロック図である。 FIG. 4 is a block diagram showing an electrical configuration of the information processing apparatus 100.
　第１のヘッドフォンユニット１ａ及び第２のヘッドフォンユニット１ｂは、それぞれ、制御部４ａ、４ｂと、記憶部５ａ、５ｂと、スピーカ６ａ、６ｂと、モーションセンサ７ａ、７ｂと、通信部８ａ、８ｂとを備えている。 The first headphone unit 1a and the second headphone unit 1b include a control unit 4a, 4b, a storage unit 5a, 5b, a speaker 6a, 6b, a motion sensor 7a, 7b, and a communication unit 8a, 8b, respectively. It has.
　制御部４ａ、４ｂは、例えば、ＣＰＵ（Central Processing Unit）等により構成され、ヘッドフォンユニット１ａ、１ｂにおける各部を統括的に制御する。 The control units 4a and 4b are constituted by, for example, a CPU (Central Processing Unit) and the like, and comprehensively control each unit in the headphone units 1a and 1b.
　記憶部５ａ、５ｂは、制御部４ａ、４ｂの処理に必要な各種のプログラムや各種のデータが固定的に記憶される不揮発性のメモリと、制御部４ａ、４ｂの作業領域として用いられる揮発性のメモリとを含む。上記プログラムは、光ディスクや、半導体メモリ等の可搬性の記録媒体から読み取られてもよいし、ネットワーク上のサーバ装置からダウンロードされてもよい。 The storage units 5a and 5b are a nonvolatile memory in which various programs and various data necessary for the processing of the control units 4a and 4b are fixedly stored, and a volatile memory used as a work area for the control units 4a and 4b. Memory. The program may be read from a portable recording medium such as an optical disk or a semiconductor memory, or may be downloaded from a server device on a network.
　スピーカ６ａ、６ｂは、制御部４ａ、４ｂにより出力された音信号に基づいて楽曲等の音を出力する。モーションセンサ７ａ、７ｂは、ユーザの動きを検出可能に構成されている。モーションセンサ７ａ、７ｂは、例えば、加速度センサ、角速度センサ、角度センサ（地磁気センサ）のうちいずれか１つによって構成されるか、あるいは、これらのセンサのうち２以上の組合せにより構成される。 Speakers 6a and 6b output sounds such as music based on the sound signals output by the control units 4a and 4b. The motion sensors 7a and 7b are configured to be able to detect a user's movement. The motion sensors 7a and 7b are configured by any one of an acceleration sensor, an angular velocity sensor, an angle sensor (geomagnetic sensor), or a combination of two or more of these sensors, for example.
　モーションセンサ７ａ、７ｂにおける検出軸は、典型的には直交する３軸方向（３軸方向の加速度、３軸回りの角速度、３軸回りの角度）とされるが、検出軸は、１軸方向、２軸方向等であってもよい。 The detection axes in the motion sensors 7a and 7b are typically in three orthogonal directions (acceleration in three axes, three angular velocities, three angles), but the detection axes are in one axis. It may be biaxial.
　第１のヘッドフォンユニット１ａにおける通信部８ａと、第２のヘッドフォンユニット１ｂにおける通信部８ｂとは、無線により相互に通信可能に構成されている。 The communication unit 8a in the first headphone unit 1a and the communication unit 8b in the second headphone unit 1b are configured to be able to communicate with each other wirelessly.
　また、第１のヘッドフォンユニット１ａにおける通信部８ａ及び第２のヘッドフォンユニット１ｂにおける通信部８ｂは、無線によりスマートフォン２０における通信部１６との間で相互に通信可能に構成されている。 Further, the communication unit 8a in the first headphone unit 1a and the communication unit 8b in the second headphone unit 1b are configured to be able to communicate with each other with the communication unit 16 in the smartphone 20 wirelessly.
　図１及び図４を参照して、スマートフォン２０は、筐体１１と、制御部１２と、記憶部１３と、表示部１４と、近接センサ１５と、通信部１６と、マイクロフォン１７と、スピーカ１８とを備えている。 1 and 4, the smartphone 20 includes a housing 11, a control unit 12, a storage unit 13, a display unit 14, a proximity sensor 15, a communication unit 16, a microphone 17, and a speaker 18. And.
　筐体１１は、厚さが薄い直方体形状を有しており、ユーザが持ち運び可能とされている。制御部１２は、例えば、ＣＰＵ等により構成され、スマートフォン２０における各部を統括的に制御する。 The housing 11 has a rectangular parallelepiped shape with a small thickness, and can be carried by the user. The control part 12 is comprised by CPU etc., for example, and controls each part in the smart phone 20 centralizedly.
　記憶部１３は、制御部１２の処理に必要な各種のプログラムや各種のデータが固定的に記憶される不揮発性のメモリと、制御部１２の作業領域として用いられる揮発性のメモリとを含む。上記プログラムは、光ディスクや、半導体メモリ等の可搬性の記録媒体から読み取られてもよいし、ネットワーク上のサーバ装置からダウンロードされてもよい。 The storage unit 13 includes a nonvolatile memory in which various programs and various data necessary for the processing of the control unit 12 are fixedly stored, and a volatile memory used as a work area of the control unit 12. The program may be read from a portable recording medium such as an optical disk or a semiconductor memory, or may be downloaded from a server device on a network.
　表示部１４は、筐体１１の正面に配置されている。表示部１４は、制御部１２の制御に応じて、各種の画像を画面上に表示させる。 The display unit 14 is disposed in front of the housing 11. The display unit 14 displays various images on the screen under the control of the control unit 12.
　近接センサ１５は、表示部１４上に設けられている。近接センサ１５は、表示部１４へのユーザの指の近接を検出し、ユーザの指が近接したことを示す信号と、指が近接した位置を示す信号とを制御部１２に出力する。 The proximity sensor 15 is provided on the display unit 14. The proximity sensor 15 detects the proximity of the user's finger to the display unit 14, and outputs a signal indicating that the user's finger is close and a signal indicating the position where the finger is close to the control unit 12.
　通信部１６は、無線により、第１のヘッドフォンユニット１ａにおける通信部８ａ及び第２のヘッドフォンユニット１ｂにおける通信部８ｂとの間で相互に通信可能に構成されている。また、通信部１６は、他の電話機や、ネットワーク上のサーバ装置等との間で通信可能に構成されている。 The communication unit 16 is configured to be able to communicate with each other wirelessly between the communication unit 8a in the first headphone unit 1a and the communication unit 8b in the second headphone unit 1b. The communication unit 16 is configured to be able to communicate with other telephones, a server device on the network, and the like.
　マイクロフォン１７は、ユーザの通話による音声を電気信号に変換して、この信号を制御部１２へと出力する。スピーカ１８は、制御部１２の制御に応じて、相手の通話による音声等を出力する。 The microphone 17 converts the voice of the user's call into an electrical signal and outputs this signal to the control unit 12. The speaker 18 outputs voice or the like due to the other party's call in accordance with the control of the control unit 12.
＜動作説明＞
　次に、情報処理装置１００の動作について説明する。図５は、スマートフォン２０の制御部１２における処理を示すフローチャートである。 <Description of operation>
Next, the operation of the information processing apparatus 100 will be described. FIG. 5 is a flowchart showing processing in the control unit 12 of the smartphone 20.
　まず、スマートフォン２０の制御部１２は、楽曲の再生が開始されたかどうかを判定する（ステップ１０１）。楽曲の再生が開始されていない場合（ステップ１０１のＮＯ）、スマートフォン２０の制御部１２は、再び、楽曲の再生が開始されたかどうかを判定する。 First, the control unit 12 of the smartphone 20 determines whether or not music playback has started (step 101). When the reproduction of the music has not been started (NO in step 101), the control unit 12 of the smartphone 20 determines again whether the reproduction of the music has been started.
　楽曲の音声データがスマートフォン２０からヘッドフォンユニット１に送信されて楽曲の再生が開始されたとする（ステップ１０１のＹＥＳ）。この場合、スマートフォン２０の制御部１２は、モーションセンサ７ａによって検出された第１の検出値を第１のヘッドフォンユニットから取得する（ステップ１０２）。 Suppose that audio data of a music is transmitted from the smartphone 20 to the headphone unit 1 and playback of the music is started (YES in step 101). In this case, the control unit 12 of the smartphone 20 acquires the first detection value detected by the motion sensor 7a from the first headphone unit (step 102).
　次に、スマーフォンの制御部は、モーションセンサ７ｂによって検出された第２の検出値を第２のヘッドフォンユニットから取得する（ステップ１０３）。 Next, the control unit of the smartphone acquires the second detection value detected by the motion sensor 7b from the second headphone unit (step 103).
　次に、スマートフォン２０の制御部１２は、第１の検出値及び第２の検出値に基づいて、現時点でのユーザの動きのテンポを算出（取得）する（ステップ１０４）。ユーザの動きのテンポは、ユーザが周期的な動きをしたときの単位時間当たりの周期的な動きの回数である。 Next, the control unit 12 of the smartphone 20 calculates (acquires) the tempo of the user's movement at the current time based on the first detection value and the second detection value (step 104). The user's movement tempo is the number of periodic movements per unit time when the user makes periodic movements.
　本実施形態では、楽曲を聞いたユーザが頭を周期的に動かしたときの１分間当たりの頭の動きの回数（ＢＰＭ：Beat Per Minute）が、ユーザの動きのテンポとして使用される。 In this embodiment, the number of times of movement of the head per minute (BPM: Beat Per Minute) when the user who listens to the music moves his / her head periodically is used as the tempo of the user's movement.
　なお、本実施形態では、第１の検出値及び第２の検出値の両方の検出値に基づいて、ユーザの動きのテンポが算出されるが、一方の検出値に基づいて、ユーザの動きのテンポが算出されてもよい。この場合、第１のヘッドフォンユニット及び第２のヘッドフォンユニットの両方にモーションセンサが設けられている必要はなく、第１のヘッドフォンユニット及び第２のヘッドフォンユニットのうち、一方にのみモーションセンサが設けられていてもよい。 In the present embodiment, the user's movement tempo is calculated based on both the first detection value and the second detection value. However, based on one of the detection values, the user's movement tempo is calculated. The tempo may be calculated. In this case, it is not necessary to provide a motion sensor in both the first headphone unit and the second headphone unit, and a motion sensor is provided in only one of the first headphone unit and the second headphone unit. It may be.
　ユーザの動きのテンポを算出すると、次に、スマートフォン２０の制御部１２は、現時点での楽曲のテンポを算出（取得）する（ステップ１０５）。楽曲のテンポは、単位時間あたりの拍の回数である。本実施形態では、１分間当たりの拍の回数（ＢＰＭ：Beat Per Minute）が、楽曲のテンポとして使用される。 After calculating the tempo of the user's movement, the control unit 12 of the smartphone 20 next calculates (acquires) the tempo of the music at the present time (step 105). The tempo of the music is the number of beats per unit time. In this embodiment, the number of beats per minute (BPM: BeatBPer Minute) is used as the tempo of the music.
　ここで、楽曲のテンポは、後述のように、ユーザの動きのテンポに基づいて変わる可能性がある。従って、ステップ１０５では、楽曲のテンポが現時点においてどのようなテンポであるかを判断するために、必要なタイミングで、楽曲のテンポを算出している。 Here, the tempo of the music may change based on the user's movement tempo, as will be described later. Accordingly, in step 105, the tempo of the music is calculated at a necessary timing in order to determine what the tempo of the music is at the present time.
　現時点での楽曲のテンポを算出するために、元々の楽曲のテンポ（ユーザの動きに基づいて変化される前の楽曲のテンポ）の情報が用いられてもよい。この元々の楽曲のテンポの情報は、例えば、予めメタ情報として楽曲に関連付けられたＢＰＭの情報が用いられてもよい。また、ストリーミング再生により楽曲が再生される場合、サーバ装置から元々の楽曲のテンポの情報が取得されてもよい。 In order to calculate the tempo of the current music, information on the original music tempo (the tempo of the music before being changed based on the user's movement) may be used. As the original tempo information, for example, BPM information associated with the music in advance as meta information may be used. Further, when music is played back by streaming playback, information on the tempo of the original music may be acquired from the server device.
　楽曲のテンポを算出すると、次に、スマートフォン２０の制御部１２は、楽曲のテンポに基づいて、複数の範囲（所定の範囲）を設定する（ステップ１０６）。 Once the music tempo is calculated, the control unit 12 of the smartphone 20 then sets a plurality of ranges (predetermined ranges) based on the music tempo (step 106).
　図６は、設定される複数の範囲を示す図である。図６において、縦軸は、テンポ（ＢＰＭ）を示しており、横軸は時間を示している。また、図６には、楽曲のその時点におけるテンポが実線で示されている。 FIG. 6 is a diagram showing a plurality of ranges to be set. In FIG. 6, the vertical axis represents tempo (BPM), and the horizontal axis represents time. In FIG. 6, the tempo of the music at that time is indicated by a solid line.
　なお、元々の楽曲のテンポ（例えば、メタ情報によって表されるＢＰＭ）は、テンポアップ、テンポダウン等によって曲の再生中に変わる可能性があるが、図６に示す例では、便宜的に、元々の楽曲のテンポは、一定であるとする。 Note that the tempo of the original music (for example, BPM represented by the meta information) may change during music playback due to tempo up, tempo down, etc., but in the example shown in FIG. It is assumed that the original music tempo is constant.
　図６に示すように、複数の範囲は、楽曲のテンポの等倍拍を基準とした範囲を含む。また、複数の範囲は、楽曲のテンポの２倍拍、３倍拍、４倍拍・・を基準とした範囲を含む。つまり、複数の範囲は、楽曲のテンポのｎ倍（ｎは、１以外の正の整数）を基準とした範囲を含む。 As shown in FIG. 6, the plurality of ranges include ranges based on equal beats of the music tempo. The plurality of ranges include ranges based on double beat, triple beat, quadruple beat,... Of the music tempo. That is, the plurality of ranges include a range based on n times the tempo of the music (n is a positive integer other than 1).
　また、複数の範囲は、楽曲のテンポの１／２倍拍、１／３倍拍、１／４倍拍・・を基準とした範囲を含む。つまり、複数の範囲は、楽曲のテンポの１／ｎ倍（ｎは、１以外の正の整数）を基準とした範囲を含む。なお、複数の範囲は、楽曲のテンポの１＋１／２（＝１．５）倍拍、１＋１／３（≒１．３３）倍拍、１＋１／４（＝１．２５）倍拍、・・を基準とした範囲を含んでいてもよい。つまり、複数の範囲は、楽曲のテンポの１＋１／ｎ倍（ｎは、１以外の正の整数）を基準とした範囲を含んでいてもよい。 Also, the plurality of ranges include ranges based on ½ times the beat, １ ／ times, ¼ times the tempo of the music. That is, the plurality of ranges include ranges based on 1 / n times the tempo of the music (n is a positive integer other than 1). The plurality of ranges are: 1 + 1/2 (= 1.5) double beat, 1 + 1/3 (≈1.33) double beat, 1 + 1/4 (= 1.25) double beat of music tempo,. A reference range may be included. That is, the plurality of ranges may include a range based on 1 + 1 / n times the tempo of the music (n is a positive integer other than 1).
　図６に示すような範囲を設定するために、まず、スマートフォン２０の制御部１２は、現時点での楽曲のテンポに±αの値を加算して、等倍拍を基準としとした範囲を設定する。 In order to set a range as shown in FIG. 6, first, the control unit 12 of the smartphone 20 adds a value of ± α to the tempo of the current music and sets a range based on the equal beat. To do.
　また、スマートフォン２０の制御部１２は、現時点での楽曲のテンポを２倍にして、その２倍にした値に±βの値を加算して、２倍拍を基準とした範囲を設定する。同様にして、スマートフォン２０の制御部１２は、楽曲のテンポの３倍拍、４倍拍・・を基準とした範囲を設定する。 Also, the control unit 12 of the smartphone 20 sets the range based on the double beat by doubling the current music tempo and adding the value of ± β to the doubled value. Similarly, the control unit 12 of the smartphone 20 sets a range based on the triple beat, quadruple beat,... Of the music tempo.
　また、スマートフォン２０の制御部１２は、現時点での楽曲のテンポを１／２倍にして、その１／２倍にした値に±γの値を加算して、１／２倍拍を基準とした範囲を設定する。同様にして、スマートフォン２０の制御部１２は、楽曲のテンポの１／３倍拍、１／４倍拍・・を基準とした範囲を設定する。 In addition, the control unit 12 of the smartphone 20 halves the tempo of the current music, adds a value of ± γ to the halved value, and uses the ½ beat as a reference. Set the range. Similarly, the control unit 12 of the smartphone 20 sets a range based on 1/3 times the tempo of music and 1/4 times the beat.
　各範囲を設定するために用いられるα、β、γ等の値は、同じであってもよいし、異なっていてもよい。 The values of α, β, γ, etc. used for setting each range may be the same or different.
　なお、ここでの説明から理解されるように、楽曲のテンポが変われば、各範囲もこれに応じて変わる。楽曲のテンポは、元々の楽曲のテンポがテンポアップ、テンポダウンすることによって変わることがあり、また、後述のように、ユーザの動きのテンポに応じて変わることがある。 As can be understood from the description here, if the tempo of the music changes, each range also changes accordingly. The tempo of the music may change as the tempo of the original music increases or decreases, and may change according to the tempo of the user's movement, as will be described later.
　複数の範囲を設定すると、次に、スマートフォン２０の制御部１２は、ユーザの動きのテンポの値（ＢＰＭ）が、複数の範囲のうちいずれかの範囲内の値であるかどうかを判定する（ステップ１０７）。 When a plurality of ranges are set, next, the control unit 12 of the smartphone 20 determines whether the user's movement tempo value (BPM) is a value within one of the plurality of ranges ( Step 107).
　図７は、楽曲の拍と、ユーザの動きの拍との関係を示す図である。図７において、○印は、楽曲の拍のタイミングを示しており、パルスは、ユーザの動きの拍のタイミングを示している。 FIG. 7 is a diagram showing the relationship between the beat of music and the beat of user movement. In FIG. 7, ◯ indicates the beat timing of the music, and the pulse indicates the beat timing of the user's movement.
　図７に示すように、ユーザが楽曲の拍に対して等倍拍を刻む動きをしている場合、ステップ１０７において、ユーザの動きのテンポの値が、等倍拍を基準とした範囲内の値であると判定される。なお、ユーザが楽曲の拍に対して等倍拍よりも少し速いテンポ、少し遅いテンポで動いた場合にも、ユーザの動きのテンポの値が、等倍拍を基準とした範囲内の値であると判定される。 As shown in FIG. 7, when the user is making a movement that engraves a single beat with respect to the beat of the music, in step 107, the value of the user's movement tempo is within a range based on the single beat. It is determined to be a value. Note that even if the user moves at a slightly faster tempo and a slightly slower tempo than the beat of the music, the user's movement tempo value is within the range based on the beat. It is determined that there is.
　また、ユーザが楽曲の拍に対して２倍拍を刻む動きをしている場合、ステップ１０７において、ユーザの動きのテンポの値が、２倍拍を基準とした範囲内の値であると判定される。なお、ユーザが楽曲の拍に対して２倍拍よりも少し速いテンポ、少し遅いテンポで動いた場合にも、ユーザの動きのテンポの値が、２倍拍を基準とした範囲内の値であると判定される。 If the user is making a movement that doubles the beat of the music, it is determined in step 107 that the value of the user's movement tempo is within a range based on the double beat. Is done. Note that even if the user moves at a tempo slightly faster and slightly slower than the double beat, the user's movement tempo value is within a range based on the double beat. It is determined that there is.
　また、ユーザが楽曲の拍に対して１／２倍拍を刻む動きをしている場合、ステップ１０７において、ユーザの動きのテンポの値が、１／２倍拍を基準とした範囲内の値であると判定される。なお、ユーザが楽曲の拍に対して１／２倍拍よりも少し速いテンポ、少し遅いテンポで動いた場合にも、ユーザの動きのテンポの値が、１／２倍拍を基準とした範囲内の値であると判定される。 If the user is making a movement that halves the beat of the music, in step 107, the value of the user's movement tempo is a value within a range based on the ½ beat. It is determined that Note that even if the user moves at a tempo that is a little faster than ½ times the beat of the music and a slightly slower tempo, the value of the user's movement tempo is within the range based on the ½ time It is determined that the value is within the range.
　ここで、図７では、楽曲の拍のタイミングと、ユーザの動きの拍のタイミングが一致している場合が示されている。一方、ステップ１０７において、スマートフォン２０の制御部１２が判断しているのは、あくまで、楽曲のテンポ（ＢＰＭ）と、ユーザの動きのテンポ（ＢＰＭ）との関係であり、楽曲の拍のタイミングと、ユーザの動きの拍のタイミングとの関係ではない。 Here, FIG. 7 shows a case where the timing of the beat of the music matches the timing of the beat of the user's movement. On the other hand, in step 107, the control unit 12 of the smartphone 20 determines only the relationship between the music tempo (BPM) and the user's movement tempo (BPM). It is not related to the timing of the user's movement beat.
　ユーザの動きのテンポの値が、いずれかの範囲内の値である場合（ステップ１０７のＹＥＳ）、スマートフォン２０の制御部１２は、ユーザの動きのテンポ（ＢＰＭ）と、楽曲のテンポ（ＢＰＭ）との差ｄを算出する（ステップ１０８）。 When the value of the user's movement tempo is within one of the ranges (YES in step 107), the control unit 12 of the smartphone 20 determines the user's movement tempo (BPM) and the music tempo (BPM). Is calculated (step 108).
　次に、スマートフォン２０の制御部１２は、範囲毎に用意された各パラメータｋのうち、対応する範囲のパラメータｋを記憶部から読みだす（ステップ１０９）。なお、パラメータｋの値は、範囲毎に異なる値が用意されており、パラメータｋと範囲との関係は、予めテーブル化されて記憶部に記憶されている。なお、本実施形態において、パラメータｋは、正の数である。 Next, the control unit 12 of the smartphone 20 reads the parameter k in the corresponding range from the parameters k prepared for each range from the storage unit (step 109). Note that different values of the parameter k are prepared for each range, and the relationship between the parameter k and the range is tabulated in advance and stored in the storage unit. In the present embodiment, the parameter k is a positive number.
　次に、スマートフォン２０の制御部１２は、差ｄにｋを乗算する（ステップ１１０）。そして、スマートフォン２０の制御部１２は、現時点での楽曲のテンポの値に、差ｄ×パラメータｋの値を加算して、楽曲のテンポを更新する（ステップ１１１）。 Next, the control unit 12 of the smartphone 20 multiplies the difference d by k (step 110). Then, the control unit 12 of the smartphone 20 adds the difference d × the value of the parameter k to the current music tempo value to update the music tempo (step 111).
　つまり、更新後の楽曲のテンポ（ＢＰＭ）＝現時点での楽曲のテンポ（ＢＰＭ）＋［（ユーザの動きのテンポ（ＢＰＭ））－（楽曲のテンポ（ＢＰＭ））］×ｋである。 That is, the updated music tempo (BPM) = current music tempo (BPM) + [(user movement tempo (BPM)) − (music tempo (BPM))] × k.
　この式から理解されるように、ユーザの動きのテンポが楽曲のテンポよりも速い場合には、楽曲のテンポが速くされる。逆に、ユーザの動きのテンポが楽曲のテンポよりも遅い場合には、楽曲のテンポが遅くされる。 As can be understood from this equation, when the user's movement tempo is faster than the tempo of the music, the tempo of the music is increased. Conversely, if the user's movement tempo is slower than the music tempo, the music tempo is slowed down.
　なお、楽曲のテンポが、元々の楽曲のテンポ（メタ情報等により示される値）に対して速くなり過ぎないように、楽曲のテンポについて上限値が設定されていてもよい。同様に、楽曲のテンポが、元々の楽曲のテンポ（メタ情報等により示される値）に対して遅くなり過ぎないように、楽曲のテンポについて、下限値が設定されていてもよい。 Note that an upper limit may be set for the tempo of the music so that the tempo of the music does not become too fast with respect to the tempo of the original music (value indicated by meta information or the like). Similarly, a lower limit value may be set for the tempo of the music so that the tempo of the music does not become too slow with respect to the tempo of the original music (value indicated by meta information or the like).
　ここで、パラメータｋの値は、ユーザの動きのテンポと楽曲のテンポとの間の差ｄに対してどの程度楽曲のテンポを変化させるかを決定する値である。ここで、例えば、ユーザが、楽曲に対して２倍拍付近の拍を刻んでいる場合、ユーザが、楽曲に対して等倍拍付近の拍を刻んでいる場合よりも、差ｄの値が大きい。 Here, the value of the parameter k is a value that determines how much the tempo of the music is changed with respect to the difference d between the user's motion tempo and the tempo of the music. Here, for example, when the user is engraving a beat near double beat with respect to the music, the value of the difference d is larger than when the user is engraving a beat near equal double beat with respect to the music. large.
　従って、２倍拍を基準とした範囲と、等倍拍を基準とした範囲とでパラメータｋとして同じ値が用いられると、ユーザが、楽曲に対して２倍拍付近の拍を刻んでいる場合に、急激に楽曲のテンポが変化してしまうおそれがある。従って、本実施形態では、パラメータｋの値を各範囲で異ならせることとしている。 Therefore, when the same value is used as the parameter k for a range based on double beats and a range based on equal beats, the user is engraving a beat near double beats with respect to the music In addition, the tempo of the music may change suddenly. Therefore, in this embodiment, the value of the parameter k is made different in each range.
　例えば、２倍拍、３倍拍、・・、１／２倍拍、１／３倍拍、・・を基準とした範囲では、差ｄの値が大きいので、パラメータｋは、急激な楽曲のテンポの変化を抑制するようにその値が設定される。一方、等倍拍を基準とした範囲では、差ｄの値はそれほど大きくなることはないので、パラメータｋは、ユーザの動きのテンポに対する楽曲のテンポの追従性を重視して、その値が設定される。 For example, in the range based on double beat, triple beat,..., 1/2 beat, 1/3 beat,..., The value of difference d is large. Its value is set to suppress changes in tempo. On the other hand, since the value of the difference d does not increase so much in the range based on the equal beat, the parameter k is set with an emphasis on the followability of the tempo of the music to the tempo of the user's movement. Is done.
　楽曲のテンポを更新すると、スマートフォン２０の制御部１２は、更新された楽曲のテンポと一致する様に、楽曲のテンポを調整する（ステップ１１２）。このとき、スマートフォン２０の制御部１２は、例えば、楽曲の再生速度を調整することで、楽曲のテンポを調整する。 When the tempo of the music is updated, the control unit 12 of the smartphone 20 adjusts the tempo of the music so as to coincide with the updated tempo of the music (step 112). At this time, the control unit 12 of the smartphone 20 adjusts the tempo of the music, for example, by adjusting the playback speed of the music.
　ここで、スマートフォン２０の表示部の画面上において楽曲に関連する動画が再生される場合がある。このような場合、楽曲の再生速度が調整（楽曲のテンポが調整）されたときに、これに合わせて、動画の再生速度が調整されてもよい。 Here, there is a case where a video related to the music is played on the screen of the display unit of the smartphone 20. In such a case, when the music playback speed is adjusted (the music tempo is adjusted), the video playback speed may be adjusted accordingly.
　ステップ１０７において、ユーザの動きのテンポの値（ＢＰＭ）が、どの範囲にも属さない値である場合（ステップ１０７のＮＯ）、制御部は、現時点での楽曲のテンポを維持する（現時点での楽曲の再生速度を維持する）（ステップ１１３）。 In step 107, when the tempo value (BPM) of the user's movement is a value that does not belong to any range (NO in step 107), the control unit maintains the current tempo of the music (currently present). The playback speed of the music is maintained) (step 113).
　ユーザの動きのテンポの値が、どの範囲にも属さない値である場合とは、本実施形態では、例えば、ユーザが、楽曲のテンポに対して１．５倍で拍を刻んでいるような場合である。 The case where the tempo value of the user's movement is a value that does not belong to any range means that, for example, in this embodiment, the user ticks the beat by 1.5 times the tempo of the song. Is the case.
　ステップ１１２において、楽曲のテンポを調整した後、あるいは、ステップ１１３において楽曲のテンポを維持した後、スマートフォン２０の制御部１２は、楽曲の再生が終了したかどうかを判定する（ステップ１１４）。 After adjusting the tempo of the music in step 112 or maintaining the tempo of the music in step 113, the control unit 12 of the smartphone 20 determines whether or not the reproduction of the music has ended (step 114).
　楽曲の再生が終了していない場合（ステップ１１４のＮＯ）、スマートフォン２０の制御部１２は、再び、ステップ１０２に戻り、ステップ１０２以降の処理を実行する。一方、楽曲の再生が終了した場合（ステップ１１４のＹＥＳ）、スマートフォン２０の制御部１２は、処理を終了する。 If the reproduction of the music has not ended (NO in step 114), the control unit 12 of the smartphone 20 returns to step 102 again and executes the processing from step 102 onward. On the other hand, when the reproduction of the music ends (YES in step 114), the control unit 12 of the smartphone 20 ends the process.
　［楽曲のテンポの変化の具体例］
　以下、具体例を挙げて、ユーザの動きのテンポに基づいて楽曲のテンポがどのように変化をするかについて詳細に説明する。 [Specific examples of changes in music tempo]
Hereinafter, a specific example will be used to explain in detail how the tempo of the music changes based on the tempo of the user's movement.
　図８は、ユーザの動きのテンポに基づいて、楽曲のテンポが速くされるときの様子を示す図であり、図９は、ユーザの動きのテンポに基づいて、楽曲のテンポが遅くされるときの様子を示す図である。なお、図８及び図９において、元々の楽曲のテンポ（メタ情報等により示されるＢＰＭの値）は、一定であるとする。 FIG. 8 is a diagram illustrating a state in which the tempo of the music is accelerated based on the user's motion tempo, and FIG. 9 is a diagram in which the music tempo is decreased based on the user's motion tempo. It is a figure which shows a mode. 8 and 9, it is assumed that the tempo of the original music (the BPM value indicated by the meta information or the like) is constant.
　図８を参照して、例えば、ユーザが、楽曲のテンポを遅く感じていて、楽曲のテンポに対して２倍拍付近の拍を刻んでいるとする。この場合、ユーザの動きのテンポの値が、楽曲の２倍拍を基準とした範囲内の値であると判定される。 Referring to FIG. 8, for example, it is assumed that the user feels that the tempo of the music is slow and ticks around double beats with respect to the tempo of the music. In this case, it is determined that the tempo value of the user's movement is a value within a range based on the double beat of the music.
　ユーザの動きのテンポの値が、２倍拍を基準とした範囲内の値である場合、更新後の楽曲のテンポ＝現時点での楽曲のテンポ＋［（ユーザの動きのテンポ）－（楽曲のテンポ）］×ｋ（ｋの値は、２倍拍を基準とした範囲に対応する値）による式が適用される。 If the value of the user's motion tempo is within a range based on the double beat, the updated music tempo = current music tempo + [(user motion tempo) − (musical tempo) Tempo)] × k (the value of k is a value corresponding to a range based on the double beat) is applied.
　これにより、図８に示すように、時刻ｔ１の時点から楽曲のテンポが徐々に速くなる。なお、２倍拍を基準とした範囲では、急激な楽曲のテンポの変化を抑制するように、パラメータｋの値が設定されているので、楽曲のテンポは、徐々にゆっくりと変化する。 Thereby, as shown in FIG. 8, the tempo of the music gradually increases from time t1. In the range based on the double beat, the value of the parameter k is set so as to suppress a sudden change in the tempo of the music, so that the tempo of the music changes gradually and slowly.
　ユーザの動きのテンポと比較される各範囲は、楽曲のテンポを基準に設定されるので、ユーザの動きのテンポに基づいて楽曲のテンポが変化すると、これに応じて各範囲も変化する。 Each range to be compared with the user's motion tempo is set based on the tempo of the music, so when the music tempo changes based on the user's motion tempo, each range also changes accordingly.
　図８に示す例では、時刻ｔ１の時点から楽曲のテンポが徐々に速くなった後も、ユーザは、楽曲のテンポを遅く感じていて、徐々に速くなる楽曲のテンポに対して２倍拍付近の拍を刻でいる。ユーザが楽曲のテンポに対して２倍拍付近の拍を刻んでいる場合、楽曲のテンポが上限値に達しない限り、楽曲のテンポは、徐々に速くなる。 In the example shown in FIG. 8, even after the tempo of the music gradually increases from the time t1, the user feels the tempo of the music slow and is about double beats with respect to the tempo of the music gradually increasing. The beat is engraved. When the user has a beat of about double beats with respect to the music tempo, the music tempo is gradually increased unless the music tempo reaches the upper limit.
　図８に示す例では、時刻ｔ２の時点で、ユーザは、楽曲に対して２倍拍を刻むよりも、等倍拍を刻んだ方がタイミングをとりやすいと感じ、体の動きを、２倍拍を刻む動きから等倍拍を刻む動きへと変化させている。 In the example shown in FIG. 8, at time t2, the user feels that it is easier to take the timing than engraving the double beat on the music, and the body movement is doubled. The movement from ticking to changing to the same beat.
　ユーザの動きのテンポの値が、等倍拍を基準とした範囲内の値である場合、更新後の楽曲のテンポ＝現時点での楽曲のテンポ＋［（ユーザの動きのテンポ）－（楽曲のテンポ）］×ｋ（ｋの値は、等倍拍を基準とした範囲に対応する値）による式が適用される。 If the tempo value of the user's movement is a value within the range based on the equal beat, the tempo of the updated music = current tempo of the music + [(tempo of the user's movement) − (song of the music Tempo)] × k (the value of k is a value corresponding to a range based on equal beats) is applied.
　これにより、ユーザの動きのテンポが、等倍拍を基準とした範囲内で楽曲のテンポよりも少し速い場合、少し遅い場合に、これに追従して、楽曲のテンポが少し速く、あるいは、少し遅くされる。 As a result, when the user's movement tempo is a little faster than the song tempo within a range based on the same beat, the song tempo is a little faster or a little slower. Be late.
　なお、等倍拍を基準とした範囲では、パラメータｋは、ユーザの動きのテンポに対する楽曲のテンポの追従性を重視して設定されているので、ユーザの動きのテンポに精度よく追従して楽曲のテンポが変化される。 In the range based on the equal beat, the parameter k is set with an emphasis on the follow-up of the music tempo with respect to the user's movement tempo. The tempo changes.
　次に、図９を参照して、例えば、ユーザが、楽曲のテンポを速く感じていて、楽曲のテンポに対して１／２倍拍付近の拍を刻んでいるとする。この場合、ユーザの動きのテンポの値が、楽曲の１／２倍拍を基準とした範囲内の値であると判定される。 Next, referring to FIG. 9, for example, it is assumed that the user feels the tempo of the music fast and ticks a beat of about 1/2 times the tempo of the music. In this case, it is determined that the tempo value of the user's movement is a value within a range based on a ½ beat of the music.
　ユーザの動きのテンポの値が、１／２倍拍を基準とした範囲内の値である場合、更新後の楽曲のテンポ＝現時点での楽曲のテンポ＋［（ユーザの動きのテンポ）－（楽曲のテンポ）］×ｋ（ｋの値は、１／２倍拍を基準とした範囲に対応する値）による式が適用される。 When the tempo value of the user's movement is a value within a range based on a half-beat, the tempo of the updated music = the tempo of the current music + [((tempo of the user's movement) − ( Musical tempo)] × k (the value of k is a value corresponding to a range based on ½ beat) is applied.
　これにより、図９に示すように、時刻ｔ１の時点から楽曲のテンポが徐々に遅くなる。なお、１／２倍拍を基準とした範囲では、急激な楽曲のテンポの変化を抑制するように、パラメータｋの値が設定されているので、楽曲のテンポは、徐々にゆっくりと変化する。 Thereby, as shown in FIG. 9, the tempo of the music gradually slows from the time t1. Note that, in the range based on the half-beat, the value of the parameter k is set so as to suppress a sudden change in the music tempo, so that the music tempo changes gradually and slowly.
　図９に示す例では、時刻ｔ１の時点から楽曲のテンポが徐々に遅くなった後も、ユーザは、楽曲のテンポを速く感じていて、徐々に遅くなる楽曲のテンポに対して１／２倍拍付近の拍を刻でいる。ユーザが楽曲のテンポに対して１／２倍拍付近の拍を刻んでいる場合、楽曲のテンポが下限値に達しない限り、楽曲のテンポは、徐々に遅くなる。 In the example shown in FIG. 9, even after the tempo of the music gradually decreases from the time t1, the user feels the tempo of the music fast and is ½ times the tempo of the music gradually decreasing. The beat around the beat is engraved. If the user has a beat that is about ½ times the tempo of the music, the tempo of the music gradually decreases unless the tempo of the music reaches the lower limit.
　図９に示す例では、時刻ｔ２の時点で、ユーザは、楽曲に対して１／２倍拍を刻むよりも、等倍拍を刻んだ方がタイミングをとりやすいと感じ、体の動きを、１／２倍拍を刻む動きから等倍拍を刻む動きへと変化させている。 In the example shown in FIG. 9, at time t2, the user feels that it is easier to take the timing than engraving the music by doubling the beat, and the movement of the body is The movement is changed from a movement that ticks half a beat to a movement that ticks an equal beat.
　ユーザの動きのテンポの値が、等倍拍を基準とした範囲内の値である場合、更新後の楽曲のテンポ＝現時点での楽曲のテンポ＋［（ユーザの動きのテンポ）－（楽曲のテンポ）］×ｋ（ｋの値は、等倍拍を基準とした範囲に対応する値）による式が適用される。 If the tempo value of the user's movement is a value within the range based on the equal beat, the tempo of the updated music = current tempo of the music + [(tempo of the user's movement) − (song of the music Tempo)] × k (the value of k is a value corresponding to a range based on equal beats) is applied.
　これにより、ユーザの動きのテンポが、等倍拍を基準とした範囲内で楽曲のテンポよりも少し速い場合、少し遅い場合に、これに追従して、楽曲のテンポが少し速く、あるいは、少し遅くされる。 As a result, when the user's movement tempo is a little faster than the song tempo within a range based on the same beat, the song tempo is a little faster or a little slower. Be late.
　＜作用等＞
　本実施形態では、ユーザの動きのテンポに基づいて、再生されている楽曲のテンポを動的に変化させることができるので、ユーザが楽曲を聞いているときの娯楽性を高めることができる。 <Action etc.>
In the present embodiment, since the tempo of the music being played can be dynamically changed based on the tempo of the user's movement, entertainment when the user is listening to the music can be enhanced.
　例えば、ユーザからすると、無意識に体の動きのテンポに合ったテンポで楽曲が再生されるので、普通に楽曲を聞いているよりも楽曲を楽しむことができる。また、ユーザは、体の動きのテンポにより意識的に楽曲のテンポをコントロールすることもできる。このとき、楽曲のテンポを制御するための専用の機器を使用する必要とすることなしに、ユーザは、体の動きのテンポだけで楽曲のテンポをコントロールすることができる。 For example, since the music is played back at a tempo that matches the tempo of the body movement unconsciously from the user, it is possible to enjoy the music rather than listening to the music normally. In addition, the user can consciously control the tempo of music by the tempo of body movement. At this time, the user can control the tempo of the music only with the tempo of the body movement without using a dedicated device for controlling the tempo of the music.
　また、本実施形態では、ユーザの動きのテンポの値が、いずれかの範囲内の値である場合に、楽曲のテンポが変化される。一方で、ユーザの動きのテンポの値が、どの範囲にも属さない値である場合には、楽曲のテンポは維持される。 In this embodiment, the tempo of the music is changed when the tempo value of the user's movement is a value within one of the ranges. On the other hand, when the tempo value of the user's movement is a value that does not belong to any range, the tempo of the music is maintained.
　つまり、本実施形態では、常に、ユーザの動きのテンポに基づいて、楽曲のテンポを変化させているのではなく、ユーザの動きのテンポの値が、いずれかの範囲内の値である場合に限って、楽曲のテンポを変化させている。 In other words, in the present embodiment, the tempo of the music is not always changed based on the tempo of the user's movement, but the tempo of the user's movement is a value within one of the ranges. Only the tempo of the music is changed.
　これにより、ユーザの意図に反してユーザの動きのテンポが楽曲のテンポに反映されてしまうことを防止することができる。 Thereby, it is possible to prevent the user's movement tempo from being reflected in the music tempo against the user's intention.
　また、本実施形態では、各範囲は、楽曲のテンポに基づいて設定される。これにより、ユーザの動きのテンポと比較される範囲として、適切な範囲を設定することができる。 In this embodiment, each range is set based on the tempo of the music. Thereby, an appropriate range can be set as a range to be compared with the user's motion tempo.
　また、本実施形態では、各範囲は、楽曲のテンポのｎ倍（ｎは、１以外の正の整数）を基準とした範囲を含む。また、各範囲は、楽曲のテンポの１／ｎ倍（ｎは、１以外の正の整数）を基準とした範囲を含む。また、各範囲は、楽曲のテンポの等倍を基準とした範囲を含む。 In the present embodiment, each range includes a range based on n times the tempo of the music (n is a positive integer other than 1). Each range includes a range based on 1 / n times the tempo of the music (n is a positive integer other than 1). Each range includes a range based on the same tempo of the music.
　一般的に、人は、楽曲を聞いているときに、楽曲の等倍、ｎ倍、１／ｎ倍付近のテンポで体を動かすことが多く、本実施形態では、このようなテンポでユーザの体を動かしているときに、楽曲のテンポを変化させている。これにより、ユーザの意図に沿って、適切に楽曲のテンポを変化させることができる。 In general, when listening to music, people often move their bodies at a tempo near the same size, n times, or 1 / n times that of the music. The tempo of the music is changed while moving. Thereby, the tempo of a music can be changed appropriately according to a user's intention.
　ここで、上述のように、本実施形態では、体の動きのテンポにより意識的に楽曲のテンポをコントロールするという楽しみ方がある。一方、ユーザによっては、楽曲のテンポにつられてしまい、楽曲のテンポに対して、少し速いテンポ、少し遅いテンポで体を動かすことが困難である場合がある。例えば、ユーザによっては、等倍拍に対応する範囲において、楽曲のテンポに対して、少し速いテンポ、少し遅いテンポで体を動かすことが困難である場合がある。 Here, as described above, in this embodiment, there is a way of enjoying that the tempo of the music is consciously controlled by the tempo of the body movement. On the other hand, depending on the user, the music is tempoed, and it may be difficult to move the body at a slightly faster tempo than a tempo of the music. For example, depending on the user, it may be difficult to move the body at a slightly faster tempo and a slightly slower tempo than the tempo of the music in the range corresponding to the equal beat.
　一方で、楽曲のテンポに対してｎ倍付近、１／ｎ倍付近（ｎは、１以外の整数）の拍を刻むことはユーザに依らず容易である。そして、本実施形態では、ユーザがこのような拍を刻んだ時に、楽曲のテンポが調整される。つまり、体の動きのテンポにより意識的に楽曲のテンポをコントロールするという楽しみ方の場合、楽曲に誘発されやすいｎ倍付近、１／ｎ倍付近のユーザの動きを楽曲のテンポ調整のトリガーに用いることが特に有効である。 On the other hand, it is easy not to depend on the user to engrave a beat of n times or 1 / n times (n is an integer other than 1) with respect to the tempo of the music. And in this embodiment, when a user cuts such a beat, the tempo of music is adjusted. In other words, in the case of enjoyment in which the tempo of the music is consciously controlled by the tempo of the body movement, the user movement near n times or 1 / n times that is easily induced by the music is used as a trigger for adjusting the music tempo Is particularly effective.
　また、本実施形態では、ユーザの動きのテンポが、楽曲のテンポのｎ倍（ｎは、１以外の正の整数）を基準とした範囲内にある場合に、楽曲のテンポが速くなる。一方で、本実施形態では、ユーザの動きのテンポが、楽曲のテンポの１／ｎ倍（ｎは、１以外の正の整数）を基準とした範囲内にある場合に、楽曲のテンポが遅くなる。 In the present embodiment, the tempo of the music increases when the user's movement tempo is within a range based on n times the tempo of the music (n is a positive integer other than 1). On the other hand, in this embodiment, when the user's movement tempo is within a range based on 1 / n times the tempo of music (n is a positive integer other than 1), the music tempo is slow. Become.
　これにより、各範囲に応じて、適切に楽曲のテンポを速く又は遅くすることができる。 This makes it possible to appropriately increase or decrease the tempo of the music according to each range.
　また、本実施形態では、更新後の楽曲のテンポ＝現時点での楽曲のテンポ＋［（ユーザの動きのテンポ）－（楽曲のテンポ）］×ｋによる式により、楽曲のテンポが調整される。これにより、楽曲のテンポの速さを適切に変化させることができる。 In the present embodiment, the tempo of the music is adjusted by the following formula: updated music tempo = current music tempo + [(user movement tempo) − (music tempo)] × k. Thereby, the speed of the tempo of a music can be changed appropriately.
　さらに、本実施形態では、範囲毎にそれぞれ異なるパラメータｋが使用される。これにより、範囲毎に、楽曲のテンポの速さを適切に変化させることができる。 Furthermore, in this embodiment, a different parameter k is used for each range. Thereby, the speed of the music tempo can be appropriately changed for each range.
≪各種変形例≫
　以上の説明では、楽曲のテンポを基準とした範囲として、複数の範囲が設定される場合について説明した。一方、この範囲の数は、１つであってもよい（例えば、等倍拍、２倍拍、１／２倍拍を基準とした範囲のうち１つだけ等）。 ≪Various modifications≫
In the above description, a case where a plurality of ranges are set as ranges based on the tempo of the music has been described. On the other hand, the number of the ranges may be one (for example, only one of the ranges based on the equal beat, double beat, and half beat).
　以上の説明では、ユーザの動きのテンポとして、ユーザの頭の動きのテンポが用いられる場合について説明した。一方、ユーザの動きのテンポは、頭以外の部分の動きのテンポ（例えば、首を振る動作、手をタップする動作、足踏みする動作等のテンポ）であってもよい。また、ユーザの動きのテンポは、ユーザが運動しているときのテンポ（例えば、歩くテンポ、走るテンポ、ダンス、スキー等の各種のスポーツをしているときのテンポ）であってもよい。また、ユーザの動きのテンポは、呼吸や、脈拍などのテンポであってもよい。 In the above description, the case where the tempo of the user's head movement is used as the tempo of the user's movement has been described. On the other hand, the user's movement tempo may be a movement tempo other than the head (for example, a tempo such as a swinging motion, a tapping motion, or a stepping motion). The user's movement tempo may be a tempo when the user is exercising (for example, a walking tempo, a running tempo, a tempo when performing various sports such as dance, skiing, etc.). The user's movement tempo may be a tempo such as breathing or pulse.
　ユーザの動きのテンポを検出するために、首、手、足等にモーションセンサ、脈拍センサ等を含むバンド等が取り付けられてもよい。あるいは、カメラによって撮像された画像に基づいてユーザの動きのテンポが判断されてもよい（人体認識、骨認識等）。あるいは、タッチセンサや、圧力センサ等によって検出された値に基づいて、ユーザの動きのテンポが判断されてもよい。 In order to detect the tempo of the user's movement, a band including a motion sensor, a pulse sensor, etc. may be attached to the neck, hand, foot, etc. Alternatively, the user's movement tempo may be determined based on an image captured by the camera (human body recognition, bone recognition, etc.). Alternatively, the user's movement tempo may be determined based on a value detected by a touch sensor, a pressure sensor, or the like.
　ユーザの動きのテンポを正確に検出するために、種類や、設置される場所が異なる複数のセンサが用いられてもよい。 In order to accurately detect the user's movement tempo, a plurality of sensors of different types and locations may be used.
　本技術は、ライブパフォーマンス等で使用されてもよい。この場合、パフォーマンスを行っているユーザの動きのテンポに応じて、楽曲のテンポが変わる。 This technology may be used for live performances. In this case, the tempo of the music changes according to the tempo of the movement of the user performing the performance.
　以上の説明では、ユーザの動きのテンポの情報が、楽曲のテンポの調整に用いられる場合について説明した。一方、ユーザの動きのテンポの情報が、楽曲を選択するための情報として用いられてもよい。この場合、楽曲の選択において、ユーザの動きのテンポに近いテンポを有する楽曲が選択される。また、ユーザの動きのテンポの情報が、楽曲のテンポの調整と、楽曲の選択との両方に用いられてもよい。 In the above description, a case has been described in which information about the user's movement tempo is used to adjust the tempo of a song. On the other hand, information on a user's movement tempo may be used as information for selecting a song. In this case, in the selection of music, music having a tempo close to the tempo of the user's movement is selected. Further, information on the tempo of the user's movement may be used for both the adjustment of the music tempo and the selection of the music.
　楽曲のテンポが、ユーザの動きのテンポに応じて速くなり、上限値に達したとき、再生されている楽曲よりもテンポが速い他の楽曲に、楽曲の再生が切り替えられてもよい。同様に、楽曲のテンポが、ユーザの動きのテンポに応じて遅くなり、下限値に達したとき、再生されている楽曲よりもテンポが遅い他の楽曲に、楽曲の再生が切り替えられてもよい。 When the tempo of the music increases according to the tempo of the user's movement and reaches the upper limit value, the music playback may be switched to another music having a faster tempo than the music being played. Similarly, when the tempo of the music slows according to the user's motion tempo and reaches the lower limit, the music playback may be switched to another music having a slower tempo than the music being played. .
　楽曲のテンポが、ユーザの動きのテンポに応じて変化して、所定の値となったときに、楽曲の再生に関する処理以外の他の処理（例えば、ＳＮＳ（Social Network Service）、メール等）が実行されてもよい。 When the tempo of the music changes according to the tempo of the user's movement and reaches a predetermined value, processing other than the processing related to music playback (for example, SNS (Social Network Service), e-mail, etc.) May be executed.
　楽曲のテンポと、ユーザの動きのテンポとの間の差ｄが小さい状態が一定時間以上継続した場合、その後の所定期間は、楽曲のテンポの変化が規制されてもよい。楽曲のテンポの変化が規制されるメタ情報が楽曲に関連付けられている場合、その楽曲については、楽曲のテンポの調整が規制されてもよい。 When the difference d between the tempo of the music and the user's movement tempo is small for a predetermined time or longer, the change of the music tempo may be regulated for a predetermined period thereafter. When the meta information that restricts the change in the tempo of the music is associated with the music, the adjustment of the tempo of the music may be regulated for the music.
　楽曲のテンポが、ユーザの動きのテンポに応じて変化されたとき、これをユーザに気付かせるために、音量が変化（例えば、一時的に音量が大きくなって、その後に戻る）されてもよし、効果音が再生されてもよい。あるいは、楽曲のテンポが、ユーザの動きのテンポに応じて変化されたとき、スマートフォン２０の画面上の表示が変化されてもよい。 When the tempo of the music is changed according to the tempo of the user's movement, the volume may be changed (for example, the volume is temporarily increased and then returned) to make the user aware of this. Sound effects may be reproduced. Or when the tempo of a music is changed according to the tempo of a user's movement, the display on the screen of the smart phone 20 may be changed.
　運動の種類や、運動の激しさに応じて、パラメータｋの値が変化されてもよい。この場合、例えば、ユーザの運動が激しくなるほど、楽曲のテンポが大きく変化するように、パラメータｋの値が変化される。 The value of the parameter k may be changed according to the type of exercise and the intensity of exercise. In this case, for example, the value of the parameter k is changed so that the tempo of the music greatly changes as the user's exercise becomes more intense.
　２人以上のユーザの動きのテンポに基づいて、楽曲のテンポが変化されてもよい。また、ユーザの動きのテンポに基づいて制御される対象は、楽曲のテンポに限られない。例えば、視覚・触覚などを通じてユーザが知覚可能な周期性のある外部刺激（映像、振動等）のテンポが、ユーザの動きのテンポに基づいて変化されてもよい。 The tempo of the music may be changed based on the tempo of movement of two or more users. The target controlled based on the user's movement tempo is not limited to the tempo of the music. For example, the tempo of periodic external stimuli (video, vibration, etc.) that can be perceived by the user through visual / tactile senses may be changed based on the tempo of the user's movement.
　以上の説明では、スマートフォン２０の制御部１２が、各種の処理を行う場合について説明した。一方、このような各種の処理は、ヘッドフォンユニット１の制御部により実行されてもよいし、ネットワーク上のサーバ装置により実行されてもよい。 In the above description, the case where the control unit 12 of the smartphone 20 performs various processes has been described. On the other hand, such various processes may be executed by the control unit of the headphone unit 1 or may be executed by a server device on the network.
　以上の説明では、情報処理装置１００が、ヘッドフォン１０と、スマートフォン２０とを含む場合について説明した。一方、情報処理装置１００は、ヘッドフォン１０単体であってもよいし、スマートフォン２０単体であってもよい。 In the above description, the case where the information processing apparatus 100 includes the headphones 10 and the smartphone 20 has been described. On the other hand, the information processing apparatus 100 may be a single headphone 10 or a single smartphone 20.
　また、情報処理装置１００は、据え置き型のスピーカ、デスクトップＰＣ（Personal computer）等の据え置き型の装置であってもよいし、タブレットＰＣ、ラップトップＰＣ、携帯音楽プレイヤー、携帯ゲーム機、携帯電話機（スマートフォン２０を除く）等の持ち運び可能な装置であってもよい。また、情報処理装置１００は、例えば、ヘッドマウントディスプレイや、メガネ型のスマートグラス等のウェアラブル装置であってもよい。 The information processing apparatus 100 may be a stationary apparatus such as a stationary speaker or a desktop PC (Personal computer), a tablet PC, a laptop PC, a portable music player, a portable game machine, a cellular phone ( It may be a portable device such as a smartphone 20 (except for the smartphone 20). Further, the information processing apparatus 100 may be a wearable device such as a head mounted display or glasses-type smart glasses.
　本技術は、以下の構成をとることもできる。 This technology can take the following configurations.
（１）ユーザの動きのテンポの情報を取得し、前記ユーザの動きのテンポの情報に基づいて、再生されている楽曲のテンポを動的に変化させる制御部
　を具備する情報処理装置。
（２）　上記（１）に記載の情報処理装置であって、
　前記制御部は、前記ユーザの動きのテンポが所定の範囲内にあるかどうかを判定し、前記ユーザの動きのテンポが前記所定の範囲内にある場合に、前記楽曲のテンポを変化させる
　情報処理装置。
（３）　上記（２）に記載の情報処理装置であって、
　前記制御部は、前記楽曲のテンポの情報を取得し、前記楽曲のテンポの情報に基づいて、前記所定の範囲を設定する
　情報処理装置。
（４）　上記（３）に記載の情報処理装置であって、
　前記所定の範囲は、前記楽曲のテンポのｎ倍（ｎは、１以外の正の整数）を基準とした範囲を含む
　情報処理装置。
（５）　上記（３）又は（４）に記載の情報処理装置であって、
　前記所定の範囲は、前記楽曲のテンポの１／ｎ倍（ｎは、１以外の正の整数）を基準とした範囲を含む
　情報処理装置。
（６）　上記（３）～（５）のうち、いずれか１つに記載の情報処理装置であって、
　前記所定の範囲は、前記楽曲のテンポの等倍を基準とした範囲を含む
　情報処理装置。
（７）　上記（４）に記載の情報処理装置であって、
　前記制御部は、前記ユーザの動きのテンポが、前記楽曲のテンポのｎ倍を基準とした範囲内にある場合、前記楽曲のテンポを速くするように、前記楽曲のテンポを変化させる
　情報処理装置。
（８）　上記（５）に記載の情報処理装置であって、
　前記制御部は、前記ユーザの動きのテンポが、前記楽曲のテンポの１／ｎ倍を基準とした範囲内にある場合、前記楽曲のテンポを遅くするように、前記楽曲のテンポを変化させる
　情報処理装置。
（９）　上記（２）～（８）のうちいずれか１つに記載の情報処理装置であって、
　前記制御部は、前記ユーザの動きのテンポと、前記楽曲のテンポとの差ｄを算出し、前記差ｄに基づいて、前記楽曲のテンポを変化させる
　情報処理装置。
（１０）　上記（９）に記載の情報処理装置であって、
　前記制御部は、前記差ｄにパラメータｋを乗算した値を、前記楽曲のテンポに加算することで、前記楽曲のテンポを変化させる
　情報処理装置。
（１１）　上記（１０）に記載の情報処理装置であって、
　前記所定の範囲は、複数の範囲を含み、
　前記制御部は、範囲毎にそれぞれ異なる前記パラメータｋを使用する
　情報処理装置。
（１２）　ユーザの動きのテンポの情報を取得し、
　ユーザの動きのテンポの情報に基づいて、再生されている楽曲のテンポを動的に変化させる
　情報処理方法。
（１３）　ユーザの動きのテンポの情報を取得し、
　ユーザの動きのテンポの情報に基づいて、再生されている楽曲のテンポを動的に変化させる
　制御部としてコンピュータを機能させるプログラム。 (1) An information processing apparatus comprising: a control unit that acquires information on a user's movement tempo and dynamically changes a tempo of a music being played based on the information on the user's movement tempo.
(2) The information processing apparatus according to (1) above,
The control unit determines whether or not the tempo of the user's movement is within a predetermined range, and changes the tempo of the music when the tempo of the user's movement is within the predetermined range. apparatus.
(3) The information processing apparatus according to (2) above,
The information processing apparatus, wherein the control unit acquires tempo information of the music piece and sets the predetermined range based on the tempo information of the music piece.
(4) The information processing apparatus according to (3) above,
The predetermined range includes a range based on n times the tempo of the music (n is a positive integer other than 1).
(5) The information processing apparatus according to (3) or (4) above,
The predetermined range includes a range based on 1 / n times the tempo of the music (n is a positive integer other than 1).
(6) The information processing apparatus according to any one of (3) to (5) above,
The predetermined range includes a range based on an equal magnification of the tempo of the music.
(7) The information processing apparatus according to (4) above,
The control unit changes the tempo of the music so as to increase the tempo of the music when the user's movement tempo is in a range based on n times the tempo of the music. .
(8) The information processing apparatus according to (5) above,
The control unit changes the tempo of the music so as to slow down the tempo of the music when the user's movement tempo is in a range based on 1 / n times the tempo of the music. Processing equipment.
(9) The information processing apparatus according to any one of (2) to (8),
The information processing apparatus, wherein the control unit calculates a difference d between the tempo of the user's movement and the tempo of the music, and changes the tempo of the music based on the difference d.
(10) The information processing apparatus according to (9) above,
The control unit changes the tempo of the music piece by adding a value obtained by multiplying the difference d by a parameter k to the tempo of the music piece.
(11) The information processing apparatus according to (10) above,
The predetermined range includes a plurality of ranges,
The control unit uses the parameter k that is different for each range.
(12) Acquire user movement tempo information,
An information processing method for dynamically changing the tempo of a music being played based on information on a user's movement tempo.
(13) Obtain information about the user's movement tempo,
A program that causes a computer to function as a control unit that dynamically changes the tempo of the music being played based on information about the tempo of user movement.
　４ａ…第１のヘッドフォンユニットの制御部
　４ｂ…第２のヘッドフォンユニットの制御部
　１０…ヘッドフォン
　１２…スマートフォンの制御部
　２０…スマートフォン
　１００…情報処理装置 4a: Control unit of first headphone unit 4b: Control unit of second headphone unit 10 ... Headphone 12 ... Control unit of smartphone 20 ... Smartphone 100 ... Information processing device

Claims (13)

  1. 　ユーザの動きのテンポの情報を取得し、前記ユーザの動きのテンポの情報に基づいて、再生されている楽曲のテンポを動的に変化させる制御部
    　を具備する情報処理装置。     An information processing apparatus comprising: a control unit that acquires information about a user's movement tempo and dynamically changes a tempo of a music piece being played based on the information about the user's movement tempo.
  2. 　請求項１に記載の情報処理装置であって、
    　前記制御部は、前記ユーザの動きのテンポが所定の範囲内にあるかどうかを判定し、前記ユーザの動きのテンポが前記所定の範囲内にある場合に、前記楽曲のテンポを変化させる
    　情報処理装置。     The information processing apparatus according to claim 1,
    The control unit determines whether or not the tempo of the user's movement is within a predetermined range, and changes the tempo of the music when the tempo of the user's movement is within the predetermined range. apparatus.
  3. 　請求項２に記載の情報処理装置であって、
    　前記制御部は、前記楽曲のテンポの情報を取得し、前記楽曲のテンポの情報に基づいて、前記所定の範囲を設定する
    　情報処理装置。     An information processing apparatus according to claim 2,
    The information processing apparatus, wherein the control unit acquires tempo information of the music piece and sets the predetermined range based on the tempo information of the music piece.
  4. 　請求項３に記載の情報処理装置であって、
    　前記所定の範囲は、前記楽曲のテンポのｎ倍（ｎは、１以外の正の整数）を基準とした範囲を含む
    　情報処理装置。     The information processing apparatus according to claim 3,
    The predetermined range includes a range based on n times the tempo of the music (n is a positive integer other than 1).
  5. 　請求項３に記載の情報処理装置であって、
    　前記所定の範囲は、前記楽曲のテンポの１／ｎ倍（ｎは、１以外の正の整数）を基準とした範囲を含む
    　情報処理装置。     The information processing apparatus according to claim 3,
    The predetermined range includes a range based on 1 / n times the tempo of the music (n is a positive integer other than 1).
  6. 　請求項３に記載の情報処理装置であって、
    　前記所定の範囲は、前記楽曲のテンポの等倍を基準とした範囲を含む
    　情報処理装置。     The information processing apparatus according to claim 3,
    The predetermined range includes a range based on an equal magnification of the tempo of the music.
  7. 　請求項４に記載の情報処理装置であって、
    　前記制御部は、前記ユーザの動きのテンポが、前記楽曲のテンポのｎ倍を基準とした範囲内にある場合、前記楽曲のテンポを速くするように、前記楽曲のテンポを変化させる
    　情報処理装置。     The information processing apparatus according to claim 4,
    The control unit changes the tempo of the music so as to increase the tempo of the music when the user's movement tempo is in a range based on n times the tempo of the music. .
  8. 　請求項５に記載の情報処理装置であって、
    　前記制御部は、前記ユーザの動きのテンポが、前記楽曲のテンポの１／ｎ倍を基準とした範囲内にある場合、前記楽曲のテンポを遅くするように、前記楽曲のテンポを変化させる
    　情報処理装置。     The information processing apparatus according to claim 5,
    The control unit changes the tempo of the music so as to slow down the tempo of the music when the user's movement tempo is in a range based on 1 / n times the tempo of the music. Processing equipment.
  9. 　請求項２に記載の情報処理装置であって、
    　前記制御部は、前記ユーザの動きのテンポと、前記楽曲のテンポとの差ｄを算出し、前記差ｄに基づいて、前記楽曲のテンポを変化させる
    　情報処理装置。     An information processing apparatus according to claim 2,
    The information processing apparatus, wherein the control unit calculates a difference d between the tempo of the user's movement and the tempo of the music, and changes the tempo of the music based on the difference d.
  10. 　請求項９に記載の情報処理装置であって、
    　前記制御部は、前記差ｄにパラメータｋを乗算した値を、前記楽曲のテンポに加算することで、前記楽曲のテンポを変化させる
    　情報処理装置。     The information processing apparatus according to claim 9,
    The control unit changes the tempo of the music piece by adding a value obtained by multiplying the difference d by a parameter k to the tempo of the music piece.
  11. 　請求項１０に記載の情報処理装置であって、
    　前記所定の範囲は、複数の範囲を含み、
    　前記制御部は、範囲毎にそれぞれ異なる前記パラメータｋを使用する
    　情報処理装置。     The information processing apparatus according to claim 10,
    The predetermined range includes a plurality of ranges,
    The control unit uses the parameter k that is different for each range.
  12. 　ユーザの動きのテンポの情報を取得し、
    　ユーザの動きのテンポの情報に基づいて、再生されている楽曲のテンポを動的に変化させる
    　情報処理方法。     Get tempo information of user movement,
    An information processing method for dynamically changing the tempo of a music being played based on information on a user's movement tempo.
  13. 　ユーザの動きのテンポの情報を取得し、
    　ユーザの動きのテンポの情報に基づいて、再生されている楽曲のテンポを動的に変化させる
    　制御部としてコンピュータを機能させるプログラム。     Get tempo information of user movement,
    A program that causes a computer to function as a control unit that dynamically changes the tempo of the music being played based on information about the tempo of user movement.
PCT/JP2018/046365 2018-02-02 2018-12-17 Information processing device, information processing method, and program WO2019150800A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018017213 2018-02-02
JP2018-017213 2018-02-02

Publications (1)

Publication Number Publication Date
WO2019150800A1 true WO2019150800A1 (en) 2019-08-08

Family

ID=67479915

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/046365 WO2019150800A1 (en) 2018-02-02 2018-12-17 Information processing device, information processing method, and program

Country Status (1)

Country Link
WO (1) WO2019150800A1 (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003085888A (en) * 2001-09-07 2003-03-20 Sony Corp Music reproducing device and control method for the same
JP2005156641A (en) * 2003-11-20 2005-06-16 Sony Corp Playback mode control device and method

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003085888A (en) * 2001-09-07 2003-03-20 Sony Corp Music reproducing device and control method for the same
JP2005156641A (en) * 2003-11-20 2005-06-16 Sony Corp Playback mode control device and method

Similar Documents

Publication Publication Date Title
US11805345B2 (en) Haptic output system
CN111326132B (en) Audio processing method and device, storage medium and electronic equipment
US7585252B2 (en) Personal training device using multi-dimensional spatial audio
JP6055657B2 (en) GAME SYSTEM, GAME PROCESSING CONTROL METHOD, GAME DEVICE, AND GAME PROGRAM
WO2020224322A1 (en) Method and device for processing music file, terminal and storage medium
JP6596896B2 (en) Head-related transfer function selection device, head-related transfer function selection method, head-related transfer function selection program, sound reproduction device
WO2005106839A1 (en) Semiconductor device having music generation function, and mobile electronic device, mobile telephone device, spectacle instrument, and spectacle instrument set using the same
CN109119057A (en) Musical composition method, apparatus and storage medium and wearable device
JP6161886B2 (en) Audio output system, information processing apparatus, information processing program, and audio output control method
JP7476930B2 (en) Vibration Sensor
WO2019150800A1 (en) Information processing device, information processing method, and program
WO2018168247A1 (en) Information processing device, information processing method, and program
US11487496B2 (en) Controlling audio processing
JP2023546839A (en) Audiovisual rendering device and method of operation thereof
JP2014081727A (en) Voice output system, voice output program, voice output control method, and information processing device
JP2018064216A (en) Force sense data development apparatus, electronic apparatus, force sense data development method and control program
WO2023084933A1 (en) Information processing device, information processing method, and program
CN113318432B (en) Music control method in game, nonvolatile storage medium and electronic device
JP7293741B2 (en) Posture improvement support device, posture improvement support method, and posture improvement support program
US20240135912A1 (en) Audio cancellation system and method
US20240233702A9 (en) Audio cancellation system and method
WO2023173285A1 (en) Audio processing method and apparatus, electronic device, and computer-readable storage medium
KR20240088517A (en) Spatial sound processing method and apparatus therefor
JP2009086056A (en) Mobile terminal device, movement guide method and movement guide program
WO2020008856A1 (en) Information processing apparatus, information processing method, and recording medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18904204

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18904204

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP