JP2022147952A - Rhythm playback device, rhythm playback program, and rhythm playback method - Google Patents

Abstract

To provide a rhythm playback device, a rhythm playback program, and a rhythm playback method that can extract rhythms from sound source data and plays back the rhythms as waveforms that act on the tactile sense of a human body.SOLUTION: A rhythm playback device 100 includes a signal extraction unit 11, an amplitude detection unit 12, and a waveform conversion unit 14. The signal extraction unit 11 extracts sound source data as a frequency band signal. The amplitude detection unit 12 detects the amplitude of the signal extracted by the signal extraction unit 11. On the basis of the amplitude detected by the amplitude detection unit 12, the waveform conversion unit 14 converts the signal extracted by the signal extraction unit 11 into a predetermined waveform.SELECTED DRAWING: Figure 2

Description

The present invention relates to a rhythm reproduction device, a rhythm reproduction program, and a rhythm reproduction method.

In recent years, in addition to music reproduction in the audible range, rhythm reproduction technology has been developed that generates tactile waveforms by outputting from vibration actuators based on sound source data.

Patent Document 1 describes a conventional rhythm reproducing device. This rhythm playback device includes branching means for branching an electrical signal from an audio playback device to be connected, amplification means for amplifying the voltage of one of the branched electrical signals, and rectification for converting the amplified electrical signal into a direct current. means, vibration presenting means attached to the back of the user's earlobe and presenting low-frequency vibration (approximately 200 Hz or less) based on the DC-converted electrical signal, and other electrical signals that are inserted into the user's inner ear and branched. and an acoustic output means for converting the signal into an acoustic signal in an audible range and outputting the same phase as the low-frequency vibration.

Japanese Unexamined Patent Application Publication No. 2012-50003

The rhythm playback device described in Patent Document 1 rectifies the original sound source and presents vibrations to the user by using the high-cut function of the vibration actuator. It is far from the rhythm of the original sound source. In addition, since the waveform of the original sound source is applied to the vibration actuator as it is, it is not possible to obtain a comfortable feel. It was difficult.

SUMMARY OF THE INVENTION The present invention has been made in view of such circumstances, and its object is to provide a rhythm reproducing apparatus and rhythm reproducing apparatus capable of extracting rhythm from sound source data and reproducing it as a waveform acting on the tactile sense of the human body. To provide a program and a rhythm reproduction method.

A rhythm reproduction apparatus according to one aspect of the present invention includes a signal extractor that extracts sound source data as a frequency band signal, an amplitude detector that detects the amplitude of the signal extracted by the signal extractor, and the amplitude detector. and a waveform conversion section for converting the signal extracted by the signal extraction section into a predetermined waveform based on the amplitude detected by the signal extraction section.

Another aspect of the present invention is a rhythm reproduction program. This rhythm reproduction program includes a signal extraction step of extracting sound source data as a frequency band signal, an amplitude detection step of detecting the amplitude of the signal extracted by the signal extraction step, and the amplitude detected by the amplitude detection step. and a waveform conversion step of converting the signal extracted by the signal extraction step into a predetermined waveform based on the above.

Another aspect of the present invention is a rhythm reproduction method. This rhythm reproduction method includes a signal extraction step of extracting sound source data as a frequency band signal, an amplitude detection step of detecting the amplitude of the signal extracted by the signal extraction step, and the amplitude detected by the amplitude detection step. and a waveform conversion step of converting the signal extracted by the signal extraction step into a predetermined waveform based on.

According to the present invention, a rhythm can be extracted from sound source data and reproduced as a waveform that affects the tactile sense of the human body.

FIG. 4 is a schematic diagram for explaining the action on the sense of touch by the rhythm reproduction device according to the embodiment; 1 is a block diagram showing the configuration of a rhythm reproducing device; FIG. 4 is a flowchart showing a procedure of conversion processing of sound source data; 5 is a graph showing sound source data and a drive signal after waveform conversion;

BEST MODE FOR CARRYING OUT THE INVENTION The present invention will be described below based on preferred embodiments with reference to FIGS. 1 to 4. FIG. The same or equivalent constituent elements and members shown in each drawing are denoted by the same reference numerals, and duplication of description will be omitted as appropriate. In addition, the dimensions of the members in each drawing are appropriately enlarged or reduced for easy understanding. Also, in each drawing, some of the members that are not important for explaining the embodiments are omitted.

(embodiment)
FIG. 1 is a schematic diagram for explaining how the rhythm reproducing device 100 according to the embodiment affects the sense of touch. The rhythm reproducing apparatus 100 converts input sound source data into a waveform (driving signal) to be applied to the vibration actuator 5 . The sound source data may be provided externally or from a memory (not shown) built into the rhythm reproducing apparatus 100 . After signal processing of the sound source data by the rhythm reproduction device 100 , the converted waveform is sent to the vibration actuator 5 . The vibration actuator 5 is attached, for example, near the user's ear, and gives vibration to the user through the sense of touch.

FIG. 2 is a block diagram showing the configuration of the rhythm reproduction device 100. As shown in FIG. Rhythm reproduction device 100 includes signal extraction section 11 , amplitude detection section 12 , storage section 13 and waveform conversion section 14 , and converts the waveform of input sound source data to generate a drive signal for driving vibration actuator 5 .

In terms of hardware, each unit in rhythm playback device 100 can be realized by electronic elements such as a computer CPU, mechanical parts, etc., and in terms of software, it can be realized by computer programs and the like. It depicts the functional blocks implemented by Therefore, those skilled in the art will understand that these functional blocks can be realized in various forms by combining hardware and software.

The signal extraction unit 11 extracts sound source data as signals in at least one or more frequency bands. The signal extraction unit 11 is configured by a bandpass filter that passes signals within each frequency band. The signal extractor 11 outputs the signal extracted for each frequency band to the amplitude detector 12 .

The amplitude detector 12 detects the amplitude of the input signal for each frequency band. The amplitude detection unit 12 outputs the input signal for each frequency band and the amplitude of each signal to the waveform conversion unit 14 .

The storage unit 13 stores a waveform setting table 13a including waveforms determined according to frequency bands and amplitudes. The storage unit 13 is configured by a data storage device such as a RAM (Random Access Memory), a flash memory, a hard disk storage device, or the like. The waveform setting table 13a is a table including rectangular waves, sawtooth waves, impulse waves, etc. as waveforms determined according to the frequency band and amplitude.

In order to make the rise of the vibration generated by the vibration actuator 5 sharp in a short period of time, the waveform included in the waveform setting table 13a should have a steep rise characteristic. The waveforms included in the waveform setting table 13a may include waveforms that can be reproduced by the vibration actuator 5 with a tactile sensation of 800 Hz or less, for example.

Using the waveform setting table 13a, the waveform conversion unit 14 converts the waveform of the input signal for each frequency band based on the amplitude of each signal. The waveform transforming unit 14 may transform the waveform of the signal for all frequency bands, or may transform the waveform of the signal whose amplitude exceeds a predetermined amplitude threshold, for example. Also, the predetermined amplitude threshold may be changed according to the amplitude of the sound source data, or may be arbitrarily changed. The waveform converter 14 superimposes the converted waveforms for each frequency band to generate a drive signal to be input to the vibration actuator 5 .

For example, when generating a rectangular wave, the waveform conversion unit 14 may set the interval period to the waveform after conversion, and adjust the intervals of the rectangular wave included in the drive signal. The interval period means a predetermined period. Specifically, when generating a rectangular wave or the like, the waveform conversion unit 14 sets an interval period from the point of time when the waveform such as the rectangular wave is generated, and generates another waveform such as the rectangular wave during the interval period. By not generating it, the interval between waveforms such as rectangular waves can be adjusted. The interval period may be set for each waveform and included in the waveform setting table 13a. An interval period may be inserted when the number of waveforms exceeding a predetermined threshold in amplitude exceeds a predetermined threshold in the number of waveforms within a predetermined period. The predetermined period and the predetermined threshold for the number of waveforms may be arbitrarily varied.

The vibration actuator 5 is, for example, an eccentric type or linear movable type vibrator. The vibration actuator 5 has a support member (not shown) that supports a movable portion that generates vibration, and is configured such that the movable portion comes into contact with the user's body.

Next, the operation of the rhythm reproducing apparatus 100 will be described based on the conversion processing of sound source data. FIG. 3 is a flow chart showing the procedure of conversion processing of sound source data. The signal extraction unit 11 of the rhythm reproduction device 100 extracts signals for each frequency band from the sound source data (S1). The amplitude detector 12 detects the amplitude of the signal extracted by the signal extractor 11 for each frequency band (S2).

The waveform converter 14 collates the waveform setting table 13a based on the amplitude detected for each frequency band, and generates a rectangular wave signal (S3). The waveform conversion unit 14 may generate not only a rectangular wave but also a sawtooth wave included in the waveform setting table 13a.

The waveform conversion unit 14 sets the interval period included in the waveform setting table 13a for the generated rectangular wave signal (S4), and ends the process. The rhythm reproducing device 100 repeats the processing from step S1 to step S4 from the beginning to the end of the sound source data to generate a driving signal for the vibration actuator 5. FIG.

The vibration actuator 5 receives the drive signal generated by the waveform converter 14 and generates vibration. By driving the vibration actuator 5 with a waveform generated based on the amplitude of the signal for each frequency band, the rhythm reproduction device 100 can extract the rhythm from the sound source data and reproduce it as a waveform that affects the tactile sense of the human body. .

The rhythm reproduction device 100 can generate vibrations that the user can easily perceive tactilely by generating a waveform, such as a rectangular wave or a sawtooth wave, with steep rise characteristics as a drive signal. Also, the rhythm reproducing apparatus 100 generates, as the drive signal, a waveform including frequency components of 800 Hz or less, as a range of waveforms that can be reproduced by the user's tactile sensation.

In addition, the rhythm reproducing apparatus 100 inserts an interval period into the waveform of the drive signal to adjust the interval of the rectangular wave or the like, thereby separating each of the vibrations that are generated moment by moment so that they can be easily perceived by the sense of touch. can be done.

Also, the rhythm reproducing device 100 extracts the main rhythm from the sound source data of the music and gives the user a comfortable tactile sensation with the vibration actuator 5, thereby providing the music in the audible range and allowing the user to experience the rhythm of the music. be able to. Also, the rhythm reproducing device 100 can provide a hearing-impaired person with a rhythm by touch, not by sound, so that they can experience music.

FIG. 4 is a graph showing sound source data and drive signals after waveform conversion. The horizontal axis in FIG. 4 represents time, and the vertical axis represents amplitude. The sound source data before conversion includes a plurality of portions in which sounds are generated in clusters (portions whose amplitude exceeds a predetermined threshold value) at intervals. In the sound source data, the amplitude fluctuates in the part where the sound is generated in clusters, so that the strength of the sound is generated in the audible range, and a sense of rhythm is generated.

The driving signal generated by the rhythm reproducing apparatus 100 generates rectangular waves at portions of sound source data where sounds are generated in clusters and has large amplitudes, and interval periods are formed between the rectangular waves. The rhythm reproduction device 100 inputs the generated drive signal to the vibration actuator 5 to give rhythmic vibrations to the user. In the drive signal of FIG. 4, the signal extending vertically like a line represents a short rectangular wave.

(Modification)
The waveform conversion unit 14 may change the gain and frequency of the rectangular wave generated as the drive signal based on an arbitrary correlation coefficient according to the sound source data. Although the drive signal shown in FIG. 4 includes a negative sign waveform, it is converted into a positive sign waveform by a rectifying circuit or a multiplier circuit according to the specifications of the vibration actuator 5 to be used. good too.

The waveform included in the drive signal contains frequency components of 800 Hz or less, which is the range in which vibrations can be perceived. can be Also, the waveform included in the drive signal may include frequency components of 20 Hz or less in order to further reduce sound leakage to the surroundings.

In addition, according to the number of channels of the sound source data, a configuration including a plurality of rhythm reproducing devices 100 and vibration actuators 5 may be used. The number of vibration actuators 5 may be thinned out by a process of reducing the number of channels output. Alternatively, one sound source data may be distributed, and a plurality of rhythm reproducing devices 100 and vibration actuators 5 corresponding to a plurality of frequency bands may be provided.

In the above-described embodiment, the vibration actuator 5 is mounted near the ear, but it is not limited to this and may be mounted anywhere on the body. Alternatively, the four vibration actuators 5 may be attached to both hands and both feet of the user.

As a method for providing vibration to the user, the vibration actuator 5 is used in the above-described embodiment. good too.

Sound source data includes not only music but also language-based sound sources such as recitation and narration. The rhythm reproduction device 100 can also extract language intonation and accent in reading and speaking, and is expected to support language learning.

Next, the features of the rhythm reproduction device 100, the rhythm reproduction program, and the rhythm reproduction method according to the embodiment and modifications will be described.
Rhythm reproduction device 100 includes signal extraction section 11 , amplitude detection section 12 and waveform conversion section 14 . The signal extraction unit 11 extracts sound source data as a frequency band signal. The amplitude detector 12 detects the amplitude of the signal extracted by the signal extractor 11 . The waveform converter 14 converts the signal extracted by the signal extractor 11 into a predetermined waveform based on the amplitude detected by the amplitude detector 12 . As a result, the rhythm reproducing apparatus 100 can extract the rhythm from the sound source data and reproduce it as a waveform that affects the tactile sense of the human body.

Predetermined waveforms include square waves or sawtooth waves. As a result, the rhythm reproducing device 100 can generate vibrations that the user can easily perceive through the sense of touch.

The waveform converter 14 provides predetermined intervals between the converted predetermined waveforms. As a result, the rhythm reproducing device 100 can separate the vibrations that are generated moment by moment by inserting interval periods in the waveform of the driving signal so that they can be easily perceived by the sense of touch.

The rhythm reproduction program causes the computer to execute a signal extraction step, an amplitude detection step and a waveform conversion step. The signal extraction step extracts the sound source data as a frequency band signal. The amplitude detection step detects the amplitude of the signal extracted by the signal extraction step. The waveform conversion step converts the signal extracted by the signal extraction step into a predetermined waveform based on the amplitude detected by the amplitude detection step. As a result, the rhythm reproduction program can extract the rhythm from the sound source data and reproduce it as a waveform that affects the tactile sense of the human body.

A rhythm reproduction method comprises a signal extraction step, an amplitude detection step and a waveform conversion step. The signal extraction step extracts the sound source data as a frequency band signal. The amplitude detection step detects the amplitude of the signal extracted by the signal extraction step. The waveform conversion step converts the signal extracted by the signal extraction step into a predetermined waveform based on the amplitude detected by the amplitude detection step. According to this rhythm reproduction method, a rhythm can be extracted from sound source data and reproduced as a waveform that affects the tactile sense of the human body.

The above has been described based on the embodiments of the present invention. Those skilled in the art will appreciate that these embodiments are illustrative and that various variations and modifications are possible within the scope of the claims of the present invention, and that such variations and modifications also fall within the scope of the claims of the present invention. It is about to be done. Accordingly, the description and drawings herein are to be regarded in an illustrative rather than a restrictive sense.

5 Vibration Actuator 11 Signal Extractor 12 Amplitude Detector 13 Storage 13a Waveform Setting Table 14 Waveform Transformer 100 Rhythm Playback Device

Claims (5)

a signal extraction unit that extracts sound source data as a frequency band signal;
an amplitude detector that detects the amplitude of the signal extracted by the signal extractor;
a waveform conversion unit for converting the signal extracted by the signal extraction unit into a predetermined waveform based on the amplitude detected by the amplitude detection unit;
rhythm playback device. 2. A rhythm reproducing apparatus according to claim 1, wherein said predetermined waveform includes a rectangular wave or a sawtooth wave. 3. The rhythm reproducing apparatus according to claim 1, wherein said waveform converting section provides predetermined intervals between the converted predetermined waveforms. a signal extraction step of extracting sound source data as a frequency band signal;
an amplitude detection step of detecting the amplitude of the signal extracted by the signal extraction step;
a waveform conversion step of converting the signal extracted by the signal extraction step into a predetermined waveform based on the amplitude detected by the amplitude detection step;
A rhythm playback program that causes a computer to execute a signal extraction step of extracting sound source data as a frequency band signal;
an amplitude detection step of detecting the amplitude of the signal extracted by the signal extraction step;
a waveform conversion step of converting the signal extracted by the signal extraction step into a predetermined waveform based on the amplitude detected by the amplitude detection step;
A rhythm playback method comprising:

Images