JP7171530B2 - Haptic vibration delivery device, Haptic vibration delivery method, Haptic vibration delivery program - Google Patents

Description

The present invention relates to a haptic vibration distribution device, a haptic vibration distribution method, and a haptic vibration distribution program for distributing vibrations that can be felt as a tactile sensation.

The technique described in Non-Patent Document 1 is known as a technique for distributing vibrations that are felt as a sense of touch. Non-Patent Document 1 discloses a platform that transmits tactile information and a physical network node that functions as a gateway for inputting and outputting tactile information of the body and tangible objects.

Satoshi Matsuzono, Kota Minamizawa, "HaptI/O: Development of haptic transmission node using IP transmission technology", Master's thesis, Keio University, 2018.03.

If the device that acquires the haptic vibration signal (distribution source terminal) and the device that presents it (distribution destination terminal) are paired, content using the haptic vibration signal can be enjoyed. However, if the acquisition device (distribution source terminal) and the presentation device (distribution destination terminal) are different, there is a possibility that part of the data will be lost or degraded. For example, if the acquisition device has one channel and the presentation device has two channels, only one of the presentation devices outputs a signal, or both presentation devices output the same signal. Conversely, when the acquisition device has two channels and the presentation device has one channel, only one channel of the acquisition device is output, or the sum of both channels is output.

SUMMARY OF THE INVENTION It is an object of the present invention to reduce discomfort even when the number of channels differs between a distribution source terminal and a distribution destination terminal.

A haptic vibration distribution device of the present invention includes at least a channel number detector and an output signal generator. The number-of-channels detection unit detects the number N of channels of the delivery destination terminal. The output signal generator converts a vibration signal, which is a signal related to vibration of the number of channels M associated with onomatopoeia information, into an N-channel vibration signal using the onomatopoeia information. Here, M and N are integers of 1 or more.

According to the tactile vibration distribution device of the present invention, since the onomatopoeia information is used to convert it into N-channel vibration signals, signals can be selected so as to easily match human senses. Therefore, discomfort can be reduced.

The figure which shows the functional structural example of a haptic vibration delivery system. The figure which shows the example of the processing flow of a haptic vibration delivery system. The figure which shows the image which linked|related onomatopoeia information with the vibration signal. 4 is a diagram showing an example of a vibration signal stored in a storage unit 190; FIG. The figure which shows the image of the vibration signal to distribute. The figure which shows the structural example of a computer.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described in detail. Components having the same function are given the same number, and redundant description is omitted.

In this specification, D, M, and N are integers of 1 or more, K is an integer indicating the frame length, d is an integer of 1 or more and D or less, m is an integer of 1 or more and M or less, and n is 1 or more and N or less. An integer, k is an integer of 1 or more and K or less, N_1, .

FIG. 1 shows an example of the functional configuration of the haptic vibration distribution system, and FIG. 2 shows an example of the processing flow of the haptic vibration distribution system. The haptic vibration distribution system 10 includes a haptic vibration distribution device 100, a distribution source terminal 200, and distribution destination terminals 300_1, . . . , 300_D. The distribution source terminal 200 and the distribution destination terminals 300_1, . It may be an object attached with a device (sensor, vibrator, etc.) to transmit information.

The distribution source terminal 200 includes at least an acquisition unit 210 . The acquisition unit 210 acquires and outputs a vibration signal, which is a signal related to vibration, using a tactile vibration sensor or the like that detects tactile vibration (S210). The number of channels of the vibration signal is M, and the frame length is K. Let the vibration signals of the m-th channel be x _m (1), ..., x _m (k), ..., x _m (K). The vibration signal may be sampled at 48 kHz, for example, and the frame length K may be set to 4800 (that is, 0.1 second).

Either the distribution source terminal 200 has the onomatopoeia giving unit 220 or the haptic vibration distribution device 100 has the onomatopoeia giving unit 120 . The onomatopoeia giving unit 220, 120 receives the vibration signal acquired by the acquisition unit 210, or the vibration signal and the acoustic signal when the vibration signal is acquired, acquires or generates the onomatopoeia (text information) for the vibration signal, and the onomatopoeia Onomatopoeia information, which is information indicating , is output in association with the vibration signal (S220, S120). The onomatopoeia may be acquired by a person inputting it to the distribution source terminal 200 or another terminal, and the onomatopoeia giving unit 220 or the onomatopoeia giving unit 120 may associate the vibration signal with the onomatopoeia information. Alternatively, from the acoustic signal or the tactile vibration itself when tactile vibration (vibration signal) is acquired, a single pronunciation (or half-tone vibration) is extracted, a phoneme is determined, an onomatopoeic word is generated, and multiple syllables are extracted. You may automatically generate onomatopoeia by integrating. For automatic generation, for example, reference 1 (Kazushi Ishihara, Yuya Hattori, Tomohiro Nakatani, Tetsuya Ogata, Hiroshi Okuno, "Resolving phoneme determination ambiguity in onomatopoeic conversion of environmental sounds", Information Processing Society of Japan 66th National Convention, 3Y-5, Mar. 2004.). The frame length K of the vibration signal described above is set to a length at which a signal corresponding to a single sound or two or three single sounds (two single sounds "ton" are "tonton") is extracted from the vibration signal. It is desirable to FIG. 3 shows an image in which onomatopoeia information is associated with the vibration signal. Information in which two or more onomatopoeias are associated with a vibration signal may be used as onomatopoeia information. For example, you may change onomatopoeia by a channel.

When the onomatopoeia imparting unit 220 associates the onomatopoeia information, the M-channel vibration signal associated with the onomatopoeia information output by the onomatopoeia imparting unit 220 is transmitted from the distribution source terminal 200 to the haptic vibration distribution device 100 . When the onomatopoeia adding unit 120 associates the onomatopoeia information, for example, the M-channel vibration signal and the onomatopoeia input by a person, or the M-channel vibration signal and the acoustic signal are transmitted from the distribution source terminal 200 to the haptic vibration distribution device 100. be.

The vibration signal associated with the onomatopoeia information output from the onomatopoeia imparting unit 120 or the onomatopoeia imparting unit 220 may be input to the storage unit 190 together with the number of channels M and stored in the storage unit 190 .

The haptic vibration distribution device 100 includes a channel number detection section 130 , an output signal generation section 160 and a storage section 190 . The number-of-channels detection unit 130 acquires and outputs the number of channels N of the delivery destination terminal (S130). If there is one delivery destination terminal, one channel number N_1 should be detected. , 300_D as shown in FIG. 1, the number of (D) channels N_1, . . . , N_D of each of the destination terminals 300_d is detected. In addition, when the vibration signal is distributed when there is a distribution request from the distribution destination terminal 300_d, information on the number of channels N_d is included in the distribution request from the distribution destination terminal 300_d, and the channel number detection unit 130 receives The number of channels N_d may be acquired from the distribution request.

The output signal generation unit 160 receives the number of channels (N_1, ..., N_D) of the distribution destination terminal and the vibration signal of M channels associated with the onomatopoeia information, and receives N_1 for transmitting to the distribution destination terminals 300_1, ..., 300_D. Channel vibration signals, . . . , N_D channel vibration signals are generated and output. If the number of channels M of the vibration signal associated with the onomatopoeia information and the number of channels N_d of the delivery destination terminal 300_d are the same, the output signal generation unit 160 generates the M-channel vibration signal associated with the input onomatopoeia information, The N_d channel vibration signal is directly sent to the delivery destination terminal 300_d. When the number of channels M of the vibration signal associated with the onomatopoeia information and the number of channels N_d of the delivery destination terminal 300_d are different, the output signal generation unit 160 determines the number of channels M of the vibration signal associated with the onomatopoeia information and the delivery destination terminal The number of channels N_d of 300_d is compared, and considering the difference in the number of channels, the M-channel vibration signal associated with the onomatopoeia information is converted into an N-channel vibration signal using the onomatopoeia information (S160). . The storage unit 190 stores vibration signals associated with onomatopoeia information. FIG. 4 is an example of a vibration signal stored in the storage unit 190. As shown in FIG. In this example, the vibration signal is stored in association with not only the onomatopoeia information but also the number of channels (number of channels), rhythm (BPM: Beat per Minute), and power. The number of channels, rhythm, and power may be associated as appropriate. In this embodiment, an example using rhythm and power is not shown, but will be shown in a modified example described later.

In this paragraph and the next paragraph, the number of channels of the delivery destination terminal 300 is assumed to be N. First, an example in the case of N>M will be shown. The output signal generation unit 160 converts the vibration signal of the channel number M associated with the input onomatopoeia information into the signal of the M channels out of the signal of the channel number N of the delivery destination terminal as it is, and then NM A signal for each channel is generated as follows. The output signal generation unit 160 acquires from the storage unit 190 the vibration signal associated with the same onomatopoeia information as the onomatopoeia information associated with the M-channel vibration signal. Then, the vibration signal acquired from the storage unit 190 is also used to generate an N-channel vibration signal. For example, vibration signals associated with the same onomatopoeia information for NM channels may be acquired from the storage unit 190 . The output signal generation unit 160 may assign the M-channel vibration signals and the NM-channel vibration signals acquired from the storage unit 190 to the N channels as they are, or assign the result of the weighted addition to each of the N channels. may be assigned. If the vibration signals associated with the same onomatopoeia information for NM channels in the storage unit 190 are recorded for NM channels or more, the vibration signals in the storage unit 190 are given priority in advance, A vibration signal having a high priority may be preferentially acquired, or a vibration signal newly stored in the storage unit 190 may be preferentially acquired.

Next, an example in the case of N<M is shown. Output signal generating section 160 may assign the results of weighted addition of M-channel vibration signals received from distribution source terminal 200 to each of N channels. Moreover, the priority of onomatopoeia may be memorize|stored in the memory|storage part 190, and weighting depending on a priority may be performed. For example, if different onomatopoeias are associated with the vibration signals of the M channels depending on the channel, weighted addition may be performed by increasing the weight of the vibration signal of the channel associated with the onomatopoeia of higher priority. The output signal generation unit 160 selects N channels from the vibration signals of the M channels received from the distribution source terminal 200 at random, or from the vibration signals of the channels associated with onomatopoeia with high priority, and each May be assigned to a channel.

When distributing the vibration signal to each of the distribution destination terminals 300_1, . The haptic vibration distribution device 100 distributes vibration signals generated by the output signal generation unit 160 to the distribution destination terminals 300_1, . . . , 300_D. The signal output from the output signal generation unit 160 may additionally be stored in the storage unit 190 as a vibration signal associated with onomatopoeia information of the number of channels N_d. FIG. 5 shows an image of the vibration signal to be distributed.

Destination terminals 300_1, . . . , 300_D are provided with presentation units 370_1, . The presentation unit 370 — d receives the received vibration signal as an input, and transmits the vibration to the user by vibration or the like according to the vibration signal.

According to the tactile vibration distribution device of the present invention, since the onomatopoeia information is used to convert it into N-channel vibration signals, signals can be selected so as to easily match human senses. Therefore, discomfort can be reduced.

[Modification 1]
The haptic vibration distribution device 100 may further include a rhythm detection section 140 . In this case, the rhythm detection unit 140 receives the M-channel vibration signal as input, detects the rhythm of the M-channel vibration signal, and outputs it (S140).

The output signal generation unit 160 receives a rhythm as input, and based on the rhythm, generates and outputs N_1 channel vibration signals, . Specifically, for example, when N>M, the output signal generation unit 160 may acquire vibration signals from the storage unit 190 by giving high priority to vibration signals having a similar rhythm. Alternatively, the output signal generation unit 160 acquires from the storage unit 190 vibration signals associated with the same onomatopoeia information for NM channels, and the vibration signals of the M channels and the NM channels acquired from the storage unit 190 Vibration signals having a closer rhythm may be weighted and added, and the result may be assigned to each of the N channels as an N-channel vibration signal. Conversely, when N≦M, the vibration signals may be generated so that the priority of the vibration signal having a closer rhythm is higher. For example, when N≦M, the output signal generation unit 160 weights and adds the vibration signals of the M channels so that the closer the rhythm is and the higher the priority of the vibration signals is, the weighted sum is added to the N channel vibration signals. may be

According to the haptic vibration distribution device of this modified example, a vibration signal more similar to that of the first embodiment can be used, so that discomfort can be further reduced.

[Modification 2]
The haptic vibration distribution device 100 of the first embodiment may further include a power detection unit 150 , and the haptic vibration distribution device 100 of the first modification may further include the power detection unit 150 . In this case, the power detection unit 150 receives the M-channel vibration signal as an input, and detects and outputs the power of each channel of the M-channel vibration signal (S150). The "power" to be detected may be the maximum value max {x _m (1), ..., x _m (k), ..., x _m (K)} of the vibration signal, or the average value (x _m ( 1) +...+ _xm (k)+...+ _xm (K))/K.

Output signal generating section 160 receives power as an input, and based on the power, generates and outputs N_1 channel vibration signals, . Specifically, for example, when N>M, the output signal generation unit 160 obtains the average power of the M channels, and preferentially extracts the vibration signal having the average power close to the average power from the storage unit 190. good. Alternatively, the output signal generation unit 160 acquires vibration signals associated with the same onomatopoeia information for NM channels from the storage unit 190, and prioritizes vibration signals with average powers close to the average power of the M channels. The vibration signals of the M channels and the vibration signals of the NM channels acquired from the storage unit 190 are weighted more heavily for the vibration signals with higher priority, and the results of weighted addition are added to the respective channels of the N channels. may be assigned. Further, for example, when N≤M, the power detection unit 150 detects the power of each of the M channels of the vibration signal, and the output signal generation unit 160 weights the vibration signal of the M channels as the power increases. may be used as the N-channel vibration signal.

According to the haptic vibration distribution device of this modified example, a vibration signal more similar to that of the first embodiment can be used, so that discomfort can be further reduced.

[Program, recording medium]
In the above-described various processes, the recording unit 2020 of the computer 2000 shown in FIG. It can be implemented by

A program describing the contents of this processing can be recorded in a computer-readable recording medium. Any computer-readable recording medium may be used, for example, a magnetic recording device, an optical disk, a magneto-optical recording medium, a semiconductor memory, or the like.

Also, the distribution of this program is carried out by selling, assigning, lending, etc. portable recording media such as DVDs and CD-ROMs on which the program is recorded. Further, the program may be distributed by storing the program in the storage device of the server computer and transferring the program from the server computer to other computers via the network.

A computer that executes such a program, for example, first stores the program recorded on a portable recording medium or the program transferred from the server computer once in its own storage device. Then, when executing the process, this computer reads the program stored in its own recording medium and executes the process according to the read program. Also, as another execution form of this program, the computer may read the program directly from a portable recording medium and execute processing according to the program, and the program is transferred from the server computer to this computer. Each time, the processing according to the received program may be executed sequentially. In addition, the above processing is executed by a so-called ASP (Application Service Provider) type service, which does not transfer the program from the server computer to this computer, and realizes the processing function only by the execution instruction and result acquisition. may be It should be noted that the program in this embodiment includes information that is used for processing by a computer and that conforms to the program (data that is not a direct instruction to the computer but has the property of prescribing the processing of the computer, etc.).

Moreover, in this embodiment, the device is configured by executing a predetermined program on a computer, but at least a part of these processing contents may be implemented by hardware.

100 tactile vibration distribution device 120, 220 onomatopoeia addition unit 130 channel number detection unit 140 rhythm detection unit 150 power detection unit 160 output signal generation unit 190 storage unit 200 distribution source terminal 210 acquisition unit 300 distribution destination terminal 370 presentation unit

Claims (7)

Let M and N be integers of 1 or more,
a storage unit storing vibration signals associated with onomatopoeia information;
a channel number detection unit that acquires the channel number N of the delivery destination terminal;
An output signal generation unit that converts a vibration signal, which is a signal related to vibration of the number of channels M associated with onomatopoeia information, into an N-channel vibration signal using the onomatopoeia information ,
The output signal generation unit acquires from the storage unit a vibration signal associated with the same onomatopoeia information as the onomatopoeia information associated with the vibration signal of the M channel, and also uses the vibration signal acquired from the storage unit to transmit the N channel generate a vibration signal
A haptic vibration distribution device characterized by : The haptic vibration delivery device according to claim 1 ,
Information about the rhythm of the vibration signal is also associated with the vibration signal stored in the storage unit,
A rhythm detection unit for detecting the rhythm of the M-channel vibration signal is also provided,
The haptic vibration distribution device, wherein the output signal generation unit acquires the vibration signals from the storage unit by giving high priority to vibration signals having a similar rhythm. The haptic vibration delivery device according to claim 1 or 2 ,
Information about the power of the vibration signal is also associated with the vibration signal stored in the storage unit,
A power detection unit for detecting the power of each channel of the M-channel vibration signal is also provided,
The haptic vibration distribution device, wherein the output signal generation unit acquires the vibration signals from the storage unit by giving high priority to vibration signals having powers close to an average power of the M channels. The haptic vibration delivery device according to any one of claims 1 to 3 ,
The storage unit also stores a predetermined onomatopoeia priority,
The haptic vibration distribution device, wherein the output signal generation unit generates N-channel vibration signals by weighted addition depending on priority. The haptic vibration delivery device according to any one of claims 1 to 4 ,
A power detection unit for detecting the power of each channel of the M-channel vibration signal is also provided,
The haptic vibration distribution device, wherein the output signal generation unit generates the N-channel vibration signal by weighted addition in which the weight of the vibration signal having a large power is increased. Let M and N be integers of 1 or more,
Store the vibration signal associated with the onomatopoeia information in the recording unit,
an acquisition step of acquiring a vibration signal that is a signal related to M-channel vibration in the delivery source terminal;
an onomatopoeia giving step of associating, for each channel, onomatopoeia information corresponding to the vibration signal of each channel with respect to the vibration signal of the M channels;
a channel number detection step of detecting the channel number N of the delivery destination terminal;
an output signal generating step of converting the M-channel vibration signal into an N-channel vibration signal using the onomatopoeia information;
A haptic vibration delivery method for executing a presentation step of presenting haptic vibration based on an N-channel vibration signal at a delivery destination terminal,
The output signal generating step acquires a vibration signal associated with the same onomatopoeia information as the onomatopoeia information associated with the M-channel vibration signal from the storage unit, and uses the vibration signal acquired from the storage unit to generate the N-channel generate a vibration signal
A haptic vibration delivery method characterized by : A haptic vibration distribution program for causing a computer to function as the haptic vibration distribution device according to any one of claims 1 to 5 .

Images