WO2018066299A1 - Information processing device, information processing method, and program - Google Patents

Information processing device, information processing method, and program Download PDF

Info

Publication number
WO2018066299A1
WO2018066299A1 PCT/JP2017/032408 JP2017032408W WO2018066299A1 WO 2018066299 A1 WO2018066299 A1 WO 2018066299A1 JP 2017032408 W JP2017032408 W JP 2017032408W WO 2018066299 A1 WO2018066299 A1 WO 2018066299A1
Authority
WO
WIPO (PCT)
Prior art keywords
signal
device
information processing
vibration
side
Prior art date
Application number
PCT/JP2017/032408
Other languages
French (fr)
Japanese (ja)
Inventor
猛史 荻田
諒 横山
山野 郁男
Original Assignee
ソニー株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to JP2016-198777 priority Critical
Priority to JP2016198777 priority
Priority to JP2017100764A priority patent/JP2018064264A/en
Priority to JP2017-100764 priority
Application filed by ソニー株式会社 filed Critical ソニー株式会社
Priority claimed from US16/328,913 external-priority patent/US20190220095A1/en
Publication of WO2018066299A1 publication Critical patent/WO2018066299A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer

Abstract

[Problem] Using oscillations, to improve function, operability, etc. [Solution] An information processing device according to the present technology comprises a computational processing unit. The computational processing unit: on the basis of first feature information which is extracted from a first sound signal which corresponds to a first channel from among a multi-channel sound which is outputted from a sound output device which is capable of outputting the multi-channel sound, generates a first tactile sensation presentation signal which is supplied to a first tactile sensation presentation device from among a plurality of tactile sensation presentation devices; and, on the basis of second feature information which is extracted from a second sound signal which corresponds to a second channel from among the multi-channel sound, generates a second tactile sensation presentation signal which is supplied to a second tactile sensation presentation device from among the plurality of tactile sensation presentation devices.

Description

The information processing apparatus, information processing method and program

This technique, for example, an information processing apparatus such as a mobile device, an information processing method, and a program.

Generally, the human audible range is said to 20,000Hz from approximately 20 Hz, the frequency characteristics of the digital audio signal is also set accordingly. However, low bandwidth, in particular the following low-frequency 100Hz is unlikely to sense a sound through human eardrum vibrations. Further, there is a limit to the reproduction capability of the following low-range sound 100Hz even the speaker. As strategy, technique to reproduce replacing woofer (bass) components of 5.1ch audio to the vibration of the vibrating device is known (see Patent Document 1).

JP 2014-229312 JP

Vibration-device included in the information processing apparatus, such as a smart phone is mainly remains to be utilized like the operation response or incoming call notification, such as on the touch sensitive panel. As seen in Patent Document 1, there is such technology to reproduce a vibration of the woofer (bass) components of 5.1ch audio, techniques for more effectively apply the vibration device in the information processing apparatus still insufficient it is.

In view of the circumstances as described above, an object of the present technology, with the vibration, the information processing apparatus capable of improving such functionality and operability, is to provide an information processing method, and a program.

In order to solve the above problems, an information processing apparatus according to the present disclosure, there is provided an arithmetic processing unit. The arithmetic processing unit, among the plurality of channels of audio output sound of a plurality of channels from the output enable audio output device, the first feature information extracted from the first audio signal corresponding to the first channel based on, among a plurality of tactile sense presentation device, to generate a first haptic presentation signal supplied to the first haptic presentation device, among the plurality of channels of audio, the second audio corresponding to the second channel based on the second feature information extracted from the signal, among the plurality of tactile sense presentation device, to generate a second tactile presentation signal supplied to the second haptic presentation device.

In the information processing apparatus, the arithmetic processing unit, as the first characteristic information, from said first audio signal, be extracted signal of the first low-frequency component belonging to a predetermined frequency below the frequency band good.

In the information processing apparatus, the arithmetic processing unit, as the second characteristic information, the second audio signal may be extracted second low frequency component belonging to the frequency band below a predetermined frequency.

In the information processing apparatus, the first haptic presentation device and the second haptic presentation device is remotely located, the arithmetic processing unit, opposite phase of the second low-frequency component of the signal a signal, and the amplitude of vibration is outputted from the second haptic presentation device based on the second low-frequency component of the signal, attenuated due to be transmitted to the first haptic presentation device a first opposite phase signal corresponding to the amplitude of the vibration, a signal obtained by adding to the first low-frequency component of the signal may be generated as the first tactile presentation signal.

In the information processing apparatus, the first haptic presentation device and the second haptic presentation device is remotely located, the arithmetic processing unit, the inverse phase of the first low-frequency component of the signal a signal, and the amplitude of vibration is outputted from the first haptic presentation device based on the first low-frequency component of the signal, attenuated due to be transmitted to the second haptic presentation device a second inverse phase signal corresponding to the amplitude of the vibration, a signal obtained by adding the second low-frequency component of the signal may be generated as the second haptic presentation signal.

In the information processing apparatus, the plurality of tactile sense presentation device, provided in the housing, the arithmetic processing unit, said plurality of orientations gravity direction positional relationship of the haptic presentation device that depends on the orientation of the posture of the casing and to determine close to the one of the horizontal direction, when the direction of the positional relationship is determined to be close to the horizontal direction, generating the first haptic presentation signal based on the first characteristic information, and, it may generate the second haptic presentation signal based on the second feature information.

In the information processing apparatus, the arithmetic processing unit, the orientation in the positional relationship when it is determined that the closer to the direction of gravity, the generated monaural audio signal from the plurality of channels of audio signals, based on the monaural audio signal it may generate the first haptic presentation signal and the second haptic presentation signal.

In the information processing apparatus, the arithmetic processing unit, the extracting third feature information from monaural audio signal, based on the third characteristic information, the first haptic presentation signal and the second haptic presentation signal it may be generated.

In the information processing apparatus, the arithmetic processing unit, as the third characteristic information, the monaural audio signal may be extracted signal of the third low frequency component belonging to the frequency band below a predetermined frequency.

In the information processing apparatus, the arithmetic processing unit, the signal of the third low frequency component, said first and generates a tactile sense presentation signal and antiphase signal of the third low frequency component of the signal and it may be generated as the second haptic presentation signal.

In the information processing apparatus, the plurality of tactile sense presentation device, the housing including a display device, provided at a first end and a second end which is opposite end portions of one coordinate direction of said display device it may be.

In the information processing apparatus, the plurality of tactile sense presentation device, may be provided to the wearable device.

In the information processing apparatus, the plurality of tactile sense presentation device, may be provided on the belt-type wearable device.

In the information processing apparatus, the plurality of tactile sense presentation device, the first side and the first side when said belt is worn on the body of the user be provided on a second side of the opposite good.

The information processing method according to the present technique, the arithmetic processing unit, among the plurality of channels of audio output sound of a plurality of channels from the output enable audio output device, from a first audio signal corresponding to the first channel based on the first feature information extracted among a plurality of tactile sense presentation device, to generate a first haptic presentation signal supplied to the first haptic presentation device, among the plurality of channels of audio, the second based on the second feature information extracted from the second audio signal corresponding to the channel, of the plurality of tactile sense presentation device, to generate a second tactile presentation signal supplied to the second haptic presentation device.

Program according to the present technology, among the plurality of channels of audio output sound of a plurality of channels from the output enable audio output device, a first feature extracted from the first audio signal corresponding to the first channel based on the information, among the plurality of tactile sense presentation device, to generate a first haptic presentation signal supplied to the first haptic presentation device, among the plurality of channels of audio, the second corresponding to the second channel based on the second feature information extracted from the speech signal, among the plurality of tactile sense presentation device, as an arithmetic processing unit for generating a second haptic presentation signal supplied to the second haptic presentation device, a computer to function make.

The information processing apparatus according to the present disclosure, there is provided a control unit. Wherein the control unit receives a request from the information processing terminal via a network, among the plurality of channels of audio output sound of a plurality of channels from the output enable audio output device, a first voice corresponding to the first channel based on the first feature information extracted from the signal, among the plurality of tactile sense presentation device, to generate a first haptic presentation signal supplied to the first haptic presentation device, among the plurality of channels of audio, the based on the second feature information extracted from the second audio signal corresponding to the second channel, among the plurality of tactile sense presentation device, generating a second haptic presentation signal supplied to the second haptic presentation device and transmits each information of the first haptic presentation signal and the second haptic presentation signal to the information processing terminal via the network.

The information processing apparatus according to another aspect of the present technology,
A housing,
A display device having a display screen capable of displaying images,
And two vibration devices disposed on the first end and a second end which is opposite end portions of one coordinate axis of the display screen of the casing,
Following the movement of an object displayed on a display screen of the display device comprises an arithmetic processing unit for the control to vibrate by shifting the said two vibration devices time.

In this information processing apparatus, the arithmetic processing unit may be one that is configured to vibrate the two vibrating device at different frequencies.

The information processing apparatus according to still another aspect of the present technology,
A housing,
A display device having a display screen capable of displaying images,
A touch sensor panel provided overlapping on said display device,
The first end which is opposite end portions of the one coordinate axis direction of the display screen of the housing and disposed in the second end, two vibration devices each vibrate in at least the other coordinate axis of the display screen When,
When the operation screen is displayed on the display device, and a processing unit for a touch operation to the touch sensor panel when it is detected, the controller controls the two vibration devices so as to vibrate in the same phase to.

As described above, according to this technique, it is possible to improve such with vibration function and operability.

It is a block diagram showing a hardware configuration of the information processing apparatus of the first embodiment of the present technology. Is a diagram illustrating an example of the arrangement and each of the vibration direction of the vibrating device of the oscillating device and R the side of the L-side of the information processing apparatus of FIG. The user information processing apparatus of FIG. 1 is a diagram showing a state in which both hands. Is a waveform diagram showing the processing up to the vibration waveform of the RL is generated from the stereo audio signal. The vibrating device of the L-side and R-side is a diagram for explaining the vibration noise generated when vibrated. It is a diagram showing a configuration of a portion for generating a vibration waveform capable of canceling the vibration noise in the arithmetic processing unit. The information processing apparatus of FIG. 1 the user is a diagram showing a state in which with one hand. It is a flowchart illustrating a method of generating a vibration waveform of LR respectively corresponding to the orientation of the housing of the information processing apparatus. It is a diagram showing a vibration direction of the vibrating device when the information processing apparatus of FIG. 1 user holds with one hand. It is a flowchart showing a procedure of generation of the vibration waveform by the vibration notification. It is a diagram showing a distribution of vibration in the touch sensor panel surface in the case where the respective vibration device L side and the R side is vibrated in opposite phases to each other. It is a diagram showing a distribution of vibration in the touch sensor panel surface in the case where the respective vibration device L side and the R side is vibrated at the same phase with each other. On a display screen of the information processing system of FIG. 1 is a diagram showing how the moving objects is displayed. It is a diagram illustrating an example of a vibration waveform of the combined L-side and R-side movement of the objects displayed. Two additional vibration device is a diagram showing the added information processing apparatus. Is a front view showing the mounted state of the stereo vibration belt according to the present technology. It is a top view of a stereo vibration belt attached to the user's waist. Is an exploded view of the stereo vibration belt at the time of non-attachment. It is a block diagram showing a controller configuration of a stereo vibration belt. Is a front view showing a vibrating the vibrating device of the left and right in the stereo vibration belt in the vertical direction. Is a front view showing that the upper and lower direction of the vibration of the right and left vibration device and opposite to each other in the stereo vibration belt of FIG. 20. It is a top view showing a vibrating the vibrating device of the left and right in the stereo vibration belt back and forth horizontally. Is a top view showing that the front and rear direction of the vibration of the right and left vibration device and opposite to each other in the stereo vibration belt of FIG. 22. It is a top view showing that the front and rear direction of the vibration of the left and right vibrating device was identical to each other in the stereo vibration belt of FIG. 22. Is a front view showing a vibrating the vibrating device of the left and right in the stereo vibration belt to the belt body thickness direction. Is a front view showing that the left and right vibrations of the belt member thickness direction of the orientation of the vibration device and the same as each other in the stereo vibration belt of FIG. 25. It is a front view showing a stereo vibration device system according to the present technology. Is a block diagram showing an electrical configuration of the stereo vibration device system. It is a top view showing a modification of the stereo vibration belt. It is a perspective view showing a stereo vibration belt attachable to the hand tool of the user.

Hereinafter, an embodiment of the present technology based on the drawings.
<First embodiment>

Hereinafter, an embodiment of the present technology based on the drawings.
This embodiment, the present disclosure is obtained by applying for example a portable, such as a smart phone, or wearable information processing apparatus such as a mobile device.

Configuration of the information processing apparatus]
Figure 1 is a block diagram showing a hardware configuration of the information processing apparatus of the first embodiment of the present technology.
As shown in the figure, the information processing apparatus 100, the arithmetic processing unit 1, a display 2, an acceleration sensor 3, a gyro sensor 4, the audio output amplifier 5, L (left) side of the speaker 6L (sound output device), R (right) side of the speaker 6R (sound output device), L side of the vibration device driving circuit 7L, R side of the vibration device driving circuit 7R, vibrating device 8L (tactile sense presentation device) of the L side, the R-side vibration device 8R ( having a tactile presentation device), and the like.

Arithmetic processing unit 1, CPU (Central Processing Unit), RAM (Random Access Memory), constituted by a ROM (Read Only Memory) and a flash ROM. The CPU performs arithmetic processing for executing an operating system and application programs loaded from the ROM and the flash ROM in the main memory area of ​​the RAM. Specifically, CPU, the display control of the arithmetic processing unit 1 to the connected display 2, processing of the video taken by the camera unit (not shown), the processing of the acceleration data generated by the acceleration sensor 3, not shown close processing of the proximity data generated by the sensor, and it operates in the angular acceleration data generated by the gyro sensor 4. Furthermore, CPU is, the L-side of the vibrating device 8L and R-side vibration device 8R a so as to respectively oscillate at vibration waveform of interest, controlling the vibration device driving circuit 7R vibration device driving circuit 7L and R side of the L side .

Display 2 has a panel-type display device for displaying an image, and a display driving circuit for generating a signal for output on the basis of the display unit display data supplied from the processing unit 1. Note that the indicator display 2, the touch sensor panel is supplied to the arithmetic processing unit 1 to generate a touched coordinate signal may be provided by the user.

Acceleration sensor 3, a sensor for detecting an acceleration in three axial directions applied to the information processing apparatus 100 (xyz axis directions). The direction orthogonal two axial vertical and horizontal in the screen of the display 2 of the information processing apparatus 100 x-axis and y-axis directions, the x-axis direction and the y-axis direction and the z-axis direction.

Gyro sensor 4 is a sensor for detecting the angular acceleration of the individual axis directions of the three axes given to the information processing apparatus 100 (xyz axes). Angular acceleration data detected by the gyro sensor 4, the processing unit 1, for example, used in processing such as detection and image stabilization of the posture of the information processing apparatus 100.

The audio output amplifier 5, and generates a signal for driving the speaker 6L for the L-side from the voice data supplied L side of the arithmetic processing unit 1, the audio data supplied R side of the arithmetic processing unit 1 generating a signal for driving the speaker 6R for the R side.

Each vibrating device 8R vibration devices 8L and R side of the L side is a device that generates vibrations in the information processing apparatus 100. In the present embodiment, vibration time, vibration frequency, vibration device having a structure capable of generating any vibration waveform with a high degree of freedom by varying the vibration amplitude can be used. For example, linear vibrator, a vibration device such as a piezoelectric element is used.

Vibration device driving circuit 7L of L side, it supplies a drive signal to the vibrating device 8L of L side on the basis of the vibration data of the arithmetic processing unit 1 supplied L side from.
Vibration device driving circuit 7R for R side, supplies a drive signal to the vibrating device 8R of R side on the basis of the vibration data of the arithmetic processing unit 1 supplied R side from.

Arithmetic processing unit 1, with respect to the control of the vibrating device 8R vibration devices 8L and R side of the L-side, generating respective vibration waveform of the vibration device 8R vibration devices 8L and R side L side from the stereo audio signal to be output configured. Each vibrating device 8L, will be explained later how to generate a vibration waveform 8R.

Alignment and vibration directions of the two vibration Device
Figure 2 is a diagram illustrating an example of a vibration direction arrangement and the respective vibrating device 8R vibration devices 8L and R side of the L side of the case where the information processing apparatus 100 according to the present technique as a smart phone.
Here, of the two axial vertical and horizontal in the screen of the display 2 of the information processing apparatus 100, the longer direction x-direction, shorter direction and y-direction.

In this example, the vibration device 8R vibration devices 8L and R side of the L side is arranged at both ends in the x-direction in the housing 101 of the information processing apparatus 100. The vibration direction of the vibrating device 8R vibration devices 8L and R side of the L side is the y-direction. Thus, with the vibrating device 8R vibration devices 8L and R side L side from the center of gravity G of the information processing apparatus 100 can be located as much as possible away, vibrating device of the L-side 8L and R sides of the vibrating device 8R vibration direction of, the L side of the vibrating device 8L and R side of the vibrating device 8R orthogonal orientation with respect to a straight line connecting the position the center of gravity G of the. Therefore, it is possible moment of force is generated by the vibration of the vibrating device 8R vibration devices 8L and R side of the L-side, to generate vibrations of a larger energy.

Further, as shown in FIG. 3, when a user holds a substantially horizontal position both ends in the x-direction of the casing 101 of the information processing apparatus 100 in the left and right hand, along a substantially gravity direction is in the hands of the user vibration of the direction is transmitted. Here, human sensitivity to vibration in the direction of gravity, since it is higher than the sensitivity to vibration in the horizontal direction, can be given a higher sensitivity vibration to the user.

Further, in FIG. 2, the vibration direction of the vibrating device 8R vibration devices 8L and R side of the L-side, with respect to a straight line connecting the position the center of gravity G of the vibrating device 8R vibration devices 8L and R side of the L side Although the orthogonal direction (y-direction), may be vibrated in a direction that includes at least the y-direction component. Alternatively, it may be vibrated in the x-direction. This makes it possible to give a feeling of the housing 101 of the information processing apparatus 100 is expanded and contracted in the x-direction to the user. Furthermore, it may be vibrated vibration device 8R vibration devices 8L and R side of the L-side in the z-axis direction.

It may also be arranged vibration device 8R vibration devices 8L and R side of the L-side at both ends in the y direction of the casing 101 of the information processing apparatus 100. Alternatively, both the vibration device 8R vibration devices 8L and R side of the L-side, may be those composed of a plurality of vibrating devices.

[Generation of the vibration waveform from the stereo audio]
Next, an operation of generating respective vibration waveform of the vibration device 8R vibration devices 8L and R side L side from the stereo audio signal to be outputted to the speaker 6L and the R-side speaker 6R for L side by the arithmetic processing unit 1 explain.

Generally, the human audible range is said to 20,000Hz order of 20 Hz, the frequency characteristics of the digital audio signal is also set accordingly. However, low bandwidth, in particular the following low-frequency 100Hz is unlikely to sense a sound through human eardrum vibrations. Further, there is a limit to the reproduction capability of the following low-range sound 100Hz even the speaker. As strategy, technique to reproduce replacing woofer (bass) components of 5.1ch audio to the vibration of the vibrating device is known (see Patent Document 1). However, not only it generates vibration of 1ch in this way. The vibration of the 1ch, there is a limit to the expansion of the case of representing information by vibration.

In contrast, in the information processing apparatus 100 of the present embodiment, the arithmetic processing unit 1, as described below, L-side and R-side from the stereo audio signal to be outputted to the speaker 6L and the R-side speaker 6R for L side each of the vibration waveform LR separately generated.

Figure 4 is a waveform diagram showing the processing from the stereo audio signal to generate the vibration waveform of RL.
Arithmetic processing unit 1, for example, extracts a signal of a predetermined low frequency component from the signal of the stereo sound reproduced from such information files and streaming received stored in the memory (multiple channel audio). More specifically, the arithmetic processing unit 1 (first audio signal corresponding to the first channel) low-frequency component of the signal (a predetermined frequency below the frequency band, such as, for example, from below 100Hz audio signal L side the first low-frequency component of the signals belonging to: extracts a first feature information), a low-frequency component, such as from the R-side audio signal (a second audio signal corresponding to the second channel) for example 100Hz or less signals: extracting a (second low frequency component of the signals belonging to the following frequency bands predetermined frequency the second feature information).
Incidentally, stereo audio signals reproduced is amplified by the audio output amplifier 5, and output to the speaker 6L and the R-side speaker 6R for L side.

Next, the arithmetic processing unit 1, a signal of low frequency components extracted from the L side of the speech signal, to normalize such that the level or waveform suitable for driving the vibrating device. Likewise, similarly to normalize even the signal of the low-frequency component extracted from the audio signal of the R side.

Thus, L-side and R-side each of the vibration waveform is generated. Data of the generated L side of the vibration waveform (first haptic presentation signal) is supplied to the vibration device driving circuit 7L of L side, a vibration device 8L of L side is driven. Similarly, the data of the generated R side of the vibration waveform (second haptic presentation signal) is supplied to the vibration device driving circuit 7R for R side, a vibration device 8R of R side is driven.

Vibration Thus, the vibration device 8L of L-side while oscillating in phase with the signal of the low-frequency component of the L side of the sound, a vibration device 8R of R-side is tuned to the signal of the low-frequency component of the audio R side by stereo vibration tuned to the stereo sound is achieved. As a result, since the low-frequency components of the stereo sound is output in both vibration and sound, it may provide sufficient stereo user.

[LR extra canceling of vibration of mutual]
As shown in FIG. 5, the x-direction end portions of the information processing apparatus 100 if the user has both hands, transmitted as a vibration noise by damping vibrations 31 vibration devices 8R of R side on the left 41 of the user, conversely vibration 33 of the vibrating device 8L of L side is transmitted as a vibration noise 34 in the right hand 42 of the user is attenuated. These vibrations noises 32, 34 causes that prevent providing a clear stereo vibration to the user.

6, the arithmetic processing unit 1 is a diagram showing a configuration of a portion for generating a vibration waveform capable of canceling the vibration noise 32 and 34 above.
Processing unit 1 generates an inverse phased waveform vibration waveform of the generated R side from the low-frequency component of the stereo sound R sound. Subsequently, the arithmetic processing unit 1, the vibration amplitude of the amplitude of the antiphase of the waveform are transmitted with a damping from the vibration device 8R of R side to the L-side end portion of the casing 101 of the information processing apparatus 100 ( that is, the vibrating device 8R of R side is adjusted to match the value of the amplitude of vibration) that is transmitted attenuated vibration device 8L of L side. Thus, in antiphase with the vibration noise 32, and amplitude vibration noise 32 substantially equal waveform for noise canceling (first antiphase signal: there in antiphase signal of the low-frequency component of the signal R sound Te, and the amplitude of the vibration output from the vibration device 8R of R-side based on the signal of the low-frequency component of the R sound corresponds to the amplitude of the vibration damping due to be transmitted to the vibration device 8L of L side signal) is obtained. The arithmetic processing unit 1, a waveform for the noise canceling, and the vibration waveform of the vibrating device 8L of the result of addition to the vibration waveform of the generated L side from the low-frequency component of the stereo sound L sound L side to.

When generating a vibration waveform of the R-side is the same. That is, the arithmetic processing unit 1 generates an inverse phased waveform vibration waveform of the generated L side from the low-frequency component of the stereo sound L sound. Subsequently, the arithmetic processing unit 1, the vibration amplitude of the amplitude of the antiphase of the waveform are transmitted with the attenuation R side end portion of the housing 101 of the information processing apparatus 100 from the vibration device 8L of L side ( that is, the vibrating device 8L of L side is adjusted to match the value of the amplitude of vibration) that is transmitted attenuated vibration device 8R of R side. Thus, in antiphase with the vibration noise 34, and amplitude vibration noise 34 substantially equal waveform for noise canceling (second inverse phase signal: a reversed phase of the signal L sound of the low-frequency component of the signal Te, and the amplitude of the vibration output from the vibration device 8L of L-side based on the signal of the low-frequency component of the L sound corresponds to the amplitude of the vibration damping due to be transmitted to the vibration device 8R of R side signal) is obtained. The arithmetic processing unit 1, a waveform for the noise canceling, a result of adding the vibration waveform of the generated R side from the low-frequency component of the stereo sound R sound and vibration waveform of the vibration device 8R of R side to.

By the above, the information processing apparatus 100 of the present embodiment, the vibration noise 32 transmitted by the vibration 31 of the vibrating device 8R of R-side to the left end portion of the housing 101 is superimposed on the vibration waveform of the vibration device 8L of L side It was canceled by the waveform component for noise canceling. Similarly, the vibration noise 34 which is transmitted to the right end portion of the casing 101 by the vibration 33 of the vibrating device 8L of L side, counteracted by waveform component for noise canceling which is superimposed on the vibration waveform of the vibrating device 8R of R side It is. By this vibration noise 32, 34 is canceled out so, it is possible to provide a clear stereo vibration to the user.

[Switching between stereo vibration and monaural vibration]
As shown in FIG. 7, when having the information processing apparatus 100 with one hand, the user will receive stereo vibration with one hand, not only clear stereo is not obtained, it collapses also tuned sense of the output sound there is a possibility.

Therefore, the arithmetic processing unit 1 of the information processing apparatus 100 of this embodiment, any two vibration devices 8L that depends on the orientation of the housing 101 of the information processing apparatus 100, the orientation of the positional relationship between 8R of gravity and horizontally determine close to, in a case where it is close to the horizontal direction is determined to be close to the case and the gravity direction is determined, and is configured to switch the method of generating LR each of the vibration waveform.

Figure 8 is a flowchart illustrating a method of generating a vibration waveform of LR respectively corresponding to the orientation of the housing 101 of the information processing apparatus 100.

Arithmetic processing unit 1, with the start of reproduction of stereo sound (step S101), and determines the posture of the information processing apparatus 100 based on the output of the gyro sensor 4 (step S102). More specifically, for example, as shown in FIG. 7, when the information processing apparatus 100 is being held with one hand, since the x-direction of the information processing apparatus 100 is a direction along a substantially gravity direction, processing unit 1 determines that the casing 101 of the information processing apparatus 100 in this case is in a vertical position. Conversely, as shown in FIG. 3, when the information processing apparatus 100 is being held with both hands, since the y-direction of the information processing apparatus 100 is a direction along a substantially gravity direction, the arithmetic processing unit 1 the information processing apparatus 100 in this case determines that the housing 101 is in a horizontal position.

Operation when it is determined to be in the horizontal position by the information processing apparatus 100 is being held by both hands are as previously described. That is, the arithmetic processing unit 1, respectively extracts a predetermined low-frequency component from the L side of the audio signal and the R-side of the audio signals reproduced at the step S101 (step S103). Subsequently, the arithmetic processing unit 1, a low frequency signal of the low frequency signal and the R-side of the extracted L side, a vibration device 8L, to normalize such that the level or waveform suitable for driving the 8R (step S104).

Next, the arithmetic processing unit 1 adds respective waveforms for noise canceling a Normalized each waveform of L-side and R-side (step S105). Arithmetic processing unit 1, each added waveform of L-side and R-side, corresponding vibrating device driving circuit 7L, respectively applied to 7R (step S106).

Next, the operation when it is determined to be in the vertical position by the information processing apparatus 100 is being held with one hand.
Processing unit 1 generates a monaural speech signal from a stereo audio signal (step S107). Monaural audio signal is obtained, for example, such as by mixing the audio signal of the audio signal and the R side of the L side. Alternatively, it may be generated monaural audio signal from either the audio signals of the L-side of the audio signal and the R-side of the audio signal. In FIG. 8 shows a case of generating a monophonic sound signal from the L-side of the audio signal.

Next, the arithmetic processing unit 1, predetermined low-frequency component from the generated monaural audio signal (a predetermined frequency (e.g., 100 Hz) the following third belonging to the frequency band of the low-frequency component of the signal: the third feature information ) is extracted (step S108). Subsequently, the arithmetic processing unit 1, the extracted monaural low-frequency signal, a vibration device 8L, to normalize such that the level or waveform suitable for driving the 8R (step S109).

Next, the arithmetic processing unit 1 generates an inverse phase of the waveform relative to the normalized waveform (step S110), the respective vibration waveforms of opposite phase L-side and R-side one another vibration device driving circuit 7L, the 7R each application (step S111).

As a result, L-side and R-side each of the vibration devices 8L of, 8R is left by vibrating a vibration waveform of opposite phase, for example, as shown in FIG. 9, the upper portion of the housing 101 of the information processing apparatus 100 when you are joined by acceleration in the direction joined by acceleration in the right direction in the lower portion of the housing 101 of the information processing apparatus 100, the reverse on the top of the housing 101 of the information processing apparatus 100 acceleration is applied to the right applied acceleration to the left in the lower portion of the housing 101 of the information processing apparatus 100 when they are. Therefore, compared with the case of vibrating L side and the R side each of the vibration devices 8L of the 8R in phase, it is possible to give a large vibration feeling to the user's hand holding the information processing apparatus 100.

Application Example antiphase vibration of the vibrating device of the L-side and R-side]
As described above, each of the vibration devices 8L of L side and the R side, technology of giving a user's hand to strong vibration feeling by vibrating the 8R in opposite phase, the any or information to the user through vibration of the information processing apparatus 100 it can also be applied to notify. For example, telephone, e-mail, of SNS messages arrive, the alarm notification of the schedule, other, can be used for the notification of information to a user from a variety of applications.

Figure 10 is a flowchart showing a procedure of generation of the vibration waveform by the vibration notification.
Arithmetic processing unit 1, for example, incoming call, when the conditions for starting the vibration notification is satisfied (step S201), generates a reverse phase of the waveform for that assigned to the notification information waveform (step S202), whereas vibration waveform of the vibration device 8L of waveforms of L side, the waveform of the other opposite phase as the vibration waveform of the vibrating device 8R of R side, the corresponding vibration device driving circuit 7L, respectively applied to 7R (step S203). Thus, each of the vibration devices 8L of L-side and R side, 8R vibrate in opposite phases to each other.

Thus, L-side and R-side each of the vibration devices 8L of, by vibrating the in phase opposition to each other 8R, it is possible to notify the information to the user in a larger vibration.

Here, although the vibration device 8R vibration devices 8L and R side of the L side and to vibrate in the y direction, may be vibrated in a direction that includes at least the y-direction component. Alternatively, each of the vibration devices 8L, may be vibrated to 8R in the x-direction. This makes it possible to give a feeling of the housing 101 of the information processing apparatus 100 is expanded and contracted in the x-direction to the user. Furthermore, it may be the vibrating device 8L, the 8R is vibrated in the z-axis direction.

[In-phase vibration of the vibrating device of the L-side and R-side]
Meanwhile, L-side and R-side each of the vibration devices 8L of, to vibrate at opposite phases to each other 8R, as shown in FIG. 11, the greater the vibration components cancel each other at the central portion of the housing 101 of the information processing apparatus 100 . Therefore, the type of information processing apparatus touch sensor panel is adhered to the screen of the display 2, the user when responding to vibration against the user touches the touch sensor panel, the position touched on the touch sensor panel the difference in the strength of the vibrations response occurs.

Arithmetic processing unit 1 of the information processing apparatus 100 of this embodiment, when an input operation on the touch sensor panel, as shown in FIG. 12, to oscillate in the same phase of the waveform of the vibration device L side and the R side constructed. Thus, it is possible to substantially equalize the intensity of the vibrations in response to the user by the position touched on the touch sensor panel, can give a sense of discomfort due to the response vibration intensity variation when the touch sensor panel operated by the user no. Also in this case, the vibration direction of the vibrating device can be either x-direction, y-direction, the z-axis direction.

Vibration control of each vibration device in conjunction with the movement of the object in the View
In display 2 of the information processing apparatus 100, while displaying the images with motion such as moving, in accordance with the movement of the object, L side and so that the direction of movement of an object in the hand of the user feels the R side each vibrating device 8L, may be controlled vibration of 8R.

For example, as shown in FIG. 13, if the object 50 on the screen of the display 2 moves from top to bottom, the arithmetic processing unit 1, the vibrating device 8L of L-side upper side, a vibration device 8R of R side as the lower , L side of the vibrating device 8L, vibrates with a time difference in the order of the vibration device 8R of R side. Thus, it is possible to sense the vibration tuned to the movement of the object 50 from top to bottom to the user.

Figure 14 is a diagram showing an example of a vibration waveform of the combined L-side and R-side movement of the objects displayed.
Vibrating device 8L in this way L-side, with generating vibration by a time difference in the order of the vibration device 8R of R side, the frequency of vibration of the vibrating device 8R frequency and R-side vibration of the L side of the vibrating device 8L by the user providing a difference enough to be perceptible, it can be user switching to the vibration of the vibrating device 8R of R-side to easily sensed from vibration of the L side of the vibrating device 8L. Furthermore, each of the vibration devices 8L, the vibration of 8R, gradually increasing the strength by further gradually decreased before stopping the vibration, it is possible to produce a continuous movement appearance of an object.

If the object in the screen of the display 2 moves from bottom to top, a vibration device 8R of R side, it is sufficient to vibrate with a time difference in the order of L side of the vibrating device 8L.

Furthermore, as shown in FIG. 15, the vibration at both ends of the y-direction of the housing 101 of the information processing apparatus 100 device 8R ', 8L' by adding, to the left and right object 50 on the screen of the display 2 in FIG. 13 when moving, it is possible to sense the vibration tuned to the movement of the left and right of the object 50 to the user. Incidentally, the vibration device 8R ', 8L' vibration direction is x direction.

<Modification 1>
Stereo vibration technology described above is not limited to a smart phone, it can also be applied to the game controller. In addition, obtain such as smart phones and game controllers, not only on the type of the information processing apparatus with the hand, and wristband wearable devices that are worn on the wrist of the user, and wearable devices of the neck type, such as head-mounted display, a tactile it is also applicable to the wearable device that can be attached to a variety of mating attachment section capable.

<Modification 2>
Additionally, the present technology, processes for stereo vibration by the arithmetic processing unit 1 of the information processing apparatus 100 can be performed by the control unit of the cloud server on the network (information processing apparatus). Arithmetic processing unit 1 of the information processing apparatus 100 requests the control unit of the cloud server (information processing apparatus), the controller of the cloud server (information processing apparatus), in response to this request, the information processing apparatus 100 each vibrating device 8L of the information processing apparatus 100 based on the signal of the low-frequency component of the stereo sound to be output, generates a vibration waveform of 8R, to the information processing apparatus 100 via the network.

<Modification 3>
[Stereo vibration belt]
Next, a description will be given stereo vibration belt applied to the belt wound around the present technology to the user's waist.
Figure 16 is a front view showing the mounted state of the stereo vibration belt 200 to lumbar user U. Figure 17 is a top view of a stereo vibration belt 200 attached to the waist of the user U. Figure 18 is a developed view of a stereo vibration belt 200 at the time of non-attachment.

As shown in these figures, the stereo vibration belt 200, a buckle portion 201 and the belt member 202 fixed to one end, the R-side incorporating the vibrating device units 203L and vibration device L side incorporating the vibrating device and a vibration device unit 203R. In the figure, left and right and left as seen from the user U. Vibration device unit 203R of the vibration device unit 203L and the R side of the L-side, the stereo vibration belt 200 is disposed so as to come to the left and right symmetrical positions as viewed from the user U when mounted on the waist of the user U. That is, the vibration device unit 203R of the vibration device unit 203L and the R side of the L-side, the left side (first side) of the belt 200 is attached to the user, and the left side of the opposite right (second side ) to be provided. Incidentally, a plurality of vibrating devices 203L, 203R are in good be provided in front and behind the user (typically, a plurality of vibrating devices 203L, 203R may be provided on the opposite side positions, it may be provided in any position). To accommodate individual differences in the size of the waist of the user U, as shown in FIG. 18, the vibration device unit 203R of the vibration device unit 203L and the R side of the L-side predetermined sliding range in the longitudinal direction of the belt member 202 SL, is slidable to SR, it is preferably adapted to be locked in the slide position at which the user U decides. Also, so that correct orientation of the mounting of the stereo vibration belt 200 user U, the mark indicating the left is denoted on the surface of the outer casing of the vibration device unit 203R of the vibration device unit 203L and the R side of the L side It is desirable

Inside the buckle portion 201 has a built-in controller 211.
Figure 19 is a block diagram showing a configuration of the controller 211.
The controller 211 has processing unit 212, a wireless module 213, L side of the vibration device driving circuit 214L, the vibration device driving circuit 214R for R side, the power supply unit and the like (not shown).

Processing unit 212, CPU, RAM, composed of a ROM and a flash ROM. The CPU performs arithmetic processing for executing a program loaded from ROM and a flash ROM in the main memory area of ​​the RAM. Specifically, CPU is the control of the radio module 213, the belt 202 each loaded L side of the vibration of the device unit 203L vibrating device and R sides of the vibrating device unit in each object of a vibration device 203R in to vibrate in the vibration waveform, and controls the vibration device driving circuit 214R of the vibration device driving circuit 214L and R side of the L side.

Output of the vibration device driving circuit 214L of L side with vibration device is supplied to the L side of the vibrating device unit 203L via a signal line 215L provided in the belt member 202 in the vibrating device unit 203L of the L side is driven, output of the vibration device driving circuit 214R for R side vibration device is supplied to the vibrating device unit 203R for R side through a signal line 215R provided on the belt member 202 in the vibrating device unit 203R for R side is driven.

Radio module 213 may, for example, receives a radio transmission stereo audio signal from the information processing apparatus 300 such as a portable or wearable mobile devices such as smartphones. Wireless module 213 is, for example, a wireless module of short-range wireless communication such as Bluetooth (registered trademark). Alternatively, the controller 211 of the stereo vibration belt 200 from the information processing apparatus 300, data of the vibration waveform of the LR generated from a stereo audio signal in the processing unit of the information processing apparatus 300 may be transmitted.

A power supply unit (not shown), the power required for the operation of the stereo vibration belt 200, for example, a like in a DC / DC converter for generating from the charge of the primary battery or secondary battery.

Next, the operation of the stereo vibration belt 200.
The information processing apparatus 300 wirelessly transmits a stereo audio signal to be output to the L side of the speaker and the R side of the speaker to the controller 211 of the stereo vibration belt 200. Processing in the controller 211 of the stereo vibration belt 200 unit 212 extracts a signal of a low frequency component, such as from Sutoreo audio signal wirelessly received from the information processing apparatus 300 for example 100Hz or less, the vibration of the vibrating device unit 203L of L side generates a L-side and R-side each of the vibration waveform by normalized such that the level or waveform suitable for driving the vibrating device in a vibration device unit devices and the R-side 203R, vibration device driving circuit of the L-side 214L and it supplies the vibration device driving circuit 214R for R side. Thus, the vibration device of the vibration device unit 203L of L side make the vibration tuned to the signal of the low-frequency component of the L side of the sound, vibration devices vibrating device unit 203R for R side audio R side oscillating tuned to the low frequency component of the signal. As a result, the user U stereo vibration tuned to stereo sound can be tasted in the whole body through the waist.

Next, the vibration direction of the vibrating device in a vibration device unit 203R vibration device and R side in the vibration device unit 203L of the mounted stereo vibration belt 200 L side will be described.

Figure 20, each vibration device vibrating device unit 203R vibration device and R side in the vibration device unit 203L of the L-side, by oscillating in the short side direction of the belt member 202, vertical vibration to the user U it is an example of such is provided. In this case, the arithmetic processing unit 212, as shown in FIG. 21, a stereo audio signal monaural the vibration waveform of opposite phase generated from the audio signal in the oscillating device unit 203L of the L-side vibration devices and the R-side by driving the vibration device in the vibration device unit 203R, it may be the proper direction of the vibration of the LR each is upside down. This can provide a greater vibration feeling to the user U.

Figure 22 by vibrating the vibrating device of the oscillating device unit 203R vibration device and R side in the vibration device unit 203L of the L-side in the longitudinal direction of the belt member 202, vibration in the horizontal direction is given to the user U it is an example of the way. In this case also processing unit 212, as shown in FIG. 23, the vibration of the vibrating device and the R-side in the vibration device unit 203L of the L-side vibration waveform of opposite phase generated the stereo audio signal from the monaural audio signal by driving the vibration device in the device units 203R, it may be before or after the orientation of each of the vibration is upside down. This can provide a force in the horizontal direction of rotation to the user U. The arithmetic processing unit 212, as shown in FIG. 24, the vibration of the stereo audio signal from the monaural audio signal of the vibration device and the R-side in the vibration device unit 203L of the L-side to generate a vibration waveform of the same phase by driving the vibration device in the device unit 203R, the front and rear directions of the respective vibration may be the same. In this case, it is possible to give mainly the front-rear direction of the force to the user U.

Figure 25 by vibrating the vibrating device of the vibrating device unit 203R vibration device and R side in the vibration device unit 203L of the L-side in the thickness direction of the belt member 202, a release and the compression to the waist of the user U is an example in which vibration is to be given as repeated. In this case, the arithmetic processing unit 212, as shown in FIG. 26, the vibration of the vibrating device and the R-side in the vibration device unit 203L of the L-side stereo audio signal in monaural and the same phase vibration waveform generated from the audio signal by driving the vibration device in the device units 203R, it may be such that each oscillation of the belt member thickness direction of the orientation is always the same.

<Modification 4>
[Stereo vibration device system]
Figure 27 is a diagram showing a composed stereoscopic vibrating device system 400 at the vibration device unit 404R of the vibration device unit 404L and the R-side of individually removable L side for general belt 402.
Vibration device unit 404R of the vibration device unit 404L and the R-side of the L-side, each such can be mounted separately at any location of a general belt 402 having a mounting portion 405, such as a hook.

Figure 28 is a block diagram showing an electrical configuration of a stereo resonator device system 400.
Vibration device unit 404L of the L side has processing unit 412L, the wireless module 413L, the L-side of the vibration device driving circuit 414L, the vibration device 416L and the power supply unit of the L side like (not shown).

Processing unit 412L is, CPU, RAM, composed of a ROM and a flash ROM. The CPU performs arithmetic processing for executing a program loaded from ROM and a flash ROM in the main memory area of ​​the RAM. Specifically, CPU is the control of the radio module 413L, a vibration device 416L of L side so as to vibrate in the vibration waveform of the object, and controls the vibration device driving circuit 414L of the L side.

Output of the vibration device driving circuit 414L of the L side is supplied to the L side of the vibrating device 416L in the vibration device unit 404L of the L-side vibration device 416L of the L side is driven.

Wireless module 413L, for example, receives a radio transmission stereo audio signal from the information processing apparatus 300 such as a portable or wearable mobile devices such as smartphones. Wireless module 413L is, for example, a wireless module for short-range wireless communication such as Bluetooth (registered trademark). Alternatively, the vibration device unit 404L of the L-side from the information processing apparatus 300, data of the vibration waveform of the L-side generated from a stereo audio signal in the processing unit of the information processing apparatus 300 may be transmitted.

A power supply unit (not shown), the power required for the operation of the vibrating device unit 404L of the L-side, for example, a like in a DC / DC converter for generating from the charge of the primary battery or secondary battery.

Vibration device unit 404R for R side, like the vibration device unit 404L of the L side, the arithmetic processing unit 412R, the wireless module 413R, vibration device driving circuit 414R for R side, without vibrating device 416R and the power supply unit of the R side (shown ) has the like.

Processing unit 412R is, CPU, RAM, composed of a ROM and a flash ROM. The CPU performs arithmetic processing for executing a program loaded from ROM and a flash ROM in the main memory area of ​​the RAM. Specifically, CPU is the control of the radio module 413R, a vibration device 416R for R side to vibrate in the vibration waveform of the object, and controls the vibration device driving circuit 414R for R side.

Output of the vibration device driving circuit 414R for R side is supplied to a vibrating device 416R for R side in the vibration device unit 404R for R side vibration device 416R for R side is driven.

Wireless module 413R is, for example, receives a radio transmission stereo audio signal from the information processing apparatus 300 such as a portable or wearable mobile devices such as smartphones. Wireless module 413R is, for example, a wireless module for short-range wireless communication such as Bluetooth (registered trademark). Alternatively, the vibration device unit 404R for R side from the information processing apparatus 300, data of the vibration waveform of the R-side generated from a stereo audio signal in the processing unit of the information processing apparatus 300 may be transmitted.

A power supply unit (not shown), the power required for the operation of the vibrating device unit 404R for R side, for example, a like in a DC / DC converter for generating from the charge of the primary battery or secondary battery.

In the stereo vibration device system 400, at the same time the audio signal to be output to the L side of the speaker of the information processing apparatus 300 is wirelessly transmitted to the vibration device unit 404L of the L side, is output to the R side of the speaker of the information processing apparatus 300 audio signal is wirelessly transmitted to the vibration device unit 404R for R side.

The vibrating device unit 404L of the L side, the arithmetic processing unit 412L extracts the signal of the low-frequency component such as the audio signal radio received L side from the information processing apparatus 300 for example 100Hz or less, suitable for driving the vibrating device 416L to produce a vibration waveform of L side by normalized such that the level or waveform, and supplies the vibration device driving circuit 414L of the L side. Thus, the vibration device 416L of the L-side oscillates in phase with the signal of the low-frequency component of the L side of the voice.

On the other hand, also in the vibration device unit 404R for R side, processing unit 412R extracts the signal of the low-frequency component such as the audio signal radio received R side from the information processing apparatus 300 for example 100Hz or less, the vibration device It generates a vibration waveform of R side by normalized such that the level or waveform suitable for driving the 416R, supplied to the vibration device driving circuit 414R for R side. Thus, the vibration device 416R for R side oscillates in phase with the signal of the low-frequency component of the R sound.

Thus, like the stereo vibration belt 200 of the user U is a stereo vibration by the vibration device unit 404R of the vibration device unit 404L and the R-side of the L-side, it can be tasted in the whole body through the waist.

Further, according to the stereo vibration device system 400 can freely select the position of the vibration device unit 404R of the vibration device unit 404L and the R-side of the L side.

Vibration device unit of the vibrating device unit 404L and the R-side of the L-side 404R is important to taste correctly mounted it is clear stereo with relation left and right symmetrical positions of the waist of the user U. In stereo vibrating device system 400, the vibration device unit 404R of the vibration device unit 404L and the R-side of the L side is provided separately and may be attached to the belt 202a by mistake the left and right. To prevent such attachment error, it is preferable that such a mark indicating the right and left are denoted by like printed on the vibrating device unit 404L and the R-side of the vibrating device unit 404R exterior case of the L side.

<Modification 5>
In the above third modification, as shown in FIG. 18, slidable vibration device unit 203R of the vibration device unit 203L and the R side of the L-side predetermined sliding range ST in the longitudinal direction of the belt member 202, in SR by the structure, and to accommodate the difference in waist size among users. However, if such a configuration, adjustment of the position of the vibration device unit 203R of the vibration device unit 203L and the R-side for each user is required, it is troublesome when sharing the stereo vibration belt 200 by a plurality of users.

Figure 29 is a diagram showing a stereo vibration belt 200a which can omit the position adjustment for each user of the vibration device unit 203R of the vibration device unit 203L and the R-side of the L side.
In the stereo vibration belt 200a, telescopic extendable portion 202b in the longitudinal direction is symmetrically provided a belt body 202c in the front-rear and left-right are used. In the stereo vibration belt 200a, so the user U1, L half and R side half of the belt member 202c wound around the U2 waist extends uniformly in the longitudinal direction by stretching portion 202b, the waist around the user U1 and the user U2 by the difference in size, it can not collapse the positional relationship of the bilateral symmetry of the vibration device unit 203 of the vibration device unit 203L and the R side of the L side. Therefore when sharing the stereo vibration belt 200a by a plurality of users U1, U2, the position adjustment of the L side of the vibrating device unit 203L and the R-side of the vibrating device unit 203 is not required. Note that the entire belt member 202c may be made of an elastic section 202b.

Incidentally, far, it describes the stereo vibration belt capable wrapped user's waist but, as shown in FIG. 30, it is also possible to configure as a stereo vibration belt 200b wound around the wrist of the user. Further, it is also possible to configure the user's neck, as a stereo vibration belt capable wrapped like ankle.

Incidentally, the vibration device unit 203L, 203R is not limited to the type of wearable device of a belt wound on the body of the user, it may be provided to the wearable device other than the belt type. For example, the vibration device unit 203L, 203R, the head-mounted display, or may be provided in various wearable devices such as glasses wearable device.

<Various modifications>
In the above description, as an example of a sound output device, it has been described as the speaker 6L, and 6R example. On the other hand, the sound output device may be a headphone (including an earphone). Further, the sound output device, two-channel sound signals (i.e., stereo signal) is not limited to the sound output device corresponding to the sound output device corresponding to three or more channels of sound signals (for example, three or more channels of multi-channel speaker it may be etc.).

In the above description, haptic presentation device (vibrating device 8L, 8R or vibration device unit 203L, 203R) has been described a case the audio signal underlying vibrating a is a stereo signal (i.e., 2-channel). On the other hand, the audio signal may be a three or more channels of audio signals. In the above description, (if for example, the audio signal is three or more channels) has been described the case where the number of the sound output device is two, the number of sound output device may be three or more .

In the above description, as an example of a tactile sense presentation device for presenting tactile to a user, a vibration device 8L, 8R, has been described as the vibration device unit 203L, the 203R example. On the other hand, the tactile presentation device may be a device for presenting tactile to a user by pressure. In the above description, (if for example, the audio signal is three or more channels) has been described the number of tactile sense presentation device is two, the number of tactile sense presentation device, may be three or more .

In the above description, the tactile presentation signal supplied to the tactile sense presenting device is described for the case where a signal of the vibration waveform. On the other hand, if the tactile sense presentation device is a device for presenting tactile to a user, for example by pressure, tactile presentation signal may be a signal of the pressure waveform.

In the above description, the low-frequency component (first characteristic information, a second feature information) belonging from the audio signal into a frequency band below a predetermined frequency is extracted, based on the low-frequency component, tactile presentation signal ( the first tactile presentation signal, has been described a case where the second haptic presentation signal) is generated. On the other hand, from the audio signal, the high frequency component (the first characteristic information, a second feature information) belonging to the frequency band at or above a predetermined frequency is extracted, based on the high-frequency component, tactile presentation signal (first tactile sense presentation signal, the second tactile presentation signal) may be generated (Note, which will, also applies to the third feature information in the monaural audio signal). In this case, for example, the high-frequency component, the user is an evanescent component of the frequency band as the sound through the tympanic membrane.

Additionally, the present technology may also be configured as follows.
(1) among the plurality of channels of audio output sound of a plurality of channels from an audio output device capable of outputting, on the basis of the first feature information extracted from the first audio signal corresponding to the first channel , among the plurality of tactile sense presentation device, to generate a first haptic presentation signal supplied to the first haptic presentation device, among the plurality of channels of audio, extracted from the second audio signal corresponding to the second channel based on the second characteristic information, the plurality of tactile sense presentation device, an information processing apparatus having a processing unit for generating a second haptic presentation signal supplied to the second haptic presentation device.
(2) The information processing apparatus according to (1),
The arithmetic processing unit, wherein the first characteristic information, from said first audio signal, the information processing apparatus for extracting a signal of the first low-frequency component belonging to the frequency band below a predetermined frequency.
(3) The information processing apparatus according to (2),
The arithmetic processing unit, said a second characteristic information, the second audio signal, the information processing apparatus for extracting a signal of the second low frequency component belonging to the frequency band below a predetermined frequency.
(4) The information processing apparatus according to (3),
The first haptic presentation device and the second haptic presentation device is remotely located,
The arithmetic processing unit, the second a reverse phase signal of the low-frequency component of the signal, and the oscillation output from the second haptic presentation device based on the second low-frequency component of the signal amplitude, a first inverse phase signal corresponding to the first amplitude of the vibration damping due to be transmitted to the tactile sense presentation device, signals obtained by adding to the first low-frequency component of the signal, the first the information processing apparatus for generating a tactile sense presentation signal.
(5) The information processing apparatus according to (3) or (4),
The first haptic presentation device and the second haptic presentation device is remotely located,
The arithmetic processing unit, said first be reversed phase signal of the low-frequency component of the signal, and the oscillation output from the first haptic presentation device on the basis of the first low-frequency component of the signal amplitude, a second reverse phase signal corresponding to said second amplitude of vibration attenuation due to be transmitted to the tactile sense presentation device, signals obtained by adding the second low-frequency component of the signal, the second the information processing apparatus for generating a tactile sense presentation signal.
(6) The information processing apparatus according to any one of the above (1) to (5),
Said plurality of tactile sense presentation device, provided in the housing,
The arithmetic processing unit, wherein the plurality of orientations of the positional relationship between the tactile sense providing devices that depends on the orientation of the housing of the posture to determine close to the one direction of gravity and horizontal directions, the orientation in the positional relationship in the horizontal direction If it is determined to be close to, on the basis of the first feature information to generate a first haptic presentation signals, and information for generating the second haptic presentation signal based on the second feature information processing apparatus.
(7) The information processing apparatus according to (6),
The arithmetic processing unit, when the direction of the positional relationship is determined to be close to the direction of gravity, the plurality of channels to generate a monaural audio signal from the audio signal, based on the monaural audio signal, the first haptic prompting signal and an information processing apparatus for generating the second haptic presentation signal.
(8) The information processing apparatus according to (7),
The arithmetic processing unit, the extracting third feature information from monaural audio signal, based on the third characteristic information, the first haptic presentation signal and said second information processing apparatus for generating a tactile sense presentation signal .
(9) The information processing apparatus according to (8),
The arithmetic processing unit, wherein the third characteristic information of said monaural from the audio signal, the information processing apparatus for extracting a signal of the third low frequency component belonging to the frequency band below a predetermined frequency.
(10) The information processing apparatus according to (9),
The arithmetic processing unit, the signal of the third low frequency component to generate a first haptic presentation signal and the reverse phase signal of the third low-frequency component of the signal, the second the information processing apparatus for generating a tactile sense presentation signal.
(11) The information processing apparatus according to any one of the above (1) to (10),
It said plurality of tactile sense presentation device, the housing including a display device, the display first end and the information processing device provided in the second end are opposite ends of one coordinate axis of the device.
(12) The information processing apparatus according to any one of the above (1) to (10),
It said plurality of tactile sense presentation device, the information processing device provided in the wearable device.
(13) The information processing apparatus according to (12),
It said plurality of tactile sense presentation device, information processing is provided in the belt-type wearable device of the apparatus.
(14) The information processing apparatus according to (13),
It said plurality of tactile sense presentation device, a first side and an information processing device provided on the second side of the side opposite to the first side when said belt is worn on the body of the user.
(15) processing unit,
Among the plurality of channels of audio output sound of a plurality of channels from the output enable audio output device, on the basis of the first feature information extracted from the first audio signal corresponding to the first channel, a plurality of of tactile sense presentation device, to generate a first haptic presentation signal supplied to the first haptic presentation device,
Wherein among the plurality of channels of audio, based on the second feature information extracted from the second audio signal corresponding to the second channel, among the plurality of tactile sense presentation device, supplied to the second haptic presentation device an information processing method for generating a second haptic presentation signal to.
(16) among the plurality of channels of audio output sound of a plurality of channels from an audio output device capable of outputting, on the basis of the first feature information extracted from the first audio signal corresponding to the first channel , among the plurality of tactile sense presentation device, to generate a first haptic presentation signal supplied to the first haptic presentation device, among the plurality of channels of audio, extracted from the second audio signal corresponding to the second channel based on the second characteristic information, the plurality of tactile sense presentation device, as an arithmetic processing unit for generating a second haptic presentation signal supplied to the second haptic presentation device,
Program causing a computer to function.
(17) receives a request from the information processing terminal via a network, among the plurality of channels of audio output sound of a plurality of channels from the output enable audio output device, from a first audio signal corresponding to the first channel based on the first feature information extracted among a plurality of tactile sense presentation device, to generate a first haptic presentation signal supplied to the first haptic presentation device, among the plurality of channels of audio, the second based on the second feature information extracted from the second audio signal corresponding to the channel, of the plurality of tactile sense presentation device, to generate a second tactile presentation signal supplied to the second haptic presentation device, the information processing apparatus having a control unit for transmitting each information of the first haptic presentation signal and the second haptic presentation signal to the information processing terminal via the network

Besides, the present technology is not limited to the embodiments described above, it can of course be modified in various ways without departing from the gist of the present technology.

1 ... processing unit 2 ... display 3 ... acceleration sensor 4 ... gyro sensor 5. L ... audio output amplifier 5 ... audio output amplifier 6L ... L side of the speaker 6R ... vibration device of the vibration device driving circuit 8L ... L side of the vibration device driving circuit 7R ... R side of the speaker 7L ... L side R side 8R ... R side of the vibration device 100 ... information processing apparatus 101 ... housing

Claims (17)

  1. Among the plurality of channels of audio output sound of a plurality of channels from the output enable audio output device, on the basis of the first feature information extracted from the first audio signal corresponding to the first channel, a plurality of of tactile sense presentation device, to generate a first haptic presentation signal supplied to the first haptic presentation device, among the plurality of channels of audio, extracted from the second audio signal corresponding to the second channel first based on the second characteristic information, the plurality of tactile sense presentation device, an information processing apparatus having a processing unit for generating a second haptic presentation signal supplied to the second haptic presentation device.
  2. The information processing apparatus according to claim 1,
    The arithmetic processing unit, wherein the first characteristic information, from said first audio signal, the information processing apparatus for extracting a signal of the first low-frequency component belonging to the frequency band below a predetermined frequency.
  3. The information processing apparatus according to claim 2,
    The arithmetic processing unit, said a second characteristic information, the second audio signal, the information processing apparatus for extracting a signal of the second low frequency component belonging to the frequency band below a predetermined frequency.
  4. The information processing apparatus according to claim 3,
    The first haptic presentation device and the second haptic presentation device is remotely located,
    The arithmetic processing unit, the second a reverse phase signal of the low-frequency component of the signal, and the oscillation output from the second haptic presentation device based on the second low-frequency component of the signal amplitude, a first inverse phase signal corresponding to the first amplitude of the vibration damping due to be transmitted to the tactile sense presentation device, signals obtained by adding to the first low-frequency component of the signal, the first the information processing apparatus for generating a tactile sense presentation signal.
  5. The information processing apparatus according to claim 3,
    The first haptic presentation device and the second haptic presentation device is remotely located,
    The arithmetic processing unit, said first be reversed phase signal of the low-frequency component of the signal, and the oscillation output from the first haptic presentation device on the basis of the first low-frequency component of the signal amplitude, a second reverse phase signal corresponding to said second amplitude of vibration attenuation due to be transmitted to the tactile sense presentation device, signals obtained by adding the second low-frequency component of the signal, the second the information processing apparatus for generating a tactile sense presentation signal.
  6. The information processing apparatus according to claim 1,
    Said plurality of tactile sense presentation device, provided in the housing,
    The arithmetic processing unit, wherein the plurality of orientations of the positional relationship between the tactile sense providing devices that depends on the orientation of the housing of the posture to determine close to the one direction of gravity and horizontal directions, the orientation in the positional relationship in the horizontal direction If it is determined to be close to, on the basis of the first feature information to generate a first haptic presentation signals, and information for generating the second haptic presentation signal based on the second feature information processing apparatus.
  7. The information processing apparatus according to claim 6,
    The arithmetic processing unit, when the direction of the positional relationship is determined to be close to the direction of gravity, the plurality of channels to generate a monaural audio signal from the audio signal, based on the monaural audio signal, the first haptic prompting signal and an information processing apparatus for generating the second haptic presentation signal.
  8. The information processing apparatus according to claim 7,
    The arithmetic processing unit, the extracting third feature information from monaural audio signal, based on the third characteristic information, the first haptic presentation signal and said second information processing apparatus for generating a tactile sense presentation signal .
  9. The information processing apparatus according to claim 8,
    The arithmetic processing unit, wherein the third characteristic information of said monaural from the audio signal, the information processing apparatus for extracting a signal of the third low frequency component belonging to the frequency band below a predetermined frequency.
  10. The information processing apparatus according to claim 9,
    The arithmetic processing unit, the signal of the third low frequency component to generate a first haptic presentation signal and the reverse phase signal of the third low-frequency component of the signal, the second the information processing apparatus for generating a tactile sense presentation signal.
  11. The information processing apparatus according to claim 1,
    It said plurality of tactile sense presentation device, the housing including a display device, the display first end and the information processing device provided in the second end are opposite ends of one coordinate axis of the device.
  12. The information processing apparatus according to claim 1,
    It said plurality of tactile sense presentation device, the information processing device provided in the wearable device.
  13. The information processing apparatus according to claim 12,
    It said plurality of tactile sense presentation device, information processing is provided in the belt-type wearable device of the apparatus.
  14. The information processing apparatus according to claim 13,
    It said plurality of tactile sense presentation device, a first side and an information processing device provided on the second side of the side opposite to the first side when said belt is worn on the body of the user.
  15. Arithmetic processing unit,
    Among the plurality of channels of audio output sound of a plurality of channels from the output enable audio output device, on the basis of the first feature information extracted from the first audio signal corresponding to the first channel, a plurality of of tactile sense presentation device, to generate a first haptic presentation signal supplied to the first haptic presentation device,
    Wherein among the plurality of channels of audio, based on the second feature information extracted from the second audio signal corresponding to the second channel, among the plurality of tactile sense presentation device, supplied to the second haptic presentation device an information processing method for generating a second haptic presentation signal to.
  16. Among the plurality of channels of audio output sound of a plurality of channels from the output enable audio output device, on the basis of the first feature information extracted from the first audio signal corresponding to the first channel, a plurality of of tactile sense presentation device, to generate a first haptic presentation signal supplied to the first haptic presentation device, among the plurality of channels of audio, extracted from the second audio signal corresponding to the second channel first based on the second characteristic information, the plurality of tactile sense presentation device, as an arithmetic processing unit for generating a second haptic presentation signal supplied to the second haptic presentation device,
    Program causing a computer to function.
  17. Receiving a request from the information processing terminal via a network, among the plurality of channels of audio output sound of a plurality of channels from the output enable audio output device, which is extracted from the first audio signal corresponding to the first channel based on the first characteristic information, among the plurality of tactile sense presentation device, to generate a first haptic presentation signal supplied to the first haptic presentation device, among the plurality of channels of audio, corresponding to the second channel based on the second feature information extracted from the second audio signal, among the plurality of tactile sense presentation device, to generate a second tactile presentation signal supplied to the second haptic presentation device, the first the information processing apparatus of each information of the tactile sense presentation signal and the second tactile sense presentation signal having a control unit that transmits to the information processing terminal via the network.
PCT/JP2017/032408 2016-10-07 2017-09-08 Information processing device, information processing method, and program WO2018066299A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2016-198777 2016-10-07
JP2016198777 2016-10-07
JP2017100764A JP2018064264A (en) 2016-10-07 2017-05-22 Information processing device, information processing method, and program
JP2017-100764 2017-05-22

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US16/328,913 US20190220095A1 (en) 2016-10-07 2017-09-08 Information processing apparatus, information processing method, and program

Publications (1)

Publication Number Publication Date
WO2018066299A1 true WO2018066299A1 (en) 2018-04-12

Family

ID=61831014

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/032408 WO2018066299A1 (en) 2016-10-07 2017-09-08 Information processing device, information processing method, and program

Country Status (1)

Country Link
WO (1) WO2018066299A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005258666A (en) * 2004-03-10 2005-09-22 Sony Corp Input device, electronic device, and method for inputting touch to electronic device as feedback
JP2012168947A (en) * 2011-02-11 2012-09-06 Immersion Corp Sound to haptic effect conversion system using amplitude value
JP2015060591A (en) * 2013-09-18 2015-03-30 イマージョン コーポレーションImmersion Corporation Orientation adjustable multi-channel haptic device
WO2016092644A1 (en) * 2014-12-10 2016-06-16 富士通株式会社 Electronic device and drive control method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005258666A (en) * 2004-03-10 2005-09-22 Sony Corp Input device, electronic device, and method for inputting touch to electronic device as feedback
JP2012168947A (en) * 2011-02-11 2012-09-06 Immersion Corp Sound to haptic effect conversion system using amplitude value
JP2015060591A (en) * 2013-09-18 2015-03-30 イマージョン コーポレーションImmersion Corporation Orientation adjustable multi-channel haptic device
WO2016092644A1 (en) * 2014-12-10 2016-06-16 富士通株式会社 Electronic device and drive control method

Similar Documents

Publication Publication Date Title
KR101600070B1 (en) Transmitter/receiver unit and receiver unit
CN1822723B (en) Method for adjusting a hearing aid, hearing aid and mobile control unit for the adjustment of a hearing aid
KR101595384B1 (en) Watch-type mobile terminal
US20080216578A1 (en) Vibration assembly, input device using the vibration assembly, and electronic equipment using the input device
KR101727899B1 (en) Mobile terminal and operation control method thereof
US9729971B2 (en) Stereo earphone
TWI660618B (en) mobile phone
US8521239B2 (en) Mobile telephone
US8139803B2 (en) Systems and methods for haptic sound
US20130279724A1 (en) Auto detection of headphone orientation
EP2227730B1 (en) Touch-sensitive device
CN103988113B (en) Indirect wearable computing device having a bone conduction speaker
EP3062491A1 (en) Bracelet-type transmission/reception device and bracelet-type notification device
US20040087346A1 (en) Mobile handset and assembly having multi-loudspeaker system
WO2014031756A2 (en) Systems and methods for a vibrating input device
JP2012127940A (en) Portable navigation device
CN102640517B (en) Directional sound system, the sound transmitted to the spatial location method and the communication system has
US20170155993A1 (en) Wireless Earpieces Utilizing Graphene Based Microphones and Speakers
KR20130015293A (en) 3d camera assembly and mobile terminal having it
JP6250041B2 (en) Reduction of external vibration in the bone conduction speaker
KR101709497B1 (en) Mobile terminal and operation control method thereof
CN104025559B (en) Transmission of audio routing in the integrated distribution network
CN104375632A (en) Display device and method for controlling the same
CN105450848A (en) Mobile terminal and controlling method thereof
US9716782B2 (en) Mobile telephone

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17858138

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase in:

Ref country code: DE