JP6456513B2 - Experience control device - Google Patents

Description

  This disclosure relates to a sensation control apparatus that controls a sensation device that outputs vibration, light, and the like in accordance with sound. This application claims priority based on Japanese Patent Application No. 2015-200762, which is a Japanese patent application filed on October 9, 2015, and uses all the contents described in the Japanese patent application. .

  Conventional sensation devices are mainly used to convert the bass component of music into mechanical vibrations (referred to as “sensory sensation”) so that the music listener can experience it, or to create a sense of reality in a home theater system. There are known things that allow viewers to feel a feeling of vibration and vibration.

  In recent years, in conjunction with light, it is used for production at live concerts, etc. In addition to 3D images and sound at amusement parks or movie theaters, called 4D movies, front and back, left and right, up and down It has realized special effects that stimulate the five senses, such as movement, vibration, wind, fog, scent, strobe, and smoke.

  Japanese Patent Laying-Open No. 2006-287483 (Patent Document 1) relates to a signal processing circuit for body sensation sound for producing a sense of reality in the above-mentioned home theater system. Specifically, the signal processing circuit of this document mixes the left signal, right signal, left surround signal, right surround signal, and low frequency sound effect signal of the 5.1 channel surround system, and performs signal processing on the mixed signal. By doing so, a bodily sensation sound signal is generated. Here, the signal processing circuit is configured to output the sensory sound signal only when the low frequency sound effect signal is large.

JP 2006-287483 A

  Even if the sensory sound signal is generated so as to match the sound signal in the above-mentioned Patent Document 1, there may be a difference between the sound and the sensory experience due to a delay in the rise of the sensory device. Further, there may be a difference between the sound and the bodily sensation due to the difference in personal sense. In Patent Document 1, no consideration is given to such a problem.

  The present disclosure has been made in consideration of the above-described problems, and an object thereof is to provide a sensation control device capable of reducing the difference between sound and sensation and giving a comfortable sensation to the user. That is.

  A sensation control device according to one aspect is for controlling a sensation module that gives a sensation specific to a user, and includes at least an input unit to which an acoustic signal is input, a determination unit, a drive signal generation unit, and a delay A circuit and an acoustic signal output unit; The determination unit determines whether or not sensation control data for controlling the sensation module is input to the input unit together with the acoustic signal. The drive signal generation unit generates a drive signal for driving the sensation module based on the sensation control data when the sensation control data is input to the input unit, and the sensation control data is input together with the sound signal. When not input to the unit, a drive signal for driving the sensation module is generated based on the acoustic signal. The delay circuit delays the acoustic signal, and the delay time is variable. The acoustic signal output unit outputs the delayed acoustic signal.

  According to the above-described aspect, it is possible to provide a sensation control device that can reduce a difference between sound and sensation and provide a comfortable sensation to the user.

It is an external view showing typically an example of a bodily sensation system according to the first embodiment. It is a block diagram which shows the functional structure of the connection box of FIG. It is a block diagram which shows the functional structure of the sensation apparatus of FIG. It is a block diagram which shows an example of a detailed structure of an acoustic signal input part and an acoustic signal output in the connection box of FIG. It is a figure for demonstrating the timing adjustment of the sound and bodily sensation using the connection box of FIG. It is a flowchart which shows operation | movement of the connection box of FIG. It is a flowchart which shows the procedure of step S140A of FIG. 6, S140B in more detail. It is a figure which shows the waveform of an acoustic signal, and the operation timing of each sensation module. It is a flowchart which shows the procedure which discriminate | determines whether the sensation control data is contained in the input signal in the sensation control apparatus by 3rd Embodiment.

  Hereinafter, embodiments will be described in detail with reference to the drawings. In addition, the same reference number is attached | subjected to the part which is the same or it corresponds, and the description may not be repeated.

<First Embodiment>
[Example of bodily sensation system]
FIG. 1 is an external view schematically showing an example of a bodily sensation system according to the first embodiment. FIG. 1 shows an example of using the sensation control device (connection box 10) for controlling the sensation devices 30A and 30B when the sensation devices 30A and 30B (wristbands) are used in a seat such as an airplane or a long-distance bus. ing.

  Referring to FIG. 1A, an armrest of a seat 50 such as an airplane is usually provided with a 3.5 mmφ stereo mini jack 52 for connecting an earphone or headphones. From the jack 52, an audio signal from an audio device such as a CD player, a DVD player, a Blu-ray (registered trademark) player and / or a video device, or an audio signal of a radio broadcast or a television broadcast is output.

  In the present embodiment, there is provided a sensation control device that can be used when not only analog sound signals but also sensation control data created so as to match the sound signals is output from the jack 52 together. Accordingly, it is possible to provide a bodily sensation system that can be applied to a case where a composer or the like has created music that includes not only sound (or sound and video) but also bodily sensation.

  In the above case, the sensation control data has a predetermined specific frequency in a non-audible region (a region higher than about 20 kHz, which is the upper limit frequency that humans can hear) so as not to affect the acoustic signal. Modulation is performed on the area, and the modulated sensation control data is superimposed on the acoustic signal. Hereinafter, the acoustic signal and the sensation control data after modulation incorporated in the acoustic signal are collectively referred to as a superimposed signal.

  As shown in FIG. 1A, a connection box 10 serving as a sensation control device is connected to the jack 52 in order to extract the sensation control data from the received superimposed signal. The connection box 10 uses a filter to extract a signal in a specific frequency region of the superimposed signal, and reproduces the sensation control data by demodulating the extracted signal. The connection box 10 generates a drive signal for driving a corresponding sensation module provided in the sensation device based on the sensation control data. The generated drive signal is transmitted from the connection box 10 to each sensation module provided in the sensation device 30 using a wireless communication method such as BLUETOOTH (registered trademark) (see FIG. 1 for an example of the sensation module). B)).

  Furthermore, the connection box 10 is configured to be able to handle a case where only an acoustic signal that does not include sensation control data is received. In this case, the connection box 10 generates a plurality of drive signals for driving each sensation module based on the intensity of each frequency component of the acoustic signal extracted by the plurality of filters, and the generated drive signals are transmitted to the wireless communication device. Send to the bodily sensation device using the method.

  In any of the above cases (when a superimposed signal is received or when only an acoustic signal is received), the acoustic signal is output to the earphone or headphones via a stereo mini jack (not shown) provided in the connection box 10. Is done. In the above description, the driving signal of each sensation module is transmitted to the sensation device by wireless communication, but may be transmitted to the sensation device by wired communication.

  FIG. 1B shows an example of a sensation device. In the case of FIG. 1 (B), the sensation apparatus has the form of wristbands 30A and 30B to be worn on both wrists of the user. Inside the wristband, a communication device for communicating with the connection box 10 of FIG. 1 (A), a vibrator as an experience module, and an air bag and a blower for inflating the air bag are attached. Yes. The vibrator can give a vibration to the user, and the blower can inflate the air bag to apply pressure to the user's wrist. Furthermore, LED (Light Emitted Diode) 37 for outputting light according to an acoustic signal is attached to wristbands 30A and 30B as a bodily sensation module.

  The on / off of the output of these sensation modules (ie, vibrator, blower, and LED) is controlled according to the drive signal of each sensation module received from the connection box 10 as the sensation control device. The output level of the sensation module may be changed according to the sound pressure level of the sound output. For example, the greater the sound pressure level of the sound output, the greater the output intensity of the sensation module.

  Note that the sensation device controlled by the connection box 10 is not limited to the wristband. For example, instead of the wristband, a band-like thing wound around a part of the body such as an arm, a leg, or an ankle, or a cushion-like thing pressed against a part of the body such as the back or the waist may be used. Furthermore, the sensation module attached to the sensation device is not limited to the vibrator, blower, and LED.

[Functional configuration of connection box]
FIG. 2 is a block diagram showing a functional configuration of the connection box of FIG. Referring to FIG. 2, a connection box 10 as a sensation control device includes a microcomputer 11 including a CPU (Central Processing Unit) and a memory, an acoustic signal input unit 12, a digital filter 16, and a sensation module drive signal generation. Unit 17, acoustic signal output unit 13, communication unit 14, antenna 21, and power supply unit 15 (battery).

  The microcomputer 11 controls each component of the connection box 10. Furthermore, the microcomputer 11 functions as a determination unit that determines whether the input signal from the output unit 51 of the audio device includes sensation control data for controlling the sensation module.

  The acoustic signal input unit 12 receives an analog acoustic signal from the output unit 51 of the acoustic device. In the case of FIG. 1, an analog acoustic signal is input from a stereo mini jack 52 that is an output terminal of the output unit 51 to a stereo mini plug that is an input terminal of the acoustic signal input unit 12. As described above, the sensation control data modulated in the specific frequency region within the non-audible region may be input by being incorporated into the acoustic signal. The acoustic signal input unit 12 performs A / D (Analog to Digital) conversion of the input acoustic signal or superimposed signal into a digital signal. The digitally converted acoustic signal or superimposed signal is input to the microcomputer 11.

  The digital filter 16 extracts a desired frequency band from the acoustic signal or the superimposed signal in accordance with a command from the microcomputer 11. The digital filter 16 is configured by, for example, a band pass filter, a low pass filter, a high pass filter, and a combination thereof. For example, when a superimposed signal is input to the acoustic signal input unit 12, sensation control data modulated to a specific frequency region within the non-audible region is extracted by a band pass filter or a high pass filter. When only the acoustic signal, not the superimposed signal, is input to the acoustic signal input unit 12, for example, in order to generate a driving signal for each body sensation module based on the acoustic signal, Sound ranges are extracted by a low-pass filter, a band-pass filter, and a high-pass filter, respectively.

  When a superimposed signal (ie, an acoustic signal and modulated sensation control data) is input to the acoustic signal input unit 12, the drive signal generation unit 17 is in the non-audible region extracted by the digital filter 16. The sensation control data is reproduced by demodulating the signal in the specific frequency region. The drive signal generator 17 generates a drive signal for driving each sensation module based on the sensation control data. Specifically, in the case of FIG. 2, the drive signal generation unit 17 includes a vibrator drive signal generation unit 18 that generates a drive signal for a vibrator, a blower drive signal generation unit 19 that generates a drive signal for a blower, and an LED And an LED drive signal generation unit 20 that generates a drive signal for use. The output of each body sensation module is controlled according to the corresponding drive signal.

  On the other hand, when only the acoustic signal, not the superimposed signal, is input to the acoustic signal input unit 12, the drive signal generation unit 17 detects each sensation based on a plurality of signal components of the acoustic signal extracted by the digital filter 16. Generate drive signals for the module. In this case, for example, a method similar to Patent Document 1 can be used.

  The digital filter 16 and the drive signal generation unit 17 are configured by a dedicated digital circuit, for example, a programmable FPGA (Field Programmable Gate Array). When the microcomputer 11 is sufficiently fast, the functions of the digital filter 16 and the drive signal generation unit 17 may also be realized by the microcomputer 11.

  The acoustic signal output unit 13 performs D / A (Digital to Analog) conversion on the acoustic signal A / D converted by the acoustic signal input unit 12 and outputs the analog acoustic signal after the D / A conversion to the acoustic output device 53. To do. The sound output device 53 is, for example, an earphone, a headphone, a speaker, or the like. As will be described with reference to FIG. 4, the acoustic signal output unit 13 further includes a delay circuit capable of adjusting a delay time in order to delay the output acoustic signal.

  The communication unit 14 generates a transmission signal by modulating the drive signal of each sensation module generated by the drive signal generation unit 17 according to a wireless communication method such as BLUETOOTH (registered trademark). The generated transmission signal is transmitted to the communication unit (32 in FIG. 3) provided in the sensation apparatus 30 via the antenna 21.

  The power supply unit 15 supplies power necessary for the operation of each of the above-described elements constituting the connection box 10 using a battery.

[Functional structure of sensory equipment]
FIG. 3 is a block diagram showing a functional configuration of the sensation apparatus shown in FIG. With reference to FIG. 3, the sensation apparatus 30 includes a microcomputer 31 including a CPU and a memory, a communication unit 32, an antenna 38, a vibrator 34, a blower 35, an air bag 36, an LED 37, and a power supply unit 33. (Battery).

  The microcomputer 31 controls each component of the sensation apparatus 30. The communication unit 32 receives the transmission signal from the connection box 10 via the antenna 38 and demodulates the received transmission signal to reproduce the driving signal of each sensation module.

  Each body sensation module operates according to the reproduced corresponding drive signal. Specifically, the vibrator 34 gives a vibration feeling to the user by being turned on and off according to the drive signal for the vibrator 34. The blower 35 applies pressure to the user's wrist by inflating the air bag according to the drive signal for the blower 35. The LED 37 stimulates the user with light by turning on and off according to the drive signal for the LED 37. Thus, the user can experience a unique sense of reality that matches the sound.

  The power supply unit 33 supplies electric power necessary for the operation of each of the above-described elements constituting the sensation device 30 with a battery.

[Detailed Configuration of Acoustic Signal Input Unit and Acoustic Signal Output Unit]
FIG. 4 is a block diagram illustrating an example of a detailed configuration of the acoustic signal input unit and the acoustic signal output in the connection box of FIG. 2. With reference to FIG. 4, the acoustic signal input unit 12 and the acoustic signal output unit 13 are built in the connection box 10 of FIG.

  The acoustic signal input unit 12 includes an amplitude adjustment unit 60 and an A / D conversion unit 61. The amplitude adjustment unit 60 is, for example, an amplifier and / or an attenuator, and adjusts the amplitude of the input signal by multiplying the input signal (acoustic signal or superimposed signal) by a predetermined gain. The A / D converter 61 converts the input signal into a digital signal.

  The acoustic signal output unit 13 includes a delay circuit 70, a D / A conversion unit 71, and an amplitude adjustment unit 72. The delay circuit 70 delays the output signal (acoustic signal or superimposed signal) output to the acoustic output device 53 by a set amount. As the delay circuit 70, for example, a FIFO (First In, First Out) type data buffer can be used. In this case, the buffer capacity is variable and is set to a value corresponding to the delay amount. When the data buffer becomes full, the first stored acoustic data is extracted from the data buffer and output. For example, the buffer capacity of the data buffer may be set by a program from the microcomputer 11, may be set by a dedicated register, or may be set by an adjustment knob provided in the connection box 10. It may be. The reason why such a delay circuit 70 is necessary will be described later with reference to FIG.

  The D / A converter 71 converts the output signal into an analog signal. The amplitude adjustment unit 72 is, for example, an amplifier and / or an attenuator, and adjusts the amplitude of the output signal by multiplying the output signal (acoustic signal or superimposed signal) output to the acoustic output device 53 by a predetermined gain. .

[Necessity of delay processing]
When the operation of various body sensation modules is controlled using the connection box (body sensation control device) 10 described above, there may be a difference between the sound and the body sensation depending on the rising characteristics of the body sensation module used. Furthermore, it is considered that the difference in timing between the sound and the bodily sensation is most comfortable, depending on the individual. In order to correct such a delay in the rise of the sensation module and a shift in the sense of the user, the acoustic signal is delayed by the delay circuit 70 of FIG.

  FIG. 5 is a diagram for explaining timing adjustment of sound and sensation using the connection box of FIG. 2. Referring to FIG. 5, when the sensation control data is incorporated in the non-audible area of the sound signal as described above, the sensation control data is extracted using the digital filter 16 and the extracted sensation control is performed. Drive signals for the sensation modules 34 to 37 are generated according to the data. When the sensation control data is not incorporated in the acoustic signal, the sensation modules 34 to 37 are driven based on the acoustic signal (for example, by sampling a plurality of frequency domain signals and synthesizing them). Drive signals are generated.

  When the drive signal is generated, the drive signal generation unit 17 varies the rise (activation) timing of each drive signal according to the difference in the rise characteristics of each sensation module. In this case, the timing of activation of the drive signal supplied to the bodily sensation module is accelerated as the bodily sensation module takes longer to start. As a result, the sensory module is prevented from shifting due to the rising characteristics of the sensory module.

  In parallel with the generation of the drive signal, the input original sound signal is delayed by the delay circuit 70. The delay amount of the delay circuit 70 is set according to the rise time of the sensation module (usually according to the sensation module with the slowest rise). As a result, it is possible to eliminate the difference between the sound and the bodily sensation. The delay amount of the delay circuit 70 may be further adjusted according to the user's feeling. The acoustic signal after the delay processing is output to an acoustic output device 53 such as an earphone or a speaker.

[Operation of connection box]
FIG. 6 is a flowchart showing the operation of the connection box of FIG. FIG. 7 is a flowchart showing in more detail the procedure of steps S140A and S140B of FIG. Hereinafter, with reference to FIG. 2 to FIG. 7, the operation up to now will be summarized and the operation of the connection box 10 as the sensation control device will be described.

  The microcomputer 11 built in the connection box 10 determines whether or not the acoustic signal input unit 12 is connected to the output unit 51 of the acoustic device (that is, a plug that is an input terminal of the acoustic signal input unit 12 is connected to the output unit 51. It is detected whether or not it is inserted into the jack 52 which is an output terminal. The connection box 10 is in a standby state until the connection between the acoustic signal input unit 12 and the output unit 51 of the acoustic device is detected (NO in step S105) (step S100).

  Various methods can be considered as a method for determining whether or not the plug is inserted into the jack. For example, insertion into a jack can be detected by detecting a change in impedance between each terminal of the plug.

  When the microcomputer 11 detects that the acoustic signal input unit 12 and the output unit 51 of the acoustic device are connected (YES in step S105), the A / D converter built in the acoustic signal input unit 12 Thus, an input signal (acoustic signal or superimposed signal) from the output unit 51 of the acoustic device is A / D converted. Subsequently, the microcomputer 11 uses the digital filter 16 to extract a signal in a specific frequency region within the non-audible region, and determines whether or not sensation control data is included in the input signal based on the signal in the specific frequency region. (Step S110).

  When the sensation control data is included in the input signal as a result of the determination in step S110 (that is, when the input signal is a superimposed signal) (YES in step S115), the process from step S120A to step S140A is performed. A series of steps is executed repeatedly. Specifically, it is as follows.

  First, a superimposed signal is input to the acoustic signal input unit 12 (step S120A). The digital filter 16 filters a specific frequency region in the input superimposed signal. The drive signal generation unit 17 takes out the sensation control data by demodulating the filtered signal (step S125A).

  Next, the drive signal generation unit 17 generates a drive signal (vibrator drive signal, blower drive signal, LED drive signal) for driving each sensation module according to the extracted sensation control data (step S130A). The timing at which each drive signal is activated is set to be different depending on the rise time of each sensation module.

  Each generated drive signal is output to the corresponding sensation module of the sensation device 30 by the communication unit 14 (step S135A). Each sensation module operates according to the corresponding drive signal, so that the user can feel a special sense of presence.

  In parallel with the above steps S120A to S135A, the acoustic signal output unit 13 performs delay processing on the digital superimposed signal (or acoustic signal) after A / D conversion, and the superimposed signal (or acoustic signal) after the delay processing. Is converted to an analog signal by D / A conversion. Then, the acoustic signal output unit 13 outputs the analog-converted superimposed signal (or acoustic signal) to the acoustic output device 53 (step S140A).

  Details of step S140A of FIG. 6 are shown in the flowchart of FIG. FIG. 7 shows an example in which a FIFO variable capacity data buffer is used as the delay circuit 70. The buffer capacity of the data buffer is set in proportion to the delay amount of the delay circuit 70.

  Referring to FIG. 7, when delay processing is necessary (YES in step S300), first, an A / D converted acoustic signal (referred to as acoustic data) is stored in a data buffer (step S310). Storage of the acoustic data in the data buffer is continued until the data buffer is full. When the data buffer is full, the first stored acoustic data is retrieved from the data buffer (step S320). The acoustic data extracted from the data buffer is D / A converted (step S330). Then, D / A converted acoustic data (referred to as an acoustic signal) is output to the acoustic output device 53.

  On the other hand, as a result of the determination in step S110 of FIG. 6, when the sensation control data is not included in the input signal (that is, when the input signal is only an acoustic signal) (NO in step S115), the process starts from step S120B. A series of steps up to step S140B is repeatedly executed. Specifically, it is as follows.

  First, an acoustic signal is input to the acoustic signal input unit 12 (step S120B). The digital filter 16 extracts data of a plurality of frequency bands from the input acoustic signal (step S125B).

  Next, the driving signal generation unit 17 drives driving sensors (vibrator driving signal, blower driving signal, LED, etc.) based on the extracted acoustic signals of each band or a part of them. Drive signal) is generated (step S130B). The timing at which each drive signal is activated is set to be different depending on the rise time of each sensation module.

  Each generated drive signal is output to the corresponding sensation module of the sensation device 30 by the communication unit 14 (step S135B). Each sensation module operates according to the corresponding drive signal, so that the user can feel a special sense of presence.

  In parallel with the above steps S120B to S135B, the acoustic signal output unit 13 performs a delay process on the digital acoustic signal after A / D conversion, and performs an analog signal by D / A converting the acoustic signal after the delay process. Return to. Then, the acoustic signal output unit 13 outputs the analog-converted acoustic signal to the acoustic output device 53 (Step S140B). Details of step S140B in FIG. 6 are the same as in step S140A, and are shown in the flowchart in FIG.

[effect]
As described above, according to the sensation control device of the first embodiment, both when the sound signal indicating the musical tone of the music is input and when the control data of the sensation device is input together with the sound signal, Users can experience a sense of realism that matches the music. Furthermore, when the user feels a sense of reality, the output timing of the acoustic signal and the timing for activating each sensation module can be adjusted according to the rise time of each sensation module and the difference in the senses of the user. It is possible to provide a comfortable experience to the user by reducing the deviation of the experience.

<Second Embodiment>
The second embodiment relates to details in the case where sensation control data is provided embedded in an acoustic signal. Specifically, it is assumed that the composer composes a song and then uses the authoring tool to embed sensation control data for controlling each sensation module in the non-audible area of the acoustic signal indicating the musical tone of the song. is there.

  FIG. 8 is a diagram illustrating the waveform of the acoustic signal and the operation timing of each body sensation module. The timing chart of FIG. 8A shows an example of a screen display when creating sensation control data using an authoring tool. Specifically, FIG. 8A shows the temporal change of the acoustic signal and the operation timing of each sensation module (LED, vibrator, blower) designated by the composer so as to match the acoustic signal. .

  FIG. 8B shows a timing diagram of the acoustic signal and sensation control data output by the authoring tool based on the timing diagram of FIG. 8A in order to write on a recording medium such as a CD, DVD, or Blu-ray disc. ing. As shown in FIG. 8B, the operation timing of each sensation module is earlier than the design timing shown in FIG. 8A, and the difference in timing depends on the rise time of each sensation module. Yes.

  For example, the desired operation timing of the LED (that is, the timing that matches the acoustic signal) is the time t1 and the time t9 shown in FIG. 8A, whereas the operation timing of the LED written on the recording medium is the time. It is slightly earlier than t1 and time t2. Similarly, the desired operation timing of the vibrator is time t2, time t5, and time t8, whereas the operation timing written to the recording medium is earlier than that of the LED. The desired operation timing of the blower is from time t3 to time t4 and from time t6 to time t7, whereas the operation timing written to the recording medium is much earlier than in the case of the LED and vibrator.

  By creating the sensation control data as described above, the timing at which the drive signal for driving each sensation module is activated can be automatically changed according to the rise time of the corresponding sensation module (rise time). The longer the is, the earlier the activation timing). Furthermore, in this case, it is not necessary to delay the acoustic signal in step S140A in FIG. 6 (that is, step S300 in FIG. 7 is NO). As a result, it is possible to minimize the difference between the sound and the bodily sensation and give the user a comfortable bodily sensation.

  Note that the delay time of the acoustic signal may be adjusted in order to correct the difference in personal feeling (that is, step S300 in FIG. 7 is YES). Therefore, when the timing adjustment is performed by the sensation control data, generally, the delay time of the delay circuit 70 when the sensation control data is input to the input unit together with the audible signal is the sensation control data together with the audible signal. Is shorter than when no value is input to the input unit.

  When the acoustic signal (or superimposed signal) is not delayed in step S140A, the acoustic signal output unit 13 outputs the analog acoustic signal (or superimposed signal) input to the acoustic signal input unit 12 to the acoustic output device 53 as it is. You may make it do. Even if the superimposed signal is output as it is, the sensation control data is incorporated in the non-audible region of the acoustic signal, and thus does not adversely affect the acoustic output device 53.

<Third Embodiment>
In 3rd Embodiment, the more detailed procedure of step S110 of the flowchart of FIG. 6, ie, the step which determines whether sensation control data is contained in an input signal is shown.

  In particular, in the third embodiment, identification information (ID code) to be controlled is recorded in advance on the first silent portion of each piece of music recorded on a CD, DVD, Blu-ray disc or the like. It is desirable to leave. By detecting the identification information recorded in the first silent part when each music piece is reproduced, it is possible to extract the sensation control data from the superimposed signal including the subsequent acoustic signal without delay.

  Hereinafter, the detailed procedure of step S110 will be described in detail with reference mainly to FIGS. Since parts other than step S110 in the configuration of the sensation device 30 and the sensation control apparatus 10 and the operation of the sensation control apparatus are the same as those in the first and second embodiments, description thereof will not be repeated.

  FIG. 9 is a flowchart illustrating a procedure for determining whether or not sensation control data is included in an input signal in the sensation control apparatus according to the third embodiment.

  As described with reference to FIG. 6, the microcomputer 11 incorporated in the connection box 10 detects that the acoustic signal input unit 12 is connected to the output unit 51 of the acoustic device (YES in step S <b> 105 in FIG. 6). The input signal to the acoustic signal input unit 12 is A / D converted. Subsequently, the microcomputer 11 determines whether or not any signal is included in the specific frequency region by filtering the specific frequency region to which the sensation control code is assigned in the non-audible region by the digital filter 16. (Step S200 in FIG. 9). When the microcomputer 11 determines that the signal is not included in the specific frequency region (NO in step S210), the microcomputer 11 determines that the sensation control data is not included in the input signal (step S250).

  On the other hand, when some signal is included in the specific frequency region, the microcomputer 11 identifies the identification information of the sensation module (for example, an ID code (Identification Code) set in advance for each sensation module) in the specific frequency region. Is included (step S220). As a result, when the microcomputer 11 determines that the identification information of the sensation module is not included in the specific frequency region (NO in step S230), the microcomputer 11 determines that the sensation control data is not included in the input signal ( If it is determined that the identification information of the sensation module is included in the specific frequency region (YES in step S230), it is determined that the sensation control data is included in the input signal (step S240).

  When executing the above procedure, it is desirable to record the identification information of the sensation module in the first silent portion of each piece of music recorded on a CD, DVD, Blu-ray disc or the like. Then, based on the information recorded in the silent part, it is possible to extract the sensation control data from the superimposed signal including the subsequent acoustic signal without delay.

<Fourth Embodiment>
In the first to third embodiments, it is assumed that the acoustic signal output from the output unit 51 of the acoustic device is an analog signal. However, when a digital acoustic signal is input instead of the analog signal, It is also possible to configure the connection box 10 to be applicable. For example, the present invention can also be applied when a video signal is input as an input signal together with an audio signal as in the HDMI (registered trademark) standard. When a digital acoustic signal is input, A / D conversion in the acoustic signal input unit 12 and D / A conversion in the acoustic signal output unit 13 are unnecessary.

  Also in the above case, as in the first to third embodiments, the sensation control data is preferably incorporated into the acoustic signal as a signal modulated in a specific frequency region within the non-audible region. As a result, the sensation control data can be incorporated into the acoustic signal without changing the standard of the existing communication interface.

  It should be thought that embodiment disclosed this time is an illustration and restrictive at no points. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  DESCRIPTION OF SYMBOLS 10 Connection box (sensation control apparatus), 11 Microcomputer (determination part), 12 Acoustic signal input part, 13 Acoustic signal output part, 14, 32 Communication part, 16 Digital filter, 17 Drive signal generation part, 18 Vibrator drive signal generation Unit, 19 blower drive signal generation unit, 20 blower drive signal generation unit, 30, 30A, 30B sensory device (wristband), 34 vibrator (sensory module), 35 blower (sensory module), 36 air bag, 37 LED (sensory sensory) Module), 51 output unit of audio equipment, 53 audio output device, 70 delay circuit.

Claims (5)

A bodily sensation control device for controlling a bodily sensation module that gives a bodily sensation to the user,
An input unit to which at least an acoustic signal is input; and
A determination unit that determines whether or not sensation control data for controlling the sensation module is input to the input unit together with the acoustic signal;
When the sensory control data is input to the input unit together with the acoustic signal, a driving signal for driving the sensory module is generated based on the sensory control data, and the sensory control data is generated together with the acoustic signal. A drive signal generation unit that generates a drive signal for driving the sensory module based on the acoustic signal when not being input to the input unit;
A delay circuit that delays the acoustic signal and has a variable delay time;
An acoustic signal output unit for outputting the acoustic signal after the delay ,
When the sensation control data is input to the input unit together with the acoustic signal, the sensation control data is created in advance so that the timing at which the drive signal is activated differs according to the rise time of the sensation module. A bodily sensation control device. Wherein when the sensible control data with the acoustic signal is not input to the input unit, the drive signal generating unit, the drive signal in response to the rise time of the experience module to differentiate the timing of activating claim 1 The sensation control device according to 1. A bodily sensation control device for controlling a bodily sensation module that gives a bodily sensation to the user,
An input unit to which at least an acoustic signal is input; and
A determination unit that determines whether or not sensation control data for controlling the sensation module is input to the input unit together with the acoustic signal;
When the sensory control data is input to the input unit together with the acoustic signal, a driving signal for driving the sensory module is generated based on the sensory control data, and the sensory control data is generated together with the acoustic signal. A drive signal generation unit that generates a drive signal for driving the sensory module based on the acoustic signal when not being input to the input unit;
A delay circuit that delays the acoustic signal and has a variable delay time;
An acoustic signal output unit for outputting the acoustic signal after the delay ,
When the sensation control data is not input to the input unit together with the acoustic signal, the drive signal generation unit varies the timing at which the drive signal is activated according to the rise time of the sensation module. . The delay time of the delay circuit when the sensation control data is input to the input unit together with the acoustic signal is shorter than that when the sensation control data is not input to the input unit together with the acoustic signal. The sensation control device according to any one of claims 1 to 3 . The sensation control data is modulated into a specific frequency region in a non-audible region and incorporated into the acoustic signal,
The driving signal generation unit extracts the signal in the specific frequency region using a filter and demodulates the sensation control data when the sensation control data is input to the input unit together with the acoustic signal. The sensation control device according to any one of claims 1 to 4, wherein the sensation control device reproduces and generates the drive signal according to the reproduced sensation control data.

Images