JP2002078066A - Vibration waveform signal output device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide vibration matching video and audio to a viewer in accordance with the reproduction of the video and the audio. SOLUTION: AV source data 10 have video and audio tracks and also a vibration track or a vibration pattern designation data track. In the vibration track, a vibration waveform signal synchronized with the video track or the audio track is written. The vibration pattern designation data track is data to select a vibration pattern stored in a storage section 30 of an AV amplifier 2 in accordance with the video or audio. Such AV source data are reproduced to provide vibration adaptive to the video or audio to a viewer in accordance with the reproduction of the video and audio.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a vibration waveform signal output device capable of transmitting not only images and sounds but also vibrations corresponding to the images and sounds to a viewer such as a movie.

[0002]

2. Description of the Related Art In an apparatus for reproducing an AV source such as a movie, a video is reproduced with high definition and sound such as music and sound effects is reproduced realistically in order to reproduce with high sense of reality. However, the image reproduces a virtual space beyond a screen such as a screen, and the sound is only heard from behind a speaker. In recent years, a surround system has been developed for sound, and the sound has spread throughout the space surrounding the viewer. However, the current movie playback is not sufficiently realistic, and the virtual I'm just looking into the space.

[0003]

Originally, the entertainment of a movie is to provide a viewer with a virtual world in a virtual world, so the higher the sense of reality, the higher the value of the entertainment. For that purpose, it is more effective if the AV source includes not only the visual and auditory senses but also the skin senses. For example, if vibration and impact in an action scene in a movie, wind pressure and pressure felt by the skin are generated together with reproduction of video and audio, it is expected that the sense of reality will be significantly improved.

[0004] Hitherto, there has been known "Body Sonic (trademark)" in which a low-frequency component of music is input to an actuator incorporated in a chair to vibrate the body. However, since this is merely an actuation of the actuator with the low-frequency component of the audio signal, the level of the vibration is not such that the dynamics of a movie or a game can be reproduced. That is, the vibration necessary to enhance the sense of reality in a movie or the like includes not only low-frequency components included in audio signals such as music and sound effects but also extremely low frequencies. The wind pressure of explosives, the pressure of something looming, momentary weightlessness, the vibration of car races, all vibrations at frequencies much lower than the components of music.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a vibration waveform signal output device capable of giving an extremely low frequency vibration suitable for a video or audio to a viewer in accordance with the reproduction of the video or audio.

[0006]

SUMMARY OF THE INVENTION The present invention has a video amplifying means for amplifying a video signal or an audio amplifying means for amplifying an audio signal, and amplifies and outputs a vibration waveform signal for giving vibration to a viewer. And a vibration waveform amplifying means. According to the present invention, in an amplifier for reproducing AV source data, in addition to a means for amplifying a video signal and / or a means for amplifying an audio signal, a means for amplifying a vibration waveform signal for giving vibration to a viewer is provided. Was. In order to apply vibration to the viewer, a seat incorporating an actuator, a jacket in which a vibration element such as a piezoelectric element is embedded, or the like may be used, and the means of vibration is not limited. By this vibration means, vibration is supplied to the viewer in addition to video and audio, so that an AV source such as a movie can be reproduced with a more realistic feeling.

According to the present invention, there are provided storage means for storing a plurality of types of vibration pattern data, which are vibration waveforms for giving vibration to a viewer, pattern specifying means for specifying any of the vibration pattern data, and specification by the pattern specifying means. Reading means for reading out the obtained vibration pattern data and outputting it as a vibration waveform signal. The present invention is characterized in that the pattern designating means is means for reading designation data recorded in parallel with a video signal or an audio signal in parallel with reproduction of the video signal or the audio signal. The present invention is characterized in that the pattern designating means is means for designating vibration pattern data by a viewer's operation. In the present invention, the vibration pattern data is stored. The vibration pattern data simulates the vibration of various specific scenes or represents an abstract image, and can be an extremely low frequency signal not included in the audio signal. . By reading this in parallel with the video signal or the audio signal, it is possible to supply vibrations suited to the atmosphere of each scene of the video and audio, and by reading the signal according to the viewer's selection, The user's favorite vibration can be added to the video or audio.

The present invention relates to an audio amplifying means for amplifying an audio signal and outputting the amplified signal to a speaker, and an envelope extracting means for extracting an envelope of the audio signal and outputting it as a vibration waveform signal for giving vibration to a viewer. And characterized in that:
The present invention is characterized in that the envelope extracting means extracts an envelope in a low frequency range of the audio signal. The present invention is characterized in that the envelope extracting means extracts an envelope for a signal section whose level is equal to or more than a certain level. According to the present invention, an envelope of music and sound effects is extracted, and a signal of an extremely low frequency linked to the strength of the original signal is created. As a result, fluctuations of several Hz or 1 Hz or less can be generated. For example, in the case of rock music, since a strong rhythm is engraved as a whole, its envelope, that is, a waveform representing a change in volume, includes a rhythm beat. Therefore, by using the envelope as a vibration waveform signal, it is possible to give the viewer a beat-like swing associated with the rhythm of the music.

[0009] The invention includes a sound amplification means for outputting to the speaker amplifies the audio signal, 1/2 ⁿ (n the voice signal
(A positive integer) and outputs a vibration waveform signal for giving vibration to the viewer. The present invention is characterized in that the frequency dividing means extracts and divides a signal in a low frequency range of the audio signal. The present invention is characterized in that the frequency dividing means divides a signal section whose level is equal to or more than a certain level. In the present invention, based on an audio signal included in a movie or a game, the frequency is reduced to half by dividing the frequency, and the frequency is reduced by about one digit by repeating the same. Half the frequency means a pitch difference of octave, and the pitch of the music at that time is, for example, "do"
When, the sound below the octave is also "do", and even if the sound is leaked from the vibrating chair and heard in the ear, it does not disturb the musical chord. Assuming that the original sound is 50 Hz, one frequency division can newly generate a component of 25 Hz and two frequency divisions of 12.5 Hz. In general, it is said that air vibration having a frequency of 20 Hz or less cannot be heard by the ear as sound, but it can be sensed by the body, which becomes a skin sensation and causes a sense of realism that has not existed in the past.

According to the present invention, a storage means for storing a reference pattern which is a time change pattern of an audio signal related to a specific vibration waveform, and a time change pattern of an audio signal inputted to the audio amplification means are analyzed. Comparing the obtained time change pattern with the reference pattern,
Determining means for supplying only the section in which the analyzed time change pattern of the input audio signal matches the reference pattern to the envelope extracting means or the frequency dividing means. The present invention relates to a storage means for storing vibration pattern data, which is data of a specific vibration waveform, and a reference pattern, which is a time change pattern of an audio signal relating to the specific vibration waveform, in association with each other; Analyzing the time change pattern of the audio signal to be analyzed, comparing the analyzed time change pattern with the reference pattern, and when the analyzed time change pattern matches the reference pattern, the vibration corresponding to the matched reference pattern. Means for reading out the pattern data and outputting it as a vibration waveform signal. According to the present invention, a reference pattern that is a time change pattern of an audio signal related to a specific vibration waveform is stored in the storage unit. The specific vibration waveform is, for example, a blast, a train shake, or the like, and the audio signal related thereto is an explosion sound, a running sound of a train, or the like. The determining means determines whether there is such an audio signal in the audio signal of the movie or the like based on the time change pattern, and in the case, determines the vibration waveform signal to generate a vibration (corresponding) based on the audio signal. Is output.

According to the present invention, a storage means for storing vibration pattern data, which is a vibration waveform for giving vibration to a viewer, an envelope extraction means for extracting an envelope of an input audio signal; Frequency dividing means for ^{dividing by} 1/2 ⁿ (n is a positive integer), vibration pattern data read from the storage means, an envelope signal extracted by the envelope extracting means, and a divided signal divided by the frequency dividing means And mixing means for mixing low-frequency signals input from the outside at a selected or appropriate ratio and outputting the resultant as a vibration waveform signal. According to the present invention, by appropriately selecting or mixing the mixing ratio of the original music and sound signals such as sound effects, low-frequency signals such as vibration data, frequency-divided music and sound effects, and their envelopes. It is possible to output an optimal vibration waveform signal according to the source being played or being shown.

[0012] The present invention is characterized in that a filter for filtering the vibration waveform signal is provided, and a frequency characteristic of the filter is changed according to a type of the video signal or the audio signal.

[0013]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An AV system according to an embodiment of the present invention will be described with reference to the drawings. Figure 1 shows the AV
FIG. 1 is a diagram illustrating a configuration of a system. AV source device 1
AV source media (eg, DVD) storing AV source data including video data and audio data
, A device that stores AV source data in a large-capacity storage such as a hard disk, a device that receives AV source data from a satellite or a cable, an audio data reproducing device that does not include video, a video game machine, and the like. The AV source device 1 reads predetermined AV source data according to a user's request operation or the like, or generates AV source data and inputs the AV source data to the AV amplifier 2.
The AV source data has a video track and an audio track as shown in FIG. 3, and additionally has a vibration track or a vibration pattern designation data track for vibrating the chair of the user. There is also.

Here, the AV source device 1 converts the video data, audio data, and the like into digital data as the AV data.
The signal may be input to the amplifier 2, or may be converted to an analog video signal and audio signal and then input to the AV amplifier 2. The video signal and the audio signal may be composite signals or separate line signals.

The AV amplifier 2 amplifies an input video signal (video data) and projects it on a screen 4. Also,
The AV amplifier 2 amplifies the input audio signal (audio data) and outputs it from the speaker group 3. The speaker group 3 includes left and right main speakers, left and right rear speakers, a center speaker, and a subwoofer 3a, and the AD source data includes audio data of a plurality of channels corresponding to each speaker. Among them, the audio signal input to the subwoofer 3a is a signal obtained by separating only the low frequency range from all the audio signals. Also, audio data of a small number of channels such as left and right two channels is written in the AV source data, and the AV amplifier 2 processes the audio data of the small number of channels by filtering or the like to generate an audio signal for the multi-channel speaker. You may do so.

A vibration chair 5 (including a vibration cushion) is connected to the AV amplifier 2. This vibration chair 5
Has a built-in actuator, and vibrates according to a vibration waveform signal output from the AV amplifier 2. AV amplifier 2
Outputs a vibration waveform signal corresponding to the AV source data to be reproduced to the vibration chair 5. The vibration chair 5 is a chair that operates an actuator with an input vibration waveform signal to vibrate the seating surface and the backrest in the same manner as the vibration waveform.

By making the vibration waveform signal a signal having a waveform corresponding to the contents of the AV source data, the AV source data can be more realistically displayed than when only the video and audio are reproduced.

FIG. 2 is a schematic block diagram of the AV amplifier 2. In this figure, a case where a playback device for playing back AV source data is connected as the AV source device 1 will be described as an example. Each track of the AV source data 10 is reproduced by the AV source device 1 and input to the AV amplifier 2. The AV amplifier 2 includes a video signal processing unit 11, an audio signal processing unit 12, and a vibration waveform signal processing unit 13. The video signal processing unit 11 converts a video signal into a normal AV signal.
Since this is a processing unit that performs amplification (similar to an amplifier) and then displays (projects it on a screen), details are omitted in this figure. The audio signals of each channel of the audio track are amplified by separate amplifiers 21 and output from the corresponding speakers 3 respectively. Then, the audio signal of the subwoofer which is responsible for the lowest-range sound of the audio signals of the plurality of channels is output to the speaker and input to the vibration waveform signal processing unit 13.

The vibration waveform signal processing section 13 selects or combines various vibration waveform signals and outputs the selected signal to the vibration chair 5. Various signal waveform signals are formed based on signal track data included in the AV source data, signal pattern data stored in the AV amplifier 2, bass audio signals for the subwoofer, and the like. .

When the AV source data to be reproduced includes a vibration track on which a vibration waveform signal is recorded, the AV source device 1 reads out the vibration track, demodulates the vibration waveform signal, and inputs the signal to the AV amplifier 2. In the AV amplifier 3, this signal is input to the vibration waveform processing unit 13. The vibration waveform processing unit 13 includes a gain adjustment unit 22 for each system that separately adjusts the gain of a plurality of types of vibration waveform signals. The vibration waveform signal of the vibration track input from the AV amplifier 2 is: One of them is input to the gain adjustment unit 22. The gain adjustment unit 22 includes a control unit 31
The gain of the vibration waveform signal is adjusted in accordance with the instruction.
The vibration waveform signal whose gain has been adjusted is input to the adder 26. The adder 26 is supplied with the vibration waveform signals of the plurality of systems, the gains of which are separately adjusted. Adder 2
6 synthesizes these vibration waveform signals and outputs them to the filter 27.

The gain adjustment section 22 can independently adjust the gain of the vibration waveform signal of each system, and the adjustment range is from 0 to 1. Normally, by appropriately adjusting the gain of each system, the adder 26 synthesizes the vibration waveform signals of a plurality of systems at an appropriate ratio. Further, by setting the gain of one system to be larger than 0 and setting the gain of another system to 0, it is also possible to select only the one system. That is, the gain adjustment unit 22 also functions as a system selection unit.

In the vibration waveform signal processing section 13, the audio signal of the subwoofer bass channel is directly converted into a single system vibration waveform signal by the gain adjustment section 22.
, And also to the envelope extraction unit 23 and the frequency dividing circuit 24. The envelope extracting unit 23 is a circuit that extracts the envelope of the audio signal. As shown in FIG. 5A, the envelope extraction unit 23 extracts the envelope by performing low-pass filtering on the audio signal of the subwoofer bass channel, and extracts a DC component corresponding to the amplitude of the original waveform from the envelope waveform. The signal is cut and oscillated around the 0 level, and is output as an oscillating waveform signal. The output envelope vibration waveform is input to the gain adjustment unit 22 as one system of vibration waveform signal.

The frequency ^dividing circuit 24 converts the input audio signal of the subwoofer bass channel into 1/2 ⁿ
(N is a positive integer). The control unit 31 instructs how to set the value of n. The control unit 31 determines the value of n according to the type of the AV source data to be reproduced. For example, when reproducing a music source, n = 2 is set. Musical sources include classical, rock, Japanese drums, flamenco, and dance. When playing a game source, n = 3. Examples of games include car racing, martial arts, and flight simulators. When reproducing a movie source, n = 4. Examples of movie sources include suspense, action, horror, war, and battle. By ^dividing the frequency by 1/2 ⁿ , the bass signal is converted into a bass signal, and the frequency is such that the human body feels as vibration. Also, 1/2
^{By dividing} the frequency by ⁿ , the frequency of the converted signal always has an octave relationship with the original signal, and there is no possibility that the frequency of the converted signal becomes audible in the audible frequency range. The waveform signal divided by the frequency dividing circuit 24 is input to the gain adjustment unit 22 as one system of vibration waveform signal.

On the other hand, this AV amplifier 2 has the configuration shown in FIG.
As shown in (B), the storage unit 30 stores a plurality of types of vibration pattern data. Each vibration pattern is a vibration pattern (pattern 0 to 9) representing a specific scene.
9), and are classified into vibration patterns (patterns 100 to 199) representing abstract images. As signal patterns representing specific scenes, vibrations caused by vehicles (vibration patterns 0, 1, 2,...) And vibrations caused by wind (vibration patterns 10,
11, ...). As a vibration pattern representing an abstract image, there are a calm vibration pattern and a dynamic vibration pattern. This signal pattern data is selected by vibration pattern designation data included in the AV source data or by a user operation.

When the AV source data to be reproduced includes vibration pattern designation data, the AV source device 1 reads out the vibration pattern designation data track together with the video track and the audio track, and inputs the read data to the AV amplifier 2. The vibration pattern designation data is data for designating a vibration pattern according to the video scene of the video track or the audio scene of the audio track, and is transmitted from the AV source device 1 in parallel with the video and audio.
The signal is input to the amplifier 2. The reading unit 25 of the AV amplifier 2
The vibration pattern data specified by the vibration pattern specification data is read to form a vibration waveform signal. This vibration waveform signal is input to the gain adjustment unit 22 as a vibration waveform of one system.

When the vibration pattern designation data is written in the vibration pattern designation data track and the vibration pattern data is designated, the envelope of the duration and amplitude of the vibration may be written in the vibration pattern designation data. Realistic control becomes possible.

As described above, the AV amplifier 2 is included in the vibration track data included in the AV source data, the vibration pattern data specified by the vibration pattern specification data included in the AV source data, and the audio track of the AV source data. Selecting or appropriately mixing an audio signal of a bass channel for a subwoofer (or separated from audio data) and an oscillation waveform signal such as an envelope or a frequency-divided signal of the audio signal, and filtering the mixed oscillation waveform signal 27
Output to

The filter 27 adjusts the level of each frequency component of the vibration waveform signal. Filter characteristics are controlled by control unit 3.
Set by 1. The control unit 31 sets a filter characteristic that increases the sense of reality of the scene according to the type of AV source data to be reproduced. For example, when reproducing a music source, a filter characteristic that represents the propagation characteristics of low-frequency vibration in a church, a theater, a rock venue, a tablao, an underground, or the like is set in accordance with the type of the music. When a game source is reproduced, a filter characteristic is set according to the type of the game so as to well convey the atmosphere of a race track, a soccer stadium, or the like. When a movie source is reproduced, a filter characteristic that represents the propagation of vibration in space or underwater is set according to the content of the movie. The type such as the genre of the AV source to be reproduced is determined based on the header information of the AV source data.

FIG. 5C shows an example of the filter characteristics.
The illustrated example shows the following filter characteristics.
When a game-based car race is reproduced, a filter characteristic that emphasizes an extremely low frequency range and also emphasizes a frequency range of an explosion sound of about 50 Hz is used. In the case of music flamenco / tablao, a filter characteristic that emphasizes the vibration of a step (stepping) less than 10 Hz is used. Also,
When an action-type movie is reproduced, a filter characteristic of broadly passing a frequency of about 10 Hz is used. Note that the filter characteristics are not limited to those illustrated in FIG.

In the above embodiment, all the audio signals of the subwoofer bass channel are input to the gain adjustment unit 22, the envelope extraction unit 23, and the frequency dividing circuit 24.
Only the portion exceeding the predetermined threshold may be used as the vibration waveform signal. In this case, the AV amplifier 2 is provided with a judging section 35 as shown in FIG. 6, and the audio signal of the subwoofer bass channel is input to this judging section 35. Stage gain adjuster 22, envelope extractor 23, and frequency divider 24
To enter.

The combination of the mixing ratio or the signal of the gain adjusting section 22 and the combination of the filter characteristics of the filter 27 are determined in advance, and the AV source data to be reproduced or the viewer is selected according to the selection of the viewer. It is possible to output a vibration waveform signal according to the content of the data and the viewer's preference.

In the above embodiment, all audio signals of the subwoofer bass channel are used as vibration signals. However, only the section of a specific vibration pattern among the audio signals of the subwoofer bass channel is used as a vibration waveform signal. It may be used. FIG.
This embodiment will be described below with reference to FIG. FIG.
Is a block diagram of the AV amplifier 2 of the embodiment. This embodiment differs from the AV amplifier 2 shown in FIG. 2 in that the audio signal of the subwoofer bass channel is directly converted into a gain control unit 22, an envelope extraction unit 23, and a frequency dividing circuit 24.
Is input via the determination unit 35 instead of the input.

Then, the storage section 30 of the AV amplifier 2 is provided with a reference pattern table indicated by a dotted line in FIG. In this reference pattern table, a time-varying pattern of a sound spectrum associated with various vibrations such as explosions, strong winds, and footsteps is written as a reference pattern. The AV amplifier 2 receives digital data from the AV source device 1 and demodulates the digital data.
Amplifying device. When video data and audio data reproduced from the AV source device 1 are input, the AV
The amplifier 2 temporarily buffers the signal, demodulates the signal in accordance with the time axis, and outputs the signal. The determining unit 35 pre-reads the buffered bass channel data for the subwoofer and determines whether there is a section having a waveform similar to the reference pattern.

The operation of the determination unit 35 will be described with reference to the flowchart of FIG. Note that this determination unit 35 is
1 may be implemented as software. First, the buffered audio signal (digital audio data) of the subwoofer bass channel is pre-read and its level is checked (s1). Then, it is determined whether or not the level of the audio signal has exceeded a predetermined threshold for a predetermined time or longer (s2). If the threshold has been exceeded for a certain period of time or more, this section is cut out as a processing target section (s3), and the time change pattern of the frequency spectrum in this section is analyzed (s4). Then, the time variation pattern of the analyzed spectrum is compared with each reference pattern stored in the reference pattern table (s5). As a result of the comparison, if the time change pattern of the analyzed spectrum matches any of the reference patterns (s6), it is determined that the vibration based on the audio signal in this section matches the scene of the AV source. This is used as a vibration waveform signal and the gain adjustment unit 2
2. Output to the envelope extraction unit 23 and the frequency dividing circuit 24 (s
7). Thus, only a portion related to the scene of the AV source can be cut out from the audio signal and used as a vibration waveform signal, so that more effective vibration can be generated.

Further, in the above embodiment, when a vibration pattern designating data track exists in the AV source data, the vibration pattern designated by the vibration pattern designating data from among the vibration pattern data stored in the AV amplifier 2. Although data is read out, even when there is no vibration pattern designation data track, vibration pattern data suitable for the scene can be determined by the above pattern comparison, and the corresponding vibration pattern data can be read. This embodiment will be described with reference to FIGS. FIG. 8 is a block diagram of the AV amplifier 2 of the same embodiment. The difference of this embodiment from the AV amplifier 2 shown in FIG. 2 is that the determination unit 36 does not read out the vibration pattern data based on the vibration pattern designation data included in the AV source data, but the audio signal of the subwoofer bass channel is determined. Is to determine which vibration pattern data to read out based on this.

Therefore, the explosion stored in the reference pattern table set in the storage unit 30
Each reference pattern such as strong wind and footstep is associated with vibration pattern data that generates the same type of vibration (explosion, strong wind, footstep, etc.). The AV amplifier 2 is a device that inputs digital data from the AV source device 1 and demodulates and amplifies the same, as in the embodiment of FIG. When video data, audio data, and the like reproduced from the AV source device 1 are input, the AV amplifier 2 temporarily buffers them, demodulates them according to the time axis, and outputs them. The determining unit 36 pre-reads the buffered bass channel data for the subwoofer and determines whether there is a section having a waveform similar to the reference pattern.

The operation of the determination unit 36 will be described with reference to the flowchart of FIG. Note that this determination unit 36 is
1 may be implemented as software. First, the buffered audio signal (digital audio data) of the subwoofer bass channel is pre-read and its level is checked (s11). Then, it is determined whether or not the level of the audio signal exceeds a predetermined threshold value for a predetermined time or more (s12). If the threshold has been exceeded for a certain period of time or more, this section is cut out as a processing target section (s13), and the time change pattern of the frequency spectrum in this section is analyzed (s14). Then, the time variation pattern of the analyzed spectrum is compared with each reference pattern stored in the reference pattern table (s15). As a result of the comparison, when the time change pattern of the analyzed spectrum matches any of the reference patterns (s16), it is determined that the presence of the vibration of the matched pattern can increase the sense of realism in this section. The reading of the vibration pattern data associated with the reference pattern
(S17). In response to this instruction, the reading unit 2
5 reads out the associated vibration pattern. This makes it possible to determine a portion related to the scene of the AV source from the audio signal and read out the corresponding vibration pattern data. Therefore, even if the AV source data has no vibration pattern designation data track, the vibration pattern can be effectively used. Data can be used.

In the above embodiment, the vibration waveform signal is formed in accordance with the AV source data to be reproduced. However, the user selects a desired vibration pattern, and the AV amplifier 2 and the AV source device 1 A that suits this
It is also possible to automatically select and reproduce V source data. In this case, the vibration waveform signal processing unit 13
Regardless of the content of the AV source data to be reproduced, the vibration pattern data selected by the user is continuously output.

When a user selects desired AV source data, it is possible to narrow down the AV source data by selecting a vibration pattern and to assist the selection. This embodiment will be described with reference to FIGS. FIG. 10 is a diagram showing a vibration pattern-AV source data correspondence table. This table corresponds to the AV in FIG.
It is stored in the storage unit 30 of the amplifier 2 and used by the control unit 31. In this table, corresponding to each vibration pattern (vibration patterns 100 to) representing the abstract image, AV source data that matches the vibration pattern and the impression is registered for each genre. As for the classification and registration of each AV source data (title) in this table, when the user plays the title for the first time, the AV amplifier may learn and classify and register the corresponding vibration pattern. Note that one title may be associated with a plurality of vibration patterns. When the user selects a vibration pattern and a genre, AV source data corresponding to the selected vibration pattern and belonging to the selected genre is extracted.

FIG. 11 is a flowchart showing the operation of the control unit 31. Note that the control unit 31 may have a function of instructing the AV source device 1 of an AV source to be reproduced and reproducing the automatically selected source, or simply a candidate AV source data (title). May be displayed and the function of only supporting the user's selection may be used. First, the user selects and inputs a vibration pattern from the operation unit 32 (s
21). The input of the vibration pattern may be performed by inputting the vibration pattern number. When the vibration pattern is selected,
Next, a genre selection screen is displayed (s22). In this embodiment, the genre is classified into a movie (movie), a game, and music (music). When the user selects a genre (s23), the AV source data of the selected genre that matches the selected vibration pattern is extracted (s24), and a list is displayed (s25). When the user views the title list and selects one of them (s26), the user instructs the AV source device 1 to reproduce the selected title. If the AV amplifier 2 has no function of instructing the AV source device 1 to reproduce, s2
It is sufficient to end the operation up to 5.

In the above embodiment, AV source data having a video track and an audio track has been described. However, the same processing can be performed for source data of only an audio track.

In the above embodiment, the AV of a movie or music
Although the scene in which the source data is reproduced has been mainly described, the present invention can also be applied to a screen such as a game.

[0043]

As described above, according to the present invention, since appropriate vibration can be added to video and audio,
Video and audio can be reproduced with a higher sense of reality for the viewer.

[Brief description of the drawings]

FIG. 1 shows an A including an AV amplifier according to an embodiment of the present invention.
Diagram for explaining the configuration of the V system

FIG. 2 is a block diagram of an AV amplifier of the AV system.

FIG. 3 is a diagram showing a configuration of AV source data reproduced by the AV system.

FIG. 4 is a view for explaining contents stored in a storage unit of the AV amplifier;

FIG. 5 is a diagram illustrating functions of an envelope extraction unit, a frequency divider, and a filter of the AV amplifier.

FIG. 6 is a block diagram of an AV amplifier according to another embodiment of the present invention;

FIG. 7 is a flowchart showing the operation of a determination unit of the AV amplifier.

FIG. 8 is a block diagram of an AV amplifier according to still another embodiment of the present invention.

FIG. 9 is a flowchart showing the operation of a determination unit of the AV amplifier.

FIG. 10 is a diagram showing a vibration pattern-AV source data correspondence table set in a storage unit of the AV amplifier;

FIG. 11 is a flowchart showing the operation of the control unit of the AV amplifier.

[Explanation of symbols]

1 ... AV source device, 2 ... AV amplifier, 3 ... Speaker,
3a: subwoofer, 4: screen, 5: vibration chair,
Reference numeral 22: gain adjuster, 23: envelope extractor, 24: frequency divider, 25: readout unit, 26: adder, 27: filter,
30 storage unit, 31 control unit, 35, 36 determination unit

Claims (14)

[Claims] 1. A vibration device comprising: a video amplifying means for amplifying a video signal; or an audio amplifying means for amplifying an audio signal, and a vibration waveform amplifying means for amplifying a vibration waveform signal for giving vibration to a viewer. Waveform signal output device. 2. A storage means for storing a plurality of types of vibration pattern data, which is a vibration waveform for giving a vibration to a viewer, a pattern specifying means for specifying any of the vibration pattern data, and a pattern specifying means for specifying one of the vibration pattern data. A reading means for reading out the vibration pattern data and outputting it as a vibration waveform signal. 3. The pattern designating means according to claim 2, wherein the pattern designating means reads designation data recorded in parallel with the video signal or the audio signal in parallel with reproduction of the video signal or the audio signal. Vibration waveform signal output device. 4. The vibration waveform signal output device according to claim 2, wherein said pattern designating means is means for designating vibration pattern data by a viewer's operation. 5. An audio amplifying means for amplifying an audio signal and outputting it to a speaker, an envelope extracting means for extracting an envelope of the audio signal and outputting it as a vibration waveform signal for giving vibration to a viewer, A vibration waveform signal output device comprising: 6. The vibration waveform signal output device according to claim 5, wherein said envelope extraction means extracts an envelope in a low frequency range of said audio signal. 7. The vibration waveform signal output device according to claim 5, wherein said envelope extraction means extracts an envelope for a signal section whose level is equal to or more than a certain level. 8. A sound amplifying means for amplifying a sound signal and outputting the amplified signal to a speaker, and a vibration waveform for ^dividing the sound signal to 1/2 ⁿ (n is a positive integer) to give a vibration to a viewer. A vibration waveform signal output device comprising: a frequency dividing unit that outputs a signal. 9. The vibration waveform signal output device according to claim 7, wherein said frequency dividing means extracts and divides a signal in a low frequency range of said audio signal. 10. The vibration waveform signal output device according to claim 8, wherein said frequency dividing means divides the frequency of a signal section whose level is equal to or more than a certain level. 11. A storage means for storing a reference pattern, which is a time change pattern of an audio signal related to a specific vibration waveform, and a time change pattern of an audio signal input to the audio amplification means, and the analysis is performed. Comparing the time change pattern with the reference pattern and determining only the section of the input audio signal where the analyzed time change pattern matches the reference pattern, and supplying the section to the envelope extracting means or the frequency dividing means; The vibration waveform signal output device according to any one of claims 5 to 10, further comprising: 12. A memory means for storing vibration pattern data, which is data of a specific vibration waveform, and a reference pattern, which is a time change pattern of an audio signal relating to the specific vibration waveform, in association with each other; Analyze the time change pattern of the input audio signal, compare the analyzed time change pattern with the reference pattern, and when the analyzed time change pattern matches the reference pattern, correspond to the matched reference pattern. Means for reading out the vibration pattern data and outputting it as a vibration waveform signal. 13. A storage means for storing vibration pattern data which is a vibration waveform for giving vibration to a viewer, an audio signal input, and an envelope extraction means for extracting an envelope of the audio signal; , And frequency ^dividing means for ^{dividing the} audio signal by 1/2 ⁿ (n is a positive integer); vibration pattern data read from the storage means; an envelope signal extracted by the envelope extracting means; A mixing means for mixing the frequency-divided signal divided by the means and a low-frequency signal input from the outside at a selected or appropriate ratio and outputting as a vibration waveform signal. 14. The filter according to claim 1, further comprising a filter for filtering the vibration waveform signal, wherein a frequency characteristic of the filter is changed according to a type of the video signal or the audio signal. Vibration signal output device.