KR101417065B1 - apparatus and method for generating virtual sound - Google Patents

Abstract

The present invention relates to an apparatus and a method for implementing a virtual stereo sound.

A method for implementing a stereoscopic sound according to the present invention comprises the steps of: generating a stereophonic sound using an HRTF (Head Related Transfer Function) for an input audio signal and forming an output direction using the sound beam; And outputting an audio signal in the generated stereo sound and output direction.

Stereo sound, HRTF, sound beam

Description

[0001] The present invention relates to an apparatus and a method for generating a virtual stereo sound,

The present invention relates to an apparatus and a method for implementing a virtual stereo sound.

As storage media and audio coding techniques are developed, various media and audio systems have been emerging that provide multi-channel stereophonic sound beyond the conventional mono sound and two-dimensional stereo sound. The Dolby AC-3 surround surround stereo system includes a center, a front left (left), a front right (right), a rear left (left stereo), a rear right (stereo right) And a central subwoofer that produces a low-pitched sound, that is, a 5.1-channel sound data composed of five speakers and a single woofer. The encoded AC-3 data can be played in mono, stereo, Dolby matrix, and 5 or 5.1 channel digital surround, depending on the decoding method. Currently, AC-3 recording is popular in the movies, and US HDTV and DVD also use AC-3 audio.

DTS stands for Digital Theater Systems and is the name of the multi-channel surround encoding technology used in movies and music developed in 1993. DTS has a high and flexible compression algorithm that can be quantized to 192 kHz and 24 bits at the maximum sampling frequency and is perfect compared to linear PCM (Pulse Code Modulation) coding (44.1 kHz, 16 bit) It is possible to reproduce the original sound close to the original sound.

DVD, which is becoming popular as a representative medium for providing multi-channel stereophonic sound, compresses multi-channel sound signals by PCM, Dolby AC-3, MPEG audio system, etc. Recently, titles to be compressed by the DTS system are also increasing to be.

In addition, home theater system (Home Theater System) is popularized in the home can experience the stereoscopic sound full of tension at the level of a movie theater.

2. Description of the Related Art In recent years, broadband and mobile communication terminals have been widely used by the general public, and multimedia services such as audio on demand and video on demand including broadcasting service through the Internet network and wireless network A service that is universalized and provides three-dimensional stereoscopic images and sounds is attempted.

As such, the multi-channel sound system, which is getting more and more popular by the general public, requires speakers as many as the number of channels, resulting in installation cost and space problems.

An object of the present invention is to provide a device and a method for implementing a virtual stereophonic sound by using a front array speaker array composed of a plurality of speakers for solving installation problems and space problems occurring in a multi-channel sound system. have.

A method for implementing a stereoscopic sound according to the present invention comprises the steps of: generating a stereophonic sound using an HRTF (Head Related Transfer Function) for an input audio signal and forming an output direction using the sound beam; And outputting an audio signal in the generated stereo sound and output direction.

According to another aspect of the present invention, there is provided an apparatus for implementing a virtual stereophonic sound comprising: a head related transfer function (HRTF) generation module for receiving an audio signal and generating a stereo sound; A sound beam generating module for receiving an audio signal and forming an output direction thereof; And an output controller for controlling the HRTF and the audio signal generated by the sound beam to be outputted to the speaker.

According to the apparatus and method for implementing a virtual stereophonic sound according to the present invention, by implementing a virtual stereophonic sound using a single speaker composed of a plurality of speaker arrays, a plurality of speakers It is possible to solve the problem of the space in which the light-emitting elements are arranged.

In addition, the present invention has an effect that the direction of the audio signal can be adjusted so that the user can hear the optimal sound even if the user changes the listening position.

A method for implementing a stereoscopic sound according to the present invention comprises the steps of: generating a stereophonic sound using an HRTF (Head Related Transfer Function) for an input audio signal and forming an output direction using the sound beam; And outputting an audio signal in the generated stereo sound and output direction.

In the present invention, the generated stereo sound is outputted in the front direction and the input audio signal is outputted in the direction formed through the sound beam.

In the present invention, the generated stereo sound is output in the front direction and the direction formed through the sound beam.

In the present invention, the output direction can be changed by selectively adjusting the delay time for forming the sound beam.

In the present invention, the speaker for outputting the audio signal is a single speaker composed of a plurality of speaker arrays.

In the present invention, the loudspeakers are grouped into one or more different speaker arrays depending on the stereo sound and the output direction.

In the present invention, the grouped speaker array can be selectively changed.

According to another aspect of the present invention, there is provided an apparatus for implementing a virtual stereophonic sound comprising: a head related transfer function (HRTF) generation module for receiving an audio signal and generating a stereo sound; A sound beam generating module for receiving an audio signal and forming an output direction thereof; And an output controller for controlling the HRTF and the audio signal generated by the sound beam to be outputted to the speaker.

In the present invention, the speaker is a single speaker including a plurality of speaker arrays.

In the present invention, the speakers are grouped into a predetermined number and classified into a HRTF output speaker and a sound beam output speaker.

In the present invention, the output controller controls the generated stereophonic sound to be output in the front direction and outputs the input audio signal in a direction formed through the sound beam.

In the present invention, the output controller controls the generated stereo sound to be output in the front direction and the direction formed through the sound beam.

In the present invention, the output control unit controls the display unit to display a menu for selecting a speaker for grouping and the number of speakers and a position of a speaker for outputting an audio signal, and controls an audio signal output according to the selection.

In the present invention, the output controller controls the menu to display a delay time for forming a sound beam, and controls the audio signal output according to the selection.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

1 is a configuration diagram illustrating a virtual stereophonic sounding apparatus according to an embodiment of the present invention.

Referring to FIG. 1, an HRTF generation module 110 for generating a virtual stereo sound using a HRTF (Head Related Transfer Function); A sound beam generating module 120 for forming a sound beam to adjust the direction of sound; And an output controller 130 for controlling the HRTF and the audio signal generated by the sound beam to be output to the speaker array 140.

Here, the HRTF generation module 110 and the sound beam generation module 120 may be composed of a plurality of units, and will be described in detail with reference to FIG. 2 below.

2 is a detailed configuration diagram of a virtual stereophonic sounding apparatus according to an embodiment of the present invention.

Referring to FIG. 2, a plurality of HRTF generation modules 111, 112, 113, and 114 for generating a virtual stereo sound using HRTF; A sound beam front left (SFL) module 121 for generating a front left channel sound beam, a sound beam front right (SFR) module 122 for generating a sound beam for a front right channel, Including a sound beam generation module 120 that includes a sound beam rear left (SRL) module 123 for generating a rear right channel sound signal, and a sound beam rear right (SRR) module 124 for generating a sound beam for a rear right channel .

In more detail, the HRTF generation module 110 positions the sound image of the front channel and the rear channel with respect to the input audio signal, and removes crosstalk between the front channel and the rear channel to generate stereo sound.

Here, the input audio signal is a four-channel audio signal, and the present invention is not limited thereto. For example, the audio signal may be processed for two or more audio channel inputs.

The HRTF is a concept of a path from a sound source to reaching two ears of a human. The sound is propagated from the sound source to the eardrum as a unit impulse response due to the sound propagation path Is defined. In order to easily apply the nested spatial acoustic characteristics to headphones or audio, the values in the time domain are usually used. In HRTF, there is a time difference and level difference information between the channels, It contains information about reflections and diffractions in the head, trunk, ears, etc. in the path from the source of the clue to the eardrum. By using this, a binaural stereophonic sound can be generated by applying HRTF with spatial information corresponding to a desired three-dimensional position to a non-stereoscopic simple sound.

However, when the stereo sound is heard through the stereo speaker, the acoustic signals generated by the left and right speakers are mixed with each other due to interference in the space as they progress to the ears of the listener, so that the two- . As a result, stereoscopic sound recorded or generated in the form of two channels can not feel stereoscopic effect because three-dimensional information is damaged. In this way, among the acoustic signals of each channel at the listening position, the mixed signal added to the original signal is called crosstalk and is generally removed by using a transient filter.

3, the HRTF generation module 110 generates a binaural stereophonic sound to estimate the front channels FL and FR through the front channel sound image localization unit, The crosstalk is removed in a form suitable for a speaker for outputting an audio signal to a signal added to the signal added to the signal.

Likewise, a binaural stereophonic sound is generated to negate the rear channels RL and RR through the rear channel sound image localization unit, and an audio signal is output to the signals added to the original signal through rear channel channel refusal rejection Crosstalk is eliminated in a form suitable for the speaker.

3 and 4, a stereo sound is generated using HRTF for the audio input signals of the front channels FL and FR and the rear channels RL and RR of the four channels, And outputs them by matching 1: 1 to each of four grouped speakers. That is, the audio signal in which the first virtual stereophony is generated outputs the FL, FR, RL, and RR audio signals from the respective speakers of H1.

When the input audio signal is applied to the speaker, the sound beam generation module 120 adjusts the direction of the sound by delaying the audio signal to implement stereo sound.

More specifically, as shown in FIG. 5, the plurality of sound beam generating modules 120 apply a same time delay amount to a plurality of sound sources, that is, groups of eight speakers, Let the sound propagate.

For example, FIG. 6 shows an example of forming a sound beam through a speaker array in which a plurality of speakers are arranged in a line.

Referring to FIG. 6, when eight speakers labeled 0 to 7 generate the same sound and delay the signal applied to each speaker by using a constant delay amount d1 to d7, The direction of the audio signal to which the beam is formed and is output is changed.

That is, the sound image of the front channel and the rear channel is positioned with respect to the audio signal input by using the HRTF generation module 110, and again, the crosstalk between the front channel and the rear channel is removed to generate stereo sound, 120 to change the direction of the output audio signal.

For example, if the input audio signal is a representative 5.1-channel audio signal of a multi-channel audio source, a front left channel, a front right channel, a rear left channel, And a sound beam is formed in a direction toward the left and right corners of the wall surrounding the user and in the direction of the left and right walls or the reflection surface of the user, And the reflected sound is output to the position where the user is located, so that the user can hear stereoscopic sounds similar to those projected from a speaker located at the listening position.

In addition, the present invention is not limited to the four-channel audio signal, and it is possible to generate a stereo sound and a sound beam using HRTF for two or more audio channel inputs.

The output control unit 130 controls the audio signals generated by the HRTF generation module 110 and the sound beam generation module 120 to be outputted from the speakers.

7A shows one speaker composed of a plurality of speaker arrays. FIG. 7B shows a speaker array for outputting audio signals generated by the HRTF generation module 110 and the sound beam generation module 120. FIG. Fig.

7B, the output controller 130 may control to output the HRTF-generated audio signals to a predetermined number of speakers, i.e., four grouped speakers.

Here, the audio signals for RL, FL, FR and RR outputted in FIG. 3 are outputted to the four grouped speakers in a one-to-one correspondence and outputted, or RL, FL, FR and RR The audio signal for the RL is output to the grouped H1, and the audio signals for the FL, H3, and H4 are output to the H2, H2, and H4, respectively.

Also, the output controller 130 controls the audio signals input from a predetermined number of speakers, that is, groups of eight, to be output in the SFL, SFR, SRL, and SRR directions.

Here, the number of speakers arranged in the one speaker can be changed, and the position of a speaker outputting front or rear signals and the number of grouped speakers can be changed.

That is, the output controller 130 outputs the stereo sound in the front direction, controls the input audio signal to be outputted in a direction formed through the sound beam, or controls the generated stereo sound in the front direction and the direction formed through the sound beam As shown in FIG.

Also, the output controller 130 controls the number of speakers for grouping and the speaker position for outputting an audio signal to be changed.

For example, when a menu such as a remote controller is input, a speaker for displaying and grouping the OSD on a display unit or the like connected to the front unit of the speaker or a speaker connected thereto, and a speaker for outputting an audio signal Control the position to be selected

Also, the output controller 130 controls the delay time for forming the sound beam, that is, theta angle, so that the output direction of the audio signal can be selected.

For example, when a sound beam changing menu is input by a remote controller or the like, the direction and angle value of the sound beam output are displayed by the OSD so that they can be selected.

This allows the user to select the output direction of the audio signal so that he / she can hear the best stereo sound even if he / she moves the listening position.

Here, the selected grouped speakers and the number of the speakers, the position of the speaker for outputting the audio signal, the theta angle, and the like can be stored.

Therefore, the present invention solves a space problem in which a plurality of loudspeakers are arranged at various positions and installation costs generated in a multi-channel sound system by arranging only one speaker composed of a plurality of speaker arrays to realize a virtual stereo sound There is an effect that can be.

8 is a flowchart illustrating a method for implementing a virtual stereo sound according to an embodiment of the present invention.

Referring to FIG. 8, an HRTF is generated for an input audio signal and a sound beam is generated (S710).

For example, the sound image of the front channel and the rear channel is positioned on the audio signal input using the HRTF generation module 110, and the crosstalk between the front channel and the rear channel is removed to generate stereo sound.

Here, if the input audio signal is a representative 5.1 channel of a multi-channel audio source, a front left (FL) channel, a front right channel (FR), a rear left channel (RL) ) Channel and a rear right channel (RR: Rear Right channel) as inputs, and outputs stereo sound using the HRTF to the front direction. The four input audio channels are output in the direction of the sound beam So that the reflections are output to the location where the user is located.

In addition, the present invention is not limited to the four-channel audio signal, and it is possible to generate a stereo sound and a sound beam using HRTF for two or more audio channel inputs.

For example, in the case of two channels, the stereo sound generated using the HRTF is output in the front direction and the direction formed through the sound beam.

Thereafter, the HRTF and the speaker for outputting the audio signal generated by the sound beam are selected (S720).

For example, FIG. 9 is a view showing a progress direction of a virtual stereo sound according to an embodiment of the present invention.

9, stereophonics generated through the HRTF generation module 110 are output in the front direction, and sounds formed through the sound beam generation module 120 surround the user such as SFL, SFR, SRL, SRR In the direction toward the right and left corners of the wall and on the left and right walls of the user or in the direction toward the appropriate area of the reflection surface and the reflection sound is outputted to the position where the user is located, You can hear a stereo sound.

In addition, an audio signal can be output by changing the number of speakers and the position of a speaker for outputting an audio signal according to a user's input command.

For example, when a change menu is input through a remote controller or the like, a display unit displayed on a part of a speaker array or a display unit to which a speaker is connected is used to display and group the OSD and the number of speakers, Make choices

In addition, it is possible to change the output direction of the audio signal by adjusting the delay time, that is, theta angle, to form a sound beam according to a user's input command.

For example, when a sound beam changing menu is input by a remote controller or the like, the direction and angle value of the sound beam output are displayed by the OSD so that they can be selected.

This allows the user to select the output direction of the audio signal so that he / she can hear the best stereo sound even if he / she moves the listening position.

Here, the selected grouped speakers and the number of the speakers, the position of the speaker for outputting the audio signal, the theta angle, and the like can be stored.

Thereafter, the HRTF and the audio signal generated by the sound beam are output to the speaker (S730). If the selection step of the speaker is not performed, an audio signal may be output to the speaker that is stored by default, or an audio signal may be output to the speaker that is stored by the user.

For example, the speaker array is divided into a speaker for outputting a stereo sound generated by HRTF and a speaker for outputting an audio signal formed of a sound beam, and outputs an audio signal.

More specifically, as shown in FIG. 6B, audio signals for RL, FL, FR, and RR outputted in FIG. 3 are outputted to each speaker grouped by four in a plurality of speaker arrays, or RL , FL, FR, and RR, that is, the RL audio signal is output to the grouped H1, the audio signal for FL, H3 for FR, and H4 for RR are output.

In addition, eight speakers are grouped, and audio signals for SFL, SFR, SRL, and SRR are output in the form of sound beams from the grouped speakers.

As described above, the present invention realizes virtual stereophonic sound using one speaker composed of a plurality of speaker arrays, thereby solving the installation cost incurred in the multi-channel sound system and the space problem of arranging a plurality of speakers at various positions There is an effect that can be.

In addition, the present invention has an effect that the direction of the audio signal can be adjusted so that the user can hear the optimal sound even if the user changes the listening position.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood that various modifications and applications not illustrated in the drawings are possible. For example, each component specifically shown in the embodiments of the present invention can be modified and implemented. It is to be understood that all changes and modifications that come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein.

BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a configuration diagram of a virtual stereophonic sounding device according to an embodiment of the present invention; Fig.

2 is a detailed configuration diagram of a virtual stereophonic sounding apparatus according to an embodiment of the present invention;

3 is a block diagram illustrating an HRTF generation module according to an embodiment of the present invention.

4 is a diagram illustrating speaker output through an HRTF generation module according to an embodiment of the present invention.

5 is a diagram illustrating a speaker output through a sound beam generating module according to an embodiment of the present invention.

FIG. 6 illustrates sound beam formation using a plurality of speakers according to an embodiment of the present invention. FIG.

FIG. 7 illustrates a virtual stereo sounding speaker constructed of a plurality of speaker arrays according to an embodiment of the present invention; FIG.

8 is a flow chart illustrating a method for implementing a virtual stereo sound according to an embodiment of the present invention.

9 is a view showing the progress direction of virtual stereophonic sound according to the embodiment of the present invention.

Claims (14)

Generating a stereophonic sound using an HRTF (Head Related Transfer Function) for an input audio signal and forming an output direction using the sound beam; Outputting an audio signal in the generated stereo sound and output direction; Displaying an OSD indicating a number of speakers outputting the audio signal, a position of a speaker outputting the audio signal, and an output direction of the audio signal; Receiving a user's input command for selecting at least one of a number of speakers outputting the audio signal, a position of a speaker outputting the audio signal, and an output direction of the audio signal; And Changing at least one of a number of speakers outputting the audio signal, a position of a speaker outputting the audio signal, and an output direction of the audio signal based on the user input command, Implementation method. The method according to claim 1, And outputting the generated stereo sound in a front direction and outputting the inputted audio signal in a direction formed through a sound beam. The method according to claim 1, And outputting the generated stereo sound in a front direction and a direction formed through a sound beam. delete The method according to claim 1, Wherein the speaker outputting the audio signal is one speaker composed of a plurality of speaker arrays. 6. The method of claim 5, Wherein the loudspeakers are grouped into one or more different speaker arrays depending on the stereo sound and the output direction. The method according to claim 6, Wherein the grouped speaker array is selectively capable of changing the grouped speaker array. A HRTF (Head Related Transfer Function) generation module for receiving an audio signal and generating a stereo sound; A sound beam generating module for receiving an audio signal and forming an output direction thereof; An OSD indicating a number of speakers outputting the audio signal, a position of a speaker outputting the audio signal, and an output direction of the audio signal are controlled so that the audio signal generated by the HRTF and the sound beam is output to the speaker And receives a user's input command for selecting at least one of a number of speakers outputting the audio signal, a position of a speaker outputting the audio signal, and an output direction of the audio signal, And an output controller for changing at least one of a number of speakers outputting the audio signal, a position of a speaker outputting the audio signal, and an output direction of the audio signal. 9. The method of claim 8, Wherein the speaker is a single speaker including a plurality of speaker arrays. 9. The method of claim 8, Wherein the speakers are grouped into a predetermined number and divided into HRTF output speakers and sound beam output speakers. 9. The method of claim 8, Wherein the output controller controls the generated stereophonic sound to be output in the front direction and outputs the input audio signal in a direction formed through the sound beam. 9. The method of claim 8, Wherein the output controller controls the generated stereophonic sound to be output in a front direction and a direction formed through a sound beam. delete delete

Images