KR20180018464A - 3d moving image playing method, 3d sound reproducing method, 3d moving image playing system and 3d sound reproducing system - Google Patents

Abstract

A stereoscopic image playing method according to one embodiment of the present invention comprises: an extraction step which extracts audio signals and 3D location information of an object from a stereoscopic image file; a determination step which determines a transmitting function corresponding to the 3D location information; a generation step which uses the transmitting function to generate a sound source signal which sounds as if a voice by the audio signals occurs in a place corresponding to the 3D location information; and a playing step which is synchronized with video signals of the stereoscopic image file to play the sound source signal. The video signal is a 3D image signal on a 3D space, and the 3D location information contains a space coordinate of the object contained in the 3D image signal on the 3D space. The sound source signal makes a sound pressure level in a location (hereafter, refers to ″acoustic focusing point″) corresponding to the space coordinate of the object contained in the 3D image signal on the 3D space be higher than a sound pressure level in an area except the acoustic focusing point. The acoustic focusing point is selected by a user. The acoustic focusing point is selected by the user, considering at least any one among the number of acoustically bright points, the controlling of locations of each point, and the controlling of strength of each point. The purpose of the present invention is to provide the stereoscopic image playing method, a stereoscopic voice playing method, a stereoscopic image playing system, and a stereoscopic voice playing system which randomly control a voice generating location in an audio and video space to be able to realistically play voices.

Description

TECHNICAL FIELD [0001] The present invention relates to a stereoscopic image reproducing method, a stereoscopic image reproducing method, a stereoscopic image reproducing system, and a stereo sound reproducing system,

The present invention relates to a stereoscopic image reproducing method, a sound reproducing method, a stereoscopic image reproducing system, and a stereoscopic image reproducing method capable of reproducing a moving image while controlling a sound generating position so that an audio signal included in a moving image file of a stereoscopic image, a hologram, To an acoustic reproduction system.

[0002] Acoustic control techniques using multiple sound sources have been developed to improve acoustic characteristics at several points, but recently, they have been developed to improve the acoustic characteristics of a specific space where the listener is located.

There are two main types of sound control using multiple sound sources: active noise control to reduce the sound volume of the space using multiple active sources (eg, sound sources), and the other one By varying the spacing between sound sources arranged in a particular shape [R. C. Jones, 'On the theory of directional patterns of continuous source distributions on a plane surface', J. Acoust. Soc. Am. 16 (3), 147-171 (1945)], control for increasing the acoustic power radiated at a specific angle by varying the time delay and magnitude between respective sound sources [R. L. Prichard, 'Maximum directivity index of a linear point array,' J. Acoust. Soc. Am. 26, 1034-1039 (1954)). This control has been studied mainly for active sonar, typically Dolph [C. L. Dolph, 'A current distribution for broadside arrays which optimizes the relationship between beamwidth and sidelobe level,' Proc. As proposed by IRE 34 (6), 335-348 (1946), a side lobe of a certain size is generated so as not to be influenced by components other than acoustic power radiated into a specific directional angle from a sound source, (Mathematical solution) which has a weight function of a sound source array. However, it has been difficult to apply a mathematical solution to this specific sound source array to any sound source, so an optimization study that assumes an arbitrary sound source array and has a maximum direction in a specific direction has been proposed by Streit [Roy L. Streit, discrete array of arbitrary geometry, 'J. Acost. Soc. Am. 69 (1), 199-212 (1981). However, this research also assumes that only the sound source arrangement is arbitrary, and it is not suitable to be applied to a general listening space having various types of sound source radiation and reflection and sound absorption.

Unlike the study of optimizing the radiation pattern, the technique of controlling the sound pressure level for the space in which the listener is located is called active noise control [P. Lueg 1936 Process of silencing sound oscillations. U.S. Pat. 2,043,416.

The active noise control method is a method to actively control the noise by using the secondary sound source, the acoustic position energy or the sound power formed by the background noise source, and to acquire the quietness with respect to the listener in the low frequency band or the whole space to be. In this case, the space where the noise is successfully controlled and the quietness is acquired is called a quiet zone.

And, U.S. Patent No. 5,802,190 (Linear speaker array) discloses a technique for controlling indirect characteristics such as directionality using limited assumptions such as ignoring distances or reflections to a listener. Also, U.S. Patent No. 5,910,990 (Apparatus and method for automatic equalization of personal multi-channel audio system) discloses a method for reproducing a signal without distortion using a transfer function.

In this way, the conventional sound control method of a space using a plurality of sound sources merely changes the time delay between the sound sources and the input size thereof, and only the directionality of the sound source is changed using the limited sound source arrangement, There was no consideration of the location of the listener or the space where the listener could be located. In addition, the conventional method has a problem that the characteristics of the listening space, such as reflection and sound absorption, can not be taken into consideration, considering only the free space.

On the other hand, various products have emerged along with the development of technologies for stereoscopic images and virtual reality, but the development of technologies capable of realizing video and sound close to real life is still insufficient.

U.S. Pat. No. 2,043,416 U.S. Patent No. 5,802,190 U.S. Patent No. 5,910,990

R. C. Jones, 'On the theory of directional patterns of continuous source distributions on a plane surface', J. Acoust. Soc. 16 (3), 147-171 (1945). R. L. Prichard, 'Maximum directivity index of a linear point array,' J. Acoust. Soc. Am. 26, 1034-1039 (1954). C. L. Dolph, 'A current distribution for broadside arrays which optimizes the relationship between beamwidth and sidelobe level,' Proc. IRE 34 (6), 335-348 (1946). Roy L. Streit, 'Optimization of Discrete Arrays of Arbitrary Geometry,' J. Opt. Acost. Soc. Am. 69 (1), 199-212 (1981).

SUMMARY OF THE INVENTION It is an object of the present invention to provide a stereoscopic image reproducing method, a stereoscopic sound reproducing method, a stereoscopic image reproducing method, and a stereoscopic image reproducing method capable of real- A stereoscopic image reproducing system and a stereo sound reproducing system.

According to an aspect of the present invention, there is provided a stereoscopic image reproducing method including an extracting step of extracting three-dimensional position information of an audio signal and an object from a stereoscopic image file, determining a transfer function corresponding to the three- A generating step of generating a sound source signal by using the transfer function to sound as if the sound by the audio signal occurs at a position corresponding to the three-dimensional position information; Wherein the video signal is a three-dimensional image signal on a 3D space, the three-dimensional position information includes spatial coordinates of the object included in the three-dimensional image signal on the 3D space, , And the sound source signal is a sound signal of the object included in the 3D image signal on the 3D space The sound pressure level at a position corresponding to a coordinate (hereinafter, referred to as 'sound concentration point') is higher than a sound pressure level in a region other than the sound concentration point, and the sound concentration point is selected by the user, The acoustic focus point is selected in consideration of at least one of the number of acoustically bright points, the position of each point, and the intensity of each point when the user selects the acoustic focus point.

The stereoscopic image reproducing method may further include a storing step of calculating and storing a transfer function corresponding to each sound concentration point in the listening area, and the determining step may include: determining a transfer function corresponding to the sound concentration point, As a transfer function for generating the sound source signal.

The video signal includes a left eye image signal and a right eye image signal, and the three-dimensional position information may include spatial coordinates of an object included in the stereoscopic image implemented by the left eye image signal and the right eye image signal.

According to another aspect of the present invention, there is provided a stereoscopic image reproducing system for extracting three-dimensional position information of an audio signal and an object from a stereoscopic image file, reading a transfer function corresponding to the three- A signal analyzing and generating unit for generating a sound source signal that sounds as if the sound by the audio signal occurs at a position corresponding to the three-dimensional position information, an amplifier unit for dividing and amplifying the sound source signal into multiple channels, And a speaker unit for synchronizing the sound source signal delivered from the stereoscopic image file with a video signal of the stereoscopic image file, wherein the video signal is a 3D image signal in 3D space, And the spatial coordinates of the object included in the video signal, The sound pressure level at a position corresponding to the spatial coordinates of the object included in the three-dimensional image signal on the three-dimensional image signal (hereinafter, referred to as 'sound concentration point') is higher than the sound pressure level in the area other than the sound concentration point, Wherein the acoustic concentration point is selected by a user and controls at least one of the number of acoustic bright points, the position of each point, and the intensity of each point when the acoustic concentration point is selected by the user May be selected by considering.

The video signal includes a left eye image signal and a right eye image signal, and the three-dimensional position information may include spatial coordinates of an object included in the stereoscopic image implemented by the left eye image signal and the right eye image signal.

The speaker unit may include a plurality of speakers formed of M X N (M, N is a natural number) array.

According to the stereoscopic image reproducing method, the sound reproducing method, the stereoscopic image reproducing system, and the sound reproducing system according to the present invention, stereo sound can be implemented so that sound sources are generated at controlled sound generating positions, It becomes possible. In addition, since it is possible to give the impression that the sound is generated directly from the object to be visually sensed, more realistic stereoscopic image viewing becomes possible. Further, the sound generating position can be easily controlled by a user operation.

1 is a schematic diagram for explaining the theoretical content related to the present invention.
FIG. 2 is a block diagram of a sound reproducing apparatus in which the above-described theoretical background is implemented.
3 is a flowchart showing a process of controlling the sound generation position in the listening space.
4 is a schematic view showing a stereo sound reproducing system according to the present invention.
5 is a configuration diagram of a stereoscopic image reproducing system according to an embodiment of the present invention.
6 is a flowchart of a stereoscopic image reproducing method according to an embodiment of the present invention.
7 is a block diagram of a stereo sound reproducing system according to an embodiment of the present invention.
8 is a flowchart of a stereophonic sound reproducing method according to an embodiment of the present invention.
9 is a block diagram of a stereo sound reproducing system according to another embodiment of the present invention.
10A to 10D are conceptual diagrams illustrating a user input unit of a stereophonic sound reproducing method according to another embodiment of the present invention.
11 is a flowchart of a stereophonic sound reproducing method according to another embodiment of the present invention.

The present invention will now be described in detail with reference to the accompanying drawings, which show specific embodiments in which the present invention may be practiced. For a specific embodiment shown in the accompanying drawings, those skilled in the art will be described in detail so as to be sufficient for practicing the present invention. Other embodiments than the particular embodiment need not be mutually exclusive but different from each other. It is to be understood that the following detailed description is not to be taken in a limiting sense.

The detailed description of the specific embodiments shown in the accompanying drawings is read in conjunction with the accompanying drawings, and the drawings are considered as a part of the description of the entire invention. The mention of direction or orientation is for convenience of description only and is not intended to limit the scope of the invention in any way.

First, the theoretical background related to the present invention will be described in detail.

1 is a schematic diagram for explaining the theoretical content related to the present invention. 1 schematically shows a listening space (a) in which a first speaker and a second speaker serving as sound sources are provided. The listening space a is a space where the listener (user) is located, and the listener position b is a place where the listener is currently located in the listening space a. 1 shows a case in which one acoustic bright point is shown. However, even when there are a plurality of acoustic bright points, a plurality of acoustic bright points may be displayed in the listening space (a).

1. Determination of the input signal for one acoustically bright point

은 다음의 수학식 1과 같이 표현할 수 있다.(Acoustic bright point or acoustic focus point c) in the listening space a, which is made by the first to n-th sound sources when there is a first to an n-th sound source in the listening space (a) Sound pressure in

Can be expressed by the following equation (1).

은 공간상의 지점이고,

는 i번째 음원의 위치를 의미한다. 그리고

는

과

사이의 관계를 표현해주는 전달함수이다. 여기서 전달함수는 수학적인 모델로 정의하거나 실제 측정을 통해서 쉽게 얻을 수 있다. 공간상의 지점

에 대한 제1 내지 제n 음원 사이의 전달함수는 수학식 2와 같이 행렬로 표현할 수 있다.here,

Is a point in space,

Is the position of the i-th sound source. And

The

and

Is a transfer function that expresses the relationship between. Here, the transfer function can be defined as a mathematical model or easily obtained through actual measurement. Point in space

The transfer function between the first to n-th sound sources can be represented by a matrix as shown in Equation (2).

에 대한 공간상관행렬(Spatial Correlation matrix)

는 다음과 같이 정의된다.Point in space

(Spatial Correlation Matrix)

Is defined as follows.

에서의 음향 포텐셜 에너지 밀도

는 공간상관행렬과 입력해의 내적(innerproduct)을 사용하여 나타낼 수 있으며 수학식 4와 같다.One point

The acoustic potential energy density

Can be expressed using the spatial correlation matrix and the innerproduct of the input solution.

의 음향 포텐셜 에너지 밀도를 최대화하는 입력해 벡터

를 구할 수 있고, 이를 음향밝기제어라 부른다. 한 지점

에 대해서 음향밝기제어를 수행하면 N개의 음원을 제어하는 입력해 벡터

는 수학식 5과 같다.For a given input power,

The input acoustic vector maximizing the acoustic potential energy density of

And this is called an acoustic brightness control. One point

The sound intensity control for the input sound vector

Is expressed by Equation (5).

는 수학식 2에서 정의된 벡터

의 크기로 수학식 6와 같이 계산된다.here,

Is a vector defined in equation (2)

As shown in Equation (6).

를 통해 각 음원을 통해 나가는 오디오 신호의 크기와 위상차를 계산할 수 있다. i번째 스피커에 입력되는 오디오 신호의 크기

는 수학식 7과 같다.The vector of equation (5)

The size and phase difference of the audio signal output through each sound source can be calculated. The size of the audio signal input to the i-th speaker

Is expressed by Equation (7).

의 복소수 편각을 통해 구할 수 있다.The phase difference of the audio signal input to the i-th speaker is

Can be obtained through complex declination of.

2. Determination of the input signal for several acoustically bright points

이라 하면, 각 지점에 대한 음향밝기제어 해는 수학식 8과 같다.When the number of points used by the user to control the sound field is two or more, it can be controlled in the following manner. M points in space

, The acoustic brightness control solution for each point is expressed by Equation (8).

An input solution for several points can be defined by equation (9).

를 N개의 음원의 제어 입력 해로 사용한다. 여기서

는 수학식 4에서 정의한 바 있다.

는 i번째 점의 세기를 조절하는 상수이고 0과 1 사이의 실수값을 가진다.

값을 0으로 설정하는 경우, i번째 점의 세기를 0으로 하여 해당 점을 사용하지 않는 것을 뜻하며, 이 값을 1로 설정하는 경우, 음향 밝기 제어에 의해 집중되는 밝기를 100% 사용하는 것을 뜻한다.If the number of control points increases, the size of the input solution may continue to increase. Therefore,

Is used as the control input solution of N sound sources. here

Is defined in Equation (4).

Is a constant that controls the intensity of the i-th point and has a real value between 0 and 1.

When the value is set to 0, the intensity of the i-th point is set to 0 and the corresponding point is not used. If this value is set to 1, 100% of the brightness concentrated by the acoustic brightness control is used do.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

FIG. 2 is a block diagram of a sound reproducing apparatus in which the above-described theoretical background is implemented. The sound reproducing apparatus shown in FIG. 2 includes a sound source reproducing unit 100, a signal analyzing and generating unit 200, and a user controller 300.

The sound source reproducing unit 100 includes a speaker unit 110 corresponding to a plurality of sound sources and an amplifier unit 120 capable of driving the plurality of speakers 110. Here, the speaker unit 110 includes a plurality of speakers of M × N (M, N is a natural number) array, and the amplifier unit 120 may be a multi-channel audio amplifier.

The signal analysis and generation unit 200 includes a playback device 210 capable of receiving digital data such as a CD or an MP3 having an input audio signal, an audio signal from the playback device 210, A signal analyzer 220 for receiving a control signal q from the signal analyzer 220 and a signal analyzer 220 for receiving the control signal q from the signal analyzer 220, And a multi-channel signal generator 230 for providing a sound source signal. The signal analyzer 220 determines a sound source signal that sounds as if the sound is reproduced at a specific position in the listening space, that is, the sound concentration point, and transmits the multi-channel signal And an analyzer 221. Specifically, in determining the sound source signal, a sound source signal is determined such that the sound pressure level at the sound concentration point is higher than the sound pressure level in a region other than the sound concentration point. More specifically, a sound source signal is determined such that the ratio of the acoustic potential energy density at the acoustic concentration point to the sum of the energy of the individual sound source signal becomes the maximum.

The user controller 300 includes an input unit 310 for inputting the number, position, and intensity of acoustically bright points from the user, a transceiver 320 for transmitting and receiving data to and from the signal analysis and generating unit 200, And a display unit 330 for confirming the current control state.

Therefore, according to such an audio reproducing apparatus, it is possible to make it sound as if the sound is reproduced at a specific position in the listening space, so that it is possible to make the listener feel as if the sound is reproduced at a desired position, Can be provided.

FIG. 3 is a flowchart showing a process of generating a specific position at which sound is reproduced in a listening space.

The signal analyzing unit 220 of the signal analyzing and generating unit 200 inputs the sound intensity to the speaker unit 110 through the input unit 310 of the user controller 300, A transfer function between the sound source signal and the sound signal output from the sound concentration point is calculated (step S1).

Next, the signal analyzing unit 220 of the signal analyzing and generating unit 200 determines a sound source signal that sounds as if the sound is reproduced at the sound concentration point using the transfer function measured at step S1, To the multi-channel signal generator 230 (step S2). Specifically, in determining the sound source signal, a sound source signal is determined such that the sound pressure level at the sound concentration point is higher than the sound pressure level in a region other than the sound concentration point. More specifically, a sound source signal is determined such that the ratio of the acoustic potential energy density at the acoustic concentration point to the sum of the energy of the individual sound source signal becomes the maximum. Here, although a single frequency is described, it is understood that when the frequency is composed of a plurality of frequencies, the sound source signal for each frequency is determined. Further, the sound source signal determined here functions as a filtering coefficient for filtering the original sound signal (any sound to be sounded as if it is reproduced at a specific position in the listening space) in step S3 described later.

Next, in the multi-channel signal generator 300 of the signal analyzing and generating unit 200, the original sound signal is filtered based on the information received from the signal analyzing unit 220 using the sound source signal determined in step S2, Generates a sound source signal (filtered sound source signal) optimized for generating a specific position at which the sound is reproduced, that is, a control sound source signal, and transmits it to the sound source playback unit 100 (step S3). Here, although a single frequency is described, when the frequency is composed of a plurality of frequencies, the original sound signal is filtered with the determined sound source signal at each frequency, and the sound source signal for the optimized one, that is, the control sound source signal is generated You can do it.

Next, the sound source playback unit 100 transmits the optimized sound source signal, that is, the control sound source signal, from the multi-channel signal generator 300 of the signal analysis and generation unit 200 to the amplifier unit 120 and the speaker unit 110 (Step S4), so that a specific position in which the sound is reproduced is generated in the listening space (step S5).

The sound reproducing apparatus of this embodiment takes into consideration the case where variable variables such as the size of the listening space, the position where a plurality of speaker units 110 are installed in the listening space, and the position of a listener can be arbitrarily determined . Therefore, in this case, since the transfer function is changed each time the variables are changed, the signal analysis unit 220 is included for calculation of the transfer function.

On the other hand, when the user controls the sound field in the listening space, the following three adjustments are possible. That is, (i) a function to set the number of acoustically bright points, (ii) a function to control the position of each point, and (iii) a function to control the intensity of each point. The set points have respective numbers, and transmit the position and intensity of corresponding numbers to the signal analysis and generation unit 200. At this time, an input solution of N channels is determined according to the solution obtained previously.

First, in the case of using one acoustic concentration point, the listener may feel that sound occurs at the point where the acoustic concentration point is located. By adjusting the intensity of the acoustic focus point, the listener is aware of the change in the sense of distance of the sound being heard. For example, if you decrease the intensity of the acoustic focus, you will notice that the direction of the sound does not change, but the sound is heard farther away. When the location of the acoustic focus point is located near the listener's ears, the listener can feel the presence feeling by listening to the sound concentrated on him / her.

Second, in the case of using multiple acoustic focus points, the listener may feel that sound occurs at two or more points where acoustic focus points are located, since there are two or more specific positions where the sound sounds as if it were reproduced. Furthermore, it is possible to distinguish the case where different sound sources are used for each sound concentration point and the case where one sound source (same sound source) is used for each sound concentration point.

First, when using different sound sources for each sound concentration point, it can be perceived that sound is generated in different directions in which the sound concentration points are located, because it sounds as if different sounds are reproduced at two or more specific positions . For example, if you concentrate one sound concentration point in front of the listener and use the sound source of violin sound and concentrate the other sound concentration points in the back of the listener to use the sound source of piano sound, the listener can hear the sound of the violinist and the piano player And you can feel the sense of presence listening to music. This holds true for a large number of points.

In addition, when one sound source is used for each sound concentration point, a different spatial feeling can be felt depending on the combination of sound concentration points. In other words, by adjusting the position of the sound concentration points, it is possible to increase the size difference and the phase difference of the sound output from each speaker. For example, since it sounds as if different sounds are reproduced at two or more specific positions , And a long sounding reverberation time (wet sound) in a wide concert hall. Conversely, a dry sound with short reverberation time can be created. That is, the listener can feel that he / she is located in a completely different space regardless of the space actually occupied by the listener.

4 is a schematic view showing a stereo sound reproducing system according to the present invention. 4, the stereophonic sound reproducing system according to the present invention includes a speaker unit 110 formed of an array of M × N (M, N is a natural number) array, and a sound source signal The sound generating positions C ₁ and C ₂ (corresponding to the above-mentioned 'acoustic concentration points') can be adjusted as the sound generating positions C ₁ and C ₂ are reproduced through the speaker unit 110. Here, the sound generating positions C ₁ and C ₂ can be represented by spatial coordinates of the x, y, and z axes, and the listener b can display the audio signals reproduced through the speaker unit 110 It is heard. At this time, the sound generating positions C ₁ and C ₂ are located in the listening space a, and the listening space a is a space occupied by the speaker unit 110 and a space between the speaker unit 110 and the listener b Can be defined by distance.

5 is a configuration diagram of a stereoscopic image reproducing system according to an embodiment of the present invention. The stereoscopic image reproducing system according to the present invention includes a speaker 110, an amplifier 120, a screen 130, a signal analyzing and generating unit 200, and a storage unit 300.

The stereoscopic image file 10 may include an audio signal 12 and a video signal 13. The video signal 13 of the stereoscopic image file 10 may be composed of a left eye image signal and a right eye image signal. The spatial coordinates (object position information) of the object included in the stereoscopic image implemented by the left eye image signal and the right eye image signal can be used as position information for generating a sound source signal. Alternatively, the video signal 13 of the stereoscopic image file 10 may be a hologram image signal, and spatial coordinates (object position information) of an object included in the hologram image may be used as position information for generating a sound source signal .

The signal analysis and generation unit 200 extracts object position information from the stereoscopic image file 10 to generate a sound source signal. The sound source signal is generated by a transfer function corresponding to specific position information as described above, and the transfer function corresponding to each sound generating position in the listening area (a) may be stored in the storage unit 300 in advance. The signal analysis and generation unit 200 generates a sound source signal based on the three-dimensional space coordinates included in the object position information, and transmits the sound source signal to the amplifier unit 120.

The amplifier unit 120 demultiplexes the sound source signal into a plurality of channels, amplifies the sound signal, and transmits the amplified sound signal to the speaker unit 110. The speaker unit 110, which is composed of the M × N array, reproduces the sound source signal transmitted from the amplifier unit 120 do. At this time, the sound source signal reproduced through the speaker unit 110 should be synchronized with the video signal 13 reproduced through the screen unit 130.

According to the stereoscopic image reproducing system of the present invention, an audio signal 12 (for example, a metabolism of a main character) corresponding to an object (for example, a main character) included in a stereoscopic image is generated So that a more realistic stereoscopic image can be viewed.

6 is a flowchart of a stereoscopic image reproducing method according to the present invention. First, the 3D position information of the audio signal and the object is extracted from the stereoscopic image file (S500). The three-dimensional position information 12 of the object may include the spatial coordinates of the object included in the stereoscopic image.

The signal analysis and generation unit 200 determines a transfer function corresponding to the three-dimensional position information (S510). At this time, the transfer function corresponding to each sound generating position in the listening area (a) can be calculated and stored in advance by the method described above.

Thereafter, a sound source signal is generated (S510) to make it sound as if an audio signal is generated at a position corresponding to the three-dimensional position information using the transfer function (S530), and the sound source signal is synchronized with the video signal of the stereoscopic image file at operation S530.

According to the stereoscopic image reproducing method of the present invention, audio signals corresponding to the objects included in the stereoscopic image are displayed as if they occur at the location of the corresponding object, thereby enabling more realistic stereoscopic image viewing.

FIG. 7 is a configuration diagram of a stereo sound reproducing system according to an embodiment of the present invention, and FIG. 8 is a flowchart of a stereo sound reproducing method according to an embodiment of the present invention. 7, a stereophonic sound reproducing system according to an embodiment of the present invention includes a speaker unit 110, an amplifier unit 120, a signal analysis and generation unit 200, and a storage unit 300 .

The moving picture file 20 includes the audio signal 21 and the position information of the moving object 20 (object position information 22), and the stereo sound reproducing method first extracts the audio signal 21 from the moving picture file 20, Information 22 is extracted (S600).

Thereafter, the signal analysis and generation unit 200 determines a transfer function corresponding to the object position (S610). At this time, the transfer function corresponding to each sound generating position in the listening area may be stored in the storage unit 300 in advance. The signal analysis and generation unit 200 reads the transfer function corresponding to the object position information 22 extracted from the moving image file 20 from the storage unit 300.

When the transfer function is determined, a sound source signal is generated so that sound is generated by the audio signal 21 at a position corresponding to the object position information (S620).

The sound source signal is separated and amplified into a plurality of channels by the amplifier unit 120 and then transmitted to the speaker unit 110 and reproduced through the speaker unit 110 composed of M × N (M, N is a natural number) array. , Sound caused by the audio signal 21 sounds as if it occurs at a position corresponding to the object position information 22.

9 is a block diagram of a stereo sound reproducing system according to another embodiment of the present invention. 9, the spatial position information 32 corresponding to the object position information 22 is input through the user controller 400, unlike the embodiment of FIG. That is, the signal analysis and generation unit 200 generates a sound source signal that sounds as if the sound of the audio signal 31 is generated at a position corresponding to the spatial position information 32 input from the user controller 400. The user controller 400 for receiving the spatial position information 32 includes a display unit (not shown) and an input unit (not shown) for facilitating user input.

10A to 10D show an image displayed on the display unit (not shown) in which the user controller 400 is implemented with a touch screen. Of course, other embodiments may be implemented with input means other than a touch screen.

In the touch screen, the listening space (a), the listener position (b), and the sound generating position (c) are displayed. The user can set the sound generating position c through an operation such as touch within the listening space a displayed on the touch screen.

10A can be displayed on the touch screen, and the sound generating position c is displayed by the user's touch. The listening space (a) is displayed as a closed space with a closed curve, which can be displayed so as to distinguish colors from the external space.

The user can set a plurality of sound generating positions c as shown in Figs. 10B and 10C. Although Fig. 10B and Fig. 10C illustrate the setting of three acoustic generating positions c, it is also possible to set the number of acoustic generating positions c to be less or larger than this. The number of positions at which sounds due to the audio signal appear to be generated can be determined according to the set number of sound generating positions c. On the other hand, the user can change the sound generating position c through a manipulation such as dragging on the touch screen.

10D, the user may touch the sound generating position c on the touch screen or press the sound generating position c for a predetermined time to change the intensity of the sound reproduced at the corresponding position.

When the user first sets the sound generating position c, the intensity of the sound reproduced at the position is set as the reference value. For example, the reference value may be a sound level of " level 1 ". Then, when the user touches the corresponding sound generating position (c), the level 2, 3 ... The intensity can be increased. Conversely, when the intensity of the sound is to be reduced, the acoustic generating position c may be touched for a predetermined period or a touch having a predetermined pressure may be applied. In addition, the intensity of the sound can be controlled by a continuous touch or the like. With respect to displaying sound intensities, the intensities of levels 1, 2, and 3 may be displayed as 1, 2, 3, or about, medium, or strong, respectively, but are not limited thereto.

11 is a flowchart of a stereophonic sound reproducing method according to another embodiment of the present invention.

First, an audio signal is extracted from a moving picture file (S700), and spatial coordinate information is received from the user (S710). Here, the space coordinate information corresponds to the above object position information, and means a sound generation position that the user desires to set arbitrarily.

Then, a transfer function corresponding to the spatial coordinates is determined (S720), and a sound source signal is generated such that sound due to the audio signal extracted from the moving picture file is sounded in the spatial coordinates using the transfer function (S730) , And reproduces the generated sound source signal through the speaker (S740).

According to this, a stereophonic sound can be implemented so that a sound source is generated at a controlled sound generating position, so that it is possible to realize a sound field close to actual one. In addition, since it is possible to give the impression that the sound is generated directly from the object to be visually sensed, more realistic stereoscopic image viewing becomes possible. Further, the sound generating position can be easily controlled by a user operation.

While the present invention has been described in terms of specific embodiments including the preferred embodiments thereof, those skilled in the art will appreciate that various modifications, additions and substitutions are possible, will be. In addition, various structural and functional modifications can be made without departing from the scope and spirit of the present invention. Accordingly, the spirit and scope of the present invention may be understood broadly as described in the claims appended hereto.

100: sound source reproducing section
110: Speaker
120: Amplifier
130:
200: Signal Analysis and Generator
210: Playback device
220: Signal Analysis Unit
221: Signal Analyzer
230: Multi-channel signal generator
300:
400: User controller

Claims (6)

An extraction step of extracting three-dimensional position information of an audio signal and an object from a stereoscopic image file;
Determining a transfer function corresponding to the three-dimensional position information;
A generating step of generating a sound source signal by using the transfer function so as to sound as if the sound by the audio signal occurs at a position corresponding to the three-dimensional position information; And
And a reproducing step of reproducing the sound source signal in synchronization with a video signal of the stereoscopic image file,
Wherein the video signal is a 3D image signal on a 3D space, the 3D position information includes spatial coordinates of the object included in the 3D image signal on the 3D space,
Wherein the sound source signal includes a sound pressure level at a position corresponding to a spatial coordinate of the object included in the three-dimensional image signal on the 3D space (hereinafter, referred to as an 'acoustic concentration point'), Level,
Wherein the acoustic concentration point is selected by a user and controls at least one of the number of acoustic bright points, the position of each point, and the intensity of each point when the acoustic concentration point is selected by the user Considered to be chosen,
Stereoscopic image reproduction method. The method according to claim 1,
And a storage step of calculating and storing a transfer function corresponding to each acoustic concentration point in the listening area,
Wherein the determining step determines the transfer function corresponding to the sound concentration point as a transfer function for generating the sound source signal by reading a transfer function corresponding to the sound concentration point among the transfer functions previously stored. The method according to claim 1,
Wherein the video signal includes a left eye image signal and a right eye image signal, and the three-dimensional position information includes spatial coordinates of an object included in the stereoscopic image implemented by the left eye image signal and the right eye image signal. Extracting an audio signal and three-dimensional position information of the object from the stereoscopic image file, reading a transfer function corresponding to the three-dimensional position information, and generating sound by the audio signal at a position corresponding to the three- A signal analyzing and generating unit for generating a sound source signal for causing the sound source signal to sound;
An amplifier unit for separating and amplifying the sound source signal into multiple channels; And
And a speaker unit for synchronizing and outputting the sound source signal transmitted from the amplifier unit to a video signal of the stereoscopic image file,
Wherein the video signal is a 3D image signal on a 3D space, the 3D position information includes spatial coordinates of the object included in the 3D image signal on the 3D space,
Wherein the sound source signal includes a sound pressure level at a position corresponding to a spatial coordinate of the object included in the three-dimensional image signal on the 3D space (hereinafter, referred to as an 'acoustic concentration point'), Level,
Wherein the acoustic concentration point is selected by a user and controls at least one of the number of acoustic bright points, the position of each point, and the intensity of each point when the acoustic concentration point is selected by the user Considered to be chosen,
Stereoscopic image reproduction system. 5. The method of claim 4,
Wherein the video signal includes a left eye image signal and a right eye image signal, and the three-dimensional position information includes spatial coordinates of an object included in the stereoscopic image implemented by the left eye image signal and the right eye image signal. 5. The method of claim 4,
Wherein the speaker unit includes a plurality of speakers formed of an MXN (M, N is a natural number) array.

Images