KR101645515B1 - 3-dimensional sound source evaluation apparatus and method - Google Patents
3-dimensional sound source evaluation apparatus and method Download PDFInfo
- Publication number
- KR101645515B1 KR101645515B1 KR1020150069604A KR20150069604A KR101645515B1 KR 101645515 B1 KR101645515 B1 KR 101645515B1 KR 1020150069604 A KR1020150069604 A KR 1020150069604A KR 20150069604 A KR20150069604 A KR 20150069604A KR 101645515 B1 KR101645515 B1 KR 101645515B1
- Authority
- KR
- South Korea
- Prior art keywords
- sound source
- dimensional
- evaluation
- user command
- unit
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
- H04S7/301—Automatic calibration of stereophonic sound system, e.g. with test microphone
Abstract
A three-dimensional sound source evaluation apparatus and method are disclosed. The three-dimensional sound source evaluation apparatus includes an input unit for receiving a user command including a criterion for selection and evaluation of a sound source, and a control unit for generating and evaluating a three-dimensional sound source according to the received user command, A sound source selecting unit for selecting a sound source included in a selection criterion of the user command, a sound source mixing unit for mixing a selected sound source with a three dimensional sound source effect to generate a three dimensional sound source, And a sound source evaluation unit for performing performance evaluation based on criteria.
Description
The present invention relates to a sound source evaluation apparatus, and more particularly, to a three-dimensional sound source evaluation apparatus and method.
Recently, development of acoustic equipment industry and stereoscopic sound system combined with 3D stereoscopic image have been getting attention. The interest in stereoscopic sound is not limited to just one medium, but it will be reflected in various multimedia media such as TV, mobile phone, movie theater, and game. Due to the development of multimedia communication, it is evolving from the technology of multimedia reproduction development to the technology which can be realized according to the emotion of the listener, the taste, and the user can actively reproduce.
Therefore, in the modern society, three - dimensional stereo sound is generated and it is evaluated whether such stereo sound is well - made according to the evaluation standard. Demand for 3D stereo is increasing, and measurable systems are making much progress. In particular, systems capable of evaluating the sound quality of 3D audio have been developed, and a lot of research has actually been done.
However, the present technologies do not have a criterion for judging the state of a three dimensional sound source with the obtained data, but are provided only with a sound source database, or provided with an evaluation means only or limitedly with limited data.
This is because the evaluation criteria vary depending on the evaluation standards of each country, the criteria applied to the evaluation on the three dimensional sound source, or the type or purpose of the three dimensional sound source. Therefore, there is a demand for a system that quantitatively and objectively evaluates the quality of three-dimensional stereo sound produced by an acoustic measurement device, and stores and manages sound sources through a database system.
Korean Patent Laid-Open Publication No. 10-2010-0087928 relates to a method and an apparatus for evaluating sound quality of an audio signal by selecting an optimum sound quality evaluator according to the number of channels of an audio signal.
Korean Patent Registration No. 10-0829870 discloses a sound quality of a multi-channel audio compression codec for measuring the degree to which an audio signal encoded and decoded by a multi-channel audio compression codec generates audible sound quality deterioration in comparison with an original signal before compression. An evaluation apparatus and a method thereof.
SUMMARY OF THE INVENTION It is an object of the present invention to provide an apparatus and a method for evaluating a three dimensional sound source, which can not only measure the completeness of a sound source but also evaluate evaluation results in real time.
It is another object of the present invention to provide an apparatus and method for estimating a three dimensional sound source, which is updated by adding or modifying sound source evaluation criteria.
In order to achieve the above object,
The three-dimensional sound source evaluating apparatus according to the present invention comprises:
An input unit for receiving a user command including a criterion for selection and evaluation of a sound source, and a controller for generating and evaluating a three-dimensional sound source according to the received user command, A sound source selecting unit for selecting a sound source included in the reference, a sound source mixing unit for mixing a selected sound source with a three-dimensional sound source effect to generate a three-dimensional sound source, And a sound source evaluation unit that performs performance evaluation based on evaluation criteria.
And a database for storing the sound source and the three-dimensional sound source.
Wherein the sound source selecting unit searches the sound source according to the user command from the database and selects at least one of the searched sound sources.
The sound source mixing unit mixes the selected sound source and the three-dimensional sound source effect at least once to generate a three-dimensional sound source.
The sound source evaluating unit detects a reference sound source corresponding to the evaluation reference and analyzes the similarity between the detected reference sound source and the three dimensional sound source.
According to the present invention, there is provided a method of evaluating a three-
Receiving a user command including a criterion for evaluating a sound source, selecting a sound source included in the selection criterion of the received user command, mixing the selected sound source with the three-dimensional sound source effect, And a step of performing performance evaluation of the generated three-dimensional sound source according to an evaluation criterion of the user command.
According to the apparatus and method for evaluating a three dimensional sound source according to the present invention, not only the completeness of a sound source but also the evaluation result can be known in real time.
It can also be updated by adding or modifying source criteria.
1 is a block diagram for explaining a 3D stereoscopic sound source evaluating apparatus according to an embodiment of the present invention.
2 is a block diagram illustrating a control unit according to an embodiment of the present invention.
3 is a block diagram illustrating a database according to an embodiment of the present invention.
4 is a flowchart illustrating a method of evaluating a 3D sound source according to an exemplary embodiment of the present invention.
5 is a flowchart illustrating a sound source selection method according to an embodiment of the present invention.
FIG. 6 is a flowchart illustrating a sound source evaluation method according to an embodiment of the present invention.
Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the drawings, the same reference numerals as used in the appended drawings denote like elements, unless indicated otherwise. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather obvious or understandable to those skilled in the art.
1 is a block diagram for explaining a 3D stereoscopic sound source evaluating apparatus according to an embodiment of the present invention.
Referring to FIG. 1, the three-dimensional sound
The three-dimensional sound
The
Also, the
The
The
The
The
For example, in the case of a sound source separation effect, a user can select a sound source mixed with a violin and a piano in a database, output a sound source, and then apply a sound source separation effect to create a sound source having only a violin.
In the case of artificial reverberation, artificial reverberation can be applied to a violin recorded in an anechoic chamber to create a sound source that has the same effect as in a concert hall.
In the case of crosstalk cancellation, applying a crosstalk cancellation effect to a recorded violin sound source at a concert hall can produce a crosstalk-canceled sound source such as a violin recorded in an echo chamber.
2 is a block diagram illustrating a control unit according to an embodiment of the present invention.
Referring to FIG. 2, the
The sound
Accordingly, the sound
In this way, the sound
The sound
The sound
In this case, the sound source mixed in the sound
The sound
Here, the sound
The sound
The BSS eval is a method for quantitatively evaluating a separated source. The basic principle is as shown in Equation (1).
here,
Is an estimated image, Means a true image, Refers to spatial distortion, Quot; means interference, and " Refers to artifacts.
here,
Means a part of the sound source to be evaluated, Means an ideal sound source.The sound
Also, the sound
As shown in Equation (3), the sound
Therefore, the sound
The sound
For example, in the case of a violin three-dimensional stereo sound source to which the sound source separation effect is applied, the sound
In the case of the violin three-dimensional stereo sound source to which the artificial reverberation effect is applied, the sound
In the case of a violin three-dimensional stereo sound source to which the crosstalk cancellation effect is applied, the sound
3 is a block diagram illustrating a database according to an embodiment of the present invention.
Referring to FIG. 3, the
The
Unfractionated sound source means a sound source recorded in an anechoic room. Here, the anechoic room is a room designed so that the bottom, the ceiling, and the surrounding wall are all built in as a sound absorbing material to reduce the reflection of sound.
The room impulse response sound source means a sound source in which the impulse response is recorded in the room. Here, the impulse response is the response to the system when the impact is applied.
Head-transfer function Sound source means sound source recorded with effect like stereo sound. Here, the head transfer function allows stereo sound to be heard with a headphone, such as a 5.1-channel speaker.
The
The
4 is a flowchart illustrating a method of evaluating a 3D sound source according to an exemplary embodiment of the present invention.
Referring to FIG. 4, the three-dimensional sound source evaluation method not only measures the state and quality of a three-dimensional sound source, but also evaluates the sound source in a simple and real-time manner in real time. Three dimensional stereo sound source evaluation method can evaluate the sound sources even if the evaluation criteria for the sound sources are changed. The evaluation also displays the results and provides them to the user using graphs, tables, and the like.
The three-dimensional sound source evaluation method is largely divided into three stages, which are performed in the following order through the three-dimensional sound
The first step is to select a sound source according to a user command (S100). The first step is to search the sound source in the
The second step mixes the selected sound source and the three-dimensional stereo sound effect (S110). In the second step, a three-dimensional sound source is generated by mixing the sound source selected in the first step and the three-dimensional sound source effect stored in the
In the third step, performance evaluation of the three-dimensional sound source is performed (S120). In the third step, the 3D sound source generated in the second step is compared with the reference sound source. In the third step, the similarity is quantitatively quantified, and the performance is evaluated objectively. The third step displays providing the evaluated result to the user.
5 is a flowchart illustrating a sound source selection method according to an embodiment of the present invention.
Referring to FIG. 5, the first step performs a refinement step according to the following procedure.
The first step is to receive a user command (S200). The first step receives a user command from the
The first step is to search the sound source from the database (S210). In the first step, the sound source corresponding to the selection criterion of the user command is searched in the
The first step is to select at least one sound source (S220). In the first step, the searched sound sources are digitized, and the points of each sound sources are designated, and the sound sources are sorted in ascending or descending order. If the number of selected sound sources is set, the first step selects the sound sources according to the selected order according to the sorted order.
FIG. 6 is a flowchart illustrating a sound source evaluation method according to an embodiment of the present invention.
Referring to FIG. 6, the third step performs a refinement step according to the following procedure.
In the third step, an evaluation criterion of the three-dimensional sound source is selected (S300). The third step selects evaluation criteria according to the evaluation criteria contained in the user command. The criteria may be performance such as source separation, crosstalk rejection, artificial reverberation, and the like.
Here, the sound source separation evaluates the degree of sound source separation, the crosstalk elimination evaluates the degree of crosstalk cancellation, and the artificial reverberation evaluates the degree of implementation of artificial reverberation. Each performance can be applied evaluation criteria such as BSS eval, SQM, spatial overview.
In the third step, the reference sound source is selected (S310). The third step is to analyze the selected evaluation criterion and detect the sound source having the average point of the criterion as the reference sound source.
In the third step, similarity between the three-dimensional sound source and the reference sound source is analyzed (S320). In the third step, the similarity between the reference sound source and the 3D stereo sound source is quantitatively analyzed and compared. The third step displays the result of the analyzed performance evaluation to the user.
The present invention can also be embodied as computer-readable codes on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer apparatus is stored. Examples of the computer-readable recording medium include a hard disk, a ROM, a RAM, a CD-ROM, a hard disk, a magnetic tape, a floppy disk, an optical data storage device, And the like.
While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be taken by way of limitation in the embodiment in which said invention is directed. It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the scope of the appended claims.
1: 3D stereoscopic sound source evaluation device
110: input unit
120:
130:
140: Database
210: Sound source selection unit
220: sound source mixing unit
230: sound source evaluation unit
310: raw source data
320: machining source data
330: Metadata
Claims (6)
And a controller for generating and evaluating a three-dimensional sound source according to the received user command,
Wherein,
A sound source selection unit for selecting a sound source included in the selection criterion of the received user command;
A sound source mixing unit for mixing the selected sound source with a three-dimensional sound source effect to generate a three-dimensional sound source; And
And a sound source evaluation unit which performs performance evaluation of the generated three-dimensional sound source according to evaluation criteria of the user command,
Wherein the sound source evaluation unit
Wherein the reference sound source corresponding to the evaluation criterion is detected and the degree of similarity between the detected reference sound source and the three-dimensional sound source is analyzed.
And a database for storing the sound source and the three-dimensional sound source.
Wherein the sound source selection unit comprises:
Searching the sound source according to the user command from the database, and selecting at least one of the searched sound sources.
Wherein the sound source-
Wherein the selected sound source and the three-dimensional sound source effect are mixed at least once to generate a three-dimensional sound source.
Selecting a sound source included in the selection criterion of the received user command;
Generating a three-dimensional sound source by mixing the selected sound source with a three-dimensional sound source effect; And
And performing the performance evaluation of the generated three-dimensional stereoscopic sound source on the basis of the evaluation criterion of the user command,
Wherein the performance evaluation comprises:
Wherein the reference sound source corresponding to the evaluation criterion is detected and the degree of similarity between the detected reference sound source and the three-dimensional sound source is analyzed.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150069604A KR101645515B1 (en) | 2015-05-19 | 2015-05-19 | 3-dimensional sound source evaluation apparatus and method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150069604A KR101645515B1 (en) | 2015-05-19 | 2015-05-19 | 3-dimensional sound source evaluation apparatus and method |
Publications (1)
Publication Number | Publication Date |
---|---|
KR101645515B1 true KR101645515B1 (en) | 2016-08-05 |
Family
ID=56711372
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020150069604A KR101645515B1 (en) | 2015-05-19 | 2015-05-19 | 3-dimensional sound source evaluation apparatus and method |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR101645515B1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109716794A (en) * | 2016-09-20 | 2019-05-03 | 索尼公司 | Information processing unit, information processing method and program |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101495879B1 (en) * | 2013-12-27 | 2015-02-25 | 광운대학교 산학협력단 | A apparatus for producing spatial audio in real-time, and a system for playing spatial audio with the apparatus in real-time |
-
2015
- 2015-05-19 KR KR1020150069604A patent/KR101645515B1/en active IP Right Grant
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101495879B1 (en) * | 2013-12-27 | 2015-02-25 | 광운대학교 산학협력단 | A apparatus for producing spatial audio in real-time, and a system for playing spatial audio with the apparatus in real-time |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109716794A (en) * | 2016-09-20 | 2019-05-03 | 索尼公司 | Information processing unit, information processing method and program |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR102642275B1 (en) | Augmented reality headphone environment rendering | |
RU2625953C2 (en) | Per-segment spatial audio installation to another loudspeaker installation for playback | |
JP5149968B2 (en) | Apparatus and method for generating a multi-channel signal including speech signal processing | |
RU2613731C2 (en) | Device for providing audio and method of providing audio | |
CN105900457B (en) | The method and system of binaural room impulse response for designing and using numerical optimization | |
KR101705960B1 (en) | Three-dimensional sound compression and over-the-air transmission during a call | |
US20190327573A1 (en) | Sound field forming apparatus and method, and program | |
US9554227B2 (en) | Method and apparatus for processing audio signal | |
Schoeffler et al. | Evaluation of spatial/3D audio: Basic audio quality versus quality of experience | |
Grimm et al. | Spatial acoustic scenarios in multichannel loudspeaker systems for hearing aid evaluation | |
JP2013523006A (en) | Stereo sound reproduction method and apparatus | |
US10869151B2 (en) | Speaker system, audio signal rendering apparatus, and program | |
WO2022014326A1 (en) | Signal processing device, method, and program | |
KR101645515B1 (en) | 3-dimensional sound source evaluation apparatus and method | |
Bergner et al. | Identification of discriminative acoustic dimensions in stereo, surround and 3D music reproduction | |
KR102231755B1 (en) | Method and apparatus for 3D sound reproducing | |
US20210105571A1 (en) | Sound image reproduction device, sound image reproduction method, and sound image reproduction program | |
JPWO2010119572A1 (en) | Surround signal generating apparatus, surround signal generating method, and surround signal generating program | |
JPWO2018066384A1 (en) | Signal processing apparatus and method, and program | |
JP6998823B2 (en) | Multi-channel objective evaluation device and program | |
Holbrook | Sound objects and spatial morphologies | |
Tang et al. | Dynamic sound field synthesis for speech and music optimization | |
Liu et al. | Objective quality measurement in multi-channel audio systems by multivariate adaptive regression splines model | |
JP7083405B2 (en) | Audio signal processors, systems and methods that distribute ambient signals across multiple ambient signal channels. | |
Delgado et al. | Influence of binaural processing on objective perceptual quality assessment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
E701 | Decision to grant or registration of patent right |