KR101055798B1 - Method of generating audio information for 2-dimension array speaker and recording medium for the same - Google Patents

Abstract

PURPOSE: An audio information generating method and recording medium therefore are provided to generate audio information for 2D array speaker. CONSTITUTION: An existing medium data is ripped(S910). An audio information generating method for 2D array speaker receives an output channel input(S920). The audio information generating unit for 2D array speaker opens a ripped video and audio data(S930). Change of the audio information according to the change of the time through an audio control window is visually displayed(S940).

Description

Method of generating audio information for 2-dimension array speaker and recording medium for the same}

TECHNICAL FIELD The present invention relates to an audio authoring tool, and more particularly to an audio authoring technique for generating audio information for a two dimensional array speaker that is two dimensionally arranged behind a display surface.

In line with the spread of devices such as DVDs and HDTVs and the trend of digital broadcasting, display devices are developing from CRTs to LCDs and PDPs to OLED systems, and the size of display devices is becoming larger and larger.

In addition, as the number of people who want to enjoy movies and the like with higher quality images and sounds increases, the importance of more dynamic and realistic sounds is increasing day by day. Therefore, more and more people are spared no expense in purchasing a projection, a large display device, a multi-channel speaker device, or the like.

In order to provide a more lively and realistic sound, Korean Patent Publication No. 2009-0100566 discloses a "display device having an object-oriented stereoscopic coordinate display."

Korean Patent Publication No. 2009-0100566 discloses a speaker system in which a plurality of small speakers are arranged behind a display monitor.

1 is a view showing a display screen and a two-dimensional array speaker disposed behind it.

Referring to FIG. 1, it can be seen that a 2D array speaker is disposed behind the display screen 110 and outputs sound in conjunction with an object of an image displayed on the display screen.

The two-dimensional array speaker includes a plurality of speakers 120, 130, 140,... Arranged in the horizontal and vertical directions.

FIG. 2 is a diagram illustrating that only speakers related to an object on a display screen are selected and output sound.

Referring to FIG. 2, it can be seen that speakers that output sound among two-dimensional array speakers are selected in cooperation with an object of an image displayed on a display screen, and only the selected speakers output sound.

That is, when a person speaking on the display screen is displayed, sound is output from speakers located at the mouth of the person.

However, Korean Patent Laid-Open Publication No. 2009-0100566 discloses only the idea of associating an object with a two-dimensional array speaker, and discloses a specific audio information (data) structure suitable for the two-dimensional array speaker or a method for generating such audio information. The technique is silent.

Generating two-dimensional audio information from original video information and audio information for a typical AV system can be very tedious and painful as the duration of the content is longer, and is more efficient considering that the movie is nearly two hours long. And providing a tool that can simply generate two-dimensional audio information is an important issue for popularizing two-dimensional array speaker systems.

Therefore, there is an urgent need for an audio information structure for a multimedia system with a sound system using two-dimensional array speakers and a new audio information generation technique for efficiently generating such audio information.

An object of the present invention for solving the above problems is to make it possible to generate audio information for a two-dimensional array speaker more simply and easily from video information and audio information for a conventional AV system.

In addition, it is an object of the present invention to contribute to the popularization of two-dimensional array speakers by making it possible to easily and simply generate audio information for two-dimensional array speakers without much time consuming.

In addition, an object of the present invention is to allow a user to observe the waveform of an audio signal with his or her eyes and to set an editing section for adding audio editing information quickly and accurately to more simply and easily generate audio information for a two-dimensional array speaker. It is done.

According to an aspect of the present invention, there is provided a method of generating audio information for a two-dimensional array speaker, the method comprising: setting an editing section for audio information synchronized with video information; Generating audio editing information for the editing section for designating one or a plurality of speakers to output sound according to the audio information among speakers that are two-dimensionally arranged behind a surface displaying an image according to the video information. Steps. In particular, the audio editing information includes information for synchronizing with the video information and the audio information.

In this case, the audio editing information may include a channel number of the speaker to output the sound.

In this case, the audio editing information may include a horizontal pixel position (X) and a vertical pixel position (Y) on the image to which the sound is to be output, in order to designate a speaker to output the sound.

In this case, the audio editing information may include depth information on an image from which the sound is output.

In this case, the audio editing information may include delay information on the sound.

In this case, the audio editing information is managed through a channel list, and any one of the audio editing information, the video information, and the audio information in response to a user input to an element of the channel list corresponding to the audio editing information, respectively. Access to one or more may be provided.

In this case, the setting of the editing section may include visually displaying a change of the audio information according to a change of time through an audio control window, and editing the editing section based on a user section setting for the audio control window. It may include a step of setting.

The generating of the audio editing information may include displaying the two-dimensional array icon corresponding to a plurality of speakers to the user and generating the audio editing information based on the user's selection of the two-dimensional array icon. It may include the step.

According to the present invention, it is possible to generate audio information for a two-dimensional array speaker more simply and easily from video information and audio information for a conventional AV system.

In addition, the present invention can easily and simply generate audio information for a two-dimensional array speaker without much time consumption, thereby contributing to the popularization of the two-dimensional array speaker.

In addition, the present invention allows the user to observe the waveform of the audio signal with his or her eyes and to set the editing section for adding the audio editing information quickly and accurately to more simply and easily generate the audio information for the two-dimensional array speaker.

1 is a view showing a display screen and a two-dimensional array speaker disposed behind it.
FIG. 2 is a diagram illustrating that only speakers related to an object on a display screen are selected and output sound.
3 is a diagram illustrating a main screen configuration of an audio information generating tool for a 2D array speaker according to an exemplary embodiment of the present invention.
4 is a diagram illustrating an example of an audio control window illustrated in FIG. 3.
FIG. 5 is a diagram illustrating an example of a channel list displayed in the channel data list window shown in FIG. 3.
6 is a diagram illustrating a channel number setting screen of an audio information generating tool for a 2D array speaker according to an exemplary embodiment of the present invention.
FIG. 7 is a diagram illustrating a screen in which an audio information generation tool for opening a two-dimensional array speaker according to an embodiment of the present invention opens video information.
8 is a diagram illustrating a screen in which an audio information generation tool for opening a two-dimensional array speaker according to an embodiment of the present invention opens audio information.
9 is a flowchart illustrating a method of generating audio information for a two-dimensional array speaker according to an embodiment of the present invention.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. Here, the repeated description, well-known functions and configurations that may unnecessarily obscure the subject matter of the present invention, and detailed description of the configuration will be omitted. Embodiments of the present invention are provided to more completely describe the present invention to those skilled in the art. Accordingly, the shape and size of elements in the drawings may be exaggerated for clarity.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

3 is a diagram illustrating a main screen configuration of an audio information generating tool for a 2D array speaker according to an exemplary embodiment of the present invention.

Referring to FIG. 3, the main screen of the audio information generating tool includes a video control window 310, an audio control window 320, a channel control window 330, and a channel data list window 340.

The audio information generation tool for the 2D array speaker opens a media file in which video information and audio information synchronized with the video information are mixed, and displays an image according to the video information through the video control window 310. .

In this case, the media file may be obtained by ripping a medium such as a DVD or a Blu-ray disc.

At this time, the entire playback, video search using the search bar, section playback, and the like may be supported through the video control window 310.

In this case, a control for playing only a section corresponding to the channel list selected on the channel control window 330 may be disposed in the video control window 310.

In this case, when the channel list is selected on the channel control window 330, a control for automatically moving to the start position of the corresponding channel list may be disposed in the video control window 310.

As such, the channel control window 330 and the video control window 310 operate in conjunction to edit audio information while visually checking the video data, thereby easily and conveniently providing audio editing information for the 2D array speaker for each editing section. Can be generated.

As shown in FIG. 3, the video control window 310 may include an area indicating a time and a frame of a current position.

According to an exemplary embodiment, a region corresponding to a 2D array speaker may be displayed on a specific layer of an image displayed in the video control window 310. For example, the image displayed in the video control window 310 may be divided into a grid having a width X length of 6 X 4 and corresponding to an edit section in which audio editing information for specifying a speaker to output sound is input. When the image is displayed, the color, transparency, or brightness of the grid corresponding to the speaker among 24 grids may be displayed to be different from other grids.

The audio control window 320 visually displays video information synchronized audio information displayed by the video control window 310. In this case, the audio information may be included in a media file including the video information.

In this case, audio information for a predetermined time period may be visually displayed in the audio control window 320. For example, the waveform corresponding to the audio information may be displayed in the audio control window 320 for a time interval of about 15 seconds. The length or scale of the time interval may be easily manipulated through a user interface through a mouse of the audio control window.

At this time, the user can easily set the editing section by eye through the audio control window 320. For example, if you look at the audio control window 320, it is easy to identify the section without sound and the section with sound, so you can select only the section with sound. It's easy to know whether or not you can efficiently associate objects that correspond to two-dimensional array speakers and sound sources.

The audio control window 320 may have one or more location bars, and when the location bar is clicked, the video control window 310 may move to the corresponding time, such as the video control window 310.

In this case, the audio control window 320 may support section playback, section setting, and the like, and may support a spectrum mode for a specific section. In this case, the spectral mode may be a time-frequency conversion of audio information for a predetermined time.

The channel control window 330 includes an edit section in which audio editing information for designating one or a plurality of speakers for outputting sound according to audio information among speakers that are two-dimensionally arranged behind a surface displaying an image according to video information is edited. To be generated for. That is, the channel control window 330 selects a sound output channel to be used for the set editing section. In this case, the editing section may be set through the audio control window 320 or may be directly input through the channel control window 330.

In this case, the selection of the sound output channel may be performed by referring to the audio control window 320 or the video control window 310.

In this case, the output channel is information for designating a speaker to output audio information among speakers that are two-dimensionally arranged behind a surface displaying an image according to video information. For example, a speaker array consisting of a total of 24 speakers, 6 horizontally and 4 vertically, may have an output channel corresponding to 1 to 24.

As shown in FIG. 3, the channel control window 330 may include a two-dimensional array icon 331.

Each button of the two-dimensional array icon 331 indicates the position (channel) of the speaker to be output. The output channel setting may be made through the 2D array icon 331 with reference to the audio control window 320 or the video control window 310.

In this case, the user may select an output channel (speaker) for outputting a sound in a specific editing section from the displayed two-dimensional array icon 331 with a mouse click.

In this case, the number of output channels (speakers) selected in a specific editing section may be plural. For example, when a building occupies a large area on the screen is exploded, sound may be output from all speakers located in an area corresponding to a building among two-dimensional array speakers. In this case, the user may select a plurality of channels from the two-dimensional array icon 331 so that sound is output from the plurality of speakers.

In addition, the channel control window 330 may include a coordinate input window 332.

Through the coordinate input window 332, the coordinates of the position where the sound is to be output in the corresponding editing section may be input.

In this case, the coordinate input window 332 may be provided with a section for receiving the horizontal pixel position X and the vertical pixel position Y on the image to which the sound is to be output. In addition, the coordinate input window 332 may be provided with a section for receiving the depth information (Z) or delay (D) information for the sound output image.

For example, depth information Z on the image or delay D information on the sound may be utilized to output a sound generated from an object distant from a viewer on the image. That is, when an explosion occurs in the far back while a person is talking in the image, the depth information (Z) or delay (D) information for the sound may be utilized to vividly convey the explosion sound in the far back. .

The channel control window 330 may include a section display window 330 to receive a direct edit section. The section display window 330 may include a section for receiving a start time, an end time, and a basic offset time difference from the start time to the end time.

The channel data list window 340 displays audio editing information input through the channel control window 330. That is, the channel list indicating the channel information is displayed in the channel data list window 340. Each element of the channel list corresponds to one editing section and includes output channel information indicating zero or more speakers to be used for sound output in the corresponding section.

In the video control window 310, regions are divided and displayed so as to correspond to the two-dimensional speaker array. When audio editing information is generated for a specific editing section, when the image of the corresponding editing section is displayed, the speakers selected for sound output are displayed. The corresponding area may be indicated by a shade or the like. As such, the generated audio editing information may be visually displayed on the video control window 310 to verify the visually generated audio editing information.

4 is a diagram illustrating an example of an audio control window illustrated in FIG. 3.

Referring to FIG. 4, the audio control window may include a segment start position bar 410, a current position bar 420, and a segment end position bar 430.

The user views the waveform displayed on the audio control window, sets the section start position bar 410 at a desired position, clicks the mouse to set the start point of the edit section, and the section end position bar 430 at the desired position. You can set the end point of the editing section by clicking and clicking the mouse.

When the current position bar 420 is located at a specific position in the audio control window, the detailed time of the position may be displayed. When the current position bar 420 clicks a specific position, the image displayed in the video control window is displayed at the corresponding time. You can jump.

The scale and size of the audio control window can be changed by user manipulation.

In this way, the user can easily observe the waveform by using the audio control window to easily set the editing section which is a unit of setting the audio editing information for the two-dimensional array speaker.

FIG. 5 is a diagram illustrating an example of a channel list displayed in the channel data list window shown in FIG. 3.

Referring to FIG. 5, the channel list includes a plurality of elements (each row), and each row corresponds to an editing section.

Each element of the channel list includes audio editing information for designating one or a plurality of speakers to output sound according to audio information among speakers arranged in two dimensions.

Each element of the channel list includes a start time field 510, an end time field 520, a length field 530, a layer field 540, a coordinate value field 550, a channel number field 560, a channel. An information field 570 and a volume field 580.

The start time field 510, the end time field 520, and the length field 530 indicate the start time, end time, and length of the edit section.

The layer field 540 indicates the number of layers when a plurality of layers are set in the corresponding editing section. That is, a plurality of layers may be set in the same editing section and may be selected as speakers for sound output of different speakers for each layer.

The coordinate value field 550 indicates a horizontal pixel position (X), a vertical pixel position (Y), and a depth (Z) on the image in which sound is to be output in the corresponding editing section. For example, if both the X and Y values are set to 0, the top left speaker of the two-dimensional array speaker may be selected for sound output.

The channel number field 560 indicates a channel number of a speaker to output sound in a corresponding editing section of the 2D array speaker.

In the example shown in FIG. 5, in the case of generating audio editing information for a two-dimensional array speaker including a total of 24 speakers of width X length 6 X 4, the numbers 1 to 24 of the channel number field 560 represent Indicates a channel number, and "PROG" indicates that two or more speakers are used for sound output.

Channel information field 570 visually represents the selected output channel. That is, the channel information field 570 has a cell corresponding to the total number of speakers and displays a cell corresponding to the speaker selected for sound output in a different color so that the user can easily recognize the speaker selected for the plurality of editing sections. do.

The volume field 580 indicates volume information set for the corresponding editing section.

In the example shown in FIG. 5, the same volume 100 is set for all editing sections, but the volume may be set differently for each editing section.

In addition, when two or more layers exist for the same editing section, the volume may be set differently for each layer.

Although not explicitly shown in FIG. 5, the audio editing information may include synchronization information such as a time code since it should be synchronized with the video information and the audio information.

The audio editing information generated by the audio information generating tool for the 2D array speaker may be stored as a file separate from the media file including the video information and the audio information.

6 is a diagram illustrating a channel number setting screen of an audio information generating tool for a 2D array speaker according to an exemplary embodiment of the present invention.

Referring to FIG. 6, it can be seen that the audio information generation tool for the 2D array speaker receives the number of speakers (number of channels) of the 2D array speaker.

For example, a two dimensional array speaker may include 12, 24 or 48 speakers.

At this time, if the number of speakers of the 2D array speaker is set by the user, the channel control window 330 shown in FIG. 3 may be changed according to the set number of speakers. For example, if the user sets the number of speakers to 12, 12 two-dimensional array icons may be generated. If the user sets the number of speakers to 24, 24 two-dimensional array icons may be generated.

In this case, the audio information generation tool for the 2D array speaker may receive editor information together.

When the number of speakers of the two-dimensional array speaker is set, the audio information generation tool for the two-dimensional array speaker opens a media file in which video information and audio information synchronized with the video information are mixed, and loads an image according to the video information into the memory. The loaded image may be displayed in the video control window shown in FIG. 3.

FIG. 7 is a diagram illustrating a screen in which an audio information generation tool for opening a two-dimensional array speaker according to an embodiment of the present invention opens video information.

Referring to FIG. 7, the audio information generating tool may open a specific file, load it into a memory, and display the loaded image in a video control window. In this case, the file may be obtained by ripping a medium such as a DVD or a Blu-ray disc.

8 is a diagram illustrating a screen in which an audio information generation tool for opening a two-dimensional array speaker according to an embodiment of the present invention opens audio information.

Referring to FIG. 8, a video information generation tool for a two-dimensional array speaker may be opened and loaded into a memory to open and load audio information synchronized with video information displayed in a video control window to be loaded into the memory and displayed in the audio control window. have.

When both video and audio information are open and displayed in the video control window and the audio control window, respectively, the video information generation tool for the two-dimensional array speaker can be easily two-dimensionally arranged for the editing section using the interface to the channel control window. Audio editing information for designating one or a plurality of speakers to output sound among the speakers may be generated.

9 is a flowchart illustrating a method of generating audio information for a two-dimensional array speaker according to an embodiment of the present invention.

Referring to FIG. 9, in the method for generating audio information for a two-dimensional array speaker according to an embodiment of the present invention, first, existing media data is ripping (S910).

In this case, the existing media data may be DVD format data or Blu-ray disc format data.

At this time, the file generated as a result of the step (S910) may be an AVI file.

Also, in the method for generating audio information for a 2D array speaker, an output channel input is received (S920).

In this case, the output channel input may be the number of speakers included in the 2D array speaker. For example, if the two-dimensional array speaker includes a total of 24 speakers at 6 × 4, the output channel input may be 24.

In addition, the method for generating audio information for the 2D array speaker opens the ripped video and audio data (S930).

That is, in order to generate audio information for the 2D array speaker, the video information and the audio information of the existing format are opened and provided to the user so that the audio editing information for the 2D array speaker can be efficiently generated.

In addition, in the method for generating audio information for a 2D array speaker, an editing section is set for audio information synchronized with video information (S940).

In this case, step S940 is a step of visually displaying the change of the audio information according to the change of time through the audio control window and the step of setting the editing section based on the user's section setting for the audio control window It may include.

In addition, the audio information generating method for a two-dimensional array speaker, one or a plurality of speakers to output the sound according to the audio information of the speakers arranged in two dimensions behind the surface for displaying the image according to the video information Audio editing information for designation is generated for the editing section (S950).

In this case, the audio editing information includes the video information and information for synchronizing with the audio information.

In this case, the audio editing information may include a channel number of the speaker to output the sound.

In this case, the audio editing information may include a horizontal pixel position (X) and a vertical pixel position (Y) on the image to which the sound is to be output, in order to designate a speaker to output the sound.

In this case, the audio editing information may include depth information on the image from which the sound is output.

In this case, the audio editing information may include delay information on the sound.

At this time, the audio editing information is managed through the channel list shown in FIG. 5, and the channel data list window shown in FIG. 3 in response to a user's input to an element of the channel list corresponding to the audio editing information, respectively, Access to one or more of the audio editing information of 340, the video information of video control window 310, and the audio information of audio control window 320 may be provided.

Step S950 may include displaying a two-dimensional array icon corresponding to a plurality of speakers to the user and generating the audio editing information based on the user's selection of the two-dimensional array icon. .

The performing agent of each step illustrated in FIG. 9 may be an audio information generating tool for a two-dimensional array speaker.

Each step shown in FIG. 9 may be performed in the order shown in FIG. 9, in the reverse order, or simultaneously.

The method for generating audio information for a two-dimensional array speaker according to the present invention can be implemented in the form of program instructions that can be executed by various computer means and recorded in a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the media may be those specially designed and constructed for the purposes of the present invention, or they may be of the kind well-known and available to those having skill in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tape, optical media such as CD-ROMs, DVDs, and magnetic disks, such as floppy disks. Magneto-optical media, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like.

As described above, the audio information generating method for the 2D array speaker according to the present invention is not limited to the configuration and method of the embodiments described as described above, but the embodiments may be modified in various ways. All or some of the embodiments may be selectively combined.

S910: Rip Existing Media Data
S920: Receive output channel input step
S930: Opening video and audio data
S940: Receiving Edit Section Setting Step
S950: step of generating audio editing information

Claims (9)

Receiving an editing section for audio information synchronized with video information;
Generating audio editing information for the editing section for designating one or a plurality of speakers to output sound according to the audio information among speakers that are two-dimensionally arranged behind a surface displaying an image according to the video information. Steps,
The audio editing information includes information for synchronization with the video information and the audio information,
The step of receiving the editing section is
Visually displaying a change in the audio information with a change in time through an audio control window; And
Receiving the editing section based on a user's section setting for the audio control window;
Audio information generation method for a two-dimensional array speaker comprising a. The method according to claim 1,
The audio editing information
And the channel number of the speaker to output the sound. The method according to claim 1,
The audio editing information
And a horizontal pixel position (X) and a vertical pixel position (Y) on an image to which the sound is to be output, in order to designate a speaker to output the sound. The method according to claim 2 or 3,
And the audio editing information comprises depth information on an image from which the sound is output. The method according to claim 2 or 3,
The audio editing information
Audio information generation method for a two-dimensional array speaker, characterized in that it comprises a delay (delay) information for the sound. The method according to claim 1,
The audio editing information
Managed through a channel list, wherein access to any one or more of the audio editing information, the video information, and the audio information is provided in response to a user input to an element of the channel list corresponding to the audio editing information, respectively; Audio information generation method for a two-dimensional array speaker, characterized in that. delete Receiving an editing section for audio information synchronized with video information;
Generating audio editing information for the editing section for designating one or a plurality of speakers to output sound according to the audio information among speakers that are two-dimensionally arranged behind a surface displaying an image according to the video information. Steps,
The audio editing information includes information for synchronization with the video information and the audio information,
Generating the audio editing information
Displaying a two-dimensional array icon corresponding to the plurality of speakers to the user; And
Generating the audio editing information based on the user's selection of the two-dimensional array icon
Audio information generation method for a two-dimensional array speaker comprising a. A computer-readable recording medium in which a program for executing the method of any one of claims 1 to 3, 6 or 8 is recorded.

Images