KR20160065510A - Method for producing video file or streaming packet including non-audible sound wave and television broadcasting system using the method - Google Patents

Abstract

According to an embodiment of the present invention, a method for generating a broadcast image file including a non-audible sound wave is disclosed. The method for generating a broadcast image file including a non-audible sound wave comprises the following steps of: receiving a broadcast image file including a video track and a main audio track; and mixing a non-audible sound wave with sound data of one of the main audio track or a first sub audio track when the broadcast image file includes the first sub audio track having the sound data which is the same as at least a portion of the sound data of the main audio track. Therefore, the method enables a viewer to selectively listen to a non-audible sound wave while a broadcast image including the non-audible sound wave having specific information is broadcast.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method for generating a broadcast image file or a streaming packet including a non-audible sound wave and a television broadcasting system using the method,

The present invention relates to a method for generating a broadcast image file or a streaming packet including non-audible sound waves and a television broadcast system using the method. More particularly, A method of generating a broadcast image file or a streaming packet that enables a viewer to selectively listen to a non-audible sound wave, and a television broadcast system using the method.

Recently, technology for providing mobile interworking services to viewers by inserting non-audible sound waves into television (TV) images is being studied. For example, Korean Patent Application No. 2013-0043862 (filed on April 19, 2013, registered on Feb. 10, 2014) discloses a method of providing a user-customized advertisement based on an acoustic signal output from a TV.

However, there are some problems in the TV-mobile interworking service using non-audible sound waves. In other words, some viewers do not like the non-audible sound due to health or stress, and some of the viewers' TV speakers are outdated and the non-audible sound is turned into audible noise.

One solution to this problem is to allow viewers to manipulate the TV's set-top box so that the non-audible sound can be picked up from the TV. However, existing non-audiovisual sound blocking software Or the hardware needs to be replaced.

According to an embodiment of the present invention, there is provided a television broadcasting system capable of transmitting not only an acoustic signal including a non-audible sound wave but also an original acoustic signal not including a non-audible sound wave when a broadcast is transmitted from a broadcasting station or the like.

According to an embodiment of the present invention, when a viewer who receives a broadcasting image file or streaming data including a non-audible sound wave does not want to listen to a non-audible sound wave, And selects a different audio track so as to listen to sounds that do not include non-audible sound waves.

According to an embodiment of the present invention, there is provided a method of generating a broadcast image file including a non-audible sound wave, the method comprising: receiving a broadcast image file including a video track and a main audio track; And when the broadcast image file includes a first sub audio track having the same sound data as at least a portion of the sound data of the main audio track, And mixing audio data with audio data, the method comprising the steps of:

According to an embodiment of the present invention, there is provided a method of generating a moving picture streaming packet including a non-audible sound wave, the method comprising: receiving a series of streaming packets for a moving picture including a video track and a main audio track; And when the moving picture includes a first sub audio track having the same sound data as at least a part of the sound data of the main audio track, a streaming packet of the main audio track or a stream of the first sub audio track And inserting the audio stream into the packet.

According to an embodiment of the present invention, there is provided a computer-readable recording medium on which program instructions for performing the method are recorded.

According to an embodiment of the present invention, there is provided a television broadcast system comprising: a first storage device for storing a first broadcast image file including a video track and a main audio track; An acoustic mixing device for generating a second broadcast image file including non-audible sound waves in the first broadcast image file; And a second storage device for storing the second broadcast image file, wherein the first broadcast image file includes a first audio file having a first audio data having the same sound data as the audio data of the main audio track, And mixes the non-audible sound wave with sound data of one of the main audio track or the first sub audio track when the audio signal includes a sub audio track.

According to an embodiment of the present invention, there is provided a television broadcasting system comprising: an acoustic mixing device for receiving a series of streaming packets for a moving picture including a video track and a main audio track and inserting non-audible sound waves into at least one streaming packet; Wherein the audio mixing apparatus includes a first sub audio track having the same sound data as at least a part of the audio data of the main audio track, Or into a streaming packet of the first sub-audio track.

According to an embodiment of the present invention, when broadcasting is transmitted from a broadcasting station or the like, not only acoustic signals including non-audible sound waves but also original sound signals not including non-audible sound waves can be transmitted.

In addition, according to an embodiment of the present invention, a viewer who receives a broadcast image file or streaming data including a non-audible sound wave through the television system can perform hardware / software upgrade of the existing set-top box if he / It is possible to listen to sounds that do not include non-audible sound waves by selecting other audio tracks without need.

1 is a block diagram for explaining a television broadcasting system according to a first embodiment of the present invention;
2 is a block diagram of an acoustic mixing apparatus according to the first embodiment;
3 and 4 are views for explaining a process of generating a second broadcast image file by the sound mixing apparatus according to the first embodiment;
5 is a diagram illustrating an exemplary method of generating a second broadcast image file according to an embodiment;
6 is a block diagram of an acoustic mixing apparatus according to the second embodiment.
7 is a diagram for explaining an exemplary streaming packet input to the acoustic mixing apparatus according to the second embodiment,
8 is a diagram for explaining an exemplary method of inserting non-audible sound waves into a streaming packet according to the second embodiment.

BRIEF DESCRIPTION OF THE DRAWINGS The above and other objects, features, and advantages of the present invention will become more readily apparent from the following description of preferred embodiments with reference to the accompanying drawings. However, the present invention is not limited to the embodiments described herein but may be embodied in other forms. Rather, the embodiments disclosed herein are provided so that the disclosure can be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. In this specification, when an element is referred to as being on another element, it means that it can be formed directly on the other element, or a third element may be placed therebetween.

The terminology used herein is for the purpose of illustrating embodiments and is not intended to be limiting of the present invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. The terms "comprises" and / or "comprising" used in the specification do not exclude the presence or addition of one or more other elements.

Hereinafter, the present invention will be described in detail with reference to the drawings. In describing the specific embodiments below, various specific details have been set forth in order to explain the invention in greater detail and to assist in understanding it. However, it will be appreciated by those skilled in the art that the present invention may be understood by those skilled in the art without departing from such specific details. In some instances, it should be noted that portions of the invention that are well known in the description of the invention and not significantly related to the invention do not describe confusion in describing the present invention.

1 is a block diagram for explaining a television broadcasting system according to a first embodiment of the present invention.

Referring to the drawings, a television broadcasting system according to a first embodiment includes a first storage device 10, an acoustic mixing device 20, a non-audible sound generator 30, a second storage device 40, a broadcast transmission system 50, and a television system 60.

The first storage device 10 is a storage means for storing broadcast image files, and may be embodied as a semiconductor memory such as a magnetic recording medium such as a hard disk drive (HDD) or a flash memory. In the present specification, the term " broadcast image file " may be, for example, a moving image file of a TV program produced for broadcasting in a TV broadcasting station, but may be any moving image file. In one embodiment, the broadcasting image file includes a video track and an audio track, and may be a moving picture file of any one of moving picture file formats such as MPEG, MPEG2, MPEG2-TS, MXF, GXF, MOV, WMV, In the illustrated embodiment, the first storage device 10 stores a first broadcast image file 11, the first broadcast image file 11 includes a video track and a main audio track, And may further include an audio track.

The non-audible sound generator 30 may generate sound waves in the non-audible frequency band and transmit the sound waves to the sound mixing device 20. Here, "non-audible frequency" means a frequency band that can not be heard by human hearing, and may include frequencies in the 18 to 24 KHz band, for example. At this time, the non-audible sound generator 30 can generate a non-audible sound wave in which specific information such as product information and broadcast program information is planted.

The generation of the non-audible sound wave including specific information is performed by modulating specific information, for example, digital data, by one of various modulation methods such as amplitude modulation (ASK), frequency modulation (FSK), or phase modulation By putting this on non-audible sound waves, it is possible to generate such non-audible sound waves. In addition, a technique for inserting arbitrary information into non-audible sound waves is disclosed in, for example, Patent Application No. 2013-0107604 filed by the present inventor (a method and apparatus for transmitting and receiving sound waves using time-varying frequency-based symbols) 0038120 (a position estimation method and a position estimation system for estimating the position of a mobile terminal using an acoustic system and an acoustic system used therefor), or a technology disclosed in Patent Application No. 2012-0078410 (proximity data collection method and system) Can be used.

On the other hand, all of the techniques disclosed in the above-mentioned patent applications are incorporated herein by reference and should be treated as part of this specification.

The acoustic mixing device 20 is a device for generating a second broadcast image file 41 by including the non-audible sound generated by the non-audible sound generator 30 in the first broadcast image file. In one embodiment, the acoustic mixing apparatus 20 generates a sub audio track having the same sound data as the sound data of the main audio track of the first broadcast image file 11, and outputs the non-audible sound wave to the main audio track By mixing with audio data of one of the sub audio tracks, non-audible sound waves can be included in the first broadcast image file. At this time, at least a part of the sound data of the main audio track may be sound data in an audible frequency band of the main audio track.

Also, in one embodiment, the sound mixing apparatus 20 may determine whether the first broadcast image file 11 already includes a sub-audio track having the same sound data as at least a portion of the main audio track, before generating the sub- If it is determined that the sub audio track includes the sub audio track, the non-audible sound wave can be included in the existing sub audio track or the main audio track without generating a new sub audio track.

The second storage device 40 may be a storage device for storing broadcast image files, for example, a magnetic recording medium such as a hard disk drive or a semiconductor memory such as a flash memory. In one embodiment, the first storage device 10 and the second storage device 40 may be physically identical storage means or may be separate storage means.

Alternatively, the second storage device 40 may be a memory (RAM) for temporarily storing the second broadcast image file 41 before transmitting the second broadcast image file 41 generated by the sound mixing device 20 It is possible.

In the illustrated embodiment, the second storage device 40 stores the second broadcast image file 41. Here, the second broadcast image file 41 is a file generated by the sound mixing apparatus 20, and is a broadcast image file including a non-audible sound wave in the first broadcast image file 11. In one embodiment, the second broadcast image file 41 may include a video track, a main audio track, and a sub audio track, and the non-audible sound wave may include audio data of one of the main audio track or sub audio track Can be mixed and inserted into this audio track.

The broadcast transmission system 50 is a transmission system for transmitting the second broadcast image file 41 stored in the second storage device 40 to the television broadcasting system 60. The broadcast transmission system 50 may be an analog broadcasting system or a digital broadcasting system and may be implemented in various ways. For example, the broadcast transmission system 50 may be implemented by any one of terrestrial broadcasting using a transmission tower, satellite broadcasting using satellite, wired broadcasting using a wired line, or Internet broadcasting using the Internet, And transmits the file 41 to the television system 60 in accordance with the broadcasting, unicasting, or multicasting method.

Also, when the broadcast transmission system 50 is a digital broadcast system, the second broadcast image file 41 can be transmitted to the television broadcast system 60 by a streaming method or a download method.

The television system 60 can receive the broadcast image file (i.e., the second broadcast image file 41) including the non-audible sound wave and convert it into an analog signal. The television system 60 may include a set-top box 61 and a television receiver 62. The set-top box 61 is connected to the television receiver 62 and receives and appropriately converts the second broadcast image file 41 transmitted through the broadcast transmission system 50 to transmit video and sound through the television receiver 62 Can be output.

In one embodiment, the non-audible sound waves included in the second broadcast image file 41 are extracted from the second broadcast image file 41 by the set-top box 61 or the television receiver 62, Can be output. In this case, the speaker may be built in the television receiver 62 or may be a device outside the television receiver 62. [

According to the television broadcasting system of the above-described embodiment, when a TV broadcast is transmitted from a broadcasting station, an acoustic signal including non-audible sound waves and an original acoustic signal including no non-audible sound waves can be transmitted together.

In addition, a viewer who receives the second broadcasting image file including the non-audible sound through the television system 60 can listen to the sound without the non-audible sound by selecting another audio track if he / she does not want to listen to the non-audible sound. For example, when a non-audible sound is included in the sound of the main audio track set as default at the time of watching the broadcast, the viewer can hear the sound without the non-audible sound by selecting the sub audio track. That is, according to an embodiment of the present invention, it is possible to use the audio track selection function of the existing set-top box without upgrading the hardware and / or software of the existing set-top box installed in each home, .

Hereinafter, an exemplary configuration of an acoustic mixing device 20 for generating a second broadcast image file 41 by inserting a non-audible sound wave into the first broadcast image file 11 will be described with reference to FIG. 2 to FIG.

2 is a block diagram of an acoustic mixing apparatus 20 according to the first embodiment. 3 and 4 illustrate a process of generating a second broadcast image file according to an embodiment. Each of FIGS. 3 and 4 (a) through 4 (e) 22, 23, 24) of the broadcast image file.

In the illustrated embodiment, it is assumed that the broadcast image file is composed of a video container called a " container format "or a" wrapper format " A video container is also called a "container" or a "format" and is a format for converting video data and audio data into a single video file. Each container format includes MPEG, MPEG2, MPEG2-TS, MXF, GXF, MOV , WMV, MP4, and the like. That is, the video data and audio data compressed through the codec are made into one video file according to a specific container format according to extensions such as MPEG, MPEG2, TS, MXF, GXF, MOV, WMV,

The first broadcast image file 11 shown in Fig. 3 (a) includes a header H containing file information, a video track V containing video data, A main audio track MA including data, and a first sub audio track SA1 including audio data. In general, a video container includes a header (and / or metadata), a video track, and a main audio track, and may optionally further include one or more sub audio tracks for audio multiplexing, In the illustrated embodiment, only the header H, the video track V, the main audio track MA, and the first sub audio track SA1 of the first broadcast image file 11 A person skilled in the art will understand. In FIG. 3, it is assumed that the main audio track MA includes, for example, Korean audio data and the first sub audio track SA1 includes, for example, English audio data.

2, the acoustic mixing apparatus 20 may include a demultiplexer 21, an audio processing unit 22, an audio mixer unit 23, and a remultiplexer 24.

The demultiplexer 21 demultiplexes the first broadcast image file 11. That is, the demultiplexer 21 demultiplexes the first broadcast image file 11 configured according to the format of the video container 111 as shown in FIG. 3 (a) to generate a video track V, a main audio track The first sub audio track MA, and the first sub audio track SA1. In an alternative embodiment, the demultiplexer 21 may selectively extract only the necessary tracks (e.g., the main audio track MA or the first sub audio track SA1) without separating all the tracks from the video container 111. [

The audio processing unit 22 generates a second sub audio track SA2 to be added to the first broadcast image file 11 based on the main audio track MA (see Fig. 3 (c)). For example, the audio processing unit 22 generates the same audio data as the audio data of the main audio track as the second sub audio track SA2 by copying the audio data of the main audio track MA.

The acoustic data of the main audio track MA and the acoustic data of the generated second sub-audio track SA2 need not be completely identical. For example, only the acoustic data within the audible frequency range that the human being can hear is the same, and the acoustic data in the other frequency bands may be different. For example, the second sub audio track SA2 may have the same sound data in the frequency band of 200 Hz to 14 KHz of the main audio track MA, but may not include the sound data of other frequency bands. Also, the codec format in which each audio track is compressed may be different.

After generating the second sub audio track SA2, the audio mixer unit 23 inserts the non-audible sound wave generated by the non-audible sound wave generator 30 into the audio track (see FIG. 3D). For example, the audio mixer unit 23 may convert the non-audible sound wave into a main audio track MA or a sub audio track having the same sound data as at least a part of the sound data of the main audio track (i.e., SA2), and insert the non-audible sound wave.

As a specific method of inserting non-audible sound waves into an audio track, for example, it is necessary to decode and decompress the sound data of the audio track, mix the decoded original sound and non-audible sound, Can be inserted.

Although the illustrated embodiment shows an example in which non-audible sound waves are inserted into the main audio track MA, in an alternative embodiment a non-audible sound may be inserted into the second sub audio track SA2. When the non-audible sound wave is inserted into the main audio track, the non-audible sound wave may be output to the speaker together with the audio data of the main audio track, unless the television viewer performs a separate operation.

In addition, when non-audible sound waves of a predetermined frequency band already exist in the main track or sub audio track of the predetermined frequency band, in order to prevent the change of the non-audible sound wave, And then insert the non-audible sound wave.

The audio mixer unit 23 may be implemented as an analog mixer or a digital mixer according to a processing method of an audio signal. At this time, a non-audible sound wave generated by the non- And is preferably transmitted to the audio mixer unit 23 in the form of an analog signal or a digital signal according to the type of the audio mixer unit 23.

The remultiplexer 24 multiplexes the demultiplexed first broadcast image file 11 and the second sub audio track. (I.e., header H, video track V, main audio track MA, first sub audio track SA1) of the first broadcast image file 11, The track SA2 is summed in accordance with the format of the arbitrary video container 411 to form one moving picture file (i.e., the second broadcasting image file 41) (see Fig. 3 (e)). The video container 411 of the second broadcast image file 41 may be of the same format as the video container 111 of the first broadcast image file 11 but may be of another format. At this time, the multiplexing can be performed by accurately matching the time sync between the video of the video track (V) and the audio tracks (MA, SA1, SA2). Alternatively, an operation of synchronizing such a time sync may be performed in the audio mixer unit 23. [

On the other hand, FIG. 4 shows another example of the first broadcast image file 11. The first broadcast image file 11 shown in Fig. 4A is composed of a header H, a video track V containing video data, Audio track MA and a first sub-audio track SA1 including audio data, wherein the first sub-audio track SA1 contains a copy of the audio data of the main audio track MA . That is, FIG. 4 assumes that the main audio track MA and the first sub audio track SA1 contain the same sound data.

In this example, the demultiplexer 21 demultiplexes the first broadcast image file 11 of Fig. 4 (a) to generate a video track V, a main audio track MA, and a first Separates the sub audio track SA1.

In this case, since the sub audio track (i.e., the first sub audio track SA1) having the same sound data as the main audio track MA already exists, the audio processing section 22 needs to generate a new audio track And therefore, the broadcast image files of FIGS. 4 (b) and 4 (c) are the same.

Thereafter, the audio mixer unit 23 can insert the non-audible sound wave generated by the non-audible sound generator 30 into the main audio track MA or the first sub audio track SA1, And a non-audible sound wave is inserted into the main audio track MA.

4 (e), the remultiplexer 24 multiplexes the demultiplexed first broadcast image file 11 to generate a header H, a video track V, a main audio track MA, And the first sub audio track SA1 are combined into one moving picture file (i.e., the second broadcasting picture file 41) according to the format of the arbitrary video container 411. [

The acoustic mixing apparatus 20 described above can be implemented with hardware and / or software necessary to generate a sub audio track and insert the non-audible sound into the main or sub audio track. For example, the sound mixing device 20 may be implemented by hardware such as a computer processor, a memory, a storage device, and a sound signal input / output terminal, and may be loaded into a memory and executed thereby to implement the demultiplexer 21, the audio processing section 22, (Application program) that performs the functions of the multiplexer 23 and the remultiplexer 24, as shown in Fig. At this time, the functions of the demultiplexer 21, the audio processing unit 22, the audio mixer unit 23, and the remultiplexer 24 described above may be executed in one integrated program or in a plurality of programs. Also, some of the components may be omitted according to a specific embodiment. For example, the demultiplexer 21 or the remultiplexer 24 may be omitted depending on the format of the moving picture file or depending on the presence or function of any sound data processing unit connected to the front end or the rear end of the sound mixing apparatus 20 I will understand.

5 is a diagram for explaining an exemplary method of generating a broadcast image file including a non-audible sound wave according to the first embodiment.

Referring to the drawing, in step S110, the sound mixing apparatus 20 receives a broadcast image file. Here, the broadcast image file is the above-described first broadcast image file 11 including a video track, a main audio track, and optionally one or more sub audio tracks.

Thereafter, the sound mixing apparatus 20 demultiplexes the first broadcast image file 11 (S120), and transmits the first broadcast image file 11, which has the same sound data as the sound data of the main audio track MA, It can be determined whether or not the audio track SA already exists (S130). In this case, in one embodiment, the file header H in the first broadcast image file may be analyzed to determine whether a sub audio track SA exists.

If the sub audio track SA having the same sound data exists in the first broadcast image file 11 (S130-Y), the process proceeds to step S150.

If it is determined in step S130 that the same sub audio track SA as the audio data of the main audio track MA is not present in the first broadcast image file 11 (S130-N), the process proceeds to step S140 , So that the acoustic mixing apparatus 20 generates the sub audio track SA. The sub audio track generated at this time is an audio track having the same sound data as at least a part of the sound data of the main audio track MA. To this end, as described above with reference to FIGS. 2 and 3, for example, by copying at least a part of the sound data of the main audio track MA (for example, acoustic data of the audible frequency band) The same sound data can be generated as a sub audio track.

Next, in step S150, the acoustic mixing device 20 adds the non-audible sound wave containing the specific information to the audio track. For example, when the audio mixer unit 23 of the acoustic mixing apparatus 20 receives the non-audible sound wave generated from the non-audible sound generator 30 as the main audio track MA or at least the audio data of the main audio track MA It is possible to insert the non-audible sound wave by mixing with the sound data of one of the audio tracks of the sub audio tracks SA having the same sound data.

Thereafter, in step S160, the acoustic mixing apparatus 20 multiplexes the first broadcast image file 11 and the sub audio track. For example, when the remultiplexer 24 of the sound mixing apparatus 20 has the file header H, the video track V, and the main audio track MA, which are the constituent elements of the first broadcast image file 11, And multiplexes the track SA to generate one moving picture file (i.e., the second broadcast image file 41).

Although an exemplary method of generating the second broadcast image file has been described with reference to FIG. 5, it will be understood by those skilled in the art that various alternative embodiments are possible.

For example, some of the steps may be omitted according to a specific embodiment of the invention. The demultiplexing step (S120) and / or the remultiplexing step (S160) may be omitted depending on the type of the moving picture file or depending on the presence or function of any data processing unit connected to the front end or the rear end of the sound mixing apparatus 20 .

Hereinafter, a second embodiment will be described with reference to FIGS. 6 to 8. FIG. The second embodiment relates to a method and apparatus for inserting non-audible sound waves into a streaming packet of a broadcast image.

6 shows a block diagram of an acoustic mixing device 80 according to the second embodiment. The acoustic mixing device 80 according to the second embodiment is located on the transmission path of any streaming packet. For example, in the case of real-time live broadcast on a television, an acoustic mixing (mixing) according to the second embodiment is performed at an arbitrary position on the transmission path from the recording site of the broadcasting station to the television system of the viewer side (for example, Device 80 may be located.

At this time, the streaming packets flowing into the sound mixing device 80 may have different sizes or structures depending on the streaming protocol. Currently widely used streaming protocols are RTMP and RTMPT protocols for Flash Player, MS Smooth protocol for Silverlight or Windows Media Player, HLS for Apple's iOS-based devices, streaming protocol, SMPTE-259M / 292M / 372M / 424M / ST-2081 / ST-2082 standard protocol for delivering uncompressed video and embedded compressed or uncompressed sound in the internal network of the broadcasting station, MPEG2 -TS protocol. The name of the transmission unit of streaming data (e.g., "packet", "segment", "frame", "file", etc.), the capacity and structure of each transmission unit The structure and size of the header or payload).

Hereinafter, an exemplary packet structure shown in FIG. 7 is assumed to simplify the description of the present invention. 7 is a diagrammatic representation of a TS packet according to MPEG2-TS. In this example, it is assumed that the video to be streamed has one video track and two audio tracks (for example, "Audio 1" may be Korean and "Audio 2" may be English audio data). The video and audio data are respectively encoded and packetized in a video track and an audio track, multiplexed through a multiplexer (MUX) 70, and finally streamed in a packet unit called a TS packet. As shown, one TS packet may be composed of a header H and a payload, and the payload includes video data V or audio data A1 or A2. Here, it is assumed that "A1" is the data of the main audio track (Audio 1) and "A2" is the data of the sub audio track (Audio 2).

6, the acoustic mixing apparatus 80 may include a packet extracting unit 81, a packet processing unit 82, an audio mixer unit 83, and a packet transmitting unit 84.

The packet extracting unit 81 can receive a streaming packet and extract a streaming packet of an audio track from the packet. For example, the packet extracting unit 81 may demultiplex incoming streaming packets to extract packets of an audio track.

The packet processing unit 82 determines whether or not the moving picture to be streamed includes a sub audio track having the same sound data as at least a part of the sound data of the main audio track (for example, sound data in the audio frequency band of the main audio track). As a result of the determination, if the sub audio track is not included, a streaming packet of the sub audio track having the same sound data as at least a part of the sound data of the main audio track is generated.

7, although there is one sub audio track Audio 2, the data A2 of the sub audio track is not the same as the data A1 of the main audio track, so the packet processing unit 82 And generates packets of the second sub audio track to produce a second sub audio track having the same data as the data A1 of the main audio track. For example, the packet processing unit 82 can generate packets of the second sub audio track having the same data as the audio data of the main audio track by copying them each time packets of the main audio track are input.

The audio mixer unit 83 inserts the non-audible sound wave generated from the non-audible sound generator 30 into a streaming packet of the main audio track or a streaming packet of the second sub-audio track. As a specific method of inserting non-audible sound waves into a streaming packet, for example, sound data in a payload of a streaming packet is decoded and decompressed, and then the decoded original sound and non-audible sound are mixed and re- Sound waves can be inserted.

The packet transmitting unit 84 transmits the streaming packets processed in the sound mixing device 80 toward the original transmission path. For example, the packet transmitting unit 84 may transmit packets of the audio track extracted by the packet extracting unit 81 and packets of the audio track generated by the packet processing unit 82. In an alternative embodiment, if the packet extractor 81 also extracts a streaming packet of a video track, the packet of the video track may include a delay buffer (not shown) within the audio mixing device 80 (or outside the device 80) And may be transmitted by the packet transmitting unit 84. [

The acoustic mixing device 80 according to the second embodiment described above can be implemented with hardware and / or software necessary to extract streaming packets, generate packets, and insert non-audible sound waves into the packets. For example, when the acoustic mixing device 80 is loaded into the memory and executed by hardware such as a computer processor, a memory, a storage device, and a sound signal input / output terminal, the packet extracting unit 81, the packet processing unit 82, A mixer unit 83, and a packet transmitting unit 84. The software (application program) At this time, the functions of the components 81, 82, 83, and 84 described above may be executed in one integrated program or in a plurality of programs. Also, some of the components may be omitted according to a specific embodiment.

8 is a diagram for explaining an exemplary method of inserting non-audible sound waves into a streaming packet according to the second embodiment.

In step S210, the acoustic mixing device 80 receives a series of streaming packets for the moving picture including the video track and the main audio track.

The streaming packet of the audio track can be extracted from the streaming packet received in step S220. For example, the packet extracting unit 81 of the sound mixing device 80 may demultiplex streaming packets to extract packets of an audio track.

Then, in step S230, whether or not the moving picture to be streamed includes a sub audio track having the same sound data as at least a part of the sound data of the main audio track (for example, sound data within the audio frequency band of the main audio track) .

At this time, for this determination, for example, it may be determined based on the information contained in the header of the streaming packet. For example, in the case of the MPEG2-TS protocol, this determination can be performed by referring to the program connection table (PAT) and / or the program map table (PMT) among the program designation information (PSI) included in the TS packet header. Alternatively, in the alternative embodiment, it may be possible to perform the above-described determination step by receiving all the packets of each channel for each of a plurality of audio tracks and then comparing the sound data of the respective audio tracks.

If it is determined that the moving picture to be streamed does not include the same sub audio track as the main audio track in step S230-N, a streaming packet of the same sub audio track as the main audio track is generated in step S240, The process proceeds to step S250. If it is determined in step S230 that the streaming moving picture includes a sub audio track having the same sound data as the sound data of the main audio track (S230-Y), the flow advances to step S250.

In step S250, the non-audible sound wave generated by the non-audible sound generator is transmitted to a streaming packet of the main audio track or at least a part of the sound data of the main audio track (for example, sound data in the audio frequency band of the main audio track) Into a streaming packet of a sub audio track having audio data.

Thereafter, in step S260, the streaming packets processed as described above are transmitted to the outside of the acoustic mixing device 80 along the original transmission path.

As described above, the second embodiment has been described on the assumption of the exemplary packet structure of FIG. However, those skilled in the art will also understand that for streaming transmissions under various streaming protocols that define packets (or segments, fragments, or files) in different transmission units than in FIG. 7, It will be appreciated that the techniques for transmitting are applicable.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention. Therefore, the scope of the present invention should not be limited by the described embodiments, but should be determined by the scope of the appended claims, as well as the appended claims.

10: First storage device
20, 80: Acoustic mixing device
30: non-audible sound generator
40: Second storage device
50: Broadcasting transmission system
60: Television system

Claims (18)

A method for generating a broadcast image file including a non-audible sound wave,
Receiving a broadcast image file including a video track and a main audio track; And
Wherein when the broadcast image file includes a first sub-audio track having the same sound data as at least a portion of the sound data of the main audio track, the non-audible sound is converted into a sound of one of the main audio track or the first sub- And mixing the audio image data with the audio data to generate a broadcast image file including a non-audible sound wave. The method according to claim 1,
Wherein at least a part of the audio data of the main audio track is audio data in an audio frequency band of the main audio track. 2. The method of claim 1, wherein prior to mixing the non-audible sound waves,
Determining whether the first broadcast image file already includes the first sub-audio track; And
And generating the first sub-audio track if the first sub-audio track does not include the first sub-audio track as a result of the determination. The method of claim 3,
Wherein the determining step determines whether the broadcast image file includes the first sub audio track by analyzing a header of the broadcast image file. CLAIMS What is claimed is: 1. A method for generating a moving picture streaming packet including a non-audible sound wave,
Receiving a series of streaming packets for a moving picture comprising a video track and a main audio track; And
When the moving picture includes a first sub audio track having the same sound data as at least a part of the sound data of the main audio track, a streaming packet of the main audio track or a streaming packet of the first sub- And a step of inserting the audio streaming packet into the video streaming packet. 6. The method of claim 5,
Wherein at least a part of the audio data of the main audio track is audio data in an audio frequency band of the main audio track. 6. The method of claim 5, wherein prior to inserting the non-audible sound wave into the streaming packet,
Determining whether the moving picture already includes the first sub audio track; And
And generating a streaming packet of the first sub-audio track if the first sub-audio track does not include the first sub-audio track. 8. The method of claim 7,
Wherein the determining step comprises analyzing a header of a streaming packet of the moving image to determine whether the moving image includes the first sub audio track. 9. A computer-readable recording medium having recorded thereon a program instruction for performing the method according to any one of claims 1 to 8. In a television broadcasting system,
A first storage device for storing a first broadcast image file including a video track and a main audio track;
An acoustic mixing device for generating a second broadcast image file including non-audible sound waves in the first broadcast image file; And
And a second storage device for storing the second broadcast image file,
The audio mixing apparatus may further include a first sub audio track having a first sub audio track having the same sound data as at least a part of the sound data of the main audio track, And mixes the audio data with one of the first sub audio tracks. 11. The method of claim 10,
Wherein at least a part of the audio data of the main audio track is audio data in an audio frequency band of the main audio track. 12. The method of claim 11,
The acoustic mixing apparatus determines whether the first broadcast image file already includes the first sub audio track and generates the first sub audio track if the first broadcast image file does not include the first sub audio track And the television broadcasting system. 13. The method of claim 12,
Wherein the audio mixing apparatus analyzes a header of the first broadcast image file to determine whether the first broadcast image file includes the first sub audio track. 12. The method of claim 11,
Further comprising: a broadcast transmission system that broadcasts, unicasts, or multicasts a second broadcast image file stored in the second storage device. In a television broadcasting system,
An acoustic mixing device for receiving a series of streaming packets for a moving picture including a video track and a main audio track and for inserting non-audible sound waves into at least one streaming packet,
Wherein the audio mixing device is adapted to convert the non-audible sound wave into a streaming packet of the main audio track or a first stream of the first audio track if the moving picture includes a first sub- audio track having the same sound data as at least a part of the audio data of the main audio track. And to insert it into the streaming packet of the sub audio track. 16. The method of claim 15,
Wherein at least a part of the audio data of the main audio track is audio data in an audio frequency band of the main audio track. 16. The method of claim 15, wherein before inserting the non-audible sound wave into the streaming packet,
And to generate a streaming packet of the first sub-audio track if the moving picture already includes the first sub-audio track, and if the moving picture does not include the first sub-audio track, Broadcasting system. 18. The method of claim 17,
Wherein the determination is made by analyzing a header of a streaming packet of the moving picture to determine whether the moving picture includes the first sub audio track.

Images