KR101946471B1 - Apparatus and method for synchronizing video and audio - Google Patents

Apparatus and method for synchronizing video and audio Download PDF

Info

Publication number
KR101946471B1
KR101946471B1 KR1020150102951A KR20150102951A KR101946471B1 KR 101946471 B1 KR101946471 B1 KR 101946471B1 KR 1020150102951 A KR1020150102951 A KR 1020150102951A KR 20150102951 A KR20150102951 A KR 20150102951A KR 101946471 B1 KR101946471 B1 KR 101946471B1
Authority
KR
South Korea
Prior art keywords
audio
magic
video
stream
bit
Prior art date
Application number
KR1020150102951A
Other languages
Korean (ko)
Other versions
KR20170011049A (en
Inventor
이상훈
박성현
Original Assignee
주식회사 이노피아테크
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 이노피아테크 filed Critical 주식회사 이노피아테크
Priority to KR1020150102951A priority Critical patent/KR101946471B1/en
Publication of KR20170011049A publication Critical patent/KR20170011049A/en
Application granted granted Critical
Publication of KR101946471B1 publication Critical patent/KR101946471B1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/04—Synchronising
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/60—Receiver circuitry for the reception of television signals according to analogue transmission standards for the sound signals

Abstract

The present invention relates to an apparatus and method for synchronizing video and audio, and more particularly to a method and apparatus for separating a content into a video stream and an audio stream, inserting a magic beat at a predetermined position of the audio stream, And after transmitting the magic bit inserted audio stream, when the microphone receives the communication magic bit, it can compare with the corresponding index to synchronize the video stream with the audio stream .

Description

[0001] APPARATUS AND METHOD FOR SYNCHRONIZING VIDEO AND AUDIO [0002]

The following embodiments relate to an apparatus and method for synchronizing video and audio when a device for outputting video and a device for outputting audio are separated.

As the audio system develops today, audio output is increasing from mono channel to 2 channel, 3 channel and 5 channel, so audio quality is evolving.

Accordingly, in utilizing video contents, users often separate and output audio using a separate audio system.

However, if video and audio are played through different devices, there may be a problem that video and audio are not synchronized due to delays in transferring audio data and delays in devices playing audio. have.

This problem is even more apparent when data is wirelessly communicated to an audio device due to the development of short-range wireless communication technology.

In order to solve this problem, the user has to perform an operation to synchronize the video with the audio when the audio is reproduced from a separate device.

Therefore, there is a need for a method of performing synchronization automatically without requiring a user to perform synchronization directly.

SUMMARY OF THE INVENTION It is an object of the present invention to provide an apparatus and method for synchronizing video and audio.

More particularly, the present invention relates to an apparatus and method for inserting a magic bit for synchronization into an audio stream and providing the same to an audio apparatus, receiving a magic bit output through an audio apparatus through a microphone, and synchronizing an audio stream and a video stream The purpose is to provide.

According to an aspect of the present invention, there is provided a method of synchronizing video and audio, the method comprising: separating content into a video stream and an audio stream; Inserting a magic beat at a predetermined location of the audio stream; Inserting an index at a position of the video stream corresponding to a position at which the magic bit is inserted; Transmitting an audio stream in which the magic bit is inserted; Receiving the magic bit through a microphone, and synchronizing the video stream with the audio stream by comparing with the corresponding index; And outputting the synchronized video stream.

At this time, the magic bit can use a sound field other than an audible frequency as a sound signal for synchronization.

At this time, the magic bit can use a sound field capable of micro-input as a sound signal for synchronization.

In this case, the step of inserting the magic bit may insert the magic bit at a predetermined time interval.

In this case, the step of inserting the magic bit may insert the magic bit at a predetermined time interval during a predetermined time period.

At this time, when inserting the plurality of magic bits, the inserting the magic bits may insert different magic bits that can distinguish the respective ones.

In this case, when inserting the plurality of magic bits, the inserting the magic bits may insert a predetermined number of different magic bits according to a predetermined order.

According to an embodiment of the present invention, there is provided an apparatus for synchronizing video and audio, comprising: a separator for separating contents into a video stream and an audio stream; An inserter inserting a magic beat at a predetermined position of the audio stream and inserting an index at a position of the video stream corresponding to a position at which the magic bit is inserted; An audio transmission unit for transmitting an audio stream in which the magic bit is inserted; A microphone for receiving the magic bit outputted through a speaker; A synchronization unit for receiving the magic bit through the microphone and for synchronizing the video stream with the audio stream by comparing with the corresponding index; And a video output unit for controlling to output the synchronized video stream to the display unit.

At this time, the magic bit can use the micro-inputable range as a sound signal for synchronization, which is a sound range other than the audible frequency.

The present invention relates to an apparatus and method for inserting a magic bit for synchronization into an audio stream and providing the same to an audio apparatus and receiving a magic bit output through an audio apparatus through a microphone to synchronize an audio stream and a video stream, By inserting a magic bit into the audio stream, you can easily synchronize audio and video.

FIG. 1 is a diagram showing a configuration of an overall system for synchronizing audio and video according to an embodiment.
2 is a flowchart illustrating an example of a process of synchronizing audio and video in a synchronization apparatus according to an exemplary embodiment.
3 is a flowchart illustrating another example of a process of synchronizing audio and video in the synchronization apparatus according to one embodiment.
FIG. 4 is a flowchart illustrating another example of a process of synchronizing audio and video in a synchronizing apparatus according to an exemplary embodiment.
5 is a diagram illustrating the frequency domain of a magic bit added to an audio stream for synchronization in accordance with one embodiment.

Other objects and features of the present invention will become apparent from the following description of embodiments with reference to the accompanying drawings.

Preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

However, the present invention is not limited to or limited by the embodiments. Like reference symbols in the drawings denote like elements.

Hereinafter, an apparatus and method for synchronizing video and audio according to an embodiment of the present invention will be described in detail with reference to FIGS. 1 to 5.

FIG. 1 is a diagram showing a configuration of an overall system for synchronizing audio and video according to an embodiment.

Referring to FIG. 1, the system of the present invention can be roughly divided into a synchronization apparatus 100 and an audio apparatus 150. The synchronizing apparatus 100 includes a separating unit 102, an inserting unit 104, an audio transmitting unit 106, a microphone 108, a synchronizing unit 110, a video output unit 112, and a display unit 114 And the like.

The synchronization device 100 may be a portable terminal such as a smart phone or a tablet and the audio device 150 may be a portable terminal such as a smart phone or a tablet, An audio system in a vehicle or an audio system in a living room. That is, the user can listen to the video through the audio system of the vehicle while watching the video on the tablet in the vehicle.

At this time, a problem that the audio and the video are out of synchronization due to a delay that may occur during the transmission of the audio stream can be solved through the following configuration of the synchronization apparatus 100.

The separating unit 102 separates the content including video and audio into a video stream and an audio stream. At this time, the content may be received from an external device, or may use content stored in a storage unit (not shown).

The inserting unit 104 inserts a magic beat at a predetermined position of the audio stream and inserts an index at the position of the video stream corresponding to the position at which the magic bit is inserted.

At this time, the magic bit is a sound signal for synchronization, which has a large variation range and has a length longer than a predetermined length and is a signal corresponding to a non-general combination, and uses a sound range capable of micro-input as a sound signal for synchronization.

Also, the magic bit may use the range of the audible frequency that can be heard by a person, but may use the range other than the audible frequency, or may use the range set as shown in Fig.

5 is a diagram illustrating the frequency domain of a magic bit added to an audio stream for synchronization in accordance with one embodiment.

Referring to FIG. 5, the frequency domain of the magic bit 530 in the entire audio frequency domain 500 is an area excluding the domain 510 of the audio frequency in the micro-inputable domain 520.

Meanwhile, the inserter 104 can insert the magic bits in various ways.

As a first example, a magic bit can be inserted at a predetermined time interval.

As a second example, a magic bit can be inserted at predetermined time intervals during a predetermined time period. Here, the start time of the content will be suitable for the predetermined time region.

When inserting a plurality of magic bits, the inserting unit 104 may insert different magic bits that can distinguish each of them, or may insert a predetermined number of different magic bits in a predetermined order .

The audio transmission unit 106 transmits the audio stream in which the magic bit is inserted to the audio device 150 by wire or wirelessly. At this time, wireless communication can be WiFi, Bluetooth communication, and the like.

The audio device 150 may include an audio receiver 152, an audio controller 154, and a speaker 156.

The audio receiving unit 152 receives an audio stream in which a magic bit is inserted from the synchronizing apparatus 100 by wire or wirelessly.

The audio controller 154 controls the audio receiver 152 to output an audio stream having a magic bit inserted thereto through the speaker 156.

At this time, since the audio device 150 performs the operation of outputting the received audio stream, it does not check whether the magic bit is inserted or not. Therefore, there is no difference from existing audio devices.

The synchronization unit 110 receives the magic bit outputted through the speaker 156 of the audio device 150 through the microphone 108 and compares the index with the index corresponding to the received magic bit to synchronize the video stream with the audio stream do.

At this time, the synchronization method may be a method of adjusting a playback point of a video stream, a method of adjusting a time point of transmitting an audio stream to the audio device 150, and the like.

The video output unit 112 controls the display unit 1140 to output the video stream synchronized by the synchronization unit 110.

The display unit 114 displays status information (or an indicator), limited numbers and characters, a moving picture, and a still picture, which are generated during operation of the synchronizing apparatus 100. It is also possible to display a synchronized video stream according to the invention.

The synchronizing apparatus 100 of the present invention includes a separating unit 102, an inserting unit 104, an audio transmitting unit (not shown) 106, a microphone 108, and a synchronization unit 110.

Hereinafter, a method of synchronizing video and audio according to the present invention will be described with reference to the drawings.

2 is a flowchart illustrating an example of a process of synchronizing audio and video in a synchronization apparatus according to an exemplary embodiment.

Referring to FIG. 2, the synchronization apparatus 100 separates the content into a video stream and an audio stream (210).

Then, the synchronization apparatus 100 inserts a magic beat at a predetermined position of the audio stream (212).

In this case, the magic bit is a sound signal for synchronization, which has a large variation range and has a length longer than a predetermined length, and is a signal corresponding to a non-general combination.

Magicbit can use a range that can be micro-input, or a range that can be micro-input other than audio frequency.

Then, the synchronization apparatus 100 inserts an index at the position of the video stream corresponding to the position at which the magic bit is inserted (214).

Then, the synchronization apparatus 100 transmits the audio bit into which the magic bit is inserted to the audio apparatus 150 (216).

When the synchronization device 100 receives the magic bit through the microphone 218,

And compares the video stream with the audio stream in comparison with the corresponding index (220).

Then, the synchronization apparatus 100 outputs the synchronized video stream (222).

3 is a flowchart illustrating another example of a process of synchronizing audio and video in the synchronization apparatus according to one embodiment.

Referring to FIG. 3, the synchronization apparatus 100 separates the content into a video stream and an audio stream (310).

Then, the synchronization apparatus 100 inserts a magic beat at a predetermined position of the audio stream (312).

In this case, the magic bit is a sound signal for synchronization, which has a large variation range and has a length longer than a predetermined length, and is a signal corresponding to a non-general combination.

Magicbit can use a range that can be micro-input, or a range that can be micro-input other than audio frequency.

The synchronization apparatus 100 inserts an index at the position of the video stream corresponding to the position at which the magic bit is inserted (314).

Then, the synchronization apparatus 100 transmits the audio bit in which the magic bit is inserted to the audio apparatus 150 (316).

When the synchronization device 100 receives the magic bit through the microphone (318)

The video stream is compared with the corresponding index to synchronize 320 with the audio stream.

Then, the synchronization apparatus 100 outputs the synchronized video stream (322).

Then, the synchronization apparatus 100 confirms whether the content has been terminated (324).

If it is determined in step 324 that the content has not been terminated, the synchronization apparatus 100 returns to step 312 after a predetermined time has elapsed (step 326).

When inserting a plurality of magic bits in step 312, it is possible to insert different magic bits that can distinguish each of them, or may insert a predetermined number of different magic bits in a predetermined order.

FIG. 4 is a flowchart illustrating another example of a process of synchronizing audio and video in a synchronizing apparatus according to an exemplary embodiment.

Referring to FIG. 4, the synchronization apparatus 100 separates contents into a video stream and an audio stream (410).

Then, the synchronization apparatus 100 inserts a magic beat at a predetermined position of the audio stream (412).

In this case, the magic bit is a sound signal for synchronization, which has a large variation range and has a length longer than a predetermined length, and is a signal corresponding to a non-general combination.

Magicbit can use a range that can be micro-input, or a range that can be micro-input other than audio frequency.

The synchronization apparatus 100 inserts an index at the position of the video stream corresponding to the position at which the magic bit is inserted (414).

Then, the synchronization apparatus 100 transmits the audio bit in which the magic bit is inserted to the audio apparatus 150 (416).

When the synchronization device 100 receives the magic bit through the microphone 418,

The video stream is compared with the corresponding index to synchronize with the audio stream (420).

Then, the synchronization apparatus 100 outputs the synchronized video stream (422).

Then, the synchronization apparatus 100 confirms whether the interval for setting the synchronization has ended (424).

If it is determined in step 424 that the interval for establishing the synchronization has not been completed, the synchronization apparatus 100 returns to step 412 after a predetermined time has elapsed (step 426).

In the case of inserting a plurality of magic bits in step 412, it is possible to insert different magic bits that can distinguish each of them, or may insert a predetermined number of different magic bits according to a predetermined order.

If it is determined in step 424 that the interval for setting the synchronization has ended, the synchronization apparatus 100 transmits the remaining audio stream that has not yet been transmitted to the audio apparatus, and outputs the remaining video stream that has not been output to the display, (428). In step 428, no magic bit is inserted into the audio stream transmitted.

The method of synchronizing video and audio according to an embodiment of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

As described above, the present invention has been described with reference to particular embodiments, such as specific elements, and specific embodiments and drawings. However, it should be understood that the present invention is not limited to the above- And various modifications and changes may be made thereto by those skilled in the art to which the present invention pertains.

Accordingly, the spirit of the present invention should not be construed as being limited to the embodiments described, and all of the equivalents or equivalents of the claims, as well as the following claims, belong to the scope of the present invention .

100; Synchronization device
102; Separating portion
104; The insertion portion
106; Audio transmitter
108; MIC
110; The synchronization unit
112; Video output unit
114; Display portion
150; Audio device

Claims (10)

Separating the content into a video stream and an audio stream;
Inserting a magic beat at a predetermined location of the audio stream;
Inserting an index corresponding to the magic bit at a position of the video stream corresponding to a position at which the magic bit is inserted;
Transmitting an audio stream in which the magic bit is inserted;
Receiving the magic bit through a microphone, and synchronizing the video stream with the audio stream by comparing with the corresponding index; And
Outputting the synchronized video stream
Lt; / RTI >
The magic bit
As a sound signal for synchronization, use a non-audible frequency range that can be micro-input.
How to sync video and audio.
delete delete The method according to claim 1,
The step of inserting the magic bit comprises:
And inserting the magic bit at a predetermined time interval
How to sync video and audio.
The method according to claim 1,
The step of inserting the magic bit comprises:
And inserting the magic bits at predetermined time intervals during a predetermined time period
How to sync video and audio.
The method according to claim 1,
The step of inserting the magic bit comprises:
When inserting a plurality of magic bits, a different magic bit that can distinguish each of them is inserted
How to sync video and audio.
The method according to claim 1,
The step of inserting the magic bit comprises:
When a plurality of magic bits are inserted, a predetermined number of different magic bits are inserted in a predetermined order
How to sync video and audio.
A computer-readable recording medium having recorded thereon a program for executing the method according to any one of claims 1 and 4 to 7.
A separator for separating the content into a video stream and an audio stream;
Inserting a magic beat at a predetermined position of the audio stream and inserting an index corresponding to the magic bit at a position of the video stream corresponding to a position at which the magic bit is inserted;
An audio transmission unit for transmitting an audio stream in which the magic bit is inserted;
A microphone for receiving the magic bit outputted through a speaker;
A synchronization unit for receiving the magic bit through the microphone and for synchronizing the video stream with the audio stream by comparing with the corresponding index; And
A video output unit for controlling the output of the synchronized video stream to the display unit
Lt; / RTI >
The magic bit
As a sound signal for synchronization, use a non-audible frequency range that can be micro-input.
A device that synchronizes video and audio. delete
KR1020150102951A 2015-07-21 2015-07-21 Apparatus and method for synchronizing video and audio KR101946471B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150102951A KR101946471B1 (en) 2015-07-21 2015-07-21 Apparatus and method for synchronizing video and audio

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150102951A KR101946471B1 (en) 2015-07-21 2015-07-21 Apparatus and method for synchronizing video and audio

Publications (2)

Publication Number Publication Date
KR20170011049A KR20170011049A (en) 2017-02-02
KR101946471B1 true KR101946471B1 (en) 2019-02-11

Family

ID=58151764

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150102951A KR101946471B1 (en) 2015-07-21 2015-07-21 Apparatus and method for synchronizing video and audio

Country Status (1)

Country Link
KR (1) KR101946471B1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11789526B2 (en) 2021-08-10 2023-10-17 Samsung Electronics Co., Ltd. Method and electronic system for outputting video data and audio data
CN113691886A (en) * 2021-08-25 2021-11-23 三星电子（中国）研发中心 Downloading method and device of streaming media file

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11346348A (en) * 1998-06-02 1999-12-14 Nec Corp Video/audio synchronization method and video/audio multiplexer
KR100644562B1 (en) * 1999-08-20 2006-11-13 삼성전자주식회사 Apparatus for synchronizing audio/video signal and method thereof
KR100745250B1 (en) * 2005-05-20 2007-08-01 엘지전자 주식회사 Computer recordable medium recording multimedia file for audio/video syncronization and syncronizing device of audio/video
KR20130087678A (en) * 2012-01-30 2013-08-07 오픈스택 주식회사 The apparatus and method for lip sync control between audio from the speaker and video from the tvset

Also Published As

Publication number Publication date
KR20170011049A (en) 2017-02-02

Similar Documents

Publication Publication Date Title
US10178345B2 (en) Apparatus, systems and methods for synchronization of multiple headsets
US20170034263A1 (en) Synchronized Playback of Streamed Audio Content by Multiple Internet-Capable Portable Devices
TWI539851B (en) Frame sync across multiple channels
US9942684B2 (en) Audio signal processing method and audio signal processing apparatus
CN102577360B (en) Synchronized playback of media players
TWI556656B (en) Audio player with bluetooth function and audio playing method thereof
JP2004007140A (en) Voice reproducing device and voice reproduction control method to be used for the same device
EP3175456B1 (en) Noise suppression system and method
KR101662684B1 (en) Method for synchronous playback by multiple smart devices, and apparatus
CN110428798B (en) Method for synchronizing voice and accompaniment, Bluetooth device, terminal and storage medium
KR101946471B1 (en) Apparatus and method for synchronizing video and audio
US20220182712A1 (en) Synchronizing audio of a secondary-language audio track
WO2018206287A1 (en) Obtention of latency information in a wireless audio system
US9286382B2 (en) Method and system for simultaneous playback of audio tracks from a plurality of digital devices
US10181312B2 (en) Acoustic system, communication device, and program
CN112105005A (en) Method and device for controlling Bluetooth equipment to play
CN105810221A (en) Wireless synchronous audio play system
CN113613221B (en) TWS master device, TWS slave device, audio device and system
CN113613148B (en) Audio superposition control method and device, audio equipment and system
EP3486789A1 (en) Content reproduction device, content reproduction system, and method for controlling content reproduction device
KR101838608B1 (en) Multi play synchronization apparatus and control method thereof, contents play program
CN113613125A (en) Audio synchronization control method and device, audio equipment and system
JP5223409B2 (en) Digital radio, control method and program
KR101582472B1 (en) Wireless audio palying method and audio source performing the same
JP2013114723A (en) Information processing device, information processing method, and program

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right
GRNT Written decision to grant