KR20130087678A - The apparatus and method for lip sync control between audio from the speaker and video from the tvset - Google Patents
The apparatus and method for lip sync control between audio from the speaker and video from the tvset Download PDFInfo
- Publication number
- KR20130087678A KR20130087678A KR1020120008705A KR20120008705A KR20130087678A KR 20130087678 A KR20130087678 A KR 20130087678A KR 1020120008705 A KR1020120008705 A KR 1020120008705A KR 20120008705 A KR20120008705 A KR 20120008705A KR 20130087678 A KR20130087678 A KR 20130087678A
- Authority
- KR
- South Korea
- Prior art keywords
- audio signal
- speaker
- delay time
- time
- detected
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/04—Synchronising
- H04N5/08—Separation of synchronising signals from picture signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
- H04N5/60—Receiver circuitry for the reception of television signals according to analogue transmission standards for the sound signals
Abstract
The present invention relates to a device for adjusting a sync between an image output from a TV set and an audio signal output from a speaker. A specific frequency detector for detecting an audio signal corresponding to a waveform; a time when the audio signal of a specific waveform of a specific frequency output from the speaker is detected through the specific frequency detector and a specific frequency output from the speaker of the TV set A delay time calculating unit for calculating a signal delay time of the TV set with respect to the speaker by comparing the detected time of an audio signal of a waveform, and being output from the delay time calculating unit to the speaker in proportion to the signal delay time of the TV set And a delay time controller for delaying the audio signal.
Accordingly, the present invention delays the audio signal output to the speaker when the sync of the video signal output from the TV set and the audio signal output from the speaker due to the delay time difference of each signal, the video signal and the speaker output from the TV set This has the effect of automatically syncing the audio signal output from.
In addition, by providing the sync control device of the present invention in each classroom, there is an effect of automatically matching the sync of the video signal output from the TV set and the audio signal output from the speaker according to the environment of each classroom.
Description
The present invention relates to an apparatus and a method for controlling a sync of an image output from a TV set and an audio signal output from a speaker, and in particular, a sync of an image signal output from a TV set and an audio signal output from a speaker. The present invention relates to a sync control apparatus and method for synchronizing an audio signal output from a speaker with a video signal output from a TV set by delaying an audio signal output from a speaker when the delay time does not match.
Recently, each school has a broadcasting room equipped with a camera and a microphone. In such a broadcasting room, all students transmit a video signal input from a camera and an audio signal input from a microphone to a TV installed in each classroom. You can enjoy the video and audio from the video.
In general, however, the TV in each classroom is equipped in the front, and there is a limit in controlling the audio volume greatly, so that the students sitting behind the classroom have difficulty in sounding.
Therefore, the video signal is output from the TV set, and the audio signal is output from the speakers installed in each classroom so that the students sitting in the back of the classroom can hear the sound well. There was an inconvenience that the audio signal was not well synchronized.
To overcome this problem, a method of delaying an audio signal output to a speaker using a signal delay device has been implemented.
1 is a perspective view showing a broadcast transmitting device and a signal delay device in the related art.
As shown in FIG. 1, an audio signal input from the
However, in order to transmit the video signal input from the
In order to solve this problem, a method of delaying the audio signal output to the speaker is provided by installing a
However, by measuring the time difference between the audio signal output from the speaker and the video signal output to the TV set, the conventional method of delaying the signal output to the speaker manually, the audio signal output to the speaker and the image output to the TV set There was a difficulty in accurately synchronizing the signal, and it was cumbersome to use.
In addition, for example, when the audio broadcasting and video signals are transmitted from the school broadcasting room to the speakers and TV sets installed in each classroom, the delay time of the audio signals may vary depending on the location and environment of the classroom, so that the audio There was a difficulty in delaying the signal.
The present invention has been made to solve the above-mentioned problems, and when the sync of the video signal output from the TV set and the audio signal output from the speaker does not match due to the delay time difference of each signal automatically outputs the audio signal output to the speaker The present invention relates to a sync control device and a method for adjusting the sync between the video signal output from a TV set and the audio signal output from a speaker.
In order to achieve the above object, a sync control apparatus for an image output from a TV set and an audio signal output from a speaker includes a microphone for detecting an audio signal output from a speaker and a speaker of the TV set, and detected through the microphone. A specific frequency detector for detecting an audio signal corresponding to a specific waveform of a specific frequency among audio signals, a time for detecting an audio signal of a specific waveform of a specific frequency output from the speaker through the specific frequency detector and a speaker of the TV set A delay time calculating unit for comparing the detected time of an audio signal of a specific waveform output from a specific frequency and calculating a signal delay time of the TV set with respect to the speaker, wherein the delay time calculating unit is used to determine the signal delay time of the TV set. A delay time delay that proportionally delays the audio signal output to the speaker It includes parts.
In addition, the delay time calculating unit determines that the first detected audio signal as the audio signal output through the speaker when a specific waveform of two specific frequencies are detected within the predetermined time through the microphone, the second detected audio The signal is determined to be an audio signal output through the TV.
The sync control apparatus of the image output from the TV set and the audio signal output from the speaker of the present invention is a microphone for detecting the audio signal output from the speaker and the speaker of the TV set, the specific frequency of the audio signal detected through the microphone A specific frequency detector for detecting an audio signal corresponding to a waveform; a time when the audio signal of a specific waveform of a specific frequency output from the speaker is detected through the specific frequency detector and a specific frequency output from the speaker of the TV set A delay unit calculating a signal delay time of the TV set with respect to the speaker by comparing the detected time of an audio signal of a waveform, a communication unit transferring a signal delay time of the TV set calculated through the delay time calculator; The switch in proportion to the signal delay time of the TV set received through the communication unit And a first delay time controller configured to delay the audio signal output to the beaker, wherein the first delay time controller receives an image signal and an audio signal through a camera and a microphone and outputs the signal to the TV set and the speaker. Include.
The apparatus may further include a second delay time controller configured to delay the audio signal received from the broadcast transmission device for a predetermined time and output the delayed audio signal to the speaker, wherein the second delay time controller is a signal delay of the TV set in the first delay time controller. If only part of the time t1 of the time T = t1 + t2) delays the audio signal, the audio signal output to the speaker is delayed for the remaining time t2 except for the partial time.
In addition, the TV set and the speaker receives and outputs an audio signal to which an audio signal of a specific waveform corresponding to an inaudible frequency is added to an audio signal input from a microphone from a broadcasting transmission device at predetermined time intervals, and outputs the audio signal. The apparatus includes an inaudible frequency insert for inserting the inaudible frequency.
In the sync control device of the present invention, a method of synchronizing an image of a TV set with an audio signal of a speaker is performed by a delay notification device. When an audio signal corresponding to a specific waveform of two specific frequencies is detected within a predetermined time, (A) determining the audio signal corresponding to the specific waveform of the first detected specific frequency as the audio signal output from the speaker and detecting the detected time, the corresponding waveform of two specific frequencies detected within the predetermined time (B) determining an audio signal corresponding to a specific waveform of a second detected specific frequency among audio signals as an audio signal output from the speaker of the TV set, and detecting the detected time; detecting the detected audio signal from the speaker To the speaker based on the detected time and the time when the audio signal output from the speaker of the TV set is detected. And a step (c) and (d) for delaying the audio signal in proportion to the signal delay of the TV set to be output to the speaker for calculating a signal delay time of the TV set.
In the sync control apparatus of the present invention, a method of synchronizing an image of a TV set with an audio signal of a speaker is performed when the delay notification device detects an audio signal corresponding to a specific waveform of two specific frequencies within a predetermined time. (A) determining the audio signal corresponding to the specific waveform of the audio signal output from the speaker and detecting the detected time, wherein the delay notification device corresponds to the specific waveform of two specific frequencies detected within the predetermined time. (B) determining an audio signal corresponding to a specific waveform of a second detected specific frequency among audio signals as an audio signal output from a speaker of a TV set, and detecting a detected time, wherein the delay notification device outputs from the speaker The time when the detected audio signal was detected and the time when the audio signal output from the speaker of the TV set was detected. (C) calculating and transmitting the signal delay time of the TV set with respect to the speaker with a hot water; and transmitting the audio signal to the delay notification device by delaying an audio signal by a part of the signal delay time of the TV set. In step (d), the delay notification device delays the audio signal by the remaining time except for the time delayed in step (d) of the signal delay time of the TV set and outputs it to the speaker.
The present invention delays the audio signal output to the speaker when the sync of the video signal output from the TV set and the audio signal output from the speaker is not matched due to the delay time difference of each signal output from the video signal and the speaker output from the TV set There is an effect of automatically syncing the audio signal.
In addition, by providing the sync control device of the present invention in each classroom, there is an effect of automatically matching the sync of the video signal output from the TV set and the audio signal output from the speaker according to the environment of each classroom.
1 is a perspective view showing a conventional broadcast transmitting device and a signal delay device;
2 is an internal configuration diagram of a sink adjusting device according to an embodiment of the present invention;
3 is an internal configuration diagram of a sink adjusting device according to another embodiment of the present invention;
4 is a flowchart illustrating a process of synchronizing an image signal output from a TV set with an audio signal output from a speaker through a sync control device according to an embodiment of the present invention;
5 is a view illustrating a time difference between an image signal output from a TV set and an audio signal output from a speaker according to an exemplary embodiment of the present invention.
DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention.
2 is an internal configuration diagram of a sink control apparatus according to an embodiment of the present invention.
Referring to FIG. 2, the
The sink control device includes a
The
The
The
The
The multiplexing and
In this case, the multiplexing and transport
Here, the program specification information is composed of a total of four tables such as a program association table (PAT), a program map table (PMT), a network information table (NIT), and a conditional access table (CAT).
In addition, program and system information protocols include STT (System Time Table), MGT (Master Guide Table), VCT (Virtual Channal Table), RRT (Rating Region Table), EIT (Event Information Table), ETT (Extended Text Table), etc. It consists of a table.
In addition, music-related data includes information such as music title, artist, genre, and the like.
The
At this time, the modulation method is determined according to the digital broadcasting method. In the case of the Advanced Television System Committee (ATSC) method, 8-VSB (Vestigial Side Band) modulation method is used.
The first
The first
In this case, when the digital audio signal is input from the microphone, the audio signal input from the microphone is directly transmitted to the first
On the other hand, in the case of an audio signal output to a speaker of a TV set in general, the time taken for the audio signal and the video signal to be compressed and modulated by the multiplexing and
Therefore, the first
The inaudible
In this case, it is preferable that a specific waveform of a specific frequency becomes an inaudible frequency, and the inaudible frequency is not inserted between the audio signals, but is preferably loaded together at regular intervals.
In this case, the
In this case, the inaudible
If the inaudible
The D /
The
The
The
In this case, a modified discrete cosine transform (MDCT) method may be used as a method of converting an audio signal into a frequency domain, and a detailed description thereof will be omitted.
In addition, according to an embodiment of the present invention, it is preferable that a specific waveform of a specific frequency detected by the specific
If it is determined that the audio signal corresponding to the inaudible frequency is detected in the specific waveform of the specific frequency through the
The
3 is a perspective view of a sink control apparatus according to another embodiment of the present invention.
3 is a configuration in which the second
In this case, the second
That is, the first
In another embodiment of the present invention, when the first
In addition, the second
For example, in the first classroom, when the signal delay time of the TV set occurred 3.1 seconds, the second classroom, the signal delay time of the TV set 3.0 seconds occurs, the first
In this case, the second delay
In this case, the audio can be tuned to satisfy all of the slightly different delay differences in each classroom.
In addition, as shown in FIG. 3 of the present invention, the first
FIG. 4 is a flowchart illustrating a process of matching a sync of an image output from a TV set with an audio output from a speaker through a sync adjusting device according to an embodiment of the present invention, and FIG. 5 is a flowchart of a TV set according to an embodiment of the present invention. This is a view for explaining the time difference between the audio output from the audio output from the speaker.
4 and 5, if an audio signal is detected through a microphone in operation S401, the
When the
In operation S404, the
In operation S405, the
In operation S406, the
Then, the first
In this way, when an image is output from the TV set, an audio signal corresponding thereto may be output from the speaker.
Meanwhile, in the detailed description of the present invention, the first
The first delay
In this case, in each classroom where the same audio signal and video signal are broadcast, the audio signal output to the speaker may be delayed in accordance with the signal delay time of the TV set that varies depending on the environment of each classroom.
In addition, as shown in FIG. 5, the broadcast is terminated by transmitting an audio signal corresponding to a specific waveform, i.e., an inaudible frequency, of a specific frequency at a predetermined time interval to a TV set and a speaker by adding the audio signal input from the microphone. Periodically until the inaudible frequency specifies the signal delay time of the TV set for the speaker, thereby delaying the audio signal output to the speaker.
By doing so, it is possible to synchronize the video signal of the TV set with the audio signal of the speaker from the beginning of the broadcast to the end.
In the above description has been described by presenting a preferred embodiment of the present invention, the present invention is not necessarily limited thereto, and those skilled in the art to which the present invention pertains should be within the scope not departing from the technical spirit of the present invention. It will be readily appreciated that various substitutions, modifications and variations can be made.
100: broadcast device 200: broadcast transmission device
210: Receiver 220: Video encoder
230: audio encoder 240: multiplexing and transport stream generation unit
250: modulator 260: A / D converter
270: first delay time control unit 280: inaudible frequency insertion unit
290: D / A converter 300: broadcast receiving device
400: delay notification device 410: microphone
420: specific frequency detection unit 430: delay time calculation unit
440: communication unit 450: second delay time control unit
Claims (7)
A specific frequency detector configured to detect an audio signal corresponding to a specific waveform of a specific frequency among the audio signals detected through the microphone;
By comparing the time of detecting the audio signal of a specific waveform of a specific frequency output from the speaker with the specific frequency detection unit and the time of detecting the audio signal of a specific waveform of a specific frequency output from the speaker of the TV set, the speaker A delay time calculating unit for calculating a signal delay time of the TV set with respect to the apparatus;
And a delay time control unit for delaying the audio signal output to the speaker in proportion to the signal delay time of the TV set by the delay time calculator.
When a specific waveform of two specific frequencies is detected within the predetermined time through the microphone, the first detected audio signal is determined as the audio signal output through the speaker, and the second detected audio signal is determined through the TV. And a control device for synchronizing the video signal of the TV set and the audio signal of the speaker, which is determined as an output audio signal.
A specific frequency detector configured to detect an audio signal corresponding to a specific waveform of a specific frequency among the audio signals detected through the microphone;
By comparing the time of detecting the audio signal of a specific waveform of a specific frequency output from the speaker with the specific frequency detection unit and the time of detecting the audio signal of a specific waveform of a specific frequency output from the speaker of the TV set, the speaker A delay time calculating unit for calculating a signal delay time of the TV set with respect to the apparatus;
A communication unit for transmitting a signal delay time of the TV set calculated through the delay time calculating unit;
And a first delay time controller configured to delay an audio signal output to the speaker in proportion to a signal delay time of the TV set received through the communication unit.
The first delay time control unit includes a video signal and an audio signal of the TV set and the audio signal of the speaker, characterized in that included in the broadcast transmission device for receiving the video signal and audio signal through the camera and the microphone and output to the TV set and the speaker. Sink Control.
A second delay time control unit for delaying the audio signal received from the broadcast transmission device for a predetermined time to output to the speaker,
The second delay time controller, when the first delay time controller delays an audio signal only a part of time t1 of the signal delay time (T = t1 + t2) of the TV set, and t2) delaying the audio signal output to the speaker.
Receives and outputs an audio signal to which an audio signal of a specific waveform corresponding to an inaudible frequency is added to an audio signal input from a microphone from a broadcasting transmitter at predetermined time intervals.
The broadcast transmission device is a sink control device for the audio signal of the video signal and the speaker of the TV set, characterized in that it comprises an inaudible frequency insertion unit for inserting the inaudible frequency.
When an audio signal corresponding to a specific waveform of two specific frequencies is detected within a predetermined time, the audio signal corresponding to the specific waveform of the first detected specific frequency is determined as an audio signal output from the speaker, and the detected time is detected ( step a);
The audio signal corresponding to the specific waveform of the second detected specific frequency among the audio signals corresponding to the specific waveform of the two specific frequencies detected within the predetermined time is determined as the audio signal output from the speaker of the TV set, and the detected time is determined. Detecting (b);
(C) calculating a signal delay time of the TV set for the speaker based on a time when the audio signal output from the speaker is detected and a time when the audio signal output from the speaker of the TV set is detected; And
And (d) delaying an audio signal output to the speaker in proportion to the signal delay time of the TV set.
The delay notification device determines that the audio signal corresponding to the specific waveform of the second detected specific frequency is the audio signal output from the speaker of the TV set among the audio signals corresponding to the specific waveform of the two specific frequencies detected within the predetermined time. (B) detecting the detected time;
The delay notification device calculates and transmits the signal delay time of the TV set for the speaker based on the time when the audio signal output from the speaker is detected and the time when the audio signal output from the speaker of the TV set is detected. (c) step; And
(D) transmitting, by the broadcast transmitting device, the audio signal to the delay notification device by delaying an audio signal by a part of the signal delay time of the TV set;
And (e) outputting the audio signal to the speaker by the delay notification device delaying the audio signal by the remaining time except the time delayed in step (d) of the signal delay time of the TV set. To sync audio signal from speakers with speaker.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020120008705A KR20130087678A (en) | 2012-01-30 | 2012-01-30 | The apparatus and method for lip sync control between audio from the speaker and video from the tvset |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020120008705A KR20130087678A (en) | 2012-01-30 | 2012-01-30 | The apparatus and method for lip sync control between audio from the speaker and video from the tvset |
Publications (1)
Publication Number | Publication Date |
---|---|
KR20130087678A true KR20130087678A (en) | 2013-08-07 |
Family
ID=49214297
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020120008705A KR20130087678A (en) | 2012-01-30 | 2012-01-30 | The apparatus and method for lip sync control between audio from the speaker and video from the tvset |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR20130087678A (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20170011049A (en) * | 2015-07-21 | 2017-02-02 | 주식회사 이노피아테크 | Apparatus and method for synchronizing video and audio |
WO2018199347A1 (en) * | 2017-04-25 | 2018-11-01 | 주식회사 제이디솔루션 | Complex speaker system capable of simultaneously outputting ultra-directional and non-directional signals |
WO2019156389A1 (en) * | 2018-02-06 | 2019-08-15 | 삼성전자주식회사 | Display apparatus and audio system including same |
US10732927B2 (en) | 2018-10-12 | 2020-08-04 | Samsung Electronics Co., Ltd. | Electronic device and control method thereof |
WO2020256184A1 (en) * | 2019-06-20 | 2020-12-24 | 엘지전자 주식회사 | Display device |
WO2022065952A3 (en) * | 2020-09-28 | 2022-05-19 | 삼성전자 주식회사 | Electronic device for performing synchronization of video data and audio data, and control method therefor |
US11789526B2 (en) | 2021-08-10 | 2023-10-17 | Samsung Electronics Co., Ltd. | Method and electronic system for outputting video data and audio data |
-
2012
- 2012-01-30 KR KR1020120008705A patent/KR20130087678A/en not_active Application Discontinuation
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20170011049A (en) * | 2015-07-21 | 2017-02-02 | 주식회사 이노피아테크 | Apparatus and method for synchronizing video and audio |
WO2018199347A1 (en) * | 2017-04-25 | 2018-11-01 | 주식회사 제이디솔루션 | Complex speaker system capable of simultaneously outputting ultra-directional and non-directional signals |
WO2019156389A1 (en) * | 2018-02-06 | 2019-08-15 | 삼성전자주식회사 | Display apparatus and audio system including same |
US10732927B2 (en) | 2018-10-12 | 2020-08-04 | Samsung Electronics Co., Ltd. | Electronic device and control method thereof |
WO2020256184A1 (en) * | 2019-06-20 | 2020-12-24 | 엘지전자 주식회사 | Display device |
US11887588B2 (en) | 2019-06-20 | 2024-01-30 | Lg Electronics Inc. | Display device |
WO2022065952A3 (en) * | 2020-09-28 | 2022-05-19 | 삼성전자 주식회사 | Electronic device for performing synchronization of video data and audio data, and control method therefor |
US11789526B2 (en) | 2021-08-10 | 2023-10-17 | Samsung Electronics Co., Ltd. | Method and electronic system for outputting video data and audio data |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR20130087678A (en) | The apparatus and method for lip sync control between audio from the speaker and video from the tvset | |
CN105940679B (en) | Method and apparatus for synchronizing the playback at two electronic equipments | |
CN1918609B (en) | Remote control system and related method and apparatus | |
MX2010002144A (en) | Digital broadcasting receiver and method for controlling the same. | |
BR112013006943A2 (en) | receiver, method of receiving a receiver, and program for controlling a receiver | |
EP2583452A4 (en) | Method and apparatus for providing digital broadcasting service with 3-dimensional subtitle | |
TW201145887A (en) | Data feedback for broadcast applications | |
US20080310460A1 (en) | Deterministic Program Clock Reference Re-stamping for Synchronous Bit Rate Adaptation based on Mega-frame Initialization Packet | |
WO2008157549A3 (en) | Apparatus and methods of enhancing radio programming | |
US20060233266A1 (en) | Content processing device, content transmitting device, content receiving device, content distribution system, content synchronization program, and recording medium | |
TW202114432A (en) | Use of in-band metadata as basis to access reference fingerprints to facilitate | |
JP6603105B2 (en) | Broadcast communication system, broadcast communication apparatus, and broadcast communication method | |
JP5383520B2 (en) | Relay device, program, system, and method for correcting loss of synchronization between video frame and audio frame | |
KR20160065510A (en) | Method for producing video file or streaming packet including non-audible sound wave and television broadcasting system using the method | |
KR101425821B1 (en) | System and method for sending digital multimedia broadcasting information by means of sound wave communication based-audio signal, and apparatus applied to the same | |
KR101954880B1 (en) | Apparatus and Method for Automatic Subtitle Synchronization with Smith-Waterman Algorithm | |
KR20180058615A (en) | Apparatus for converting broadcasting signal method for using the same | |
KR101030806B1 (en) | System for monitoring automation of broadcast and advertisement contents | |
WO2021009255A9 (en) | Latency management for content delivery | |
JP6765246B2 (en) | Transmitter and program | |
KR100762649B1 (en) | Method for setting volume automatically in digital broadcasting receiving apparatus and system thereof | |
JP2019047287A (en) | Broadcast communication system, broadcast communication apparatus, and broadcast communication method | |
JP6280077B2 (en) | Synchronous broadcast system, transmitter | |
JP2020115626A (en) | Subtitle delay control device, control method and program | |
KR100781685B1 (en) | Digital speaker broadcasting system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A201 | Request for examination | ||
E902 | Notification of reason for refusal | ||
E601 | Decision to refuse application |