KR20120074700A - Audio apparatus and display apparatus having the same, apparatus and method for compensating lipsync with external device - Google Patents

Audio apparatus and display apparatus having the same, apparatus and method for compensating lipsync with external device Download PDF

Info

Publication number
KR20120074700A
KR20120074700A KR1020100136618A KR20100136618A KR20120074700A KR 20120074700 A KR20120074700 A KR 20120074700A KR 1020100136618 A KR1020100136618 A KR 1020100136618A KR 20100136618 A KR20100136618 A KR 20100136618A KR 20120074700 A KR20120074700 A KR 20120074700A
Authority
KR
South Korea
Prior art keywords
audio
signal
speaker
time
speaker unit
Prior art date
Application number
KR1020100136618A
Other languages
Korean (ko)
Inventor
장준덕
Original Assignee
엘지전자 주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 엘지전자 주식회사 filed Critical 엘지전자 주식회사
Priority to KR1020100136618A priority Critical patent/KR20120074700A/en
Publication of KR20120074700A publication Critical patent/KR20120074700A/en

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/005Correction of errors induced by the transmission channel, if related to the coding algorithm
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10Digital recording or reproducing
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43632Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wired protocol, e.g. IEEE 1394
    • H04N21/43635HDMI
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/91Television signal processing therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

PURPOSE: An audio device and a display device with the same, and a lip sync correcting device and a method thereof are provided to compensate for a delayed time difference due to audio sound decoding and encoding operations of an external device. CONSTITUTION: An audio device comprises the following units. A first receiving unit(401) receives an audio signal. A transmitting unit transmits the audio signal and the test signal to an external device. A second receiving unit(405) receives a return signal in response to the test signal. A speaker outputs a voice in response to the audio signal and adjusts voice output timing about the audio signal according to the return signal. The speaker synchronizes voice output timing with the voice output timing of the external device.

Description

Audio device and display device, lip sync correction device and method including the same {Audio Apparatus and Display Apparatus having the same, Apparatus and method for compensating lipsync with external device}

The present invention relates to an audio device, a display device including the same, a lip sync correction device and a method thereof.

A / V receivers, which are typically used in home theaters and the like, are commonly used to connect to televisions (S / PDIF) via Sony / Philips Digital Interconnect Format (S / PDIF) ports. do.

On the other hand, the television (TV), for example, as shown in Figure 1, analog stereo audio input port 10, audio decoder 11, component port 12, HMI (HDMI: High Definition) Multimedia Interface) port 13, HDMI switch 14, S / PDIF port 15, the main board 16, the display unit 17, the amplifier 18, the speaker 19 and the like.

In addition, the main board 16 includes an audio processor 16a, a video processor 16b, a controller 16c, and the like, for example, a digital signal processed by the audio processor 16a. The audio signal is amplified by the amplifier 18 and then output as sound through the speaker 19.

The digital audio signal is converted to an optical output and then output to an external device, for example, an A / V receiver 200, connected through the S / PDIF port 15. In the receiver 200, a digital audio signal of the received optical output is decoded and encoded by using an audio codec, and then a speaker of a multi-channel (for example, 5.1 CH) is used. It is output as a sound through the (not shown).

Accordingly, the user can simultaneously listen to high-quality audio in three dimensions at the same time through a speaker provided in the television 100 and a multi-channel speaker connected to the A / V receiver 200. .

However, in the A / V receiver 200, as described above, the digital audio signal of the optical output received through the S / PDIF port 15 is decoded and encoded by using an audio codec. For example, when audio decoding and encoding takes more than a predetermined time, a time difference occurs between audio output through a speaker of a television and audio output through a multi-channel speaker connected to an A / V receiver. As a result, howling may occur due to the difference in audio output time.

The present invention, for example, by matching the lip sync between the audio output through the speaker of the television and the audio output through the speaker connected to the external device, so that howling does not occur An apparatus and a method for correcting lip sync with an apparatus are provided.

An audio device according to the present invention includes a first receiver for receiving an audio signal, a transmitter for transmitting the audio signal and a test signal to an external device, a second receiver for receiving a return signal in response to the test signal; And a speaker configured to output a voice according to the audio signal and to adjust a voice output time according to the audio signal according to the return signal.

In addition, the speaker unit may delay the voice output time according to the audio signal according to the return signal.

In addition, the return signal may include information on the voice output time of the external device.

The speaker may synchronize a voice output time point with the voice output time point of the external device.

In addition, the speaker may delay the voice output time according to the audio signal according to a time difference between the transmission time of the test signal and the reception time of the return signal.

In addition, another audio apparatus according to the present invention includes a first receiver for receiving an audio signal, a transmitter for transmitting the audio signal and a test signal to a plurality of external devices, and a plurality of return signals in response to the test signal. And a speaker configured to output a voice according to the audio signal and to adjust a voice output time according to the audio signal according to one of the plurality of return signals.

In addition, the speaker may delay the voice output time according to the audio signal according to any one of the plurality of return signals with a late reception time.

Also, the plurality of return signals may include information on the voice output time point of each of the external devices.

The plurality of return signals may include a first return signal and a second return signal, and when the reception time of the second return signal is later than the reception time of the first return signal, the speaker may output the voice output time. It is possible to synchronize with the voice output time point corresponding to the second return signal.

According to an exemplary embodiment of the present invention, a display apparatus includes a first receiver configured to receive an audio signal and a video signal, a display configured to display an image according to the video signal, and transmit the audio signal and a test signal to an external device. And a transmitter, a second receiver configured to receive a return signal in response to the test signal, and a built-in speaker configured to output a voice according to the audio signal and to adjust a voice output time according to the audio signal according to the return signal. It is possible.

In addition, another audio device according to the present invention receives the audio signal and the test signal from the first speaker unit for receiving an audio signal and the first skipper unit, and receives a return signal in response to the test signal. And a second speaker unit transmitting to the first speaker unit, wherein the first speaker unit may adjust a voice output time point according to the audio signal according to the return signal.

The first speaker may be configured to delay the voice output time according to the audio signal according to the return signal.

In addition, the return signal may include information on the voice output time of the second speaker unit.

The first speaker unit may synchronize a voice output point of time with the voice output point of time of the second speaker unit.

The first speaker may be configured to delay the voice output time according to the audio signal according to a time difference between the transmission time of the test signal and the reception time of the return signal.

In addition, another audio device according to the present invention receives the audio signal and the test signal from the first speaker unit for receiving an audio signal (Audio signal), the first skipper unit, and returns a first corresponding to the test signal A second speaker for transmitting a signal to the first speaker and a first speaker for receiving the audio signal and the test signal from the first skipper and transmitting a second return signal to the first speaker in response to the test signal; And a three speaker unit, wherein the first speaker unit may adjust a voice output time point according to the audio signal according to one of the first return signal and the second return signal.

The first speaker may be configured to delay a voice output time according to the audio signal according to any one of the first return signal or the second return signal, which has a late reception time.

The first return signal may include information on the voice output time point of the second speaker unit, and the second return signal may include information on the voice output time point of the third speaker unit.

The first speaker unit may synchronize a voice output time point to the voice output time point of the third speaker unit when the time point at which the second return signal is received is later than the time point at which the first return signal is received. It is possible.

In addition, the first speaker unit may delay the voice output time according to the audio signal according to a time difference between the transmission time of the test signal and the reception time of the second return signal.

In addition, another display apparatus according to the present invention receives an audio signal and a video signal, a television including a built-in speaker unit and the audio signal and a test signal from the television, and An external speaker for transmitting a return signal to the television in response to a test signal, the television can adjust the audio output time according to the audio signal in accordance with the return signal.

In addition, the lip synch correcting apparatus according to the present invention is an lip synch correcting apparatus having an HDMI port and an S / PDIF port, the audio processing unit for generating a test audio packet and the test audio After the packet is transmitted to the external device, the time until the return packet is received is counted, the lip synch correction time is set, and output audio to the speaker and output to the external device according to the lip synch time. It may include a control unit for synchronizing audio.

In addition, the test audio packet may include a start bit and an end bit, and may be transmitted to an external device through an HDMI ARC port.

The controller may be configured to link and store the lip sync correction time and unique identification information corresponding to the external device.

The control unit may delay the output audio to the speaker for a predetermined time according to the lip synch correction time, and synchronize the output audio to the external device.

When the lip synch correction time is set, the controller may output the audio signal processed by the audio processor through an S / PDIF port to an external device.

The external device may generate and transmit the return packet when the test audio packet is received and the decoding and encoding operations are completed.

In addition, in the lip sync correction method according to the present invention, when entering a lip sync correction mode with an external device, a counting step of generating a test audio packet, transmitting the time to the external device and counting time, and receiving a return packet from the external device If so, it is possible to include a time setting step of setting the time counted to date as a lip synch correction time and a synchronization step of synchronizing the output audio to a speaker and the output audio to an external device according to the lip synch correction time.

The counting step may generate a test audio packet including a start bit and an end bit, and then transmit the test audio packet to the external device through an HDMI ARC port.

In addition, in the time setting step, it is possible to link and store the lip synch correction time and the unique identification information corresponding to the external device.

In the synchronizing step, the output audio to the speaker may be delayed for a predetermined time according to the lip synch correction time to synchronize the output audio to the external device.

In addition, in the synchronizing step, it is possible to output audio to an external device through the S / PDIF port.

The external device may generate and transmit the return packet when the test audio packet is received and the decoding and encoding operations are completed.

An apparatus and method for correcting a lip sync with an external device according to the present invention may include, for example, counting a time until a return packet is received after transmitting a test audio packet to an external device such as an A / V receiver. (Lipsync) by setting a correction time, and then performing a lip sync operation to synchronize the audio output through the speaker of the television and the audio output through the speaker connected to an external device according to the lip sync correction time. By compensating for the time difference delayed by the audio decoding and encoding operation of the external device, howling can be prevented.

1 shows a configuration of an embodiment of a general television;
2 to 10 are views for explaining an audio device according to the present invention;
11 to 12 are views for explaining the display device according to the present invention;
Fig. 13 is a diagram showing the configuration of an embodiment of a television to which the present invention is applied;
14 is a flowchart illustrating an embodiment of a lip sync correction method with an external device according to the present invention;
15 illustrates an embodiment of a user interface screen displayed in accordance with the present invention; And
16 is a diagram illustrating an embodiment of a type of test audio packet according to the present invention.

Hereinafter, an audio device, a display device including the same, a lip sync correction device and a method thereof according to the present invention will be described in detail with reference to the accompanying drawings.

As the invention allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. It is to be understood that the present invention is not intended to be limited to the specific embodiments but includes all changes, equivalents, and alternatives falling within the spirit and scope of the present invention.

In describing the present invention, terms such as first and second may be used to describe various components, but the components may not be limited by the terms. The terms may be used only for the purpose of distinguishing one component from another component. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component.

The term and / or may include a combination of a plurality of related items or any item of a plurality of related items.

When an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, but other elements may be present in between Can be understood. On the other hand, when it is mentioned that an element is "directly connected" or "directly connected" to another element, it can be understood that no other element exists in between.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. The singular expressions may include plural expressions unless the context clearly dictates otherwise.

In the present application, the terms "comprises", "having", and the like are used interchangeably to designate one or more of the features, numbers, steps, operations, elements, components, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, parts, or combinations thereof.

Unless otherwise defined, all terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries can be interpreted as having a meaning consistent with the meaning in the context of the relevant art and are, unless expressly defined in the present application, interpreted in an ideal or overly formal sense .

In addition, the following embodiments are provided to explain more fully to the average person skilled in the art. The shapes and sizes of the elements in the drawings and the like can be exaggerated for clarity.

First, the audio device according to the present invention, a display device including the same, and a lip sync correction device and method include, for example, a television (TV) used in connection with an external device such as an A / V receiver or the like, as well as various other A devices. It can also be applied to / V devices.

2 to 10 are diagrams for explaining an audio device according to the present invention.

Referring to FIG. 2, an audio device according to the present invention may include a plurality of speaker units 400 and 410. For example, the first speaker unit 400 and the second speaker unit 410 may be included.

Here, the first speaker unit 400 may receive an audio signal (AS) from the outside. In addition, the first speaker unit 400 may generate a test signal (TS) used to synchronize the timing of the voice output of the second speaker unit 410.

The second speaker unit 410 may receive an audio signal from the first speaker unit 400. In addition, the second speaker unit 410 may receive a test signal TS from the first speaker unit 400. That is, the first speaker unit 400 may receive the audio signal AS from the outside and transmit the audio signal AS and the test signal TS received from the second speaker unit 410.

As such, the first speaker unit 400 transmits the input audio signal AS and the generated test signal TS to an external device, that is, the second speaker unit 410.

Accordingly, the first speaker unit 400 may be a main speaker, and the second speaker unit 410 may be referred to as an auxiliary speaker. Alternatively, the first speaker unit 400 may be regarded as an internal speaker, and the second speaker unit 410 may be regarded as an external speaker.

The configuration of the first speaker unit 400 and the second speaker unit 410 will be described below in more detail with reference to FIG. 2.

Referring to FIG. 3, the first speaker unit 400 may include a first receiver 401, a second receiver 405, a first transmitter 404, and a first voice output unit 403. In addition, the first speaker unit 400 may include a first control unit 402.

The first receiver 401 may receive an audio signal AS from the outside.

The first controller 402 may generate a test signal TS in response to the audio signal received by the first receiver 401.

The first transmitter 404 may transmit the audio signal AS received by the first receiver 401 and the test signal TS generated by the first controller 402 to an external device. The external device may be the second speaker unit 410.

As shown in FIG. 4, the test signal TS transmitted by the first transmitter 404 may be located before the audio signal AS. In this case, the second speaker unit 410 may receive and confirm the test signal TS first before receiving the audio signal AS.

The second receiver 405 may receive a return signal RS in response to the test signal TS transmitted by the first transmitter 404. For example, the second receiver 405 may receive the return signal RS transmitted by the second speaker 410 in response to the test signal TS.

The first voice output unit 403 may output a voice according to the audio signal received by the first receiver 401. In addition, the first voice output unit 403 may adjust the voice output time according to the audio signal in response to the return signal RS received by the second receiver 405 under the control of the first controller 402. Do. Here, the first audio output unit 403 may be referred to as a speaker.

Although the first audio output unit 403 adjusts the output time of the audio, the first control unit 402 corresponds to the return signal RS received by the second reception unit 405. The voice output time point according to the control may be adjusted, and the first voice output unit 403 may also output the voice whose first control point 402 has adjusted the output time point.

In FIG. 3, the first control unit 402 and the first audio output unit 403 are described as separate, but the first control unit 402 may be included in the first audio output unit 403. .

On the other hand, from the perspective of the second speaker unit 410, that is, the first speaker unit 400, the external device includes a third receiver 411, a second transmitter 412, a second controller 413, and a second device. The voice output unit 414 may be included.

Here, the third receiver 411 may receive the audio signal AS and the test signal TS transmitted by the first transmitter 404 of the first speaker 400.

The second voice output unit 414 may output the voice according to the audio signal received by the third receiver 411 under the control of the second controller 413. The second voice output unit 414 may also be a speaker.

The second transmitter 412 may transmit the return signal RS to the second receiver 405 of the first speaker 400 under the control of the second controller 413.

The second controller 413 may generate a return signal RS in response to the test signal TS received through the third receiver 411.

Here, the return signal RS may be a signal for the first speaker unit 400 to confirm the voice output point of time of the second speaker unit 410.

The first speaker unit 400 outputs the voice of the second voice output unit 414 of the second speaker unit 410 using a return signal RS transmitted from an external device, that is, the second speaker unit 410. Information about the viewpoint can be obtained. Accordingly, the first speaker unit 400 outputs the voice in response to the information on the output time of the voice of the second voice output unit 414 of the second speaker unit 410 obtained through the return signal RS. It is possible to do That is, the first speaker unit 400 outputs the voice in response to the information on the voice output time of the second voice output unit 414 of the second speaker unit 410 obtained through the return signal RS. It is possible to adjust.

Accordingly, it is possible to synchronize the time point at which the voice output of the first speaker unit 400 and the second speaker unit 410 is synchronized, thereby preventing occurrence of a howling phenomenon.

The operations of the first speaker unit 400 and the second speaker unit 410 will be described below in more detail with reference to FIGS. 5, 6, and 7.

As illustrated in FIG. 5, when the first receiver 401 receives an audio signal AS in the first speaker unit 400 or S1 (600), the first controller 402 performs a predetermined audio processing. May be performed (601). In addition, the first controller 402 may generate a test signal TS in response to the received audio signal AS.

In addition, the received audio signal AS and the generated test signal TS may be transmitted 602 to an external device, that is, the second speaker unit 410, through the first transmitter 404.

Thereafter, the first speaker S1 may receive the return signal RS in response to the transmitted test signal TS.

In addition, the first speaker S1 may adjust (603) an output point of voice in response to the return signal RS according to the control unit of the first control unit 402.

Thereafter, a predetermined voice may be output 604 at the output time t2 to be adjusted.

In the second speaker unit 410, when the first speaker unit 400 transmits the audio signal AS and the test signal TS, the third receiver 411 receives 610 and receives a predetermined voice processing process. It is possible to perform (611).

Meanwhile, the second speaker unit 410 may receive the audio signal AS that has undergone the voice processing from the first speaker unit 400. That is, although the first speaker unit 400 may directly transmit the received audio signal AS to the second speaker unit 410 by omitting a voice processing process, the audio received by the first speaker unit 400 may be used. It is also possible to perform a predetermined voice processing process on the signal and to transmit the processed audio signal to an external device, that is, the second speaker unit 410. In this case, step 611 may be omitted.

Thereafter, the second voice output unit 414 may output the voice processed voice at a predetermined time t2 (612).

The first speaker 400 may use various methods to adjust the output time point of the voice using the return signal RS.

For example, as in the case of FIG. 6A, the first speaker unit 400 receives the return signal RS received from the second speaker unit 410 and the transmission point of the test signal TS. It is possible to adjust the output time point of the voice by using.

In detail, the transmission time point of the test signal TS transmitted from the first speaker unit 400 to the second speaker unit 410 is 0, and the first speaker unit 400 receives from the second speaker unit 410. Assume that the reception time of one return signal RS is 10.

In this case, the second speaker unit 400 may be regarded as outputting the audio signal AS transmitted by the first speaker unit 410 after being delayed by approximately 10.

Accordingly, the first speaker unit 400 may delay and output the voice output time point by 10 from the first output time point. Therefore, the audio output of the first speaker unit 400 and the second speaker unit 410 may be substantially synchronized.

Alternatively, as in the case of FIG. 6B, the return signal RS received by the first speaker unit 400 includes information about a voice output time point t2 of the second speaker units 410 and S2. It is possible to do

In this case, the first speaker unit 400 outputs the voice corresponding to the information on the voice output time t2 of the second speaker units 410 and S2 included in the return signal RS, thereby providing the first speaker unit. It is possible to substantially synchronize the audio output of the 400 and the second speaker unit 410.

The method of synchronizing the audio output of the first speaker unit 400 and the second speaker unit 410 by using the return signal RS received from the second speaker unit 410 in the first speaker unit 400 is described herein. It may not be limited.

In order to delay the output of the voice by using the return signal RS received from the second speaker unit 410 in the first speaker unit 400, as shown in FIG. 7, a plurality of buffers 7010 to 750, Buffer It is possible to include).

For example, as shown in FIG. 7, the first speaker unit 400 may include first to fifth buffers 710 to 750 and a selection unit 700.

Here, each of the buffers 710 to 750 may delay the voice data AD to be output for a predetermined time.

The selector 700 may select and output any one of the outputs of the first to fifth buffers 710 to 750.

Assume that the delay values of the first to fifth buffers 710 to 750 are 1 ms.

Here, when the first speaker unit 400 delays the output of the voice by a total of 3 ms, the selector 700 may select the voice data AD output from the third buffer 730.

In the present invention, a method of delaying voice output, that is, voice data to be output, may not be limited to FIG. 7.

Unlike the present invention, a comparative example without using the return signal RS will be described with reference to FIG. 8.

As shown in FIG. 8, in the comparative example, when the first receiver 401 receives the audio signal AS 500 in the first speaker unit 400 and S1, the first controller 402 performs a predetermined voice processing procedure ( Audio Signal Processing) may be performed (501).

In addition, the received audio signal AS may be transmitted 502 to an external device, that is, the second speaker unit 410, through the first transmitter 404.

Thereafter, the first speaker unit S1 may output a predetermined voice 503 according to the control unit of the first control unit 402.

In the second speaker unit 410, when the first speaker unit 400 transmits the audio signal AS, the third receiver 411 receives 510 and performs a predetermined voice processing process (511). It is possible.

Thereafter, the second voice output unit 414 may output the voice processed voice at a predetermined time point t2 (512).

In this case, since the first speaker unit 400 does not receive the signal returned from the second speaker unit 410, the voice output time point of the second speaker unit 410 may not be confirmed. Accordingly, when the second speaker unit 410 outputs the voice at a time delayed by a predetermined point of time, the first speaker unit 400 and the second speaker unit 410 may output voices at different times. . In this case, a howling phenomenon may occur to deteriorate the voice quality.

On the other hand, in the present invention, even if the second speaker unit 410 outputs the voice at a time delayed by a predetermined time point, the first speaker unit 400 uses the return signal RS to output the voice output time point to the second speaker unit ( Since it is possible to synchronize the voice output time of 410, it is possible to prevent deterioration of the voice quality.

On the other hand, a plurality of external devices may be connected to the first speaker unit 400. For example, as in the case of FIG. 9, the second speaker 410 and the third speaker 800 may be connected to the first speaker 400. Hereinafter, the description of the parts described in detail above will be omitted.

In this case, the first speaker unit 400 transmits the received audio signal AS and the test signal TS to each external device, that is, the second speaker unit 410 and the third speaker unit 800, respectively. It is possible.

In addition, the first speaker 400 may receive a return signal RS from a plurality of external devices, respectively.

In this case, the first speaker unit 400 adjusts the voice output time according to the audio signal AS according to any one of the plurality of return signals RS, and outputs the voice at the adjusted time. It is possible to.

For example, as in the case of FIG. 10, the first speaker unit 400 receives the first return signal RS1 from the second speaker unit 410 at time t21, and the third speaker at time t22 later than t21. Assume a case where the second return signal RS2 is received from the unit 800.

In this case, the first speaker unit 400 may output voice in response to the second return signal RS2 having a later reception point than the first return signal RS1. That is, the first speaker 400 may delay the voice output time according to the audio signal AS according to any one of the plurality of return signals RS.

In this case, the howling phenomenon may occur to some extent, but the excessively deepening of the howling phenomenon can be suppressed because the output of the sound late part can be made larger.

11 to 12 are views for explaining the display device according to the present invention. Hereinafter, the description of the parts described in detail above will be omitted.

Referring to FIG. 11, the display apparatus according to the present invention may include a television 1000 and an external speaker unit 1010 that receive a video signal (VS) and an audio signal (AS).

In addition, the television 1000 may include a built-in speaker unit 900.

11, the television 1000 corresponds to the first speaker unit 400, and the external speaker unit 1010 corresponds to the second speaker unit 410 in FIG. 11. Can be.

Looking at the configuration of the display device according to the present invention in detail, as shown in FIG. Display unit 1007 for displaying an image according to the first display unit 100, a first transmitter 1008 for transmitting an audio signal AS and a test signal TS to an external device, that is, an external speaker unit 1010, and a test signal TS Corresponding to the second receiver 1009 receiving the return signal RS and the audio signal according to the audio signal AS, and adjusting the audio output time according to the audio signal AS according to the return signal RS. It may include a built-in speaker 900.

In addition, the television 1000 separates the signal received by the first receiver 1001 into an audio signal AS and a video signal VS, and the audio signal separated by the multiplexer 1002 and the multiplexer 1002. A video processing unit 1004 for processing audio (AS), an image processing unit 1004 for processing video signals VS separated by the multiplexer unit 1002, and a video / audio output of the television 1000 are controlled. 1 may include a control unit 1003.

Here, the built-in speaker 900 outputs the audio processed by the audio processing unit 1004, and the display unit 1007 displays the image processed by the image processing unit 1006.

Here, although the internal speaker 900 has been described as adjusting the audio output time point, it is also possible for the first control unit 1003 to adjust the audio output time point.

On the other hand, from the perspective of the external speaker unit 1010, that is, the television 1000, the external device includes a third receiver 411, a second transmitter 412, a second controller 413, and a second audio output unit ( 414).

Here, the external speaker unit 1010 may be substantially the same as the configuration of the second speaker unit 410 described with reference to FIG. 3. Therefore, description of the external speaker unit 1010 will be omitted.

Since the configuration and operation of the display device having such a configuration can be sufficiently inferred from the configuration and operation of the audio device described above in detail, further description is omitted.

On the other hand, in the television to which the present invention is applied, for example, as shown in Fig. 13, an analog stereo audio input port 30, an audio decoder 31, a component 32, an HDMI port 33, an HDMI switch 34, the S / PDIF port 35, the main board 36, the display unit 37, the amplifier 38, the speaker 39, the timer 40, and the like.

The main board 36 includes an audio processor 36a, a video processor 36b, a controller 36c, and the like. The digital audio signal processed by the audio processor 36a may be After amplified by the amplifier 38, it is output as a sound through the speaker 39.

The digital audio signal is converted to an optical output and then transmitted to an external device, for example, an A / V receiver 400, connected through the S / PDIF port 35. The receiver 400 decodes and encodes the digital audio signal of the received optical output by using an audio codec, and then a speaker of a multi-channel (for example, 5.1CH) (not shown). Sound) through the

On the other hand, when the control unit 36c enters the lip synch correction mode with the A / V receiver 400 at the user's request, for example, the control unit 36c operates to control the audio processing unit 36a to perform a predetermined test. Generates an audio packet.

In addition, the generated test audio packet is transmitted to the A / V receiver 400. For example, the test audio packet may be connected to one of the HDMI ports 33 as illustrated in FIG. An ARC (Audio Return Channel) port is transmitted to the A / V receiver 400.

Then, the time counted by the timer 40 is checked, and when a return packet is received from the A / V receiver 400, the time counted up to now as a lip sync correction time is checked. After setting, according to the lip synch correction time, a series of lip synch correction operations for synchronizing the output audio to the speaker 39 and the output audio to the A / V receiver 400 will be performed. Is the same as

FIG. 14 is a flowchart illustrating an embodiment of a method for correcting lip sync with an external device according to the present invention. In the controller 36c, the user inputs a lip sync correction mode with an external device. In operation S10, for example, the control unit 36c controls the video processing unit 36b to operate, and as shown in FIG. 15, a user interface for various input selections ( After generating a UI (User Interface) image, the display unit 37 displays the screen.

Meanwhile, selection items such as an A / V receiver, a component, an HDMI, and a DTV may be displayed on the user interface image for selecting the input, and the user may select the selection item of the A / V receiver. If so, a guide message inquiring whether to perform a lip synch correction operation with the A / V receiver may be displayed.

When the lip synch correction operation is selected, the controller 36c controls the video processor 36b to display a guide message for connecting and connecting the A / V receiver to the HDMI port, and then displays the HDMI message. It is checked whether the A / V receiver is connected to the port 33.

When the A / V receiver 400 is connected and connected through the HDMI port 33, the control unit 36c controls the audio processing unit 36a to control the test audio packet (set in advance). Test Audio Packet (S11), the test audio packet is, for example, as shown in Figure 16, Vendor Specific Info Frame among the packet type values defined in the HDMI standard (Vendor Specific Info Frame) The 0x81 value defined by) may be newly defined and used as the type value of the test audio packet according to the present invention.

The test audio packet may include a start bit and an end bit. In the control unit 36c, the generated test audio packet is included in an audio return channel (ARC) of an HDMI port. Through the transmission to the A / V receiver 400 (S12).

The control unit 36c controls the timer 40 to count the time (S13), and thereafter monitors whether a return packet is received from the A / V receiver 400. For example, when the A / V receiver 400 detects 0x81 newly defined as a type value of a test audio packet according to the present invention as described above, the A / V receiver 400 determines that the packet is a test audio packet. .

In addition, when the start and end bits included in the test audio packet are searched and checked, when all the test audio packets are received, decoding and encoding operations are performed using an audio codec, and the decoding and encoding operations are performed. When this is completed, a return packet corresponding thereto is generated and transmitted to the television.

On the other hand, when the control unit 36c receives the return packet from the A / V receiver 400 (S14), the time counted up to the present is checked (S15), and then the time is lip synch correction time or lip sync delay. (Lipsync Delay) time is set (S16), the lip sync correction time, along with the unique identification information (e.g. AV Recrver_ID) assigned to the A / V receiver 400, non-volatile, such as flash memory Stored in memory.

Then, the lip synch correction mode is canceled. Then, when the audio output mode to the external device is set (S17), the control unit 36c receives the digital audio signal processed by the audio processor 36a. And outputting the digital audio signal to the speaker 39 through the amplifier 38 and converting the digital audio signal into an optical output, and then transmitting the digital audio signal to an A / V receiver connected through the S / PDIF port. At this time, the lip synch correction time is checked to delay the output timing of the audio signal output through the amplifier 38.

For example, when the lip synch correction time is set to 1.5 seconds, the time difference between the audio output through the speaker of the television and the audio output through the multi-channel speaker connected to the A / V receiver is 1.5 seconds. Will be judged.

In addition, by delaying the output timing of the audio signal output through the amplifier 38 by 1.5 seconds, the audio output through the speaker of the television, the audio output through the multi-channel speaker connected to the A / V receiver, etc. A lip sync correction operation is performed to match the synchronization between the two.

Then, since any corresponding operation requested by the user is performed (S19), by compensating for a time delay delayed by an audio decoding and encoding operation performed by an external device such as an A / V receiver itself, Howling can be prevented from occurring.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention as defined in the appended claims. , Alteration, substitution, addition, or the like.

300: TV 400: external device
30: audio input port 31: audio decoder
32: Component 33: HDMI Port
34: HDMI switch 35: S / PDIF port
36: main board 36a: audio processing unit
36b: video processor 36c: controller
37: display unit 38: amplifier
39: speaker 40: timer

Claims (33)

A first receiver configured to receive an audio signal;
A transmitter for transmitting the audio signal and the test signal to an external device;
A second receiver configured to receive a return signal in response to the test signal; And
A speaker for outputting a voice corresponding to the audio signal and adjusting a voice output time according to the audio signal according to the return signal;
Audio device comprising a.
The method of claim 1,
The speaker unit delays the voice output time according to the audio signal according to the return signal.
The method of claim 2,
The return signal includes information on the voice output time of the external device.
The method of claim 3, wherein
And the speaker synchronizes a voice output time point with the voice output time point of the external device.
The method of claim 2,
And the speaker delays the voice output point according to the audio signal according to a time difference between the transmission point of the test signal and the reception point of the return signal.
A first receiver configured to receive an audio signal;
A transmitter for transmitting the audio signal and the test signal to a plurality of external devices;
A second receiver configured to receive a plurality of return signals in response to the test signal; And
A speaker configured to output a voice corresponding to the audio signal and to adjust a voice output point according to the audio signal according to one of the plurality of return signals;
Audio device comprising a.
The method according to claim 6,
And the speaker is configured to delay a voice output time according to the audio signal according to any one of a plurality of the return signals with a late reception time.
The method of claim 7, wherein
The plurality of return signals include information on the voice output time point of each of the external devices.
The method of claim 8,
The plurality of return signals include a first return signal and a second return signal,
When the reception time of the second return signal is later than the reception time of the first return signal,
And the speaker synchronizes a voice output time point with the voice output time point corresponding to the second return signal.
A first receiver configured to receive an audio signal and a video signal;
A display unit which displays an image according to the video signal;
A transmitter for transmitting the audio signal and the test signal to an external device;
A second receiver configured to receive a return signal in response to the test signal; And
A built-in speaker configured to output a voice according to the audio signal and to adjust a voice output time according to the audio signal according to the return signal;
Display device comprising a.
A first speaker unit receiving an audio signal; And
A second speaker unit receiving the audio signal and the test signal from the first skipper unit and transmitting a return signal to the first speaker unit in response to the test signal;
Including,
The first speaker unit controls the audio output time according to the audio signal according to the return signal.
The method of claim 11,
And the first speaker unit delays the voice output time according to the audio signal according to the return signal.
The method of claim 12,
The return signal includes information on the voice output time point of the second speaker unit.
The method of claim 13,
And the first speaker unit synchronizes a voice output point of time with the voice output point of time of the second speaker unit.
The method of claim 12,
And the first speaker unit delays the voice output time point according to the audio signal according to a time difference between the time point at which the test signal is transmitted and the time point at which the return signal is received.
A first speaker unit receiving an audio signal;
A second speaker unit receiving the audio signal and the test signal from the first skipper unit and transmitting a first return signal to the first speaker unit in response to the test signal; And
A third speaker unit receiving the audio signal and the test signal from the first skipper unit and transmitting a second return signal to the first speaker unit in response to the test signal;
Including,
And the first speaker unit adjusts a voice output time point according to the audio signal according to one of the first return signal and the second return signal.
17. The method of claim 16,
And the first speaker unit delays a voice output time according to the audio signal according to any one of the first return signal or the second return signal having a late reception time.
The method of claim 17,
The first return signal includes information on the voice output time point of the second speaker unit.
The second return signal includes information on the voice output time point of the third speaker unit.
The method of claim 18,
When the reception time of the second return signal of the first speaker unit is later than the reception time of the first return signal,
And the first speaker unit synchronizes a voice output time point to the voice output time point of the third speaker unit.
The method of claim 19,
And the first speaker unit delays the voice output time point according to the audio signal according to a time difference between the time point at which the test signal is transmitted and the time point at which the second return signal is received.
A television that receives an audio signal and a video signal and includes a built-in speaker unit; And
An external speaker unit which receives the audio signal and the test signal from the television and transmits a return signal to the television in response to the test signal;
Including,
And the television adjusts an audio output time point according to the audio signal according to the return signal.
In the lip-sync correction device having an HDMI port and S / PDIF port,
An audio processor for generating a test audio packet; And
After transmitting the test audio packet to the external device, counting the time until the return packet is received, setting the lip synch correction time, and outputting audio to a speaker according to the lip synch correction time, and the external device. A controller for synchronizing output audio to the furnace;
Lip synch correction device comprising a.
The method of claim 22,
The test audio packet includes a start bit and an end bit, and is transmitted to an external device through an HDMI ARC port.
The method of claim 22,
And the controller is configured to cooperatively store the lip sync correction time and unique identification information corresponding to the external device.
The method of claim 22,
And the control unit delays the output audio to the speaker by a predetermined time according to the lip synch correction time, and synchronizes it with the output audio to the external device.
The method of claim 22,
And the control unit outputs the audio signal processed by the audio processing unit to the external device through the S / PDIF port after the lip synch correction time is set.
The method of claim 22,
And the external device receives the test audio packet, and generates and returns the return packet when the decoding and encoding operations are completed.
A counting step of generating a test audio packet, counting a time after transmitting the test audio packet to the external device when the lip synch correction mode with the external device is entered;
A time setting step of setting a time counted so far as a lip synch correction time when a return packet is received from the external device; And
Synchronizing the output audio to a speaker and the output audio to an external device according to the lip synch correction time;
Lip synch correction method comprising a.
29. The method of claim 28,
The counting step, after generating a test audio packet including a start bit and the end bit, and transmits to the external device through the HDMI ARC (HDMI ARC) port, characterized in that the lip sync correction method.
29. The method of claim 28,
In the time setting step, the lip sync correction time and the unique identification information corresponding to the external device are stored in association with each other.
29. The method of claim 28,
The synchronizing step may include delaying the output audio to a speaker for a predetermined time and synchronizing the output audio to an external device according to the lip synch correction time.
29. The method of claim 28,
The synchronizing step, Lip sync correction method characterized in that for outputting audio to an external device through the S / PDIF (S / PDIF) port.
29. The method of claim 28,
The external device receives the test audio packet, and when the decoding and encoding operation is completed, the external device generates and transmits the lip sync correction method.
KR1020100136618A 2010-12-28 2010-12-28 Audio apparatus and display apparatus having the same, apparatus and method for compensating lipsync with external device KR20120074700A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020100136618A KR20120074700A (en) 2010-12-28 2010-12-28 Audio apparatus and display apparatus having the same, apparatus and method for compensating lipsync with external device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020100136618A KR20120074700A (en) 2010-12-28 2010-12-28 Audio apparatus and display apparatus having the same, apparatus and method for compensating lipsync with external device

Publications (1)

Publication Number Publication Date
KR20120074700A true KR20120074700A (en) 2012-07-06

Family

ID=46708786

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020100136618A KR20120074700A (en) 2010-12-28 2010-12-28 Audio apparatus and display apparatus having the same, apparatus and method for compensating lipsync with external device

Country Status (1)

Country Link
KR (1) KR20120074700A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20150030946A (en) * 2013-09-13 2015-03-23 삼성전자주식회사 A/v receiving apparatus and method for delaying output of audio signal and a/v signal processing system
EP3226570A1 (en) 2016-03-31 2017-10-04 Thomson Licensing Synchronizing audio and video signals rendered on different devices
WO2020075965A1 (en) * 2018-10-12 2020-04-16 Samsung Electronics Co., Ltd. Electronic device and control method thereof
WO2022092871A1 (en) * 2020-10-28 2022-05-05 엘지전자 주식회사 Display device and operating method therefor
US11375265B2 (en) 2019-12-02 2022-06-28 Samsung Electronics Co., Ltd. Electronic apparatus and controlling method thereof

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20150030946A (en) * 2013-09-13 2015-03-23 삼성전자주식회사 A/v receiving apparatus and method for delaying output of audio signal and a/v signal processing system
EP3226570A1 (en) 2016-03-31 2017-10-04 Thomson Licensing Synchronizing audio and video signals rendered on different devices
WO2017167542A1 (en) 2016-03-31 2017-10-05 Thomson Licensing Synchronizing audio and video signals rendered on different devices
WO2020075965A1 (en) * 2018-10-12 2020-04-16 Samsung Electronics Co., Ltd. Electronic device and control method thereof
KR20200041635A (en) * 2018-10-12 2020-04-22 삼성전자주식회사 Electronic device and control method thereof
US10732927B2 (en) 2018-10-12 2020-08-04 Samsung Electronics Co., Ltd. Electronic device and control method thereof
US11375265B2 (en) 2019-12-02 2022-06-28 Samsung Electronics Co., Ltd. Electronic apparatus and controlling method thereof
WO2022092871A1 (en) * 2020-10-28 2022-05-05 엘지전자 주식회사 Display device and operating method therefor

Similar Documents

Publication Publication Date Title
US8811375B2 (en) Multimedia apparatus and synchronization method thereof
US8903523B2 (en) Audio processing device, audio processing method, and program
KR100912212B1 (en) Audiovisualav device and control method thereof
US8417850B2 (en) Information processing device and method for processing signal of information processing device
US20090180755A1 (en) Video/Audio Reproducing Apparatus
EP3100458B1 (en) Method and apparatus for synchronizing the playback of two electronic devices
KR101168612B1 (en) Device and method for synchronizing data in digital television receiver
US20080291266A1 (en) Apparatus, method and system for synchronizing a common broadcast signal among multiple television units
CN101394527B (en) Reception apparatus and method of controlling image output by reception apparatus
US11457266B2 (en) Method for synchronizing audio and video and related apparatus
KR20120074700A (en) Audio apparatus and display apparatus having the same, apparatus and method for compensating lipsync with external device
KR20060020751A (en) Apparatus and method for synchronization between moving picture and caption
WO2017141977A1 (en) Audio device and control method
JP4837018B2 (en) AV equipment
JP2009182912A (en) Video/audio reproducing apparatus
JP2009171079A (en) Video/audio reproducing apparatus
CN114189737A (en) Digital television and rapid channel switching method thereof
JP2007235519A (en) Method and system for video sound synchronization
TW201737717A (en) Method for audio detection and corresponding device
US20130136191A1 (en) Image processing apparatus and control method thereof
KR102152337B1 (en) Digital broadcast receiving system
KR100655000B1 (en) Television Receiver and Method for Auto Controlling Signal Syncronization
JP2006186454A (en) Broadcast receiver, portable broadcast receiver
KR100698298B1 (en) Display device and method for matching video/audio thereof
JP5248663B2 (en) Interface method

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E601 Decision to refuse application