WO2011028174A1 - Signal processing device for simultaneously outputting more than one language - Google Patents

Signal processing device for simultaneously outputting more than one language Download PDF

Info

Publication number
WO2011028174A1
WO2011028174A1 PCT/SG2009/000306 SG2009000306W WO2011028174A1 WO 2011028174 A1 WO2011028174 A1 WO 2011028174A1 SG 2009000306 W SG2009000306 W SG 2009000306W WO 2011028174 A1 WO2011028174 A1 WO 2011028174A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio
signal
language
audio signal
video
Prior art date
Application number
PCT/SG2009/000306
Other languages
French (fr)
Inventor
Kian Tiong Yeo
Hon Gay Siew
Yuan Fuat Chin
Original Assignee
Tcl Thomson Electronics Singapore Pte Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tcl Thomson Electronics Singapore Pte Ltd filed Critical Tcl Thomson Electronics Singapore Pte Ltd
Priority to PCT/SG2009/000306 priority Critical patent/WO2011028174A1/en
Publication of WO2011028174A1 publication Critical patent/WO2011028174A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/60—Receiver circuitry for the reception of television signals according to analogue transmission standards for the sound signals
    • H04N5/607—Receiver circuitry for the reception of television signals according to analogue transmission standards for the sound signals for more than one sound signal, e.g. stereo, multilanguages
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4341—Demultiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H04N21/4856—End-user interface for client configuration for language selection, e.g. for the menu or subtitles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8106—Monomedia components thereof involving special audio data, e.g. different tracks for different languages
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/61—Network physical structure; Signal processing
    • H04N21/6106—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network
    • H04N21/6112—Network physical structure; Signal processing specially adapted to the downstream path of the transmission network involving terrestrial transmission, e.g. DVB-T

Definitions

  • Various embodiments relate generally to a signal processing device, in particular, a signal processing device for processing multiple language audio/video signals and simultaneously outputting more than one language.
  • video or audio program in nowadays is provided with multiple audio tracks to enable additional services for various groups of users.
  • TV program or video streaming over the Internet may be provided with multi-language audio tracks to allow an option to view the program in a preferred language for viewers speaking different languages, or may be provided with an additional audio track including descriptive video services (DVS) to provide narrative description of action or other scene related information for viewer with visual impairments.
  • DVDS descriptive video services
  • the television system When receiving a bilingual or multilingual broadcast program, the television system allows a viewer or a group of viewers to select one language and output the selected language to an audio output device (e.g. loudspeaker and/or headphone).
  • an audio output device e.g. loudspeaker and/or headphone.
  • Embodiments provide a signal processing device which enables viewers to listen to multiple languages of one program.
  • Embodiments provide a signal processing device, which may include an input port configured to receive an audio signal comprising a first language audio signal and a second language audio signal, and an audio signal processor coupled to the input port.
  • the audio signal processor is configured to process the received audio signal such that it can be output by an audio output, wherein the audio signal processor comprises an audio signal language determiner configured to determine the first language audio signal and the second language audio signal.
  • the signal processing device may further include a first audio output port coupled to the audio signal processor and configured to provide the first language audio signal to a first audio output device, and a second audio output port coupled to the audio signal processor and configured to provide the second language audio signal to a second audio output device being different from the first audio output device.
  • the audio signal processor is configured to simultaneously provide the first language audio signal to the first audio output port and to provide the second language audio signal to the second audio output port.
  • FIG. 1 shows a block diagram of a television system in accordance with an embodiment
  • FIG. 2 shows a signal processing device in accordance with an embodiment
  • FIG. 3 shows a signal processing device in accordance with another embodiment
  • FIG. 4 shows a signal processing device in accordance with a further embodiment
  • FIG. 5 shows a television system including a signal processing device according to an embodiment
  • FIG. 6 shows a signal processing device used for Internet TV according to an embodiment
  • FIG. 7 shows a flowchart illustrating a method for signal processing in a signal processing device according to an embodiment.
  • Embodiments provide a signal processing device, which enables some viewers of a group of viewers to listen to a program or audio/video in one language from a first audio output device and enables other viewer of the group of viewers to listen to the program or audio/video in another language from a second audio output device.
  • the signal processing device may include an input port configured to receive an audio signal comprising a first language audio signal and a second language audio signal, and an audio signal processor coupled to the input port.
  • the audio signal processor is configured to process the received audio signal such that it can be output by an audio output, wherein the audio signal processor comprises an audio signal language determiner configured to determine the first language audio signal and the second language audio signal.
  • the signal processing device may further include a first audio output port coupled to the audio signal processor and configured to provide the first language audio signal to a first audio output device, and a second audio output port coupled to the audio signal processor and configured to provide the second language audio signal to a second audio output device being different from the first audio output device.
  • the audio signal processor is configured to simultaneously provide the first language audio signal to the first audio output port and to provide the second language audio signal to the second audio output port.
  • the input port of the signal processing device may be configured to receive an audio/video signal comprising a video signal and the audio signal.
  • the signal processing device may further include a video signal processor coupled to the input port, wherein the video signal processor is configured to process the received video signal such that it can be displayed on a display.
  • the signal processing device may include a video signal output port coupled to the video signal processor and configured to provide the video signal to the display, e.g. to a CRT (cathode ray tube), LCD (liquid crystal display), OLED (organic light emitting diode) or plasma display, etc.
  • the audio/video signal received by the input port of the signal processing device may be a composite video signal, which includes a video channel signal, a first audio channel signal representing the first language audio signal, and a second audio channel signal representing the second language audio signal.
  • the composite video signal may be a bilingual video/program including audio tracks in two languages for different users.
  • the audio/video signal may be a MPEG transport stream, such as a MPEG-2 transport stream, which includes video and audio elementary streams.
  • the input port of the signal processing device may be configured to receive the video signal and the audio signal separately.
  • the signal processing device according to the embodiments may be configured as a television signal processing device, e.g. included within a television system.
  • the signal processing device may also be incorporated into other audio/video devices, such as VCRs (videocassette recorder), personal video recorders, DVD players, MP4 players, MP3 players, etc.
  • the audio signal received by the input port of the signal processing device further includes a language audio signal identifying information.
  • the audio signal language determiner may be configured to determine the first language audio signal and the second language audio signal using the language audio signal identifying information.
  • the language audio signal identifying information may be a bilingual language audio signal identification information. Based on the bilingual language audio signal identification information, the audio signal language determiner determines that the received audio signal is a bilingual audio signal, and accordingly determines the first language audio signal and the second language audio signal included in the received audio signal.
  • the language audio signal identifying information may be a multiple language audio signal identification information. Based on the multiple language audio signal identification information, the audio signal language determiner may be configured to determine that the received audio signal is a multilingual audio signal, and accordingly determines one or more language audio signals included in the received audio signal. In other words, in alternative embodiments, the language audio signal identifying information may be a language audio signal identification information identifying more than two different languages. Based on the language audio signal identification information identifying more than two different languages, the audio signal language determiner may determine that the received audio signal is an audio signal including more than two different languages, and accordingly determines the first language audio signal and the second language audio signal included in the received audio signal and one or more further language audio signal(s). The additional languages may for example be output via additional output ports to additional headphones, for example.
  • the first audio output device may include at least one loudspeaker, e.g. the loudspeaker integrated in a television system.
  • the second audio output device may include a headphone.
  • the audio signal processor is configured to simultaneously provide the first language audio signal to the first audio output port and to provide the second language audio signal to the second audio output port
  • the first audio output device, the first audio output device and the second audio output device are configured to simultaneouly output the first language audio signal and the second language audio signal, respectively.
  • the at least one loudspeaker is configured to output the first language audio signal and the headphone is configured to output the second language audio signal simultaneously, such that users could listen to different language audio signals of one program (e.g. a TV program, a recordered video, etc.) at different audio output devices simultaneously.
  • a sound isolation is provided between the user listening to the loudspeaker and the user listening to the headphone.
  • the audio/video signal is encoded in accordance with a broadcast audio/video encoding format, e.g. an encoding format used in the broadcast television system including analogue television system and digital television system.
  • a broadcast audio/video encoding format e.g. an encoding format used in the broadcast television system including analogue television system and digital television system.
  • the audio/video signal is encoded in accordance with an audio/video encoding format selected from a group of audio/video encoding format consisting of or including analog audio/video encoding format and digital audio/video encoding format.
  • the audio/video signal may be encoded in accordance with an analog audio/video encoding format selected from a group consisting of: National Television System Committee (NTSC) encoding format, Phase Alternating Line (PAL) encoding format and Sequential Color with Memory (SECAM) encoding format.
  • NTSC National Television System Committee
  • PAL Phase Alternating Line
  • SECAM Sequential Color with Memory
  • the audio/video signal may be encoded in accordance with a digital audio/video encoding format selected from a group consisting of: Advanced Television Systems Committee (ATSC) encoding format, Digital Video Broadcasting (DVB) encoding format, and Internet-based audio/video encoding format.
  • ATSC Advanced Television Systems Committee
  • DVD Digital Video Broadcasting
  • the audio/video signal may be encoded in accordance with other digital audio/video encoding format, such as Digital Terrestrial Multimedia Broadcast (DTMB) encoding format and Integrated Services Digital Broadcasting (ISDB) encoding format.
  • DTMB Digital Terrestrial Multimedia Broadcast
  • ISDB Integrated Services Digital Broadcasting
  • the audio signal is encoded in accordance with an audio/video encoding format selected from a group consisting of: Near Instantaneous Companded Audio Multiplex (NICAM), Zweikanalton, Multichannel television sound (MTS or BTSC), and MPEG transport stream.
  • NICAM Near Instantaneous Companded Audio Multiplex
  • Zweikanalton Multichannel television sound
  • BTSC Multichannel television sound
  • MPEG transport stream MPEG transport stream
  • the signal processing device further includes a language selector configured to select the first language audio signal or the second language audio signal to be output to the first audio output port or the second audio output port.
  • the laguage selector may generate a selection signal depending on a user input.
  • the selection signal may provide an indication that a first language audio signal and a second language audio signal are selected from the received audio signal which may include multiple language audio signals.
  • the selection signal may provide an indication that one language audio signal of the audio signal is selected to be ouput to the first audio output port, and another language audio signal of the audio signal is selected to be ouput to the second audio output port.
  • the method may include receiving an audio signal including a first language audio signal and a second language audio signal via an input port of the signal processing device; and processing by an audio signal processor the received audio signal such that it can be output by an audio output.
  • the audio signal processing includes determining the first language audio signal and the second language audio signal.
  • the method may further include outputting the first language audio signal to a first audio output port coupled to the audio signal processor, and simultaneously outputting the second language audio signal to a second audio output port coupled to the audio signal processor.
  • the first language audio signal is to be to provided to a first audio output device
  • the second language audio signal is to be to provided to a second audio output device, wherein the second audio output device is different from the first audio output device.
  • the signal processing device and the method according to the embodiments above enable a bilingual or multilingual audio/video program to be ouput to two audio ouput devices in two languages simultaneously, thus allowing the viewers speaking different languages to view an audio/video program at the same time.
  • the signal processing device may include more than two audio output ports to provide more than two language audio signals to more than two audio output devices, depending on the number of language audio signals included in the received audio/video signal and depending on the number of audio output devices coupled to the signal processing device.
  • the language selector is configured to receive a user input, which allows users to select independently which languages are to be ouput to the first audio output device and the second audio output devices respectively.
  • a group of viewers can listen to one language from at least one loudspeaker of a display, while one or more viewers can listen to another language from a headphone, for example.
  • good sound isolation is provided between the viewers listening to the loudspeaker and the viewers listening to the headphone.
  • the volume setting of the first audio output device and the second audio output device may be adjusted independently to cater for different needs of the viewers listening to different audio output devices.
  • FIG. 1 shows a block diagram of a television system in accordance with various embodiments.
  • the television system 100 includes a front end circuit 102 configured to receive RF signals, demodulate and decode the tuned RF signals, and condition the demodulated and decoded signals for further processing.
  • the front end circuit 102 may include a tuner configured to receive RF signals of a selected channel via an antenna 104, a cable or a satellite dish. The tuner is configured to frequency-shift the received RF signal to an intermediate frequency (IF) signals.
  • the front end circuit 102 may further include an IF processor configured to demodulate and decode the IF signals to produce video and audio signals for further processing.
  • the television system 100 further includes a TV System-on-a-Chip (SoC) 106 as a central processing circuit, which is configured to provide decoding/encoding functions of input/output sources and to provide quality enhancement of the video/audio signals.
  • SoC TV System-on-a-Chip
  • the TV SoC 106 may include various interfaces for input/output, signal processors for processing the video and audio signals, and controllers for central processing control of the TV system.
  • the TV SoC 106 may include various input ports 108 configured to receive input signals from external sources.
  • Examples of the input ports 108 may include but are not limited to line-in, HDMI (High-Definition Multimedia Interface), DVI (Digital Visual Interface), USB (Universal Serial Bus), LAN (Local Area Network) and VGA (Video Graphics Array).
  • the TV SoC 106 may also include various output ports 1 10, examples of which include but are not limited to line-out, S/PDIF (Sony/Philips Digital Interconnect Format).
  • S/PDIF Synchronization/Philips Digital Interconnect Format
  • the TV SoC 106 is configured to further process the video and audio signals received from the front end circuit 102.
  • the video signals processed in the TV SoC 106 are output to a display 112 which provides video images and animations for viewers.
  • the display may be of various technologies, such as CRT (cathode ray tube), LCD (liquid crystal display), OLED (organic light emitting diode) or plasma display.
  • the television system 100 may include one or more amplifiers 114 configured to amplify the audio signals received from the TV SoC 106, so as to drive acoustic output devices, such as loudspeakers 116 and headphone 118.
  • amplifiers 114 configured to amplify the audio signals received from the TV SoC 106, so as to drive acoustic output devices, such as loudspeakers 116 and headphone 118.
  • the television system 100 further includes a power supply unit 120 configured to receive AC voltage via a power plug 122, and to convert the received AC voltage to different levels of DC voltages to drive various circuits in the television system 100.
  • FIG. 2 shows a signal processing device in accordance with an embodiment.
  • the signal processing device 200 includes an input port 202 configured to receive an audio signal comprising a first language audio signal and a second language audio signal, and an audio signal processor 204 coupled to the input port 202.
  • the audio signal processor 204 is configured to process the received audio signal such that it can be output by an audio output.
  • the audio signal processor 204 includes an audio signal language determiner 206 configured to determine the first language audio signal and the second language audio signal.
  • the audio signal language determiner 206 is configured to determine the first and the second language audio signals using a language audio signal identifying information comprised in the received audio signal.
  • the language audio signal identifying information may provide indication that the received audio signal is a bilingual or multilingual audio signal, as will be described in more detail below.
  • the signal processing device 200 may further include a first audio output port 208 coupled to the audio signal processor 204 and configured to provide the first language audio signal to a first audio output device, and a second audio output port 210 coupled to the audio signal processor 204 and configured to provide the second language audio signal to a second audio output device being different from the first audio output device.
  • the audio signal processor 204 is configured to simultaneously provide the first language audio signal to the first audio output port 208 and to provide the second language audio signal to the second audio output port 210, such that the first language audio signal and the second language audio signal can be simultaneously output to the first audio output device and the second audio output device, respectively.
  • FIG. 3 shows a signal processing device in accordance with another embodiment.
  • a signal processing device 300 is provided in this embodiment including an input port 302 configured to receive an audio signal, an audio signal processor 304 configured to process the received audio signal such that it can be output by an audio output, an audio signal language determiner 306 configured to determine the first language audio signal and the second language audio signal, a first audio output port 308 configured to provide the first language audio signal to a first audio output device, and a second audio output port 310 configured to provide the second language audio signal to a second audio output device being different from the first audio output device.
  • the audio signal processor 304 is configured to simultaneously provide the first language audio signal to the first audio output port 308 and to provide the second language audio signal to the second audio output port 310.
  • the audio signal language determiner 306 may determine the various language audio signals using a language audio signal identifying information comprised in the received audio signal.
  • the language audio signal identifying information may indicate that one or more language audio signals are comprised in the received audio signal, and the audio signal language determiner 306 is configured to determine the respective language audio signals using the idnetifying information accordingly.
  • the information of the determined language audio signals may be notified to a user, e.g. displayed in a menu on the display.
  • the user may select the user-desired language audio signals to be output to the user-desired audio output devices.
  • the signal processing device 300 may further include a language selector 312.
  • the language selector 312 is configured to select the first language audio signal or the second language audio signal to be output to the first audio output port or the second audio output port.
  • the language selector 312 may receive a user input selecting that one language of a bilingual video/audio program is to be output to the loudspeaker and the other language of the bilingual video/audio program is to be output to the headphone.
  • the language selector 312 may receive a user input selecting two languages of a multilingual video/audio program to be output to the loudspeaker and the headphone, respectively.
  • the language selector 312 may generate a corresponding selection signal based on the user input, and the audio signal processor 304 may provide the first and the second language audio signals to the first and the second output ports depending on the selection signal of the language selector 312.
  • the signal processing device 300 may be incorporated in a television, and the language selector 312 may be a remote control device which receives the user input signal and transmits the corresponding generated selection signal to the signal processing device 300 through an infrared (IR) link and an IR receiver.
  • the language selector 312 may be configured to transmit the selection signal to the signal processing device 300 through other communication means, such as ultrasonic or RF signals, in other examples.
  • the language selector 312 may be integrated in the signal processing device 300, and may be configured to receive the user input signal from an external user device and generate the selection signal for the signal processing device 300.
  • FIG. 4 shows a signal processing device in accordance with a further embodiment.
  • a signal processing device 400 is provided in this embodiment including an input port 402 configured to receive an audio signal, an audio signal processor 404 configured to process the received audio signal, an audio signal language determiner 406 configured to determine the first language audio signal and the second language audio signal, a language selector 412 configured to select the first language audio signal or the second language audio signal to be output to the first audio output port or the second audio output port, a first audio output port 408 configured to provide the first language audio signal to a first audio output device, and a second audio output port 410 configured to provide the second language audio signal to a second audio output device being different from the first audio output device.
  • the input port 402 is configured to receive an audio/video signal comprising a video signal and the audio signal.
  • the signal processing device 400 may further include a video signal processor 414 coupled to the input port 402 to receive the video signal.
  • the video signal processor 414 may be configured to process the received video signal, such as decoding encoding, quality enhancement and format conversion to be compatible with a display.
  • a video signal output port 416 is coupled to the video signal processor 414, and is configured to provide the video signal to the display such that the processed video signal can be displayed on the display.
  • the audio signal language determiner 406 and the language selector 412 may be configured to work in a similar manner as the audio signal language determiner 306 and the language selector 312 as described above.
  • the received audio/video signal may be encoded in accordance with an analog audio/video encoding format or a digital audio/video encoding format, so as to be transmitted and received in an analog television system, a digital television system or an Internet television system accordingly.
  • the audio/video signal may include more than one language audio signals, and may be encoded in accordance with an audio/video encoding format selected from a group of audio/video encoding format consisting of Near Instantaneous Companded Audio Multiplex (NICAM), Zweikanalton, Multichannel television sound (MTS or BTSC), MPEG transport stream.
  • NICAM Near Instantaneous Companded Audio Multiplex
  • MTS Multichannel television sound
  • MPEG transport stream Depending on the language audio signal identifying information according to the different audio/video encoding format, the audio signal language determiner 406 may determine the respective language audio signals comprised in the received audio/video signal.
  • the audio/video signal is encoded in accordance with NIC AM, wherein the NIC AM structure includes a 3 -bit application control field.
  • the modes of the audio/video signal can be determined to be one of the following: (i) one stereo audio signal; (ii) two independent mono audio signals; (iii) one mono audio signal and one data signal; (iv) one data signal.
  • the language audio signal identifying information may be the 3-bit application control field of the NICAM signal. If the 3-bit application control field identifies that the NICAM signal is in mode (ii), the received audio/video signal is determined to a bilingual audio/video signal and the audio signal language determiner 406 may determine the two independent language audio signals accordingly.
  • the audio/video signal is encoded in accordance with Zweikanalton, which uses two separate FM carriers for audio signal transmission.
  • the second FM carrier is transmitted on a frequency higher than the main FM carrier, and can carry either a completely separate audio program or be used for stereo sound transmission.
  • the second FM carrier includes a modulated control tone, and the frequency of the modulated control tone may determine if the audio signal is a stereo signal or a dual sound signal.
  • the language audio signal identifying information may be the control tone of the received audio signal. If the control tone identifies that the audio signal is a dual sound signal, the received audio signal is determined to a bilingual audio signal and the audio signal language determiner 406 may determine the two independent language audio signals accordingly.
  • the audio/video signal is encoded in accordance with BTSC, and the received BTSC signal may be decoded by a BTSC decoder.
  • the BTSC signal may include a language audio signal identifying information indicating whether a second audio program (SAP) is included. If from the language audio signal identifying information it is determined that the SAP is included, the audio signal language determiner 406 may determine that the received audio/video signal is a bilingual audio/video signal and determine the two independent language audio signals accordingly.
  • SAP second audio program
  • the audio/video signal may be encoded in
  • the MPEG transport stream includes a plurality of elementary streams for audio and video.
  • the language audio signal identifying information may correspond to the number of audio elementary streams detected in the received MPEG transport stream, wherein each audio elementary stream may carry one separate language. If from the language audio signal identifying information it is determined that more than one audio elementary streams are received, the audio signal language determiner 406 may determine that the received audio/video signal is a bilingual or multilingual audio/video signal and determine the respective language audio signals accordingly.
  • the audio/video signal may be encoded in accordance with any other audio/video encoding format suitable for a bilingual or multilingual audio/video program.
  • the signal processing device 200, 300, 400 as described in the embodiments above may be implemented as an anaolog circuit, a digital circuit or a combination of analog and digital circuit depending on the signals to be processed.
  • the circuit may be understood as any kind of a logic implementing entity, which may be hardware, software, firmware, or any combination thereof.
  • the circuit may be a hardwired circuit such as e.g.
  • ASIC application-specific integrated circuit
  • programmable logic circuit such as a programmable processor, e.g. implemented as a microprocessor being programmed to provide the respective function of the circuit.
  • the signal processing devices 200, 300, 400 in the above embodiments may be integrated in the TV Soc 106 of FIG. 1, for example, to process video/audio signals received from television broadcast, or to process video/audio signals received from an external player device such as a DVD player.
  • the signal processing devices 200, 300, 400 may also be incorporated in other video/audio player devices to process bilingual or multilingual video/audio signals in other embodiments.
  • the signal processing devices 200, 300, 400 may be incorporated in a computer to process bilingual or multilingual video/audio signals received via Internet TV.
  • FIG. 5 shows a television system including a signal processing device according to an embodiment.
  • the television system 500 includes a tuner 502 configured to receive signals of analog television broadcast or digital television broadcast via an antenna 504, a cable or a satellite dish.
  • the television system 500 is described in the context of the signals transmitted using DVB-T (digital video broadcasting - terrestrial) standard, but it is understood that the television system 500 may be configured to receive and process signals transmitted using other digital television standards in alternative embodiments.
  • the tuner 502 is further configured to frequency-shift the received RF signal to IF signals, which is transmitted to an IF processor 506.
  • the IF processor 506 is configured to demodulate and decode the IF signals to produce video signals and audio signals.
  • the IF signals received via an analog transmission may be demodulated, wherein the video signal 508 may be output to a video processing device and a display and the audio signal 510 may be transmitted to an IF sound demodulator 512 for further demodulation.
  • the audio signal 510 may be a second sound intermediate frequency (SSIF) signal, which is demodulated and decoded by the IF sound demodulator 512 according to the audio standard or audio encoding format that is detected from the audio signal 510.
  • the processing implemented at the IF sound demodulator 512 may include decimation, equalization, DC notch filtering, noise reduction, de-emphasis and scaling.
  • the IF sound demodulator 512 is configured to determine a baseband audio signal from the received IF audio signal, and transmit the baseband audio signal to a signal processor 514 for further processing.
  • the IF signals received via a digital transmission are encoded in a MPEG transport stream which encapsulates video and audio elementary streams.
  • the IF processor 506 may be configured to feed the IF signal received from the DVB-T broadcast to a DVB-T channel receiver 522 for processing.
  • the DVB-T channel receiver 522 is configured to demodulate and decode the IF signal for the MPEG transport stream, and a channel interface 524 is configured to transmit the decoded MPEG transport stream to a MPEG system processor 526.
  • the MPEG system processor 526 is configured to further process the received MPEG transport stream, such as descrambling, de-multiplexing and routing of data to memory. After de-multiplexing, the video elementary streams and the audio elementary streams may be determined and dispatched to a video processor/decoder, an audio processor/decoder, or a system microprocessor for further downstream processing.
  • the audio signal (e.g. encoded in Dolby Digital or MPEG- I/II formats) from the MPEG system processor 526 may be output to the signal processor 514.
  • the signal processor 514 is configured to decode the audio signal according to its encoding format, and further process the audio data.
  • the signal processor 514 may be the signal processing device described in the embodiments above. In one embodiment, the signal processor 514 is configured to determine the respective language audio signals from the audio signal received from the MPEG system processor 526. For example, the signal process 514 may identify that more than one audio elementary streams are received from the MPEG system processor 526, and may determine two or more language audio signals accordingly for output.
  • the signal processor 514 may be configured to determine the language audio signal identification information from the audio signal received from the IF sound demodulator 512, e.g. by evaluating pilot levels or control/identification signals comprised in the audio signal.
  • the language audio signal identification information may indicate that the audio signal is a bilingual/multilingual audio signal or a mono audio signal, based on which the signal processor 512 may determine one or more language audio signals for output.
  • the signal processor 514 may also be configured to receive various types of audio signals (e.g. audio signals recorded or played in another medium) from various input paths/ports, such as an audio line-in port 532.
  • the received audio signals are processed by an analog front-end circuit 534, and then output to the signal processor 514.
  • the signal processor 514 may be configured to process and analyze the audio signals output from the analog front-end circuit 534 in a similar manner as the embodiments above, so as to identify language information and to determine and select the respective language audio signals for output.
  • the signal processor 514 may also be configured to perform post-processing, such as volume control, equalizer setting, channel matrixing and switching.
  • the determined and selected first language audio signal from the signal processor 514 may be amplified by a first amplifier 542 and output to a first audio output device 544 (e.g. one or more loudspeakers), and the determined and selected second language audio signal from the signal processor 514 may be amplified by a second amplifier 546 and output to a second audio output device 548 (e.g. a headphone).
  • the selected first language audio signal or second language audio signal may be output to a third audio output device via an audio line-out port 550, for example.
  • a selected third language audio signal may be output to a third audio output device simultaneously with the output of the first and the second language audio signals to the first and the second audio output devices.
  • the signal processor 514 may be configured to control the first amplifier 542 and the second amplifier 546, such that the first language audio signal and the second language audio signal may be amplified to a different degree. This would allow the volume of the first language audio signal output from the first audio output device 544 and the volume of the second language audio signal output from the second audio output device 548 to be adjusted independently, depending on the needs of the different users of the first audio output device 544 and the second audio output device 548.
  • a plurality of language audio signals comprised in a received audio/video signal can be selected and output simultaneously to a plurality of audio output devices, such that a group of users watching the same audio/video program can enjoy the program in different languages simultaneously.
  • the signal processing device may present the language audio signal identification information to the user, e.g. in a TV menu, for the user to select the desired language audio signals to be output to the desired audio output device.
  • FIG. 5 describes the signal processing device incorporated in an analog or digital television system.
  • the signal processing device may also be used in an Internet TV.
  • FIG. 6 shows a signal processing device used for Internet TV according to an embodiment.
  • the Internet TV system includes a media interface 602 configured to interface the TV to the Internet to receive the video and audio data, and configured to extract internet protocol packets to obtain the transport stream.
  • a channel decoder 604 is provided to detect and correct errors in the received transport stream, and to transmit the corrected transport stream to a program selector 606.
  • the transport stream may include one or more program streams multiplexed together, wherein each program stream may include video, audio and data elementary streams of a program or channel.
  • the program selector 606 is configured to extract a program stream from the corrected transport stream, for example, using a selection signal provided by a user who select the desired program or channel to be output.
  • a de-multiplexer 608 is configured to receive the extracted program stream, and to extract video, audio and data elementary streams of the extracted program stream.
  • the extracted video, audio and data elementary streams may be transmitted to a signal processor 610.
  • the signal processor 610 may be a signal processing device as described in the above embodiments, and is configured to determine the language audio signals and outputs the selected language audio signals simultaneously to the selected audio output devices based on the input from a user.
  • the signal processing device as described in the above embodiments may be used in an analogy television system (e.g. NTSC, PAL, SECAM), a digital television system (e.g. ATSC, DVB, DTMB, ISDB), or an Internet television system.
  • the signal processing device according to the embodiments may be used to process video/audio signals encoded in accordance with any video/audio encoding standards, such as NICAM, Zweikanalton, BTSC and MPEG Transport Stream.
  • FIG. 7 shows a flowchart illustrating a method for signal processing in a signal processing device according to an embodiment.
  • an audio signal comprising a first language audio signal and a second language audio signal is received via an input port of a signal processing device.
  • the received audio signal is processed by an audio signal processor such that it can be output by an audio output, wherein the audio signal processing comprises determining the first language audio signal and the second language audio signal.
  • the first language audio signal is output to a first audio output port coupled to the audio signal processor, wherein the first language audio signal is to be provided to a first audio output device.
  • the second language audio signal is simultaneously outputt to a second audio output port coupled to the audio signal processor, wherein the second language audio signal is to be provided to a second audio output device being different from the first audio output device.
  • a bilingual or multilingual language mode of a video or audio (such as a received TV broadcast program or a recorded video/audio program) can be identified, and the audio signal can be output simultaneously in a first language to a first audio output device and in a second language to a second audio output device.
  • the embodiments thus enables a group of users to select independently which languages are to be output to the respective audio output devices, and to listen to multiple languages of a video or audio at the same time.
  • the embodiments also allows the volume settings of different audio output devices to be set independently.

Abstract

Embodiments provide a signal processing device (200) including an input port (202) configured to receive an audio signal comprising a first language audio signal and a second language audio signal, and including an audio signal processor (204) configured to process the received audio signal and including an audio signal language determiner configured to determine the first and the second language audio signals. The signal processing device (200) may further include a first audio output port (208) configured to provide the first language audio signal to a first audio output device, and a second audio output port (210) configured to provide the second language audio signal to a second audio output device being different from the first audio output device. The audio signal processor is configured to simultaneously provide the first language audio signal to the first audio output port and to provide the second language audio signal to the second audio output port.

Description

SIGNAL PROCESSING DEVICE FOR SIMULTANEOUSLY OUTPUTTING
MORE THAN ONE LANGUAGE
Technical Field
[0001] Various embodiments relate generally to a signal processing device, in particular, a signal processing device for processing multiple language audio/video signals and simultaneously outputting more than one language.
Background
[0002] Compared with early video or audio program having a single mono audio track, video or audio program in nowadays is provided with multiple audio tracks to enable additional services for various groups of users. For example, TV program or video streaming over the Internet may be provided with multi-language audio tracks to allow an option to view the program in a preferred language for viewers speaking different languages, or may be provided with an additional audio track including descriptive video services (DVS) to provide narrative description of action or other scene related information for viewer with visual impairments.
[0003] When receiving a bilingual or multilingual broadcast program, the television system allows a viewer or a group of viewers to select one language and output the selected language to an audio output device (e.g. loudspeaker and/or headphone). [0004] However, for a group of viewers speaking different languages and watching the same program, some of the viewers may not be able to understand the selected language and thus cannot enjoy the program.
Summary
[0005] Embodiments provide a signal processing device which enables viewers to listen to multiple languages of one program.
[0006] Embodiments provide a signal processing device, which may include an input port configured to receive an audio signal comprising a first language audio signal and a second language audio signal, and an audio signal processor coupled to the input port. The audio signal processor is configured to process the received audio signal such that it can be output by an audio output, wherein the audio signal processor comprises an audio signal language determiner configured to determine the first language audio signal and the second language audio signal. The signal processing device may further include a first audio output port coupled to the audio signal processor and configured to provide the first language audio signal to a first audio output device, and a second audio output port coupled to the audio signal processor and configured to provide the second language audio signal to a second audio output device being different from the first audio output device. The audio signal processor is configured to simultaneously provide the first language audio signal to the first audio output port and to provide the second language audio signal to the second audio output port. Brief Description of the Drawings
[0007] In the drawings, like reference characters generally refer to the same parts throughout the different views. The drawings are not necessarily to scale, emphasis instead generally being placed upon illustrating the principles of the invention. In the following description, various embodiments of the invention are described with reference to the following drawings, in which:
FIG. 1 shows a block diagram of a television system in accordance with an embodiment;
FIG. 2 shows a signal processing device in accordance with an embodiment; FIG. 3 shows a signal processing device in accordance with another embodiment; FIG. 4 shows a signal processing device in accordance with a further
embodiment;
FIG. 5 shows a television system including a signal processing device according to an embodiment;
FIG. 6 shows a signal processing device used for Internet TV according to an embodiment;
FIG. 7 shows a flowchart illustrating a method for signal processing in a signal processing device according to an embodiment.
Description
[0008] The following detailed description refers to the accompanying drawings that show, by way of illustration, specific details and embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. The various embodiments are not necessarily mutually exclusive, as some embodiments can be combined with one or more other embodiments to form new embodiments. The following detailed description therefore, is not to be taken in a limiting sense, and the scope of the present invention is defined by the appended claims.
[0009] The word "exemplary" is used herein to mean "serving as an example, instance, or illustration". Any embodiment or design described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments or designs.
[0010] Embodiments provide a signal processing device, which enables some viewers of a group of viewers to listen to a program or audio/video in one language from a first audio output device and enables other viewer of the group of viewers to listen to the program or audio/video in another language from a second audio output device.
[0011] The signal processing device may include an input port configured to receive an audio signal comprising a first language audio signal and a second language audio signal, and an audio signal processor coupled to the input port. The audio signal processor is configured to process the received audio signal such that it can be output by an audio output, wherein the audio signal processor comprises an audio signal language determiner configured to determine the first language audio signal and the second language audio signal. The signal processing device may further include a first audio output port coupled to the audio signal processor and configured to provide the first language audio signal to a first audio output device, and a second audio output port coupled to the audio signal processor and configured to provide the second language audio signal to a second audio output device being different from the first audio output device. The audio signal processor is configured to simultaneously provide the first language audio signal to the first audio output port and to provide the second language audio signal to the second audio output port.
[0012] In one embodiment, the input port of the signal processing device may be configured to receive an audio/video signal comprising a video signal and the audio signal. The signal processing device may further include a video signal processor coupled to the input port, wherein the video signal processor is configured to process the received video signal such that it can be displayed on a display. The signal processing device may include a video signal output port coupled to the video signal processor and configured to provide the video signal to the display, e.g. to a CRT (cathode ray tube), LCD (liquid crystal display), OLED (organic light emitting diode) or plasma display, etc.
[0013] In an embodiment, the audio/video signal received by the input port of the signal processing device may be a composite video signal, which includes a video channel signal, a first audio channel signal representing the first language audio signal, and a second audio channel signal representing the second language audio signal. For example, the composite video signal may be a bilingual video/program including audio tracks in two languages for different users. In an exemplary embodiment, the audio/video signal may be a MPEG transport stream, such as a MPEG-2 transport stream, which includes video and audio elementary streams. In another embodiment, the input port of the signal processing device may be configured to receive the video signal and the audio signal separately. [0014] The signal processing device according to the embodiments may be configured as a television signal processing device, e.g. included within a television system. The signal processing device may also be incorporated into other audio/video devices, such as VCRs (videocassette recorder), personal video recorders, DVD players, MP4 players, MP3 players, etc.
[0015] According to an embodiment, the audio signal received by the input port of the signal processing device further includes a language audio signal identifying information. The audio signal language determiner may be configured to determine the first language audio signal and the second language audio signal using the language audio signal identifying information.
[0016] In one embodiment, the language audio signal identifying information may be a bilingual language audio signal identification information. Based on the bilingual language audio signal identification information, the audio signal language determiner determines that the received audio signal is a bilingual audio signal, and accordingly determines the first language audio signal and the second language audio signal included in the received audio signal.
[0017] In another embodiment, the language audio signal identifying information may be a multiple language audio signal identification information. Based on the multiple language audio signal identification information, the audio signal language determiner may be configured to determine that the received audio signal is a multilingual audio signal, and accordingly determines one or more language audio signals included in the received audio signal. In other words, in alternative embodiments, the language audio signal identifying information may be a language audio signal identification information identifying more than two different languages. Based on the language audio signal identification information identifying more than two different languages, the audio signal language determiner may determine that the received audio signal is an audio signal including more than two different languages, and accordingly determines the first language audio signal and the second language audio signal included in the received audio signal and one or more further language audio signal(s). The additional languages may for example be output via additional output ports to additional headphones, for example.
[0018] In an embodiment, the first audio output device may include at least one loudspeaker, e.g. the loudspeaker integrated in a television system. The second audio output device may include a headphone. When the audio signal processor is configured to simultaneously provide the first language audio signal to the first audio output port and to provide the second language audio signal to the second audio output port, the first audio output device, the first audio output device and the second audio output device are configured to simultaneouly output the first language audio signal and the second language audio signal, respectively. In an embodiment, the at least one loudspeaker is configured to output the first language audio signal and the headphone is configured to output the second language audio signal simultaneously, such that users could listen to different language audio signals of one program (e.g. a TV program, a recordered video, etc.) at different audio output devices simultaneously. A sound isolation is provided between the user listening to the loudspeaker and the user listening to the headphone.
[0019] According to an embodiment, the audio/video signal is encoded in accordance with a broadcast audio/video encoding format, e.g. an encoding format used in the broadcast television system including analogue television system and digital television system. In an embodiment, the audio/video signal is encoded in accordance with an audio/video encoding format selected from a group of audio/video encoding format consisting of or including analog audio/video encoding format and digital audio/video encoding format.
[0020] In one embodiment, the audio/video signal may be encoded in accordance with an analog audio/video encoding format selected from a group consisting of: National Television System Committee (NTSC) encoding format, Phase Alternating Line (PAL) encoding format and Sequential Color with Memory (SECAM) encoding format.
[0021] In another embodiment, the audio/video signal may be encoded in accordance with a digital audio/video encoding format selected from a group consisting of: Advanced Television Systems Committee (ATSC) encoding format, Digital Video Broadcasting (DVB) encoding format, and Internet-based audio/video encoding format. In other embodiments, the audio/video signal may be encoded in accordance with other digital audio/video encoding format, such as Digital Terrestrial Multimedia Broadcast (DTMB) encoding format and Integrated Services Digital Broadcasting (ISDB) encoding format.
[0022] According to an embodiment, the audio signal is encoded in accordance with an audio/video encoding format selected from a group consisting of: Near Instantaneous Companded Audio Multiplex (NICAM), Zweikanalton, Multichannel television sound (MTS or BTSC), and MPEG transport stream.
[0023] In an embodiment, the signal processing device further includes a language selector configured to select the first language audio signal or the second language audio signal to be output to the first audio output port or the second audio output port. For example, the laguage selector may generate a selection signal depending on a user input. In one embodiment, the selection signal may provide an indication that a first language audio signal and a second language audio signal are selected from the received audio signal which may include multiple language audio signals. In another embodiment, the selection signal may provide an indication that one language audio signal of the audio signal is selected to be ouput to the first audio output port, and another language audio signal of the audio signal is selected to be ouput to the second audio output port.
[0024] Another embodiment provides a method for signal processing in a signal processing device. The method may include receiving an audio signal including a first language audio signal and a second language audio signal via an input port of the signal processing device; and processing by an audio signal processor the received audio signal such that it can be output by an audio output. The audio signal processing includes determining the first language audio signal and the second language audio signal. The method may further include outputting the first language audio signal to a first audio output port coupled to the audio signal processor, and simultaneously outputting the second language audio signal to a second audio output port coupled to the audio signal processor. The first language audio signal is to be to provided to a first audio output device, and the second language audio signal is to be to provided to a second audio output device, wherein the second audio output device is different from the first audio output device.
[0025] The signal processing device and the method according to the embodiments above enable a bilingual or multilingual audio/video program to be ouput to two audio ouput devices in two languages simultaneously, thus allowing the viewers speaking different languages to view an audio/video program at the same time.
[0026] It is understood that the signal processing device may include more than two audio output ports to provide more than two language audio signals to more than two audio output devices, depending on the number of language audio signals included in the received audio/video signal and depending on the number of audio output devices coupled to the signal processing device.
[0027] According to the embodiments, the language selector is configured to receive a user input, which allows users to select independently which languages are to be ouput to the first audio output device and the second audio output devices respectively.
[0028] By the above embodiments, a group of viewers can listen to one language from at least one loudspeaker of a display, while one or more viewers can listen to another language from a headphone, for example. In addition, good sound isolation is provided between the viewers listening to the loudspeaker and the viewers listening to the headphone.
[0029] According to a further embodiment, the volume setting of the first audio output device and the second audio output device may be adjusted independently to cater for different needs of the viewers listening to different audio output devices.
[0030] FIG. 1 shows a block diagram of a television system in accordance with various embodiments.
[0031] The television system 100 includes a front end circuit 102 configured to receive RF signals, demodulate and decode the tuned RF signals, and condition the demodulated and decoded signals for further processing. The front end circuit 102 may include a tuner configured to receive RF signals of a selected channel via an antenna 104, a cable or a satellite dish. The tuner is configured to frequency-shift the received RF signal to an intermediate frequency (IF) signals. The front end circuit 102 may further include an IF processor configured to demodulate and decode the IF signals to produce video and audio signals for further processing.
[0032] The television system 100 further includes a TV System-on-a-Chip (SoC) 106 as a central processing circuit, which is configured to provide decoding/encoding functions of input/output sources and to provide quality enhancement of the video/audio signals. The TV SoC 106 may include various interfaces for input/output, signal processors for processing the video and audio signals, and controllers for central processing control of the TV system.
[0033] The TV SoC 106 may include various input ports 108 configured to receive input signals from external sources. Examples of the input ports 108 may include but are not limited to line-in, HDMI (High-Definition Multimedia Interface), DVI (Digital Visual Interface), USB (Universal Serial Bus), LAN (Local Area Network) and VGA (Video Graphics Array).
[0034] The TV SoC 106 may also include various output ports 1 10, examples of which include but are not limited to line-out, S/PDIF (Sony/Philips Digital Interconnect Format).
[0035] The TV SoC 106 is configured to further process the video and audio signals received from the front end circuit 102.
[0036] The video signals processed in the TV SoC 106 are output to a display 112 which provides video images and animations for viewers. The display may be of various technologies, such as CRT (cathode ray tube), LCD (liquid crystal display), OLED (organic light emitting diode) or plasma display.
[0037] The television system 100 may include one or more amplifiers 114 configured to amplify the audio signals recevied from the TV SoC 106, so as to drive acoustic output devices, such as loudspeakers 116 and headphone 118.
[0038] The television system 100 further includes a power supply unit 120 configured to receive AC voltage via a power plug 122, and to convert the received AC voltage to different levels of DC voltages to drive various circuits in the television system 100.
[0039] FIG. 2 shows a signal processing device in accordance with an embodiment.
[0040] In an embodiment, the signal processing device 200 includes an input port 202 configured to receive an audio signal comprising a first language audio signal and a second language audio signal, and an audio signal processor 204 coupled to the input port 202. The audio signal processor 204 is configured to process the received audio signal such that it can be output by an audio output.
[0041] The audio signal processor 204 includes an audio signal language determiner 206 configured to determine the first language audio signal and the second language audio signal. In an embodiment, the audio signal language determiner 206 is configured to determine the first and the second language audio signals using a language audio signal identifying information comprised in the received audio signal. The language audio signal identifying information may provide indication that the received audio signal is a bilingual or multilingual audio signal, as will be described in more detail below. [0042] The signal processing device 200 may further include a first audio output port 208 coupled to the audio signal processor 204 and configured to provide the first language audio signal to a first audio output device, and a second audio output port 210 coupled to the audio signal processor 204 and configured to provide the second language audio signal to a second audio output device being different from the first audio output device.
[0043] According to an embodiment, the audio signal processor 204 is configured to simultaneously provide the first language audio signal to the first audio output port 208 and to provide the second language audio signal to the second audio output port 210, such that the first language audio signal and the second language audio signal can be simultaneously output to the first audio output device and the second audio output device, respectively.
[0044] FIG. 3 shows a signal processing device in accordance with another embodiment.
[0045] Similar to the signal processing device 200 of FIG. 2, a signal processing device 300 is provided in this embodiment including an input port 302 configured to receive an audio signal, an audio signal processor 304 configured to process the received audio signal such that it can be output by an audio output, an audio signal language determiner 306 configured to determine the first language audio signal and the second language audio signal, a first audio output port 308 configured to provide the first language audio signal to a first audio output device, and a second audio output port 310 configured to provide the second language audio signal to a second audio output device being different from the first audio output device. The audio signal processor 304 is configured to simultaneously provide the first language audio signal to the first audio output port 308 and to provide the second language audio signal to the second audio output port 310.
[0046] In an embodiment, the audio signal language determiner 306 may determine the various language audio signals using a language audio signal identifying information comprised in the received audio signal. For example, the language audio signal identifying information may indicate that one or more language audio signals are comprised in the received audio signal, and the audio signal language determiner 306 is configured to determine the respective language audio signals using the idnetifying information accordingly.
[0047] In an embodiment, the information of the determined language audio signals may be notified to a user, e.g. displayed in a menu on the display. The user may select the user-desired language audio signals to be output to the user-desired audio output devices.
[0048] In this embodiment, the signal processing device 300 may further include a language selector 312. The language selector 312 is configured to select the first language audio signal or the second language audio signal to be output to the first audio output port or the second audio output port. In an embodiment, the language selector 312 may receive a user input selecting that one language of a bilingual video/audio program is to be output to the loudspeaker and the other language of the bilingual video/audio program is to be output to the headphone. In another embodiment, the language selector 312 may receive a user input selecting two languages of a multilingual video/audio program to be output to the loudspeaker and the headphone, respectively. The language selector 312 may generate a corresponding selection signal based on the user input, and the audio signal processor 304 may provide the first and the second language audio signals to the first and the second output ports depending on the selection signal of the language selector 312.
[0049] In one embodiment, the signal processing device 300 may be incorporated in a television, and the language selector 312 may be a remote control device which receives the user input signal and transmits the corresponding generated selection signal to the signal processing device 300 through an infrared (IR) link and an IR receiver. The language selector 312 may be configured to transmit the selection signal to the signal processing device 300 through other communication means, such as ultrasonic or RF signals, in other examples. In another embodiment, the language selector 312 may be integrated in the signal processing device 300, and may be configured to receive the user input signal from an external user device and generate the selection signal for the signal processing device 300.
[0050] FIG. 4 shows a signal processing device in accordance with a further embodiment.
[0051]. Similar to the signal processing device 300 of FIG. 3, a signal processing device 400 is provided in this embodiment including an input port 402 configured to receive an audio signal, an audio signal processor 404 configured to process the received audio signal, an audio signal language determiner 406 configured to determine the first language audio signal and the second language audio signal, a language selector 412 configured to select the first language audio signal or the second language audio signal to be output to the first audio output port or the second audio output port, a first audio output port 408 configured to provide the first language audio signal to a first audio output device, and a second audio output port 410 configured to provide the second language audio signal to a second audio output device being different from the first audio output device.
[0052] In an embodiment, the input port 402 is configured to receive an audio/video signal comprising a video signal and the audio signal. The signal processing device 400 may further include a video signal processor 414 coupled to the input port 402 to receive the video signal. The video signal processor 414 may be configured to process the received video signal, such as decoding encoding, quality enhancement and format conversion to be compatible with a display. A video signal output port 416 is coupled to the video signal processor 414, and is configured to provide the video signal to the display such that the processed video signal can be displayed on the display.
[0053] The audio signal language determiner 406 and the language selector 412 may be configured to work in a similar manner as the audio signal language determiner 306 and the language selector 312 as described above.
[0054] In an embodiment, the received audio/video signal may be encoded in accordance with an analog audio/video encoding format or a digital audio/video encoding format, so as to be transmitted and received in an analog television system, a digital television system or an Internet television system accordingly.
[0055] The audio/video signal may include more than one language audio signals, and may be encoded in accordance with an audio/video encoding format selected from a group of audio/video encoding format consisting of Near Instantaneous Companded Audio Multiplex (NICAM), Zweikanalton, Multichannel television sound (MTS or BTSC), MPEG transport stream. Depending on the language audio signal identifying information according to the different audio/video encoding format, the audio signal language determiner 406 may determine the respective language audio signals comprised in the received audio/video signal.
[0056] In one embodiment, the audio/video signal is encoded in accordance with NIC AM, wherein the NIC AM structure includes a 3 -bit application control field. Based on the 3 -bit application control field, the modes of the audio/video signal can be determined to be one of the following: (i) one stereo audio signal; (ii) two independent mono audio signals; (iii) one mono audio signal and one data signal; (iv) one data signal. In this example, the language audio signal identifying information may be the 3-bit application control field of the NICAM signal. If the 3-bit application control field identifies that the NICAM signal is in mode (ii), the received audio/video signal is determined to a bilingual audio/video signal and the audio signal language determiner 406 may determine the two independent language audio signals accordingly.
[0057] In another embodiment, the audio/video signal is encoded in accordance with Zweikanalton, which uses two separate FM carriers for audio signal transmission. The second FM carrier is transmitted on a frequency higher than the main FM carrier, and can carry either a completely separate audio program or be used for stereo sound transmission. The second FM carrier includes a modulated control tone, and the frequency of the modulated control tone may determine if the audio signal is a stereo signal or a dual sound signal. In this example, the language audio signal identifying information may be the control tone of the received audio signal. If the control tone identifies that the audio signal is a dual sound signal, the received audio signal is determined to a bilingual audio signal and the audio signal language determiner 406 may determine the two independent language audio signals accordingly.
[0058] In a further embodiment, the audio/video signal is encoded in accordance with BTSC, and the received BTSC signal may be decoded by a BTSC decoder. The BTSC signal may include a language audio signal identifying information indicating whether a second audio program (SAP) is included. If from the language audio signal identifying information it is determined that the SAP is included, the audio signal language determiner 406 may determine that the received audio/video signal is a bilingual audio/video signal and determine the two independent language audio signals accordingly.
[0059] In a further embodiment, the audio/video signal may be encoded in
accordance with MPEG transport stream, wherein the MPEG transport stream includes a plurality of elementary streams for audio and video. The language audio signal identifying information may correspond to the number of audio elementary streams detected in the received MPEG transport stream, wherein each audio elementary stream may carry one separate language. If from the language audio signal identifying information it is determined that more than one audio elementary streams are received, the audio signal language determiner 406 may determine that the received audio/video signal is a bilingual or multilingual audio/video signal and determine the respective language audio signals accordingly.
[0060] It is understood that the audio/video signal may be encoded in accordance with any other audio/video encoding format suitable for a bilingual or multilingual audio/video program. [0061] The signal processing device 200, 300, 400 as described in the embodiments above may be implemented as an anaolog circuit, a digital circuit or a combination of analog and digital circuit depending on the signals to be processed. The circuit may be understood as any kind of a logic implementing entity, which may be hardware, software, firmware, or any combination thereof. In an embodiment, the circuit may be a hardwired circuit such as e.g. a circuit implemented as an application-specific integrated circuit (ASIC) or a hard-wired logic gate structure, or a programmable logic circuit such as a programmable processor, e.g. implemented as a microprocessor being programmed to provide the respective function of the circuit.
[0062] The signal processing devices 200, 300, 400 in the above embodiments may be integrated in the TV Soc 106 of FIG. 1, for example, to process video/audio signals received from television broadcast, or to process video/audio signals received from an external player device such as a DVD player. The signal processing devices 200, 300, 400 may also be incorporated in other video/audio player devices to process bilingual or multilingual video/audio signals in other embodiments. In a further embodiment, the signal processing devices 200, 300, 400 may be incorporated in a computer to process bilingual or multilingual video/audio signals received via Internet TV.
[0063] FIG. 5 shows a television system including a signal processing device according to an embodiment.
[0064] The television system 500 includes a tuner 502 configured to receive signals of analog television broadcast or digital television broadcast via an antenna 504, a cable or a satellite dish. In this example, the television system 500 is described in the context of the signals transmitted using DVB-T (digital video broadcasting - terrestrial) standard, but it is understood that the television system 500 may be configured to receive and process signals transmitted using other digital television standards in alternative embodiments. The tuner 502 is further configured to frequency-shift the received RF signal to IF signals, which is transmitted to an IF processor 506.
[0065] The IF processor 506 is configured to demodulate and decode the IF signals to produce video signals and audio signals.
[0066] In one example, the IF signals received via an analog transmission may be demodulated, wherein the video signal 508 may be output to a video processing device and a display and the audio signal 510 may be transmitted to an IF sound demodulator 512 for further demodulation. The audio signal 510 may be a second sound intermediate frequency (SSIF) signal, which is demodulated and decoded by the IF sound demodulator 512 according to the audio standard or audio encoding format that is detected from the audio signal 510. In an embodiment, the processing implemented at the IF sound demodulator 512 may include decimation, equalization, DC notch filtering, noise reduction, de-emphasis and scaling. The IF sound demodulator 512 is configured to determine a baseband audio signal from the received IF audio signal, and transmit the baseband audio signal to a signal processor 514 for further processing.
[0067] In another example, the IF signals received via a digital transmission, e.g. in accordance with DVB-T standard, are encoded in a MPEG transport stream which encapsulates video and audio elementary streams. The IF processor 506 may be configured to feed the IF signal received from the DVB-T broadcast to a DVB-T channel receiver 522 for processing. The DVB-T channel receiver 522 is configured to demodulate and decode the IF signal for the MPEG transport stream, and a channel interface 524 is configured to transmit the decoded MPEG transport stream to a MPEG system processor 526.
[0068] The MPEG system processor 526 is configured to further process the received MPEG transport stream, such as descrambling, de-multiplexing and routing of data to memory. After de-multiplexing, the video elementary streams and the audio elementary streams may be determined and dispatched to a video processor/decoder, an audio processor/decoder, or a system microprocessor for further downstream processing.
[0069] In an embodiment, the audio signal (e.g. encoded in Dolby Digital or MPEG- I/II formats) from the MPEG system processor 526 may be output to the signal processor 514. The signal processor 514 is configured to decode the audio signal according to its encoding format, and further process the audio data.
[0070] The signal processor 514 may be the signal processing device described in the embodiments above. In one embodiment, the signal processor 514 is configured to determine the respective language audio signals from the audio signal received from the MPEG system processor 526. For example, the signal process 514 may identify that more than one audio elementary streams are received from the MPEG system processor 526, and may determine two or more language audio signals accordingly for output.
[0071] In another embodiment, the signal processor 514 may be configured to determine the language audio signal identification information from the audio signal received from the IF sound demodulator 512, e.g. by evaluating pilot levels or control/identification signals comprised in the audio signal. The language audio signal identification information may indicate that the audio signal is a bilingual/multilingual audio signal or a mono audio signal, based on which the signal processor 512 may determine one or more language audio signals for output.
[0072] In a further embodiment, the signal processor 514 may also be configured to receive various types of audio signals (e.g. audio signals recorded or played in another medium) from various input paths/ports, such as an audio line-in port 532. The received audio signals are processed by an analog front-end circuit 534, and then output to the signal processor 514. The signal processor 514 may be configured to process and analyze the audio signals output from the analog front-end circuit 534 in a similar manner as the embodiments above, so as to identify language information and to determine and select the respective language audio signals for output.
[0073] In addition to the identification and selection of respective language audio signals, the signal processor 514 may also be configured to perform post-processing, such as volume control, equalizer setting, channel matrixing and switching.
[0074] The determined and selected first language audio signal from the signal processor 514 may be amplified by a first amplifier 542 and output to a first audio output device 544 (e.g. one or more loudspeakers), and the determined and selected second language audio signal from the signal processor 514 may be amplified by a second amplifier 546 and output to a second audio output device 548 (e.g. a headphone). In an embodiment, the selected first language audio signal or second language audio signal may be output to a third audio output device via an audio line-out port 550, for example. In another embodiment, a selected third language audio signal may be output to a third audio output device simultaneously with the output of the first and the second language audio signals to the first and the second audio output devices. [0075] In another embodiment, the signal processor 514 may be configured to control the first amplifier 542 and the second amplifier 546, such that the first language audio signal and the second language audio signal may be amplified to a different degree. This would allow the volume of the first language audio signal output from the first audio output device 544 and the volume of the second language audio signal output from the second audio output device 548 to be adjusted independently, depending on the needs of the different users of the first audio output device 544 and the second audio output device 548.
[0076] By the signal processing device in accordance with the above embodiments, a plurality of language audio signals comprised in a received audio/video signal can be selected and output simultaneously to a plurality of audio output devices, such that a group of users watching the same audio/video program can enjoy the program in different languages simultaneously. The signal processing device may present the language audio signal identification information to the user, e.g. in a TV menu, for the user to select the desired language audio signals to be output to the desired audio output device.
[0077] The above embodiments in FIG. 5 describes the signal processing device incorporated in an analog or digital television system. The signal processing device may also be used in an Internet TV.
[0078] FIG. 6 shows a signal processing device used for Internet TV according to an embodiment.
[0079] The Internet TV system includes a media interface 602 configured to interface the TV to the Internet to receive the video and audio data, and configured to extract internet protocol packets to obtain the transport stream. [0080] A channel decoder 604 is provided to detect and correct errors in the received transport stream, and to transmit the corrected transport stream to a program selector 606. The transport stream may include one or more program streams multiplexed together, wherein each program stream may include video, audio and data elementary streams of a program or channel.
[0081] The program selector 606 is configured to extract a program stream from the corrected transport stream, for example, using a selection signal provided by a user who select the desired program or channel to be output.
[0082] A de-multiplexer 608 is configured to receive the extracted program stream, and to extract video, audio and data elementary streams of the extracted program stream.
[0083] The extracted video, audio and data elementary streams may be transmitted to a signal processor 610. The signal processor 610 may be a signal processing device as described in the above embodiments, and is configured to determine the language audio signals and outputs the selected language audio signals simultaneously to the selected audio output devices based on the input from a user.
[0084] The signal processing device as described in the above embodiments may be used in an analogy television system (e.g. NTSC, PAL, SECAM), a digital television system (e.g. ATSC, DVB, DTMB, ISDB), or an Internet television system. The signal processing device according to the embodiments may be used to process video/audio signals encoded in accordance with any video/audio encoding standards, such as NICAM, Zweikanalton, BTSC and MPEG Transport Stream.
[0085] FIG. 7 shows a flowchart illustrating a method for signal processing in a signal processing device according to an embodiment. [0086] At 702, an audio signal comprising a first language audio signal and a second language audio signal is received via an input port of a signal processing device.
[0087] At 704, the received audio signal is processed by an audio signal processor such that it can be output by an audio output, wherein the audio signal processing comprises determining the first language audio signal and the second language audio signal.
[0088] At 706, the first language audio signal is output to a first audio output port coupled to the audio signal processor, wherein the first language audio signal is to be provided to a first audio output device.
[0089] At 708, the second language audio signal is simultaneously outputt to a second audio output port coupled to the audio signal processor, wherein the second language audio signal is to be provided to a second audio output device being different from the first audio output device.
[0090] By the signal processing device and the method of signal processing according to various embodiments, a bilingual or multilingual language mode of a video or audio (such as a received TV broadcast program or a recorded video/audio program) can be identified, and the audio signal can be output simultaneously in a first language to a first audio output device and in a second language to a second audio output device. The embodiments thus enables a group of users to select independently which languages are to be output to the respective audio output devices, and to listen to multiple languages of a video or audio at the same time. The embodiments also allows the volume settings of different audio output devices to be set independently. [0091] While the invention has been particularly shown and described with reference to specific embodiments, it should be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. The scope of the invention is thus indicated by the appended claims and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced.

Claims

Claims claimed is:
A signal processing device, comprising:
an input port configured to receive an audio signal comprising a first language audio signal and a second language audio signal;
an audio signal processor coupled to the input port, wherein the audio signal processor is configured to process the received audio signal such that it can be output by an audio output, wherein the audio signal processor comprises an audio signal language determiner configured to determine the first language audio signal and the second language audio signal;
a first audio output port coupled to the audio signal processor and configured to provide the first language audio signal to a first audio output device; and a second audio output port coupled to the audio signal processor and configured to provide the second language audio signal to a second audio output device being different from the first audio output device;
wherein the audio signal processor is configured to simultaneously provide the first language audio signal to the first audio output port and to provide the second language audio signal to the second audio output port.
The signal processing device as claimed in claim 1, further comprising:
wherein the input port is configured to receive an audio/video signal comprising a video signal and the audio signal; a video signal processor coupled to the input port, wherein the video signal processor is configured to process the received video signal such that it can be displayed on a display; and
a video signal output port coupled to the video signal processor and configured to provide the video signal to the display.
3. The signal processing device as claimed in claim 1 ,
being configured as a television signal processing device.
4. The signal processing device as claimed in claim 1,
wherein the audio signal further comprises a language audio signal identifying information;
wherein the audio signal language determiner is configured to determine the first language audio signal and the second language audio signal using the language audio signal identifying information.
5. The signal processing device as claimed in claim 4,
wherein language audio signal identifying information is a bilingual language audio signal identification information.
6. The signal processing device as claimed in claim 1 ,
wherein the first audio output device comprises at least one loudspeaker. The signal processing device as claimed in claim 1 ,
wherein the second audio output device comprises a headphone.
The signal processing device as claimed in claim 2,
wherein the audio/video signal is encoded in accordance with a broadcast audio/video encoding format.
The signal processing device as claimed in claim 2,
wherein the audio/video signal is encoded in accordance with an audio/video encoding format selected from a group of audio/video encoding format consisting of:
analog audio/video encoding format; and
digital audio/video encoding format.
The signal processing device as claimed in claim 9,
wherein the audio/video signal is encoded in accordance with an audio/video encoding format selected from a group of audio/video encoding format consisting of:
Near Instantaneous Companded Audio Multiplex;
Zweikanalton;
Multichannel television sound; and
MPEG transport stream. The signal processing device as claimed in claim 9,
wherein the digital audio/video encoding format is selected from a group consisting of:
Internet-based audio/video encoding format;
Digital Video Broadcast encoding format; and
Advanced Television Systems Committee encoding format.
The signal processing device as claimed in claim 1, further comprising:
a language selector configured to select the first language audio signal or the second language audio signal to be output to the first audio output port or the second audio output port.
A method for signal processing in a signal processing device, the method comprising:
receiving an audio signal comprising a first language audio signal and a second language audio signal via an input port of the signal processing device;
processing, by an audio signal processor, the received audio signal such that it can be output by an audio output, wherein the audio signal processing comprises determining the first language audio signal and the second language audio signal; outputting the first language audio signal to a first audio output port coupled to the audio signal processor, wherein the first language audio signal is to be provided to a first audio output device; and simultaneously outputting the second language audio signal to a second audio output port coupled to the audio signal processor, wherein the second language audio signal is to be provided to a second audio output device, wherein the second audio output device is different from the first audio output device.
PCT/SG2009/000306 2009-09-01 2009-09-01 Signal processing device for simultaneously outputting more than one language WO2011028174A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/SG2009/000306 WO2011028174A1 (en) 2009-09-01 2009-09-01 Signal processing device for simultaneously outputting more than one language

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/SG2009/000306 WO2011028174A1 (en) 2009-09-01 2009-09-01 Signal processing device for simultaneously outputting more than one language

Publications (1)

Publication Number Publication Date
WO2011028174A1 true WO2011028174A1 (en) 2011-03-10

Family

ID=43649528

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SG2009/000306 WO2011028174A1 (en) 2009-09-01 2009-09-01 Signal processing device for simultaneously outputting more than one language

Country Status (1)

Country Link
WO (1) WO2011028174A1 (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015101395A1 (en) * 2013-12-30 2015-07-09 Arcelik Anonim Sirketi Method for operating an image display device with voice-over feature
US9971319B2 (en) 2014-04-22 2018-05-15 At&T Intellectual Property I, Lp Providing audio and alternate audio simultaneously during a shared multimedia presentation
US10362346B2 (en) 2017-04-20 2019-07-23 Apple Inc. Simultaneous playback for multiple audience members with different visual and audio needs
US10652622B2 (en) 2017-06-27 2020-05-12 At&T Intellectual Property I, L.P. Method and apparatus for providing content based upon a selected language
CN114554270A (en) * 2022-02-28 2022-05-27 维沃移动通信有限公司 Audio and video playing method and device
US11553215B1 (en) * 2017-09-25 2023-01-10 Amazon Technologies, Inc. Providing alternative live media content

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB396032A (en) * 1930-10-22 1933-07-27 Jacob Beck Process for the simultaneous presentation of sound films in different languages
JPS5812434A (en) * 1981-07-14 1983-01-24 Matsushita Electric Ind Co Ltd Sound multiplex broadcast receiver
JPS5951675A (en) * 1982-09-17 1984-03-26 Matsushita Electric Ind Co Ltd Sound multiplex receiver
CN1459989A (en) * 2002-05-23 2003-12-03 何联泉 Mobile telephone having multiple earphones and microphones capable of operating simultaneously
JP2005110046A (en) * 2003-09-30 2005-04-21 Toshiba Corp Electronic apparatus

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB396032A (en) * 1930-10-22 1933-07-27 Jacob Beck Process for the simultaneous presentation of sound films in different languages
JPS5812434A (en) * 1981-07-14 1983-01-24 Matsushita Electric Ind Co Ltd Sound multiplex broadcast receiver
JPS5951675A (en) * 1982-09-17 1984-03-26 Matsushita Electric Ind Co Ltd Sound multiplex receiver
CN1459989A (en) * 2002-05-23 2003-12-03 何联泉 Mobile telephone having multiple earphones and microphones capable of operating simultaneously
JP2005110046A (en) * 2003-09-30 2005-04-21 Toshiba Corp Electronic apparatus

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015101395A1 (en) * 2013-12-30 2015-07-09 Arcelik Anonim Sirketi Method for operating an image display device with voice-over feature
US9971319B2 (en) 2014-04-22 2018-05-15 At&T Intellectual Property I, Lp Providing audio and alternate audio simultaneously during a shared multimedia presentation
US10754313B2 (en) 2014-04-22 2020-08-25 At&T Intellectual Property I, L.P. Providing audio and alternate audio simultaneously during a shared multimedia presentation
US10362346B2 (en) 2017-04-20 2019-07-23 Apple Inc. Simultaneous playback for multiple audience members with different visual and audio needs
US10652622B2 (en) 2017-06-27 2020-05-12 At&T Intellectual Property I, L.P. Method and apparatus for providing content based upon a selected language
US11553215B1 (en) * 2017-09-25 2023-01-10 Amazon Technologies, Inc. Providing alternative live media content
CN114554270A (en) * 2022-02-28 2022-05-27 维沃移动通信有限公司 Audio and video playing method and device

Similar Documents

Publication Publication Date Title
JP4375837B2 (en) Digital audio / video system and method
US7975285B2 (en) Broadcast receiver and output control method thereof
US20090249420A1 (en) Method for configuring video apparatus according to video system and content, and video apparatus and server applying the same
US6867820B2 (en) Method for displaying audio settings menu of display apparatus
US10230918B2 (en) Controlling sound output based on an output mode of a device
US20130051584A1 (en) Device control apparatus, device control method, and program
US8446533B2 (en) Television apparatus and method for controlling the same
US8750386B2 (en) Content reproduction device
JP4652302B2 (en) Audio reproduction device, video / audio reproduction device, and sound field mode switching method thereof
WO2011028174A1 (en) Signal processing device for simultaneously outputting more than one language
JP2007060658A (en) Control method and system based on scenario
KR20070041567A (en) Audio source selection
JP2010187158A (en) Content processing device
US20130053992A1 (en) Device control apparatus, device control method, and program
US20120154679A1 (en) User-controlled synchronization of audio and video
JP2008035399A (en) Audio/video reproducing system and audio/video reproducing method
JP4611951B2 (en) Audio reproduction device, video / audio reproduction device, and sound field mode switching method thereof
JP2007306470A (en) Video/audio reproducing unit and sound image moving method thereof
KR20100132801A (en) Method and apparatus for receving digital broadcasting signal
JP2008301149A (en) Sound field control method, sound field control program, and sound reproducing device
KR101245158B1 (en) Automatic display setting system for digital broadcast receiver and method thereof
JP2007243460A (en) Relaying apparatus, av reproduction system, and av source apparatus
JP2009017187A (en) Apparatus, system, and method for video/audio reproduction
JP2007258867A (en) Av source apparatus and av reproduction system
JP2009021663A (en) Video audio reproducing apparatus, video audio reproducing system and video audio reproducing method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09849055

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 05/06/2012)

122 Ep: pct application non-entry in european phase

Ref document number: 09849055

Country of ref document: EP

Kind code of ref document: A1