CN104519393B - Handle the method and interlock circuit of video-audio data - Google Patents

Handle the method and interlock circuit of video-audio data Download PDF

Info

Publication number
CN104519393B
CN104519393B CN201310443742.7A CN201310443742A CN104519393B CN 104519393 B CN104519393 B CN 104519393B CN 201310443742 A CN201310443742 A CN 201310443742A CN 104519393 B CN104519393 B CN 104519393B
Authority
CN
China
Prior art keywords
those
audio data
data
dtv
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201310443742.7A
Other languages
Chinese (zh)
Other versions
CN104519393A (en
Inventor
黄凌轩
黄宏吉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
MediaTek Inc
Original Assignee
MStar Semiconductor Inc Taiwan
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by MStar Semiconductor Inc Taiwan filed Critical MStar Semiconductor Inc Taiwan
Priority to CN201310443742.7A priority Critical patent/CN104519393B/en
Publication of CN104519393A publication Critical patent/CN104519393A/en
Application granted granted Critical
Publication of CN104519393B publication Critical patent/CN104519393B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
    • H04N21/43637Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving MPEG packets from an IP network
    • H04N21/4383Accessing a communication channel

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The present invention provides a kind of method handling video-audio data and relevant module, the module is directly transferred to the mobile device that those users respectively hold by by the audio stream of the different channel specified by two persons used above, so that those users are able to be not only capable of playing monophonic audio by DTV to be limited, and the program audio for the channel that it to be watched can be listened to.

Description

Handle the method and interlock circuit of video-audio data
Technical field
The present invention discloses a kind of method handling video-audio data and relevant module, and espespecially a kind of DTV can correspond to not The method for handling video-audio data that is co-channel next while providing different voice data streams to multiple mobile devices to play out And the module of application this method.
Background technology
Occurs the divided frame (Picture-in-picture, PIP, also known as picture screen) of a part on the market at present DTV, function, which essentially consists in, in a manner of divided frame while to play the sections of two or more channels on single screen Purpose picture.Due to the picture for the program that can play multiple and different channels simultaneously, divided frame DTV would generally have compared with The larger sized screen of general domestic TV, such as outdoor video wall.
However, although general divided frame DTV can play the picture of multiple programs simultaneously, but can not The audio of those programs is played simultaneously, and in other words, general divided frame DTV is to play those in a manner of monophonic The audio stream (being typically the audio stream of mother picture subordinate channel) of one of program in program.Therefore, there is multiple make when simultaneously When user watches the different program pictures on same divided frame DTV, the user for only watching mother picture is able to simultaneously Hear the audio for the program that it to be watched, and the user for watching other sprites is then merely able to watch the program that it to be watched Picture.
Invention content
In order to improve general divided frame DTV in prior art be merely able to play single channel audio and can not The shortcomings that playing the audio of other channels simultaneously, present invention is disclosed a kind of methods of processing video-audio data and processing video-audio data Module.
The method of disclosed processing video-audio data is applied to a DTV.The DTV is to aobvious simultaneously Show multiple sprites.This method includes:Receive a derived data, the derived data include corresponding to multichannel video data with Audio data;Multiple selection instructions are received, wherein each selection instruction is sent out by a mobile device, with selecting those frequencies One of road;The video counts of those channels selected respectively corresponding to those selection instructions are decoded from the derived data According to audio data;The video data for those channels that those selection instructions select respectively is played respectively at those sprites; And it is respectively transmitted the audio datas of those channels selected respectively corresponding to those selection instructions and refers to those selections are sent out Those mobile devices enabled.
A kind of module application of disclosed processing video-audio data is in a DTV.The DTV is to same When show multiple sprites.The module includes a control module, a decoder and a data transmission module.The control module according to A first control signal and a second control signal are generated according to multiple selection instructions.The each of those selection instructions is by a movement Device is sent out, to select one of multichannel.The decoder is according to the first control signal to comprising corresponding to this A little video datas of channel and a derived data of audio data are decoded, and are selected respectively with decoding those selection instructions Those channels video data and audio data, and export the video counts for those channels that those selection instructions select respectively It is played out according to this respectively at those sprites.The data transmission module is respectively transmitted to correspond to according to the second control signal and be somebody's turn to do The audio data of a little those selected channels of selection instruction is to those mobile devices.
Description of the drawings
Fig. 1 is the function according to the revealed module transfer audio stream of one embodiment of the invention to multiple mobile devices Block schematic diagram.
Fig. 2 is the flow chart according to the method for handling video-audio data disclosed by one embodiment of the invention.
Symbol description
100 modules
110 decoders
120 display devices
130 data transmission modules
140 control modules
150A, 150B, 150C mobile device
180 detection modules
202,204,206,208,210 step
Specific implementation mode
Referring to Fig. 1, its be according to one embodiment of the invention it is revealed processing video-audio data module 100 transmit with Audio data existing for sub-audio flow pattern state to multiple mobile device 150A, 150B, 150C function block schematic diagram.Module 100 are applied to a DTV, and the DTV can be used to show multiple sprites simultaneously.
Module 100 include a decoder 110, a display device 120, a data transmission module 130, a control module 140, An and detection module 180.
Detection module 180 is used for supplementary module 100 and is examined for the mobile device in one detection range of DTV Survey, detect multiple mobile device 150A, 150B, 150C, and for establish control module 140 and multiple mobile device 150A, Between network connectivity and data transmission module 130 and multiple mobile device 150A, 150B, 150C between 150B, 150C Network connectivity, the wherein network connectivity can be wired or wireless.
Control module 140 is used for each by multiple mobile device 150A, 150B, 150C in a wired mode or wireless mode From reception selection instruction SEL1, SEL2, SEL3, and respectively corresponds to each selection instruction and generate a first control signal and one second Control signal, the wherein first control signal can be transmitted to decoder 110 by control module 140, with indicate decoder 110 into The decoded mode of row, and the second control signal can be transmitted to data transmission module 130 by control module 140, with designation date The mode that transmission module 130 carries out data transmission.Selection instruction SEL1, SEL2, SEL3 are respectively used for selecting the DTV institute One of the multiple channels provided channel.For example with Fig. 1, control module 140 can corresponding selection instruction SEL1 generations An one first control signal C11 and second control signal C12, corresponding selection instruction SEL2 generate a first control signal C21 with One second control signal C22, corresponding selection instruct SEL3 to generate an a first control signal C31 and second control signal C32. In one embodiment of the invention, control module 140 can be according further to the configuration specified by selection instruction SEL1, SEL2 or SEL3 Setting changes configuration mode when display device 120 shows each divided frame.
A channel of the meeting of decoder 110 indicated by the first control signal, more than one that module 100 is received by outside The video flowing and audio stream corresponding to the channel are decoded in media data flow MS.For Fig. 1, decoder 110 can be by first Control a corresponding video flowing VS1 and audio stream AS1 in multimedia data stream MS of one first channel indicated by signal C11 Decode come, by one second channel indicated by first control signal C12 in multimedia data stream MS a corresponding video flowing A VS2 and audio stream AS2 decode come, by the third channel indicated by first control signal C13 in multimedia data stream MS In a corresponding video flowing VS3 and audio stream AS3 decode come.Decoder 110 can will decode come video flowing VS1, VS2, VS3 are transmitted to display device 120, and are transmitted to data transmission module by audio stream AS1, AS2, the AS3 come is decoded 130。
Display device 120 is used for configuring setting according to a divided frame to use divided frame, play video flowing VS1, The program pictures of the corresponding channel of VS2, VS3, the wherein divided frame configuration setting can by selection instruction SEL1, SEL2, Or SEL3 is specified.
Data transmission module 130 is used for audio stream AS1, AS2, AS3 being sent in a wired or wireless manner respectively more A mobile device 150A, 150B, 150C are dialled so that the user of multiple mobile device 150A, 150B, 150C are able to voluntarily select Put the sub-audio stream of the channel to be watched.
Referring to Fig. 2, it is the method for handling video-audio data according to DTV disclosed in one embodiment of the invention Flow chart, wherein module shown in FIG. 1 100 applies this method.As shown in Fig. 2, this method includes that steps are as follows:
Step 202:Multimedia data stream MS is received, multimedia data stream MS includes multiple frequencies that the DTV is provided Encoded video flowing and audio stream in road;
Step 204:Multiple selection instruction SEL1, SEL2, SEL3 are received, each selection instruction is sent out by a mobile device Go out, with selecting one of those channels;
Step 206:From in multimedia data stream MS, decode corresponding to those selection instructions SEL1, SEL2, SEL3 institutes The video flowing and audio stream of those channels selected respectively;
Step 208:Respectively at multiple sprites play that those selection instructions SEL1, SEL2, SEL3 select respectively should The video data of a little channels;And
Step 210:It is respectively transmitted those channels selected respectively corresponding to those selection instructions SEL1, SEL2, SEL3 Audio stream AS1, AS2, AS3 to send out those selection instructions SEL1, SEL2, SEL3 those mobile devices 150A, 150B, 150C。
In step 202, decoder 110 can be by receiving multimedia data stream MS in external multimedia series flow source.
In step 204, control module 140 can respectively receive selection instruction by mobile device 150A, 150B, 150C SEL1, SEL2, SEL3, to be respectively used for selecting one of multiple channels that the DTV provided channel.
In step 206, decoder 110 can by multimedia data stream MS, respectively corresponding selection instruction SEL1, SEL2, Channel specified by SEL3 decodes video flowing VS1, VS2, VS3 and audio stream AS1, AS2, AS3.
In a step 208, the divided frame that display device 120 can be specified by selection instruction SEL1, SEL2 or SEL3 It sets to generate multiple sprites, and plays the content of video flowing VS1, VS2, VS3 respectively in these sprites.In this hair In a bright embodiment, selection instruction SEL1, SEL2, SEL3 are respectively used to specify the arrangement of the divided frame in display device 120 Mode includes size, relative position, permutation and combination, the picture shape etc. between divided frame.
In step 210, the source of respective corresponding selection instruction SEL1, SEL2, the SEL3 of the meeting of data transmission module 130, comes Audio stream AS1, AS2, AS3 are transmitted to mobile device 150A, 150B, 150C so that mobile device 150A can play received Audio stream AS1, mobile device 150B can play received audio stream AS2, mobile device 150C can play it is received Audio stream AS3.
By method shown in Fig. 2, it may make that the user of mobile device 150A, 150B, 150C can be respectively simultaneously aobvious Its program to be watched is watched on showing device 120, and be can pass through mobile device 150A, 150B, the 150C respectively held and come directly Listen to the program audio that sub-audio stream AS1, AS2, AS3 are broadcast and will not be interfering with each other.
Thus, which method shown in Fig. 2 can overcome when DTV plays divided frame in prior art because only The shortcomings that having monophonic and the program audio of the different channel specified by two or more users can not be broadcast.
It note that and method shown in Fig. 2 is imposed into rational permutation and combination and/or was once referred to plus this specification any Restrictive condition and derivative embodiment, still should be regarded as the embodiment of the present invention.
Kei of the present invention shows a kind of method handling video-audio data and the module using this method, makes by by two or more The audio stream of different channel specified by user is directly transferred to the mobile device that those users respectively hold so that those make User is able to be not only capable of playing monophonic audio by DTV to be limited and be able to listen to the program audio for the channel that it to be watched Frequently.

Claims (6)

1. it is a kind of processing video-audio data method, be applied to a DTV, the DTV to simultaneously show multiple sub- pictures Face, this method include:
A derived data is received, which includes the video data and audio data corresponding to multichannel;
Multiple selection instructions are received, generate multiple first control signals according to multiple selection instruction believes with multiple second controls Number, each selection instruction is sent out by a mobile device, with selecting one of those channels;
It decodes from the derived data according to multiple first control signal and is somebody's turn to do corresponding to what those selection instructions selected respectively The video data and audio data of a little channels;
According to multiple first control signal those frequencies that those selection instructions select respectively are played respectively at those sprites The video data in road;And
Distinguish synchronous driving according to multiple second control signal and corresponds to those channels that those selection instructions select respectively Audio data to those mobile devices for sending out those selection instructions.
2. the method for processing video-audio data as described in claim 1, which is characterized in that also include:
Those mobile devices of detection in a detectable range of the DTV;And
Establish the line between the DTV and those mobile devices.
3. the method for processing video-audio data as described in claim 1, which is characterized in that also include:It is set according to those selection instructions The configuration mode of those fixed sprites.
4. it is a kind of processing video-audio data circuit, be applied to a DTV, the DTV to simultaneously show multiple sub- pictures Face, the circuit include:
One control module generates multiple first control signals and multiple second control signals according to multiple selection instructions, those choosings The each for selecting instruction is sent out by a mobile device, to select one of multichannel;
One decoder, according to multiple first control signal to including the video data and audio data corresponding to those channels One derived data is decoded, to decode the video data and audio number of those channels that those selection instructions select respectively According to, and the video data for those channels that those selection instructions select respectively is exported to be broadcast respectively at those sprites It puts;And
One data transmission module corresponds to according to the difference synchronous driving of multiple second control signal selected by those selection instructions Those channels audio data to those mobile devices.
5. the circuit of processing video-audio data as claimed in claim 4, which is characterized in that include also a detection module, to detect Those mobile devices in a detectable range of the DTV, and establish between the control module and those mobile devices Line, and establish the line between the data transmission module and those mobile devices.
6. the circuit of processing video-audio data as claimed in claim 4, which is characterized in that the control module is according to those selection instructions Set the configuration mode of those sprites.
CN201310443742.7A 2013-09-26 2013-09-26 Handle the method and interlock circuit of video-audio data Expired - Fee Related CN104519393B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310443742.7A CN104519393B (en) 2013-09-26 2013-09-26 Handle the method and interlock circuit of video-audio data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310443742.7A CN104519393B (en) 2013-09-26 2013-09-26 Handle the method and interlock circuit of video-audio data

Publications (2)

Publication Number Publication Date
CN104519393A CN104519393A (en) 2015-04-15
CN104519393B true CN104519393B (en) 2018-07-17

Family

ID=52794015

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310443742.7A Expired - Fee Related CN104519393B (en) 2013-09-26 2013-09-26 Handle the method and interlock circuit of video-audio data

Country Status (1)

Country Link
CN (1) CN104519393B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105245938B (en) * 2015-09-30 2019-08-16 努比亚技术有限公司 The device and method for playing multimedia file
CN106131666A (en) * 2016-07-18 2016-11-16 杭州当虹科技有限公司 A kind of set-top box video navigation system based on many tracks Video Composition technology

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103118298A (en) * 2013-02-21 2013-05-22 华为终端有限公司 Device and method for simultaneously playing multiple television programs

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4011949B2 (en) * 2002-04-01 2007-11-21 キヤノン株式会社 Multi-screen composition device and digital television receiver
US20060230427A1 (en) * 2005-03-30 2006-10-12 Gerard Kunkel Method and system of providing user interface
KR101386882B1 (en) * 2007-06-08 2014-04-18 삼성전자주식회사 Method and apparatus for displaying channel information of digital broadcasting
US8239897B2 (en) * 2008-09-05 2012-08-07 Eldon Technology Limited Method and apparatus for multiple audio outputs

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103118298A (en) * 2013-02-21 2013-05-22 华为终端有限公司 Device and method for simultaneously playing multiple television programs

Also Published As

Publication number Publication date
CN104519393A (en) 2015-04-15

Similar Documents

Publication Publication Date Title
CN100405832C (en) TV set apparatus capable of simultaneously receiving and playing multi-channel programs
CN108134978A (en) For the interactive method and system rendered of object-based audio
CN106063283B (en) Method and apparatus for synchronizing the playback at two electronic equipments
CN103118298A (en) Device and method for simultaneously playing multiple television programs
CN104780404B (en) Sound auxiliary device and operating method
US20190373321A1 (en) Reception device
CN105915996A (en) Multipath stream media playing method and equipment
US20090303387A1 (en) Digital tv having two channel stereo
CN104519393B (en) Handle the method and interlock circuit of video-audio data
TWI530169B (en) Method of processing video/audio data and module thereof
CN106293603A (en) Audio output system and output intent
CN100435553C (en) Image processing device and method for image display device
KR101488068B1 (en) Advertise embedded system, advertisement embedded methodm and recording medium thereof
CN102223560A (en) Audio and video playing system and method related to double-image application
KR20120081494A (en) Systems for viewing multimedia, apparatus for receiving a broadcasting signal, methods for viewing multimedia thereof, and methods for receiving a broadcasting signal thereof
US20150195617A1 (en) Image display apparatus, image processing method, and computer readable recording medium
US20120038823A1 (en) Display system
JP2008072558A (en) Television receiver
CN104244071A (en) Audio playing system and control method
JP2014036419A (en) Electronic apparatus and broadcast signal transmitter
CN102710914A (en) Double-picture display audio processing device and method
US20160330506A1 (en) Method and data processing apparatus supporting simultaneous playback
JP2008270962A5 (en)
KR101798961B1 (en) Broadcasting Signal Receiver and Driving Method thereof
KR101811398B1 (en) Broadcasting Signal Receiver and Driving Method thereof

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20200410

Address after: No.1, Duhang 1st Road, Hsinchu City, Hsinchu Science Park, Taiwan, China

Patentee after: MEDIATEK Inc.

Address before: Taiwan Hsinchu County Tai Yuan Street China jhubei City, No. 26 4 floor 1

Patentee before: MSTAR SEMICONDUCTOR Inc.

CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20180717

Termination date: 20210926