CN105142009A - Audio-video playing control method and device - Google Patents

Audio-video playing control method and device Download PDF

Info

Publication number
CN105142009A
CN105142009A CN201510466859.6A CN201510466859A CN105142009A CN 105142009 A CN105142009 A CN 105142009A CN 201510466859 A CN201510466859 A CN 201510466859A CN 105142009 A CN105142009 A CN 105142009A
Authority
CN
China
Prior art keywords
audio
video playing
video
video data
mobile terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510466859.6A
Other languages
Chinese (zh)
Other versions
CN105142009B (en
Inventor
曹芝勇
刘付光旺
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen TCL New Technology Co Ltd
Shenzhen TCL Digital Technology Co Ltd
Original Assignee
Shenzhen TCL New Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen TCL New Technology Co Ltd filed Critical Shenzhen TCL New Technology Co Ltd
Priority to CN201510466859.6A priority Critical patent/CN105142009B/en
Publication of CN105142009A publication Critical patent/CN105142009A/en
Priority to PCT/CN2016/084426 priority patent/WO2017020649A1/en
Application granted granted Critical
Publication of CN105142009B publication Critical patent/CN105142009B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440218Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Databases & Information Systems (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

The invention discloses an audio-video playing control method. The audio-video playing control method comprises the following steps: receiving an audio-video playing request sent by a mobile terminal and obtaining preset audio-video playing feature data in the audio-video playing request; screening audio-video data corresponding to a code stream received at present according to the audio-video playing feature data to obtain audio-video data to be coded; coding the audio-video data to be coded to form a multimedia file; and outputting the multimedia file to the mobile terminal so that the mobile terminal plays the audio and the video. The invention also discloses an audio-video playing control device. The audio-video playing control method is used for solving the problem that the mobile terminal fails in playing due to the limited decoding capability of the mobile terminal during multi-screen interaction.

Description

Audio and video playing control method and device
Technical field
The present invention relates to display terminal technical field, particularly relate to audio and video playing control method and device.
Background technology
At present, TV, computer and mobile phone contact three maximum large platforms in domestic consumer's daily life, and they respectively have feature: video screen is large, and viewing experience is good; Computer function is many, and storage area enriches; Portable mobile phone carries, most convenient.When user uses television-viewing video at home, although viewing experience is good, in operation and content resource far away from mobile phone and computer abundant.The advantage of three large platforms merges with regard to being intended to by the appearance of multi-screen interactive technology, realizes best Consumer's Experience.
In prior art in multi-screen interactive technology, normally each terminal directly obtains original audio, video data, terminal is decoded, then plays.Owing to needing to decode in each terminal, therefore higher to demanding terminal, if use the terminal without decoding function to play.
Foregoing, only for auxiliary understanding technical scheme of the present invention, does not represent and admits that foregoing is prior art.
Summary of the invention
Main purpose of the present invention is to provide a kind of audio and video playing control method and device, is intended to solution when carrying out multi-screen interactive, and the decoding capability restriction being subject to mobile terminal causes mobile terminal to play.
For achieving the above object, a kind of audio and video playing control method provided by the invention comprises the following steps:
When receiving the audio and video playing request of mobile terminal transmission, obtain audio and video playing characteristic preset in described audio and video playing request;
The audio, video data corresponding to the code stream be currently received according to described audio and video playing characteristic screens and obtains audio, video data to be encoded;
Coding is carried out to described audio, video data to be encoded and forms multimedia file;
Export described multimedia file to described mobile terminal, carry out audio and video playing for mobile terminal.
Preferably, the described audio, video data corresponding to the code stream be currently received according to described audio and video playing characteristic screens and obtains audio, video data to be encoded and comprise:
According to audio and video playing characteristic, coupling screening is carried out to the PID of program in the described code stream be currently received, to delete and the unmatched PID of described audio and video playing characteristic and corresponding audio, video data, form audio, video data to be encoded.
Preferably, described to described audio, video data to be encoded carry out coding formed multimedia file comprise:
Determine need the first audio, video data of recompile in audio, video data to be encoded and do not need the second audio, video data of recompile according to described audio and video playing characteristic and preset features information in the code stream be currently received;
The encryption algorithm corresponding according to described audio and video playing characteristic, to described first audio, video data recompile process;
Audio, video data after recompile and described second audio, video data are carried out encapsulation and form multimedia file.
Preferably, described to described audio, video data to be encoded carry out coding formed multimedia file also comprise:
Judge whether current network speed is less than the described mobile maximal rate supported eventually;
If so, then according to the code check of described current network speed setting recompile;
If not, then the maximal rate that described mobile terminal is supported is set as the code check of recompile.
Preferably, describedly export multimedia file to described mobile terminal, also comprised carry out the step of video playback for mobile terminal before:
Judge whether the size of multimedia file is greater than preset value;
If so, then perform and describedly export multimedia file to described mobile terminal, carry out the step of video playback for mobile terminal.
In addition, for achieving the above object, the present invention also provides a kind of audio and video playing control device to comprise:
Acquisition module, for receive mobile terminal send audio and video playing request time, obtain audio and video playing characteristic preset in described audio and video playing request;
Screening module, screens for the audio, video data corresponding to the code stream be currently received according to described audio and video playing characteristic and obtains audio, video data to be encoded;
Coding module, forms multimedia file for carrying out coding to described audio, video data to be encoded;
Transport module, for exporting described multimedia file to described mobile terminal, carries out audio and video playing for mobile terminal.
Preferably, described screening module specifically for, according to audio and video playing characteristic, coupling screening is carried out to the PID of program in the described code stream be currently received, to delete and the unmatched PID of described audio and video playing characteristic and corresponding audio, video data, form audio, video data to be encoded.
Preferably, described coding module comprises:
Determining unit, for determining need the first audio, video data of recompile in audio, video data to be encoded and do not need the second audio, video data of recompile according to described audio and video playing characteristic and preset features information in the code stream be currently received;
Coding unit, for the encryption algorithm corresponding according to described audio and video playing characteristic, carries out recompile process to described first audio, video data;
Encapsulation unit, forms multimedia file for the audio, video data after recompile and described second audio, video data being carried out encapsulation.
Preferably, described coding module also comprises:
Second judging unit, for judging whether current network speed is less than the described mobile maximal rate supported eventually;
Setup unit, when being less than for current network speed the maximal rate supported described mobile end, according to the code check of described current network speed setting recompile; When current network speed is more than or equal to the maximal rate supported described mobile end, the maximal rate that described mobile terminal is supported is set as the code check of recompile.
Preferably, described audio and video playing control device also comprises:
Judge module, for judging whether the size of multimedia file is greater than preset value; When the size of described multimedia file is greater than preset value, triggers described transport module and export multimedia file to described mobile terminal, carry out video playback for mobile terminal.
The embodiment of the present invention by receive mobile terminal send audio and video playing request time, obtain audio and video playing characteristic preset in described audio and video playing request; And the audio, video data corresponding to the code stream be currently received according to described audio and video playing characteristic screens and obtains audio, video data to be encoded; Coding is carried out to described audio, video data to be encoded and forms multimedia file; Then export described multimedia file to described mobile terminal, carry out audio and video playing for mobile terminal.Due to when carrying out audio and video playing, encryption algorithm corresponding according to the audio and video playing characteristic of mobile terminal for audio, video data is re-started coding, therefore, when carrying out multi-screen interactive, the decoding capability restriction being subject to mobile terminal causes mobile terminal to play.
Accompanying drawing explanation
Fig. 1 is the schematic flow sheet of audio and video playing control method first embodiment of the present invention;
Fig. 2 is the refinement schematic flow sheet of encoding to audio, video data in audio and video playing control method the 3rd embodiment of the present invention;
Fig. 3 is audio and video playing characteristic and preset features information comparison exemplary plot in audio and video playing control method one embodiment of the present invention;
Fig. 4 is the refinement schematic flow sheet of encoding to audio, video data in audio and video playing control method the 4th embodiment of the present invention;
Fig. 5 is the schematic flow sheet of audio and video playing control method the 5th embodiment of the present invention;
Fig. 6 is the functional module structure schematic diagram of audio and video playing control device first embodiment of the present invention;
Fig. 7 is the refinement functional module structure schematic diagram of coding module in audio and video playing control device the 3rd embodiment of the present invention;
Fig. 8 is the refinement functional module structure schematic diagram of coding module in audio and video playing control device the 4th embodiment of the present invention;
Fig. 9 is the functional module structure schematic diagram of audio and video playing control device the 5th embodiment of the present invention.
The realization of the object of the invention, functional characteristics and advantage will in conjunction with the embodiments, are described further with reference to accompanying drawing.
Embodiment
Should be appreciated that specific embodiment described herein only in order to explain the present invention, be not intended to limit the present invention.
The invention provides a kind of audio and video playing control method, with reference to Fig. 1, in audio and video playing control method first embodiment of the present invention, this audio and video playing control method comprises the following steps:
Step S10, when receiving the audio and video playing request of mobile terminal transmission, obtains audio and video playing characteristic preset in described audio and video playing request;
The audio and video playing control method that the embodiment of the present invention provides is mainly used in multi-screen interactive transmission system.Particularly, this Multi-screen interaction system comprises a main display terminal and multiple secondary display terminal, and wherein, the audio, video data that secondary display terminal shows according to main display terminal carries out audio and video playing.In following embodiment, with main display terminal for television set, secondary display terminal is mobile terminal is that example makes detailed description.
Particularly, above-mentioned mobile terminal and television set carry out communication and are connected (such as bluetooth connects or network connects), can communication mutually.Be provided with many equipment viewing application in the terminal, after user clicks this application of startup, audio and video playing request will be generated, this audio and video playing request comprises audio and video playing characteristic, this audio and video playing characteristic comprise mobile terminal support video/audio format, screen resolution, speech selection, number of channels, the maximal rate of support and the maximum frame per second etc. play.This audio and video playing request is sent to television set by mobile terminal under networking state, and television set receives this audio and video playing request and will resolve the audio and video playing characteristic obtained in audio and video playing request.
It should be noted that the mode of mobile terminal transmission playing request can be arranged according to actual needs, make detailed description for network connection.Particularly, first mobile terminal judges whether that setting up network connects, after setting up networking connection; Judge whether to there is the television set that can access; Can the television set in orientation when existing, then described mobile terminal sends handshake request to described television set and is connected with the communication of mobile terminal to set up television set.Set up after communication is connected at television set and mobile terminal, above-mentioned audio and video playing request can be sent to television set by network by mobile terminal.
Step S20, the audio, video data corresponding to the code stream be currently received according to described audio and video playing characteristic screens and obtains audio, video data to be encoded;
Step S30, carries out coding to described audio, video data to be encoded and forms multimedia file;
In the present embodiment, store the standard code algorithm of the encapsulation format that mobile terminal is commonly used in a television set.Television set is when carrying out audio and video playing, Real-time Obtaining code stream, and the audio, video data in code stream is decoded out play, this audio, video data is screened according to above-mentioned audio and video playing characteristic simultaneously, thus obtain the audio, video data to be encoded that mates with mobile terminal.Then according to above-mentioned standard code algorithm, audio, video data is carried out code conversion, and be encapsulated as the multimedia file of audio frequency and video form corresponding to above-mentioned audio and video playing characteristic, finally this multimedia file is stored in the buffer memory of television set.
Step S40, exports described multimedia file to described mobile terminal, carries out audio and video playing for mobile terminal.
There is multimedia file in the buffer memory of television set after, will by this multimedia file with the form of packet by network transmission to mobile terminal.After mobile terminal receives multimedia file, multimedia file is stored in internal memory, when being cached to a certain degree, reminding user is the need of broadcasting; When user inputs the operational order of broadcasting, then call player loading multimedia file, thus realize audio and video playing.
The embodiment of the present invention by receive mobile terminal send audio and video playing request time, obtain audio and video playing characteristic preset in described audio and video playing request; And the audio, video data corresponding to the code stream be currently received according to described audio and video playing characteristic screens and obtains audio, video data to be encoded; Coding is carried out to described audio, video data to be encoded and forms multimedia file; Then export described multimedia file to described mobile terminal, carry out audio and video playing for mobile terminal.Due to when carrying out audio and video playing, encryption algorithm corresponding according to the audio and video playing characteristic of mobile terminal for audio, video data is re-started coding, therefore, when carrying out multi-screen interactive, the decoding capability restriction being subject to mobile terminal causes mobile terminal to play.
Further, based on audio and video playing control method first embodiment of the present invention, in audio and video playing control method second embodiment of the present invention, above-mentioned steps S20 comprises:
According to audio and video playing characteristic, coupling screening is carried out to the PID of program in the described code stream be currently received, to delete and the unmatched PID of described audio and video playing characteristic and corresponding audio, video data, form audio, video data to be encoded.
In the present embodiment, above-mentioned television set real-time reception code stream, and import hardware filter into by decoder (Demod), identify to filter in code stream finally by above-mentioned PID and save destination data.Particularly, television set can search the PID of the unnecessary track of this program and letter from the pmt table of program according to above-mentioned audio and video playing characteristic, then the PID searching acquisition is all marked into a sequence array, finally by hardware filter, legal PID is generated the stream of the TS after filtering.Particularly in this TS flows owing to deleting the audio, video data of above-mentioned unnecessary track and letter correspondence, thus reduce volume of transmitted data.
Further, with reference to Fig. 2, based on audio and video playing control method first embodiment of the present invention, in audio and video playing control method the 3rd embodiment of the present invention, above-mentioned steps S30 comprises:
Step S31, determines need the first audio, video data of recompile in audio, video data to be encoded and do not need the second audio, video data of recompile according to described audio and video playing characteristic and preset features information in the code stream be currently received;
Step S32, the encryption algorithm corresponding according to described audio and video playing characteristic, to described first audio, video data recompile process;
Step S33, carries out encapsulation and forms multimedia file by the audio, video data after recompile and described second audio, video data.
As shown in Figure 3, the preset features information of above-mentioned code stream and audio and video playing characteristic are compared determine both differences: comprise encapsulation format, video format is different with resolution.Now, needing the parameter of carrying out code conversion to be video format, when carrying out audio, video data recompile, needing video format to be revised as H.263.Simultaneously according to above table when carrying out encapsulation and forming multimedia file, need encapsulation format to be revised as 3GPP, to meet the format needs of mobile terminal support.In embodiments of the present invention, due to above-mentioned audio and video playing characteristic and preset features information in the code stream be currently received are compared, and only for needing content corresponding to the parameter of recompile to encode, the time needed of encoding therefore can be reduced.
Understandable, in order to meet resolution requirements, improve result of broadcast.In the present embodiment, conversion of resolution process can also be carried out to audio, video data to be encoded.Particularly, in the present embodiment, above-mentioned steps S30 can also comprise:
Judge whether the resolution of the code stream be currently received is greater than the display resolution of described mobile terminal;
If so, then conversion of resolution is carried out to described audio, video data to be encoded.
In the present embodiment, after legal PID being generated the stream of the TS after filtering by hardware filter, decode to this TS stream and obtain audio, video data to be encoded, this audio, video data comprises: the base pixel data that video decode is formed are become elementary bit stream with by audio decoder.Then judge whether the resolution of the code stream be currently received is less than the display resolution of described mobile terminal, when the resolution of the code stream be currently received is greater than the display resolution of described mobile terminal, then conversion of resolution is carried out to base pixel data in above-mentioned audio, video data to be encoded, and then re-start encoding operation; When the resolution of the code stream be currently received is less than or equal to the display resolution of described mobile terminal, then directly carry out recompile operation.As shown in Figure 3, the resolution of code stream is 1920*1080, the display resolution 1280*720 of mobile terminal, now then needs the resolution of above-mentioned base pixel data to change, is converted to 1280*720.
The mode of conversion of resolution can be arranged according to actual needs, and particularly, with the resolution of above-mentioned code stream for 1920*1080, the display resolution 1280*720 of mobile terminal is that example makes detailed description.In the present embodiment, above-mentioned horizontal direction conversion coefficient is a=1280/1920, and vertical direction variation coefficient is b=720/1080.
Further, with reference to Fig. 4, based on audio and video playing control method the 3rd embodiment of the present invention, in audio and video playing control method the 4th embodiment of the present invention, above-mentioned steps S30 also comprises:
Step S34, judges whether current network speed is less than the described mobile maximal rate supported eventually; If so, then perform step S35, otherwise perform step S36;
Step S35, according to the code check of described current network speed setting recompile;
Step S36, is set as the code check of recompile by the maximal rate that described mobile terminal is supported.
In the present embodiment, according to the network speed of network test tool real-time testing current network, can then judge that the maximal rate that current network speed and mobile terminal are supported compares.When current network speed be less than described mobile support eventually maximal rate time, then according to the code check of current network speed determination recompile, thus effectively prevent that the code check of encoding is excessive causes transmission not smooth, and then impact is in the effect of mobile terminal playing.
Further, with reference to Fig. 5, based on audio and video playing control method any embodiment of the present invention, in audio and video playing control method the 5th embodiment of the present invention, also comprise before above-mentioned steps S40:
Step S50, judges whether the size of multimedia file is greater than preset value; If so, then step S40 is performed, no, then continue to judge whether the size of multimedia file is greater than preset value.
In the present embodiment, above-mentioned multimedia file is temporary in the internal memory of television set, along with video is ceaselessly play, the multimedia file be stored in internal memory will constantly increase, (the above-mentioned preset value when reaching smallest transmission unit, need to be greater than code check * n, n for specifying duration, such as, is 1, is broadcasting 1 video size in second), by multimedia file by Internet Transmission to mobile terminal, carry out audio and video playing for mobile terminal.
The present invention also provides a kind of audio and video playing control device, and with reference to Fig. 6, in audio and video playing control device first embodiment of the present invention, this audio and video playing control device comprises:
Acquisition module 10, for receive mobile terminal send audio and video playing request time, obtain audio and video playing characteristic preset in described audio and video playing request;
The audio and video playing control device that the embodiment of the present invention provides is mainly used in multi-screen interactive transmission system.Particularly, this Multi-screen interaction system comprises a main display terminal and multiple secondary display terminal, and wherein, the audio, video data that secondary display terminal shows according to main display terminal carries out audio and video playing.In following embodiment, with main display terminal for television set, secondary display terminal is mobile terminal is that example makes detailed description.
Particularly, above-mentioned mobile terminal and television set carry out communication and are connected (such as bluetooth connects or network connects), can communication mutually.Be provided with many equipment viewing application in the terminal, after user clicks this application of startup, audio and video playing request will be generated, this audio and video playing request comprises audio and video playing characteristic, this audio and video playing characteristic comprise mobile terminal support video/audio format, screen resolution, speech selection, number of channels, the maximal rate of support and the maximum frame per second etc. play.This audio and video playing request is sent to television set by mobile terminal under networking state, and television set receives this audio and video playing request and will resolve the audio and video playing characteristic obtained in audio and video playing request.
It should be noted that the mode of mobile terminal transmission playing request can be arranged according to actual needs, make detailed description for network connection.Particularly, first mobile terminal judges whether that setting up network connects, after setting up networking connection; Judge whether to there is the television set that can access; Can the television set in orientation when existing, then described mobile terminal sends handshake request to described television set and is connected with the communication of mobile terminal to set up television set.Set up after communication is connected at television set and mobile terminal, above-mentioned audio and video playing request can be sent to television set by network by mobile terminal.
Screening module 20, screens for the audio, video data corresponding to the code stream be currently received according to described audio and video playing characteristic and obtains audio, video data to be encoded;
Coding module 30, forms multimedia file for carrying out coding to described audio, video data to be encoded;
In the present embodiment, store the standard code algorithm of the encapsulation format that mobile terminal is commonly used in a television set.Television set is when carrying out audio and video playing, Real-time Obtaining code stream, and the audio, video data in code stream is decoded out play, this audio, video data is screened according to above-mentioned audio and video playing characteristic simultaneously, thus obtain the audio, video data to be encoded that mates with mobile terminal.Then according to above-mentioned standard code algorithm, audio, video data is carried out code conversion, and be encapsulated as the multimedia file of audio frequency and video form corresponding to above-mentioned audio and video playing characteristic, finally this multimedia file is stored in the buffer memory of television set.
Transport module 40, for exporting described multimedia file to described mobile terminal, carries out audio and video playing for mobile terminal.
There is multimedia file in the buffer memory of television set after, will by this multimedia file with the form of packet by network transmission to mobile terminal.After mobile terminal receives multimedia file, multimedia file is stored in internal memory, when being cached to a certain degree, reminding user is the need of broadcasting; When user inputs the operational order of broadcasting, then call player loading multimedia file, thus realize audio and video playing.
The embodiment of the present invention by receive mobile terminal send audio and video playing request time, obtain audio and video playing characteristic preset in described audio and video playing request; And the audio, video data corresponding to the code stream be currently received according to described audio and video playing characteristic screens and obtains audio, video data to be encoded; Coding is carried out to described audio, video data to be encoded and forms multimedia file; Then export described multimedia file to described mobile terminal, carry out audio and video playing for mobile terminal.Due to when carrying out audio and video playing, encryption algorithm corresponding according to the audio and video playing characteristic of mobile terminal for audio, video data is re-started coding, therefore, when carrying out multi-screen interactive, the decoding capability restriction being subject to mobile terminal causes mobile terminal to play.
Further, based on audio and video playing control device first embodiment of the present invention, in audio and video playing control device second embodiment of the present invention, above-mentioned screening module 20 specifically for, according to audio and video playing characteristic, coupling screening is carried out to the PID of program in the described code stream be currently received, to delete and the unmatched PID of described audio and video playing characteristic and corresponding audio, video data, form audio, video data to be encoded
In the present embodiment, above-mentioned television set real-time reception code stream, and import hardware filter into by decoder (Demod), identify to filter in code stream finally by above-mentioned PID and save destination data.Particularly, television set can search the PID of the unnecessary track of this program and letter from the pmt table of program according to above-mentioned audio and video playing characteristic, then the PID searching acquisition is all marked into a sequence array, finally by hardware filter, legal PID is generated the stream of the TS after filtering.Particularly in this TS flows owing to deleting the audio, video data of above-mentioned unnecessary track and letter correspondence, thus reduce volume of transmitted data.Then decode to this TS stream and obtain audio, video data to be encoded, this audio, video data comprises: the base pixel data that video decode is formed are become elementary bit stream with by audio decoder.
Further, with reference to Fig. 7, based on audio and video playing control device first embodiment of the present invention, in audio and video playing control device the 3rd embodiment of the present invention, above-mentioned coding module 30 comprises
Determining unit 31, for determining need the first audio, video data of recompile in audio, video data to be encoded and do not need the second audio, video data of recompile according to described audio and video playing characteristic and preset features information in the code stream be currently received;
Coding unit 32, for the encryption algorithm corresponding according to described audio and video playing characteristic, carries out recompile process to described first audio, video data;
Encapsulation unit 33, forms multimedia file for the audio, video data after recompile and described second audio, video data being carried out encapsulation.
As shown in Figure 3, the preset features information of above-mentioned code stream and audio and video playing characteristic are compared determine both differences: comprise encapsulation format, video format is different with resolution.Now, needing the parameter of carrying out code conversion to be video format, when carrying out audio, video data recompile, needing video format to be revised as H.263.Simultaneously according to above table when carrying out encapsulation and forming multimedia file, need encapsulation format to be revised as 3GPP, to meet the format needs of mobile terminal support.In embodiments of the present invention, due to above-mentioned audio and video playing characteristic and preset features information in the code stream be currently received are compared, and only for needing content corresponding to the parameter of recompile to encode, the time needed of encoding therefore can be reduced.Understandable, if just encode after carrying out conversion of resolution to audio, video data to be encoded in a second embodiment, then the basis of encoding is the audio, video data to be encoded after conversion of resolution.
Understandable, in order to meet resolution requirements, improve result of broadcast.In the present embodiment, conversion of resolution process can also be carried out to audio, video data to be encoded.Particularly, in the present embodiment, above-mentioned coding module 30 can also comprise:
First judging unit, for judging whether the resolution of the code stream be currently received is less than the display resolution of described mobile terminal;
Processing unit, for when the resolution of the code stream be currently received is greater than the display resolution of described mobile terminal, carries out conversion of resolution to described audio, video data to be encoded.
In the present embodiment, after legal PID being generated the stream of the TS after filtering by hardware filter, decode to this TS stream and obtain audio, video data to be encoded, this audio, video data comprises: the base pixel data that video decode is formed are become elementary bit stream with by audio decoder.Then judge whether the resolution of the code stream be currently received is less than the display resolution of described mobile terminal, when the resolution of the code stream be currently received is greater than the display resolution of described mobile terminal, then conversion of resolution is carried out to base pixel data in above-mentioned audio, video data to be encoded, and then re-start encoding operation; When the resolution of the code stream be currently received is less than or equal to the display resolution of described mobile terminal, then directly carry out recompile operation.As shown in Figure 3, the resolution of code stream is 1920*1080, the display resolution 1280*720 of mobile terminal, now then needs the resolution of above-mentioned base pixel data to change, is converted to 1280*720.
The mode of conversion of resolution can be arranged according to actual needs, and particularly, with the resolution of above-mentioned code stream for 1920*1080, the display resolution 1280*720 of mobile terminal is that example makes detailed description.In the present embodiment, above-mentioned horizontal direction conversion coefficient is a=1280/1920, and vertical direction variation coefficient is b=720/1080.
Further, with reference to Fig. 8, based on audio and video playing control device the 3rd embodiment of the present invention, in audio and video playing control device the 4th embodiment of the present invention, above-mentioned coding module 20 also comprises:
Second judging unit 24, for judging whether current network speed is less than the described mobile maximal rate supported eventually;
Setup unit 25, when being less than for current network speed the maximal rate supported described mobile end, according to the code check of described current network speed setting recompile; When current network speed is more than or equal to the maximal rate supported described mobile end, the maximal rate that described mobile terminal is supported is set as the code check of recompile.
In the present embodiment, according to the network speed of network test tool real-time testing current network, can then judge that the maximal rate that current network speed and mobile terminal are supported compares.When current network speed be less than described mobile support eventually maximal rate time, then according to the code check of current network speed determination recompile, thus effectively prevent that the code check of encoding is excessive causes transmission not smooth, and then impact is in the effect of mobile terminal playing.
Further, with reference to Fig. 9, based on audio and video playing control device any embodiment of the present invention, in audio and video playing control device the 5th embodiment of the present invention, above-mentioned audio and video playing control device also comprises:
Judge module 50, for judging whether the size of multimedia file is greater than preset value; When the size of described multimedia file is greater than preset value, triggers described transport module 40 and export multimedia file to described mobile terminal, carry out video playback for mobile terminal.
These are only the preferred embodiments of the present invention; not thereby the scope of the claims of the present invention is limited; every utilize specification of the present invention and accompanying drawing content to do equivalent structure or equivalent flow process conversion; or be directly or indirectly used in other relevant technical fields, be all in like manner included in scope of patent protection of the present invention.

Claims (10)

1. an audio and video playing control method, is characterized in that, described audio and video playing control method comprises the following steps:
When receiving the audio and video playing request of mobile terminal transmission, obtain audio and video playing characteristic preset in described audio and video playing request;
The audio, video data corresponding to the code stream be currently received according to described audio and video playing characteristic screens, and obtains audio, video data to be encoded;
Coding is carried out to described audio, video data to be encoded and forms multimedia file;
Export described multimedia file to described mobile terminal, carry out audio and video playing for mobile terminal.
2. audio and video playing control method as claimed in claim 1, is characterized in that, the described audio, video data corresponding to the code stream be currently received according to described audio and video playing characteristic screens and obtain audio, video data to be encoded and comprise:
According to audio and video playing characteristic, coupling screening is carried out to the PID of program in the described code stream be currently received, to delete and the unmatched PID of described audio and video playing characteristic and corresponding audio, video data, form audio, video data to be encoded.
3. audio and video playing control method as claimed in claim 1, is characterized in that, describedly carries out coding formation multimedia file to described audio, video data to be encoded and comprises:
Determine need the first audio, video data of recompile in audio, video data to be encoded and do not need the second audio, video data of recompile according to described audio and video playing characteristic and preset features information in the code stream be currently received;
The encryption algorithm corresponding according to described audio and video playing characteristic, to described first audio, video data recompile process;
Audio, video data after recompile and described second audio, video data are carried out encapsulation and form multimedia file.
4. audio and video playing control method as claimed in claim 3, is characterized in that, describedly carries out coding formation multimedia file to described audio, video data to be encoded and also comprises:
Judge whether current network speed is less than the described mobile maximal rate supported eventually;
If so, then according to the code check of described current network speed setting recompile;
If not, then the maximal rate that described mobile terminal is supported is set as the code check of recompile.
5. the audio and video playing control method as described in any one of Claims 1-4, is characterized in that, describedly exports multimedia file to described mobile terminal, also comprises before carrying out the step of video playback for mobile terminal:
Judge whether the size of multimedia file is greater than preset value;
If so, then perform and describedly export multimedia file to described mobile terminal, carry out the step of video playback for mobile terminal.
6. an audio and video playing control device, is characterized in that, described audio and video playing control device comprises:
Acquisition module, for receive mobile terminal send audio and video playing request time, obtain audio and video playing characteristic preset in described audio and video playing request;
Screening module, screens for the audio, video data corresponding to the code stream be currently received according to described audio and video playing characteristic and obtains audio, video data to be encoded;
Coding module, forms multimedia file for carrying out coding to described audio, video data to be encoded;
Transport module, for exporting described multimedia file to described mobile terminal, carries out audio and video playing for mobile terminal.
7. audio and video playing control device as claimed in claim 6, it is characterized in that, described screening module specifically for, according to audio and video playing characteristic, coupling screening is carried out to the PID of program in the described code stream be currently received, to delete and the unmatched PID of described audio and video playing characteristic and corresponding audio, video data, form audio, video data to be encoded.
8. audio and video playing control device as claimed in claim 6, it is characterized in that, described coding module comprises:
Determining unit, for determining need the first audio, video data of recompile in audio, video data to be encoded and do not need the second audio, video data of recompile according to described audio and video playing characteristic and preset features information in the code stream be currently received;
Coding unit, for the encryption algorithm corresponding according to described audio and video playing characteristic, carries out recompile process to described first audio, video data;
Encapsulation unit, forms multimedia file for the audio, video data after recompile and described second audio, video data being carried out encapsulation.
9. audio and video playing control device as claimed in claim 8, it is characterized in that, described coding module also comprises:
Second judging unit, for judging the maximal rate whether current network speed is less than described mobile terminal and supports;
Setup unit, when being less than for current network speed the maximal rate supported described mobile end, according to the code check of described current network speed setting recompile; When current network speed is more than or equal to the maximal rate supported described mobile end, the maximal rate that described mobile terminal is supported is set as the code check of recompile.
10. the audio and video playing control device as described in any one of claim 6 to 9, is characterized in that, described audio and video playing control device also comprises:
Judge module, for judging whether the size of multimedia file is greater than preset value; When the size of described multimedia file is greater than preset value, triggers described transport module and export multimedia file to described mobile terminal, carry out video playback for mobile terminal.
CN201510466859.6A 2015-07-31 2015-07-31 Audio and video playing control method and device Active CN105142009B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201510466859.6A CN105142009B (en) 2015-07-31 2015-07-31 Audio and video playing control method and device
PCT/CN2016/084426 WO2017020649A1 (en) 2015-07-31 2016-06-02 Audio/video playback control method and device thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510466859.6A CN105142009B (en) 2015-07-31 2015-07-31 Audio and video playing control method and device

Publications (2)

Publication Number Publication Date
CN105142009A true CN105142009A (en) 2015-12-09
CN105142009B CN105142009B (en) 2019-03-01

Family

ID=54727194

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510466859.6A Active CN105142009B (en) 2015-07-31 2015-07-31 Audio and video playing control method and device

Country Status (2)

Country Link
CN (1) CN105142009B (en)
WO (1) WO2017020649A1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105635810A (en) * 2015-12-30 2016-06-01 北京奇艺世纪科技有限公司 Processing method, apparatus, and system for television signal
CN106341726A (en) * 2016-09-12 2017-01-18 努比亚技术有限公司 Information play method and equipment thereof
WO2017020649A1 (en) * 2015-07-31 2017-02-09 深圳Tcl数字技术有限公司 Audio/video playback control method and device thereof
WO2017185798A1 (en) * 2016-04-29 2017-11-02 广州视睿电子科技有限公司 Method and device for sharing multimedia file
CN107820102A (en) * 2017-09-26 2018-03-20 北京奇艺世纪科技有限公司 A kind of data transmission method, device, terminal and server
CN110446081A (en) * 2019-09-04 2019-11-12 南京安谱软件有限公司 A kind of method for processing video frequency, apparatus and system
CN112839238A (en) * 2019-11-22 2021-05-25 腾讯科技(深圳)有限公司 Screen projection playing method and device and storage medium

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113784210B (en) * 2021-09-03 2023-09-22 上海哔哩哔哩科技有限公司 Pre-monitoring frequency playing method and cloud broadcasting guide table service system

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030233663A1 (en) * 2002-06-14 2003-12-18 Rao Ram R. Transcoding media content from a personal video recorder for a portable device
CN102571726A (en) * 2010-12-23 2012-07-11 中国移动通信集团广东有限公司 Multimedia data sharing method, system and state judgment server
CN103024441A (en) * 2011-09-27 2013-04-03 海尔集团公司 Method for playing television programs by mobile terminal
US20130265385A1 (en) * 2010-12-08 2013-10-10 Huawei Device Co., Ltd. Method and Apparatus for Adjusting Site Bandwidth, Conferencing Terminal, and Media Control Server
CN103686210A (en) * 2013-12-17 2014-03-26 广东威创视讯科技股份有限公司 Method and system for achieving audio and video transcoding in real time
CN103841462A (en) * 2013-12-03 2014-06-04 深圳市九洲电器有限公司 Method and device for multiple-screen program playing of digital set top box

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103491409B (en) * 2013-09-17 2017-03-15 深圳市宇恒互动科技开发有限公司 A kind of multi-screen control system, the implementation method of multi-screen control system and remote control
CN103841461B (en) * 2014-03-26 2018-07-06 联想(北京)有限公司 Information processing method, device and electronic equipment
CN105142009B (en) * 2015-07-31 2019-03-01 深圳Tcl数字技术有限公司 Audio and video playing control method and device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030233663A1 (en) * 2002-06-14 2003-12-18 Rao Ram R. Transcoding media content from a personal video recorder for a portable device
US20130265385A1 (en) * 2010-12-08 2013-10-10 Huawei Device Co., Ltd. Method and Apparatus for Adjusting Site Bandwidth, Conferencing Terminal, and Media Control Server
CN102571726A (en) * 2010-12-23 2012-07-11 中国移动通信集团广东有限公司 Multimedia data sharing method, system and state judgment server
CN103024441A (en) * 2011-09-27 2013-04-03 海尔集团公司 Method for playing television programs by mobile terminal
CN103841462A (en) * 2013-12-03 2014-06-04 深圳市九洲电器有限公司 Method and device for multiple-screen program playing of digital set top box
CN103686210A (en) * 2013-12-17 2014-03-26 广东威创视讯科技股份有限公司 Method and system for achieving audio and video transcoding in real time

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017020649A1 (en) * 2015-07-31 2017-02-09 深圳Tcl数字技术有限公司 Audio/video playback control method and device thereof
CN105635810A (en) * 2015-12-30 2016-06-01 北京奇艺世纪科技有限公司 Processing method, apparatus, and system for television signal
CN105635810B (en) * 2015-12-30 2018-12-18 北京奇艺世纪科技有限公司 A kind of processing method of TV signal, device and system
WO2017185798A1 (en) * 2016-04-29 2017-11-02 广州视睿电子科技有限公司 Method and device for sharing multimedia file
CN106341726A (en) * 2016-09-12 2017-01-18 努比亚技术有限公司 Information play method and equipment thereof
CN107820102A (en) * 2017-09-26 2018-03-20 北京奇艺世纪科技有限公司 A kind of data transmission method, device, terminal and server
CN107820102B (en) * 2017-09-26 2019-11-15 北京奇艺世纪科技有限公司 A kind of data transmission method, device, terminal and server
CN110446081A (en) * 2019-09-04 2019-11-12 南京安谱软件有限公司 A kind of method for processing video frequency, apparatus and system
CN110446081B (en) * 2019-09-04 2022-02-22 南京安谱软件有限公司 Video processing method, device and system
CN112839238A (en) * 2019-11-22 2021-05-25 腾讯科技(深圳)有限公司 Screen projection playing method and device and storage medium

Also Published As

Publication number Publication date
WO2017020649A1 (en) 2017-02-09
CN105142009B (en) 2019-03-01

Similar Documents

Publication Publication Date Title
CN105142009A (en) Audio-video playing control method and device
CN105025327B (en) A kind of method and system of mobile terminal live broadcast
CN102388609B (en) Method and apparatus for delivery of scalable media data
CN101335586B (en) Method and mobile terminal for playing mobile phone television service on multimedia playing equipment
CN103248947A (en) Video multiple screen sharing method and system for achieving same
CN102340706A (en) Digital television program sharing device, method and set-top box
CN101273637A (en) Media contents management
CN106303661B (en) A kind of live streaming client realizes the method and system of adaptive screen rotation
CN107040825B (en) Terminal, television, multi-screen interaction system and screen capture parameter setting method
US10404606B2 (en) Method and apparatus for acquiring video bitstream
CN110557672A (en) Television program sharing method, television and storage medium
CN103024441B (en) A kind of method of playing television program at mobile terminal
JP7029218B2 (en) Playback data acquisition method, equipment, equipment and storage medium
CN102098564A (en) Method for watching television programs based on wireless fidelity (wi-fi)
CN103200458A (en) Television program message display method and user equipment
CN104010204B (en) Image information processing method and device
CN101252676A (en) Multimedia mobile terminal and method for automatic selecting multimedia program source
CN103188531A (en) Multi-source signal collection system and method
CN1602055A (en) Information processing apparatus and information processing method
CN201957067U (en) Gateway providing device and video cloud computing system
CN106604085A (en) Video sharing method and video sharing device
CN104333765A (en) Processing method and device of video live streams
CN106254873B (en) Video coding method and video coding device
CN1878210A (en) Method for providing interactive digital broadcasting service in mobile communication terminal
CN104506882B (en) Internet stream media is converted into the server and its conversion method of IPTV forms

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant