WO2017020649A1 - 音视频播放控制方法及装置 - Google Patents

音视频播放控制方法及装置 Download PDF

Info

Publication number
WO2017020649A1
WO2017020649A1 PCT/CN2016/084426 CN2016084426W WO2017020649A1 WO 2017020649 A1 WO2017020649 A1 WO 2017020649A1 CN 2016084426 W CN2016084426 W CN 2016084426W WO 2017020649 A1 WO2017020649 A1 WO 2017020649A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio
video
encoded
video playback
mobile terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2016/084426
Other languages
English (en)
French (fr)
Inventor
曹芝勇
刘付光旺
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen TCL Digital Technology Co Ltd
Original Assignee
Shenzhen TCL Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen TCL Digital Technology Co Ltd filed Critical Shenzhen TCL Digital Technology Co Ltd
Publication of WO2017020649A1 publication Critical patent/WO2017020649A1/zh
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4

Definitions

  • the present invention relates to the field of display terminal technologies, and in particular, to an audio and video playback control method and apparatus.
  • TV, computer and mobile phone are the three most popular platforms in the daily life of ordinary users. They have their own characteristics: large TV screen and good viewing experience; many computer functions and rich storage space; mobile phones are the most convenient to carry around.
  • TV TV to watch videos at home, although the viewing experience is good, the operation and content resources are far less than the richness of mobile phones and computers.
  • multi-screen interactive technology aims to integrate the advantages of the three platforms to achieve the best user experience.
  • each terminal directly acquires original audio and video data, performs decoding on the terminal, and then plays. Since decoding is required on each terminal, the terminal is required to be high, and if a terminal that does not have a decoding function is used, playback cannot be performed.
  • the main object of the present invention is to provide an audio and video playback control method and apparatus, which aims to solve the problem that the mobile terminal cannot be played due to the limitation of the decoding capability of the mobile terminal when performing multi-screen interaction.
  • the present invention provides an audio and video playback control method, and the audio and video playback control method includes the following steps:
  • the encoding the audio and video data to be encoded to form a multimedia file comprises:
  • the re-encoded audio and video data and the second audiovisual data are encapsulated to form a multimedia file.
  • the encoding the audio and video data to be encoded to form a multimedia file further includes:
  • the maximum code rate supported by the mobile terminal is set to the re-encoded code rate.
  • the method before the step of outputting the multimedia file to the mobile terminal for video playback by the mobile terminal, the method further includes:
  • step of outputting the multimedia file to the mobile terminal for video playback by the mobile terminal is performed.
  • the present invention further provides an audio and video playback control method including the following steps:
  • the filtering the audio and video data corresponding to the currently received code stream according to the audio and video playback feature data to obtain the audio and video data to be encoded includes:
  • Matching and screening the PID of the program in the currently received code stream according to the audio and video playback feature data to delete the PID and the corresponding audio and video data that do not match the audio and video playback feature data, to form an audio and video to be encoded. data.
  • the encoding the audio and video data to be encoded to form a multimedia file comprises:
  • the re-encoded audio and video data and the second audiovisual data are encapsulated to form a multimedia file.
  • the encoding the audio and video data to be encoded to form a multimedia file further includes:
  • the maximum code rate supported by the mobile terminal is set to the re-encoded code rate.
  • the method before the step of outputting the multimedia file to the mobile terminal for video playback by the mobile terminal, the method further includes:
  • step of outputting the multimedia file to the mobile terminal for video playback by the mobile terminal is performed.
  • the present invention further provides an audio and video playback control apparatus including:
  • An acquiring module configured to acquire audio and video playing feature data preset in the audio and video playing request when receiving an audio and video playing request sent by the mobile terminal;
  • a screening module configured to filter audio and video data corresponding to the currently received code stream according to the audio and video playback feature data to obtain audio and video data to be encoded
  • An encoding module configured to encode the audio and video data to be encoded to form a multimedia file
  • a transmission module configured to output the multimedia file to the mobile terminal, for the mobile terminal to perform audio and video playback.
  • the screening module is configured to perform matching screening on the PID of the program in the currently received code stream according to the audio and video playback feature data, to delete the PID that does not match the audio and video playback feature data, and corresponding Audio and video data, forming audio and video data to be encoded.
  • the encoding module comprises:
  • a determining unit configured to determine, according to the audio and video playing feature data and the preset feature information in the currently received code stream, the first audio and video data to be re-encoded in the audio and video data to be encoded and the second audio that does not need to be re-encoded Video data;
  • a coding unit configured to re-encode the first audio and video data according to an encoding algorithm corresponding to the audio and video playback feature data
  • a packaging unit configured to package the re-encoded audio and video data and the second audio and video data into a multimedia file.
  • the encoding module further includes:
  • a second determining unit configured to determine whether the current network speed is smaller than a maximum code rate supported by the mobile terminal
  • a setting unit configured to set a re-encoded code rate according to the current network speed when the current network speed is less than a maximum code rate supported by the mobile terminal; the current network speed is greater than or equal to that supported by the mobile terminal At the maximum bit rate, the maximum code rate supported by the mobile terminal is set to the re-encoded code rate.
  • the audio and video playback control device further includes:
  • a determining module configured to determine whether the size of the multimedia file is greater than a preset value; when the size of the multimedia file is greater than a preset value, triggering the transmitting module to output the multimedia file to the mobile terminal, where the mobile terminal performs video Play.
  • the embodiment of the present invention acquires the audio and video play feature data preset in the audio and video play request; and according to the audio and video play feature data, the currently received code stream Corresponding audio and video data is filtered to obtain audio and video data to be encoded; the audio and video data to be encoded is encoded to form a multimedia file; and then the multimedia file is output to the mobile terminal for audio and video of the mobile terminal. Play. Since the audio and video data is re-encoded according to the encoding algorithm corresponding to the audio and video playback feature data of the mobile terminal during the audio and video playback, when the multi-screen interaction is performed, the mobile terminal cannot be played due to the limitation of the decoding capability of the mobile terminal.
  • FIG. 1 is a schematic flow chart of a first embodiment of an audio and video playback control method according to the present invention
  • FIG. 2 is a schematic diagram of a refinement process for encoding audio and video data in a third embodiment of an audio and video playback control method according to the present invention
  • FIG. 3 is a diagram showing an example of comparing audio and video playback feature data with preset feature information in an embodiment of an audio and video playback control method according to the present invention
  • FIG. 4 is a schematic diagram showing a refinement process of encoding audio and video data in a fourth embodiment of an audio and video playback control method according to the present invention
  • FIG. 5 is a schematic flowchart diagram of a fifth embodiment of an audio and video playback control method according to the present invention.
  • FIG. 6 is a schematic structural diagram of a function module of a first embodiment of an audio and video playback control apparatus according to the present invention.
  • FIG. 7 is a schematic structural diagram of a refinement function module of an encoding module in a third embodiment of the audio and video playback control apparatus of the present invention.
  • FIG. 8 is a schematic structural diagram of a refinement function module of an encoding module in a fourth embodiment of the audio and video playback control apparatus according to the present invention.
  • FIG. 9 is a schematic structural diagram of a function module of a fifth embodiment of an audio and video playback control apparatus according to the present invention.
  • the present invention provides an audio and video playback control method.
  • the audio and video playback control method includes the following steps:
  • Step S10 when receiving an audio and video playback request sent by the mobile terminal, acquiring audio and video playback feature data preset in the audio and video playback request;
  • the audio and video playback control method provided by the embodiment of the invention is mainly applied to a multi-screen interactive transmission system.
  • the multi-screen interactive system includes a main display terminal and a plurality of sub-display terminals, wherein the sub-display terminal performs audio and video playback according to the audio and video data displayed by the main display terminal.
  • the main display terminal is a television set
  • the sub display terminal is a mobile terminal as an example.
  • the mobile terminal communicates with the television (for example, a Bluetooth connection or a network connection), and can communicate with each other.
  • a multi-device viewing application is provided in the mobile terminal.
  • the audio and video playback request includes audio and video playback feature data
  • the audio and video playback feature data includes a mobile terminal supported playback.
  • the mobile terminal sends the audio and video playback request to the television set in a networked state, and the television receives the audio and video playback request to parse the audio and video playback feature data in the audio and video playback request.
  • the manner in which the mobile terminal sends the play request may be set according to actual needs, and the network connection is taken as an example for detailed description. Specifically, the mobile terminal first determines whether to establish a network connection, and after establishing a network connection, determines whether there is a television that can be accessed; when there is a television that can be in a position, the mobile terminal sends a handshake request to the television to Establish a communication connection between the TV and the mobile terminal. After the television establishes a communication connection with the mobile terminal, the mobile terminal can send the above audio and video playback request to the television through the network.
  • Step S20 Filter audio and video data corresponding to the currently received code stream according to the audio and video playback feature data to obtain audio and video data to be encoded;
  • Step S30 encoding the audio and video data to be encoded to form a multimedia file
  • a standard encoding algorithm of a package format commonly used by mobile terminals is stored in a television set.
  • the code stream is acquired in real time, and the audio and video data in the code stream is decoded and played, and the audio and video data is filtered according to the above-mentioned audio and video playback feature data, thereby obtaining matching with the mobile terminal.
  • Audio and video data to be encoded.
  • the audio and video data is encoded and converted according to the above standard encoding algorithm, and encapsulated into a multimedia file of the audio and video format corresponding to the audio and video playback feature data, and finally the multimedia file is stored in a cache of the television.
  • Step S40 Output the multimedia file to the mobile terminal, for the mobile terminal to perform audio and video playback.
  • the multimedia file When a multimedia file exists in the cache of the television set, the multimedia file will be transmitted to the mobile terminal through the network in the form of a data packet. After receiving the multimedia file, the mobile terminal saves the multimedia file in the memory, and when the cache reaches a certain level, reminds the user whether it needs to play; when the user inputs the operation instruction of the play, the player is called to load the multimedia file, thereby realizing the audio and video playback. .
  • the embodiment of the present invention acquires the audio and video play feature data preset in the audio and video play request; and according to the audio and video play feature data, the currently received code stream Corresponding audio and video data is filtered to obtain audio and video data to be encoded; the audio and video data to be encoded is encoded to form a multimedia file; and then the multimedia file is output to the mobile terminal for audio and video of the mobile terminal. Play. Since the audio and video data is re-encoded according to the encoding algorithm corresponding to the audio and video playback feature data of the mobile terminal during the audio and video playback, when the multi-screen interaction is performed, the mobile terminal cannot be played due to the limitation of the decoding capability of the mobile terminal.
  • step S20 includes:
  • Matching and screening the PID of the program in the currently received code stream according to the audio and video playback feature data to delete the PID and the corresponding audio and video data that do not match the audio and video playback feature data, to form an audio and video to be encoded. data.
  • the television set receives the code stream in real time, and transmits the data filter through the decoder (Demod), and finally identifies the data of the program in the filtered code stream through the PID.
  • the television can search for the extra track and the PID of the program from the PMT table of the program according to the audio and video playing feature data, and then mark all the PIDs obtained by the search into a sequence array, and finally pass the hardware filter.
  • the legal PID generates a filtered TS stream. Specifically, in the TS stream, since the audio and video data corresponding to the above-mentioned redundant tracks and letters are deleted, the amount of data transmission is reduced.
  • step S30 includes:
  • Step S31 determining, according to the audio and video playback feature data and the preset feature information in the currently received code stream, the first audio and video data to be re-encoded in the audio and video data to be encoded and the second audio and video data that are not required to be re-encoded. ;
  • Step S32 re-encoding the first audio and video data according to an encoding algorithm corresponding to the audio and video playback feature data
  • Step S33 the re-encoded audio and video data and the second audio and video data are encapsulated to form a multimedia file.
  • the preset feature information of the above code stream and the audio and video playback feature data are compared to determine the difference between the two: including the package format, the video format, and the resolution.
  • the parameter that needs to be encoded and converted is a video format
  • the audio and video data is re-encoded
  • the video format needs to be modified to H.263.
  • the encapsulation format needs to be modified to 3GPP to meet the format requirements supported by the mobile terminal.
  • the coding since the audio and video playback feature data is compared with the preset feature information in the currently received code stream, and only the content corresponding to the parameter that needs to be re-encoded is encoded, the coding may be reduced. time needed.
  • step S30 may further include:
  • the TS stream is decoded to obtain audio and video data to be encoded, where the audio and video data includes: basic pixel data formed by decoding the video. And decoding the audio into a basic bit stream. And determining whether the resolution of the currently received code stream is smaller than the display resolution of the mobile terminal, and when the resolution of the currently received code stream is greater than the display resolution of the mobile terminal, The basic pixel data in the video data is subjected to resolution conversion, and then the encoding operation is performed again; when the resolution of the currently received code stream is less than or equal to the display resolution of the mobile terminal, the re-encoding operation is directly performed. As shown in FIG. 3, the resolution of the code stream is 1920*1080, and the display resolution of the mobile terminal is 1280*720. At this time, the resolution of the basic pixel data needs to be converted and converted to 1280*720.
  • the resolution conversion mode can be set according to actual needs. Specifically, the resolution of the above code stream is 1920*1080, and the display resolution of the mobile terminal is 1280*720 as an example.
  • the step S30 further includes:
  • Step S34 determining whether the current network speed is less than the maximum code rate supported by the mobile terminal; if yes, executing step S35, otherwise performing step S36;
  • Step S35 setting a re-encoded code rate according to the current network speed
  • Step S36 setting a maximum code rate supported by the mobile terminal to a re-encoded code rate.
  • the network speed of the current network may be tested in real time according to the network test tool, and then the current network speed is compared with the maximum code rate supported by the mobile terminal.
  • the code rate of the re-encoding is determined according to the current network speed, thereby effectively preventing the code rate from being too large, resulting in unsmooth transmission, thereby affecting playback on the mobile terminal. Effect.
  • step S40 further includes:
  • step S50 it is determined whether the size of the multimedia file is greater than a preset value; if yes, step S40 is performed; otherwise, it is determined whether the size of the multimedia file is greater than a preset value.
  • the multimedia file is temporarily stored in the memory of the television.
  • the multimedia file stored in the memory will continue to increase, and when the minimum transmission unit is reached (ie, the preset value, Need to be greater than the code rate *n, n is a specified duration, for example, 1, that is, playing a video size of 1 second, and the multimedia file is transmitted to the mobile terminal through the network for the mobile terminal to perform audio and video playback.
  • the present invention also provides an audio and video playback control apparatus.
  • the audio and video playback control apparatus includes:
  • the acquiring module 10 is configured to acquire the audio and video playing feature data preset in the audio and video playing request when receiving the audio and video playing request sent by the mobile terminal;
  • the audio and video playback control device provided by the embodiment of the invention is mainly applied to a multi-screen interactive transmission system.
  • the multi-screen interactive system includes a main display terminal and a plurality of sub-display terminals, wherein the sub-display terminal performs audio and video playback according to the audio and video data displayed by the main display terminal.
  • the main display terminal is a television set
  • the sub display terminal is a mobile terminal as an example.
  • the mobile terminal communicates with the television (for example, a Bluetooth connection or a network connection), and can communicate with each other.
  • a multi-device viewing application is provided in the mobile terminal.
  • the audio and video playback request includes audio and video playback feature data
  • the audio and video playback feature data includes a mobile terminal supported playback.
  • the mobile terminal sends the audio and video playback request to the television set in a networked state, and the television receives the audio and video playback request to parse the audio and video playback feature data in the audio and video playback request.
  • the manner in which the mobile terminal sends the play request may be set according to actual needs, and the network connection is taken as an example for detailed description. Specifically, the mobile terminal first determines whether to establish a network connection, and after establishing a network connection, determines whether there is a television that can be accessed; when there is a television that can be in a position, the mobile terminal sends a handshake request to the television to Establish a communication connection between the TV and the mobile terminal. After the television establishes a communication connection with the mobile terminal, the mobile terminal can send the above audio and video playback request to the television through the network.
  • the screening module 20 is configured to filter audio and video data corresponding to the currently received code stream according to the audio and video playback feature data to obtain audio and video data to be encoded.
  • the encoding module 30 is configured to encode the audio and video data to be encoded to form a multimedia file
  • a standard encoding algorithm of a package format commonly used by mobile terminals is stored in a television set.
  • the code stream is acquired in real time, and the audio and video data in the code stream is decoded and played, and the audio and video data is filtered according to the above-mentioned audio and video playback feature data, thereby obtaining matching with the mobile terminal.
  • Audio and video data to be encoded.
  • the audio and video data is encoded and converted according to the above standard encoding algorithm, and encapsulated into a multimedia file of the audio and video format corresponding to the audio and video playback feature data, and finally the multimedia file is stored in a cache of the television.
  • the transmission module 40 is configured to output the multimedia file to the mobile terminal for audio and video playback by the mobile terminal.
  • the multimedia file When a multimedia file exists in the cache of the television set, the multimedia file will be transmitted to the mobile terminal through the network in the form of a data packet. After receiving the multimedia file, the mobile terminal saves the multimedia file in the memory, and when the cache reaches a certain level, reminds the user whether it needs to play; when the user inputs the operation instruction of the play, the player is called to load the multimedia file, thereby realizing the audio and video playback. .
  • the embodiment of the present invention acquires the audio and video play feature data preset in the audio and video play request; and according to the audio and video play feature data, the currently received code stream Corresponding audio and video data is filtered to obtain audio and video data to be encoded; the audio and video data to be encoded is encoded to form a multimedia file; and then the multimedia file is output to the mobile terminal for audio and video of the mobile terminal. Play. Since the audio and video data is re-encoded according to the encoding algorithm corresponding to the audio and video playback feature data of the mobile terminal during the audio and video playback, when the multi-screen interaction is performed, the mobile terminal cannot be played due to the limitation of the decoding capability of the mobile terminal.
  • the screening module 20 is specifically configured to receive the current received according to the audio and video playback feature data.
  • the PID of the program in the code stream is matched and filtered to delete the PID and the corresponding audio and video data that do not match the audio and video playback feature data, and form the audio and video data to be encoded.
  • the television set receives the code stream in real time, and transmits the data filter through the decoder (Demod), and finally identifies the data of the program in the filtered code stream through the PID.
  • the television can search for the extra track and the PID of the program from the PMT table of the program according to the audio and video playing feature data, and then mark all the PIDs obtained by the search into a sequence array, and finally pass the hardware filter.
  • the legal PID generates a filtered TS stream. Specifically, in the TS stream, since the audio and video data corresponding to the above-mentioned redundant tracks and letters are deleted, the amount of data transmission is reduced.
  • the TS stream is then decoded to obtain audio and video data to be encoded, the audio and video data comprising: decoding basic video data formed by decoding the video and decoding the audio into a basic bit stream.
  • the encoding module 30 includes
  • a determining unit 31 configured to determine, according to the audio and video playing feature data and the preset feature information in the currently received code stream, the first audio and video data to be re-encoded in the audio and video data to be encoded and the second audio data that does not need to be re-encoded Audio and video data;
  • the encoding unit 32 is configured to perform re-encoding processing on the first audio and video data according to an encoding algorithm corresponding to the audio and video playback feature data;
  • the encapsulating unit 33 is configured to package the re-encoded audio and video data and the second audio and video data into a multimedia file.
  • the preset feature information of the above code stream and the audio and video playback feature data are compared to determine the difference between the two: including the package format, the video format, and the resolution.
  • the parameter that needs to be encoded and converted is a video format
  • the audio and video data is re-encoded
  • the video format needs to be modified to H.263.
  • the encapsulation format needs to be modified to 3GPP to meet the format requirements supported by the mobile terminal.
  • the coding since the audio and video playback feature data is compared with the preset feature information in the currently received code stream, and only the content corresponding to the parameter that needs to be re-encoded is encoded, the coding may be reduced. time needed. It can be understood that if the audio and video data to be encoded is subjected to resolution conversion in the second embodiment, the encoding is based on the resolution-converted audio and video data to be encoded.
  • the foregoing encoding module 30 may further include:
  • a first determining unit configured to determine whether a resolution of the currently received code stream is smaller than a display resolution of the mobile terminal
  • a processing unit configured to perform resolution conversion on the audio and video data to be encoded when a resolution of the currently received code stream is greater than a display resolution of the mobile terminal.
  • the TS stream is decoded to obtain audio and video data to be encoded, where the audio and video data includes: basic pixel data formed by decoding the video. And decoding the audio into a basic bit stream. And determining whether the resolution of the currently received code stream is smaller than the display resolution of the mobile terminal, and when the resolution of the currently received code stream is greater than the display resolution of the mobile terminal, The basic pixel data in the video data is subjected to resolution conversion, and then the encoding operation is performed again; when the resolution of the currently received code stream is less than or equal to the display resolution of the mobile terminal, the re-encoding operation is directly performed. As shown in FIG. 3, the resolution of the code stream is 1920*1080, and the display resolution of the mobile terminal is 1280*720. At this time, the resolution of the basic pixel data needs to be converted and converted to 1280*720.
  • the resolution conversion mode can be set according to actual needs. Specifically, the resolution of the above code stream is 1920*1080, and the display resolution of the mobile terminal is 1280*720 as an example.
  • the encoding module 20 further includes:
  • the second determining unit 24 is configured to determine whether the current network speed is smaller than a maximum code rate supported by the mobile terminal;
  • the setting unit 25 is configured to: when the current network speed is less than the maximum code rate supported by the mobile terminal, set a re-encoded code rate according to the current network speed; the current network speed is greater than or equal to that supported by the mobile terminal. At the maximum code rate, the maximum code rate supported by the mobile terminal is set to the re-encoded code rate.
  • the network speed of the current network may be tested in real time according to the network test tool, and then the current network speed is compared with the maximum code rate supported by the mobile terminal.
  • the code rate of the re-encoding is determined according to the current network speed, thereby effectively preventing the code rate from being too large, resulting in unsmooth transmission, thereby affecting playback on the mobile terminal. Effect.
  • the audio-video playback control apparatus further includes:
  • the determining module 50 is configured to determine whether the size of the multimedia file is greater than a preset value; when the size of the multimedia file is greater than a preset value, triggering the transmitting module 40 to output the multimedia file to the mobile terminal for the mobile terminal Play video.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Databases & Information Systems (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

本发明公开了一种音视频播放控制方法，所述音视频播放控制方法包括以下步骤：接收到移动终端发送的音视频播放请求时，获取所述音视频播放请求中预置的音视频播放特征数据；根据所述音视频播放特征数据对当前接收到的码流对应的音视频数据进行筛选得到待编码的音视频数据；对所述待编码的音视频数据进行编码形成多媒体文件；将所述多媒体文件输出至所述移动终端，以供移动终端进行音视频播放。本发明还公开了一种音视频播放控制装置。本发明解决了进行多屏互动时，受到移动终端的解码能力限制造成移动终端无法播放。

Description

音视频播放控制方法及装置
技术领域
本发明涉及显示终端技术领域，尤其涉及音视频播放控制方法及装置。
背景技术
目前，电视、电脑和手机是普通用户日常生活中接触最多的三大平台，它们各有特点：电视屏幕大，观看体验好；电脑功能多，储存空间丰富；手机随身携带，最方便。用户在家中使用电视观看视频时，虽然观看体验好，但是在操作和内容资源上远不及手机和电脑丰富。多屏互动技术的出现就旨在将三大平台的优势进行融合，实现最佳的用户体验。
现有技术中在多屏互动技术中，通常是各终端直接获取原始的音视频数据，在终端上进行解码，然后播放。由于在各终端上需要进行解码，因此对终端要求较高，若使用不具有解码功能的终端将无法进行播放。
上述内容仅用于辅助理解本发明的技术方案，并不代表承认上述内容是现有技术。
发明内容
本发明的主要目的在于提供一种音视频播放控制方法及装置，旨在解决进行多屏互动时，受到移动终端的解码能力限制造成移动终端无法播放。
为实现上述目的，本发明提供的一种音视频播放控制方法，所述音视频播放控制方法包括以下步骤：
接收到移动终端发送的音视频播放请求时，获取所述音视频播放请求中预置的音视频播放特征数据；
根据音视频播放特征数据对所述当前接收到的码流中节目的PID进行匹配筛选，以删除与所述音视频播放特征数据不匹配的PID及对应的音视频数据，形成待编码的音视频数据；
对所述待编码的音视频数据进行编码形成多媒体文件；
将所述多媒体文件输出至所述移动终端，以供移动终端进行音视频播放；其中，
所述对所述待编码的音视频数据进行编码形成多媒体文件包括：
根据所述音视频播放特征数据与当前接收到的码流中预置特征信息确定待编码音视频数据中需要重新编码的第一音视频数据和不需要重新编码的第二音视频数据；
根据所述音视频播放特征数据对应的编码算法，对所述第一音视频数据重新编码处理；
将重新编码后的音视频数据和所述第二音视频数据进行封装形成多媒体文件。
优选地，所述对所述待编码的音视频数据进行编码形成多媒体文件还包括：
判断当前的网速是否小于所述移动终端所支持的最大码率；
若是，则根据所述当前网速设定重新编码的码率；
若否，则将所述移动终端所支持的最大码率设定为重新编码的码率。
优选地，所述将多媒体文件输出至所述移动终端，以供移动终端进行视频播放的步骤之前还包括：
判断多媒体文件的大小是否大于预设值；
若是，则执行所述将多媒体文件输出至所述移动终端，以供移动终端进行视频播放的步骤。
此外，为实现上述目的，本发明还提供一种音视频播放控制方法包括以下步骤：
接收到移动终端发送的音视频播放请求时，获取所述音视频播放请求中预置的音视频播放特征数据；
根据所述音视频播放特征数据对当前接收到的码流对应的音视频数据进行筛选得到待编码的音视频数据；
对所述待编码的音视频数据进行编码形成多媒体文件；
将所述多媒体文件输出至所述移动终端，以供移动终端进行音视频播放。
优选地，所述根据所述音视频播放特征数据对当前接收到的码流对应的音视频数据进行筛选得到待编码的音视频数据包括：
根据音视频播放特征数据对所述当前接收到的码流中节目的PID进行匹配筛选，以删除与所述音视频播放特征数据不匹配的PID及对应的音视频数据，形成待编码的音视频数据。
优选地，所述对所述待编码的音视频数据进行编码形成多媒体文件包括：
根据所述音视频播放特征数据与当前接收到的码流中预置特征信息确定待编码音视频数据中需要重新编码的第一音视频数据和不需要重新编码的第二音视频数据；
根据所述音视频播放特征数据对应的编码算法，对所述第一音视频数据重新编码处理；
将重新编码后的音视频数据和所述第二音视频数据进行封装形成多媒体文件。
优选地，所述对所述待编码的音视频数据进行编码形成多媒体文件还包括：
判断当前的网速是否小于所述移动终端所支持的最大码率；
若是，则根据所述当前网速设定重新编码的码率；
若否，则将所述移动终端所支持的最大码率设定为重新编码的码率。
优选地，所述将多媒体文件输出至所述移动终端，以供移动终端进行视频播放的步骤之前还包括：
判断多媒体文件的大小是否大于预设值；
若是，则执行所述将多媒体文件输出至所述移动终端，以供移动终端进行视频播放的步骤。
此外，为实现上述目的，本发明还提供一种音视频播放控制装置包括：
获取模块，用于接收到移动终端发送的音视频播放请求时，获取所述音视频播放请求中预置的音视频播放特征数据；
筛选模块，用于根据所述音视频播放特征数据对当前接收到的码流对应的音视频数据进行筛选得到待编码的音视频数据；
编码模块，用于对所述待编码的音视频数据进行编码形成多媒体文件；
传输模块，用于将所述多媒体文件输出至所述移动终端，以供移动终端进行音视频播放。
优选地，所述筛选模块具体用于，根据音视频播放特征数据对所述当前接收到的码流中节目的PID进行匹配筛选，以删除与所述音视频播放特征数据不匹配的PID及对应的音视频数据，形成待编码的音视频数据。
优选地，所述编码模块包括：
确定单元，用于根据所述音视频播放特征数据与当前接收到的码流中预置特征信息确定待编码音视频数据中需要重新编码的第一音视频数据和不需要重新编码的第二音视频数据；
编码单元，用于根据所述音视频播放特征数据对应的编码算法，对所述第一音视频数据进行重新编码处理；
封装单元，用于将重新编码后的音视频数据和所述第二音视频数据进行封装形成多媒体文件。
优选地，所述编码模块还包括：
第二判断单元，用于判断当前的网速是否小于所述移动终端所支持的最大码率；
设定单元，用于当前的网速小于所述移动终端所支持的最大码率时，根据所述当前网速设定重新编码的码率；当前的网速大于等于所述移动终端所支持的最大码率时，将所述移动终端所支持的最大码率设定为重新编码的码率。
优选地，所述音视频播放控制装置还包括：
判断模块，用于判断多媒体文件的大小是否大于预设值；当所述多媒体文件的大小大于预设值时，触发所述传输模块将多媒体文件输出至所述移动终端，以供移动终端进行视频播放。
本发明实施例通过接收到移动终端发送的音视频播放请求时，获取所述音视频播放请求中预置的音视频播放特征数据；并根据所述音视频播放特征数据对当前接收到的码流对应的音视频数据进行筛选得到待编码的音视频数据；对所述待编码的音视频数据进行编码形成多媒体文件；然后将所述多媒体文件输出至所述移动终端，以供移动终端进行音视频播放。由于在进行音视频播放时，将音视频数据根据移动终端的音视频播放特征数据对应的编码算法重新进行编码，因此在进行多屏互动时，受到移动终端的解码能力限制造成移动终端无法播放。
附图说明
图1为本发明音视频播放控制方法第一实施例的流程示意图；
图2为本发明音视频播放控制方法第三实施例中对音视频数据进行编码的细化流程示意图；
图3为本发明音视频播放控制方法一实施例中音视频播放特征数据与预置特征信息比对示例图；
图4为本发明音视频播放控制方法第四实施例中对音视频数据进行编码的细化流程示意图；
图5为本发明音视频播放控制方法第五实施例的流程示意图；
图6为本发明音视频播放控制装置第一实施例的功能模块结构示意图；
图7为本发明音视频播放控制装置第三实施例中编码模块的细化功能模块结构示意图；
图8为本发明音视频播放控制装置第四实施例中编码模块的细化功能模块结构示意图；
图9为本发明音视频播放控制装置第五实施例的功能模块结构示意图。
本发明目的的实现、功能特点及优点将结合实施例，参照附图做进一步说明。
具体实施方式
应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限定本发明。
本发明提供一种音视频播放控制方法，参照图1，在本发明音视频播放控制方法第一实施例中，该音视频播放控制方法包括以下步骤：
步骤S10，接收到移动终端发送的音视频播放请求时，获取所述音视频播放请求中预置的音视频播放特征数据；
本发明实施例提供的音视频播放控制方法主要应用于多屏互动传输系统中。具体地，该多屏互动系统包括一个主显示终端和多个副显示终端，其中，副显示终端根据主显示终端显示的音视频数据进行音视频播放。以下各实施例中，以主显示终端为电视机，副显示终端为移动终端为例作出详细说明。
具体地，上述移动终端与电视机进行通讯连接（例如蓝牙连接或网络连接），可以相互通讯。在移动终端中设有多设备观看应用，当用户点击启动该应用后，将生成音视频播放请求，该音视频播放请求包括音视频播放特征数据，该音视频播放特征数据包括移动终端所支持播放的视频/音频格式、屏幕分辨率、语言选择、声道数量、支持的最大码率和最大帧率等。移动终端在连网状态下将该音视频播放请求发送给电视机，电视机接收到该音视频播放请求将解析获得音视频播放请求中的音视频播放特征数据。
应当说明的是，移动终端发送播放请求的方式可以根据实际需要进行设置，以网络连接为例作出详细说明。具体地，移动终端首先判断是否建立网络连接，当建立网路连接后；判断是否存在可以访问的电视机；当存在可以方位的电视机，则所述移动终端向所述电视机发送握手请求以建立电视机与移动终端的通讯连接。在电视机与移动终端建立通讯连接后，移动终端可以通过网络将上述音视频播放请求发送给电视机。
步骤S20，根据所述音视频播放特征数据对当前接收到的码流对应的音视频数据进行筛选得到待编码的音视频数据；
步骤S30，对所述待编码的音视频数据进行编码形成多媒体文件；
本实施例中，在电视机中储存有移动终端常用的封装格式的标准编码算法。电视机在进行音视频播放时，实时获取码流，并将码流中的音视频数据解码出来进行播放，同时将该音视频数据按照上述音视频播放特征数据进行筛选，从而得到与移动终端匹配的待编码的音视频数据。然后根据上述标准编码算法将音视频数据进行编码转换，并封装为上述音视频播放特征数据对应的音视频格式的多媒体文件，最后将该多媒体文件存储到电视机的缓存中。
步骤S40，将所述多媒体文件输出至所述移动终端，以供移动终端进行音视频播放。
当电视机的缓存中存在多媒体文件后，将会将该多媒体文件以数据包的形式通过网路传输给移动终端。移动终端收到多媒体文件后，将多媒体文件保存于内存，当缓存到一定程度后，提醒用户是否需要播放；当用户输入播放的操作指令时，则调用播放器加载多媒体文件，从而实现音视频播放。
本发明实施例通过接收到移动终端发送的音视频播放请求时，获取所述音视频播放请求中预置的音视频播放特征数据；并根据所述音视频播放特征数据对当前接收到的码流对应的音视频数据进行筛选得到待编码的音视频数据；对所述待编码的音视频数据进行编码形成多媒体文件；然后将所述多媒体文件输出至所述移动终端，以供移动终端进行音视频播放。由于在进行音视频播放时，将音视频数据根据移动终端的音视频播放特征数据对应的编码算法重新进行编码，因此在进行多屏互动时，受到移动终端的解码能力限制造成移动终端无法播放。
进一步地，基于本发明音视频播放控制方法第一实施例，在本发明音视频播放控制方法第二实施例中，上述步骤S20包括：
根据音视频播放特征数据对所述当前接收到的码流中节目的PID进行匹配筛选，以删除与所述音视频播放特征数据不匹配的PID及对应的音视频数据，形成待编码的音视频数据。
本实施例中，上述电视机实时接收码流，并通过解码器（Demod）传入硬件过滤器，最后通过上述PID识别过滤码流中节目的数据。具体地，电视机可以根据上述音视频播放特征数据从节目的PMT表中查找该节目多余的音轨和字母的PID，然后将查找获得的PID全部标记进一个序列数组，最后通过硬件过滤器将合法的PID生成过滤后的TS流。具体地在该TS流中由于删除了上述多余的音轨和字母对应的音视频数据，从而减小了数据传输量。
进一步地，参照图2，基于本发明音视频播放控制方法第一实施例，在本发明音视频播放控制方法第三实施例中，上述步骤S30包括：
步骤S31，根据所述音视频播放特征数据与当前接收到的码流中预置特征信息确定待编码音视频数据中需要重新编码的第一音视频数据和不需要重新编码的第二音视频数据；
步骤S32，根据所述音视频播放特征数据对应的编码算法，对所述第一音视频数据重新编码处理；
步骤S33，将重新编码后的音视频数据和所述第二音视频数据进行封装形成多媒体文件。
如图3所示，将上述码流的预置特征信息和音视频播放特征数据进行比对确定出两者的不同：包括封装格式、视频格式和分辨率不同。此时，需要进行编码转换的参数为视频格式，在进行音视频数据重新编码时，需要将视频格式修改为H.263。同时按照上述表格在进行封装形成多媒体文件时，需要将封装格式修改为3GPP，以满足移动终端支持的格式需求。在本发明实施例中，由于将上述音视频播放特征数据与当前接收到的码流中预置特征信息进行了比较，并只针对需要重新编码的参数对应的内容进行编码，因此可以减小编码需要的时间。
可以理解的，为了满足分辨率需求，提高播放效果。在本实施例中，还可以对待编码的音视频数据进行分辨率转换处理。具体地，在本实施例中，上述步骤S30还可以包括：
判断当前接收到的码流的分辨率是否大于所述移动终端的显示分辨率；
若是，则对所述待编码的音视频数据进行分辨率转换。
本实施例中，在通过硬件过滤器将合法的PID生成过滤后的TS流后，对该TS流进行解码得到待编码的音视频数据，该音视频数据包括：将视频解码形成的基本像素数据和将音频解码成基本比特流。接着判断当前接收到的码流的分辨率是否小于所述移动终端的显示分辨率，当当前接收到的码流的分辨率大于所述移动终端的显示分辨率时，则对上述待编码的音视频数据中基本像素数据进行分辨率转换，然后再重新进行编码操作；当当前接收到的码流的分辨率小于或等于所述移动终端的显示分辨率时，则直接进行重新编码操作。如图3所示，码流的分辨率为1920*1080，移动终端的显示分辨率1280*720，此时则需要将上述基本像素数据的分辨率进行转换，转换为1280*720。
分辨率转换的方式可以根据实际需要进行设置，具体地，以上述码流的分辨率为1920*1080，移动终端的显示分辨率1280*720为例作出详细说明。在本实施例中，上述水平方向变换系数为a=1280/1920，垂直方向变化系数为b = 720/1080。
进一步地，参照图4，基于本发明音视频播放控制方法第三实施例，在本发明音视频播放控制方法第四实施例中，上述步骤S30还包括：
步骤S34，判断当前的网速是否小于所述移动终端所支持的最大码率；若是，则执行步骤S35，否则执行步骤S36；
步骤S35，根据所述当前网速设定重新编码的码率；
步骤S36，将所述移动终端所支持的最大码率设定为重新编码的码率。
本实施例中，可以根据网络测试工具实时测试当前网络的网速，然后判断当前网速与移动终端所支持的最大码率进行比较。当当前的网速小于所述移动终端所支持的最大码率时，则根据当前网速确定重新编码的码率，从而有效防止编码的码率过大导致传输不流畅，进而影响在移动终端播放的效果。
进一步地，参照图5，基于本发明音视频播放控制方法任一实施例，在本发明音视频播放控制方法第五实施例中，上述步骤S40之前还包括：
步骤S50，判断多媒体文件的大小是否大于预设值；若是，则执行步骤S40，否，则继续判断多媒体文件的大小是否大于预设值。
本实施例中，上述多媒体文件暂存于电视机的内存中，随着视频不停的播放，存储于内存中的多媒体文件将不断增大，当达到最小传输单位时（即上述预设值，需要大于码率*n, n为指定时长，例如为1，即为播放1秒钟视频大小），将多媒体文件通过网络传输给移动终端，以供移动终端进行音视频播放。
本发明还提供一种音视频播放控制装置，参照图6，在本发明音视频播放控制装置第一实施例中，该音视频播放控制装置包括：
获取模块10，用于接收到移动终端发送的音视频播放请求时，获取所述音视频播放请求中预置的音视频播放特征数据；
本发明实施例提供的音视频播放控制装置主要应用于多屏互动传输系统中。具体地，该多屏互动系统包括一个主显示终端和多个副显示终端，其中，副显示终端根据主显示终端显示的音视频数据进行音视频播放。以下各实施例中，以主显示终端为电视机，副显示终端为移动终端为例作出详细说明。
具体地，上述移动终端与电视机进行通讯连接（例如蓝牙连接或网络连接），可以相互通讯。在移动终端中设有多设备观看应用，当用户点击启动该应用后，将生成音视频播放请求，该音视频播放请求包括音视频播放特征数据，该音视频播放特征数据包括移动终端所支持播放的视频/音频格式、屏幕分辨率、语言选择、声道数量、支持的最大码率和最大帧率等。移动终端在连网状态下将该音视频播放请求发送给电视机，电视机接收到该音视频播放请求将解析获得音视频播放请求中的音视频播放特征数据。
应当说明的是，移动终端发送播放请求的方式可以根据实际需要进行设置，以网络连接为例作出详细说明。具体地，移动终端首先判断是否建立网络连接，当建立网路连接后；判断是否存在可以访问的电视机；当存在可以方位的电视机，则所述移动终端向所述电视机发送握手请求以建立电视机与移动终端的通讯连接。在电视机与移动终端建立通讯连接后，移动终端可以通过网络将上述音视频播放请求发送给电视机。
筛选模块20，用于根据所述音视频播放特征数据对当前接收到的码流对应的音视频数据进行筛选得到待编码的音视频数据；
编码模块30，用于对所述待编码的音视频数据进行编码形成多媒体文件；
本实施例中，在电视机中储存有移动终端常用的封装格式的标准编码算法。电视机在进行音视频播放时，实时获取码流，并将码流中的音视频数据解码出来进行播放，同时将该音视频数据按照上述音视频播放特征数据进行筛选，从而得到与移动终端匹配的待编码的音视频数据。然后根据上述标准编码算法将音视频数据进行编码转换，并封装为上述音视频播放特征数据对应的音视频格式的多媒体文件，最后将该多媒体文件存储到电视机的缓存中。
传输模块40，用于将所述多媒体文件输出至所述移动终端，以供移动终端进行音视频播放。
当电视机的缓存中存在多媒体文件后，将会将该多媒体文件以数据包的形式通过网路传输给移动终端。移动终端收到多媒体文件后，将多媒体文件保存于内存，当缓存到一定程度后，提醒用户是否需要播放；当用户输入播放的操作指令时，则调用播放器加载多媒体文件，从而实现音视频播放。
本发明实施例通过接收到移动终端发送的音视频播放请求时，获取所述音视频播放请求中预置的音视频播放特征数据；并根据所述音视频播放特征数据对当前接收到的码流对应的音视频数据进行筛选得到待编码的音视频数据；对所述待编码的音视频数据进行编码形成多媒体文件；然后将所述多媒体文件输出至所述移动终端，以供移动终端进行音视频播放。由于在进行音视频播放时，将音视频数据根据移动终端的音视频播放特征数据对应的编码算法重新进行编码，因此在进行多屏互动时，受到移动终端的解码能力限制造成移动终端无法播放。
进一步地，基于本发明音视频播放控制装置第一实施例，在本发明音视频播放控制装置第二实施例中，上述筛选模块20具体用于，根据音视频播放特征数据对所述当前接收到的码流中节目的PID进行匹配筛选，以删除与所述音视频播放特征数据不匹配的PID及对应的音视频数据，形成待编码的音视频数据
本实施例中，上述电视机实时接收码流，并通过解码器（Demod）传入硬件过滤器，最后通过上述PID识别过滤码流中节目的数据。具体地，电视机可以根据上述音视频播放特征数据从节目的PMT表中查找该节目多余的音轨和字母的PID，然后将查找获得的PID全部标记进一个序列数组，最后通过硬件过滤器将合法的PID生成过滤后的TS流。具体地在该TS流中由于删除了上述多余的音轨和字母对应的音视频数据，从而减小了数据传输量。然后对该TS流进行解码得到待编码的音视频数据，该音视频数据包括：将视频解码形成的基本像素数据和将音频解码成基本比特流。
进一步地，参照图7，基于本发明音视频播放控制装置第一实施例，在本发明音视频播放控制装置第三实施例中，上述编码模块30包括
确定单元31，用于根据所述音视频播放特征数据与当前接收到的码流中预置特征信息确定待编码音视频数据中需要重新编码的第一音视频数据和不需要重新编码的第二音视频数据；
编码单元32，用于根据所述音视频播放特征数据对应的编码算法，对所述第一音视频数据进行重新编码处理；
封装单元33，用于将重新编码后的音视频数据和所述第二音视频数据进行封装形成多媒体文件。
如图3所示，将上述码流的预置特征信息和音视频播放特征数据进行比对确定出两者的不同：包括封装格式、视频格式和分辨率不同。此时，需要进行编码转换的参数为视频格式，在进行音视频数据重新编码时，需要将视频格式修改为H.263。同时按照上述表格在进行封装形成多媒体文件时，需要将封装格式修改为3GPP，以满足移动终端支持的格式需求。在本发明实施例中，由于将上述音视频播放特征数据与当前接收到的码流中预置特征信息进行了比较，并只针对需要重新编码的参数对应的内容进行编码，因此可以减小编码需要的时间。可以理解的，若在第二实施例中对待编码的音视频数据进行分辨率转换之后才进行编码，则编码的基础为分辨率转换后的待编码的音视频数据。
可以理解的，为了满足分辨率需求，提高播放效果。在本实施例中，还可以对待编码的音视频数据进行分辨率转换处理。具体地，在本实施例中，上述编码模块30还可以包括：
第一判断单元，用于判断当前接收到的码流的分辨率是否小于所述移动终端的显示分辨率；
处理单元，用于当当前接收到的码流的分辨率大于所述移动终端的显示分辨率时，对所述待编码的音视频数据进行分辨率转换。
本实施例中，在通过硬件过滤器将合法的PID生成过滤后的TS流后，对该TS流进行解码得到待编码的音视频数据，该音视频数据包括：将视频解码形成的基本像素数据和将音频解码成基本比特流。接着判断当前接收到的码流的分辨率是否小于所述移动终端的显示分辨率，当当前接收到的码流的分辨率大于所述移动终端的显示分辨率时，则对上述待编码的音视频数据中基本像素数据进行分辨率转换，然后再重新进行编码操作；当当前接收到的码流的分辨率小于或等于所述移动终端的显示分辨率时，则直接进行重新编码操作。如图3所示，码流的分辨率为1920*1080，移动终端的显示分辨率1280*720，此时则需要将上述基本像素数据的分辨率进行转换，转换为1280*720。
分辨率转换的方式可以根据实际需要进行设置，具体地，以上述码流的分辨率为1920*1080，移动终端的显示分辨率1280*720为例作出详细说明。在本实施例中，上述水平方向变换系数为a=1280/1920，垂直方向变化系数为b = 720/1080。
进一步地，参照图8，基于本发明音视频播放控制装置第三实施例，在本发明音视频播放控制装置第四实施例中，上述编码模块20还包括：
第二判断单元24，用于判断当前的网速是否小于所述移动终端所支持的最大码率；
设定单元25，用于当前的网速小于所述移动终端所支持的最大码率时，根据所述当前网速设定重新编码的码率；当前的网速大于等于所述移动终端所支持的最大码率时，将所述移动终端所支持的最大码率设定为重新编码的码率。
本实施例中，可以根据网络测试工具实时测试当前网络的网速，然后判断当前网速与移动终端所支持的最大码率进行比较。当当前的网速小于所述移动终端所支持的最大码率时，则根据当前网速确定重新编码的码率，从而有效防止编码的码率过大导致传输不流畅，进而影响在移动终端播放的效果。
进一步地，参照图9，基于本发明音视频播放控制装置任一实施例，在本发明音视频播放控制装置第五实施例中，上述音视频播放控制装置还包括：
判断模块50，用于判断多媒体文件的大小是否大于预设值；当所述多媒体文件的大小大于预设值时，触发所述传输模块40将多媒体文件输出至所述移动终端，以供移动终端进行视频播放。
以上仅为本发明的优选实施例，并非因此限制本发明的专利范围，凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换，或直接或间接运用在其他相关的技术领域，均同理包括在本发明的专利保护范围内。

Claims (19)

  1. 一种音视频播放控制方法，其特征在于，所述音视频播放控制方法包括以下步骤：
    接收到移动终端发送的音视频播放请求时，获取所述音视频播放请求中预置的音视频播放特征数据；
    根据音视频播放特征数据对所述当前接收到的码流中节目的PID进行匹配筛选，以删除与所述音视频播放特征数据不匹配的PID及对应的音视频数据，形成待编码的音视频数据；
    对所述待编码的音视频数据进行编码形成多媒体文件；
    将所述多媒体文件输出至所述移动终端，以供移动终端进行音视频播放；其中，
    所述对所述待编码的音视频数据进行编码形成多媒体文件包括：
    根据所述音视频播放特征数据与当前接收到的码流中预置特征信息确定待编码音视频数据中需要重新编码的第一音视频数据和不需要重新编码的第二音视频数据；
    根据所述音视频播放特征数据对应的编码算法，对所述第一音视频数据重新编码处理；
    将重新编码后的音视频数据和所述第二音视频数据进行封装形成多媒体文件。
  2. 如权利要求1所述的音视频播放控制方法，其特征在于，所述对所述待编码的音视频数据进行编码形成多媒体文件还包括：
    判断当前的网速是否小于所述移动终端所支持的最大码率；
    若是，则根据所述当前网速设定重新编码的码率；
    若否，则将所述移动终端所支持的最大码率设定为重新编码的码率。
  3. 如权利要求1所述的音视频播放控制方法，其特征在于，所述将多媒体文件输出至所述移动终端，以供移动终端进行视频播放的步骤之前还包括：
    判断多媒体文件的大小是否大于预设值；
    若是，则执行所述将多媒体文件输出至所述移动终端，以供移动终端进行视频播放的步骤。
  4. 一种音视频播放控制方法，其特征在于，所述音视频播放控制方法包括以下步骤：
    接收到移动终端发送的音视频播放请求时，获取所述音视频播放请求中预置的音视频播放特征数据；
    根据所述音视频播放特征数据对当前接收到的码流对应的音视频数据进行筛选，得到待编码的音视频数据；
    对所述待编码的音视频数据进行编码形成多媒体文件；
    将所述多媒体文件输出至所述移动终端，以供移动终端进行音视频播放。
  5. 如权利要求4所述的音视频播放控制方法，其特征在于，所述根据所述音视频播放特征数据对当前接收到的码流对应的音视频数据进行筛选得到待编码的音视频数据包括：
    根据音视频播放特征数据对所述当前接收到的码流中节目的PID进行匹配筛选，以删除与所述音视频播放特征数据不匹配的PID及对应的音视频数据，形成待编码的音视频数据。
  6. 如权利要求4所述的音视频播放控制方法，其特征在于，所述对所述待编码的音视频数据进行编码形成多媒体文件包括：
    根据所述音视频播放特征数据与当前接收到的码流中预置特征信息确定待编码音视频数据中需要重新编码的第一音视频数据和不需要重新编码的第二音视频数据；
    根据所述音视频播放特征数据对应的编码算法，对所述第一音视频数据重新编码处理；
    将重新编码后的音视频数据和所述第二音视频数据进行封装形成多媒体文件。
  7. 如权利要求6所述的音视频播放控制方法，其特征在于，所述对所述待编码的音视频数据进行编码形成多媒体文件还包括：
    判断当前的网速是否小于所述移动终端所支持的最大码率；
    若是，则根据所述当前网速设定重新编码的码率；
    若否，则将所述移动终端所支持的最大码率设定为重新编码的码率。
  8. 如权利要求4所述的音视频播放控制方法，其特征在于，所述将多媒体文件输出至所述移动终端，以供移动终端进行视频播放的步骤之前还包括：
    判断多媒体文件的大小是否大于预设值；
    若是，则执行所述将多媒体文件输出至所述移动终端，以供移动终端进行视频播放的步骤。
  9. 如权利要求8所述的音视频播放控制方法，其特征在于，所述根据所述音视频播放特征数据对当前接收到的码流对应的音视频数据进行筛选得到待编码的音视频数据包括：
    根据音视频播放特征数据对所述当前接收到的码流中节目的PID进行匹配筛选，以删除与所述音视频播放特征数据不匹配的PID及对应的音视频数据，形成待编码的音视频数据。
  10. 如权利要求8所述的音视频播放控制方法，其特征在于，所述对所述待编码的音视频数据进行编码形成多媒体文件包括：
    根据所述音视频播放特征数据与当前接收到的码流中预置特征信息确定待编码音视频数据中需要重新编码的第一音视频数据和不需要重新编码的第二音视频数据；
    根据所述音视频播放特征数据对应的编码算法，对所述第一音视频数据重新编码处理；
    将重新编码后的音视频数据和所述第二音视频数据进行封装形成多媒体文件。
  11. 如权利要求10所述的音视频播放控制方法，其特征在于，所述对所述待编码的音视频数据进行编码形成多媒体文件还包括：
    判断当前的网速是否小于所述移动终端所支持的最大码率；
    若是，则根据所述当前网速设定重新编码的码率；
    若否，则将所述移动终端所支持的最大码率设定为重新编码的码率。
  12. 一种音视频播放控制装置，其特征在于，所述音视频播放控制装置包括：
    获取模块，用于接收到移动终端发送的音视频播放请求时，获取所述音视频播放请求中预置的音视频播放特征数据；
    筛选模块，用于根据所述音视频播放特征数据对当前接收到的码流对应的音视频数据进行筛选得到待编码的音视频数据；
    编码模块，用于对所述待编码的音视频数据进行编码形成多媒体文件；
    传输模块，用于将所述多媒体文件输出至所述移动终端，以供移动终端进行音视频播放。
  13. 如权利要求12所述的音视频播放控制装置，其特征在于，所述筛选模块具体用于，根据音视频播放特征数据对所述当前接收到的码流中节目的PID进行匹配筛选，以删除与所述音视频播放特征数据不匹配的PID及对应的音视频数据，形成待编码的音视频数据。
  14. 如权利要求12所述的音视频播放控制装置，其特征在于，所述编码模块包括：
    确定单元，用于根据所述音视频播放特征数据与当前接收到的码流中预置特征信息确定待编码音视频数据中需要重新编码的第一音视频数据和不需要重新编码的第二音视频数据；
    编码单元，用于根据所述音视频播放特征数据对应的编码算法，对所述第一音视频数据进行重新编码处理；
    封装单元，用于将重新编码后的音视频数据和所述第二音视频数据进行封装形成多媒体文件。
  15. 如权利要求14所述的音视频播放控制装置，其特征在于，所述编码模块还包括：
    第二判断单元，用于判断当前的网速是否小于所述移动终端所支持的最大码率；
    设定单元，用于当前的网速小于所述移动终端所支持的最大码率时，根据所述当前网速设定重新编码的码率；当前的网速大于等于所述移动终端所支持的最大码率时，将所述移动终端所支持的最大码率设定为重新编码的码率。
  16. 如权利要求12所述的音视频播放控制装置，其特征在于，所述音视频播放控制装置还包括：
    判断模块，用于判断多媒体文件的大小是否大于预设值；当所述多媒体文件的大小大于预设值时，触发所述传输模块将多媒体文件输出至所述移动终端，以供移动终端进行视频播放。
  17. 如权利要求15所述的音视频播放控制装置，其特征在于，所述筛选模块具体用于，根据音视频播放特征数据对所述当前接收到的码流中节目的PID进行匹配筛选，以删除与所述音视频播放特征数据不匹配的PID及对应的音视频数据，形成待编码的音视频数据。
  18. 如权利要求15所述的音视频播放控制装置，其特征在于，所述编码模块包括：
    确定单元，用于根据所述音视频播放特征数据与当前接收到的码流中预置特征信息确定待编码音视频数据中需要重新编码的第一音视频数据和不需要重新编码的第二音视频数据；
    编码单元，用于根据所述音视频播放特征数据对应的编码算法，对所述第一音视频数据进行重新编码处理；
    封装单元，用于将重新编码后的音视频数据和所述第二音视频数据进行封装形成多媒体文件。
  19. 如权利要求18所述的音视频播放控制装置，其特征在于，所述编码模块还包括：
    第二判断单元，用于判断当前的网速是否小于所述移动终端所支持的最大码率；
    设定单元，用于当前的网速小于所述移动终端所支持的最大码率时，根据所述当前网速设定重新编码的码率；当前的网速大于等于所述移动终端所支持的最大码率时，将所述移动终端所支持的最大码率设定为重新编码的码率。
PCT/CN2016/084426 2015-07-31 2016-06-02 音视频播放控制方法及装置 Ceased WO2017020649A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510466859.6A CN105142009B (zh) 2015-07-31 2015-07-31 音视频播放控制方法及装置
CN201510466859.6 2015-07-31

Publications (1)

Publication Number Publication Date
WO2017020649A1 true WO2017020649A1 (zh) 2017-02-09

Family

ID=54727194

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/084426 Ceased WO2017020649A1 (zh) 2015-07-31 2016-06-02 音视频播放控制方法及装置

Country Status (2)

Country Link
CN (1) CN105142009B (zh)
WO (1) WO2017020649A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113784210A (zh) * 2021-09-03 2021-12-10 上海哔哩哔哩科技有限公司 预监视频播放方法及云导播台服务系统

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105142009B (zh) * 2015-07-31 2019-03-01 深圳Tcl数字技术有限公司 音视频播放控制方法及装置
CN105635810B (zh) * 2015-12-30 2018-12-18 北京奇艺世纪科技有限公司 一种电视信号的处理方法、装置和系统
CN105959778B (zh) * 2016-04-29 2019-06-11 广州视睿电子科技有限公司 多媒体文件分享的方法及装置
CN106341726A (zh) * 2016-09-12 2017-01-18 努比亚技术有限公司 一种信息播放方法及设备
CN107820102B (zh) * 2017-09-26 2019-11-15 北京奇艺世纪科技有限公司 一种数据传输方法、装置、终端及服务器
CN110446081B (zh) * 2019-09-04 2022-02-22 南京安谱软件有限公司 一种视频处理方法、装置及系统
CN112839238B (zh) * 2019-11-22 2023-03-24 腾讯科技（深圳）有限公司 投屏播放方法、装置和存储介质
CN115866294B (zh) * 2022-11-21 2026-03-03 深圳云天畅想信息科技有限公司 视频播放方法、装置、计算机设备和存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103491409A (zh) * 2013-09-17 2014-01-01 深圳市宇恒互动科技开发有限公司 一种多屏控制系统、多屏控制系统的实现方法和遥控器
CN103841461A (zh) * 2014-03-26 2014-06-04 联想(北京)有限公司 信息处理方法、装置及电子设备
CN103841462A (zh) * 2013-12-03 2014-06-04 深圳市九洲电器有限公司 数字机顶盒多屏幕播放节目的方法及装置
CN105142009A (zh) * 2015-07-31 2015-12-09 深圳Tcl数字技术有限公司 音视频播放控制方法及装置

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6937168B2 (en) * 2002-06-14 2005-08-30 Intel Corporation Transcoding media content from a personal video recorder for a portable device
CN102571526B (zh) * 2010-12-08 2015-05-06 华为终端有限公司 会场带宽的调整方法、装置、会议终端和媒体控制服务器
CN102571726B (zh) * 2010-12-23 2016-06-22 中国移动通信集团广东有限公司 多媒体数据共享的方法、系统及状态判定服务器
CN103024441B (zh) * 2011-09-27 2017-10-31 海尔集团公司 一种移动终端播放电视节目的方法
CN103686210B (zh) * 2013-12-17 2017-01-25 广东威创视讯科技股份有限公司 实时音视频转码方法和系统

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103491409A (zh) * 2013-09-17 2014-01-01 深圳市宇恒互动科技开发有限公司 一种多屏控制系统、多屏控制系统的实现方法和遥控器
CN103841462A (zh) * 2013-12-03 2014-06-04 深圳市九洲电器有限公司 数字机顶盒多屏幕播放节目的方法及装置
CN103841461A (zh) * 2014-03-26 2014-06-04 联想(北京)有限公司 信息处理方法、装置及电子设备
CN105142009A (zh) * 2015-07-31 2015-12-09 深圳Tcl数字技术有限公司 音视频播放控制方法及装置

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113784210A (zh) * 2021-09-03 2021-12-10 上海哔哩哔哩科技有限公司 预监视频播放方法及云导播台服务系统
CN113784210B (zh) * 2021-09-03 2023-09-22 上海哔哩哔哩科技有限公司 预监视频播放方法及云导播台服务系统

Also Published As

Publication number Publication date
CN105142009B (zh) 2019-03-01
CN105142009A (zh) 2015-12-09

Similar Documents

Publication Publication Date Title
WO2013139239A1 (en) Method for recommending users in social network and the system thereof
WO2016165556A1 (zh) 一种视频流的数据处理方法、装置和系统
WO2018223607A1 (zh) 电视终端及hdr图像转为sdr的方法和计算机可读存储介质
WO2016091011A1 (zh) 字幕切换方法及装置
WO2017005066A1 (zh) 录制音视频同步时间戳的方法和装置
WO2016101698A1 (zh) 基于dlna技术实现屏幕推送的方法及系统
WO2015154639A1 (en) Method and apparatus for recording and replaying video of terminal
WO2018192253A1 (zh) 视频信号的传输方法及装置
WO2017045441A1 (zh) 基于智能电视的音频播放方法及装置
WO2018032680A1 (zh) 音视频播放方法及系统
WO2018023926A1 (zh) 电视与移动终端的互动方法及系统
WO2017045435A1 (zh) 控制电视播放方法和装置
WO2018028124A1 (zh) 电视机及其信号源的切换方法
WO2018036057A1 (zh) 软件后台自适应升级方法及装置
WO2018018681A1 (zh) 视频节目预览方法及装置
WO2016101305A1 (zh) 视频文件处理方法及显示装置
WO2014187158A1 (zh) 终端数据云分享的控制方法、服务器及终端
WO2017054488A1 (zh) 电视播放控制方法、服务器及电视播放控制系统
WO2018233221A1 (zh) 多窗口声音输出方法、电视机以及计算机可读存储介质
WO2017121066A1 (zh) 应用程序显示方法和系统
WO2017206377A1 (zh) 同步播放节目的方法和装置
WO2017088427A1 (zh) 音频输出控制方法及装置
WO2018045682A1 (zh) 音画同步测试方法及装置
WO2017024876A1 (zh) 电视节目播放方法及装置
WO2016090991A1 (zh) 流媒体数据的下载方法及装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16832137

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 14.06.2018)

122 Ep: pct application non-entry in european phase

Ref document number: 16832137

Country of ref document: EP

Kind code of ref document: A1