WO2016107116A1 - Procédé de commande de lecture pour télévision sous protocole internet, dispositif et support de stockage informatique - Google Patents

Procédé de commande de lecture pour télévision sous protocole internet, dispositif et support de stockage informatique Download PDF

Info

Publication number
WO2016107116A1
WO2016107116A1 PCT/CN2015/082401 CN2015082401W WO2016107116A1 WO 2016107116 A1 WO2016107116 A1 WO 2016107116A1 CN 2015082401 W CN2015082401 W CN 2015082401W WO 2016107116 A1 WO2016107116 A1 WO 2016107116A1
Authority
WO
WIPO (PCT)
Prior art keywords
message
play
control message
playback
control
Prior art date
Application number
PCT/CN2015/082401
Other languages
English (en)
Chinese (zh)
Inventor
全君林
Original Assignee
深圳市中兴微电子技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市中兴微电子技术有限公司 filed Critical 深圳市中兴微电子技术有限公司
Publication of WO2016107116A1 publication Critical patent/WO2016107116A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content

Definitions

  • the present invention relates to the field of Internet Protocol Television (IPTV), and in particular, to a IPTV playback control method and apparatus, and a computer storage medium.
  • IPTV Internet Protocol Television
  • IPTV IPTV
  • STB Network Set Top Box
  • the underlying core media processing component of IPTV media processing is a multimedia framework, and the main functions of the multimedia framework are composed of the following components:
  • Stream input module responsible for sending a local file stream or a network stream or a TV stream (TS, Transport Stream) into a loop buffer (Buffer).
  • Stream separation module responsible for separating the byte stream in the loop Buffer into audio and video data.
  • Decoding module responsible for decoding the separated audio and video data, that is, decoding the audio data into directly playable pulse code modulation (PCM) data, and decoding the video data into a liquid crystal display (LCD, Liquid) YUV data displayed in Crystal Display); where YUV is the type of real color space compiled, specifically, Y represents brightness, U represents chromaticity, V represents density; YUV format is divided into compact format and planar format.
  • PCM directly playable pulse code modulation
  • Synchronization processing module responsible for synchronizing the decoded audio and video data and time information.
  • Display module responsible for outputting synchronized audio and video data, such as audio through integrated circuit built-in audio bus (I2S, Inter-IC Sound), Sony Philips digital audio interface (SPDIF, Sony/Philips Digital Interface Format) output, the video is output through High Definition Multimedia Interface (HDMI), Composite Video Broadcasting and CVBS (Composite Video Broadcast Signal).
  • I2S integrated circuit built-in audio bus
  • SPDIF Sony Philips digital audio interface
  • HDMI High Definition Multimedia Interface
  • CVBS Composite Video Broadcast Signal
  • the IPTV service system has two types of data from the application layer: one is control messages, and the other is media stream data; how to ensure smooth playback of media stream data, and ensure that the IPTV system can respond and process control messages in time, becoming An issue that the IPTV system needs to solve.
  • the embodiment of the present invention is to provide a IPTV playback control method, apparatus, and computer storage medium, which can effectively ensure that the IPTV responds to the control message in time while implementing smooth playback of the media stream data.
  • An embodiment of the present invention provides a playback control method for an IPTV, where the method includes:
  • control message When the control message does not belong to the preset global message set, the control message is responded to when the control message has a corresponding relationship with the acquired current state of the IPTV according to the corresponding relationship between the preset control message and the IPTV state.
  • the method further includes:
  • control message does not belong to the preset global message set, and determines that the control message does not correspond to the acquired current state of the IPTV, the control message is ignored.
  • the correspondence between the preset control message and the IPTV status includes:
  • the control message corresponding to the idle state includes starting to play the message
  • the control message corresponding to the first frame state includes a first frame playing message and a stop playing message
  • the control message corresponding to the play status includes a pause play message, a stop play message, a resume play message, and an end play message;
  • the control message corresponding to the pause state includes stopping the play message, restoring the play message, and fast forwarding the message;
  • the control message corresponding to the fast forward state includes stopping the playing message, restoring the playing message, and fast forwarding the message;
  • the control message corresponding to the end state includes stopping the play message.
  • the method when the IPTV is in a playing state, the method further includes:
  • the current frame is abandoned to continue playing, and the playback cycle of the next frame is entered.
  • the embodiment of the present invention further provides a playback control device for an IPTV, where the device includes: a message receiving module, a global message response module, and a status message response module;
  • a message receiving module configured to receive a control message
  • a global message response module configured to respond to the control message when the control message belongs to a preset global message set
  • the status message response module is configured to: when the control message does not belong to the preset global message set, determine, according to the correspondence between the preset control message and the IPTV status, that the control message has a corresponding relationship with the acquired current state of the IPTV Responding to the control message.
  • the device further includes:
  • An idle state module configured to respond to a start play message corresponding to an idle state
  • the first frame status module is configured to play a message in response to the first frame corresponding to the first frame state, and stop playing the message;
  • a play status module configured to respond to a pause play message corresponding to a play status, Stop playing the message, resume playing the message, and end the playback message;
  • a pause state module configured to respond to a stop play message, a resume play message, and a fast forward play message corresponding to the pause state
  • the fast forward status module is configured to respond to the stop play message, the resume play message, and the fast forward play message corresponding to the fast forward state;
  • the end status module is configured to respond to the stop play message corresponding to the end status.
  • the play status module includes:
  • the actual time monitoring unit is configured to obtain the actual consumed time of the playing cycle of the current frame
  • the estimated time acquisition unit is configured to acquire the playback cycle of the current frame and is expected to consume time
  • the frame discarding unit is configured to, when the sum of the actual consumed time and the estimated required time is greater than a preset threshold, abandon the continuous playing of the current frame and enter a playing cycle of the next frame.
  • the estimated time obtaining unit includes:
  • the next time acquisition unit is configured to obtain the estimated time spent in the next step of the playback loop to be executed.
  • An embodiment of the present invention provides a computer storage medium, where the computer storage medium stores a computer program, and the computer program is used to execute the IPTV playback control method described above.
  • the IPTV broadcast control method and apparatus and the computer storage medium provided by the embodiments of the present invention divide the IPTV into multiple states, and divide the control message into a state-independent global message and a status message responding in a specific state. Ensure that the global message is preferentially responded, and the status message is only responded to in the corresponding state; thus, the IPTV can respond to the control message in time, and the illegal control message can be prevented from affecting the normal playback of the media stream, so that the media stream The playback is smoother. Further, in the playing state, the sum of the actual consumed time of the current frame and the estimated time required to be consumed does not exceed the preset threshold, and the smooth playback of the media stream can be better ensured.
  • FIG. 1 is a schematic flowchart of an implementation process of a IPTV playback control method according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of correspondence between a control message and an IPTV state in a frame IPTV playback control method according to an embodiment of the present invention
  • FIG. 3 is a schematic structural diagram of a structure of an IPTV playback control apparatus according to an embodiment of the present invention.
  • the IPTV is pre-defined according to the state attribute of the IPTV player into six states, namely, an idle (IDLE) state, a first frame (FIRSTFRM) state, a play (PLAY) state, and a pause ( PAUSE) state, fast forward (FAST) state, end (EOS) state; usually, the current state of the IPTV player can be obtained through the "get interface", that is, the current state of the IPTV is obtained.
  • FIRSTFRM first frame
  • PLAY play
  • PAUSE pause
  • FAST fast forward
  • EOS end
  • control message is divided into a state-independent global message and a status message that responds in a specific state; and a global message set, a control message, and an IPTV state are defined in advance; wherein, the global message set It consists of a state-independent control message; the correspondence between the control message and the IPTV state describes which control messages are responded in a particular state.
  • FIG. 1 is a schematic flowchart of an implementation process of a IPTV playback control method according to an embodiment of the present invention. As shown in FIG. 1 , the method mainly includes the following steps:
  • Step 101 Receive a control message.
  • the IPTV player can receive the control message sent by the IPTV upper layer service module.
  • the IPTV upper layer service module passes the hardware abstraction layer (HAL, Hardware). Abstraction Layer) sends a control message to the player.
  • HAL hardware abstraction layer
  • Abstraction Layer Some of these control messages belong to the global message set, such as: switching channel messages, standby messages, etc.; some are not part of the global message set, only executed in a specific state, for example: start playing (CMD_PLAYER_START) message, stop playing ( CMD_PLAYER_STOP) message, etc.
  • the control message belonging to the global message set needs to be preferentially responded.
  • Step 102 When the control message belongs to a preset global message set, respond to the control message;
  • the IPTV determines whether the currently received control message is one of the global message sets, and if so, the control message belongs to a preset global message set and responds to the control message.
  • Step 103 When the control message does not belong to the preset global message set, according to the correspondence between the preset control message and the IPTV state, when the control message is determined to have a corresponding relationship with the acquired current state of the IPTV, Control messages.
  • the current status of the IPTV is obtained, and according to the correspondence between the preset control message and the IPTV status, it is determined whether the control message has a current status of the IPTV. Corresponding relationship, when it is determined that the control message has a corresponding relationship with the current state of the IPTV, indicating that the control message should be responded to in the current state of the IPTV, responding to the control message.
  • the correspondence between the control message and the IPTV status is as shown in FIG. 2, and includes:
  • the control message corresponding to the IDLE state includes a start playing (CMD_PLAYER_START) message;
  • the control message corresponding to the FIRSTFRM state includes a first frame play (CMD_PLAYER_FSTFRM) message, a stop play (CMD_PLAYER_STOP) message;
  • the control message corresponding to the PLAY state includes: pause play (CMD_PLAYER_PAUSE) message, stop playing (CMD_PLAYER_STOP) message, resume playback (CMD_PLAYER_RESUME) message, end playback (CMD_PLAYER_EOS) message;
  • the control message corresponding to the PAUSE state includes a stop play (CMD_PLAYER_STOP) message, a resume play (CMD_PLAYER_RESUME) message, and a fast forward play (CMD_PLAYER_FAST) message;
  • the control message corresponding to the FAST state includes a stop play (CMD_PLAYER_STOP) message, a resume play (CMD_PLAYER_RESUME) message, and a fast forward play (CMD_PLAYER_FAST) message;
  • the control message corresponding to the EOS state includes a stop play (CMD_PLAYER_STOP) message.
  • IDLE is the initial state, and the IDLE state can be migrated to the FIRSTFRM state only after receiving the CMD_PLAYER_START message.
  • CMD_PLAYER_FSTFRM migrates to the PLAY state.
  • the PLAY state reaches the end of the file stream, it actively sends the CMD_PLAYER_EOS message to enter the EOS state.
  • the EOS state is determined, when the packet in the audio/video queue and the decoding waiting display queue is played, the initiative is initiated.
  • the CMD_PLAY_STOP message is sent internally to enter the IDLE state. This is a basic normal playback process. EOS and FIRSTFRM are unstable and will not stay too long.
  • PLAY, IDLE, PAUSE, and FAST are stable and can reside for a long time. In this state, the states are concatenated by messages.
  • control message when the control message does not belong to a preset global message set, and it is determined that the control message does not have a corresponding relationship with the acquired current state of the IPTV, the control message is ignored.
  • the current control message is a fast forward play message
  • the current status of the IPTV is an IDLE state
  • the control message does not belong to the preset global message set, and the step is determined in step 103.
  • the control message does not have a corresponding relationship with the IDLE state.
  • the fast forward play message may be considered as an illegal message and cannot be responded, and the fast forward play is ignored. Message.
  • the IPTV can quickly respond to the global message, and the illegal message can be ignored in time, so that the playback of the media stream is not affected by the illegal message.
  • demultiplexing, audio output, audio decoding, video output, and video decoding are playback cycles for one frame.
  • the first frame state since the first frame state is entered, the first frame state has been decoded.
  • the data of the first frame can be subjected to audio output, audio decoding, video output, video decoding of the first frame and then demultiplexed for the next frame when entering the playing state. Therefore, the playback cycle of each frame in the present invention refers to: audio output, audio decoding, video output, video decoding, and demultiplexing of the next frame data.
  • the time spent on the playback cycle for each frame should not exceed a reasonable threshold, typically 20 milliseconds (ms). Therefore, when the time consumed for the playback cycle of a certain frame exceeds the threshold, the frame should be discarded decisively to avoid affecting the playback of subsequent media streams.
  • a reasonable threshold typically 20 milliseconds (ms). Therefore, when the time consumed for the playback cycle of a certain frame exceeds the threshold, the frame should be discarded decisively to avoid affecting the playback of subsequent media streams.
  • the IPTV when the IPTV is in the playing state, the IPTV needs to perform the following steps:
  • Step A Obtain an actual consumed time of a play cycle of the current frame
  • step B it takes time to acquire the playback cycle of the current frame.
  • step C when the sum of the actual consumed time and the estimated required consumption time is greater than a preset threshold, the current frame is discarded and the playback cycle of the next frame is entered.
  • the playback time of the current frame may also be time consuming to be represented by the expected time of the next step in the playback loop to be executed, because if it is expected to execute the next step in the playback loop Exceeding the preset threshold (20ms) is enough to indicate that the current frame should be discarded and the playback loop of the next frame is entered.
  • the audio output, audio decoding, video output, video decoding, and demultiplexing are actually run in the playback cycle of the current frame as T1, T2, T3, T4, and T5, respectively.
  • the time required for audio output, audio decoding, video output, video decoding, and demultiplexing in any one frame playback cycle is t1, t2, t3, t4, t5; where t1, t2, t3, t4
  • the initial values of t5 and t5 are 1ms, 2ms, 1ms, 4ms, 1ms, and 12ms, respectively;
  • the playback control apparatus includes: a message receiving module 301, a global message response module 302, and a status message response module 303;
  • the message receiving module 301 is configured to receive a control message.
  • the global message response module 302 is configured to respond to the control message when the control message belongs to a preset global message set;
  • the status message response module 303 is configured to determine, according to the correspondence between the preset control message and the IPTV status, that the control message has a corresponding relationship with the current state of the acquired IPTV, when the control message does not belong to the preset global message set. Responding to the control message.
  • the above playback control apparatus further includes:
  • An idle state module configured to respond to a start play message corresponding to an idle state
  • a first frame status module configured to play in response to a first frame corresponding to a first frame state Message, stop playing the message
  • the play status module is configured to respond to the pause play message corresponding to the play status, stop playing the message, resume playing the message, and end the play message;
  • a pause state module configured to respond to a stop play message, a resume play message, and a fast forward play message corresponding to the pause state
  • the fast forward status module is configured to respond to the stop play message, the resume play message, and the fast forward play message corresponding to the fast forward state;
  • the end status module is configured to respond to the stop play message corresponding to the end status.
  • the play status module includes:
  • the actual time monitoring unit is configured to obtain the actual consumed time of the playing cycle of the current frame
  • the estimated time acquisition unit is configured to acquire the playback cycle of the current frame and is expected to consume time
  • the frame discarding unit is configured to, when the sum of the actual consumed time and the estimated required time is greater than a preset threshold, abandon the continuous playing of the current frame and enter a playing cycle of the next frame.
  • the estimated time acquisition unit includes:
  • the next time acquisition unit is configured to obtain the estimated time spent in the next step of the playback loop to be executed.
  • Each of the above modules and each unit may be implemented by a Central Processing Unit (CPU), a Micro Processor Unit (MPU), and a Digital Signal Processor (DSP) located in the IPTV. Or Field Programmable Gate Array (FPGA) implementation.
  • CPU Central Processing Unit
  • MPU Micro Processor Unit
  • DSP Digital Signal Processor
  • FPGA Field Programmable Gate Array
  • the embodiment of the present invention further describes a computer storage medium, wherein the computer storage medium stores a computer program, and the computer program is used to execute the IPTV playback control method shown in FIG. 1 in the embodiment of the present invention.
  • embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention may employ hardware embodiments, software embodiments, or junctions. In the form of an embodiment of the software and hardware aspects. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) including computer usable program code.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
  • These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
  • the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
  • control message when the control message belongs to a preset global message set, responding to the control message; when the control message does not belong to a preset global message set, according to the preset Corresponding relationship between the control message and the IPTV state, determining that the control message has a corresponding relationship with the acquired current state of the IPTV, responding to the control message; thus, ensuring that the IPTV can respond to the control message in time, and avoiding illegal control
  • the message affects the normal playback of the media stream, making the media stream play smoother.

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

L'invention concerne un procédé de commande de lecture pour télévision sous protocole Internet (IPTV), comportant les étapes consistant à: recevoir un message de commande; si le message de commande appartient à un ensemble prédéfini de messages globaux, réagir au message de commande; si le message de commande n'appartient pas à l'ensemble prédéfini de messages globaux, réagir au message de commande s'il est déterminé que le message de commande correspond à un état actuel d'IPTV acquis d'après des correspondances entre les messages de commande prédéfinis et des états d'IPTV. L'invention concerne également un dispositif de commande de lecture pour IPTV et un support de stockage informatique.
PCT/CN2015/082401 2014-12-30 2015-06-25 Procédé de commande de lecture pour télévision sous protocole internet, dispositif et support de stockage informatique WO2016107116A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410843286.X 2014-12-30
CN201410843286.XA CN105812938B (zh) 2014-12-30 2014-12-30 交互式网络电视的播放控制方法和装置

Publications (1)

Publication Number Publication Date
WO2016107116A1 true WO2016107116A1 (fr) 2016-07-07

Family

ID=56284087

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/082401 WO2016107116A1 (fr) 2014-12-30 2015-06-25 Procédé de commande de lecture pour télévision sous protocole internet, dispositif et support de stockage informatique

Country Status (2)

Country Link
CN (1) CN105812938B (fr)
WO (1) WO2016107116A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101009825A (zh) * 2006-01-27 2007-08-01 中国科学院声学研究所 基于rtp协议的iptv机顶盒组/单播无缝切换方法
CN103139628A (zh) * 2013-02-21 2013-06-05 深圳创维数字技术股份有限公司 一种电视终端的控制方法及电视终端
CN103634682A (zh) * 2013-11-29 2014-03-12 乐视致新电子科技（天津）有限公司 智能电视中的全局设置实现方法及装置
CN103974105A (zh) * 2013-01-25 2014-08-06 海尔集团公司 电视控制方法及电视控制系统

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20100127162A (ko) * 2009-05-25 2010-12-03 엘지전자 주식회사 단말 내에서 브로드캐스트 서비스를 통해 관련된 콘텐츠를 검색하고 주문하는 방법 및 장치
CN102427564B (zh) * 2011-11-18 2015-01-14 百视通网络电视技术发展有限责任公司 基于iptv的时间戳实现方法及系统
CN102572569B (zh) * 2012-02-24 2015-05-06 北京原力创新科技有限公司 机顶盒、互联网电视及智能控制信号的处理方法

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101009825A (zh) * 2006-01-27 2007-08-01 中国科学院声学研究所 基于rtp协议的iptv机顶盒组/单播无缝切换方法
CN103974105A (zh) * 2013-01-25 2014-08-06 海尔集团公司 电视控制方法及电视控制系统
CN103139628A (zh) * 2013-02-21 2013-06-05 深圳创维数字技术股份有限公司 一种电视终端的控制方法及电视终端
CN103634682A (zh) * 2013-11-29 2014-03-12 乐视致新电子科技（天津）有限公司 智能电视中的全局设置实现方法及装置

Also Published As

Publication number Publication date
CN105812938A (zh) 2016-07-27
CN105812938B (zh) 2020-07-07

Similar Documents

Publication Publication Date Title
CN109168078B (zh) 一种视频清晰度切换方法及装置
US10712771B2 (en) System and method for synchronized playback of streaming digital content
TWI502977B (zh) 影音播放裝置、影音處理裝置、系統以及方法
CN101742203B (zh) 信息处理装置和信息处理方法
WO2016095369A1 (fr) Dispositif et procédé d'enregistrement d'écran
US9549027B2 (en) Network-synchronized media playback
CN105721921A (zh) 一种多窗口视频解码器的自适应选择方法
US10177958B2 (en) Method for synchronously taking audio and video in order to proceed one-to-multi multimedia stream
WO2013182011A1 (fr) Procédé et système de lecture en temps réel de vidéo en ligne à une vitesse variable
JP2009284282A (ja) コンテンツサーバ、情報処理装置、ネットワーク機器、コンテンツ配信方法、情報処理方法およびコンテンツ配信システム
CN111372138A (zh) 一种播放器端的直播低延迟技术方案
WO2015173975A1 (fr) Appareil de réception, appareil de transmission et procédé de traitement de données
CN103458271A (zh) 音视频文件拼接方法和装置
CN112367542A (zh) 一种镜像投屏的终端播放系统及方法
US20240259126A1 (en) Audio and video synchronization method and device, electronic device, and computer readable storage medium
CN106331820A (zh) 音视频的同步处理方法和装置
WO2015074380A1 (fr) Procédé et dispositif de traitement d'informations vidéo
WO2017016266A1 (fr) Procédé et dispositif pour mettre en œuvre une lecture synchrone
CN114554277B (zh) 多媒体的处理方法、装置、服务器及计算机可读存储介质
JP2002197794A (ja) 音声映像データ同期再生方法
WO2016107116A1 (fr) Procédé de commande de lecture pour télévision sous protocole internet, dispositif et support de stockage informatique
CN108282720B (zh) 一种音频数据流的传输方法及装置
CN106507194B (zh) 一种Android智能电视场景管理方法
CN112019858B (zh) 一种视频播放方法、装置、计算机设备和存储介质
WO2023282959A1 (fr) Système et procédé visant à synchroniser le rendu d'une présentation audio à plusieurs canaux avec une présentation vidéo

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15874806

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15874806

Country of ref document: EP

Kind code of ref document: A1