WO2016107116A1

WO2016107116A1 - Internet protocol television play control method, device and computer storage medium

Info

Publication number: WO2016107116A1
Application number: PCT/CN2015/082401
Authority: WO
Inventors: 全君林
Original assignee: 深圳市中兴微电子技术有限公司
Priority date: 2014-12-30
Filing date: 2015-06-25
Publication date: 2016-07-07
Also published as: CN105812938A; CN105812938B

Abstract

Disclosed is an internet protocol television (IPTV) play control method, comprising: receiving a control message; if the control message belongs to a preset global message set, then responding to the control message; if the control message does not belong to the preset global massage set, then responding to the control message if the control message is determined to correspond to an acquired IPTV current state according to correspondences between the preset control messages and IPTV states. Also disclosed are an IPTV play control device and computer storage medium.

Description

Playback control method, device and computer storage medium for interactive network television

Technical field

The present invention relates to the field of Internet Protocol Television (IPTV), and in particular, to a IPTV playback control method and apparatus, and a computer storage medium.

Background technique

The IPTV service is an emerging Internet value-added service that has emerged along with the rapid development of broadband Internet. It can provide users with telecom-level intelligent services and easy-to-use TV-style experiences. IPTV utilizes the infrastructure of broadband Internet, using home TV sets and computers as the main terminals, and uses the Network Set Top Box (STB, Set Top Box) to transmit TV signals through Internet Protocol, providing a variety of digital media services including TV programs.

The underlying core media processing component of IPTV media processing is a multimedia framework, and the main functions of the multimedia framework are composed of the following components:

1) Stream input module: responsible for sending a local file stream or a network stream or a TV stream (TS, Transport Stream) into a loop buffer (Buffer).

2) Stream separation module: responsible for separating the byte stream in the loop Buffer into audio and video data.

3) Decoding module: responsible for decoding the separated audio and video data, that is, decoding the audio data into directly playable pulse code modulation (PCM) data, and decoding the video data into a liquid crystal display (LCD, Liquid) YUV data displayed in Crystal Display); where YUV is the type of real color space compiled, specifically, Y represents brightness, U represents chromaticity, V represents density; YUV format is divided into compact format and planar format.

4) Synchronization processing module: responsible for synchronizing the decoded audio and video data and time information.

5) Display module: responsible for outputting synchronized audio and video data, such as audio through integrated circuit built-in audio bus (I2S, Inter-IC Sound), Sony Philips digital audio interface (SPDIF, Sony/Philips Digital Interface Format) output, the video is output through High Definition Multimedia Interface (HDMI), Composite Video Broadcasting and CVBS (Composite Video Broadcast Signal).

Generally, the IPTV service system has two types of data from the application layer: one is control messages, and the other is media stream data; how to ensure smooth playback of media stream data, and ensure that the IPTV system can respond and process control messages in time, becoming An issue that the IPTV system needs to solve.

Summary of the invention

In view of this, the embodiment of the present invention is to provide a IPTV playback control method, apparatus, and computer storage medium, which can effectively ensure that the IPTV responds to the control message in time while implementing smooth playback of the media stream data.

To achieve the above objective, the technical solution of the embodiment of the present invention is implemented as follows:

An embodiment of the present invention provides a playback control method for an IPTV, where the method includes:

Receiving a control message;

And responding to the control message when the control message belongs to a preset global message set;

When the control message does not belong to the preset global message set, the control message is responded to when the control message has a corresponding relationship with the acquired current state of the IPTV according to the corresponding relationship between the preset control message and the IPTV state.

In the above solution, the method further includes:

When the control message does not belong to the preset global message set, and determines that the control message does not correspond to the acquired current state of the IPTV, the control message is ignored.

In the above solution, the correspondence between the preset control message and the IPTV status includes:

The control message corresponding to the idle state includes starting to play the message;

The control message corresponding to the first frame state includes a first frame playing message and a stop playing message;

The control message corresponding to the play status includes a pause play message, a stop play message, a resume play message, and an end play message;

The control message corresponding to the pause state includes stopping the play message, restoring the play message, and fast forwarding the message;

The control message corresponding to the fast forward state includes stopping the playing message, restoring the playing message, and fast forwarding the message;

The control message corresponding to the end state includes stopping the play message.

In the foregoing solution, when the IPTV is in a playing state, the method further includes:

Get the actual consumed time of the playback loop of the current frame;

It takes time to acquire the playback loop of the current frame;

When the sum of the actual consumed time and the estimated required consumption time is greater than a preset threshold, the current frame is abandoned to continue playing, and the playback cycle of the next frame is entered.

In the above solution, the playback cycle of the current frame needs to consume time:

The estimated time spent in the next step of the playback loop that will be executed.

The embodiment of the present invention further provides a playback control device for an IPTV, where the device includes: a message receiving module, a global message response module, and a status message response module;

a message receiving module configured to receive a control message;

a global message response module, configured to respond to the control message when the control message belongs to a preset global message set;

The status message response module is configured to: when the control message does not belong to the preset global message set, determine, according to the correspondence between the preset control message and the IPTV status, that the control message has a corresponding relationship with the acquired current state of the IPTV Responding to the control message.

In the above solution, the device further includes:

An idle state module configured to respond to a start play message corresponding to an idle state;

The first frame status module is configured to play a message in response to the first frame corresponding to the first frame state, and stop playing the message;

a play status module configured to respond to a pause play message corresponding to a play status, Stop playing the message, resume playing the message, and end the playback message;

a pause state module configured to respond to a stop play message, a resume play message, and a fast forward play message corresponding to the pause state;

The fast forward status module is configured to respond to the stop play message, the resume play message, and the fast forward play message corresponding to the fast forward state;

The end status module is configured to respond to the stop play message corresponding to the end status.

In the above solution, the play status module includes:

The actual time monitoring unit is configured to obtain the actual consumed time of the playing cycle of the current frame;

The estimated time acquisition unit is configured to acquire the playback cycle of the current frame and is expected to consume time;

The frame discarding unit is configured to, when the sum of the actual consumed time and the estimated required time is greater than a preset threshold, abandon the continuous playing of the current frame and enter a playing cycle of the next frame.

In the above solution, the estimated time obtaining unit includes:

The next time acquisition unit is configured to obtain the estimated time spent in the next step of the playback loop to be executed.

An embodiment of the present invention provides a computer storage medium, where the computer storage medium stores a computer program, and the computer program is used to execute the IPTV playback control method described above.

The IPTV broadcast control method and apparatus and the computer storage medium provided by the embodiments of the present invention divide the IPTV into multiple states, and divide the control message into a state-independent global message and a status message responding in a specific state. Ensure that the global message is preferentially responded, and the status message is only responded to in the corresponding state; thus, the IPTV can respond to the control message in time, and the illegal control message can be prevented from affecting the normal playback of the media stream, so that the media stream The playback is smoother. Further, in the playing state, the sum of the actual consumed time of the current frame and the estimated time required to be consumed does not exceed the preset threshold, and the smooth playback of the media stream can be better ensured.

DRAWINGS

1 is a schematic flowchart of an implementation process of a IPTV playback control method according to an embodiment of the present invention;

2 is a schematic diagram of correspondence between a control message and an IPTV state in a frame IPTV playback control method according to an embodiment of the present invention;

FIG. 3 is a schematic structural diagram of a structure of an IPTV playback control apparatus according to an embodiment of the present invention.

detailed description

In order to explain the embodiments and technical solutions of the present invention more clearly, the technical solutions of the present invention will be described in more detail below with reference to the accompanying drawings and embodiments. It is obvious that the described embodiments are a part of the embodiments of the present invention, and not all Example. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without departing from the inventive scope are the scope of the present invention.

In the embodiment of the present invention, the IPTV is pre-defined according to the state attribute of the IPTV player into six states, namely, an idle (IDLE) state, a first frame (FIRSTFRM) state, a play (PLAY) state, and a pause ( PAUSE) state, fast forward (FAST) state, end (EOS) state; usually, the current state of the IPTV player can be obtained through the "get interface", that is, the current state of the IPTV is obtained. In addition, in the embodiment of the present invention, the control message is divided into a state-independent global message and a status message that responds in a specific state; and a global message set, a control message, and an IPTV state are defined in advance; wherein, the global message set It consists of a state-independent control message; the correspondence between the control message and the IPTV state describes which control messages are responded in a particular state.

FIG. 1 is a schematic flowchart of an implementation process of a IPTV playback control method according to an embodiment of the present invention. As shown in FIG. 1 , the method mainly includes the following steps:

Step 101: Receive a control message.

After the play thread is started, the IPTV player can receive the control message sent by the IPTV upper layer service module. Generally, the IPTV upper layer service module passes the hardware abstraction layer (HAL, Hardware). Abstraction Layer) sends a control message to the player. Some of these control messages belong to the global message set, such as: switching channel messages, standby messages, etc.; some are not part of the global message set, only executed in a specific state, for example: start playing (CMD_PLAYER_START) message, stop playing ( CMD_PLAYER_STOP) message, etc. Among them, the control message belonging to the global message set needs to be preferentially responded.

Step 102: When the control message belongs to a preset global message set, respond to the control message;

In an embodiment, the IPTV determines whether the currently received control message is one of the global message sets, and if so, the control message belongs to a preset global message set and responds to the control message.

Step 103: When the control message does not belong to the preset global message set, according to the correspondence between the preset control message and the IPTV state, when the control message is determined to have a corresponding relationship with the acquired current state of the IPTV, Control messages.

In an embodiment, when the control message does not belong to the preset global message set, the current status of the IPTV is obtained, and according to the correspondence between the preset control message and the IPTV status, it is determined whether the control message has a current status of the IPTV. Corresponding relationship, when it is determined that the control message has a corresponding relationship with the current state of the IPTV, indicating that the control message should be responded to in the current state of the IPTV, responding to the control message.

In an embodiment, the correspondence between the control message and the IPTV status is as shown in FIG. 2, and includes:

The control message corresponding to the IDLE state includes a start playing (CMD_PLAYER_START) message;

The control message corresponding to the FIRSTFRM state includes a first frame play (CMD_PLAYER_FSTFRM) message, a stop play (CMD_PLAYER_STOP) message;

The control message corresponding to the PLAY state includes: pause play (CMD_PLAYER_PAUSE) message, stop playing (CMD_PLAYER_STOP) message, resume playback (CMD_PLAYER_RESUME) message, end playback (CMD_PLAYER_EOS) message;

The control message corresponding to the PAUSE state includes a stop play (CMD_PLAYER_STOP) message, a resume play (CMD_PLAYER_RESUME) message, and a fast forward play (CMD_PLAYER_FAST) message;

The control message corresponding to the FAST state includes a stop play (CMD_PLAYER_STOP) message, a resume play (CMD_PLAYER_RESUME) message, and a fast forward play (CMD_PLAYER_FAST) message;

The control message corresponding to the EOS state includes a stop play (CMD_PLAYER_STOP) message.

Among them, IDLE is the initial state, and the IDLE state can be migrated to the FIRSTFRM state only after receiving the CMD_PLAYER_START message. After the FIRSTFRM state response CMD_PLAYER_FSTFRM, it migrates to the PLAY state. When the PLAY state reaches the end of the file stream, it actively sends the CMD_PLAYER_EOS message to enter the EOS state. When the EOS state is determined, when the packet in the audio/video queue and the decoding waiting display queue is played, the initiative is initiated. The CMD_PLAY_STOP message is sent internally to enter the IDLE state. This is a basic normal playback process. EOS and FIRSTFRM are unstable and will not stay too long. PLAY, IDLE, PAUSE, and FAST are stable and can reside for a long time. In this state, the states are concatenated by messages.

In an embodiment, in the foregoing solution, when the control message does not belong to a preset global message set, and it is determined that the control message does not have a corresponding relationship with the acquired current state of the IPTV, the control message is ignored.

In an embodiment, for example, the current control message is a fast forward play message, and the current status of the IPTV is an IDLE state; in the above step 102, it is determined that the control message does not belong to the preset global message set, and the step is determined in step 103. The control message does not have a corresponding relationship with the IDLE state. At this time, the fast forward play message may be considered as an illegal message and cannot be responded, and the fast forward play is ignored. Message.

In this way, the IPTV can quickly respond to the global message, and the illegal message can be ignored in time, so that the playback of the media stream is not affected by the illegal message.

In general, demultiplexing, audio output, audio decoding, video output, and video decoding are playback cycles for one frame. However, in the embodiment of the present invention, since the first frame state is entered, the first frame state has been decoded. The data of the first frame can be subjected to audio output, audio decoding, video output, video decoding of the first frame and then demultiplexed for the next frame when entering the playing state. Therefore, the playback cycle of each frame in the present invention refers to: audio output, audio decoding, video output, video decoding, and demultiplexing of the next frame data.

To ensure smooth playback of the media stream, the time spent on the playback cycle for each frame should not exceed a reasonable threshold, typically 20 milliseconds (ms). Therefore, when the time consumed for the playback cycle of a certain frame exceeds the threshold, the frame should be discarded decisively to avoid affecting the playback of subsequent media streams.

Therefore, in the above solution, when the IPTV is in the playing state, the IPTV needs to perform the following steps:

Step A: Obtain an actual consumed time of a play cycle of the current frame;

In step B, it takes time to acquire the playback cycle of the current frame.

In step C, when the sum of the actual consumed time and the estimated required consumption time is greater than a preset threshold, the current frame is discarded and the playback cycle of the next frame is entered.

In one embodiment, the playback time of the current frame may also be time consuming to be represented by the expected time of the next step in the playback loop to be executed, because if it is expected to execute the next step in the playback loop Exceeding the preset threshold (20ms) is enough to indicate that the current frame should be discarded and the playback loop of the next frame is entered.

In one embodiment, the audio output, audio decoding, video output, video decoding, and demultiplexing are actually run in the playback cycle of the current frame as T1, T2, T3, T4, and T5, respectively. The time required for audio output, audio decoding, video output, video decoding, and demultiplexing in any one frame playback cycle is t1, t2, t3, t4, t5; where t1, t2, t3, t4 The initial values of t5 and t5 are 1ms, 2ms, 1ms, 4ms, 1ms, and 12ms, respectively;

After the audio output is executed, if T1+t2>20ms, the next audio decoding will not be performed and exit directly; otherwise, go to the next step;

After the audio decoding is completed, if T1+T2+t3>20ms, the next video output will not be performed and exit directly; otherwise, go to the next step;

After the video output is executed, if T1+T2+T3+t4>20ms, the next step of video decoding will not be performed and exit directly; otherwise, go to the next step;

After the video decoding is completed, if T1+T2+T3+T4+t5>20ms, the next demultiplexing is not performed, and the direct exit; otherwise, the next step is entered;

After the demultiplexing is performed, if T1+T2+T3+T4+T5+t6>20ms, the next audio output will not be performed and exit directly; otherwise, proceed to the next step.

3 is a schematic structural diagram of a IPTV playback control apparatus according to an embodiment of the present invention. As shown in FIG. 3, the playback control apparatus includes: a message receiving module 301, a global message response module 302, and a status message response module 303;

The message receiving module 301 is configured to receive a control message.

The global message response module 302 is configured to respond to the control message when the control message belongs to a preset global message set;

The status message response module 303 is configured to determine, according to the correspondence between the preset control message and the IPTV status, that the control message has a corresponding relationship with the current state of the acquired IPTV, when the control message does not belong to the preset global message set. Responding to the control message.

In an embodiment, the above playback control apparatus further includes:

a first frame status module configured to play in response to a first frame corresponding to a first frame state Message, stop playing the message;

The play status module is configured to respond to the pause play message corresponding to the play status, stop playing the message, resume playing the message, and end the play message;

In an embodiment, in the upper playback control device, the play status module includes:

In an embodiment, in the above playback control apparatus, the estimated time acquisition unit includes:

Each of the above modules and each unit may be implemented by a Central Processing Unit (CPU), a Micro Processor Unit (MPU), and a Digital Signal Processor (DSP) located in the IPTV. Or Field Programmable Gate Array (FPGA) implementation.

The embodiment of the present invention further describes a computer storage medium, wherein the computer storage medium stores a computer program, and the computer program is used to execute the IPTV playback control method shown in FIG. 1 in the embodiment of the present invention.

Those skilled in the art will appreciate that embodiments of the present invention can be provided as a method, system, or computer program product. Accordingly, the present invention may employ hardware embodiments, software embodiments, or junctions. In the form of an embodiment of the software and hardware aspects. Moreover, the invention can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) including computer usable program code.

The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (system), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG. These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing device to produce a machine for the execution of instructions for execution by a processor of a computer or other programmable data processing device. Means for implementing the functions specified in one or more of the flow or in a block or blocks of the flow chart.

The computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device. The apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.

These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device. The instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.

The above is only the preferred embodiment of the present invention and is not intended to limit the scope of the present invention.

Industrial applicability

In the embodiment of the present invention, when the control message belongs to a preset global message set, responding to the control message; when the control message does not belong to a preset global message set, according to the preset Corresponding relationship between the control message and the IPTV state, determining that the control message has a corresponding relationship with the acquired current state of the IPTV, responding to the control message; thus, ensuring that the IPTV can respond to the control message in time, and avoiding illegal control The message affects the normal playback of the media stream, making the media stream play smoother.

Claims

A method for controlling playback of an interactive network television IPTV, the method comprising:

Receiving a control message;

And responding to the control message when the control message belongs to a preset global message set;

When the control message does not belong to the preset global message set, the control message is responded to when the control message has a corresponding relationship with the acquired current state of the IPTV according to the corresponding relationship between the preset control message and the IPTV state.
The playback control method according to claim 1, wherein the method further comprises:

When the control message does not belong to the preset global message set, and determines that the control message does not correspond to the acquired current state of the IPTV, the control message is ignored.
The playback control method according to claim 1, wherein the correspondence between the preset control message and the IPTV status comprises:

The control message corresponding to the idle state includes starting to play the message;

The control message corresponding to the first frame state includes a first frame playing message and a stop playing message;

The control message corresponding to the play status includes a pause play message, a stop play message, a resume play message, and an end play message;

The control message corresponding to the pause state includes stopping the play message, restoring the play message, and fast forwarding the message;

The control message corresponding to the fast forward state includes stopping the playing message, restoring the playing message, and fast forwarding the message;

The control message corresponding to the end state includes stopping the play message.
The playback control method according to claim 3, wherein when the IPTV is in a playing state, the method further includes:

Get the actual consumed time of the playback loop of the current frame;

It takes time to acquire the playback loop of the current frame;

When the sum of the actual consumed time and the estimated required consumption time is greater than a preset threshold, the current frame is abandoned to continue playing, and the playback cycle of the next frame is entered.
The playback control method according to claim 4, wherein the playback cycle of the current frame further consumes time:

The estimated time spent in the next step of the playback loop that will be executed.
An apparatus for controlling playback of an IPTV, the apparatus comprising: a message receiving module, a global message response module, and a status message response module;

a message receiving module configured to receive a control message;

a global message response module, configured to respond to the control message when the control message belongs to a preset global message set;

The status message response module is configured to: when the control message does not belong to the preset global message set, determine, according to the correspondence between the preset control message and the IPTV status, that the control message has a corresponding relationship with the acquired current state of the IPTV Responding to the control message.
The playback control device according to claim 6, wherein the device further comprises:

An idle state module configured to respond to a start play message corresponding to an idle state;

The first frame status module is configured to play a message in response to the first frame corresponding to the first frame state, and stop playing the message;

The play status module is configured to respond to the pause play message corresponding to the play status, stop playing the message, resume playing the message, and end the play message;

a pause state module configured to respond to a stop play message, a resume play message, and a fast forward play message corresponding to the pause state;

The fast forward status module is configured to respond to the stop play message, the resume play message, and the fast forward play message corresponding to the fast forward state;

The end status module is configured to respond to the stop play message corresponding to the end status.
The playback control device according to claim 7, wherein said playback status module package include:

The actual time monitoring unit is configured to obtain the actual consumed time of the playing cycle of the current frame;

The estimated time acquisition unit is configured to acquire the playback cycle of the current frame and is expected to consume time;

The frame discarding unit is configured to, when the sum of the actual consumed time and the estimated required time is greater than a preset threshold, abandon the continuous playing of the current frame and enter a playing cycle of the next frame.
The playback control device according to claim 8, wherein the estimated time acquisition unit comprises:

The next time acquisition unit is configured to obtain the estimated time spent in the next step of the playback loop to be executed.
A computer storage medium having stored therein computer executable instructions for performing the method of any one of claims 1 to 5.