CN112584195B - Video playing and processing method and device, cloud set top box, cloud platform and medium - Google Patents

Video playing and processing method and device, cloud set top box, cloud platform and medium Download PDF

Info

Publication number
CN112584195B
CN112584195B CN201910935351.4A CN201910935351A CN112584195B CN 112584195 B CN112584195 B CN 112584195B CN 201910935351 A CN201910935351 A CN 201910935351A CN 112584195 B CN112584195 B CN 112584195B
Authority
CN
China
Prior art keywords
displayed
original
video
video playing
frame
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910935351.4A
Other languages
Chinese (zh)
Other versions
CN112584195A (en
Inventor
袁景美
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN201910935351.4A priority Critical patent/CN112584195B/en
Publication of CN112584195A publication Critical patent/CN112584195A/en
Application granted granted Critical
Publication of CN112584195B publication Critical patent/CN112584195B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234363—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/437—Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA

Abstract

The application provides a video playing and processing method, a video playing and processing device, a cloud set top box, a cloud platform and a medium. The method comprises the following steps: receiving a User Interface (UI) media stream to be displayed, which is sent by a cloud platform; determining a target video playing area corresponding to each current UI frame to be displayed in the UI media stream to be displayed, wherein the target video playing area is a full transparent area; determining corresponding video resolution according to the first vertex position and the region size of the target video playing region; and sequentially overlapping the video to be played to a target video playing area, and playing the video to be played in the target video playing area according to the video resolution.

Description

Video playing and processing method and device, cloud set top box, cloud platform and medium
Technical Field
The application relates to a multimedia terminal and cloud computing, in particular to a video playing and processing method and device, a cloud set top box, a cloud platform and a medium.
Background
With the development of cloud computing and virtualization technology and the increasing maturity of interactive network television (Internet Protocol TeleVision, IPTV), in order to meet the requirements that users do not need to update home set top boxes in an iterative manner, the cloud computing and virtualization technology-based cloud intelligent set top boxes can obtain higher multimedia audio and video processing speed, enjoy richer value added services and have better user experience.
The cloud set top box is not required to support the traditional IPTV service, and in the age of rapid media development, more small videos are rushed out, and the cloud set top box is required to meet the requirements of multiple windows of users and viewing of embedded picture-in-picture (Picture In Picture, PIP). I.e. to display multiple video programs on the same screen or to insert one or more video programs simultaneously on a normally viewed main picture.
In the cloud set top box, as the cloud set top box cannot know the coordinates and the size of the small video, and the resolution of the small video is lower than the full-screen resolution, how to enable the small video to be quickly embedded into an image or video layer without distortion and to be played at a correct position is a problem to be solved urgently.
Disclosure of Invention
The embodiment of the application provides a video playing and processing method, a device, a cloud set top box, a cloud platform and a medium, which ensure that video content is watched at a correct position rapidly and smoothly on the cloud set top box with limited performance.
In a first aspect, an embodiment of the present application provides a video playing method, which is applied to a cloud set top box, including:
receiving a User Interface (UI) media stream to be displayed, which is sent by a cloud platform;
Determining a target video playing area corresponding to each current UI frame to be displayed in the UI media stream to be displayed, wherein the target video playing area is a full transparent area;
determining corresponding video resolution according to the first vertex position and the region size of the target video playing region;
and sequentially overlapping the video to be played to the target video playing area, and playing the video to be played in the target video playing area according to the video resolution.
In a second aspect, an embodiment of the present application provides a video processing method, applied to a cloud platform, including:
under the condition that a video playing instruction is received, determining a background color region group corresponding to each original UI frame in an original UI media stream, wherein the background color region group is a largest group of regions containing UI background colors;
determining a corresponding original video playing area according to the background color area group;
and setting the transparency of the original video playing area corresponding to each original UI frame to be fully transparent in sequence to obtain a corresponding UI media stream to be displayed.
In a third aspect, an embodiment of the present application provides a video playing device, which is applied to a cloud set top box, including:
the receiving module is used for receiving a User Interface (UI) media stream to be displayed, which is sent by the cloud platform;
The first determining module is configured to determine a target video playing area corresponding to each current UI frame to be displayed in the UI media stream to be displayed, wherein the target video playing area is a full transparent area;
the second determining module is used for determining the corresponding video resolution according to the first vertex position and the region size of the target video playing region;
and the playing module is used for sequentially overlapping the videos to be played to the target video playing area and playing the videos to be played in the target video playing area according to the video resolution.
In a fourth aspect, an embodiment of the present application provides a video processing apparatus, applied to a cloud platform, including:
the third determining module is configured to determine a background color region group corresponding to each original UI frame in the original UI media stream under the condition that a video playing instruction is received, where the background color region group is a largest group of regions including UI background colors;
a fourth determining module, configured to determine a corresponding original video playing area according to the background color area group;
and a fifth determining module, configured to set the transparency of the original video playing area corresponding to each original UI frame to be fully transparent in sequence, so as to obtain a corresponding UI media stream to be displayed.
In a fifth aspect, embodiments of the present application provide a clouded set-top box, where the clouded set-top box includes: a memory, and one or more processors;
the memory is configured to store one or more programs;
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the video playback method described in any one of the embodiments above.
In a sixth aspect, embodiments of the present application provide a cloud platform, the cloud platform including: the cloud set top box authentication system, the virtual machine control system and one or more virtual processor systems;
the cloud set top box authentication system is set to authenticate the cloud set top box;
the virtual machine control system is arranged to allocate a corresponding virtual processor system to the cloud set top box;
the virtual processor system is arranged to receive a video trigger instruction of the cloud set top box and feed back a processing result of the video trigger instruction to the cloud set top box;
and after receiving one or more video trigger instructions, enabling one or more virtual processor systems to implement the video processing method according to any one of the above embodiments.
In a seventh aspect, embodiments of the present application provide a storage medium storing a computer program that when executed by a processor implements a method according to any of the above embodiments.
Drawings
Fig. 1 is a block diagram of a cloud set top box system provided in the prior art;
FIG. 2 is a schematic illustration of a video presentation provided by the prior art;
fig. 3 is a flowchart of a video playing method according to an embodiment of the present application;
fig. 4 is a flowchart of a video processing method according to an embodiment of the present application;
fig. 5 is a flowchart of playing a small video by using a clouded set top box according to an embodiment of the present application;
fig. 6 is a flowchart of a small video program displayed by using a remote control to request an EPG according to an embodiment of the present application;
fig. 7 is a schematic display diagram of a background color area of a small video UI of a cloud platform according to an embodiment of the present application;
fig. 8 is a schematic diagram of a cloud platform retrieving a small video UI background color area according to an embodiment of the present application;
FIG. 9 is a schematic diagram of a tSTB retrieving an area that is fully transparent, provided by an embodiment of the present application;
fig. 10 is a block diagram of a video playing device according to an embodiment of the present application;
Fig. 11 is a block diagram of a video processing apparatus according to an embodiment of the present application;
fig. 12 is a schematic structural diagram of a clouding set top box according to an embodiment of the present application;
fig. 13 is a schematic structural diagram of a cloud platform according to an embodiment of the present application.
Detailed Description
Embodiments of the present application will be described below with reference to the accompanying drawings. Embodiments and features of embodiments in this application may be combined with each other arbitrarily without conflict.
Fig. 1 is a block diagram of a cloud set top box system provided in the prior art. As shown in fig. 1, the cloud set-top box system includes: a cloud set top box (tSTB for short), a cloud platform and a service system; the cloud platform includes: a virtual machine control system (abbreviated as VM Controller), a virtual processor system (abbreviated as vSTB) and a cloud set top box authentication system (abbreviated as tSTB authentication system); the business system comprises: an electronic program guide (Electronic Program Guide, EPG) system and a content delivery network (Content Delivery Network, CDN) system.
The cloud set top box system has the following working processes: firstly, a tSTB accesses a cloud platform through a tSTB authentication system; secondly, after passing the authentication of the tSTB authentication system, a virtual machine control system in the cloud platform distributes a corresponding vSTB for the tSTB; third, the vSTB receives the key command from the tSTB, and the vSTB feeds back the result to the tSTB according to the processing of the key command.
The method comprises the steps that a vSTB feeds back related media playing control instructions to a tSTB aiming at a playing request of a small media video, and the tSTB obtains a media stream from a CDN to decode and play; aiming at a User Interface (UI) display request of an EPG and the like, a vSTB (virtual machine control system) performs picture conversion and streaming processing in a cloud platform, and then sends the picture conversion and streaming processing to a tSTB (television set-top box) in a media stream mode, and the tSTB decodes the picture conversion and streaming processing and then performs UI display of the EPG and the like. In an embodiment, the small media video and the UI display in the EPG may be output to a television for viewing after the stb is overlaid. Fig. 2 is a schematic diagram of a video presentation provided in the prior art. As shown in fig. 2, the area 1 is a video window of the EPG, and the area 2 is a small video UI window, wherein the area 2 is used to display video content of the small video, i.e., an area used to play the small video.
Aiming at the scheme of playing small videos of the cloud set top box system shown in fig. 1, for a tSTB, the small video media stream distributed by the CDN and the UI stream used for displaying the EPG and the like need to be overlapped, and the small videos need to be rapidly displayed on the correct position of an EPG window; in the cloud platform system, the video stream channel for transmitting the UI can only transmit video information, and the tsstb cannot learn the coordinates of the small video, so the tsstb needs to search the position of the small video, calculate the size of the small video, and if the position is searched incorrectly, the size is calculated incorrectly, the speed is too slow, and the phenomena of misplacement of the video layer, incomplete filling of the video picture, poor fluency, and blocking and the like occur in the display on the television.
Aiming at the defects, the embodiment of the application provides a video playing method which is used for solving the defects that the playing position and the size of a small video cannot be known in a cloud set top box system, the dislocation of a video layer, the filling of a video picture is not full, the smoothness is poor, the blocking is caused and the like.
Fig. 3 is a flowchart of a video playing method according to an embodiment of the present application. The embodiment is suitable for the situation that the small video playing position is accurately searched and played in real time, and is executed by the cloud set top box in the cloud set top box system.
As shown in fig. 3, the video playing method in the present embodiment includes S110 to S140.
S110, receiving a UI media stream to be displayed, which is sent by the cloud platform.
In an embodiment, the UI media stream to be displayed refers to a UI video stream after the cloud platform performs processing. In an embodiment, streaming processing is performed on the UI media stream from the EPG at the cloud platform, and the UI media stream to be displayed obtained after processing is sent to the cloud set top box.
In an embodiment, after a tSTB obtains a small video stream transmitted by a CDN, a video playing instruction is fed back to a vSTB in a cloud platform; after the vSTB receives the video playing instruction, streaming processing is started on the original UI media stream from the EPG so as to obtain a corresponding UI media stream to be displayed; and sending the UI media stream to be displayed to the tSTB so that the tSTB performs display processing on the UI media stream to be displayed.
S120, determining a target video playing area corresponding to each current UI frame to be displayed in the UI media stream to be displayed.
The target video playing area is a full transparent area. In an embodiment, the target video playing area is a playing position of a small video on the television. In the actual playing process, in order to ensure that small video content can be rapidly and smoothly played at a correct small video playing position on a cloud set top box with limited performance, after the cloud set top box receives a UI media stream to be displayed, sequentially extracting a current UI frame to be displayed in the UI media stream to be displayed, dividing the current UI frame to be displayed into a plurality of subareas, taking the subarea with the minimum coordinate value in all subareas of the current UI frame to be displayed as a target subarea, searching the plurality of subareas to the periphery according to the coordinate value of the target subarea, determining the position coordinates with full transparency in the plurality of subareas, taking the full transparent area in each UI frame to be displayed as a target video playing area corresponding to the current UI frame to be displayed,
s130, determining the corresponding video resolution according to the first vertex position and the region size of the target video playing region.
In an embodiment, the first vertex position refers to a position where the coordinate value of the target video play area is minimum; the region size refers to the size of the target video play region. In an embodiment, four vertex positions of the target video playing area can be obtained according to the coordinate value of the first vertex position of the target video playing area and the area size of the target video playing area, so that the corresponding video resolution can be calculated according to the coordinate values of the four vertex positions. Where video resolution refers to the resolution corresponding to a small video on a television. Illustratively, the target video playing area is rectangular or square. In an embodiment, the coordinate values of the four vertex positions may be subtracted to obtain the length and width of the corresponding target video playing area, and then the corresponding video resolution is calculated.
And S140, sequentially overlapping the video to be played to a target video playing area, and playing the video to be played in the target video playing area according to the video resolution.
In an embodiment, the video to be played refers to a small video media stream from the CDN, and the small video media stream is superimposed into a fully transparent UI media stream where the small video is located (i.e., a UI media stream to be displayed), and output to a television for display and playing. Meanwhile, the transparency of the UI layer where the small video is located is full transparent, and the picture played before on the television is not blocked completely, so that the watching experience and fluency of a user are ensured.
In an embodiment, determining a target video playing area corresponding to each current UI frame to be displayed in the UI media stream to be displayed includes: determining a target subarea corresponding to each current UI frame to be displayed in the UI media stream to be displayed, wherein the target subarea is a full-transparent subarea with the minimum coordinate value in the current UI frame to be displayed; and determining a target video playing area corresponding to each current UI frame to be displayed according to the coordinate values of the target subareas.
In an embodiment, determining a target sub-region corresponding to each current UI frame to be displayed in the UI media stream to be displayed includes: sequentially extracting current UI frames to be displayed in the UI media stream to be displayed; dividing a current UI frame to be displayed according to a preset rule to obtain a plurality of subareas; and determining the coordinate value of each sub-region, and taking the sub-region with the smallest coordinate value as a target sub-region.
In an embodiment, determining, according to coordinate values of the target sub-regions, a target video playing region corresponding to each UI frame to be currently displayed includes: sequentially searching and determining a plurality of sub-areas around the target sub-area according to the coordinate values of the target sub-area; and determining a target video playing area corresponding to each current UI frame to be displayed according to the transparency of the plurality of subareas.
In an embodiment, the transparency of the target video playing area in each current UI frame to be displayed in the UI media stream to be displayed is fully transparent, after the cloud set-top box receives the UI media stream to be displayed sent by the cloud platform, each current UI frame to be displayed is divided according to the integer division ratio to obtain a plurality of sub-areas, the plurality of sub-areas in each current UI frame to be displayed are searched, a first sub-area (wherein the first sub-area refers to the sub-area with the minimum coordinate value) in the plurality of sub-areas is found, the coordinate value of the first sub-area is recorded, and the transparency of the sub-areas is continuously judged in four directions up, down, left and right respectively until the target video playing area is determined, namely, the area with the fully transparent transparency is found. After the target video playing area is obtained, the coordinate value of the upper left corner and the area size of the target video playing area are determined to calculate the resolution of the small video, and the small video media stream from the CDN is added to the full-transparent UI media stream where the small video is located and then is output to a television for playing.
In an embodiment, before receiving the UI media stream to be displayed, which is sent by the cloud platform, the method further includes: sending the received video triggering instruction initiated by the user to a cloud platform; receiving a broadcasting control instruction fed back by the cloud platform; a broadcast control request is sent to a content delivery network CDN; receiving a video to be played corresponding to a playing control request fed back by the CDN; and sending a video playing instruction to the cloud platform.
In an embodiment, after the cloud set top box is normally connected to the cloud platform, the cloud platform carries out streaming processing on the UI frames from the EPG, and transmits the UI media stream after the streaming processing to the cloud set top box, and after the cloud set top box decodes processing, the EPG is displayed on the television; when a user presses an EPG program to play a small video button by using a remote controller, namely, the cloud set top box receives a video trigger instruction initiated by the user, the cloud set top box sends the video trigger instruction to a cloud platform, and the cloud platform processes the video trigger instruction to obtain a corresponding broadcasting control instruction and feeds the broadcasting control instruction back to the cloud set top box; after the cloud set top box receives the broadcasting control instruction, a broadcasting control request is initiated to the CDN, the CDN responds to the broadcasting control request, and a small video stream corresponding to the video to be played and corresponding to the broadcasting control request is transmitted to the cloud set top box; after the cloud set top box receives the small video stream transmitted by the CDN, feeding back a message that the small video starts to be played to the cloud platform, namely, sending a video playing instruction to the cloud platform, so that the cloud platform can carry out streaming processing on the UI frames from the EPG to obtain a corresponding UI media stream to be displayed.
Fig. 4 is a flowchart of a video processing method according to an embodiment of the present application. The embodiment is applied to a cloud platform, and as shown in fig. 4, the video processing method in the embodiment includes S210-S230.
S210, under the condition that a video playing instruction is received, determining a background color region group corresponding to each original UI frame in the original UI media stream.
The background color area group is the largest area group containing the UI background color. The original UI media stream refers to a UI media stream in which the bottom background color of the small video play area is solid. In an embodiment, when a user plays a small video through a television, a bottom background color for displaying the small video is solid, and after acquiring a UI media stream of an EPG, the cloud platform acquires an original UI media stream of the EPG. The cloud platform can carry out streaming processing on the original UI media stream, namely, firstly, image segmentation is carried out on each original UI frame in the original UI media stream to obtain a plurality of original subareas; and then searching the small video background colors in the plurality of original subregions, finding the original subregions covering all the small video background colors in the plurality of original subregions, and forming a corresponding background color region group.
S220, determining a corresponding original video playing area according to the background color area group.
In the embodiment, under the condition that the four vertex positions of the original video playing area are not the four vertex positions of the background color area group, the first vertex position of the background color area group needs to be found, namely, the first vertex position coordinates are determined, and then the area of the background color is continuously searched in four directions, namely, up, down, left and right, so as to determine the corresponding original video playing area. The first vertex position refers to the top left corner vertex position of the original video playing area.
And S230, setting the transparency of the original video playing area corresponding to each original UI frame to be fully transparent in sequence, and obtaining a corresponding UI media stream to be displayed.
In an embodiment, the transparency of an original video playing area corresponding to each original UI frame is set to be fully transparent, so as to obtain a corresponding UI frame to be displayed; and then forming a corresponding UI media stream to be displayed through the UI frames to be displayed.
In an embodiment, determining a set of background color regions corresponding to each original UI frame in the original UI media stream includes: dividing each original UI frame in the original UI media stream in turn according to a pre-rule to obtain a plurality of original subareas; and searching the plurality of original subareas according to preset search conditions to obtain a background color area group corresponding to each original UI frame, wherein the preset search conditions are areas containing UI background colors.
In an embodiment, determining a corresponding original video playing area according to the background color area group includes: identifying and extracting four vertex positions of the background color region group; searching coordinate points with pixels as UI background colors in an extending mode to the periphery according to the four vertex positions; and determining a corresponding original video playing area according to the coordinate points.
In an embodiment, dividing each original UI frame in the original UI media stream in turn according to integer division ratio to obtain a plurality of original subregions; finding out a maximum group of original subareas which are continuous with the background color of the small video UI according to the width or length range in the original UI frame, and recording the maximum group of original subareas as the area range covered by the small video UI; and then, recording the coordinate value of the left upper corner in the background color region group, respectively extending and searching in the up-down, left-right directions, continuously searching the point with the pixel as the background color of the small video UI, determining the corresponding left upper corner coordinate and region size, and obtaining the corresponding original video playing region.
In an embodiment, before receiving the video playing instruction, the method further includes: receiving a video trigger instruction carrying a broadcast control message; generating a corresponding broadcast control instruction according to the broadcast control message in the video trigger instruction; and feeding back the broadcasting control instruction to the cloud set top box.
In an embodiment, when a user presses an EPG program to play a small video button by using a remote controller, namely when the cloud set top box receives a video trigger instruction, the cloud set top box transmits the video trigger instruction carrying a broadcast control message to a cloud platform, and the cloud platform generates a corresponding broadcast control instruction according to the broadcast control message in the video trigger instruction and transmits the broadcast control instruction back to the cloud set top box; the cloud set top box receives a video playing instruction at a cloud platform, initiates a broadcasting control request to the CDN, and the CDN responds to the broadcasting control request and transmits a small video stream to the cloud set top box; and after receiving the small video stream, the cloud set top box feeds back a video playing instruction to the cloud platform so that the cloud platform can carry out streaming processing on the UI frames in the EPG.
In an embodiment, fig. 5 is a flowchart of playing a small video by using a clouded set top box according to an embodiment of the present application. As shown in fig. 5, the present embodiment includes S310 to S360.
S310, a user turns on the television and the cloud set top box.
And S320, the cloud set top box displays an EPG interface through the television.
S330, the user requests the small video program displayed by the EPG by using the remote controller.
S340, the cloud set top box starts playing the small video.
S350, the user stops playing the small video program by using the remote controller.
S360, the cloud set top box resumes the display of the EPG interface.
In one embodiment, fig. 6 is a flowchart of a small video program displayed by using a remote control to request an EPG according to an embodiment of the present application. As shown in fig. 6, the present embodiment includes S410 to S40.
S410, the original UI media stream of the EPG is received.
S420, the original UI media stream of the EPG is subjected to fluidization treatment and displayed.
S430, transmitting the UI media stream to be displayed after the streaming processing to the tSTB.
S440, the tSTB decodes the UI media stream to be displayed and displays the output.
S450, receiving a program broadcasting control input instruction of the remote controller initiated by a user.
S460, sending a program broadcasting control input instruction of the remote controller to the vSTB.
S470, vSTB processes the broadcast control message.
The broadcast control message is generated by a program broadcast control input instruction of the remote controller.
And S480, transmitting the small video playing control instruction to the tSTB.
S490, the stb sends a small video-multicast request to the CDN.
S4100, the CDN responds to the small video play control request and feeds back the small video stream to the tsbs.
S4110, send a video play command to the vSTB.
S4120, the EPG UI media stream, which sets the black area to be fully transparent, is transmitted to the tsbs.
S4130, the small video is overlapped to the EPG UI full transparent area for display.
In an embodiment, after the tsstb is normally connected to the vSTB, the vSTB performs streaming or the like on the original UI media stream from the EPG to obtain a UI media stream to be displayed; then transmitting the UI media stream to be displayed to the tSTB, decoding and processing the tSTB, and displaying the UI media stream to be displayed corresponding to the EPG on the television; after a user presses an EPG program playing small video button by using a remote controller (namely, a tSTB receives a remote controller program playing control input instruction initiated by the user), the tSTB transmits the remote controller program playing control input instruction to a vSTB, and the vSTB processes a playing control message generated according to the remote controller program playing control input instruction and then transmits the small video playing control instruction back to the tSTB; after the tSTB obtains the small video broadcasting control instruction, a small video broadcasting control request is launched to the CDN, and the CDN responds to the small video broadcasting control request and transmits a small video stream to the tSTB; after the tSTB obtains the small video stream transmitted by the CDN, the information of starting playing of the video is fed back to the vSTB, the vSTB carries out streaming processing on the original UI frame from the EPG, the original UI frame is divided according to the proportion that the current resolution can be divided, the divided subareas are searched, the search condition is that the area containing the background color of the small video UI is found, and the largest group of areas containing the background color of the small video UI is found. Because the resolution of the small video UI is random and the position is not fixed, after the largest group of areas containing the background color of the small video UI are found, the search is needed to continue, and because the small video UI area possibly exceeds the largest group of areas currently searched by the segmentation subareas, the search is continued from the top point of the largest background color area to the upper, lower, left and right directions, the size and the coordinates of the small video are determined, the transparency of the small video UI is set to be completely transparent, and then the processed UI media stream to be displayed is transmitted to the tSTB; after the tSTB decodes the received EPG waiting display UI media stream, the resolution size is calculated by searching the transparent area in each UI frame to be displayed, and the small video distributed by the CDN is embedded into the UI layer. Because the transparency of the UI layer where the small video is located is full transparent, the previously played picture is not blocked completely, and the watching experience and fluency of a viewer are ensured.
In implementing the above embodiment shown in fig. 6, the cloud platform needs to retrieve the small video UI black background area, and the tSTB needs to retrieve the area where the small video background is fully transparent.
Fig. 7 is a schematic display diagram of a background color area of a small video UI of a cloud platform according to an embodiment of the present application. As shown in fig. 7, the background color of the small video play area is black, i.e., the transparency of the small video play area is not fully transparent.
Fig. 8 is a schematic diagram of a cloud platform retrieving a small video UI background color area according to an embodiment of the present application. As shown in fig. 8, the cloud platform divides each original UI frame in the original UI media stream of the EPG according to an integer division ratio to obtain a plurality of sub-areas P1, P2, P3. The search for the position of P1, P2, p3. pixels in Pn are sub-regions of a small video background color; since the small video UI may not be entirely at the vertex position of the segmented sub-region, and some sub-regions, although in the background color, are small in size, the small video cannot be played. Therefore, a maximum group of background color region groups Gx which are continuous to the background color of the small video UI, namely the region range covered by the small video UI, needs to be found according to the width or length range in each original UI frame; recording coordinate values of the leftmost vertex Px in Gx, respectively extending and searching in four directions, namely up, down, left and right, continuously searching points with pixels being background colors of the small video UI, determining the upper left corner coordinates and the size area of the small video UI, and finding the actual position of the small video UI; setting the video transparency in the small video size region to be fully transparent; the processed UI stream is transmitted to the tsbs.
Fig. 9 is a schematic diagram of a stb retrieving an area with full transparency according to an embodiment of the present application. As shown in fig. 9, the tSTB divides each UI frame to be displayed in the UI media stream to be displayed sent by the cloud platform into a plurality of sub-areas P1, P2, P3. Searching for a first sub-region Px in P1, P2, P3. Recording coordinate values of Px, respectively judging transparency of the subareas in four directions of up, down, left and right, finding upper left corner coordinates and size areas of the small video, and calculating resolution of the small video; and the small video media stream from the CDN is overlapped to the full transparent UI stream where the small video is positioned, and then the small video media stream is output to the television.
In an embodiment, fig. 10 is a block diagram of a video playing device according to an embodiment of the present application. The embodiment is executed by a clouded set top box. As shown in fig. 10, the video playing device provided in this embodiment includes: a first receiving module 510, a first determining module 520, a second determining module 530, and a playing module 540.
The first receiving module 510 is configured to receive a user interface UI media stream to be displayed sent by the cloud platform;
the first determining module 520 is configured to determine a target video playing area corresponding to each current UI frame to be displayed in the UI media stream to be displayed, where the target video playing area is a fully transparent area;
A second determining module 530 configured to determine a corresponding video resolution according to the first vertex position and the region size of the target video playing region;
the playing module 540 is configured to sequentially superimpose the video to be played on the target video playing area, and play the video to be played on the target video playing area according to the video resolution.
The video playing device provided in this embodiment is configured to implement the video playing method in the embodiment shown in fig. 3, and the implementation principle and the technical effect of the video playing device provided in this embodiment are similar, and are not repeated here.
In an embodiment, the first determining module includes:
the first determining unit is used for determining a target subarea corresponding to each current UI frame to be displayed in the UI media stream to be displayed, wherein the target subarea is a full-transparent subarea with the minimum coordinate value in the current UI frame to be displayed;
and the second determining unit is used for determining a target video playing area corresponding to each current UI frame to be displayed according to the coordinate value of the target subarea.
In an embodiment, the first determining unit includes:
the extraction subunit is used for sequentially extracting current UI frames to be displayed in the UI media stream to be displayed;
the segmentation subunit is used for segmenting the current UI frame to be displayed according to a preset rule to obtain a plurality of subareas;
A first determination subunit configured to determine the coordinate value of each sub-region, and take the sub-region with the smallest coordinate value as the target sub-region.
In an embodiment, the second determining unit includes:
the second determining subunit is used for sequentially searching and determining a plurality of sub-areas around the target sub-area according to the coordinate values of the target sub-area;
and the third determining subunit is configured to determine a target video playing area corresponding to each current UI frame to be displayed according to the transparency of the plurality of sub-areas.
In an embodiment, the video playing device further includes:
the first sending module is used for sending the video triggering instruction initiated by the received user to the cloud platform before receiving the UI media stream to be displayed, which is sent by the cloud platform;
the second receiving module is used for receiving a broadcasting control instruction fed back by the cloud platform;
the second sending module is arranged to send a broadcast control request to the content delivery network CDN;
the third receiving module is arranged for receiving the video to be played corresponding to the playing control request fed back by the CDN;
the third sending module is arranged for sending a video playing instruction to the cloud platform.
In one embodiment, fig. 11 is a block diagram of a video processing apparatus according to an embodiment of the present application. The present embodiment is performed by a cloud platform. As shown in fig. 11, the video processing apparatus provided in this embodiment includes: the third determination module 610, the fourth determination module 620, and the fifth determination module 630.
The third determining module 610 is configured to determine, when receiving the video playing instruction, a background color region group corresponding to each original UI frame in the original UI media stream, where the background color region group is a largest group of regions including UI background colors;
a fourth determining module 620 configured to determine a corresponding original video playing area according to the background color area group;
the fifth determining module 630 is configured to set the transparency of the original video playing area corresponding to each original UI frame to be fully transparent in sequence, so as to obtain a corresponding UI media stream to be displayed.
The video processing device provided in this embodiment is configured to implement the video processing method in the embodiment shown in fig. 4, and the implementation principle and the technical effect of the video processing device provided in this embodiment are similar, and are not repeated here.
In an embodiment, the third determining module includes:
the segmentation generating unit is used for sequentially segmenting each original UI frame in the original UI media stream according to a preset rule to obtain a plurality of original subareas;
and the retrieval determining unit is used for retrieving the plurality of original subareas according to preset retrieval conditions to obtain a background color area group corresponding to each original UI frame, wherein the preset retrieval conditions are areas containing UI background colors.
In an embodiment, the fourth determining module includes:
an identification extraction unit configured to identify and extract four vertex positions of the background color area group;
the searching unit is arranged to extend and search coordinate points with pixels as UI background colors to the periphery according to the four vertex positions;
and a third determining unit configured to determine a corresponding original video playing area according to the coordinate points.
In an embodiment, the video processing apparatus further comprises:
the fourth receiving module is used for receiving a video triggering instruction carrying a broadcast control message before receiving a video playing instruction;
the generation module is used for generating a corresponding broadcasting control instruction according to the broadcasting control message in the video triggering instruction;
and the feedback module is used for feeding back the broadcasting control instruction to the cloud set top box.
Fig. 12 is a schematic structural diagram of a clouding set top box according to an embodiment of the present application. As shown in fig. 12, the cloud set top box provided in the present application includes: processor 710 and memory 720. The number of processors 710 in the clouded set-top box may be one or more, one processor 710 being illustrated in fig. 12. The amount of memory 720 in the clouded set-top box may be one or more, one memory 720 being illustrated in fig. 12. The processor 710 and memory 720 of the clouded set-top box may be connected by a bus or other means, for example in fig. 12.
The memory 720 is a computer readable storage medium, and may be configured to store a software program, a computer executable program, and modules, such as program instructions/modules (e.g., a first receiving module, a first determining module, a second determining module, and a playing module in a video playing device) corresponding to the clouded set-top box according to any embodiment of the present application. Memory 720 may include a storage program area that may store an operating system, at least one application program required for functionality, and a storage data area; the storage data area may store data created according to the use of the device, etc. In addition, memory 720 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage device. In some examples, memory 720 may further include memory located remotely from processor 710, which may be connected to the device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The cloud set top box provided by the above embodiment can be configured to execute the video playing method applied to the cloud set top box provided by any embodiment, and has corresponding functions and effects.
Fig. 13 is a schematic structural diagram of a cloud platform according to an embodiment of the present application. As shown in fig. 13, the cloud platform provided in the present application includes: a clouded set-top box authentication system 810, a virtual machine control system 820, and a virtual processor system 830. The number of virtual processor systems 830 in the device may be one or more. The cloud platform's clouded set-top box authentication system 810, virtual machine control system 820, and virtual processor system 830 may be connected via a bus or otherwise, for example in fig. 13.
In an embodiment, the clouded set-top box authentication system 810 is configured to authenticate a clouded set-top box; a virtual machine control system 820 configured to assign a corresponding virtual processor system 830 to the clouded set-top box; the virtual processor system 830 is configured to receive a video trigger instruction of the clouding set top box, and feed back a processing result of the video trigger instruction to the clouding set top box; upon receiving one or more video trigger instructions, the one or more virtual processor systems 830 are caused to implement the video processing method of any one of the embodiments described above.
When the device is a cloud platform, the program stored in the cloud platform may be a program instruction/module corresponding to the video processing method provided by the embodiment of the present application, and the virtual processor system 830 executes one or more functions and data processing of the computer device by running the stored software program, instruction and module, thereby implementing the video processing method applied to the cloud platform in the foregoing method embodiment. It can be understood that when the device is a cloud platform, the video processing method applied to the cloud platform provided by any embodiment of the application can be executed, and the corresponding functions and effects are provided.
The embodiment of the application also provides a storage medium containing computer executable instructions, which when executed by a computer processor, are used for executing a video playing method, the method is applied to a cloud set top box, and the method comprises the following steps: receiving a User Interface (UI) media stream to be displayed, which is sent by a cloud platform; determining a target video playing area corresponding to each current UI frame to be displayed in the UI media stream to be displayed, wherein the target video playing area is a full transparent area; determining corresponding video resolution according to the first vertex position and the region size of the target video playing region; and sequentially overlapping the video to be played to a target video playing area, and playing the video to be played in the target video playing area according to the video resolution.
The embodiments also provide a storage medium containing computer executable instructions, which when executed by a computer processor, are used to perform a video processing method, the method being applied to a cloud platform, the method comprising: under the condition that a video playing instruction is received, determining a background color region group corresponding to each original UI frame in an original UI media stream, wherein the background color region group is a largest group of regions containing UI background colors; determining a corresponding original video playing area according to the background color area group; and setting the transparency of the original video playing area corresponding to each original UI frame to be fully transparent in sequence to obtain a corresponding UI media stream to be displayed.
It will be appreciated by those skilled in the art that the term user equipment encompasses any suitable type of wireless user equipment, such as mobile telephones, portable data processing devices, portable web browsers, or car-mounted mobile stations.
In general, the various embodiments of the application may be implemented in hardware or special purpose circuits, software, logic or any combination thereof. For example, some aspects may be implemented in hardware, while other aspects may be implemented in firmware or software which may be executed by a controller, microprocessor or other computing device, although the application is not limited thereto.
Embodiments of the present application may be implemented by a data processor of a mobile device executing computer program instructions, e.g. in a processor entity, either in hardware, or in a combination of software and hardware. The computer program instructions may be assembly instructions, instruction set architecture (Instruction Set Architecture, ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source or object code written in any combination of one or more programming languages.
The block diagrams of any logic flow in the figures of this application may represent program steps, or may represent interconnected logic circuits, modules, and functions, or may represent a combination of program steps and logic circuits, modules, and functions. The computer program may be stored on a memory. The Memory may be of any type suitable to the local technical environment and may be implemented using any suitable data storage technology, such as, but not limited to, read-Only Memory (ROM), random access Memory (Random Access Memory, RAM), optical Memory devices and systems (digital versatile Disk (Digital Video Disc, DVD) or Compact Disk (CD)), and the like. The computer readable medium may include a non-transitory storage medium. The data processor may be of any type suitable to the local technical environment, such as, but not limited to, general purpose computers, special purpose computers, microprocessors, digital signal processors (Digital Signal Processing, DSPs), application specific integrated circuits (Application Specific Integrated Circuit, ASICs), programmable logic devices (Field-Programmable Gate Array, FGPA), and processors based on a multi-core processor architecture.

Claims (11)

1. The video playing method is characterized by being applied to a cloud set top box and comprising the following steps of:
sending a small video playing instruction to a cloud platform;
under the condition that a small video playing instruction is received, the cloud platform determines a background color region group corresponding to each original UI frame in an EPG original UI media stream, wherein the background color region group is a largest group of regions containing small video UI background colors;
the cloud platform determines a corresponding original video playing area according to the background color area group;
the cloud platform sequentially sets the transparency of the original video playing area corresponding to each original UI frame to be fully transparent, and a corresponding UI media stream to be displayed is obtained;
the determining the corresponding original video playing area according to the background color area group comprises the following steps:
dividing each original UI frame in the original UI media stream in turn according to the integer division proportion to obtain a plurality of original subareas;
finding out a maximum group of original subareas which are continuous with the background color of the small video UI according to the width or length range in the original UI frame, and recording the maximum group of original subareas as the area range covered by the small video UI;
recording the coordinate value of the left upper corner in the background color region group, respectively extending and searching in the up-down, left-right directions, continuously searching the point with pixels being the background color of the small video UI, and determining the corresponding left upper corner coordinate and region size to obtain a corresponding original video playing region;
Receiving a UI media stream to be displayed, which is sent by the cloud platform;
determining a target video playing area corresponding to each current UI frame to be displayed in the UI media stream to be displayed, wherein the target video playing area is a full transparent area;
determining corresponding video resolution according to the first vertex position and the region size of the target video playing region;
sequentially overlapping the small videos to be played to the target video playing area, and playing the small videos to be played in the target video playing area according to the video resolution;
the determining a target video playing area corresponding to each current UI frame to be displayed in the UI media stream to be displayed includes:
sequentially extracting a current UI frame to be displayed in a UI media stream to be displayed, dividing the current UI frame to be displayed into a plurality of subareas, taking the subarea with the smallest coordinate value in all subareas of the current UI frame to be displayed as a target subarea, searching the plurality of subareas to the periphery according to the coordinate value of the target subarea, determining the position coordinates with the transparency being fully transparent in the plurality of subareas, and taking the fully transparent area in each UI frame to be displayed as a target video playing area corresponding to the current UI frame to be displayed;
The first vertex position is the position with the minimum coordinate value of the target video playing area;
the region size refers to the size of the target video playing region.
2. The method of claim 1, wherein the determining a target sub-region corresponding to each current UI frame to be displayed in the UI media stream to be displayed comprises:
sequentially extracting current UI frames to be displayed in the UI media stream to be displayed;
dividing the current UI frame to be displayed according to a preset rule to obtain a plurality of subareas;
and determining the coordinate value of each subarea, and taking the subarea with the smallest coordinate value as a target subarea.
3. The method according to claim 1, wherein the determining, according to the coordinate values of the target sub-regions, the target video playing region corresponding to each of the UI frames to be currently displayed includes:
sequentially searching and determining a plurality of subareas around the target subarea according to the coordinate values of the target subarea;
and determining a target video playing area corresponding to each current UI frame to be displayed according to the transparency of the plurality of subareas.
4. The method of claim 1, further comprising, prior to receiving the UI media stream to be displayed sent by the cloud platform:
Sending the received small video triggering instruction initiated by the user to a cloud platform;
receiving a broadcast control instruction fed back by the cloud platform;
a broadcast control request is sent to a content delivery network CDN;
and receiving a video to be played corresponding to the playing control request fed back by the CDN.
5. The video processing method is characterized by being applied to a cloud platform and comprising the following steps of:
under the condition that a small video playing instruction is received, determining a background color region group corresponding to each original UI frame in an EPG original UI media stream, wherein the background color region group is a largest group of regions containing small video UI background colors;
determining a corresponding original video playing area according to the background color area group;
setting the transparency of an original video playing area corresponding to each original UI frame to be fully transparent in sequence to obtain a corresponding UI media stream to be displayed;
the determining the corresponding original video playing area according to the background color area group comprises the following steps:
dividing each original UI frame in the original UI media stream in turn according to the integer division proportion to obtain a plurality of original subareas;
finding out a maximum group of original subareas which are continuous with the background color of the small video UI according to the width or length range in the original UI frame, and recording the maximum group of original subareas as the area range covered by the small video UI;
Recording the coordinate value of the left upper corner in the background color region group, respectively extending and searching in the up-down, left-right directions, continuously searching the point with pixels being the background color of the small video UI, and determining the corresponding left upper corner coordinate and region size to obtain a corresponding original video playing region;
transmitting the UI media stream to be displayed to the cloud set top box;
the cloud set top box receives a UI media stream to be displayed, which is sent by the cloud platform;
the cloud set top box determines a target video playing area corresponding to each current UI frame to be displayed in the UI media stream to be displayed, wherein the target video playing area is a full transparent area;
the cloud set top box determines corresponding video resolution according to the first vertex position and the region size of the target video playing region;
the cloud set top box sequentially superimposes the small videos to be played on the target video playing area, and plays the small videos to be played in the target video playing area according to the video resolution;
the determining a target video playing area corresponding to each current UI frame to be displayed in the UI media stream to be displayed includes:
sequentially extracting a current UI frame to be displayed in a UI media stream to be displayed, dividing the current UI frame to be displayed into a plurality of subareas, taking the subarea with the smallest coordinate value in all subareas of the current UI frame to be displayed as a target subarea, searching the plurality of subareas to the periphery according to the coordinate value of the target subarea, determining the position coordinates with the transparency being fully transparent in the plurality of subareas, and taking the fully transparent area in each UI frame to be displayed as a target video playing area corresponding to the current UI frame to be displayed;
The first vertex position is the position with the minimum coordinate value of the target video playing area;
the region size refers to the size of the target video playing region.
6. The method of claim 5, wherein determining the set of background color regions corresponding to each original UI frame in the EPG original UI media stream comprises:
dividing each original UI frame in the original UI media stream in turn according to a pre-rule to obtain a plurality of original subareas;
and searching the plurality of original subareas according to preset search conditions to obtain a background color area group corresponding to each original UI frame, wherein the preset search conditions are areas containing UI background colors.
7. The method of claim 5, further comprising, prior to the receiving the small video play instruction:
receiving a video trigger instruction carrying a broadcast control message;
generating a corresponding broadcast control instruction according to the broadcast control message in the video trigger instruction;
and feeding the broadcasting control instruction back to the cloud set top box.
8. A video playing device, characterized in that it is applied to a cloud platform, comprising:
the third determining module is configured to determine a background color region group corresponding to each original UI frame in the EPG original UI media stream, where the background color region group is a largest group of regions including a background color of the small video UI, when receiving the small video playing instruction;
A fourth determining module, configured to determine a corresponding original video playing area according to the background color area group;
a fifth determining module, configured to set transparency of an original video playing area corresponding to each original UI frame to be fully transparent in sequence, so as to obtain a corresponding UI media stream to be displayed;
the fourth determining module is specifically configured to divide each original UI frame in the original UI media stream in turn according to an integer division ratio, so as to obtain a plurality of original sub-areas; finding out a maximum group of original subareas which are continuous with the background color of the small video UI according to the width or length range in the original UI frame, and recording the maximum group of original subareas as the area range covered by the small video UI; recording the coordinate value of the left upper corner in the background color region group, respectively extending and searching in the up-down, left-right directions, continuously searching the point with pixels being the background color of the small video UI, and determining the corresponding left upper corner coordinate and region size to obtain a corresponding original video playing region;
the device is also applied to a cloud set top box, and comprises:
the third sending module is used for sending a video playing instruction to the cloud platform;
the first receiving module is used for receiving the UI media stream to be displayed, which is sent by the cloud platform;
the first determining module is configured to determine a target video playing area corresponding to each current UI frame to be displayed in the UI media stream to be displayed, wherein the target video playing area is a full transparent area;
The second determining module is used for determining the corresponding video resolution according to the first vertex position and the region size of the target video playing region;
the playing module is used for sequentially overlapping the small videos to be played to the target video playing area and playing the small videos to be played in the target video playing area according to the video resolution;
the first determining module is specifically configured to sequentially extract a current UI frame to be displayed in a UI media stream to be displayed, divide the current UI frame to be displayed into a plurality of sub-areas, take the sub-area with the smallest coordinate value in all the sub-areas of the current UI frame to be displayed as a target sub-area, search the plurality of sub-areas to the periphery according to the coordinate value of the target sub-area, determine the position coordinates with full transparency in the plurality of sub-areas, and take the full transparent area in each UI frame to be displayed as a target video playing area corresponding to the current UI frame to be displayed;
the first vertex position is the position with the minimum coordinate value of the target video playing area;
the region size refers to the size of the target video playing region.
9. A clouded set top box, the clouded set top box comprising: a memory, and one or more processors;
The memory is configured to store one or more programs;
when executed by the one or more processors, causes the one or more processors to implement the video playback method of any one of claims 1-4.
10. A cloud platform, the cloud platform comprising: the cloud set top box authentication system, the virtual machine control system and one or more virtual processor systems;
the cloud set top box authentication system is set to authenticate the cloud set top box;
the virtual machine control system is arranged to allocate a corresponding virtual processor system to the cloud set top box;
the virtual processor system is arranged to receive a video trigger instruction of the cloud set top box and feed back a processing result of the video trigger instruction to the cloud set top box;
upon receiving one or more video trigger instructions, causing one or more of the virtual processor systems to implement the video processing method of any one of claims 5-7.
11. A storage medium storing a computer program which, when executed by a processor, implements the video playback method of any one of claims 1 to 4 or implements the video processing method of any one of claims 5 to 7.
CN201910935351.4A 2019-09-29 2019-09-29 Video playing and processing method and device, cloud set top box, cloud platform and medium Active CN112584195B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910935351.4A CN112584195B (en) 2019-09-29 2019-09-29 Video playing and processing method and device, cloud set top box, cloud platform and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910935351.4A CN112584195B (en) 2019-09-29 2019-09-29 Video playing and processing method and device, cloud set top box, cloud platform and medium

Publications (2)

Publication Number Publication Date
CN112584195A CN112584195A (en) 2021-03-30
CN112584195B true CN112584195B (en) 2023-06-09

Family

ID=75111268

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910935351.4A Active CN112584195B (en) 2019-09-29 2019-09-29 Video playing and processing method and device, cloud set top box, cloud platform and medium

Country Status (1)

Country Link
CN (1) CN112584195B (en)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102307318A (en) * 2011-03-18 2012-01-04 海尔集团公司 Method and system for processing network video through network television
KR101268112B1 (en) * 2012-01-26 2013-05-29 주식회사 오비고 Method, apparatus and computer-readable recording medium for playing video contained in wep page
CN103297855A (en) * 2012-03-02 2013-09-11 腾讯科技（深圳）有限公司 Application display method and terminal
CN103596053A (en) * 2013-11-18 2014-02-19 深圳创维数字技术股份有限公司 Method and terminal for PIP playing
CN105446585A (en) * 2014-08-29 2016-03-30 优视科技有限公司 Video display method and device of Android intelligent terminal browser
CN106131686A (en) * 2016-06-27 2016-11-16 北京奇虎科技有限公司 Utilize video play mode changing method and the device of parasitic tool kit realization
CN106998479A (en) * 2016-01-22 2017-08-01 中兴通讯股份有限公司 A kind of methods, devices and systems for realizing set top box cloud
CN107404663A (en) * 2017-06-06 2017-11-28 晨星半导体股份有限公司 A kind of terminal device of television program playing method and correlation
CN109729417A (en) * 2019-03-28 2019-05-07 深圳市酷开网络科技有限公司 A kind of video-see play handling method, smart television and storage medium

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102307318A (en) * 2011-03-18 2012-01-04 海尔集团公司 Method and system for processing network video through network television
KR101268112B1 (en) * 2012-01-26 2013-05-29 주식회사 오비고 Method, apparatus and computer-readable recording medium for playing video contained in wep page
CN103297855A (en) * 2012-03-02 2013-09-11 腾讯科技（深圳）有限公司 Application display method and terminal
CN103596053A (en) * 2013-11-18 2014-02-19 深圳创维数字技术股份有限公司 Method and terminal for PIP playing
CN105446585A (en) * 2014-08-29 2016-03-30 优视科技有限公司 Video display method and device of Android intelligent terminal browser
CN106998479A (en) * 2016-01-22 2017-08-01 中兴通讯股份有限公司 A kind of methods, devices and systems for realizing set top box cloud
CN106131686A (en) * 2016-06-27 2016-11-16 北京奇虎科技有限公司 Utilize video play mode changing method and the device of parasitic tool kit realization
CN107404663A (en) * 2017-06-06 2017-11-28 晨星半导体股份有限公司 A kind of terminal device of television program playing method and correlation
CN109729417A (en) * 2019-03-28 2019-05-07 深圳市酷开网络科技有限公司 A kind of video-see play handling method, smart television and storage medium

Also Published As

Publication number Publication date
CN112584195A (en) 2021-03-30

Similar Documents

Publication Publication Date Title
JP5725391B2 (en) Receiving apparatus and receiving method
US8955005B2 (en) Viewer behavior tracking using pattern matching and character recognition
US11023115B2 (en) Circular video player controls
US10225613B2 (en) Method and apparatus for video playing processing and television
US11765426B2 (en) Modifying playback of replacement content based on control messages
CN103546813A (en) Android platform based video preview method and smart television
US20210274262A1 (en) Multi-subtitle display method, intelligent terminal and storage medium
CN113965813B (en) Video playing method, system, equipment and medium in live broadcasting room
US11895370B2 (en) Modifying playback of replacement content responsive to detection of remote control signals that control a device providing video to the playback device
US11937026B2 (en) Responsive to detection of remote control signals that modify operation of the playback device
US9860600B2 (en) Display apparatus and control method thereof
CN111163343A (en) Method for recognizing pattern recognition code and display device
CN112584195B (en) Video playing and processing method and device, cloud set top box, cloud platform and medium
WO2018072184A1 (en) Generation of mosaic channels for ott live broadcasts
CN111586492A (en) Video playing method and device, client device and storage medium
CN113473175B (en) Content display method and display equipment
US10743057B2 (en) Broadcaster application remote control key handling
CN105120318A (en) Television interactive system interactive information display position selecting method
KR20200021817A (en) Clould tv control apparatus
KR20210142917A (en) Method and Apparatus for Controlling a Shopping Flash Card to be Displayed on Reproduced Images of a Broadcast Program
CN114979773A (en) Display device, video processing method, and storage medium
KR20220110574A (en) Information communication terminal device and display control method in the device
KR20140049439A (en) Contents service system, and intuitive user interface for providing contents connected with broadcast program
US20160044371A1 (en) System and method for channels zapping

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant