CN113055729B - Cloud set top box image differential processing method and device - Google Patents

Cloud set top box image differential processing method and device Download PDF

Info

Publication number
CN113055729B
CN113055729B CN201911378200.XA CN201911378200A CN113055729B CN 113055729 B CN113055729 B CN 113055729B CN 201911378200 A CN201911378200 A CN 201911378200A CN 113055729 B CN113055729 B CN 113055729B
Authority
CN
China
Prior art keywords
data
frame
alpha
top box
rgb
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911378200.XA
Other languages
Chinese (zh)
Other versions
CN113055729A (en
Inventor
龚素灵
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN201911378200.XA priority Critical patent/CN113055729B/en
Publication of CN113055729A publication Critical patent/CN113055729A/en
Application granted granted Critical
Publication of CN113055729B publication Critical patent/CN113055729B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/482—End-user interface for program selection
    • H04N21/4823—End-user interface for program selection using a channel name
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
    • H04N21/8153—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics comprising still images, e.g. texture, background image

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Graphics (AREA)
  • Human Computer Interaction (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The embodiment of the invention discloses a cloud set top box image differential processing method and device, which relate to the technical fields of multimedia terminals and cloud computing, and the method comprises the following steps: according to the key instruction from the set top box, acquiring a UI image of a user interface, and separating the UI image to obtain transparency ALPHA data; performing differential processing on the ALPHA data to obtain ALPHA differential data; and sending the ALPHA differential data to the set top box, so that the differential processing of the cloud set top box image ALPHA data is realized, the data transmission quantity is reduced, and the UI interface which is more cool and rich is rapidly and smoothly experienced on the set top box with limited performance is ensured.

Description

Cloud set top box image differential processing method and device
Technical Field
The invention relates to the technical field of multimedia terminals and cloud computing, in particular to a cloud set top box image differential processing method and device.
Background
With the development of large video services becoming mature, users have higher requirements on more cool UI (interface) and richer value added service experience. Some household set-top boxes are limited by insufficient hardware performance, complex software iteration and the like, and cannot experience diversified innovative services and intelligent UI interaction functions.
In order to solve the problem of huge video experience difference of users of new and old set top boxes, cloud intelligent set top boxes based on cloud computing and virtualization technologies are generated.
In the cloud set top box, as UI, service, game, etc. are deployed at the cloud, the picture is sent to the set top box for display in a desktop stream manner, which involves the processing of rgba (Red, green, blue and Alpha transparency color space) data. In order to ensure that the television picture is clear and smooth, has no delay and does not get stuck, rgba data, particularly Alpha data, need to be processed in an effective way.
Disclosure of Invention
The embodiment of the invention provides a cloud set top box image differential processing method and device, which at least solve the technical problems of large Alpha data volume and low transmission speed.
The embodiment of the invention provides a cloud set top box image differential processing method, which comprises the following steps:
according to the key instruction from the set top box, acquiring a UI image of a user interface, and separating the UI image to obtain transparency ALPHA data;
performing differential processing on the ALPHA data to obtain ALPHA differential data;
and sending the ALPHA differential data to the set top box so as to reduce the data transmission quantity.
Preferably, the performing differential processing on the ALPHA data to obtain ALPHA differential data includes:
For each frame of the UI image, determining whether the frame is a first frame;
if the frame is not the first frame, comparing the ALPHA data of the frame with the ALPHA data of the first frame to obtain ALPHA differential data of the frame.
Preferably, the comparing the ALPHA data of the frame with the ALPHA data of the first frame to obtain ALPHA differential data includes:
dividing the ALPHA data into N regions;
comparing the ALPHA data of one region of the frame with the ALPHA data of the corresponding region of the first frame, and if there are one or more pixel points with different ALPHA data, using the ALPHA data of the region as ALPHA differential data of the region;
The ALPHA differential data of all regions of the frame are combined into ALPHA differential data of the frame.
Preferably, said sending the ALPHA-differential data to the set top box includes:
judging whether the ALPHA differential data of the frame exceeds the appointed proportion of the ALPHA data of the frame;
If the result is not exceeded, the ALPHA differential data of the frame is compressed and sent to the set top box.
Preferably, the method further comprises:
separating red, green and blue RGB data from the UI image;
Performing differential processing on the RGB data to obtain RGB differential data;
and sending the RGB differential data to the set top box so as to reduce the data transmission quantity.
Preferably, the performing differential processing on the RGB data to obtain RGB differential data includes:
For each frame of the UI image, determining whether the frame is a first frame;
If the frame is not the first frame, comparing the RGB data of the frame with the RGB data of the first frame according to a preset sequence to obtain a boundary formed by different pixel points of the RGB data;
and taking RGB data of all pixel points in the area surrounded by the boundary as RGB differential data of the frame.
Preferably, the transmitting the RGB differential data to the set top box includes:
and splicing the RGB differential data of the frame with the ALPHA differential data of the frame, and then sending the spliced RGB differential data and the ALPHA differential data to the set top box.
The embodiment of the invention provides a cloud set top box image differential processing device, which comprises:
The acquisition module is used for acquiring a User Interface (UI) image according to a key instruction from the set top box and separating the UI image to obtain transparency ALPHA data;
the difference module is used for carrying out difference processing on the ALPHA data to obtain ALPHA difference data;
And the sending module is used for sending the ALPHA differential data to the set top box.
Preferably, the acquisition module is further used for separating red, green and blue RGB data from the UI image; the difference module is also used for carrying out difference processing on the RGB data to obtain RGB difference data; the sending module is also used for sending the RGB differential data to the set top box.
The embodiment of the invention provides a cloud set top box image differential processing device which comprises a memory, a processor and a computer program stored on the memory and capable of running on the processor, wherein the computer program realizes the steps of the cloud set top box image differential processing method when being executed by the processor.
The embodiment of the invention provides a computer readable medium, wherein a program for cloud set top box image differential processing is stored on the computer readable medium, and the cloud set top box image differential processing method comprises the steps that the cloud set top box image differential processing method is realized when the program for cloud set top box image differential processing is executed by a processor.
The embodiment of the invention provides a cloud set top box image differential processing method, device, equipment and computer readable medium, which are used for acquiring a User Interface (UI) image according to a key instruction from a set top box and separating transparency ALPHA data from the UI image; performing differential processing on the ALPHA data to obtain ALPHA differential data; and sending the ALPHA differential data to the set top box, so that the differential processing of the cloud set top box image ALPHA data is realized, the data transmission quantity is reduced, and the UI interface which is more cool and rich is rapidly and smoothly experienced on the set top box with limited performance is ensured.
Drawings
Fig. 1 is a schematic flowchart of a cloud set top box image differential processing method provided by an embodiment of the present invention;
FIG. 2 is a diagram of a cloud set top box system architecture;
fig. 3 is an overall frame diagram of a clouded set-top box;
FIG. 4 is an ALPHA channel superposition diagram;
fig. 5 is a flowchart of a cloud set top box showing an EPG (electronic program guide) common scene;
FIG. 6 is a schematic diagram of an RGB data differencing method;
FIG. 7 is a schematic diagram of an ALPHA data difference method;
FIG. 8 is a schematic diagram of the concatenation of RGB data and ALPHA data;
fig. 9 is a schematic structural diagram of a clouding set-top box image differential processing device provided by an embodiment of the invention;
Fig. 10 is a schematic structural diagram of a clouding set-top box image differential processing device provided by an embodiment of the present invention.
Detailed Description
The following detailed description of embodiments of the invention is provided in connection with the accompanying drawings, and it is to be understood that the embodiments described below are merely illustrative and explanatory of the invention, and are not restrictive of the invention.
Fig. 1 is a schematic flowchart of a method for processing image differences of a cloud set top box according to an embodiment of the present invention, where, as shown in fig. 1, the method may include:
Step S101: according to the key instruction from the set top box, acquiring a UI image of a user interface, and separating the UI image to obtain transparency ALPHA data;
step S102: performing differential processing on the ALPHA data to obtain ALPHA differential data;
step S103: and sending the ALPHA differential data to the set top box so as to reduce the data transmission quantity.
The embodiment of the invention solves the problems of larger data volume and slower transmission and decompression speed when the ALPHA data of each frame of image is directly compressed and transmitted by carrying out differential processing on the ALPHA data of each frame of image, thereby achieving the effects of reducing the data volume and improving the transmission and decompression speed.
Further, the performing differential processing on the ALPHA data to obtain ALPHA differential data includes: for each frame of the UI image, determining whether the frame is a first frame; if the frame is the first frame, the ALPHA data of the first frame is directly sent to the set top box, namely the ALPHA data of the first frame is sent in full quantity; if the frame is not the first frame, comparing the ALPHA data of the frame with the ALPHA data of the first frame to obtain ALPHA differential data of the frame, in one embodiment, dividing the ALPHA data into N regions, comparing the ALPHA data of one region of the frame with the ALPHA data of the corresponding region of the first frame, if there are one or more pixel points with different ALPHA data, using the ALPHA data of the region as the ALPHA differential data of the region, then combining the ALPHA differential data of all regions of the frame into ALPHA differential data of the frame, and transmitting the ALPHA differential data of the frame to the set top box.
Further, the sending the ALPHA-differential data to the set top box includes: and transmitting all the ALPHA differential data of the frame to the set top box, or compressing the ALPHA differential data of the frame and transmitting to the set top box when judging that the ALPHA differential data of the frame does not exceed the designated proportion of the ALPHA data of the frame. For the latter, if it is determined that the ALPHA-difference data of the frame exceeds the specified proportion of the ALPHA-data of the frame, the ALPHA-data of the frame is sent to the set top box, i.e. full-size transmission.
On the basis of the above embodiment, in order to further reduce the data size and increase the data transmission speed, the method may further perform differential processing on RGB data, and may include: separating red, green and blue RGB data from the UI image; performing differential processing on the RGB data to obtain RGB differential data; and sending the RGB differential data to the set top box so as to reduce the data transmission quantity.
Further, the performing differential processing on the RGB data to obtain RGB differential data includes: for each frame of the UI image, determining whether the frame is a first frame; if the frame is the first frame, the RGB data of the first frame is directly sent to the set top box, namely the RGB data of the first frame is sent in full quantity; if the frame is not the first frame, comparing the RGB data of the frame with the RGB data of the first frame according to a preset sequence, such as from left to right, from top to bottom, from right to left, from bottom to top, and the like, so as to obtain a boundary formed by different pixel points of the RGB data; and taking RGB data of all pixel points in the area surrounded by the boundary as RGB differential data of the frame.
Further, the sending the RGB differential data to the set top box includes: and splicing the RGB differential data of the frame with the ALPHA differential data of the frame, and then sending the spliced RGB differential data and the ALPHA differential data to the set top box.
The embodiment of the invention solves the problems of larger data volume and slower transmission and decompression speed when the RGB data of each frame image is directly transmitted in video coding by carrying out differential processing on the RGB data of each frame image, thereby achieving the effects of reducing the data volume and improving the transmission speed.
According to the embodiment of the invention, the cloud set top box is used for displaying the desktop stream, and a main channel, an input channel, a display channel and other data transmission channels are established between the set top box and the cloud; then the set top box controls the remote controller, and the keys are transmitted into the cloud end through the input channel; after carrying out RGB difference and ALPHA difference processing on the UI picture, the cloud end sends the processed UI picture to the set top box through a data transmission channel in a mode of splicing ALPHA data packets in an RGB data streaming mode (such as an h264 video coding mode, but not limited to the mode); after receiving the data, the STB separates h264 stream and ALPHA data. The h264 stream is decoded, rendered and displayed, and then the ALPHA data is decoded out for superposition display.
The present invention will be described in detail with reference to fig. 2 to 7.
Fig. 2 is a diagram of a cloud set top box system, and as shown in fig. 2, the cloud set top box system mainly comprises three parts of a virtual machine, a cloud platform server and a physical set top box.
1. Physical set top box: the client runs in the physical set top box and is mainly responsible for establishing a channel with the cloud end to communicate remote control
And processing and displaying the UI stream sent by the cloud end according to the key instruction of the device or the handle.
2. Cloud platform server: is used for virtualizing various virtual machines and is in communication with clients and virtual machines.
3. Virtual machine: the virtual machine is a virtual machine which is virtualized by a cloud platform, can be a system of win7, and can also be linux or
The virtual machine agent is an extension running in the virtual machine in android X86 system.
Fig. 3 is an overall frame diagram of a clouded set-top box, as shown in fig. 3, including a clouded set-top box (tSTB), a cloud platform portal, a cloud platform, a CDN (content delivery network), and an SP platform, the interaction process may be as follows:
1) The cloud set top box (tSTB) initiates authentication to the cloud platform portal and requests to allocate virtual machine resources;
2) The cloud platform distributes virtual machines;
3) tSTB is connected with a virtual machine, and a vSTB (cloud) desktop connection channel is established;
4) Inputting an operation instruction by a user key;
5) The cloud service responds to the user key and displays the UI.
6) And after the cloud performs fluidization, compression and other treatments on the UI interface, the UI interface is sent to tSTB.
7) TSTB decompresses, decodes, renders and displays the UI stream. tSTB may support both playback of the video stream and display of the UI stream.
Fig. 4 is an ALPHA channel superposition diagram, as shown in fig. 4, involving a virtual set top box and a physical set top box, the superposition process may be as follows:
1) The physical set top box plays the video;
2) The UI layer of the virtual machine side displays, carries the ALPHA data and sends the ALPHA data to the physical side;
3) And the physical end superimposes the UI layer with the ALPHA transparency on the video layer through the cloud desktop client end for display.
From the above embodiment of cloud set top box UI desktop stream display, it can be seen that receiving a response from the set top box key to the cloud end and then displaying the UI desktop stream to the set top box is an end-to-end process. The process involves the processes of compressing, transmitting, decompressing and the like of data, and if the RGB full data and the ALPHA full data are adopted, the process is time-consuming, even obvious phenomenon of jamming and unsmooth occurs, and the experience of users is seriously affected. Therefore, the end-to-end delay must be strictly controlled within a range where the user perception is not obvious, so as to ensure that the requirement of user experience is met. Therefore, the invention mainly provides a method for carrying out ALPHA differential processing on the cloud set top box image, and also provides a method for carrying out RGB differential processing on the cloud set top box image, which is used for solving the problems of unsmooth picture, blocking and the like caused by overlarge end-to-end time delay in a cloud set top box system. The differential method can be multiple, one typical differential method is as follows, 1) the cloud separates rgba data into rgb data and alpha data, and differential processing is performed respectively; 2) rgb data differencing: and traversing the pixel points of the current frame and the first frame to obtain a minimum area containing all difference data, which is called rgb increment data. Then video coding is carried out on the rgb increment data, such as h264; 3) alpha data differencing: and dividing the alpha data of the current frame and the first frame into N small areas for comparison. And (3) putting the whole small area of the single small area into an alpha increment queue as long as the data of one pixel point is different. Thus, a group of alpha increment data which are arranged according to a certain sequence and rule is obtained; 4) And splicing the alpha incremental data behind the xh264 data, and transmitting the alpha incremental data to a cloud desktop client of the set top box.
Fig. 5 is a flowchart of a conventional scene of a cloud set top box displaying an EPG (electronic program guide), and as shown in fig. 5, the method may include the following steps:
1) The user opens the set-top box;
2) tSTB (physical set top box) initiates authentication to the cloud platform management portal to request to allocate virtual machine resources;
3) vSTB (cloud) management platform distributes virtual machines;
4) tSTB is connected with a virtual machine to establish vSTB desktop connection channels;
5) tSTB triggering and starting virtual machine side service authentication through a main channel, and notifying an in-virtual machine service APK to start authentication after the virtual agent receives the message;
6) The user operates the key of the set top box;
7) The keys are transmitted to the cloud server through the input channel and then to the virtual machine;
8) The service application in the virtual machine receives the page response after the key, and displays the EPG;
9) The android system processes the image to obtain RGBA data of the image, and the RGBA data is placed in a memory cache region of the display card;
10 The cloud performs differential processing on RGBA data, and separates RGB data and ALPHA data from RGBA data. Video encoding (such as h 264) is carried out on the RGB incremental data, the ALPHA incremental data is compressed, and the ALPHA incremental data is spliced behind the xh264 data and is used as a frame data to be sent to the client of the physical set top box.
11 After receiving the data, the cloud desktop client decodes the h264 data to obtain YUV (color coding method) data, converts the YUV data into RGB data through a system interface, and compares, renders and displays the RGB data with the data of the first frame. Then decompresses the ALPHA data, and displays the data in superposition.
In the above workflow, the differential processing of RGB data and the differential processing of ALPHA data are involved, and specific embodiments of these two processes are described below.
Fig. 6 is a schematic diagram of an RGB data differentiating method, as shown in fig. 6, the process is as follows:
1) Each cell in the figure represents a pixel, denoted P1, P2, P3. The small dots represent pixels of the current frame that are not identical to the RGB data of the first frame.
2) When the cloud acquires the RGB data of the first frame, differential processing is not performed, and full data is sent to the client.
3) When the cloud acquires RGB data of a non-first frame, comparing the RGB data of the current frame with the RGB data of the first frame.
4) Traversing and comparing are carried out according to a certain sequence, such as a mode of left to right, top to bottom and the like, and the upper, lower, left and right boundaries of the increment area are determined.
5) A minimum rectangular area containing all delta data, namely delta RGB data (i.e., the aforementioned RGB differential data) is obtained.
6) The RGB delta data is video encoded, such as h264 encoding, etc.
It should be noted that, RGB data of all pixels having differences in RGB data of the non-first frame may be used as incremental RGB data, but since RGB data of each pixel needs to be compared, the comparison throughput is increased, and the data processing speed is reduced, so that the embodiment of the present invention adopts a "traversal comparison according to a certain order, such as a manner of determining upper, lower, left and right boundaries of the incremental area from left to right, from top to bottom, etc., and after the boundaries are compared, RGB numbers of other pixel points in a rectangular area enclosed by the boundaries do not need to be compared any more, the comparison throughput is reduced, and the data processing speed is accelerated.
FIG. 7 is a schematic diagram of an ALPHA data difference method, as shown in FIG. 7, the process is as follows:
1) Each cell in the figure represents a pixel, denoted P1, P2, P3, &.. Pmxn; each slightly larger square represents an area (e.g., A1, as) and the dots represent pixels of the current frame that differ from the first frame of ALPHA data.
2) When the cloud acquires the first frame of ALPHA data, differential processing is not performed, and the total data is sent to the client.
3) When the cloud acquires non-first frame ALPHA data, comparing the current frame ALPHA data with the first frame ALPHA data.
4) The ALPHA data is divided into N regions (e.g., 8x8 regions) and the pixel points are traversed. During traversing, a mode of taking one point by a plurality of pixels (for example, taking one point by four pixels) is adopted for sampling, so that the traversing speed is increased. If the ALPHA data of any sampling point in the area A2 is different, the data of the whole area A2 is put into an ALPHA increment list. Similarly, the entire region block is placed in the ALPHA delta list in order as long as the data of one sampling point in the region is different. As shown in FIG. 7, the ALPHA delta list is A2A3A4A5. When the ALPHA increment data (i.e. the above ALPHA difference data) exceeds a certain ratio (such as one third of ALPHA data), the comparison is no longer performed, and the total data is directly sent to the client.
FIG. 8 is a schematic diagram of the concatenation of RGB data and ALPHA data, and as shown in FIG. 8, the concatenation of processed RGB delta data and ALPHA delta data is described:
1) The first part is an identification bit indicating whether the full amount of data or the incremental data.
2) The second part is RGB delta data, such as an h264 bitstream.
3) The third part is ALPHA increment data, and is composed of region size of increment data and region data.
4) The cloud transmits the data to the client together in a frame code stream mode.
5) After receiving the code stream, the client separates out h264 code stream and ALPHA increment data.
6) The client decodes (e.g. mediaCodec hard decodes) the h264 data to obtain YUV data, converts the YUV data into RGB data through a rendering interface (e.g. openGL) of the android system, compares the RGB data with the first frame full data, and then renders and displays the RGB data.
7) The client decompresses to obtain ALPHA increment data, and displays the ALPHA increment data after comparing with the first frame total data.
Fig. 9 is a schematic structural diagram of an image difference processing device of a cloud set top box according to an embodiment of the present invention, where, as shown in fig. 9, the device includes:
An obtaining module 91, configured to obtain a UI image of the user interface according to a key instruction from the set-top box, and separate the UI image to obtain transparency ALPHA data;
a difference module 92 for performing difference processing on the ALPHA data to obtain ALPHA difference data;
And a sending module 93, configured to send the ALPHA differential data to the set top box.
The difference module 92 of the embodiment of the invention solves the problems of larger data volume and slower transmission and decompression speed when the ALPHA data of each frame image is directly compressed and transmitted by carrying out difference processing on the ALPHA data of each frame image, thereby achieving the effects of reducing the data volume and improving the transmission and decompression speed.
Further, for each frame of the UI image, judging whether the frame is a first frame; if the frame is the first frame, the difference module 92 does not perform the difference processing, and the sending module 93 directly sends the ALPHA data of the first frame to the set top box, that is, performs full transmission on the ALPHA data of the first frame; if the frame is not the first frame, the difference module 92 compares the ALPHA data of the frame with the ALPHA data of the first frame to obtain ALPHA differential data of the frame, in one embodiment, the ALPHA data may be divided into N regions, the ALPHA data of one region of the frame is compared with the ALPHA data of the corresponding region of the first frame, if there are one or more pixel points with different ALPHA data at the specified position, the ALPHA data of the region is used as the ALPHA differential data of the region, then the ALPHA differential data of all regions of the frame are combined into the ALPHA differential data of the frame, and the transmission module 93 transmits the ALPHA differential data of the frame to the set top box.
Further, the transmitting module 93 may transmit all the ALPHA-difference data of the frame to the set-top box, or transmit the ALPHA-difference data of the frame to the set-top box after compressing only when it is determined that the ALPHA-difference data of the frame does not exceed the specified proportion of the ALPHA-difference data of the frame. For the latter, that is, when it is judged that the ALPHA differential data of the frame exceeds the specified proportion of the ALPHA data of the frame, the ALPHA data of the frame is transmitted to the set-top box, that is, full-size transmission, by the transmission module 93.
On the basis of the above embodiment, in order to further reduce the data volume and increase the data transmission speed, the acquisition module may be further configured to separate the RGB data from the UI image to obtain the RGB data; the difference module can also be used for carrying out difference processing on the RGB data to obtain RGB difference data; the sending module may be further configured to send the RGB differential data to the set top box.
Further, for each frame of the UI image, it is determined whether the frame is the first frame; if the frame is the first frame, the difference module 92 does not perform the difference processing, but the sending module 93 directly sends the RGB data of the first frame to the set top box, that is, the RGB data of the first frame is sent in full; if the frame is not the first frame, the difference module 93 compares the RGB data of the frame with the RGB data of the first frame in a predetermined order, for example, from left to right, from top to bottom, from right to left, from bottom to top, and so on, to obtain a boundary formed by different pixels of the RGB data; and taking RGB data of all pixel points in the area surrounded by the boundary as RGB differential data of the frame.
Further, the transmitting module 93 splices the RGB differential data of the frame with the ALPHA differential data of the frame and transmits the spliced RGB differential data and the ALPHA differential data to the set top box.
The difference module 92 of the embodiment of the invention solves the problems of larger data volume and slower transmission and decompression speeds when the RGB data of each frame image is directly transmitted in video coding by carrying out difference processing on the RGB data of each frame image, thereby achieving the effects of reducing the data volume and improving the transmission speed.
Fig. 10 is a schematic structural diagram of a clouding set-top box image difference processing device provided by the embodiment of the present invention, as shown in fig. 10, the device may include a memory 20, a processor 10, and a computer program stored in the memory 20 and capable of running on the processor 10, where the computer program implements the steps of the clouding set-top box image difference processing method when executed by the processor 10. The memory 20 may be RAM, ROM, EEPROM, flash memory, or any other medium that can be used to store the desired information and that can be accessed by a computer. The processor 10 may be a central processing unit, a digital signal processor or a microprocessor or the like.
The embodiment of the invention also provides a computer readable medium, on which a program for performing image difference processing on the cloud set top box is stored, and the method for performing image difference processing on the cloud set top box is realized when the program for performing image difference processing on the cloud set top box is executed by a processor. Those of ordinary skill in the art will appreciate that all or some of the steps, systems, functional modules/units in the apparatus, and methods disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. In a hardware implementation, the division between the functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be performed cooperatively by several physical components. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). The term computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data, as known to those skilled in the art. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital Versatile Disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a computer. Furthermore, as is well known to those of ordinary skill in the art, communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media.
In summary, after the processing of the rgb difference and the alpha difference, the embodiment of the invention can achieve the following effects: 1) The occupancy rate of the CPU is reduced; 2) The efficiency of data transmission is improved; 3) The speed of data compression and decompression is improved; 4) And the smoothness of the picture display is improved.
Although the present invention has been described in detail hereinabove, the present invention is not limited thereto and various modifications may be made by those skilled in the art in accordance with the principles of the present invention. Therefore, all modifications made in accordance with the principles of the present invention should be understood as falling within the scope of the present invention.

Claims (9)

1. The cloud set top box image differential processing method is characterized by comprising the following steps of:
according to the key instruction from the set top box, acquiring a UI image of a user interface, and separating the UI image to obtain transparency ALPHA data;
For each frame of the UI image, determining whether the frame is a first frame;
Dividing the ALPHA data into N regions if the frame is not the first frame;
comparing the ALPHA data of one region of the frame with the ALPHA data of the corresponding region of the first frame, and if there are one or more pixel points with different ALPHA data, using the ALPHA data of the region as ALPHA differential data of the region;
Combining the ALPHA differential data of all regions of the frame into ALPHA differential data of the frame;
and sending the ALPHA differential data to the set top box so as to reduce the data transmission quantity.
2. The method of claim 1, wherein said transmitting the ALPHA-differential data to the set top box comprises:
judging whether the ALPHA differential data of the frame exceeds the appointed proportion of the ALPHA data of the frame;
If the result is not exceeded, the ALPHA differential data of the frame is compressed and sent to the set top box.
3. The method according to any one of claims 1-2, wherein the method further comprises:
separating red, green and blue RGB data from the UI image;
Performing differential processing on the RGB data to obtain RGB differential data;
and sending the RGB differential data to the set top box so as to reduce the data transmission quantity.
4. A method according to claim 3, wherein the differential processing of the RGB data to obtain RGB differential data comprises:
For each frame of the UI image, determining whether the frame is a first frame;
If the frame is not the first frame, comparing the RGB data of the frame with the RGB data of the first frame according to a preset sequence to obtain a boundary formed by different pixel points of the RGB data;
and taking RGB data of all pixel points in the area surrounded by the boundary as RGB differential data of the frame.
5. The method of claim 4, wherein said sending the RGB differential data to the set top box comprises:
and splicing the RGB differential data of the frame with the ALPHA differential data of the frame, and then sending the spliced RGB differential data and the ALPHA differential data to the set top box.
6. A clouding set-top box image differential processing device, the device comprising:
The acquisition module is used for acquiring a User Interface (UI) image according to a key instruction from the set top box and separating the UI image to obtain transparency ALPHA data;
The difference module is used for judging whether each frame of the UI image is a first frame or not; dividing the ALPHA data into N regions if the frame is not the first frame; comparing the ALPHA data of one region of the frame with the ALPHA data of the corresponding region of the first frame, and if there are one or more pixel points with different ALPHA data, using the ALPHA data of the region as ALPHA differential data of the region; combining the ALPHA differential data of all regions of the frame into ALPHA differential data of the frame;
And the sending module is used for sending the ALPHA differential data to the set top box.
7. The apparatus of claim 6, wherein the device comprises a plurality of sensors,
The acquisition module is also used for separating red, green and blue RGB data from the UI image;
the difference module is also used for carrying out difference processing on the RGB data to obtain RGB difference data;
the sending module is also used for sending the RGB differential data to the set top box.
8. A clouding set-top box image difference processing device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the computer program when executed by the processor implements the steps of the clouding set-top box image difference processing method according to any one of claims 1 to 5.
9. A computer-readable medium, characterized in that a program for cloud set-top box image difference processing is stored thereon, which when executed by a processor, implements the steps of the cloud set-top box image difference processing method according to any one of claims 1 to 5.
CN201911378200.XA 2019-12-27 2019-12-27 Cloud set top box image differential processing method and device Active CN113055729B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911378200.XA CN113055729B (en) 2019-12-27 2019-12-27 Cloud set top box image differential processing method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911378200.XA CN113055729B (en) 2019-12-27 2019-12-27 Cloud set top box image differential processing method and device

Publications (2)

Publication Number Publication Date
CN113055729A CN113055729A (en) 2021-06-29
CN113055729B true CN113055729B (en) 2024-05-28

Family

ID=76506770

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911378200.XA Active CN113055729B (en) 2019-12-27 2019-12-27 Cloud set top box image differential processing method and device

Country Status (1)

Country Link
CN (1) CN113055729B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102231834A (en) * 2011-06-27 2011-11-02 深圳市茁壮网络股份有限公司 Animated portable network graphics (APNG) file processing method and device for digital television system
CN102520898A (en) * 2011-11-18 2012-06-27 惠州华阳通用电子有限公司 Processing method for embedded operating system sequence diagrams
CN104966309A (en) * 2015-06-25 2015-10-07 桂林力港网络科技有限公司 Automatic compression system and processing method for image with transparency
CN105760238A (en) * 2016-01-29 2016-07-13 腾讯科技（深圳）有限公司 Graphic instruction data processing method, device and system
CN106998479A (en) * 2016-01-22 2017-08-01 中兴通讯股份有限公司 A kind of methods, devices and systems for realizing set top box cloud
CN107241563A (en) * 2017-06-16 2017-10-10 深圳天珑无线科技有限公司 Method, intelligent mobile terminal and the device with store function of transmission of video
CN109510990A (en) * 2018-10-25 2019-03-22 深圳市腾讯信息技术有限公司 Image processing method and device, computer readable storage medium, electronic equipment
CN110113617A (en) * 2019-06-13 2019-08-09 腾讯科技（深圳）有限公司 A kind of method and device of compression of images and decompression

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9229734B2 (en) * 2010-01-15 2016-01-05 Guest Tek Interactive Entertainment Ltd. Hospitality media system employing virtual user interfaces
CN104754179B (en) * 2013-12-31 2017-11-07 澜起科技（上海）有限公司 The fully-automated synthesis method and system of static nature information in dynamic image

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102231834A (en) * 2011-06-27 2011-11-02 深圳市茁壮网络股份有限公司 Animated portable network graphics (APNG) file processing method and device for digital television system
CN102520898A (en) * 2011-11-18 2012-06-27 惠州华阳通用电子有限公司 Processing method for embedded operating system sequence diagrams
CN104966309A (en) * 2015-06-25 2015-10-07 桂林力港网络科技有限公司 Automatic compression system and processing method for image with transparency
CN106998479A (en) * 2016-01-22 2017-08-01 中兴通讯股份有限公司 A kind of methods, devices and systems for realizing set top box cloud
CN105760238A (en) * 2016-01-29 2016-07-13 腾讯科技（深圳）有限公司 Graphic instruction data processing method, device and system
CN107241563A (en) * 2017-06-16 2017-10-10 深圳天珑无线科技有限公司 Method, intelligent mobile terminal and the device with store function of transmission of video
CN109510990A (en) * 2018-10-25 2019-03-22 深圳市腾讯信息技术有限公司 Image processing method and device, computer readable storage medium, electronic equipment
CN110113617A (en) * 2019-06-13 2019-08-09 腾讯科技（深圳）有限公司 A kind of method and device of compression of images and decompression

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
面向云计算的机顶盒终端设计和实现方法研究;冯海亮;王丰;王玮宏;施玉海;;广播电视信息;20121215(12);全文 *

Also Published As

Publication number Publication date
CN113055729A (en) 2021-06-29

Similar Documents

Publication Publication Date Title
CN110446041B (en) Video encoding and decoding method, device, system and storage medium
CN112040233B (en) Video encoding method, video decoding method, video encoding device, video decoding device, electronic device, and storage medium
CN109040792B (en) Processing method for video redirection, cloud terminal and cloud desktop server
US20160134881A1 (en) Parallel media encoding
KR101962990B1 (en) Low-complexity remote presentation session encoder
EP3177024B1 (en) Apparatus for cloud streaming service
US10142707B2 (en) Systems and methods for video streaming based on conversion of a target key frame
KR101805550B1 (en) Image data encoding method for presentation virtualization and server therefor
CN110582012B (en) Video switching method, video processing device and storage medium
EP3410302B1 (en) Graphic instruction data processing method, apparatus
CN111263243B (en) Video coding method and device, computer readable medium and electronic equipment
WO2019228207A1 (en) Image encoding and decoding method , related device and storage medium
CN115190345B (en) Coordinated control method for display media, client device and storage medium
CN111031032A (en) Cloud video transcoding method and device, decoding method and device, and electronic device
US10462200B2 (en) System for cloud streaming service, method for still image-based cloud streaming service and apparatus therefor
KR101843411B1 (en) System for cloud streaming service, method of image cloud streaming service based on transparency of image and apparatus for the same
CN113055729B (en) Cloud set top box image differential processing method and device
CN106575423B (en) Broadcast link service based on cloud streaming media, broadcast link service client device, and trigger content providing server
KR102273141B1 (en) System for cloud streaming service, method of cloud streaming service using still image compression technique and apparatus for the same
CN115174917A (en) H264-based video display method and device
CN115225902A (en) High-resolution VR cloud game solution method based on scatter coding and computer equipment
CN115022725A (en) Video playing method and device
CN115920372A (en) Data processing method and device, computer readable storage medium and terminal
CN113038277B (en) Video processing method and device
KR102429225B1 (en) Method and device for transmitting remote screens

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant