WO2020134592A1 - 一种实现画中画的方法、装置和机顶盒 - Google Patents

一种实现画中画的方法、装置和机顶盒 Download PDF

Info

Publication number
WO2020134592A1
WO2020134592A1 PCT/CN2019/115625 CN2019115625W WO2020134592A1 WO 2020134592 A1 WO2020134592 A1 WO 2020134592A1 CN 2019115625 W CN2019115625 W CN 2019115625W WO 2020134592 A1 WO2020134592 A1 WO 2020134592A1
Authority
WO
WIPO (PCT)
Prior art keywords
picture
window
video
layer
top box
Prior art date
Application number
PCT/CN2019/115625
Other languages
English (en)
French (fr)
Inventor
宋玉林
朱兴昌
张维
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Publication of WO2020134592A1 publication Critical patent/WO2020134592A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window

Definitions

  • Embodiments of the present disclosure relate to, but are not limited to, a method, device, and set-top box for implementing picture-in-picture.
  • PIP picture-in-picture
  • the picture-in-picture window is associated with the set-top box application. If the user switches the application or the video application switches the page, the current picture-in-picture video playback will inevitably stop. In addition, the picture-in-picture video playback is triggered by the set-top box applications. Without these set-top box applications, the current video channel playback cannot be played.
  • Embodiments of the present disclosure provide a method, device, and set-top box for implementing picture-in-picture.
  • An embodiment of the present disclosure provides a method for implementing picture-in-picture, including:
  • a floating picture-in-picture window independent of the current application of the set-top box is displayed on the window of the current application of the set-top box.
  • An embodiment of the present disclosure also provides an apparatus for implementing picture-in-picture, including:
  • the receiving unit is configured to receive a request to open a picture-in-picture
  • the presentation unit is configured to present a suspended picture-in-picture window independent of the current application of the set-top box based on the request on the window of the current application of the set-top box.
  • An embodiment of the present disclosure also provides a set-top box, including: a memory, a processor, and a computer program stored on the memory and executable on the processor, and the processor implements the program to implement the method of implementing picture-in-picture .
  • Embodiments of the present disclosure also provide a computer-readable storage medium that stores computer-executable instructions, and the computer-executable instructions are executed to implement the method for implementing picture-in-picture.
  • Figure 1 is a schematic diagram of the set-top box system architecture.
  • Figure 2 shows the first scenario of picture-in-picture.
  • Figure 3 shows the second scenario of picture-in-picture.
  • FIG. 4 is a flowchart of a method for implementing picture-in-picture according to an embodiment of the present disclosure.
  • FIG. 5 is a schematic diagram of a set-top box layer according to an embodiment of the present disclosure.
  • FIG. 6 is a schematic diagram of watching a suspended video channel playing on a set-top box application according to an embodiment of the present disclosure.
  • FIG. 7 is a flowchart of displaying the suspended picture-in-picture window through the integrated layer according to an embodiment of the present disclosure.
  • FIG. 8 is a flowchart of determining which layer to display the content to be displayed according to the layer identifier according to an embodiment of the present disclosure.
  • FIG. 9 is a flowchart of adjusting the picture-in-picture window attribute (contents include video) of an embodiment of the present disclosure.
  • FIG. 10 is a flowchart (contents including pages) of adjusting the picture-in-picture window attribute according to an embodiment of the present disclosure.
  • FIG. 11 is a flowchart of closing a picture-in-picture according to an embodiment of the present disclosure.
  • FIG. 12 is a flowchart of switching from a picture-in-picture window to a currently active application window of a set-top box according to an embodiment of the present disclosure.
  • FIG. 13 is a flowchart of video switching according to an embodiment of the present disclosure.
  • FIG. 14 is a schematic diagram of the module composition of a set-top box according to an embodiment of the present disclosure.
  • 15 is a flowchart of starting video playback or interactive display according to an embodiment of the present disclosure.
  • 16 is a flowchart of creating an integrated layer according to an embodiment of the present disclosure.
  • 17 is a flowchart of a picture-in-picture video playback process according to an embodiment of the present disclosure.
  • FIG. 18 is a flowchart of generating and querying picture-in-picture video information according to an embodiment of the present disclosure.
  • FIG. 19 is a flowchart of changing the attributes of a video playback window according to an embodiment of the present disclosure.
  • FIG. 20 is a flowchart of attribute change of an interactive display window according to an embodiment of the present disclosure.
  • FIG. 21 is a flowchart of video playback video switching according to an embodiment of the present disclosure.
  • 22 is a flowchart of closing the picture-in-picture video playback according to an embodiment of the present disclosure.
  • FIG. 23 is a flowchart of closing an interactive picture-in-picture display according to an embodiment of the present disclosure.
  • FIG. 24 is a flowchart of switching from a picture-in-picture layer to a layer of a currently active application window according to an embodiment of the present disclosure.
  • FIG. 25 is a timing diagram of a picture-in-picture playback video of an application example of the present disclosure.
  • FIG. 26 is a timing diagram of an interactive picture-in-picture display of an application example of the present disclosure.
  • FIG. 27 is a schematic diagram of the composition of a picture-in-picture device according to an embodiment of the present disclosure.
  • FIG. 28 is a schematic diagram of the composition of a set-top box according to an embodiment of the present disclosure.
  • the set-top box system architecture includes: a remote controller 11, a set-top box 12 and a TV 13.
  • the remote controller 11 receives the user's key instruction, converts the key instruction into a corresponding request and sends it to the set-top box 12, and the set-top box 12 displays the corresponding image through the TV 13 according to the received request.
  • the set-top box 12 may also have buttons, and the set-top box 12 may also directly perform corresponding processing according to the received key information.
  • the set-top box layer is generally divided into two layers, namely the video layer and the page layer.
  • the set-top box picture-in-picture playback has the following two scenarios:
  • the first scenario is shown in Figure 2. Two video streams are injected into the video layer, one is a full-screen video stream, and the other is a small-window video stream. In this scenario, two video streams are implemented in the video layer.
  • the screen playback position corresponding to the channel code stream can only be fixed, that is, the screen playback area corresponding to the small window video stream cannot be reduced and enlarged; in addition, if the user performs a page switching operation on the set-top box, the two channel code streams will be stopped , Affects users to watch picture-in-picture playback.
  • FIG. 3 is to set the channel list preview window.
  • a small window of the channel appears in the fixed area of the screen; as the user selects a different channel , The right small window plays different videos.
  • the small window video stream is inside the video layer, and the channel list preview window is on the page layer.
  • the page layer In order to see the video of the small window, the page layer must dig out a small window page frame of the same size as the small window video (also It is to make this page frame transparent), so that the following picture-in-picture video can be seen, which achieves the effect of playing a small picture-in-picture window.
  • the playback of the small window code stream will be stopped, which affects the user to watch the picture-in-picture playback.
  • the picture-in-picture playback of the above two scenes is related to the current application of the set-top box. As long as you leave the current page, the picture-in-picture playback must be affected; the picture-in-picture playback window cannot be moved, and the playback position and size are fixed, which is not convenient for users. Watch the picture-in-picture playback when operating the set-top box application.
  • third-party value-added applications for set-top boxes, but the vast majority of third-party value-added applications (non-video applications, such as game applications) cannot obtain video information, resulting in the inability to provide picture-in-picture services on these applications. .
  • the embodiment of the present disclosure proposes a method for realizing picture-in-picture.
  • the floating picture-in-picture window can be independent of any application through the suspension playback of video or pages, so that in any application, the picture-in-picture can be presented in any state of the set-top box. Effect.
  • the method for implementing picture-in-picture in an embodiment of the present disclosure which is applied to a set-top box, includes:
  • Step 201 Receive a request to open a picture-in-picture.
  • Step 202 According to the request, a floating picture-in-picture window independent of the current application of the set-top box is displayed on the window of the current application of the set-top box.
  • the suspended picture-in-picture window and the current application of the set-top box are separated, so that the user can independently control the picture-in-picture window and the current application of the set-top box, and the user's manipulation behavior is no longer restricted, thereby effectively improving the user experience .
  • the suspended picture-in-picture window is independent of the current application of the set-top box, which means that the suspended picture-in-picture window is not associated with the current application of the set-top box. That is to say, when the current application of the set-top box is switched, the floating picture-in-picture window will not change or be closed accordingly. "Floating" means that the picture-in-picture window is always displayed above the current application window of the set-top box, and will not be overwritten when the current application of the set-top box is switched.
  • the suspended picture-in-picture window also has a corresponding application, such as a video application or a page application displayed in the suspended picture-in-picture window, which may be referred to as a suspended picture-in-picture application.
  • a suspended picture-in-picture application refers to an application other than the suspended picture-in-picture application, and other running applications of the set-top box may be one or more.
  • the presentation is independent of the suspended picture-in-picture window currently used by the set-top box, including: creating an integrated layer on top of the set-top box layer, and displaying the suspended picture-in-picture window through the integrated layer .
  • the integrated layer is used for at least one of video playback and interactive display.
  • a new layer is created, which is called an integrated layer, and can also be called a picture-in-picture layer. It can be used to play videos and perform non-video interactive services.
  • the interactive services include advertisements, system message display, etc. ;
  • This layer can display video and pages.
  • the picture-in-picture and set-top box applications can be separated.
  • the picture-in-picture window can be moved and zoomed to better improve the user experience.
  • the integrated layer has the following characteristics.
  • the integrated layer inherits the characteristics of the video layer and the page layer, which can achieve the effect of video playback and page display.
  • the characteristics of the integrated layer on the page layer Rendering the video based on it achieves the effect of having both the characteristics of the page and the ability to play the video.
  • the integrated layer is independent of the set-top box video layer and page layer, because all applications of the set-top box are rendered on the video layer and page layer, so the operation of the set-top box application will not affect the video rendered in the integrated layer And interactive information.
  • the video on the page can also be moved and zoomed, which is convenient for previewing by moving to a suitable location at any time.
  • the layers in the set-top box are generally the video layer at the bottom and the page layer at the top.
  • the comprehensive layer created in the embodiment of the present disclosure has a higher level (uppermost) than the video layer and the page layer.
  • the integrated layer can render information such as videos and pages. Because it is displayed at the top of the set-top box, it can achieve real-time preview of the video and interactive information displayed in the integrated layer no matter how the following applications are switched.
  • the set-top box layer of the embodiment of the present disclosure is divided into three layers from bottom to top.
  • the first layer is a video layer
  • the second layer is a page layer
  • the third layer is an integrated layer.
  • Layers and page layers have higher levels and are used to display picture-in-picture videos and interactive displays.
  • the information displayed in the integrated layer is not affected by the video layer and the page layer. It is suspended at the top and can scale the video size and position.
  • the user can watch the suspended video channel play on any set-top box application.
  • Figure 6 shows that in a third-party value-added application (gaming application), when a user plays a game, he can also open the suspended picture-in-picture window through the remote control to track the channel playback information of interest.
  • gaming application a third-party value-added application
  • the suspended picture-in-picture window is not related to the current application of the set-top box, no matter how the current application of the set-top box is switched, the suspended picture-in-picture window is not affected, thus avoiding the channel playback closing situation caused by the set-top box page switching; the suspended picture Picture-in-Picture can be used for channel playback or page display on third-party value-added applications.
  • it can display the picture-in-picture function under non-video third-party value-added applications.
  • the displaying the suspended picture-in-picture window through the integrated layer includes the following steps 301 and 302.
  • Step 301 When it is determined that the content of the suspended picture-in-picture window is a video, obtain video information corresponding to the video.
  • Step 302 Render and play the video on the integrated layer according to the video information.
  • the acquiring video information corresponding to the video may include: acquiring video information when the last suspended picture-in-picture window exits, or acquiring video information corresponding to the video according to a preset strategy.
  • the video information may include channel information, window position information, window size information, etc.
  • the video playback may be continued according to the information when the last suspended picture-in-picture window exits.
  • the step 202 includes: when it is determined that the content of the suspended picture-in-picture window is a page, rendering interactive display on the integrated layer according to the page.
  • the page may include advertisements, system messages, etc., and may also include game screens that require interaction.
  • the layer to be displayed can be determined according to the layer identifier, as shown in FIG. 8, including the following steps:
  • Step 401 According to the request to open the picture-in-picture, determine an integrated layer identifier (that is, an integrated layer ID).
  • Step 402 According to the integrated layer identifier, determine that the layer displaying the content is the integrated layer.
  • the set-top box When rendering video or pages in a set-top box, the set-top box has a dedicated rendering module for rendering video and non-video page functions.
  • the rendering module of the set-top box will render the video to the video layer by default. After rendering, the size of the video playback window cannot be scaled, and the position of the playback window cannot be moved.
  • the rendering module of the set-top box will render the page to the page layer by default. After rendering, the page window can be moved at will.
  • a unique identification mark is created for the integrated layer to mark the current integrated layer (referred to as an integrated layer identifier), which is different from the video layer and the page layer.
  • the video playback application When the video needs to be rendered on the integrated layer, the video playback application will pass the integrated layer identifier to the rendering module, and the rendering module will find the integrated layer according to the integrated layer identifier and render the video on the integrated layer.
  • the interactive application will pass the integrated layer identification to the rendering module.
  • the rendering module will find the integrated layer according to the integrated layer identification and render the page on the integrated layer.
  • the rendering module can integrate all the pages and videos that need to be displayed into the comprehensive layer through the comprehensive layer identification.
  • the comprehensive layer has the characteristics of the page layer and can be scaled and moved at will.
  • the video rendered on the comprehensive layer is also You can zoom and move with everything.
  • the attributes of the floating picture-in-picture window are adjusted.
  • the adjusting the attributes of the suspended picture-in-picture window includes at least one of the following: adjusting the size of the suspended picture-in-picture window, and adjusting the position of the suspended picture-in-picture window.
  • Step 501 Adjust the video playback window attribute according to the received request to adjust the picture-in-picture window attribute.
  • Step 502 Adjust the window properties of the integrated layer.
  • the integrated layer has page characteristics and can be adjusted in size and position, the user can adjust the size and position of the video played by the picture-in-picture as needed.
  • the method when the property of the PIP window needs to be adjusted, as shown in FIG. 10, when the content of the floating PIP window includes a page, the method further includes the following steps 601 and 602.
  • Step 601 Adjust the interactive display window attribute according to the received request to adjust the picture-in-picture window attribute.
  • Step 602 Adjust the window properties of the integrated layer.
  • the size and position can be adjusted, so the size and position of the page displayed in the picture-in-picture can be adjusted.
  • the suspended picture-in-picture window can be moved at any position on the set-top box screen, so that the user can browse the contents of different positions of the set-top box interface and preview the suspended picture-in-picture image at the same time.
  • the suspended picture-in-picture window can be zoomed in and out at the top of the set-top box, which can also facilitate the user to achieve the following effects: when previewing the suspended video channel playback, if you need to focus on the application of the set-top box, you can reduce the suspended Picture-in-picture window; if you need to focus on the suspended picture-in-picture, you can enlarge the suspended picture-in-picture window.
  • the method further includes: closing the floating PIP window according to the received request to close the PIP.
  • the process of closing the floating picture-in-picture window may include the following steps 701 and 702.
  • Step 701 according to the received request to close the picture-in-picture, stop displaying the content on the integrated layer.
  • Step 702 releasing the integrated layer.
  • the content when the content is a video, stop playing the video on the integrated layer.
  • the content when the content is a page, stop interactive display on the integrated layer.
  • Step 801 According to the received request to switch from the PIP window to the currently active application window of the set-top box, the content displayed on the integrated layer is transferred to the currently active application window for display.
  • Step 802 Stop displaying the content on the integrated layer and release the integrated layer.
  • step 801 the content displayed on the integrated layer in step 801 is transferred to the currently active application window for display and step 802 may be performed simultaneously.
  • Step 802 is to close the PIP process.
  • the content when the content includes video, when video switching is required (for example, channel change), as shown in FIG. 13, it includes the following steps 901 and 902.
  • video switching for example, channel change
  • Step 901 Acquire target video information according to the received video switching request.
  • Step 902 Play the target video corresponding to the target video information through the floating picture-in-picture window according to the target video information.
  • step 902 the target video corresponding to the target video information is rendered and played on the integrated layer.
  • the set-top box of the embodiment of the present disclosure may include the following modules: a general control module 1001, a layer management module 1002, a broadcast control management module 1003, a video information management module 1004, a video playback module 1005, a rendering module 1006 and Interactive module 1007.
  • the master control module 1001 is configured to receive instructions of the STB system (such as key instructions) to use the picture-in-picture function.
  • the layer management module 1002 is configured to create a set-top box integrated layer for the picture-in-picture function.
  • the broadcast control management module 1003 is configured to perform suspension picture-in-picture playback control management.
  • the video information management module 1004 is configured to save, query, and remember floating picture-in-picture video information.
  • the video playback module 1005 is configured to suspend picture-in-picture video playback and other functions.
  • the interactive module 1007 is configured to control and display the suspended picture-in-picture interactive business control.
  • the rendering module 1006 is configured to render video, pages, etc. onto the layer.
  • step 1101 the STB system is normally used.
  • the user presses the PIP shortcut key on the remote control, and the master control module receives key processing.
  • the master control module determines that the suspended picture-in-picture function needs to be turned on and informs the layer management module.
  • Step 1102 the layer management module creates a comprehensive layer, which inherits all the characteristics of the video layer and the page layer, renders the video on the characteristics of the page layer, and has both the page layer and the video layer
  • the advantages of the integrated layer are higher than that of the video layer and the page layer.
  • the integrated layer is used for video playback and interactive (such as advertising and message) display.
  • the comprehensive layer display information is not affected by the application of the set-top box, and can also be used for window size scaling and position movement.
  • step 1103 the master control module determines that if it is video playback, it notifies the broadcast control management module to trigger playback, and then performs the next step; otherwise, it proceeds to step 1108.
  • Step 1104 the broadcast control management module goes to the video information management module to query the played video information.
  • Step 1105 the video information management module obtains the last played video information (that is, the video information when the last picture-in-picture was exited) according to the saved picture-in-picture video information, and if there is no last played video information, according to the preset strategy Find a suitable video information and return to the broadcast control management module.
  • the last played video information that is, the video information when the last picture-in-picture was exited
  • Step 1106 the broadcast control management module sends the video playback module to play according to the acquired video information.
  • Step 1107 the video playback module sends a message to the rendering module and carries the integrated layer identifier, and the rendering module plays the rendered video in the integrated layer according to the integrated layer identifier.
  • Step 1108 if it is interactive processing, the master control module notifies the interactive module to process.
  • step 1109 the interactive module processes the information to be displayed to the rendering module and carries the integrated layer identifier, and the rendering module renders and displays the integrated layer according to the integrated layer identifier.
  • the process of creating an integrated layer includes the following steps 1201 to 1204.
  • Step 1201 the layer management module receives a command to create a comprehensive layer issued by the master control module.
  • Step 1202 the layer management module creates a comprehensive layer, which inherits all the characteristics of the video layer and the page layer, renders the video on the characteristics of the page layer, and has both the page layer and the video layer.
  • Step 1203 the layer management module sets the level of the integrated layer to be higher than the page layer and the video layer.
  • Step 1204 the layer management module returns the information corresponding to the integrated layer to the master control module.
  • the picture-in-picture video playback processing flow includes the following steps 1301 to 1305.
  • Step 1301 the broadcast control management module receives a playback request of the master control module, and the playback request carries the integrated layer identifier.
  • Step 1302 The broadcast control management module first queries the video information management module for corresponding video information.
  • Step 1303 the broadcast control management module sends the queried video information and the integrated layer identifier to the video playback module, instructing the video playback module to play.
  • Step 1304 the video playing module starts playing, and sends the video and the integrated layer identification to the rendering module.
  • Step 1305 the rendering module renders and plays the video on the integrated layer.
  • the picture-in-picture video information generation and query process includes the following steps 1401 to 1405.
  • step 1401 the STB successfully logs in to the platform, and the video information management module obtains video resources for picture-in-picture playback.
  • Step 1402 the video information management module saves the video information of the picture-in-picture playback.
  • Step 1403 the video information management module receives the video information that needs to be played.
  • step 1404 the video information management module queries the video information played last time.
  • Step 1405 the video information module returns the queried video information.
  • step 1501 the master control module receives a window attribute change request, which can be realized by the user pressing the picture-in-picture shortcut key on the remote control.
  • Step 1502 the master control module sends a video window attribute change request to the broadcast control management module.
  • Step 1503 the broadcast control management module forwards the window attribute change information to the video playback module.
  • Step 1504 the video playback module forwards the window attribute change information to the rendering module.
  • Step 1505 the processing of the rendering module is completed.
  • Step 1506 the master control module sends an attribute change request to the layer management module.
  • Step 1507 the layer management module performs attribute change operations according to the integrated layer.
  • Step 1508 the layer management module finishes processing the window attribute change.
  • Interactive display window attribute change process (among them, window attribute change mainly includes window position moving up and down, left and right, window size zooming, etc.).
  • step 1601 the master control module receives a window attribute change request, which can be implemented by the user pressing the remote control picture-in-picture shortcut key.
  • Step 1602 the master control module sends an interactive window attribute change request to the interactive module.
  • Step 1603 the interactive module sends the change information of the interactive window attribute to the rendering module.
  • Step 1604 the rendering module processing is completed.
  • Step 1605 the master control module sends a window attribute change request to the layer management module.
  • Step 1606 the layer management module performs attribute change operations according to the integrated layer.
  • Step 1607 the layer management module finishes processing the window attribute change.
  • step 1701 the master control module receives a video switching request, which can be realized by the user pressing the remote picture-in-picture shortcut key.
  • Step 1702 the master control module sends a video switching request to the broadcast control management module.
  • Step 1703 the broadcast control management module queries the video information management module for corresponding video information.
  • step 1704 the video information management module returns corresponding video information.
  • step 1705 the broadcast control management module notifies the video playback module to play a new video (ie, target video).
  • Step 1706 the video playback module sends the new video and the integrated layer identification to the rendering module.
  • step 1707 the rendering module renders and plays the new video.
  • step 1801 the master control module receives a request to close the picture-in-picture video, and the request can be implemented by the user pressing the shortcut key of the picture-in-picture.
  • step 1802 the master control module sends a stop command to the broadcast control management module.
  • Step 1803 the broadcast control management module sends a stop playing command to the video playback module.
  • Step 1804 the video playing module stops playing, and sends a stop playing command to the rendering module.
  • Step 1805 the rendering module stops rendering and playing on the integrated layer.
  • step 1806 the general control module sends a comprehensive layer closing request to the layer management module.
  • Step 1807 the layer management module releases the integrated layer.
  • step 1901 the master control module receives a request to close the PIP interactive display, and the request can be realized by the user pressing the remote control PIP shortcut key.
  • Step 1902 the master control module sends an interactive module to stop the interactive display command.
  • Step 1903 the interactive display module stops the interactive display and sends an interactive display command to the rendering module.
  • Step 1904 the rendering module stops interactive display on the integrated layer.
  • Step 1905 the master control module sends a comprehensive layer closing request to the layer management module.
  • Step 1906 the layer management module releases the integrated layer.
  • step 2001 the master control module receives a key request for switching the picture-in-picture window to the currently active application window of the set-top box.
  • step 2002 the master control module determines whether the current PIP window is video playback or interactive display. If it is video playback, go to step 2003; if it is interactive display, go to step 2004.
  • step 2003 the master control module processes the picture-in-picture video playback closing process, the same as the process in FIG. 22.
  • the master control module transfers the video information to the currently active application window for display, and the current active application window of the set-top box plays the video information of the picture-in-picture playback. This enables one-click switching from the suspended integrated layer to the current active application window (such as the video image) Layer) to facilitate the user experience.
  • step 2004 the master control module processes the closing process of the PIP interactive display, which is the same as the process in FIG. 23.
  • the master control module passes the interactive information to the currently active application window to display (such as a page layer), and the current active application window of the set-top box displays the picture-in-picture interactive information, so that one-click switching from the floating layer to the currently active application window Effect, which facilitates the user experience.
  • FIG. 25 it is a time sequence diagram of suspended picture-in-picture playback video, including: video playback process, process of adjusting the picture-in-picture window attribute, video playback video switching process, closing the picture-in-picture video playback process, and switching the picture-in-picture layer to The current active application window layer process.
  • the video playback process includes the following steps 2101 to 2111.
  • step 2101 the user presses the picture-in-picture shortcut key on the remote control, which indicates that picture-in-picture playback is turned on.
  • Step 2102 the master control module receives the button processing, judges that the suspended picture-in-picture function needs to be turned on, and notifies the layer management module.
  • Step 2103 the layer management module creates a comprehensive layer, and returns a creation completion message to the master control module.
  • step 2104 the master control module determines that it is video playback, notifies the broadcast control management module to play the video, and notifies the broadcast control management module of the integrated layer identifier.
  • Step 2105 the broadcast control management module queries the video information played by the video information management module.
  • Step 2106 the video information management module returns video information to the broadcast control management module.
  • Step 2107 the broadcast control management module sends a video playback request to the video playback module.
  • Step 2108 the video playback module sends the video and the integrated layer identification to the rendering module.
  • Step 2109 the rendering module plays the rendered video in the integrated layer according to the integrated layer identifier.
  • Step 2110 the video playback module sends a video playback success response to the broadcast control management module.
  • Step 2111 the broadcast control management module sends a video playback success response to the master control module.
  • the process of adjusting the picture-in-picture window attribute includes the following steps 2112 to 2120.
  • step 2112 the user presses the picture-in-picture shortcut key on the remote control, which means adjusting the properties of the picture-in-picture window.
  • step 2113 the master control module receives key processing, the master control module determines that the window attribute needs to be adjusted, and notifies the broadcast control management module.
  • Step 2114 the broadcast control management module notifies the video playback module to handle the window attribute change.
  • Step 2115 the video playback module notifies the rendering module to handle the window attribute change.
  • step 2116 the rendering module processes the completion of the window attribute change, and returns to notify the video playback module to adjust the video playback response.
  • Step 2117 the video playback module returns a notification to the broadcast control management module to adjust the video playback response.
  • Step 2118 the broadcast control management module returns a notification to the master control module to adjust the video playback response.
  • step 2119 the master control module notifies the layer management module to handle the window attribute change.
  • Step 2120 the layer management module finishes processing the layer attribute change, and returns a response to adjust the layer attribute to the master control module.
  • the video switching video switching process includes the following steps 2121 to 2129.
  • Step 2121 the user presses the picture-in-picture shortcut key on the remote control to indicate video switching.
  • the master control module receives key processing, determines that video switching is required, and notifies the broadcast control management module.
  • Step 2123 the broadcast control management module queries the video information management module for corresponding video information.
  • Step 2124 the video information management module returns corresponding video information.
  • Step 2125 the broadcast control management module notifies the video playback module to play a new video.
  • Step 2126 the video playing module sends the new video and the integrated layer identification to the rendering module.
  • Step 2127 the rendering module plays and renders the new video in the integrated layer according to the integrated layer identifier.
  • Step 2128 the video playback module sends a new video playback success response to the broadcast control management module.
  • Step 2129 the broadcast control management module sends a video switching success response to the master control module.
  • the process of closing the PIP video playback includes the following steps 2130 to 2140.
  • step 2130 the user presses the picture-in-picture shortcut key on the remote control, indicating that the picture-in-picture video playback is closed.
  • step 2131 the master control module receives the button processing, determines that the suspended picture-in-picture function needs to be turned off, and sends a request to turn off the picture-in-picture video playback to the broadcast control management module.
  • Step 2132 the broadcast control management module triggers a stop playing request to the video playback module.
  • Step 2133 the video playing module stops playing, and sends a stop playing request to the rendering module.
  • Step 2134 the rendering module stops playing, and sends a stop playing response to the video playing module.
  • step 2135 the video playback module sends a playback stop response to the broadcast control management module.
  • Step 2136 the broadcast control management module releases the broadcast control resources.
  • Step 2137 the broadcast control management module sends a stop playing response to the master control module.
  • Step 2138 the master control module triggers a request to release the integrated layer to the layer management module.
  • Step 2139 the layer management module releases the integrated layer.
  • Step 2140 the layer management module sends a release layer response to the master control module.
  • the process of switching the PIP layer to the currently active application window layer includes the following steps 2141 to 2143.
  • Step 2141 the user presses the picture-in-picture shortcut key on the remote control, indicating that the picture-in-picture layer is switched to the currently active application window layer.
  • step 2142 the master control module executes the above-mentioned process of closing the PIP video playback.
  • step 2143 the master control module passes the video information to the currently active application window to play.
  • FIG. 26 it is a time sequence diagram of interactive display of suspended picture-in-picture, including: interactive display process, process of adjusting the picture-in-picture window attribute, closing the picture-in-picture interactive process, switching the picture-in-picture layer to the current active application window layer process .
  • the interactive display process includes the following steps 2201 to 2207.
  • step 2201 the user presses the picture-in-picture shortcut key on the remote control to indicate that the picture-in-picture interactive display is opened.
  • the master control module receives the button processing, determines that the suspended picture-in-picture function needs to be turned on, and notifies the layer management module.
  • Step 2203 the layer management module creates a comprehensive layer, and returns a creation completion message to the master control module.
  • the master control module determines that it is an interactive display, notifies the interactive module, and notifies the interactive module of the integrated layer identification.
  • Step 2205 the interaction module processes the information to be displayed to the rendering module and carries the integrated layer identifier.
  • Step 2206 the rendering module renders and displays on the integrated layer according to the integrated layer identifier.
  • Step 2207 the interaction module sends an interaction success response to the master control module.
  • the process of adjusting the picture-in-picture window attribute includes the following steps 2208 to 2214.
  • step 2208 the user presses the picture-in-picture shortcut key on the remote control to indicate that the picture-in-picture window attribute is adjusted.
  • step 2209 the master control module receives the button processing, the master control module determines that the window attribute needs to be adjusted, and notifies the interactive module.
  • step 2210 the interaction module notifies the rendering module to handle the window attribute change.
  • step 2211 the rendering module finishes processing the window attribute change, and returns to notify the interactive module to adjust the interactive display response.
  • step 2212 the interactive module returns a notification to the master control module to adjust the interactive display response.
  • step 2213 the master control module notifies the layer management module to handle the window attribute change.
  • Step 2214 the layer management module finishes processing the change of the layer attribute, and returns a response to adjust the layer attribute to the master control module.
  • the process of closing the PIP interaction includes the following steps 2215 to 2223.
  • step 2215 the user presses the picture-in-picture shortcut key on the remote control, indicating that the picture-in-picture interactive display is closed.
  • the master control module receives the button processing, determines that the suspended picture-in-picture function needs to be turned off, and sends a request to turn off the interactive picture-in-picture display to the interaction module.
  • step 2217 the interactive module stops the interactive display, and sends a request for stopping the interactive display to the rendering module.
  • step 2218 the rendering module stops the interactive display, and sends a response to stop the interactive display to the interactive module.
  • Step 2219 the interactive module releases interactive resources.
  • Step 2220 the interactive module sends a stop interactive display response to the master control module.
  • step 2221 the master control module triggers a request to release the integrated layer to the layer management module.
  • Step 2222 the layer management module releases the integrated layer.
  • Step 2223 the layer management module sends a release layer response to the master control module.
  • the process of switching the picture-in-picture layer to the currently active application window layer includes the following steps 2224 to 2226.
  • step 2224 the user presses the picture-in-picture shortcut key on the remote control, indicating that the picture-in-picture layer is switched to the currently active application window layer.
  • step 2225 the master control module executes the above-mentioned interactive process of closing the picture-in-picture.
  • step 2226 the master control module transmits the interactive information to the currently active application window to play.
  • the suspended picture-in-picture provided by the embodiments of the present disclosure realizes video playback and interactive display, so that users can use the picture-in-picture function at the same time without being affected when using various applications of the set-top box, and freely zoom the picture-in-picture
  • the size of the window and the position of the moving picture-in-picture window effectively improve the user experience. Therefore, this application has broad significance in the field of set-top boxes.
  • an embodiment of the present disclosure also provides a device for implementing picture-in-picture, which is applied to a set-top box and includes a receiving unit 2301 and a presentation unit 2302.
  • the receiving unit 2301 is configured to receive a request to open a picture-in-picture.
  • the presentation unit 2302 is configured to present a suspended picture-in-picture window independent of the current application of the set-top box based on the request to open the picture-in-picture.
  • the suspended picture-in-picture window is separated from the current application of the set-top box, which effectively improves the user experience.
  • the floating picture-in-picture window is not associated with the current application of the set-top box, and is always displayed above the window of the current application of the set-top box.
  • the presentation unit 2302 is configured to create an integrated layer on top of the set-top box layer, and display the suspended picture-in-picture window through the integrated layer; wherein, the integrated layer is used to perform At least one of video playback and interactive display.
  • the presentation unit 2302 is configured to sample at least one of the following to display the suspended picture-in-picture window through the integrated layer: 1) When determining that the content of the suspended picture-in-picture window is video, Obtain the video information corresponding to the video, and render the video on the integrated layer according to the video information; 2) When it is determined that the content of the suspended picture-in-picture window is a page, according to the page Render interactive display on the comprehensive layer.
  • the presentation unit 2302 is configured to acquire video information when the last suspended picture-in-picture window exits, or acquire video information corresponding to the video according to a preset strategy.
  • the presentation unit 2302 is further configured to, after receiving the request to open the picture-in-picture, determine the integrated layer identifier according to the request to open the picture-in-picture.
  • the layer displaying the content is determined to be the integrated layer.
  • the device further includes: an adjustment unit; the adjustment unit is configured to adjust the attributes of the floating picture-in-picture window according to the received request to adjust the attributes of the picture-in-picture window.
  • the adjusting the attributes of the floating picture-in-picture window includes at least one of the following: adjusting the size of the floating picture-in-picture window, and adjusting the position of the floating picture-in-picture window.
  • the device further includes: a closing unit; the closing unit is configured to close the floating picture-in-picture window according to the received request to close the picture-in-picture.
  • the closing unit may be further configured to stop displaying content on the integrated layer and release the integrated layer.
  • the device further includes: a first switching unit; the first switching unit is configured to convert the content displayed on the integrated layer according to the received request to switch from the PIP window to the currently active application window of the set-top box Pass to the currently active application window for display, stop displaying the content on the integrated layer, and release the integrated layer.
  • the device further includes: a second switching unit; the second switching unit is configured to obtain target video information according to the received video switching request when the content of the floating picture-in-picture window includes video And, according to the target video information, play the target video corresponding to the target video information through the suspended picture-in-picture window.
  • an embodiment of the present disclosure further provides a set-top box, including: a memory 2401, a processor 2402, and a computer program 2403 stored on the memory 2401 and executable on the processor 2402.
  • the processor 2402 executes When the program is described, the method for realizing picture-in-picture provided in the foregoing embodiment is realized.
  • Embodiments of the present disclosure also provide a computer-readable storage medium that stores computer-executable instructions that are configured to be executed to implement the method for implementing picture-in-picture provided by the foregoing embodiments.
  • the storage medium may include, but is not limited to, a USB flash drive, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a mobile hard disk, a magnetic disk, or an optical disk, etc.
  • ROM read-only memory
  • RAM Random Access Memory
  • mobile hard disk a magnetic disk
  • magnetic disk a magnetic disk
  • optical disk etc.
  • the term computer storage medium includes both volatile and nonvolatile implemented in any method or technology for storing information such as computer readable instructions, data structures, program modules, or other data Sex, removable and non-removable media.
  • Computer storage media include but are not limited to RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cartridges, magnetic tape, magnetic disk storage or other magnetic storage devices, or may Any other medium used to store desired information and accessible by a computer.
  • the communication medium generally contains computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transmission mechanism, and may include any information delivery medium .

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本公开实施例提供了一种实现画中画的方法、装置和机顶盒，其中，所述方法包括：接收打开画中画的请求；根据所述打开画中画的请求，在机顶盒当前应用的窗口之上，展现独立于所述机顶盒当前应用的悬浮画中画窗口。本公开实施例中，悬浮画中画窗口与机顶盒当前应用分离，有效提高了用户体验度。

Description

一种实现画中画的方法、装置和机顶盒 技术领域
本公开实施例涉及但不限于一种实现画中画的方法、装置和机顶盒。
背景技术
现有机顶盒(Set Top Box，简称STB)在播放画中画(Picture-in-Picture，简称PIP)时，画中画窗口与机顶盒应用是相关联的。如果用户切换应用或者视频应用切换页面，必然会停止当前的画中画视频播放；另外，画中画视频播放都是由机顶盒应用触发的，离开这些机顶盒应用，当前视频频道播放就不能播放。
由此可见，将画中画窗口与机顶盒应用进行关联，会在一定程度上限制用户对机顶盒应用的操作，从而导致用户体验度不佳
发明内容
以下是对本文详细描述的主题的概述。本概述并非是为了限制权利要求的保护范围。
本公开实施例提供了一种实现画中画的方法、装置和机顶盒。
本公开实施例提供了一种实现画中画的方法，包括：
接收打开画中画的请求；
根据所述打开画中画的请求，在机顶盒当前应用的窗口之上，展现独立于所述机顶盒当前应用的悬浮画中画窗口。
本公开实施例还提供一种实现画中画的装置，包括：
接收单元，配置为接收打开画中画的请求；
展现单元，配置为根据所述请求，在机顶盒当前应用的窗口之上，展现独立于所述机顶盒当前应用的悬浮画中画窗口。
本公开实施例还提供一种机顶盒，包括：存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，所述处理器执行所述程序时实现所述实现画中画的方法。
本公开实施例还提供一种计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令被执行时实现所述实现画中画的方法。
附图说明
图1为机顶盒系统架构示意图。
图2为实现画中画的第一种场景。
图3为实现画中画的第二种场景。
图4为本公开实施例的实现画中画的方法的流程图。
图5为本公开实施例的机顶盒图层的示意图。
图6为本公开实施例的在顶盒应用上面观看悬浮的视频频道播放的示意图。
图7为本公开实施例的通过所述综合图层展现所述悬浮画中画窗口的流程图。
图8为本公开实施例的根据图层标识确定待显示的内容显示在哪个图层的流程图。
图9为本公开实施例的调整画中画窗口属性的流程图(内容包括视频)。
图10为本公开实施例的调整画中画窗口属性的流程图(内容包括页面)。
图11为本公开实施例的关闭画中画的流程图。
图12为本公开实施例的从画中画窗口切换到机顶盒当前活动应用窗口的流程图。
图13为本公开实施例的视频切换的流程图。
图14为本公开实施例的机顶盒的模块组成示意图。
图15为本公开实施例的视频播放或者互动展示启动流程图。
图16为本公开实施例的创建综合图层流程图。
图17为本公开实施例的画中画视频播放处理流程图。
图18为本公开实施例的画中画视频信息生成和查询流程图。
图19为本公开实施例的视频播放窗口属性变化流程图。
图20为本公开实施例的互动展示窗口属性变化流程图。
图21为本公开实施例的视频播放视频切换流程图。
图22为本公开实施例的关闭画中画视频播放流程图。
图23为本公开实施例的关闭画中画互动展示流程图。
图24为本公开实施例的从画中画图层切换到当前活动应用窗口图层流程图。
图25为本公开应用实例的悬浮画中画播放视频时序图。
图26为本公开应用实例的悬浮画中画互动展示时序图。
图27为本公开实施例的实现画中画装置的组成示意图。
图28为本公开实施例的机顶盒的组成示意图。
具体实施方式
下文中将结合附图对本公开的实施例进行详细说明。
在附图的流程图示出的步骤可以在诸如一组计算机可执行指令的计算机系统中执行。并且，虽然在流程图中示出了逻辑顺序，但是在某些情况下，可以以不同于此处的顺序执行所示出或描述的步骤。
如图1所示，机顶盒系统架构包括：遥控器11、机顶盒12和电视13。其中，遥控器11接收到用户的按键指令，将所述按键指令转换成相应的请求发送至机顶盒12，所述机顶盒12根据接收到的请求通过电视13显示相应图像。机顶盒12上也可以有按钮，所述机顶盒12也可以直接根据接收到的按键信息进行相应的处理。
机顶盒图层一般分为两个图层，分别是视频图层和页面图层，机顶盒画中画播放有如下两种场景：
(1)第一种场景见图2，是在视频图层里面，注入两路码流，一路是全屏视频流，一路是小窗口视频流；这种场景下，在视频图层里面实现的两路码流所对应的画面播放位置只能是固定不动的，即小窗口视频流所对应的画面播放区域不能缩小和放大；另外，如果用户在机顶盒上进行页面切换操作会停止两路码流的播放，影响用户观看画中画播放。
(2)第二种场景见图3，就是设置频道列表预览窗口，当用户在频道列表预览窗口中点击某个频道时，在屏幕固定区域出现该频道的小窗口播放；随着用户选择不同频道，右边小窗口播放不同的视频。小窗口视频流是在视频图层里面，频道列表预览窗口在页面图层，为了能看到小窗口的视频，页面图层必要要挖掉一个和小窗口视频同样大小的小窗口页面框(也就是让这个页面框透明)，使得下面的画中画视频能被看得到，这样达到了画中画小窗口播放的效果。但是如果用户在机顶盒上进行页面切换操作，则会停止小窗口码流的播放，影响用户观看画中画播放。
以上两个场景的画中画播放，都是和机顶盒当前应用相关联，只要离开当前页面，画中画播放必定受到影响；画中画播放窗口都不能移动，播放位置和大小固定，不方便用户操作机顶盒应用的时候观看画中画播放。
另外，机顶盒第三方增值应用越来越多，但绝大部分第三方增值应用(非视频类应用，比如游戏类应用)因无法获取到视频信息，而导致在这些应用上无法提供画中画业务。
本公开实施例提出了一个实现画中画的方法，通过视频或页面的悬浮式播放，实现悬浮画中画窗口可以独立于任何应用，从而在任何应用下，机顶盒任何状态都可以呈现画中画的效果。
如图4所示，本公开实施例的实现画中画的方法，应用于机顶盒，包括：
步骤201，接收打开画中画的请求。
步骤202，根据所述请求，在机顶盒当前应用的窗口之上，展现独立于所述机顶盒当前应用的悬浮画中画窗口。
本公开实施例中，悬浮画中画窗口与机顶盒当前应用分离，使得用户能够对画中画窗口和机顶盒当前应用分别独立进行操控，用户的操控行为不再受到约束，从而能有效提高用户体验度。
本公开实施例中，悬浮画中画窗口独立于所述机顶盒当前应用，是指悬浮画中画窗口与所述机顶盒当前应用没有关联关系。也就是说，在所述机顶盒当前应用切换时，悬浮画中画窗口不会随之改变或被关闭。“悬浮”是指画中画窗口始终显示在所述机顶盒当前应用的窗口之上，在机顶盒当前应用的切换时，不会被覆盖。
需要说明的是，本公开实施例中，悬浮画中画窗口也有对应的应用，如显示在悬浮画中画窗口中的视频应用或页面应用，可称为悬浮画中画应用，本公开实施例中，所述机顶盒当前应用是指除悬浮画中画应用以外，机顶盒其他运行的应用，可以是一个或多个。
在一些实施例中，所述展现独立于所述机顶盒当前应用的悬浮画中画窗口，包括：在机顶盒图层的顶层创建综合图层，通过所述综合图层展现所述悬浮画中画窗口。
其中，所述综合图层用于进行视频播放和互动展示中的至少之一。
本公开实施例中，创建了一个新的图层，称为综合图层，也可称为画中画图层，可以用来播放视频和进行非视频互动业务，互动业务包含广告、系统消息展示等；该图层可以显示视频和页面，通过在该图层上渲染视频或者互动，从而实现画中画和机顶盒应用分离，同时画中画窗口可以移动和缩放，更好的提高用户体验度。综合图层具有如下特点。
1、基于目前机顶盒的两个图层分离的现状，该综合图层继承了视频图层和页面图层的特性，能实现视频播放和页面展示的效果，该综合图层在页面图层的特性基础上渲染视频，达到了既有页面的特性又能播放视频的效果。
2、该综合图层独立于机顶盒视频图层和页面图层，因为机顶盒所有应用都是渲染在视频图层和页面图层上面，所以对机顶盒应用的操作影响不到综合图层里面渲染的视频和互动信息。
3、由于该综合图层的页面特性是可以移动和缩放的，页面上的视频也可以跟着移动和缩放，从而方便用于随时移动到合适的位置预览。
4、机顶盒中的图层，层次一般是视频图层是最下面，再上面是页面图层。本公开实施例中创建的综合图层，它的层次比视频图层和页面图层要高(最上面)。综合图层可以渲染视频和页面等信息，由于在机顶盒展示的最上面，所以可以做到不管下面应用如何切换，都能实时预览到综合图层里面展示的视频和互动信息。
参见图5，本公开实施例的机顶盒图层由下至上分为三层，第一层是视频图层，第二层是页面图层，第三层是综合图层，综合图层比视频图层和页面图层层次更高，用来展示画中画视频和互动展示。综合图层里面展示的信息不受视频图层和页面图层的影响，悬浮在最上面，并能缩放里面视频大小和位置等。
参见图6，用户可以在任何机顶盒应用上面观看悬浮的视频频道播放。图6就是在第三方增值应用(游戏类应用)里面，用户玩游戏的时候，也能同时通过遥控器打开悬浮画中画窗口跟踪关注的频道播放信息。
本公开实施例中，悬浮画中画窗口和机顶盒当前应用没有关联，不管机顶盒当前应用怎么切换，悬浮画中画窗口都不受影响，这样避免了机顶盒页面切换导致频道播放关闭情况；悬浮的画中画可以在第三方增值应用上面进行频道播放或页面展示，在任何状态下，都可以通过遥控器的画中画(PIP)按键打开悬浮画中画窗口，对频道进行浏览播放，这样就实现了在非视频类的第三方增值应用下也能展示画中画的功能。
如图7所示，在一实施例中，所述通过所述综合图层展现所述悬浮画中画窗口包括以下步骤301和步骤302。
步骤301，确定所述悬浮画中画窗口的内容为视频时，获取所述 视频对应的视频信息。
步骤302，根据所述视频信息，在所述综合图层上渲染播放所述视频。
其中，所述获取所述视频对应的视频信息，可包括：获取上次悬浮画中画窗口退出时的视频信息，或者根据预设策略获取所述视频对应的视频信息。
例如，视频信息可以包括频道信息、窗口位置信息、窗口大小信息等，可以根据上次悬浮画中画窗口退出时的这些信息，继续进行视频播放。也可以根据预设策略，例如指定频道、窗口的位置和大小等，进行视频播放。
在一些实施例中，所述步骤202包括：确定所述悬浮画中画窗口的内容为页面时，根据所述页面在所述综合图层上进行渲染互动展示。
其中，所述页面可以包括广告、系统消息等，也可以包括需要互动的游戏画面。
由于本公开实施例中，机顶盒有三个图层，可以根据图层标识确定待显示的内容显示在哪个图层，如图8所示，包括如下步骤：
步骤401，根据所述打开画中画的请求，确定综合图层标识(也即综合图层ID)。
步骤402，根据所述综合图层标识，确定显示内容的图层为所述综合图层。
机顶盒里面渲染的视频或者页面的时候，机顶盒有个专门的渲染模块用来渲染视频和非视频的页面功能。
机顶盒的渲染模块会把视频默认渲染到视频图层，渲染后视频播放窗口大小不能缩放，并且播放窗口位置不能移动。
机顶盒的渲染模块会把页面默认渲染到页面图层，渲染后页面窗口可以随意移动。
本公开实施例中，为综合图层创建一个唯一标识标记当前综合图层(称为综合图层标识)，区别于视频图层和页面图层。
当需要在综合图层渲染视频的时候，视频播放应用会把综合图层标识传递给渲染模块，渲染模块会根据综合图层标识找到综合图层，在综合图层上面渲染视频。
当需要在综合图层渲染页面的时候，互动应用会把综合图层标识传递给渲染模块，渲染模块会根据综合图层标识找到综合图层，在综合图层上面渲染页面。
渲染模块通过综合图层标识可以把需要展示的页面和视频全部融合在一起渲染到综合图层，综合图层由于具备页面图层的特性，可以随意缩放和移动，综合图层上面渲染的视频也可以跟着一切缩放和移动。
在一实施例中，根据接收到的调整画中画窗口属性的请求，调整所述悬浮画中画窗口的属性。
其中，所述调整所述悬浮画中画窗口的属性包括如下至少之一：调整所述悬浮画中画窗口的大小、调整所述悬浮画中画窗口的位置。
在一实施例中，在需要调整画中画窗口属性时，如图9所示，所述悬浮画中画窗口的内容为视频时，包括以下步骤501和步骤502。
步骤501，根据接收到的调整画中画窗口属性的请求，调整视频播放窗口属性。
步骤502，调整所述综合图层的窗口属性。
由于综合图层具有页面特征，可以调整大小和位置，所以用户可以根据需要调整画中画播放的视频的大小和位置。
在一实施例中，在需要调整画中画窗口属性时，如图10所示，所述悬浮画中画窗口的内容包括页面时，所述方法还包括以下步骤601和步骤602。
步骤601，根据接收到的调整画中画窗口属性的请求，调整互动展示窗口属性。
步骤602，调整所述综合图层的窗口属性。
由于综合图层具有页面特征，可以调整大小和位置，所以可以调 整画中画展示的页面的大小和位置。
本公开实施例中，悬浮的画中画窗口可以在机顶盒画面上任何位置随意移动，这样使得用户既能浏览机顶盒界面不同位置内容，也能同时预览到悬浮的画中画图像。而且，悬浮的画中画窗口可以在机顶盒画面上面随意放大和缩小，这样也可以方便用户做到如下效果：在预览悬浮视频频道播放的时候，如果需要重点关注机顶盒应用的时候，可以缩小悬浮的画中画窗口；如果需要重点关注悬浮的画中画的时候，可以放大悬浮的画中画窗口。
在需要关闭画中画时，在一些实施例中，所述方法还包括：根据接收到的关闭画中画的请求，关闭所述悬浮画中画窗口。
如图11所示，关闭所述悬浮画中画窗口的流程可包括如下步骤701和步骤702。
步骤701，根据接收到的关闭画中画的请求，停止在所述综合图层上显示内容。
步骤702，释放所述综合图层。
其中，在所述内容为视频时，停止在所述综合图层上播放所述视频。在所述内容为页面时，停止在所述综合图层上进行互动展示。
在一些实施例中，在需要从画中画窗口切换到机顶盒当前活动应用窗口，如图12所示，包括如下步骤801和步骤802。
步骤801，根据接收到的从画中画窗口切换到机顶盒当前活动应用窗口的请求，将所述综合图层上显示的内容传递至当前活动应用窗口进行显示。
步骤802，停止在所述综合图层上显示所述内容，释放所述综合图层。
其中，步骤801中的将所述综合图层上显示的内容传递至当前活动应用窗口进行显示和步骤802可以同时进行。
步骤802也即关闭画中画的流程。
在一实施例中，所述内容包括视频时，在需要进行视频切换时(例 如，更换频道)，如图13所示，包括如下步骤901和步骤902。
步骤901，根据接收到的视频切换的请求，获取目标视频信息。
步骤902，根据所述目标视频信息，通过所述悬浮画中画窗口播放所述目标视频信息对应的目标视频。
其中，步骤902中，在所述综合图层上渲染播放所述目标视频信息对应的目标视频。
在这种情况下，可以将画中画的当前正在播放的视频切换到目标视频进行播放。
如图14所示，本公开实施例的机顶盒，可包括如下模块：总控模块1001、图层管理模块1002、播控管理模块1003、视频信息管理模块1004、视频播放模块1005、渲染模块1006和互动模块1007。
其中，总控模块1001，配置为接收STB系统的指令(比如按键指令)使用画中画功能。
图层管理模块1002，配置为进行创建机顶盒综合图层用来进行画中画功能。
播控管理模块1003，配置为进行悬浮画中画播放控制管理。
视频信息管理模块1004，配置为悬浮画中画视频信息的保存、查询以及记忆等功能。
视频播放模块1005，配置为悬浮画中画视频播放等功能。
互动模块1007，配置为悬浮画中画中互动业务控制管理和展示。
渲染模块1006，配置为视频和页面等渲染到图层上面。
下面参照图14，对本公开实施例的实现过程进行阐述。
(一)视频播放或者互动展示启动流程。
参照图15，包括如下步骤1101至步骤1109。
步骤1101，STB系统正常使用，用户按遥控器画中画快捷键，总控模块接收到按键处理，总控模块判断需要打开悬浮画中画功能，通 知图层管理模块。
步骤1102，图层管理模块创建综合图层，该图层是继承了视频图层和页面图层的所有特性，在页面图层的特性上面渲染视频，具备了页面图层和视频图层两者的优点，综合图层的层次高于视频图层和页面图层，综合图层用于视频播放和互动(比如广告、消息)展示。综合图层展示信息不受机顶盒应用影响，也能进行窗口大小缩放和位置移动。
步骤1103，总控模块判断如果是视频播放，通知播控管理模块触发播放，执行下一步；否则转到步骤1108。
步骤1104，播控管理模块去视频信息管理模块去查询播放的视频信息。
步骤1105，视频信息管理模块根据保存的画中画视频信息，获取上次播放的视频信息(即上次画中画退出时的视频信息)，如果没有上次播放的视频信息，根据预设策略找到一个合适的视频信息返回给播控管理模块。
步骤1106，播控管理模块根据获取到的视频信息，发给视频播放模块去播放。
步骤1107，视频播放模块发消息给渲染模块并带上综合图层标识，渲染模块根据综合图层标识在综合图层中播放渲染视频。
步骤1108，如果是互动处理，总控模块通知互动模块去处理。
步骤1109，互动模块处理发消息给渲染模块需要展示的信息并带上综合图层标识，渲染模块根据综合图层标识在综合图层渲染展示。
如图16所示，创建综合图层流程包括如下步骤1201至步骤1204。
步骤1201，图层管理模块接收到总控模块发出的创建综合图层命令。
步骤1202，图层管理模块创建一个综合图层，该图层是继承了视频图层和页面图层的所有特性，在页面图层的特性上面渲染视频，具 备了页面图层和视频图层两者的优点，在上面可以同时显示页面和视频。
步骤1203，图层管理模块设置该综合图层的层次高于页面图层和视频图层。
步骤1204，图层管理模块返回综合图层对应的信息给总控模块。
如图17所示，画中画视频播放处理流程包括如下步骤1301至步骤1305。
步骤1301，播控管理模块接收到总控模块的播放请求，该播放请求携带综合图层标识。
步骤1302，播控管理模块先向视频信息管理模块查询对应的视频信息。
步骤1303，播控管理模块将查询到的视频信息和综合图层标识发送给视频播放模块，指示视频播放模块去播放。
步骤1304，视频播放模块启动播放，并将视频和综合图层标识发送至渲染模块。
步骤1305，渲染模块在综合图层上渲染播放该视频。
如图18所示，画中画视频信息生成和查询流程包括如下步骤1401至步骤1405。
步骤1401，STB登陆平台成功，视频信息管理模块获取到画中画播放的视频资源。
步骤1402，视频信息管理模块保存画中画播放的视频信息。
步骤1403，视频信息管理模块接收到查询需要播放的视频信息。
步骤1404，视频信息管理模块查询上次播放过的视频信息。
步骤1405，视频信息模块返回查询到的视频信息。
(二)视频播放窗口属性变化流程(其中窗口属性变化主要有窗口位置上下左右移动、窗口大小缩放等)。
参照图19，包括如下步骤1501至步骤1508。
步骤1501，总控模块接收到窗口属性变化请求，该请求可通过用户按遥控器画中画快捷键实现。
步骤1502，总控模块给播控管理模块发送视频窗口属性变化请求。
步骤1503，播控管理模块把窗口属性变化信息转发给视频播放模块。
步骤1504，视频播放模块把窗口属性变化信息转发给渲染模块。
步骤1505，渲染模块处理完成。
步骤1506，总控模块给图层管理模块发送属性变化请求。
步骤1507，图层管理模块根据综合图层进行属性变化操作。
步骤1508，图层管理模块处理窗口属性变化完成。
(三)互动展示窗口属性变化流程(其中窗口属性变化主要有窗口位置上下左右移动、窗口大小缩放等)。
参照图20，包括如下步骤1601至步骤1607。
步骤1601，总控模块接收到窗口属性变化请求，该请求可通过用户按遥控器画中画快捷键实现。
步骤1602，总控模块给互动模块发送互动窗口属性变化请求。
步骤1603，互动模块把互动窗口属性变化信息发送给渲染模块。
步骤1604，渲染模块处理完成。
步骤1605，总控模块给图层管理模块发送窗口属性变化请求。
步骤1606，图层管理模块根据综合图层进行属性变化操作。
步骤1607，图层管理模块处理窗口属性变化完成。
(四)视频播放视频切换流程。
参照图21，包括如下步骤1701至步骤1707。
步骤1701，总控模块接收到视频切换请求，该请求可通过用户按遥控器画中画快捷键实现。
步骤1702，总控模块给播控管理模块发送视频切换请求。
步骤1703，播控管理模块向视频信息管理模块查询到对应的视频信息。
步骤1704，视频信息管理模块返回对应的视频信息。
步骤1705，播控管理模块通知视频播放模块去播放新的视频(即目标视频)。
步骤1706，视频播放模块将新的视频和综合图层标识发送给渲染模块。
步骤1707，渲染模块渲染播放新视频。
(五)关闭画中画视频播放流程。
参照图22，包括如下步骤1801至步骤1807。
步骤1801，总控模块收到画中画视频关闭请求，该请求可通过用户按遥控器画中画快捷键实现。
步骤1802，总控模块发给播控管理模块停止播放命令。
步骤1803，播控管理模块发停止播放命令给视频播放模块。
步骤1804，视频播放模块停止播放，发送停止播放命令给渲染模块。
步骤1805，渲染模块停止在综合图层渲染播放。
步骤1806，总控模块向图层管理模块发送综合图层关闭请求。
步骤1807，图层管理模块释放综合图层。
(六)关闭画中画互动展示流程。
参照图23，包括如下步骤1901至步骤1906。
步骤1901，总控模块收到画中画互动展示关闭请求，该请求可通过用户按遥控器画中画快捷键实现。
步骤1902，总控模块发给互动模块停止互动展示命令。
步骤1903，互动展示模块停止互动展示，发送互动展示命令给渲染模块。
步骤1904，渲染模块停止在综合图层互动展示。
步骤1905，总控模块向图层管理模块发送综合图层关闭请求。
步骤1906，图层管理模块释放综合图层。
(七)从画中画图层切换到当前活动应用窗口图层流程。
参照图24，包括如下步骤2001至步骤2004。
步骤2001，总控模块接收到画中画窗口切换到机顶盒当前活动应用窗口的按键请求。
步骤2002，总控模块判断当前画中画窗口是视频播放还是互动展示，如果是视频播放转到步骤2003，如果是互动展示，转到步骤2004。
步骤2003，总控模块处理画中画视频播放关闭流程，同图22流程。
总控模块把视频信息传递给当前活动应用窗口去展示，机顶盒当前活动应用窗口去播放画中画播放的视频信息，这样实现了一键从悬浮综合图层切到当前活动应用窗口(比如视频图层)的效果，方便了用户体验。
步骤2004，总控模块处理画中画互动展示关闭流程，同图23流程。
总控模块把互动信息传递给当前活动应用窗口去展示(比如页面图层)，机顶盒当前活动应用窗口去展示画中画互动信息，这样实现 了一键从悬浮图层切到当前活动应用窗口的效果，方便了用户体验。
下面以一些应用实例进行说明。
如图25所示，为悬浮画中画播放视频时序图，包括：视频播放流程、调整画中画窗口属性流程、视频播放视频切换流程、关闭画中画视频播放流程、画中画图层切换到当前活动应用窗口图层流程。
视频播放流程包括如下步骤2101至步骤2111。
步骤2101，用户按遥控器画中画快捷键，表示打开画中画播放。
步骤2102，总控模块接收到按键处理，判断需要打开悬浮画中画功能，通知图层管理模块。
步骤2103，图层管理模块创建综合图层，向总控模块返回创建完成消息。
步骤2104，总控模块判断是视频播放，通知播控管理模块播放视频，并通知播控管理模块综合图层标识。
步骤2105，播控管理模块向查询视频信息管理模块播放的视频信息。
步骤2106，视频信息管理模块向播控管理模块返回视频信息。
步骤2107，播控管理模块向视频播放模块发送视频播放请求。
步骤2108，视频播放模块将视频和综合图层标识发送给渲染模块。
步骤2109，渲染模块根据综合图层标识在综合图层中播放渲染视频。
步骤2110，视频播放模块向播控管理模块发送视频播放成功响应。
步骤2111，播控管理模块向总控模块发送视频播放成功响应。
调整画中画窗口属性流程包括如下步骤2112至步骤2120。
步骤2112，用户按遥控器画中画快捷键，表示调整画中画窗口属 性。
步骤2113，总控模块接收到按键处理，总控模块判断需要调整窗口属性，通知播控管理模块。
步骤2114，播控管理模块通知视频播放模块处理窗口属性变化。
步骤2115，视频播放模块通知渲染模块处理窗口属性变化。
步骤2116，渲染模块处理窗口属性变化完成，返回通知视频播放模块调整视频播放响应。
步骤2117，视频播放模块向播控管理模块返回通知调整视频播放响应。
步骤2118，播控管理模块向总控模块返回通知调整视频播放响应。
步骤2119，总控模块通知图层管理模块处理窗口属性变化。
步骤2120，图层管理模块处理图层属性变化完成，向总控模块返回调整图层属性响应。
视频播放视频切换流程包括如下步骤2121至步骤2129。
步骤2121，用户按遥控器画中画快捷键，表示进行视频切换。
步骤2122，总控模块接收到按键处理，判断需要视频切换，通知播控管理模块。
步骤2123，播控管理模块向视频信息管理模块查询到对应的视频信息。
步骤2124，视频信息管理模块返回对应的视频信息。
步骤2125，播控管理模块通知视频播放模块播放新的视频。
步骤2126，视频播放模块将新的视频和综合图层标识发送给渲染模块。
步骤2127，渲染模块根据综合图层标识在综合图层中播放渲染新的视频。
步骤2128，视频播放模块向播控管理模块发送新视频播放成功响 应。
步骤2129，播控管理模块向总控模块发送视频切换成功响应。
关闭画中画视频播放流程包括如下步骤2130至步骤2140。
步骤2130，用户按遥控器画中画快捷键，表示关闭画中画视频播放。
步骤2131，总控模块接收到按键处理，判断需要关闭悬浮画中画功能，向播控管理模块发送关闭画中画视频播放请求。
步骤2132，播控管理模块向视频播放模块触发停止播放请求。
步骤2133，视频播放模块停止播放，向渲染模块发送停止播放请求。
步骤2134，渲染模块停止播放，向视频播放模块发送停止播放响应。
步骤2135，视频播放模块向播控管理模块发送停止播放响应。
步骤2136，播控管理模块释放播控资源。
步骤2137，播控管理模块向总控模块发送停止播放响应。
步骤2138，总控模块向图层管理模块触发释放综合图层的请求。
步骤2139，图层管理模块释放综合图层。
步骤2140，图层管理模块向总控模块发送释放图层响应。
画中画图层切换到当前活动应用窗口图层流程包括如下步骤2141至步骤2143。
步骤2141，用户按遥控器画中画快捷键，表示画中画图层切换到当前活动应用窗口图层。
步骤2142，总控模块执行上述关闭画中画视频播放流程。
步骤2143，总控模块把视频信息传递给当前活动应用窗口播放。
如图26所示，为悬浮画中画互动展示时序图，包括：互动展示流程、调整画中画窗口属性流程、关闭画中画互动流程、画中画图层切换到当前活动应用窗口图层流程。
互动展示流程包括如下步骤2201至步骤2207。
步骤2201，用户按遥控器画中画快捷键，表示打开画中画互动展示。
步骤2202，总控模块接收到按键处理，判断需要打开悬浮画中画功能，通知图层管理模块。
步骤2203，图层管理模块创建综合图层，向总控模块返回创建完成消息。
步骤2204，总控模块判断是互动展示，通知互动模块，并通知互动模块综合图层标识。
步骤2205，互动模块处理发消息给渲染模块需要展示的信息并带上综合图层标识。
步骤2206，渲染模块根据综合图层标识在综合图层渲染展示。
步骤2207，互动模块向总控模块发送互动成功响应。
调整画中画窗口属性流程包括如下步骤2208至步骤2214。
步骤2208，用户按遥控器画中画快捷键，表示调整画中画窗口属性。
步骤2209，总控模块接收到按键处理，总控模块判断需要调整窗口属性，通知互动模块。
步骤2210，互动模块通知渲染模块处理窗口属性变化。
步骤2211，渲染模块处理窗口属性变化完成，返回通知互动模块调整互动展示响应。
步骤2212，互动模块向总控模块返回通知调整互动展示响应。
步骤2213，总控模块通知图层管理模块处理窗口属性变化。
步骤2214，图层管理模块处理图层属性变化完成，向总控模块返回调整图层属性响应。
关闭画中画互动流程包括如下步骤2215至步骤2223。
步骤2215，用户按遥控器画中画快捷键，表示关闭画中画互动展示。
步骤2216，总控模块接收到按键处理，判断需要关闭悬浮画中画功能，向互动模块发送关闭画中画互动展示请求。
步骤2217，互动模块停止互动展示，向渲染模块发送停止互动展示请求。
步骤2218，渲染模块停止互动展示，向互动模块发送停止互动展示响应。
步骤2219，互动模块释放互动资源。
步骤2220，互动模块向总控模块发送停止互动展示响应。
步骤2221，总控模块向图层管理模块触发释放综合图层的请求。
步骤2222，图层管理模块释放综合图层。
步骤2223，图层管理模块向总控模块发送释放图层响应。
画中画图层切换到当前活动应用窗口图层流程包括如下步骤2224至步骤2226。
步骤2224，用户按遥控器画中画快捷键，表示画中画图层切换到当前活动应用窗口图层。
步骤2225，总控模块执行上述关闭画中画互动流程。
步骤2226，总控模块把互动信息传递给当前活动应用窗口播放。
综上所述，本公开实施例提供的悬浮画中画实现视频播放和互动展示，使得用户在使用机顶盒各种应用的时候，可以不受影响同时使 用画中画功能，并随意缩放画中画窗口大小和移动画中画窗口位置，有效地提升了用户体验。因此本申请在机顶盒领域具有广泛的意义。
如图27所示，本公开实施例还提供一种实现画中画的装置，应用于机顶盒，包括：接收单元2301和展现单元2302。
其中，接收单元2301，配置为接收打开画中画的请求。
展现单元2302，配置为根据所述打开画中画的请求，在机顶盒当前应用的窗口之上，展现独立于所述机顶盒当前应用的悬浮画中画窗口。
本公开实施例中，悬浮画中画窗口与机顶盒当前应用分离，有效提高了用户体验度。
在一些实施例中，悬浮画中画窗口与所述机顶盒当前应用没有关联关系，且始终显示在所述机顶盒当前应用的窗口之上。
在一些实施例中，所述展现单元2302，配置为在机顶盒图层的顶层创建综合图层，通过所述综合图层展现所述悬浮画中画窗口；其中，所述综合图层用于进行视频播放和互动展示中的至少之一。
在一些实施例中，所述展现单元2302，配置为采样如下至少之一通过所述综合图层展现所述悬浮画中画窗口：1)确定所述悬浮画中画窗口的内容为视频时，获取所述视频对应的视频信息，根据所述视频信息，在所述综合图层上渲染播放所述视频；2)确定所述悬浮画中画窗口的内容为页面时，根据所述页面在所述综合图层上进行渲染互动展示。
在一些实施例中，所述展现单元2302，配置为获取上次悬浮画中画窗口退出时的视频信息，或者根据预设策略获取所述视频对应的视频信息。
在一些实施例中，所述展现单元2302，还配置为接收打开画中画的请求之后，根据所述打开画中画的请求，确定综合图层标识。
根据所述综合图层标识，确定显示内容的图层为所述综合图层。
在一些实施例中，所述装置还包括：调整单元；调整单元配置为根据接收到的调整画中画窗口属性的请求，调整所述悬浮画中画窗口的属性。
在一实施例中，所述调整所述悬浮画中画窗口的属性包括如下至少之一：调整所述悬浮画中画窗口的大小、调整所述悬浮画中画窗口的位置。
在一实施例中，所述装置还包括：关闭单元；关闭单元配置为根据接收到的关闭画中画的请求，关闭所述悬浮画中画窗口。
在一实施例中，所述关闭单元，还可配置为停止在综合图层上显示内容，释放所述综合图层。
在一实施例中，所述装置还包括：第一切换单元；第一切换单元配置为根据接收到的从画中画窗口切换到机顶盒当前活动应用窗口的请求，将综合图层上显示的内容传递至当前活动应用窗口进行显示，停止在所述综合图层上显示所述内容，释放所述综合图层。
在一实施例中，所述装置还包括：第二切换单元；第二切换单元配置为在所述悬浮画中画窗口的内容包括视频时，根据接收到的视频切换的请求，获取目标视频信息；以及，根据所述目标视频信息，通过所述悬浮画中画窗口播放所述目标视频信息对应的目标视频。
如图28所示，本公开实施例还提供一种机顶盒，包括：存储器2401、处理器2402及存储在存储器2401上并可在处理器2402上运行的计算机程序2403，所述处理器2402执行所述程序时实现前述实施例所提供的所述实现画中画的方法。
本公开实施例还提供一种计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令配置为被执行时实现前述实施例所提供的所述实现画中画的方法。
在本实施例中，上述存储介质可以包括但不限于：U盘、只读存储器(ROM，Read-Only Memory)、随机存取存储器(RAM，Random  Access Memory)、移动硬盘、磁碟或者光盘等各种可以存储程序代码的介质。
本领域普通技术人员可以理解，上文中所公开方法中的全部或某些步骤、系统、装置中的功能模块/单元可以被实施为软件、固件、硬件及其适当的组合。在硬件实施方式中，在以上描述中提及的功能模块/单元之间的划分不一定对应于物理组件的划分；例如，一个物理组件可以具有多个功能，或者一个功能或步骤可以由若干物理组件合作执行。某些组件或所有组件可以被实施为由处理器，如数字信号处理器或微处理器执行的软件，或者被实施为硬件，或者被实施为集成电路，如专用集成电路。这样的软件可以分布在计算机可读介质上，计算机可读介质可以包括计算机存储介质(或非暂时性介质)和通信介质(或暂时性介质)。如本领域普通技术人员公知的，术语计算机存储介质包括在用于存储信息(诸如计算机可读指令、数据结构、程序模块或其他数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机存储介质包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。此外，本领域普通技术人员公知的是，通信介质通常包含计算机可读指令、数据结构、程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据，并且可包括任何信息递送介质。

Claims (15)

  1. 一种实现画中画的方法，包括：
    接收打开画中画的请求；
    根据所述打开画中画的请求，在机顶盒当前应用的窗口之上，展现独立于所述机顶盒当前应用的悬浮画中画窗口。
  2. 如权利要求1所述的方法，其中，
    悬浮画中画窗口与所述机顶盒当前应用没有关联关系，且始终显示在所述机顶盒当前应用的窗口之上。
  3. 如权利要求1所述的方法，其中，所述展现独立于所述机顶盒当前应用的悬浮画中画窗口，包括：
    在机顶盒图层的顶层创建综合图层，通过所述综合图层展现所述悬浮画中画窗口；
    其中，所述综合图层用于进行视频播放和互动展示中的至少之一。
  4. 如权利要求3所述的方法，其中，所述通过所述综合图层展现所述悬浮画中画窗口，包括如下至少之一：
    确定所述悬浮画中画窗口的内容为视频时，获取所述视频对应的视频信息，根据所述视频信息，在所述综合图层上渲染播放所述视频；
    确定所述悬浮画中画窗口的内容为页面时，根据所述页面在所述综合图层上进行渲染互动展示。
  5. 如权利要求4所述的方法，其中，所述获取所述视频对应的视频信息，包括：
    获取上次悬浮画中画窗口退出时的视频信息，或者根据预设策略 获取所述视频对应的视频信息。
  6. 如权利要求3所述的方法，其中，所述接收打开画中画的请求之后，所述方法还包括：
    根据所述打开画中画的请求，确定综合图层标识；
    根据所述综合图层标识，确定显示内容的图层为所述综合图层。
  7. 如权利要求1所述的方法，其中，所述方法还包括：
    根据接收到的调整画中画窗口属性的请求，调整所述悬浮画中画窗口的属性。
  8. 如权利要求7所述的方法，其中，所述调整所述悬浮画中画窗口的属性包括如下至少之一：
    调整所述悬浮画中画窗口的大小、调整所述悬浮画中画窗口的位置。
  9. 如权利要求1所述的方法，其中，所述方法还包括：
    根据接收到的关闭画中画的请求，关闭所述悬浮画中画窗口。
  10. 如权利要求9所述的方法，其中，所述关闭所述悬浮画中画窗口，包括：
    停止在综合图层上显示内容，释放所述综合图层。
  11. 如权利要求1所述的方法，其中，所述方法还包括：
    根据接收到的从画中画窗口切换到机顶盒当前活动应用窗口的请求，将综合图层上显示的内容传递至当前活动应用窗口进行显示，停止在所述综合图层上显示所述内容，释放所述综合图层。
  12. 如权利要求1所述的方法，其中，所述悬浮画中画窗口的内容包括视频，所述方法还包括：
    根据接收到的视频切换的请求，获取目标视频信息；
    根据所述目标视频信息，通过所述悬浮画中画窗口播放所述目标视频信息对应的目标视频。
  13. 一种实现画中画的装置，包括：
    接收单元，配置为接收打开画中画的请求；
    展现单元，配置为根据所述请求，在机顶盒当前应用的窗口之上，展现独立于所述机顶盒当前应用的悬浮画中画窗口。
  14. 一种机顶盒，包括：存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序，其中，所述处理器执行所述程序时实现如权利要求1至12中任意一项所述实现画中画的方法。
  15. 一种计算机可读存储介质，存储有计算机可执行指令，所述计算机可执行指令被执行时实现权利要求1至12中任意一项所述实现画中画的方法。
PCT/CN2019/115625 2018-12-29 2019-11-05 一种实现画中画的方法、装置和机顶盒 WO2020134592A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811633998.3 2018-12-29
CN201811633998.3A CN111385628A (zh) 2018-12-29 2018-12-29 一种实现画中画的方法、装置和机顶盒

Publications (1)

Publication Number Publication Date
WO2020134592A1 true WO2020134592A1 (zh) 2020-07-02

Family

ID=71128591

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/115625 WO2020134592A1 (zh) 2018-12-29 2019-11-05 一种实现画中画的方法、装置和机顶盒

Country Status (2)

Country Link
CN (1) CN111385628A (zh)
WO (1) WO2020134592A1 (zh)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114125135B (zh) * 2021-11-08 2023-07-04 北京百度网讯科技有限公司 一种视频内容呈现方法、装置、电子设备和存储介质
CN114979748B (zh) * 2022-05-24 2024-02-23 上海哔哩哔哩科技有限公司 视频处理方法及装置

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101465995A (zh) * 2008-11-14 2009-06-24 深圳创维数字技术股份有限公司 数字电视机顶盒、用于窗口布局的管理设备与方法
CN101583019A (zh) * 2009-06-01 2009-11-18 中兴通讯股份有限公司 一种在网络电视中实现画中画的方法、系统及机顶盒
CN101702764A (zh) * 2009-10-26 2010-05-05 深圳市同洲电子股份有限公司 一种播放视频的方法、系统及对应的机顶盒
CN102710992A (zh) * 2012-03-22 2012-10-03 华为技术有限公司 一种互动消息展示方法、装置及系统
CN105786346A (zh) * 2016-02-25 2016-07-20 彭茂笑 一种智能终端操作界面间切换的方法
CN106980441A (zh) * 2017-03-29 2017-07-25 杭州弗凡科技有限公司 车载导航终端的悬浮窗口交互方法及车载导航终端
US10070186B1 (en) * 2017-12-07 2018-09-04 Arris Enterprises Llc Method to intelligently monitor, detect and display simultaneous independent videos on a display

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101742173B (zh) * 2008-11-12 2012-05-16 中兴通讯股份有限公司 一种支持观看两路视频的方法及网络互动电视系统
US8448210B2 (en) * 2009-09-30 2013-05-21 Echostar Technologies L.L.C. Apparatus, systems and methods for rich media electronic program guides

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101465995A (zh) * 2008-11-14 2009-06-24 深圳创维数字技术股份有限公司 数字电视机顶盒、用于窗口布局的管理设备与方法
CN101583019A (zh) * 2009-06-01 2009-11-18 中兴通讯股份有限公司 一种在网络电视中实现画中画的方法、系统及机顶盒
CN101702764A (zh) * 2009-10-26 2010-05-05 深圳市同洲电子股份有限公司 一种播放视频的方法、系统及对应的机顶盒
CN102710992A (zh) * 2012-03-22 2012-10-03 华为技术有限公司 一种互动消息展示方法、装置及系统
CN105786346A (zh) * 2016-02-25 2016-07-20 彭茂笑 一种智能终端操作界面间切换的方法
CN106980441A (zh) * 2017-03-29 2017-07-25 杭州弗凡科技有限公司 车载导航终端的悬浮窗口交互方法及车载导航终端
US10070186B1 (en) * 2017-12-07 2018-09-04 Arris Enterprises Llc Method to intelligently monitor, detect and display simultaneous independent videos on a display

Also Published As

Publication number Publication date
CN111385628A (zh) 2020-07-07

Similar Documents

Publication Publication Date Title
US8837919B2 (en) Information processing apparatus, information processing method, and program
JP5783245B2 (ja) カスタマイズされたフォーマットに従ってビデオストリームを表示する方法
US11405437B2 (en) Media seek mechanisms
CA2738911C (en) Video branching
WO2017181604A1 (zh) 一种视频预览方法、装置及电子设备
WO2017181599A1 (zh) 一种显示视频的方法及装置
RU2543936C2 (ru) Воспроизведение с быстрым доступом к объектам видеоданных
CN106686446B (zh) 内容投射方法及移动终端
CN104994314A (zh) 在移动终端上通过手势控制画中画视频的方法及系统
CN103581754A (zh) 一种数据显示方法及智能设备
WO2015070546A1 (zh) 一种pip播放的方法及终端
WO2013189179A1 (zh) 马赛克视频呈现的方法、显示控制装置及终端
KR101913254B1 (ko) 서비스 처리 장치 및 서비스 처리 방법
WO2020134592A1 (zh) 一种实现画中画的方法、装置和机顶盒
CN105791914A (zh) 播放控制方法和装置
US10462531B2 (en) Methods, systems, and media for presenting an advertisement while buffering a video
US20180197509A1 (en) Information processing device, information processing method, and program
KR20190008772A (ko) 관심 객체 중점 재생 기능을 구비한 영상 재생 장치
CN115379277B (zh) 一种基于iptv业务的vr全景视频播放方法和系统
US9721615B2 (en) Non-linear video review buffer navigation
US20130229575A1 (en) Digital TV Data Processing Method and System Thereof
US11800194B2 (en) Method and device for loading electronic program guide, and non-transitory computer-readable storage medium
CN115643454A (zh) 显示设备、视频播放方法及其装置
CN115119022A (zh) 一种跳过视频广告的控制方法及显示设备
US11778275B2 (en) Information processing terminal, information processing method, and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19902207

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 11/11/2021)

122 Ep: pct application non-entry in european phase

Ref document number: 19902207

Country of ref document: EP

Kind code of ref document: A1