CN117641024A - Display equipment and media data display method - Google Patents

Abstract

Some embodiments of the present application show a display device and a media data display method, where the method includes: acquiring first media asset data; decoding the first media asset data by using a first hardware decoder, and displaying the decoded first media asset data in a first playing window; downloading second media asset data; if the controller comprises a second hardware decoder, sending the second media asset data to the second hardware decoder so that the second hardware decoder decodes the second media asset data and displays the decoded second media asset data in a second playing window; suspending playing the second media asset data; and setting a preset area of the first playing window to be in a transparent state, wherein the position of the preset area has an association relation with the display position of the second playing window. The method can enable the user to forecast the second media data to be played through the small window when watching the first media data, reduce abrupt sense of suddenly inserting the second media data, and improve user experience.

Description

Display equipment and media data display method

Technical Field

The application relates to the technical field of display equipment, in particular to display equipment and a media data display method.

Background

The use scene of the digital television comprises a newer scene, namely, when broadcasting programs, advertisements from broadband are dynamically inserted, so that the flexibility of advertisement delivery is improved.

Aiming at the problem, the solution is to reduce the delay of inserting and playing the advertisement by means of decoding the advertisement video frame in advance and the like when the broadband advertisement needs to be played, so that the time node needing to play the broadband advertisement is quickly switched to the advertisement, and the user has a very abrupt feeling due to the small correlation between the advertisement content and the current broadcast content, thereby reducing the watching experience of the user.

Disclosure of Invention

Some embodiments of the present application provide a display device and a method for displaying media data, where a user predicts second media data to be played through a small window when watching first media data, so as to reduce abrupt sense of suddenly inserting the second media data, and improve user experience.

In a first aspect, some embodiments of the present application provide a display device, including:

a display configured to display a first play window;

a controller configured to:

acquiring first media asset data;

decoding the first media asset data by using a first hardware decoder, and transmitting the decoded first media asset data to a display so that the display displays the decoded first media asset data in a first playing window;

Downloading second media asset data;

if a second hardware decoder is configured in the controller, sending the second media asset data to the second hardware decoder, so that the second hardware decoder decodes the second media asset data, and sending the decoded second media asset data to a display, so that the display displays the decoded second media asset data in a second play window, wherein the second play window is arranged at the lower layer of the first play window;

suspending playing the second media asset data;

and setting a preset area of the first playing window to be in a transparent state, wherein the position of the preset area has an association relation with the display position of the second playing window.

In some embodiments, the controller is configured to:

and controlling the display to display the forenotice characters and the countdown information of the second media data in a browser window, wherein the browser window is arranged on the upper layer of the first playing window.

In some embodiments, the controller executing the downloading of the second media asset data is further configured to:

acquiring playing parameters of second media asset data, wherein the playing parameters comprise video objects and playing time of the second media asset data;

Acquiring a film source address in the video object when a first time point is reached, wherein the first time point is a time point of a first preset duration before the playing time;

if the second media data is streaming media data, initiating a data request according to the film source address, downloading streaming media files and analyzing a streaming media protocol; downloading second media asset data according to the streaming media file and the streaming media protocol;

and if the second media asset data is not streaming media data, initiating a data request according to the film source address, and downloading the second media asset data.

In some embodiments, the controller performs setting the preset area of the first play window to a transparent state, and is further configured to:

and setting a preset area of the first playing window to be in a transparent state when a second time point is reached, wherein the second time point is a time point with a second preset duration before the playing time, and the second preset duration is smaller than the first preset duration.

In some embodiments, the controller is configured to:

and stopping playing the first media data when the playing time of the second media data is reached, and starting playing the second media data, wherein the second playing window is arranged on the upper layer of the first playing window, and the display size of the second playing window is the same as the display size of the display area.

In some embodiments, the controller is configured to:

if the controller is not configured with a second hardware decoder, sending a first section of media data in the second media data to a browser decoding module, wherein the first section of media data is second media data with a preset frame number;

and decoding the target frame video data by using the browser decoding module and sending the target frame video data to a display so that the display can display the decoded target frame video data in a browser window, wherein the browser window is arranged on the upper layer of the first playing window.

In some embodiments, the controller is configured to:

and controlling the display to display the forenotice characters and the countdown information of the second media data in the browser window.

In some embodiments, the controller is configured to:

decoding the first section of media asset data by utilizing the browser decoding module;

when the playing time of the second media data is reached, displaying the decoded first section of media data in the browser window, wherein the display size of the browser window is the same as the display area of the display;

transmitting second section of media data in the second media data to a first hardware decoder so that the first hardware decoder decodes the second section of media data, wherein the second section of media data is data except the first section of media data in the second section of media data;

And after the playing of the first section of media data is finished, setting the browser window to be in a transparent state, and playing the decoded second section of media data in the first playing window.

In a second aspect, some embodiments of the present application provide a media data display method, including:

acquiring first media asset data;

decoding the first media asset data by using a first hardware decoder, and transmitting the decoded first media asset data to a display so that the display displays the decoded first media asset data in a first playing window;

downloading second media asset data;

if the controller comprises a second hardware decoder, sending the second media asset data to the second hardware decoder so that the second hardware decoder decodes the second media asset data and sends the decoded second media asset data to a display so that the display displays the decoded second media asset data in a second play window, wherein the second play window is arranged at the lower layer of the first play window;

suspending playing the second media asset data;

and setting a preset area of the first playing window to be in a transparent state, wherein the position of the preset area corresponds to the display position of the second playing window.

In some embodiments, the method further comprises:

and controlling the display to display the second media data forenotice words and the countdown information in a browser window, wherein the browser window is arranged on the upper layer of the first playing window.

Some embodiments of the present application provide a display device and a method for displaying media data, where a user obtains a playing time of second media data when viewing first media data. Downloading the second media data in advance before playing the second media data, decoding the second media data by a second hardware decoder, suspending playing the second media data, and displaying the decoded first frame data by a second playing window at the lower layer of the current first playing window. Before the second media data is played, a transparent state is set for a preset area of the first playing window, so that the first frame of the second media data of the second playing window is displayed. According to the embodiment of the application, the second media data to be played is predicted through the small window, the abrupt sense of suddenly inserting the second media data is reduced, and the user experience is improved.

Drawings

FIG. 1 illustrates an operational scenario between a display device and a control apparatus according to some embodiments;

Fig. 2 shows a hardware configuration block diagram of the control device 100 according to some embodiments;

fig. 3 illustrates a hardware configuration block diagram of a display device 200 according to some embodiments;

FIG. 4 illustrates a software configuration diagram in a display device 200 according to some embodiments;

FIG. 5 illustrates a flow chart of a method of media data display provided in accordance with some embodiments;

FIG. 6 illustrates a flow chart of a method of downloading second media asset data provided in accordance with some embodiments;

FIG. 7 illustrates a schematic diagram of a user interface provided in accordance with some embodiments;

FIG. 8 illustrates a schematic diagram of a user interface provided in accordance with some embodiments;

FIG. 9 illustrates a schematic diagram of a user interface provided in accordance with some embodiments;

FIG. 10 illustrates a schematic diagram of a user interface provided in accordance with some embodiments;

FIG. 11 illustrates a schematic diagram of a user interface provided in accordance with some embodiments;

FIG. 12 illustrates a schematic diagram of a user interface provided in accordance with some embodiments;

FIG. 13 illustrates a schematic diagram of a user interface provided in accordance with some embodiments;

FIG. 14 illustrates a schematic diagram of a user interface provided in accordance with some embodiments.

Detailed Description

For purposes of clarity and implementation of the present application, the following description will make clear and complete descriptions of exemplary implementations of the present application with reference to the accompanying drawings in which exemplary implementations of the present application are illustrated, it being apparent that the exemplary implementations described are only some, but not all, of the examples of the present application.

It should be noted that the brief description of the terms in the present application is only for convenience in understanding the embodiments described below, and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms first, second, third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The display device provided in the embodiment of the application may have various implementation forms, for example, may be a television, an intelligent television, a laser projection device, a display (monitor), an electronic whiteboard (electronic bulletin board), an electronic desktop (electronic table), and the like. Fig. 1 and 2 are specific embodiments of a display device of the present application.

Fig. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display device 200 through the smart device 300 or the control apparatus 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the display device 200 is controlled by a wireless or wired mode. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc.

In some embodiments, a smart device 300 (e.g., mobile terminal, tablet, computer, notebook, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on a smart device.

In some embodiments, the display device may receive instructions not using the smart device or control device described above, but rather receive control of the user by touch or gesture, or the like.

In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received through a module configured inside the display device 200 device for acquiring voice commands, or the voice command control of the user may be received through a voice control device configured outside the display device 200 device.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and function as an interaction between the user and the display device 200.

As shown in fig. 3, the display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

In some embodiments the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.

The display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, a component for receiving an image signal from the controller output, displaying video content, image content, and a menu manipulation interface, and a user manipulation UI interface.

The display 260 may be a liquid crystal display, an OLED display, a projection device, or a projection screen.

The display 260 further includes a touch screen, and the touch screen is used for receiving an action input control instruction such as sliding or clicking of a finger of a user on the touch screen.

The communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display device 200 may establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.

A user interface, which may be used to receive control signals from the control device 100 (e.g., an infrared remote control, etc.).

The detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; alternatively, the detector 230 includes an image collector such as a camera, which may be used to collect external environmental scenes, user attributes, or user interaction gestures, or alternatively, the detector 230 includes a sound collector such as a microphone, or the like, which is used to receive external sounds.

The external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, or the like. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

The modem 210 receives broadcast television signals through a wired or wireless reception manner, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

The controller 250 controls the operation of the display device and responds to the user's operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments the controller includes at least one of a central processing unit (Central Processing Unit, CPU), video processor, audio processor, graphics processor (Graphics Processing Unit, GPU), RAM Random Access Memory, RAM), ROM (Read-Only Memory, ROM), first to nth interfaces for input/output, a communication Bus (Bus), and the like.

The user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

A "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user, which enables conversion between an internal form of information and a user-acceptable form. A commonly used presentation form of the user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

As shown in fig. 4, the system of the display device is divided into three layers, an application layer, a middleware layer, and a hardware layer, from top to bottom.

The application layer mainly comprises common applications on the television, and an application framework (Application Framework), wherein the common applications are mainly applications developed based on Browser, such as: HTML5 APPs; native applications (Native APPs);

the application framework (Application Framework) is a complete program model with all the basic functions required by standard application software, such as: file access, data exchange, and the interface for the use of these functions (toolbar, status column, menu, dialog box).

Native applications (Native APPs) may support online or offline, message pushing, or local resource access.

The middleware layer includes middleware such as various television protocols, multimedia protocols, and system components. The middleware can use basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, so that the purposes of resource sharing and function sharing can be achieved.

The hardware layer mainly comprises a HAL interface, hardware and a driver, wherein the HAL interface is a unified interface for all the television chips to be docked, and specific logic is realized by each chip. The driving mainly comprises: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

In some embodiments, it may be desirable to insert the second asset data at a predetermined point in time during the playing of the first asset data. For example: in broadcasting video, it is necessary to switch the advertisement from broadband. For example: the application of Hbbtv (Hybrid Broadcast/Broadband TV) inserts TA (Targeted Advertising, targeted advertisement) from Broadband. When the broadband advertisement needs to be played, the delay of inserting the played advertisement is reduced by means of decoding advertisement video frames in advance, so that the time node needing to play the broadband advertisement is quickly switched to the advertisement, and the user has a very abrupt feeling due to the fact that the correlation between the advertisement content and the current broadcast content is small, the switching operation is unknown to the user, and the watching experience of the user is reduced.

In order to solve the above technical problems, the embodiments of the present application provide a display device 200, and the structure and the functions of each part of the display device 200 may refer to the above embodiments. In addition, on the basis of the display device 200 shown in the above embodiment, the present embodiment further improves some functions of the display device 200, and as shown in fig. 5, the controller 250 performs the following steps:

The controller 250 performs step S501: acquiring first media asset data;

in some embodiments, the first media asset data is broadband video data or media asset data corresponding to a network channel. Receiving an instruction of playing the first media asset data input by a user, acquiring a storage address of the first media asset data, and acquiring the first media asset data from the storage address. The first media asset data includes first video data and first audio data. The first video data is video stream data, and the first audio data is audio stream data. In the downloading process, it is necessary to sequentially download audio data and video data of one frame into the display device 200.

In some embodiments, the video data and the audio data of the first media data may be stored in the same storage address, and the video data and the audio data may also be stored in different storage addresses, respectively, but when downloading the data, the video data and the audio data need to be downloaded to the display device 200 at the same time.

In some embodiments, the first media asset data is media asset data corresponding to a broadcast channel. The method includes receiving a user input instruction to open a broadcast channel, sampling an analog signal by a tuner-demodulator, and converting the analog signal into a digital signal stream, the signal stream including first media data. After the conversion, transmitting the first media asset data to a demultiplexer; and performing demultiplexing operation on the first media data through a demultiplexer. The first media asset data includes first video data and first audio data.

The controller 250 performs step S502: and decoding the first media asset data by using the first hardware decoder, and sending the decoded first media asset data to the display so that the display displays the decoded first media asset data in the first playing window.

In some embodiments, controller 250 includes at least one hardware decoder. If the controller 250 includes only one hardware decoder, the display device supports one-way hardware decoding; if the controller 250 includes two or more hardware decoders, the display device supports multiple hardware decoding.

In some embodiments, the acquired first media asset data is in an encoded format, the display device cannot directly display and play the first media asset data, the first media asset data needs to be sent to a decoder for decoding, and the decoded first media asset data can be displayed and played by the display device. The decoder includes a hardware decoder and a software decoder. The hardware decoder decodes the video stream using GPU (Graphics Processing Unit, graphics processor) resources.

In some embodiments, the demultiplexed first media asset data is sent to a first hardware decoder. The first hardware decoder decodes the first video data in the first media data to obtain decoded first video data, sends the decoded first video data to the graphics rendering module for processing, and displays the decoded first video data on the first playing window by the display 260. The first hardware decoder decodes the first audio data in the first media data to obtain decoded first audio data, sends the decoded first audio data to the audio output interface 270, and plays the decoded first audio data by the audio output interface. The first video data displayed by the display 260 corresponds to the first audio data played by the audio output interface 270, so as to achieve the purpose of audio-video synchronization.

The controller 250 performs step S503: downloading second media asset data;

in some embodiments, a playing time of the second media asset data is obtained before the second media asset data is downloaded.

The playing time of the second media data is the time for switching the first media data to the second media data.

In some embodiments, the controller 250 invokes the browser interface to pass the relevant playback parameters for the second media asset data insertion. Wherein the associated playback parameters include a presentation time stamp (Presentation Time Stamp, PTS) for playing back the second media asset data.

In some embodiments, the playing time of the second media asset data is a system time. For example: the playing time of the second media asset data is set to be 8:00:00 am.

In some embodiments, the playing time of the second media asset data is a playing time length of the first media asset data. For example: the first media asset data is broadcast video, timing is started from the user to switch to a broadcast channel, and when the watching time of the user reaches 30 minutes, the second media asset data starts to be played. Or, the first media asset data is a broadband video, and the statistics of the viewing duration is started when the user starts playing the broadband video, wherein the user does not count the viewing duration in the time of fast forward, fast backward and pause. And when the watching time of the user reaches 30 minutes, starting to play the second media data.

In some embodiments, the playing time of the second media asset data is the time displayed by the playing progress bar of the first media asset data. For example: the playing time of the second media data is 00:15:00 of the playing progress bar of the first media data.

In some embodiments, the second media asset data includes second video data and second audio data. The second media asset data is a broadband video, can be an advertisement video, can be media asset data to be played next to the first media asset data, and can be a propaganda film, a highlight film or a clip film of the next media asset data of the first media asset data.

In some embodiments, the second media asset data may be downloaded prior to playing the second media asset data, for example: downloading second media asset data when a first time point is reached, wherein the first time point is a time point of a first preset duration before the playing time;

in some embodiments, the playing time of the second media asset data is 8:00:00 am, and the first preset duration is 30 seconds. And when the system time reaches 7:59:30, downloading the second media asset data.

In some embodiments, the playing time of the second media data is 30 minutes of the playing time of the first media data, the first preset time is 30 seconds, and when the playing time of the first media data is 29 minutes and 30 seconds, the second media data is downloaded.

In some embodiments, the playing time of the second media data is 00:15:00 displayed by the playing progress bar of the first media data, and the first preset duration is 30 seconds. And downloading the second media data when the time displayed by the first media data playing progress bar is 00:14:30.

In some embodiments, the controller 250 invokes the browser interface to pass the relevant playback parameters for the second media asset data insertion. Wherein, the relevant playing parameters also comprise Video (Video) objects corresponding to the second media data. The nature of a video object is a kind of tag.

As shown in fig. 6, the step of downloading the second media asset data includes:

step S601, obtaining a slice source address in the video object, that is, obtaining an src attribute from the video object, where the src attribute includes a URL (uniform resource locator ), specifically referring to the slice source address.

Step S602: judging whether the second media data is streaming media data or not;

in some embodiments, the step of determining whether the second media asset data is streaming media data comprises:

acquiring a file suffix of second media asset data or acquiring the file suffix of the second media asset data from a video object;

If the file suffix of the second media asset data is the stream media file suffix, the second media asset data is stream media data;

and if the file suffix of the second media asset data is not the streaming media file suffix, the second media asset data is not the streaming media data.

For example, if the file suffix of the obtained second media asset data is mpd, the second media asset data is streaming media data; if the file suffix of the acquired second media asset data is not. Mpd but. Mp4 or. M3u8, etc., the second media asset data is not streaming media data.

If the second media data is streaming media data, executing step S603, initiating a data request according to the film source address, downloading streaming media files and analyzing streaming media protocol; downloading second media asset data according to the streaming media file and the streaming media protocol;

and initiating an http request according to the URL in the src attribute, downloading a streaming media manifest file, analyzing a streaming media protocol, and downloading second media asset data. The essence of the manifest file is an XML file, and the information such as the storage address of the video slice of the second media data stream media contained in the manifest file can be obtained by analyzing the stream media protocol, and the second media data can be downloaded according to the storage address.

If the second media asset data is not streaming media data, step S604 is executed to initiate a data request according to the source address, and download the second media asset data, i.e. initiate an http request according to the URL in the src attribute, and download the second media asset data.

In some embodiments, the downloaded second asset data is transmitted to the demultiplexer, so that the demultiplexer performs a demultiplexing operation on the second asset data.

The controller 250 performs step S504: judging whether the controller comprises a second hardware decoder or not;

in some embodiments, capabilities (capabilities) of the display device may be obtained, where the capabilities of the display device include the display device supporting several hardware decodes. When the controller 250 has only one hardware decoder, the capability of the display device is to support single-pass hardware decoding, i.e., the display device can only decode and display one audio/video data at a time. When the controller 250 has two hardware decoders, the capability of the display device is to support two-way hardware decoding, i.e., the display device can simultaneously decode and display two audio/video data.

In some embodiments, the hardware decoding capabilities of the display device may also be acquired separately.

The step of determining whether the controller includes a second hardware decoder includes:

acquiring the hardware decoding capability of the display device;

judging whether the hardware decoding of the display equipment is the single-path hardware decoding capability or not;

if the hardware decoding of the display device is a one-way hardware decoding capability, determining that the controller does not include a second hardware decoder;

if the hardware decoding of the display device is not a one-way hardware decoding capability, it is determined that the controller includes a second hardware decoder.

If the controller includes a second hardware decoder, the controller 250 performs step S505: the second media asset data is sent to the second hardware decoder, so that the second hardware decoder decodes the second media asset data, and the decoded second media asset data is sent to the display, so that the display displays the decoded second media asset data in a second playing window;

in some embodiments, the demultiplexed second asset data is sent to a second hardware decoder. The second hardware decoder decodes the second video data in the second media data to obtain decoded second video data, sends the decoded second video data to the graphics rendering module for processing, and displays the decoded second video data in the second play window by the display 260. The second hardware decoder decodes the second audio data in the second media data to obtain decoded second audio data, and sends the decoded second audio data to the audio output interface 270.

The controller 250 performs step S506: and pausing playing the second media asset data.

And calling a pause interface of the bottom layer second hardware decoder to pause the playing of the second media data, and setting the size and the position of a second playing window. The second playing window is arranged on the lower layer of the first playing window.

In some embodiments, the decoded second video data is decoded at the second hardware decoder and rendered before being displayed by the second playback window. Since the playing of the second media data is paused at this time, the current second playing window displays the first frame of the second video data, but does not play the second audio data.

In some embodiments, the first frame second video data may be set to be representative pictures. For example: the advertiser may set the advertised icon picture or logo product picture as the first frame video data of the advertising video. The first frame of video data of a movie play may be a picture with a highlight or a text picture containing a brief introduction to the highlight.

In some embodiments, the second playing window is disposed as close to the edge area of the display as possible, so as to avoid occupying the display key area of the first playing window. For example: the second playing window is arranged at four corners of the display area of the display. The display area of the second playing window is far smaller than the display area of the display, so that the second playing window does not occupy the display area of the first playing window as much as possible, and the user can see the content of the second playing window clearly.

It should be noted that, in the process of downloading the second media asset data to play the second media asset data, the first media asset data is normally played, that is, the first media asset data is still normally executed to be acquired, the first hardware decoder is used to decode the first media asset data, and the decoded first media asset data is sent to the display, so that the display displays the decoded first media asset data in the first playing window. Since the first playing window is played in full screen and is arranged on the upper layer of the second playing window, the display content of the second playing window can be shielded, as shown in fig. 7.

The controller 250 performs step S507: and setting a preset area of the first playing window to be in a transparent state, wherein the position of the preset area has an association relation with the display position of the second playing window.

In some embodiments, after the display displays the decoded second media data in the second playing window and pauses playing the second media data, the preset area of the first window may be directly set to a transparent state.

In some embodiments, the preset area of the first playing window is set to be in a transparent state when a second time point is reached, where the second time point is a time point of a second preset duration before the playing time, and the first preset duration is longer than the second preset duration.

In some embodiments, the playing time of the second media asset data is 8:00:00 am, and the second preset duration is 10 seconds. And when the system time reaches 7:59:50, setting the preset area of the first playing window to be in a transparent state.

In some embodiments, the playing time of the second media asset data is 30 minutes of the playing time of the first media asset data, the second preset time is 10 seconds, and when the playing time of the first media asset data is 29 minutes and 50 seconds, the preset area of the first playing window is set to be in a transparent state.

In some embodiments, the playing time of the second media data is 00:15:00 displayed by the playing progress bar of the first media data, and the second preset duration is 10 seconds. And when the time 00:14:50 displayed by the first media data playing progress bar, setting the preset area of the first playing window to be in a transparent state.

It should be noted that the fact that the position of the preset area and the display position of the second playing window have an association relationship means that the preset area and the display area of the second playing window in the display are the same, so that the content of the second playing window located at the lower layer can be displayed to the user, as shown in fig. 8.

In some embodiments, the controller 250 also performs: and controlling the display to display the forenotice characters and the countdown information of the second media data in a browser window before the second media data are played, wherein the browser window is arranged on the upper layer of the first playing window.

In some embodiments, a browser window may be disposed at an upper layer of the first play window, and the second media asset data preview text and the countdown information may be displayed on the browser window. Wherein, the browser window is transparent except for the forenotice text and the countdown information, so that the playing of the first media data and the displaying of the first frame of video data of the second media data are not affected, as shown in fig. 9.

By way of example, the advance notice text and countdown information may be "10 seconds later an advertisement from the internet will be played" and the countdown time will change over time. The user can further know that the advertisement corresponding to the second playing window is played after 10 seconds, abrupt sense of suddenly switching the video is avoided, and meanwhile, the user can switch channels or perform other operations in time when the user does not want to see the advertisement.

By way of example, the countdown information for the trailer may be "10 seconds later will play an XXX movie play" and the countdown time changes over time. The user can further know that the movie corresponding to the second playing window will be played after 10 seconds, so that the user can know the next movie to be played in advance.

In some embodiments, the controller 250 also performs: and when a second preset time period is reached before the second media data is played, the playing interface of the bottom layer second hardware decoder is called to start playing the second media data while the preset area of the first playing window is set to be in a transparent state, wherein the second video data in the second media data is normally displayed by the display 260, and the second audio data in the second media data is silently played or not played. And the media asset data of the first second preset duration of the second media asset data can be set as silent media asset data so as to avoid affecting the playing of the first audio data. The media asset data of the second preset duration before the second media asset data can be a clipping version of advertisement video data, a propaganda film, a highlight or a clipping fragment of a movie, so that a user can know the general content of an advertisement or a next video in advance and then decide whether to continue watching or not. The second media data is positive content except the media data of the previous second preset time length. For example, the clip content is played in a small window 10 seconds before the second media asset data, and the feature is played in a full-screen window 10 seconds after the second media asset data.

In some embodiments, the controller 250 also performs: and calling a starting interface of a bottom layer second hardware decoder to start playing the second media data for a third preset time before the second media data is played. The display 260 normally displays the second video data in the second media data, and the second audio data in the second media data is played or not played in a mute mode. The media asset data of the first third preset duration of the second media asset data can also be set as silent media asset data so as to avoid affecting the playing of the first audio data. The first preset duration of the second media asset data may be a clip version of advertisement video data, a trailer of a movie, a highlight or a clip, so that the user can know the general content of the advertisement or the next video in advance and decide whether to continue watching. The second media data is positive content except the media data of the first third preset duration. The third preset time period is smaller than the second preset time period.

The controller 250 performs step S508: and when the playing time of the second media data is reached, the first media data is paused to be played, and the second media data starts to be played, wherein the second playing window is arranged on the upper layer of the first playing window, and the display size of the second playing window is the same as the display area of the display.

In some embodiments, upon arrival of the second media data playback time, a pause interface of the underlying first hardware decoder is invoked to pause the playback of the first media data. And calling a playing interface of the bottom layer second hardware decoder to start playing the second media data. The second playing window is changed into a full-screen state, and the second playing window is arranged on the upper layer of the first playing window, so that the current display displays the second media data in a full-screen mode, as shown in fig. 10.

In some embodiments, the up and down positions of the first playing window and the second playing window may not be changed, and instead the first playing window may be set to a transparent state, so that the current display 260 displays the second playing window in full screen, as shown in fig. 11.

In some embodiments, the second playback window has a display size that is smaller than a size of the display area of the display.

In some embodiments, when the second media data playing time is reached, the browser window cancels displaying the second media data forenotice text and the countdown information, i.e. the browser window is set to a full transparent state.

In some embodiments, when the second playing window is in the small window state, the second playing window is already in the playing state, and when the playing time of the second media data is reached, the playing interface of the bottom layer second hardware decoder is not required to be called again, and the second playing window is directly displayed.

If the controller includes a second hardware decoder, the controller 250 performs step S509: sending a first section of media data in the second media data to a browser decoding module, wherein the first section of media data is second media data with a preset frame number;

in some embodiments, the key frame interval of the second media asset data is obtained, and the first media asset data is the second media asset data with the number of frames corresponding to an integer multiple of the key frame interval. For example: the key frame interval of the second media data is 60 frames, and the first media data may be the second media data of the first 60 frames, or the second media data of the first 120 frames, etc.

The key frame, also called I frame, is usually the first frame of each GOP (Group of Pictures ), and is moderately compressed to serve as a reference point for random access, and can be used as an image. GOP is a video compression technique used by MPEG. Key frames, which are important frames in inter-frame compression coding; it is a full frame compressed coded frame; the complete image can be reconstructed only by using the data of the key frame during decoding; the key frame is generated without reference to other pictures.

The controller 250 performs step S510: and decoding the target frame video data by using the browser decoding module and sending the target frame video data to a display so that the display can display the decoded target frame video data in a browser window, wherein the browser window is arranged on the upper layer of the first playing window.

In some embodiments, after the first segment of the second media asset data is sent to the browser decoding module, the target frame video data may be directly decoded by the browser decoding module and sent to the display.

In some embodiments, the target frame video data is decoded and sent to the display using the browser decoding module for a second predetermined duration before reaching the second media data play.

In some embodiments, decoding the target frame video data using the browser decoding module is essentially decoding the target frame video data by a soft decoding technique. Wherein the target frame video data is the first key frame video data. If the first piece of video data contains a plurality of key frame video data, the target frame video data may also be set to other key frame video data.

In some embodiments, the demultiplexed first piece of media asset data is sent to a browser decoding module. The browser decoding module decodes the target frame video data, sends the decoded target frame video data to the browser rendering module for processing, and displays the decoded target frame video data on a browser window by the display 260.

In some embodiments, the target frame video data may be set to be representative pictures. For example: the advertiser may set the advertised icon picture or logo product picture as the target frame video data of the advertising video. The target frame video data of a movie and television play may be a picture with a highlight or a text picture containing a brief introduction to the highlight.

In some embodiments, the display position of the browser window is set as close to the edge area of the display as possible, so as to avoid occupying the display key area of the first playing window. For example: the browser window is arranged at four corners of the display area of the display. The display area of the browser window is far smaller than the display area of the display, so that the browser window does not occupy the display area of the first playing window as much as possible, and the user can see the content of the browser window clearly.

In the process of downloading the second media asset data to the video data of the display target frame, the first media asset data is normally played, namely, the first media asset data is still normally executed to be obtained, the first hardware decoder is used for decoding the first media asset data, the decoded first media asset data is sent to the display, and the display displays the decoded first media asset data in the first playing window. Since the browser window is displayed in a small window, it is disposed at the upper layer of the first play window, but only the partial display content of the first play window is blocked, as shown in fig. 12.

In some embodiments, the preview text and countdown information of the second media asset data is displayed on a browser window.

The controller 250 performs step S511: decoding the first section of media asset data by utilizing the browser decoding module;

in some embodiments, the first segment of media asset data may be decoded directly using the browser decoding module after the step of decoding the target frame video data using the browser decoding module and sending to the display.

In some embodiments, a fourth preset duration is set before the second media data is played, and the browser decoding module is used to decode the first media data, where the fourth preset duration is smaller than the second preset duration.

In some embodiments, the playing time of the second media asset data is 8:00:00 am, and the fourth preset duration is 5 seconds. When the system time reaches 7:59:55, the browser decoding module is utilized to decode the first media asset data.

In some embodiments, the playing time of the second media asset data is 30 minutes of the playing time of the first media asset data, the fourth preset time is 5 seconds, and when the playing time of the first media asset data is 29 minutes and 55 seconds, the first media asset data is decoded by using the browser decoding module.

In some embodiments, the playing time of the second media data is 00:15:00 displayed by the playing progress bar of the first media data, and the fourth preset duration is 5 seconds. And when the time displayed by the first media data playing progress bar is 00:14:55, decoding the first section of media data by utilizing the browser decoding module.

In some embodiments, the first section of the demultiplexed second media asset data is sent to the browser decoding module. And the browser decoding module decodes the video data in the first section of media data to obtain decoded video data. And the browser decoding module decodes the audio data in the first section of media data to obtain decoded audio data.

The controller 250 performs step S512: and when the playing time of the second media data is reached, displaying the decoded first media data in the browser window, wherein the display size of the browser window is the same as the display size of the display area of the display, as shown in fig. 13.

In some embodiments, the browser decoding module sends the decoded video data to the browser rendering module for processing and display by display 260 the decoded video data on a browser window. The browser decoding module transmits the decoded audio data to the audio output interface 270, and plays the decoded audio data by the audio output interface 270.

The controller 250 performs step S513: transmitting second section of media data in the second media data to a first hardware decoder so that the first hardware decoder decodes the second section of media data, wherein the second section of media data is data except the first section of media data in the second section of media data;

in some embodiments, the second piece of media asset data in the demultiplexed second piece of media asset data is sent to the first hardware decoder. The first hardware decoder decodes the video data in the second media data segment to obtain decoded video data. The first hardware decoder decodes the audio data in the second media data segment to obtain decoded audio data.

The controller 250 performs step S514: after the playing of the first section of media asset data is completed, the browser window is set to be in a transparent state, and the decoded second section of media asset data is played in the first playing window, as shown in fig. 14.

In some embodiments, after the first segment of media data is played, the first hardware decoder sends the decoded video data to the graphics rendering module for processing, and the decoded video data is displayed by the display 260 in the browser window. The first hardware decoder transmits the decoded audio data to the audio output interface 270, and plays the decoded audio data by the audio output interface 270.

In some embodiments, after the controller 250 performs step S509, it may further perform: and decoding the video data in the first section of media data by using the browser decoding module before reaching the second preset time length before playing the second media data, sending the decoded video data to the browser rendering module for rendering, and displaying the decoded video data on a browser window by using the display 260. The video data in the first section of media data is normally displayed by the display 260, but the video data in the first section of media data is not played, or the media data of the first section of media data in the first second preset time period is silent media data, so as to avoid affecting the playing of the first audio data. The media data of the first section of media data with the second preset duration can be a clipping version of advertisement video data, propaganda films, wonderful fragments or clipping fragments of film and television drama, so that a user can know the general content of the advertisement or the next video in advance and then decide whether to continue watching or not.

In some embodiments, the controller further performs: and decoding the video data in the first section of media data by using the browser decoding module before reaching the third preset time length before playing the second section of media data, sending the decoded video data to the browser rendering module for rendering, and displaying the decoded video data on a browser window by using the display 260. The video data in the first section of media data is normally displayed by the display 260, but the video data in the first section of media data is not played, or the media data of the first section of media data in the first second preset time period is silent media data, so as to avoid affecting the playing of the first audio data. The first media data of the first section may be a clip version of advertisement video data, a propaganda film, a highlight or a clip of a movie, so that a user can know the general content of an advertisement or a next video in advance and decide whether to continue watching.

Some embodiments of the present application provide a method of media asset data display, the method being applicable to a display device, the display device comprising a display and a controller configured to: acquiring first media asset data; decoding the first media asset data by using a first hardware decoder, and transmitting the decoded first media asset data to a display so that the display displays the decoded first media asset data in a first playing window; downloading second media asset data; if the controller is configured with a second hardware decoder, sending the second media asset data to the second hardware decoder so that the second hardware decoder decodes the second media asset data and sends the decoded second media asset data to a display so that the display displays the decoded second media asset data in a second play window, wherein the second play window is arranged at the lower layer of the first play window; suspending playing the second media asset data; and setting a preset area of the first playing window to be in a transparent state, wherein the position of the preset area has an association relation with the display position of the second playing window. The method enables the user to predict the second media data to be played through the small window when watching the first media data, reduces abrupt sense of suddenly inserting the second media data, and improves user experience.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims (10)

1. A display device, characterized by comprising:

a display configured to display a first play window;

A controller configured to:

acquiring first media asset data;

decoding the first media asset data by using a first hardware decoder, and transmitting the decoded first media asset data to a display so that the display displays the decoded first media asset data in a first playing window;

downloading second media asset data;

if a second hardware decoder is configured in the controller, sending the second media asset data to the second hardware decoder, so that the second hardware decoder decodes the second media asset data, and sending the decoded second media asset data to a display, so that the display displays the decoded second media asset data in a second play window, wherein the second play window is arranged at the lower layer of the first play window;

suspending playing the second media asset data;

and setting a preset area of the first playing window to be in a transparent state, wherein the position of the preset area has an association relation with the display position of the second playing window.

2. The display device of claim 1, wherein the controller is configured to:

and controlling the display to display the forenotice characters and the countdown information of the second media data in a browser window, wherein the browser window is arranged on the upper layer of the first playing window.

3. The display device of claim 1, wherein the controller executing the downloading of the second media asset data is further configured to:

acquiring playing parameters of second media asset data, wherein the playing parameters comprise video objects and playing time of the second media asset data;

acquiring a film source address in the video object when a first time point is reached, wherein the first time point is a time point of a first preset duration before the playing time;

if the second media data is streaming media data, initiating a data request according to the film source address, downloading streaming media files and analyzing a streaming media protocol; downloading second media asset data according to the streaming media file and the streaming media protocol;

and if the second media asset data is not streaming media data, initiating a data request according to the film source address, and downloading the second media asset data.

4. The display device of claim 3, wherein the controller performing setting the preset area of the first playback window to a transparent state is further configured to:

and setting a preset area of the first playing window to be in a transparent state when a second time point is reached, wherein the second time point is a time point with a second preset duration before the playing time, and the second preset duration is smaller than the first preset duration.

5. The display device of claim 1, wherein the controller is configured to:

and stopping playing the first media data when the playing time of the second media data is reached, and starting playing the second media data, wherein the second playing window is arranged on the upper layer of the first playing window, and the display size of the second playing window is the same as the display size of the display area.

6. The display device of claim 1, wherein the controller is configured to:

if the controller is not configured with a second hardware decoder, sending a first section of media data in the second media data to a browser decoding module, wherein the first section of media data is second media data with a preset frame number;

and decoding the target frame video data by using the browser decoding module and sending the target frame video data to a display so that the display can display the decoded target frame video data in a browser window, wherein the browser window is arranged on the upper layer of the first playing window.

7. The display device of claim 6, wherein the controller is configured to:

and controlling the display to display the forenotice characters and the countdown information of the second media data in the browser window.

8. The display device of claim 6, wherein the controller is configured to:

decoding the first section of media asset data by utilizing the browser decoding module;

when the playing time of the second media data is reached, displaying the decoded first section of media data in the browser window, wherein the display size of the browser window is the same as the display area of the display;

transmitting second section of media data in the second media data to a first hardware decoder so that the first hardware decoder decodes the second section of media data, wherein the second section of media data is data except the first section of media data in the second section of media data;

and after the playing of the first section of media data is finished, setting the browser window to be in a transparent state, and playing the decoded second section of media data in the first playing window.

9. A method for displaying media asset data, comprising:

acquiring first media asset data;

decoding the first media asset data by using a first hardware decoder, and transmitting the decoded first media asset data to a display so that the display displays the decoded first media asset data in a first playing window;

Downloading second media asset data;

if a second hardware decoder is configured in the controller, sending the second media asset data to the second hardware decoder, so that the second hardware decoder decodes the second media asset data, and sending the decoded second media asset data to a display, so that the display displays the decoded second media asset data in a second play window, wherein the second play window is arranged at the lower layer of the first play window;

suspending playing the second media asset data;

and setting a preset area of the first playing window to be in a transparent state, wherein the position of the preset area has an association relation with the display position of the second playing window.

10. The method according to claim 9, wherein the method further comprises:

and controlling the display to display the second media data forenotice words and the countdown information in a browser window, wherein the browser window is arranged on the upper layer of the first playing window.