CN116347091A

CN116347091A - Content display method and display equipment

Info

Publication number: CN116347091A
Application number: CN202111588631.6A
Authority: CN
Inventors: 李起家
Original assignee: Hisense Electronic Technology Wuhan Co ltd
Current assignee: Hisense Electronic Technology Wuhan Co ltd
Priority date: 2021-12-23
Filing date: 2021-12-23
Publication date: 2023-06-27

Abstract

The embodiment provides a content display method and a display device, wherein the display device comprises a display, a multichannel codec and a controller. If the multi-channel codec has a free channel, the controller transmits a thumbnail request to the multi-channel codec, wherein the number of thumbnail requests corresponds to the current free channel number of the multi-channel codec. Obtaining the thumbnail from the multi-channel codec according to the thumbnail request, and displaying the thumbnail on the display, wherein the number of the thumbnail corresponds to the number of the thumbnail requests. Therefore, the thumbnail can be obtained simultaneously by utilizing multiple channels of the multi-channel encoding and decoding, so that the display effect of the thumbnail page is smoother, and the use experience of a user is improved.

Description

Content display method and display equipment

Technical Field

The present disclosure relates to the field of display devices, and in particular, to a content display method and a display device.

Background

A codec refers to a device or program capable of transforming a signal or a data stream. The transformations referred to herein include the operation of encoding a signal or data stream (typically for transmission, storage or encryption) or extracting an encoded stream. In the field of display devices, codecs mainly function to compress and decompress video signals or image signals.

Current display devices generally support single channel encoding and decoding, i.e., support single channel acquisition of thumbnails of media files, single channel playing of media files, and the like.

However, the display device using the single-channel codec can only obtain the thumbnail through a single channel, so that the display effect of the thumbnail page is not smooth, and finally the use experience of the user is poor.

Disclosure of Invention

The application provides a content display method and display equipment, which are used for solving the problems that the prior display equipment adopting single-channel encoding and decoding can not acquire thumbnail images while playing media files, so that only single-window video playing is supported, information of other media files can not be checked while playing the media files, and finally the use experience of users is poor.

In a first aspect, the present embodiment provides a display device, including,

a display for displaying a user interface;

a multi-channel codec;

a controller for performing:

when the multichannel coder-decoder has idle channels, sending thumbnail requests to the multichannel coder-decoder, wherein the number of the thumbnail requests corresponds to the current idle channel road number of the multichannel coder-decoder;

And acquiring the thumbnails from the multi-channel codec according to the thumbnail requests, and displaying the thumbnails on the display, wherein the number of the thumbnails corresponds to the number of the thumbnail requests.

In a second aspect, the present embodiment provides a content display method, which is applied to a controller of a display device, the display device further including a multi-channel codec, the method including:

The embodiment provides a content display method and a display device, if a multichannel codec has idle channels, a controller sends thumbnail requests to the multichannel codec, wherein the number of the thumbnail requests corresponds to the current idle channel number of the multichannel codec. Obtaining the thumbnail from the multi-channel codec according to the thumbnail request, and displaying the thumbnail on the display, wherein the number of the thumbnail corresponds to the number of the thumbnail requests. Therefore, the thumbnail can be obtained simultaneously by utilizing multiple channels of the multi-channel encoding and decoding, so that the display effect of the thumbnail page is smoother, and the use experience of a user is improved.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

FIG. 1 illustrates a usage scenario of a display device according to some embodiments;

fig. 2 shows a hardware configuration block diagram of the control apparatus 100 according to some embodiments;

fig. 3 illustrates a hardware configuration block diagram of a display device 200 according to some embodiments;

FIG. 4 illustrates a software configuration diagram in a display device 200 according to some embodiments;

FIG. 5 illustrates a user interface schematic diagram in a display device 200 according to some embodiments;

FIG. 6 illustrates a multi-channel acquisition thumbnail flow diagram in accordance with some embodiments;

FIG. 7 illustrates a thumbnail request queue processing flow diagram in accordance with some embodiments;

FIG. 8 illustrates a user interface schematic diagram in yet another display device 200, in accordance with some embodiments;

FIG. 9 illustrates a flow diagram for playing a media file in multiple channels while obtaining thumbnails in accordance with some embodiments;

FIG. 10 illustrates a user interface schematic diagram in yet another display device 200, in accordance with some embodiments;

FIG. 11 illustrates a user interface schematic diagram in yet another display device 200, in accordance with some embodiments;

FIG. 12 illustrates a flow diagram for playing a media file while obtaining a thumbnail in yet another multi-channel according to some embodiments;

FIG. 13 illustrates a flow chart of a content display method according to some embodiments;

FIG. 14 illustrates a flow chart of yet another content display method in accordance with some embodiments;

FIG. 15 illustrates a flow chart of yet another content display method in accordance with some embodiments;

fig. 16 illustrates a flow chart of yet another content display method in accordance with some embodiments.

Detailed Description

For purposes of clarity and implementation of the present application, the following description will make clear and complete descriptions of exemplary implementations of the present application with reference to the accompanying drawings in which exemplary implementations of the present application are illustrated, it being apparent that the exemplary implementations described are only some, but not all, of the examples of the present application.

It should be noted that the brief description of the terms in the present application is only for convenience in understanding the embodiments described below, and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms "first," second, "" third and the like in the description and in the claims and in the above drawings are used for distinguishing between similar or similar objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that is capable of performing the function associated with that element.

Fig. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in fig. 1, the display device 200 is also in data communication with a server 400, and a user can operate the display device 200 through the smart device 300 or the control apparatus 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the display device 200 is controlled by a wireless or wired mode. The user may control the display apparatus 200 by inputting a user instruction through at least one of a key on a remote controller, a voice input, a control panel input, and the like.

In some embodiments, the smart device 300 may include any of a mobile terminal 300A, a tablet, a computer, a notebook, an AR/VR device, etc.

In some embodiments, the smart device 300 may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on a smart device.

In some embodiments, the smart device 300 and the display device may also be used for communication of data.

In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received through a module configured inside the display device 200 device for acquiring voice commands, or the voice command control of the user may be received through a voice control apparatus configured outside the display device 200 device.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

In some embodiments, software steps performed by one step execution body may migrate on demand to be performed on another step execution body in data communication therewith. For example, software steps executed by the server may migrate to be executed on demand on a display device in data communication therewith, and vice versa.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and function as an interaction between the user and the display device 200.

Fig. 3 shows a hardware configuration block diagram of the display device 200 in accordance with an exemplary embodiment.

In some embodiments, display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, memory, a power supply, a user interface.

In some embodiments the controller comprises a central processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.

In some embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, for receiving an image signal from the controller output, for displaying video content, image content, and components of a menu manipulation interface, and a user manipulation UI interface, etc.

In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

In some embodiments, the modem 210 receives broadcast television signals via wired or wireless reception and demodulates audio-video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; alternatively, the detector 230 includes an image collector such as a camera, which may be used to collect external environmental scenes, user attributes, or user interaction gestures, or alternatively, the detector 230 includes a sound collector such as a microphone, or the like, which is used to receive external sounds.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, or the like. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other operable control. The operations related to the selected object are: displaying an operation of connecting to a hyperlink page, a document, an image, or the like, or executing an operation of a program corresponding to the icon.

In some embodiments the controller includes at least one of a central processing unit (Central Processing Unit, CPU), video processor, audio processor, graphics processor (Graphics Processing Unit, GPU), RAM Random Access Memory, RAM), ROM (Read-Only Memory, ROM), first to nth interfaces for input/output, a communication Bus (Bus), and the like.

A CPU processor. For executing operating system and application program instructions stored in the memory, and executing various application programs, data and contents according to various interactive instructions received from the outside, so as to finally display and play various audio and video contents. The CPU processor may include a plurality of processors. Such as one main processor and one or more sub-processors.

In some embodiments, a graphics processor is used to generate various graphical objects, such as: at least one of icons, operation menus, and user input instruction display graphics. The graphic processor comprises an arithmetic unit, which is used for receiving various interactive instructions input by a user to operate and displaying various objects according to display attributes; the device also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, the video processor is configured to receive an external video signal, perform at least one of decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image composition, and the like according to a standard codec protocol of an input signal, and obtain a signal that is displayed or played on the directly displayable device 200.

In some embodiments, a user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

In some embodiments, a "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user that enables conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of the user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

In some embodiments, a system of display devices may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together form the basic operating system architecture that allows users to manage files, run programs, and use the system. After power-up, the kernel is started, the kernel space is activated, hardware is abstracted, hardware parameters are initialized, virtual memory, a scheduler, signal and inter-process communication (IPC) are operated and maintained. After the kernel is started, shell and user application programs are loaded again. The application program is compiled into machine code after being started to form a process.

As shown in fig. 4, a system of display devices may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together form the basic operating system architecture that allows users to manage files, run programs, and use the system. After power-up, the kernel is started, the kernel space is activated, hardware is abstracted, hardware parameters are initialized, virtual memory, a scheduler, signal and inter-process communication (IPC) are operated and maintained. After the kernel is started, shell and user application programs are loaded again. The application program is compiled into machine code after being started to form a process.

As shown in fig. 4, the system of the display device is divided into three layers, an application layer, a middleware layer, and a hardware layer, from top to bottom. The application layer mainly comprises common applications on the television, and an application framework (Application Framework), wherein the common applications are mainly applications developed based on Browser, such as: HTML5 APPs; native applications (Native APPs);

the application framework (Application Framework) is a complete program model with all the basic functions required by standard application software, such as: file access, data exchange …, and the interface for the use of these functions (toolbar, status column, menu, dialog box).

Native applications (Native APPs) may support online or offline, message pushing, or local resource access.

The middleware layer includes middleware such as various television protocols, multimedia protocols, and system components. The middleware can use basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, so that the purposes of resource sharing and function sharing can be achieved.

The hardware layer mainly comprises a HAL interface, hardware and a driver, wherein the HAL interface is a unified interface for all the television chips to be docked, and specific logic is realized by each chip. The driving mainly comprises: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

Coding (encod) is commonly known as serialization (serialization), which serializes objects into byte arrays for network transmission, data persistence, or other purposes. Conversely, decoding (decoding)/deserializing (deserializing) restores the byte array read from the network, disk, etc. to the original object (typically a copy of the original object) to facilitate subsequent business logic operations. When remote cross-process service call (e.g., RPC call) is performed, a specific codec technique is required to encode or decode an object that needs to be transmitted over the network, so as to complete the remote call.

The audio and video fields adopt analog technology in early stage, and are developed into digital technology at present. The main benefits of digitization are: high reliability, capability of eliminating transmission and storage loss, convenience for computer processing and network transmission, and the like. After digitization, audio and video processing enters the technical field of computers, and the audio and video processing is essentially the processing of computer data. The original video data generated after the image information is acquired has very large data volume, and compression technology is not needed to be considered for some application occasions of direct local play after the image information is acquired. However, in reality, more application occasions relate to transmission and storage of video, the transmission network and the storage device cannot tolerate huge data volume of original video data, and the original video data must be transmitted and stored after being encoded and compressed.

In order to solve the above problems, the present application provides a display device including at least a display, a multi-channel codec, and a controller. The display is used to display media files and thumbnails, and the multi-channel codec is used to codec media files and thumbnails. The media file may be a video file and the thumbnail may be a brief description picture of the video file, such as a promotional poster of a movie or a television show.

The embodiment of the application will specifically describe the technical scheme of simultaneously acquiring the thumbnail by multiple channels, simultaneously acquiring the thumbnail by playing the media file and playing the video by multiple windows by taking the display device as an example.

The following is the first embodiment of the present application, i.e., the embodiment in which multiple channels acquire thumbnail images simultaneously.

In some embodiments, the controller of the display device sends a thumbnail request to the multi-channel codec if the multi-channel codec has a free channel. Here, after the user opens the thumbnail page, a thumbnail request may be sent to the multi-channel codec during the page loading process. Before sending the thumbnail request, the number of idle channels currently used by the multi-channel codec needs to be calculated. And the controller sends a thumbnail request of the corresponding channel number according to the current idle channel number of the multi-channel coder-decoder. For example, if the number of free channels of the multi-channel codec is 10, a 10-channel thumbnail request is sent to the multi-channel codec.

Further, the multi-channel codec returns the corresponding thumbnail to the controller according to the thumbnail request. At this time, the multichannel codec currently has an idle channel, and simultaneously performs the encoding and decoding, and returns the thumbnail to the controller. For example, the number of the current idle channels of the multi-channel codec is 10, and correspondingly 10 thumbnail requests are received, so that 10 idle channels work simultaneously. The controller can simultaneously acquire 10 paths of thumbnails and control the display of the thumbnails on the display.

Illustratively, as shown in the user interface diagram of FIG. 5, a 12-piece thumbnail would require 12 seconds to be displayed if acquired using a single channel codec. And adopting a multi-channel coder-decoder, if the current multi-channel coder-decoder has 6 idle channels, the 6 idle channels work simultaneously, and finally, only 2 seconds are needed for obtaining 12 thumbnails. Therefore, the method and the device for obtaining the thumbnail can improve the efficiency of obtaining the thumbnail, and enable the page display effect to be smoother.

As shown in fig. 6, a flowchart of a multi-channel thumbnail acquisition process is shown, and the specific implementation process of the first embodiment of the present application is as follows:

the UI layer issues thumbnail acquisition instructions, and the thumbnail acquisition instructions are put into a queue first, and the queue is not empty first. And then judging that a plurality of idle decoding channels exist at present. If no free channel is currently available for thumbnail acquisition, no thumbnail request is sent and the free channel needs to be waited for release. And continuously monitoring whether the idle channel exists currently or not in the process of waiting for releasing the idle channel.

If the current channel with the idle channel is obtained (the specific code is (n-ldleChannelCnt) > 0, n represents the total number of channels, ldleChannelCnt represents the number of channels currently occupied, and (n-ldleChannelCnt) > 0 represents the number of channels which are unoccupied, namely the number of idle channels), the operation of obtaining the instruction dequeue of the thumbnail is carried out according to the number of channels of the idle channel. After the thumbnail acquisition instruction is queued, the thumbnail information of the media file is acquired by utilizing the idle channel decoding according to the thumbnail acquisition instruction (in the process of decoding the thumbnail information of the media file, the number of occupied channels is increased by ldleChannelCnt++, and when the thumbnail acquisition is finished and the thumbnail is reported to the UI for display, the occupied channels are released, and the number of occupied channels is reduced by ldleChannelCnt++). Each path of idle channel executes a round of thumbnail instruction output queue, decodes and acquires the thumbnail of the media file and the process that the thumbnail is completely acquired and reported to the UI for display. For example, channels 1 to 10 are idle, and media file thumbnail information is obtained by decoding using channels 1 to 10. And finally, reporting the thumbnail information of the media file to the UI layer for display.

The thumbnail request queue processing flow shown in fig. 7 is a schematic diagram, and the flow shown in fig. 7 is a processing manner of the thumbnail acquisition instruction. The UI layer issues thumbnail acquisition instructions to be in a queue, namely, the thumbnail acquisition instructions are out of the queue at the tail of the queue, and the thumbnail requests are executed, namely, the thumbnail requests are out of the queue at the head of the queue, and the processing mode follows the principle of first-in first-out last-in last-out.

In some embodiments, the free channel of the multi-channel codec is updated to a non-free channel upon retrieving a thumbnail from the multi-channel codec according to the thumbnail request, and the non-free channel of the multi-channel codec is updated to a free channel after retrieving a thumbnail from the multi-channel codec according to the thumbnail request. When one path channel acquires the thumbnail successfully and reports the acquired thumbnail to the UI layer, the path channel is converted from a non-idle state to an idle state, and a thumbnail acquisition instruction can be continuously taken out from the instruction queue to acquire the next thumbnail.

For example, channels 1 to 10 are idle, and media file thumbnail information is obtained by decoding using channels 1 to 10. The initial state is that channels 1 to 10 are idle, and when the thumbnail is acquired from the multi-channel codec according to the thumbnail request, channels 1 to 10 are updated from the idle state to the non-idle state, that is, channels 1 to 10 are all occupied. The speed of each channel may not be consistent when acquiring the thumbnail, so that one channel successfully acquires the thumbnail, and the channel is converted from a non-idle state to an idle state. For example, channel 1 gets a thumbnail faster than channels 2 through 10, channel 1 is first updated from a non-idle state to an idle state. While lanes 2 through 10 remain in a non-idle state. The channel 1 can be continuously used for acquiring the next thumbnail according to the instruction acquired from the queue, so that the acquisition efficiency of the thumbnail is further improved, and the smoothness of page display is further improved.

The following is a second embodiment of the present application, namely an embodiment in which a thumbnail is acquired while a media file is played.

Unlike the first embodiment, the second embodiment acquires thumbnail images for display while playing a media file.

Specifically, the controller sends a media file playing request to the multi-channel codec, and it should be noted that at this time, the multi-channel codec has one idle channel for obtaining the media file. Similarly, if no free channel exists at this time, the occupied channel needs to be released to acquire the media file. After the controller sends a media file playing request to the multi-channel codec, the multi-channel codec receives the multi-channel codec, feeds back the media file to the controller according to the multi-channel codec, and controls the playing of the media file on the display.

It should be noted that the display plays the media file while the media file is continuously occupying channels of the multi-channel codec. Therefore, the channels for the multi-channel codec to acquire the thumbnail are always one less at this time.

Further, if the multi-channel codec still has a free channel, the controller of the display device sends a thumbnail request to the multi-channel codec. Here, after the user opens the thumbnail page, a thumbnail request may be sent to the multi-channel codec during the page loading process. Before sending the thumbnail request, the number of idle channels currently used by the multi-channel codec needs to be calculated. And the controller sends a thumbnail request of the corresponding channel number according to the current idle channel number of the multi-channel coder-decoder.

The multi-channel codec returns the corresponding thumbnail to the controller according to the thumbnail request. At this time, the multichannel codec currently has an idle channel, and simultaneously performs the encoding and decoding, and returns the thumbnail to the controller.

For example, the number of idle channels in the multi-channel codec is 10, and after the media file is played first and the media file is occupied, 9 idle channels remain. Then 9 thumbnail requests are correspondingly received, so that 9 idle channels work simultaneously. The controller can simultaneously acquire 9 paths of thumbnails and control the display of the 9 paths of thumbnails on the display. Illustratively, as shown in the user interface schematic of FIG. 8, the display simultaneously displays all of the thumbnails acquired below the interface while playing the media file.

In the user interface shown in fig. 8, if the user selects the other media file thumbnail 1, the selection may be such that the focus is located on the other media file thumbnail 1, and then the other media file thumbnail 1 may be enlarged and displayed during the process of playing the media file, so that the other media file thumbnail can be conveniently and clearly viewed.

As shown in a flow chart of playing media files in multiple channels and simultaneously obtaining thumbnail images in fig. 9, the specific implementation process of the second embodiment of the present application is:

The UI layer issues a media file playing request, judges whether an idle decoding channel exists currently, and waits for releasing the idle channel if the idle decoding channel does not exist currently. If there is currently an idle decoding channel, the media file is acquired using the idle decoding channel and played on the display. In the process of playing the media file, one path of decoding channel is always occupied. Thus if the total number of ways of the decoding channels is n, the number of ways of the currently available maximum acquisition thumbnail channel is n-1.

The UI layer issues thumbnail acquisition instructions, which are put into a queue, which is not empty first. And then judging that a plurality of idle decoding channels exist at present. If no free channel is currently available for thumbnail acquisition, no thumbnail request is sent and the free channel needs to be waited for release. And continuously monitoring whether the idle channel exists currently or not in the process of waiting for releasing the idle channel. It should be noted that, the UI layer may issue a media file playing request first, and then issue a thumbnail acquisition instruction, or issue a media file playing request and a thumbnail acquisition instruction at the same time. In this way, if enough idle channels are used for playing the media file and acquiring the thumbnail, the playing of the media file and the thumbnail can be simultaneously performed, so that the smoothness of page display is further improved.

And if the current channel with the idle channel is used for acquiring the thumbnail, performing the operation of acquiring the thumbnail to instruct the output queue according to the number of the idle channels. And after the thumbnail acquisition instruction is queued, acquiring the thumbnail information of the media file by utilizing idle channel decoding according to the thumbnail acquisition instruction. And finally, reporting the thumbnail information of the media file to the UI layer for display.

In some embodiments, there are some multi-channel codecs that distinguish between channels that play media files and channels that acquire thumbnails, e.g., all channels may acquire thumbnails, but some channels do not have the ability to play high definition video. Therefore, the channels have a master-slave division, for example, the master channel can play high-definition video (more than 4K), and the slave channel can only play video below 2K. According to the embodiment of the application, the channel for acquiring the media file can be fixedly set as a master channel, and the channel for acquiring the thumbnail can be fixedly set as a slave channel. Alternatively, the main channel may be used to play video and to obtain thumbnails at the same time, and the secondary channel may only obtain thumbnails, so that the main channel may also be used to obtain thumbnails when video is not needed to be played.

In some embodiments, in the user interface shown in fig. 8, if the display is playing a media file, the user may select a thumbnail under the interface by operating the control device, at which time the selected thumbnail may be enlarged on the display. While the media file being played on the display does not stop playing. The user can pause playing the media file and then select the thumbnail under the interface by operating the control device, and the selected thumbnail can be displayed on the display in a full screen mode. The user can also zoom in on the thumbnail where the focus is located by moving the focus of the screen between the thumbnails by operating the control device.

The following is a third embodiment of the present application, namely an embodiment of multi-window playing of media files.

Unlike the second embodiment, the third embodiment plays a media file in multiple windows, but does not acquire thumbnail images, nor displays thumbnail images on a display.

The controller obtains the media files from at least two channels, that is, it is necessary to send at least two media file play requests to the multi-channel codec. At this time, the multi-channel codec has at least two idle channels for acquiring the media file. Similarly, if no free channel exists at this time, the occupied channel needs to be released to acquire the media file. After the controller sends a media file playing request to the multi-channel codec, the multi-channel codec receives the multi-channel codec, feeds back the media file to the controller according to the multi-channel codec, and controls the playing of the media file on the display.

It should be noted that the display plays the media file while the media file also continues to occupy channels of the multi-channel codec. Therefore, at this time, the channels for the multi-channel codec to acquire the thumbnail are always at least two channels less. The media file is played simultaneously for multiple windows on the display.

Illustratively, as shown in the user interface of FIG. 10, the main window plays one media file and 1 sub-window is displayed below the user interface to play the other media file. The specific implementation process is as follows: the controller sends two media file play requests to the multi-channel codec. At this time, the multi-channel codec has two idle channels for acquiring the media file. The multi-channel coder-decoder utilizes one idle channel to obtain the media file of the main window and controls the media file to be played in the main window. Meanwhile, the multi-channel codec acquires the media file of the sub-window by using the other channel of idle channel, and controls the media file to be played in the sub-window. Thereby realizing the display effect of simultaneously playing a plurality of media files by utilizing multiple channels.

In the user interface shown in fig. 10, the main window plays media file 1, and media files 2 through 5 are played in a sub-window, which is located at the bottom of the main window. The sub window may or may not be displayed above the main window in an overlapping manner. The child window may also be displayed above the main window in a semi-transparent manner. In the user interface shown in fig. 10, the user may also control the focus to move between different media files by operating the control device, and by selecting different media files, cause the different media files to be played in the main window. For example, in the user interface shown in fig. 10, when the main window plays the media file 1, the user controls the focus to move to the media file 2 by operating the control device, and the focus stays on the media file 2 for more than a preset period of time, the main window is updated to play the media file 2, and the media file 1 is updated to play at the sub window. Further, if the user continues to control the focus to move to the media file 3 through the operation control device and the focus stays on the media file 3 for more than the preset time period, the main window is updated to play the media file 3, and the media file 2 is returned to the sub window to play.

The specific implementation process of the third embodiment of the present application is:

the UI layer issues a plurality of media file playing requests, judges whether an idle decoding channel exists currently, and waits for releasing the idle channel if the idle decoding channel does not exist currently. If there is currently an idle decoding channel, the media file is acquired using the idle decoding channel and played on the display. It should be noted that if only one free channel exists for playing the media file, the display effect of playing the media file by multiple windows cannot be achieved. Thus, in this embodiment, multiple idle channels exist by default for playing the media file. And finally, reporting the media file to the UI layer for display.

The following is a fourth embodiment of the present application, namely an embodiment of capturing a thumbnail while playing a media file in multiple windows.

Unlike the third embodiment, the fourth embodiment acquires thumbnail images for display while playing a media file in multiple windows.

Specifically, the controller firstly sends a media file playing request to the multi-channel codec, and it should be noted that at this time, the multi-channel codec has at least two idle channels for acquiring the media file. Similarly, if no free channel exists at this time, the occupied channel needs to be released to acquire the media file. After the controller sends a media file playing request to the multi-channel codec, the multi-channel codec receives the multi-channel codec, feeds back the media file to the controller according to the multi-channel codec, and controls the playing of the media file on the display.

It should be noted that the display plays the media file while the media file is continuously occupying channels of the multi-channel codec. Therefore, the channels for the multi-channel codec to acquire the thumbnail are always two less channels at this time.

For example, the number of idle channels in the multi-channel codec is 10, and after the media file is played first and two channels are occupied, 8 idle channels remain. Then 8 thumbnail requests are correspondingly received, so that 8 idle channels work simultaneously. The controller can simultaneously acquire 8 paths of thumbnails and control the display of the 8 paths of thumbnails on the display. Illustratively, as shown in the user interface schematic of FIG. 11, the display plays a media file in the main window, plays a further media file in the sub-window, and simultaneously displays all the thumbnails acquired below the interface.

As shown in a flow chart of playing media files in multiple channels and simultaneously obtaining thumbnail images in fig. 12, the specific implementation process of the fourth embodiment of the present application is:

the UI layer issues at least two media file playing requests, judges whether an idle decoding channel exists currently, and waits for releasing the idle channel if the idle decoding channel does not exist currently. If there is currently an idle decoding channel, the media file is acquired using the idle decoding channel and played on the display. In the process of playing the media file, one path of decoding channel is always occupied. Thus, if the total number of channels for decoding is n and the number of channels for playing the media file is m, the number of channels for the currently available maximum acquisition thumbnail is n-m.

The UI layer issues thumbnail acquisition instructions, which are put into a queue, which is not empty first. And then judging that a plurality of idle decoding channels exist at present. If no free channel is currently available for thumbnail acquisition, no thumbnail request is sent and the free channel needs to be waited for release. And continuously monitoring whether the idle channel exists currently or not in the process of waiting for releasing the idle channel.

An embodiment of the present application provides a content display method, as shown in a flowchart of the content display method in fig. 13, including the following steps:

step one, when the multichannel coder-decoder has idle channels, the controller sends thumbnail requests to the multichannel coder-decoder, wherein the number of the thumbnail requests corresponds to the current idle channel path number of the multichannel coder-decoder.

And step two, the controller acquires the thumbnails from the multi-channel codec according to the thumbnail requests, and controls the thumbnails to be displayed on the display, wherein the number of the thumbnails corresponds to the number of the thumbnail requests.

In some embodiments, the thumbnail request is not sent to the multi-channel codec when the multi-channel codec does not have a free channel.

The method of the embodiment comprises the following specific implementation processes:

And if the current channel with the idle channel is used for acquiring the thumbnail, performing the operation of acquiring the thumbnail to instruct the output queue according to the number of the idle channels. And after the thumbnail acquisition instruction is queued, acquiring the thumbnail information of the media file by utilizing idle channel decoding according to the thumbnail acquisition instruction.

In the content display method of this embodiment, if the multi-channel codec has a free channel, the controller sends a thumbnail request to the multi-channel codec, where the number of thumbnail requests corresponds to the current free channel number of the multi-channel codec. Obtaining the thumbnail from the multi-channel codec according to the thumbnail request, and displaying the thumbnail on the display, wherein the number of the thumbnail corresponds to the number of the thumbnail requests. Therefore, the thumbnail can be obtained simultaneously by utilizing multiple channels of the multi-channel encoding and decoding, so that the display effect of the thumbnail page is smoother, and the use experience of a user is improved.

In some embodiments, the free channel of the multi-channel codec is updated to a non-free channel when the thumbnail is acquired from the multi-channel codec according to the thumbnail request, and the non-free channel of the multi-channel codec is updated to a free channel after the thumbnail is acquired from the multi-channel codec according to the thumbnail request.

An embodiment of the present application provides a content display method, such as a flowchart of the content display method shown in fig. 14, including the following steps:

step one, when a multichannel coder-decoder has an idle channel, a controller sends a media file playing request to the multichannel coder-decoder;

and step two, the controller acquires the media file from the multi-channel codec according to the media file playing request, and the hole only plays the media file on the display, wherein the media file continuously occupies the corresponding channel of the multi-channel codec while playing the media file.

Step three, when a multichannel codec still has idle channels while playing the media file, sending thumbnail requests to the multichannel codec, wherein the number of the thumbnail requests corresponds to the current idle channel number of the multichannel codec;

The controller obtains the thumbnail from the multi-channel codec according to the thumbnail request, and controls the display of the thumbnail on the display, wherein the number of the thumbnail corresponds to the number of the thumbnail requests.

and a media file playing request under the UI layer judges whether an idle decoding channel exists currently, and waits for releasing the idle channel if the idle decoding channel does not exist currently. If there is currently an idle decoding channel, the media file is acquired using the idle decoding channel and played on the display. In the process of playing the media file, one path of decoding channel is always occupied. Thus if the total number of ways of the decoding channels is n, the number of ways of the currently available maximum acquisition thumbnail channel is n-1.

In the content display method of this embodiment, when the multi-channel codec has an idle channel, the controller sends a media file playing request to the multi-channel codec, and obtains a media file from the multi-channel codec according to the media file playing request, and then controls to play the media file on the display. In the process of playing the media file, one channel is continuously occupied, and if an idle channel still exists in the situation, the controller sends thumbnail requests with the corresponding number to the multi-channel codec according to the number of the residual idle channels. The controller acquires the corresponding number of thumbnails from the multi-channel codec according to the thumbnail request, and then controls the thumbnail to be displayed on the display. Therefore, the display effect of displaying the thumbnail on the interface is achieved when the media file is played on the interface, and user experience is improved. And the process of acquiring the thumbnail is also to utilize a plurality of channels of the multi-channel coder-decoder to acquire a plurality of thumbnails at the same time, so that the effect of improving the smoothness of page display can be realized at the same time.

An embodiment of the present application provides a content display method, such as a flowchart of the content display method shown in fig. 15, including the following steps:

step one, when a multichannel coder-decoder has an idle channel, a controller sends at least two media file playing requests to the multichannel coder-decoder;

and step two, the controller acquires the media file from the multi-channel codec according to the media file playing request, and plays the media file on the display, wherein the media file continuously occupies the corresponding channel of the multi-channel codec while playing the media file.

The controller sends two media file play requests to the multi-channel codec. At this time, the multi-channel codec has two idle channels for acquiring the media file. The multi-channel coder-decoder utilizes one idle channel to obtain the media file of the main window and controls the media file to be played in the main window. Meanwhile, the multi-channel codec acquires the media file of the sub-window by using the other channel of idle channel, and controls the media file to be played in the sub-window. Thereby realizing the display effect of simultaneously playing a plurality of media files by utilizing multiple channels.

In the content display method of the embodiment, when a multichannel codec has an idle channel, a controller sends at least two media file playing requests to the multichannel codec; the controller obtains the media file from the multi-channel codec according to the media file play request and plays the media file on the display. The method of the embodiment can realize the display effect of playing the media file by utilizing the main window and the sub window on the display, and simultaneously play the media file by utilizing multiple channels, so that the page display effect is smoother.

An embodiment of the present application provides a content display method, such as a flowchart of the content display method shown in fig. 16, including the following steps:

The specific implementation process of the method of the embodiment is as follows:

In the method of the embodiment, when the multichannel codec has an idle channel, the controller sends a media file playing request to the multichannel codec; the controller obtains the media file from the multi-channel codec according to the media file playing request, and plays the media file on the display, wherein the media file continuously occupies the corresponding channel of the multi-channel codec while the media file is played. When the media file is played and the multichannel codec still has idle channels, thumbnail requests are sent to the multichannel codec, wherein the number of the thumbnail requests corresponds to the current idle channel number of the multichannel codec; the controller acquires the thumbnails from the multi-channel codec according to the thumbnail requests, and controls the thumbnails to be displayed on the display, wherein the number of the thumbnails corresponds to the number of the thumbnail requests. Therefore, the display effects of playing the media file on the main window of the display, playing the media file on the slave window and displaying the thumbnail can be realized. In addition, the media file is played by utilizing multiple channels, and the thumbnail is acquired at the same time, so that the page display effect is smoother, and the use experience of a user is finally improved.

The same or similar content may be referred to each other in various embodiments of the present application, and the related embodiments are not described in detail.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, characterized by comprising:

a display for displaying a user interface;

a multi-channel codec;

a controller for performing:

2. The display device of claim 1, wherein the controller is further configured to perform:

and when the multi-channel codec does not have a free channel, not sending the thumbnail request to the multi-channel codec.

3. The display device of claim 1, wherein a free channel of the multi-channel codec is updated to a non-free channel when a thumbnail is acquired from the multi-channel codec according to the thumbnail request, and wherein a non-free channel of the multi-channel codec is updated to a free channel after a thumbnail is acquired from the multi-channel codec according to the thumbnail request.

4. The display device of claim 1, wherein the controller, prior to sending the thumbnail request to the multi-channel codec, is further to perform:

sending a media file playing request to the multi-channel codec;

and obtaining the media file from the multi-channel codec according to the media file playing request, and playing the media file on the display, wherein the media file continuously occupies the corresponding channel of the multi-channel codec while the media file is played.

5. The display device of claim 4, wherein the multi-channel codec includes a master channel and a slave channel, the master channel being fixedly used when playing the media file, the slave channel being fixedly used when acquiring the thumbnail.

6. The display device of claim 4, wherein when the media file playing requests are at least two, the media files are respectively obtained from at least two channels, and the media files are simultaneously played in multiple windows on the display.

7. The display device of claim 6, wherein the media file is played simultaneously for a main window and a widget on the display.

8. A content display method applied to a controller of a display apparatus further including a multi-channel codec, the method comprising:

9. The content display method according to claim 8, wherein before sending a thumbnail request to the multi-channel codec, the method further comprises:

sending a media file playing request to the multi-channel codec;

and obtaining the media file from the multi-channel codec according to the media file playing request, and playing the media file while displaying the thumbnail on the display, wherein the media file continuously occupies the corresponding channel of the multi-channel codec while playing the media file.

10. The content display method according to claim 9, wherein when the media file playing request is at least two, the media file is acquired from at least two channels, the media file continuously occupies at least two channels of the multi-channel codec, and the media file is simultaneously played for multiple windows on the display.