CN115225970A

CN115225970A - Display device and video skipping method thereof

Info

Publication number: CN115225970A
Application number: CN202110412758.6A
Authority: CN
Inventors: 李斌; 梁文双; 朱宗花
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2021-04-16
Filing date: 2021-04-16
Publication date: 2022-10-21

Abstract

The application provides a display device and a video skipping method of the display device, wherein the method comprises the steps of obtaining a video skipping instruction and skipping time appointed by the video skipping instruction; determining a video clip to which the jumping time belongs; acquiring the playing time of audio and video frames in the video clip; and when the playing time of a first audio/video frame in the video clip is the same as the jumping time, determining that the first audio/video frame is a target audio/video frame. And outputting video data to a display from the target audio and video frame, and outputting audio data to a loudspeaker from the target audio and video frame. The method and the device can improve the smoothness of video playing after the video jumps, and improve the experience of watching the video of the user.

Description

Display device and video skipping method thereof

Technical Field

The embodiment of the application relates to a display technology. And more particularly, to a display apparatus and a display apparatus video jumping method.

Background

Streaming media technology refers to a technology of compressing a series of media data, sending the data by segments on the network, and transmitting video and audio on the network for viewing. When a user watches videos through a streaming media video player, the user sometimes needs to jump forward or backward to the videos according to actual needs. When a user skips a video, the streaming media video player acquires the skip time of the video, acquires a video segment to which the skip time belongs, and starts to play the video from a first frame of the video segment. For example, a video clip is 10 seconds long (the first video clip is [0-10] seconds of video data, and the second clip is [10-19 ] seconds of video data), when the user wants to go to 18 seconds, the actual streaming video player will start playing from the first frame of the second clip (i.e. from 10 th second), resulting in a video jump deviation of 8 seconds. Or when the user wants to go to 9 th second, the actual streaming video player will start playing from the first frame of the first clip (i.e. start playing from 0 th second), resulting in a video jump deviation of 9 seconds.

The problem of unsmooth video playing can be caused by too large video skipping deviation, and the video watching experience of a user is reduced. Therefore, how to solve the problem that the video skipping deviation is too large when the streaming media video player performs video skipping under the control of a user so as to improve the video watching experience of the user still is worth researching.

Disclosure of Invention

The exemplary embodiment of the application provides a display device and a video skipping method of the display device, so as to solve the problems that skipping deviation is too large during video skipping, video playing is not smooth, and video watching experience of a user is reduced.

In a first aspect, an embodiment of the present application provides a display device, including:

a display configured to play video data;

a controller configured to:

acquiring a video jump instruction and jump time specified by the video jump instruction;

determining a video segment to which the jump time belongs, wherein the playing start time of the video segment is less than the jump time, and the playing end time of the video segment is greater than or equal to the jump time;

determining the playing time of audio and video frames in the video clip, wherein the audio and video frames consist of video frames and audio frames with the same playing time;

when the playing time of a first audio/video frame in the video clip is the same as the jumping time, determining that the first audio/video frame is a target audio/video frame;

and outputting video data to the display from the target audio and video frame, and outputting audio data to a loudspeaker from the target audio and video frame.

In one embodiment, when the controller is configured to determine the playing time of the audio-video frames in the video clip, the controller is configured to:

acquiring target key frames in the video clip, wherein the video clip comprises a plurality of audio and video frames, the target key frames belong to the plurality of key frames, the playing time corresponding to the target key frames is less than the jumping time, and the difference between the playing time corresponding to the target key frames and the jumping time is minimum;

and determining the playing time of the audio and video frame positioned after the target key frame in the video clip.

In one embodiment, the controller is further configured to:

and after the target key frame is obtained, removing all audio and video frames positioned before the target key frame in the video clip.

In one embodiment, when the controller is configured to determine the playing time of an audio-video frame of the video clip following the target key frame, the controller is configured to:

and decoding the audio and video frames positioned behind the target key frame in the video clip to obtain the playing time of each audio and video frame behind the target key frame.

In one embodiment, the controller is further configured to:

and removing audio and video frames which are positioned behind the target key frame and are positioned before the frame corresponding to the jumping time in the video clip.

and determining the playing time of the audio and video frames in the video clip from the initial audio and video frames of the video clip.

In another aspect, the present application provides a video skipping method for a display device, including:

acquiring a video jump instruction and jump time appointed by the video jump instruction;

and outputting video data to the display from the target audio and video frame, and outputting audio data to the loudspeaker from the target audio and video frame.

In one embodiment, the determining the playing time of the audio/video frame in the video segment includes:

In one embodiment, the method further comprises the following steps:

In one embodiment, the obtaining the playing time of the audio and video frames in the video clip includes:

and decoding audio and video frames positioned behind the target key frame in the video clip to obtain the playing time of each audio and video frame behind the target key frame.

In one embodiment, the method further comprises the following steps:

The embodiment of the present application further provides a display device video skipping apparatus, including:

the acquisition module is used for acquiring a video jump instruction and jump time specified by the video jump instruction;

the acquisition module is further configured to determine a video segment to which the skip time belongs, where a play start time of the video segment is less than the skip time, and a play end time of the video segment is greater than or equal to the skip time;

the acquisition module is also used for determining the playing time of audio and video frames in the video clip, wherein the audio and video frames consist of video frames and audio frames with the same playing time;

the processing module is used for determining that a first audio/video frame in the video clip is a target audio/video frame when the playing time of the first audio/video frame is the same as the jumping time;

and the output module starts to output video data to the display from the target audio and video frame and simultaneously starts to output audio data to the loudspeaker from the target audio and video frame.

Embodiments of the present application further provide a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed by a controller, the method described in any of the above method embodiments is implemented.

An embodiment of the present application further provides a display system, which includes the display device provided above.

The embodiment of the present application further provides a chip for executing the instruction, where the chip is configured to execute the method provided in any of the above method embodiments.

Embodiments of the present application further provide a computer program product, which includes a computer program, where the computer program is stored in a computer-readable storage medium, and at least one controller can read the computer program from the computer-readable storage medium, and when the computer program is executed by the at least one controller, the at least one controller can implement the method provided by any one of the above method embodiments.

The display device obtains the jump time specified by the video jump instruction after obtaining the video jump instruction, and traverses the playing time of the video frame in the video segment to which the jump time belongs, and when the playing time of a certain video frame in the video segment is equal to the jump time, respectively outputs video data and audio data to the display and the loudspeaker by starting with the frame corresponding to the jump time. At this time, the display and the speaker start playing the audio and video from the jump time. Therefore, when a user wants to jump the playing time of the video, the playing deviation does not occur after the video jumps, and the video is played from the appointed jumping time, so that the smoothness of playing the video after the video jumps is improved, and the video watching experience of the user is improved.

Drawings

In order to more clearly illustrate the embodiments of the present application or the implementation manner in the related art, the drawings used in the description of the embodiments or the related art will be briefly described below, and it is obvious that the drawings in the description below are some embodiments of the present application, and other drawings can be obtained by those skilled in the art according to these drawings.

A schematic diagram of an operational scenario between a display device and a control apparatus according to some embodiments is illustrated in fig. 1.

A block diagram of a hardware configuration of a display device according to some embodiments is illustrated in fig. 2.

A block diagram of a hardware configuration of a control device according to some embodiments is illustrated in fig. 3.

A schematic diagram of a software configuration in a display device according to some embodiments is illustrated in fig. 4.

An icon control interface display diagram of an application in a display device according to some embodiments is illustrated in fig. 5.

A schematic structural diagram of a display device in some embodiments is illustrated in fig. 6.

A schematic diagram of a video clip and key frames in some embodiments is illustrated in fig. 7.

A schematic diagram of a display device video hopping method provided in some embodiments is illustrated in fig. 8.

FIG. 9 illustrates a schematic diagram of a display device video hop arrangement provided in some embodiments.

Detailed Description

To make the objects, embodiments and advantages of the present application clearer, the following description of exemplary embodiments of the present application will clearly and completely describe the exemplary embodiments of the present application with reference to the accompanying drawings in the exemplary embodiments of the present application, and it is to be understood that the described exemplary embodiments are only a part of the embodiments of the present application, and not all of the embodiments.

All other embodiments, which can be derived by a person skilled in the art from the exemplary embodiments described herein without inventive step, are intended to be within the scope of the claims appended hereto. In addition, while the disclosure herein has been presented in terms of exemplary embodiment or embodiments, it should be appreciated that individual aspects of the disclosure can be utilized in a variety of forms and embodiments.

It should be noted that the brief descriptions of the terms in the present application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.

The terms "first," "second," "third," and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and are not necessarily intended to limit the order or sequence of any particular one, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments described herein are, for example, capable of operation in sequences other than those illustrated or otherwise described herein.

Furthermore, the terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or device that comprises a list of elements is not necessarily limited to those elements explicitly listed, but may include other elements not expressly listed or inherent to such product or device.

The term "module," as used herein, refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.

The term "remote control" as used in this application refers to a component of an electronic device (such as the display device disclosed in this application) that is typically wirelessly controllable over a relatively short range of distances. Typically using infrared and/or Radio Frequency (RF) signals and/or bluetooth to connect with the electronic device, and may also include WiFi, wireless USB, bluetooth, motion sensor, etc. For example: the hand-held touch remote controller replaces most of the physical built-in hard keys in the common remote control device with the user interface in the touch screen.

The term "gesture" as used in this application refers to a user's behavior through a change in hand shape or an action such as hand motion to convey a desired idea, action, purpose, or result.

Streaming media technology refers to a technology of compressing a series of media data, transmitting the data by online segmentation, and instantly transmitting video and audio on the internet for viewing, for example, the current HLS (HTTP Live Streaming) protocol and DASH (Dynamic Adaptive Streaming over HTTP) protocol used for video playing are all based on Streaming media technology. When a user watches a video through a streaming media video player, sometimes the video needs to be skipped forward or backward according to actual needs, or the definition and resolution of the video needs to be changed, at this time, the streaming media video player acquires the skip time of the video, acquires a video segment to which the skip time belongs, and plays the video from the first frame of the video segment, which may cause the video skip to have a deviation, or even cause the problem of an excessively large video skip deviation. The problem that video playing is not smooth can be caused by too large video skipping deviation, and the video watching experience of a user is reduced.

Based on the method, after the video jump instruction and the specified jump time are obtained, the video segment to which the jump time belongs can be obtained. And comparing the playing time of the video frame in the video clip with the skipping time until a target audio/video frame is obtained (the playing time of the target audio/video frame is the same as the skipping time). And after audio and video data are output to the display and the loudspeaker from the target audio and video frame, the display and the loudspeaker start to play the audio and video from the jump time. Therefore, the video display method and device can solve the problem that video playing is not smooth due to the fact that video jumping deviation is too large, and therefore video watching experience of a user is improved.

Fig. 1 is a schematic diagram illustrating an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display device 200 through the mobile terminal 300 and the control apparatus 100.

In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes an infrared protocol communication or a bluetooth protocol communication, and other short-distance communication methods, etc., and the display device 200 is controlled by wireless or other wired methods. The user may input a user command through a key on a remote controller, voice input, control panel input, etc. to control the display apparatus 200. Such as: the user can input a corresponding control command through a volume up/down key, a channel control key, up/down/left/right moving keys, a voice input key, a menu key, a power on/off key, etc. on the remote controller, to implement the function of controlling the display device 200.

In some embodiments, mobile terminals, tablets, computers, laptops, and other smart devices may also be used to control the display device 200. For example, the display device 200 is controlled using an application program running on the smart device. The application, through configuration, may provide the user with various controls in an intuitive User Interface (UI) on a screen associated with the smart device.

In some embodiments, the mobile terminal 300 may install a software application with the display device 200 to implement connection communication through a network communication protocol for the purpose of one-to-one control operation and data communication. Such as: the mobile terminal 300 and the display device 200 can be used for establishing a control instruction protocol, synchronizing a remote control keyboard to the mobile terminal 300 and controlling the function of the display device 200 by controlling the user interface on the mobile terminal 300. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200, so as to realize the synchronous display function.

As also shown in fig. 1, the display apparatus 200 also performs data communication with the server 400 through various communication means. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200.

The display device 200 may be a liquid crystal display, an OLED display, a projection display device. The particular display device type, size, resolution, etc. are not limiting, and those skilled in the art will appreciate that the display device 200 may be modified in performance and configuration as desired.

The display apparatus 200 may additionally provide an intelligent network television function of a computer support function including, but not limited to, a network television, an intelligent television, an Internet Protocol Television (IPTV), and the like, in addition to the broadcast receiving television function.

A hardware configuration block diagram of a display device 200 according to an exemplary embodiment is exemplarily shown in fig. 2.

In some embodiments, at least one of the controller 250, the tuner demodulator 210, the communicator 220, the detector 230, the input/output interface 255, the display 275, the audio output interface 285, the memory 260, the power supply 290, the user interface 265, and the external device interface 240 is included in the display apparatus 200.

In some embodiments, a display 275 receives image signals originating from the first processor output and displays video content and images and components of the menu manipulation interface.

In some embodiments, the display 275, includes a display screen assembly for presenting a picture, and a driving assembly that drives the display of an image.

In some embodiments, the video content is displayed from broadcast television content, or alternatively, from various broadcast signals that may be received via wired or wireless communication protocols. Alternatively, various image contents received from a network communication protocol and transmitted from a network server side can be displayed.

In some embodiments, a driver assembly for driving the display is also included, depending on the type of display 275.

In some embodiments, display 275 is a projection display and may also include a projection device and a projection screen.

In some embodiments, the display apparatus 200 may establish control signal and data signal transmission and reception with the external control apparatus 100 or the content providing apparatus through the communicator 220.

In some embodiments, the display apparatus 200 may adaptively adjust a display color temperature of an image. For example, the display apparatus 200 may be adjusted to display a cool tone when the temperature is in a high environment, or the display apparatus 200 may be adjusted to display a warm tone when the temperature is in a low environment.

In some embodiments, as shown in fig. 2, the input/output interface 255 is configured to allow data transfer between the controller 250 and external other devices or other controllers 250. Such as receiving video signal data and audio signal data of an external device, or command instruction data, etc.

In some embodiments, as shown in fig. 2, the tuning demodulator 210 is configured to receive a broadcast television signal through a wired or wireless receiving manner, perform modulation and demodulation processing such as amplification, mixing, resonance, and the like, and demodulate an audio and video signal from a plurality of wireless or wired broadcast television signals, where the audio and video signal may include a television audio and video signal carried in a television channel frequency selected by a user and an EPG data signal.

In some embodiments, the frequency points demodulated by the tuner demodulator 210 are controlled by the controller 250, and the controller 250 can send out control signals according to user selection, so that the modem responds to the television signal frequency selected by the user and modulates and demodulates the television signal carried by the frequency.

In some embodiments, the controller 250 and the modem 210 may be located in different separate devices, that is, the modem 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box. Therefore, the set top box outputs the television audio and video signals modulated and demodulated by the received broadcast television signals to the main body equipment, and the main body equipment receives the audio and video signals through the first input/output interface.

As shown in fig. 2, the controller 250 includes at least one of a Random Access Memory 251 (RAM), a Read-Only Memory 252 (ROM), a video processor 270, an audio processor 280, other processors 253 (e.g., a Graphics Processing Unit (GPU), a Central Processing Unit 254 (CPU), a Communication Interface (Communication Interface), and a Communication Bus 256 (Bus), which connects the respective components.

In some embodiments, RAM 251 is used to store temporary data for the operating system or other programs that are running.

In some embodiments, ROM 252 is used to store instructions for various system boots.

In some embodiments, the ROM 252 is used to store a Basic Input Output System (BIOS). The system is used for completing power-on self-test of the system, initialization of each functional module in the system, a driver of basic input/output of the system and booting an operating system.

In some embodiments, when the power-on signal is received, the display device 200 starts to power up, the CPU executes the system boot instruction in the ROM 252, and copies the temporary data of the operating system stored in the memory to the RAM 251 so as to start or run the operating system. After the start of the operating system is completed, the CPU copies the temporary data of the various application programs in the memory to the RAM 251, and then, the various application programs are started or run.

In some embodiments, CPU processor 254 is used to execute operating system and application program instructions stored in memory. And executing various application programs, data and contents according to various interactive instructions received from the outside so as to finally display and play various audio and video contents.

In some example embodiments, the CPU processor 254 may comprise a plurality of processors. The plurality of processors may include a main processor and one or more sub-processors. A main processor for performing some operations of the display apparatus 200 in a pre-power-up mode and/or operations of displaying a screen in a normal mode. One or more sub-processors for one operation in a standby mode or the like.

In some embodiments, the graphics processor 253 is used to generate various graphics objects, such as: icons, operation menus, user input instruction display graphics, and the like. The display device comprises an arithmetic unit which carries out operation by receiving various interactive instructions input by a user and displays various objects according to display attributes. And the rendering device is used for rendering various objects obtained based on the arithmetic unit, and the rendered objects are used for being displayed on a display.

In some embodiments, the video processor 270 is configured to receive an external video signal, and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, and the like according to a standard codec protocol of the input signal, so as to obtain a signal that can be displayed or played on the direct display device 200.

In some embodiments, video processor 270 includes a demultiplexing module, a video decoding module, an image compositing module, a frame rate conversion module, a display formatting module, and the like.

The demultiplexing module is used for demultiplexing the input audio and video data stream, and if the input MPEG-2 is input, the demultiplexing module demultiplexes the input audio and video data stream into a video signal and an audio signal.

And the video decoding module is used for processing the demultiplexed video signal, including decoding, scaling and the like.

And the image synthesis module, such as an image synthesizer, is used for performing superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphics generator so as to generate an image signal for display.

The frame rate conversion module is used for converting an input video frame rate, such as a 60Hz frame rate into a 120Hz frame rate or a 240Hz frame rate, and a common format is implemented by using a frame interpolation method, for example.

The display format module is used for converting the received video output signal after the frame rate conversion, and changing the signal to conform to the signal of the display format, such as outputting an RGB data signal.

In some embodiments, the graphics processor 253 may be integrated with the video processor, or may be separately provided, where the integrated configuration may perform processing of a graphics signal output to the display, and the separate configuration may perform different functions, such as a GPU + FRC (Frame Rate Conversion) architecture.

In some embodiments, the audio processor 280 is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform noise reduction, digital-to-analog conversion, and amplification processes to obtain an audio signal that can be played in a speaker.

In some embodiments, video processor 270 may comprise one or more chips. The audio processor may also comprise one or more chips.

In some embodiments, the video processor 270 and the audio processor 280 may be separate chips or may be integrated together with the controller in one or more chips.

In some embodiments, the audio output, under the control of controller 250, receives sound signals output by audio processor 280, such as: the speaker 286, and an external sound output terminal of a generating device that can output to an external device, in addition to the speaker carried by the display device 200 itself, such as: external sound interface or earphone interface, etc., and may also include a near field communication module in the communication interface, for example: and the Bluetooth module is used for outputting sound of the Bluetooth loudspeaker.

The memory 260 includes a memory for storing various software modules for driving the display device 200. Such as: various software modules stored in the first memory, including: at least one of a base module, a detection module, a communication module, a display control module, a browser module, and various service modules.

The base module is a bottom layer software module for signal communication between various hardware in the display device 200 and for sending processing and control signals to the upper layer module. The detection module is used for collecting various information from various sensors or user input interfaces, and the management module is used for performing digital-to-analog conversion and analysis management.

Fig. 3 exemplarily shows a block diagram of a configuration of the control apparatus 100 according to an exemplary embodiment. As shown in fig. 3, the control apparatus 100 includes a controller 110, a communication interface 130, a user input/output interface, a memory, and a power supply source.

The control device 100 is configured to control the display device 200 and may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200. Such as: the user responds to the channel up and down operation by operating the channel up and down keys on the control device 100.

In some embodiments, the control device 100 may be a smart device. Such as: the control apparatus 100 may install various applications that control the display apparatus 200 according to user demands.

The controller 110 includes a processor 112 and RAM 113 and ROM 114, a communication interface 130, and a communication bus. The controller is used to control the operation of the control device 100, as well as the communication cooperation between the internal components and the external and internal data processing functions.

The communication interface 130 enables communication of control signals and data signals with the display apparatus 200 under the control of the controller 110. Such as: the received user input signal is transmitted to the display apparatus 200. The communication interface 130 may include at least one of a WiFi chip 131, a bluetooth module 132, an NFC module 133, and other near field communication modules.

In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input-output interface 140. The control device 100 is provided with a communication interface 130, such as: the WiFi, bluetooth, NFC, etc. modules may transmit the user input command to the display device 200 through the WiFi protocol, or the bluetooth protocol, or the NFC protocol code.

A memory 190 for storing various operation programs, data and applications for driving and controlling the control apparatus 200 under the control of the controller. The memory 190 may store various control signal commands input by a user.

And a power supply 180 for providing operational power support to the elements of the control device 100 under the control of the controller. A battery and associated control circuitry.

Referring to fig. 4, in some embodiments, the system is divided into four layers, which are, from top to bottom, an Application (Applications) layer (abbreviated as "Application layer"), an Application Framework (Application Framework) layer (abbreviated as "Framework layer"), an Android runtime (Android runtime) and system library layer (abbreviated as "system runtime library layer"), and a kernel layer.

In some embodiments, at least one application program runs in the application program layer, and the application programs can be Window (Window) programs carried by an operating system, system setting programs, clock programs, camera applications and the like; or may be an application developed by a third party developer such as a hi program, a karaoke program, a magic mirror program, or the like. In specific implementation, the application packages in the application layer are not limited to the above examples, and may actually include other application packages, which is not limited in this embodiment of the present application.

The framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer includes a number of predefined functions. The application framework layer acts as a processing center that decides to let the applications in the application layer act. The application program can access the resource in the system and obtain the service of the system in execution through the API interface

As shown in fig. 4, in the embodiment of the present application, the application framework layer includes a manager (Managers), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used for interacting with all activities running in the system; the Location Manager (Location Manager) is used for providing the system service or application with the access of the system Location service; a Package Manager (Package Manager) for retrieving various information related to an application Package currently installed on the device; a Notification Manager (Notification Manager) for controlling display and clearing of Notification messages; a Window Manager (Window Manager) is used to manage the icons, windows, toolbars, wallpapers, and desktop components on a user interface.

In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 4, the core layer includes at least one of the following drivers: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (such as fingerprint sensor, temperature sensor, touch sensor, pressure sensor, etc.), and so on.

In some embodiments, as shown in fig. 5, the application layer containing at least one application may display a corresponding icon control in the display, such as: the system comprises a live television application icon control, a video on demand application icon control, a media center application icon control, an application center icon control, a game application icon control and the like.

In some embodiments, the live television application may provide live television via different signal sources. For example, a live television application may provide television signals using input from cable television, radio broadcasts, satellite services, or other types of live television services. And, the live television application may display video of the live television signal on the display device 200.

In some embodiments, a video-on-demand application may provide video from different storage sources. Unlike live television applications, video on demand provides a video display from some storage source. For example, the video on demand may come from a server side of cloud storage, from a local hard disk storage containing stored video programs.

In some embodiments, the media center application may provide various applications for multimedia content playback. For example, a media center, which may be other than live television or video on demand, may provide services that a user may access to various images or audio through a media center application.

In some embodiments, an application center may provide storage for various applications. The application may be a game, an application, or some other application associated with a computer system or other device that may be run on the smart television. The application center may obtain these applications from different sources, store them in local storage, and then be executable on the display device 200.

Referring to fig. 6, the present application provides a display device 10, where the display device 10 includes a display 275 and a controller 250, as described above in relation to the foregoing, the display 275 is configured to play a video, and optionally, an audio/video player may be disposed on the display device 10, and a user may view an audio/video through the audio/video player, adjust an audio/video schedule, switch a resolution of the audio/video, and the like. The controller 250 is connected to the display 275 and the speaker 286, respectively, and specifically, the video processor 270 of the controller 250 is connected to the display 275, and the audio processor 280 of the controller 250 is connected to the speaker 286.

The controller 250 is configured to obtain a video jump instruction and a jump time specified by the video jump instruction.

The video jump instruction is input to the display device 10 by a user through an operation. For example, when a user changes the video playing progress according to actual needs, the user can drag a progress bar on the audio/video player to move the video back and forth, and when the action of dragging the progress bar is finished, the video skipping instruction is generated, and at this time, the skipping time is the playing time corresponding to the action of dragging the progress bar when the action of dragging the progress bar is finished. Or when the user changes the video resolution according to the actual requirement, the user generates the video jump instruction by clicking the resolution switching button. Or in the scene of some video playback intervals (for example, a certain segment in the video is specified by the user to be played circularly), when the video segment played circularly is specified by the user, a video jump instruction is generated, and at this time, the jump time specified by the video jump instruction is the playing start time of the video segment played circularly.

Before the controller 250 acquires the video jump instruction, the controller 250 receives an external video signal and performs audio and video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, and the like on the audio and video signal according to a standard encoding protocol of an input signal. After the controller 250 acquires the video jump instruction, the controller 250 stops the audio/video processing processes of decompressing, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, and the like of the audio/video signal. At this time, the controller 250 is configured to determine a video segment to which the jump time belongs, wherein a play start time of the video segment is less than the jump time, and a play end time of the video segment is greater than or equal to the jump time. For example, as shown in FIG. 7, a video is 10 seconds and one segment, i.e., the first segment is [ 0-10) seconds of video data and the second segment is [ 10-19) seconds. When the skip time is the 11 th second, or the 15 th second, or the 18 th second, the corresponding video clip is the second clip [ 10-19) seconds. When the skip time is 5 th second, or 7 th second, or 9 th second, the corresponding video clip is the first clip [ 0-10) seconds.

The controller 250 is further configured to determine the playing time of the video and audio frames in the video segment, wherein the video and audio data are composed of the video frames and the audio frames with the same playing time, and the playing time can be understood as the time stamp carried by the video frames and the audio frames composing the video and audio frames.

When the playing time of the audio and video frames in the video segment is determined, the controller 250 may analyze the audio and video data in the video segment to obtain the timestamp carried by each frame of the audio and video data.

The controller 250 is further configured to compare the playing time of the audio-video frame in the video segment with the jumping time, and when the playing time of the first audio-video frame in the video segment is the same as the jumping time, the controller 250 determines that the first audio-video frame is the target audio-video frame. Wherein, the first audio-video frame refers to any one audio-video frame in the video clip. The target audio and video frame comprises a target video frame and a target audio frame which have the same playing time. After determining the target video frame and the target audio frame, the controller 250 outputs video data to the display 275 starting from the target video frame, and simultaneously outputs audio data to the speaker 286 starting from the target audio frame.

Specifically, the video processor 270 in the controller 250 performs video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, and the like of a video signal in accordance with a standard encoding protocol of an input signal from the jump time. The video processor 270 transmits the processed video data to the display 275 after the video processing is completed, and the display 275 displays an image from the jumping time point. Similarly, the audio processor 280 in the controller 250 performs audio processing such as decompression and decoding of the audio signal according to the standard encoding protocol of the input signal from the jump time. The audio processor 280 transmits the processed audio data to the speaker 286 after completing the audio processing, and the speaker 286 performs sound playback from the jump time point.

In one embodiment, the controller 250 is specifically configured to obtain a target key frame in the video clip. As shown in fig. 7, the video clip includes a plurality of key frames, that is, a plurality of key frames are included in all the audio-video frames included in the video clip. The playing time corresponding to the target key frame is less than the jumping time, and the difference between the playing time corresponding to the target key frame and the jumping time is minimum. Upon acquiring the target key frame, the controller 250 traverses the video clip to determine the target key frame from the key frames in the video clip.

After acquiring the target key frame, the controller 250 is further configured to determine a playing time of an audiovisual frame of the video clip that follows the target key frame. Specifically, the controller 250 starts to analyze the audio/video data in the video segment from the target key frame to obtain a timestamp carried by an audio/video frame after the target key frame. It can also be understood that the video processor 270 decodes the audio/video frames in the video segment after the target key frame to obtain the playing time of each audio/video frame after the target key frame.

In one embodiment, the controller 250 is further configured to clear all audio-video frames of the video clip that precede the target key frame after the target key frame is obtained. In particular, all audio-visual frames in the video clip that precede the target key frame can be purged by the video processor 270. Alternatively, the controller 250 may also clear all audiovisual frames preceding the target key frame, and is not limited to clearing all audiovisual frames preceding the target key frame in the video segment.

In one embodiment, the controller 250 is further configured to clear the audiovisual frames in the video clip that follow the target key frame and precede the frame corresponding to the jump time. Specifically, the audio/video frames in the video segment after the target key frame and before the frame corresponding to the jump time may be cleared by the video processor 270.

In one embodiment, when the controller 250 is configured to determine the playing time of the audio-video frame in the video segment, the controller 250 may also determine the playing time of the video frame in the audio-video segment starting from the starting audio-video frame of the video segment. In comparison, the method for acquiring the playing time of the audio/video frame starting from the target key frame can reduce the operation amount of the controller 250, thereby improving the speed and efficiency of video skipping.

The display device 10 provided by the present embodiment determines the video segment to which the jump time belongs after acquiring the video jump instruction and the specified jump time. And comparing the playing time of the video frame in the video clip with the skipping time until a target audio/video frame is obtained (the playing time of the target audio/video frame is the same as the skipping time). And outputting video data to a display from the target audio and video frame, and after outputting audio data to a loudspeaker from the target audio and video frame, starting to play video by the display from the jump time, and starting to play audio by the loudspeaker from the jump time. Therefore, the video playing method and the video playing device can solve the problem that the video playing is not smooth due to overlarge video skipping deviation, and therefore the video watching experience of a user is improved.

Referring to fig. 8, the present application provides a video skipping method for a display device, including:

s801, acquiring a video jump instruction and jump time appointed by the video jump instruction.

The video skipping instruction is input to the display device 10 by a user through operation, for example, when the user changes the video playing progress according to actual needs, the user can drag the progress bar on the audio and video player to move the video back and forth, the video skipping instruction is generated after the action of dragging the progress bar is finished, and the skipping time is the corresponding playing time when the action of dragging the progress bar is finished. Or when the user changes the video resolution according to the actual requirement, the user generates the video jump instruction by clicking the resolution switching button. Or in some video playback scenes (for example, a certain segment in the video is specified by the user to be played in a loop), when the video segment in the loop playing is specified by the user, a video jump instruction is generated, and at this time, the jump time specified by the video jump instruction is the playing start time of the video segment in the loop playing.

S802, determining the video segment to which the jumping time belongs, wherein the playing start time of the video segment is less than the jumping time, and the playing end time of the video segment is greater than or equal to the jumping time.

For example, a video 10 seconds and a segment, i.e. the first segment is [0-10] seconds of video data, the second segment is (10-19 ] seconds, when the jumping-time is 11 seconds, or 15 seconds, or 19 seconds, the corresponding video segment is the second segment (10-19 ] seconds).

And S803, determining the playing time of the audio and video frames in the video clip, wherein the audio and video frames consist of the video frames and the audio frames with the same playing time.

The playing time refers to a timestamp carried by the audio/video data corresponding to the audio/video frame.

In some embodiments, the playing time of each audio-video frame in the video segment may be determined starting from a starting audio-video frame of the video segment. Or starting from a target key frame in the video clip, determining the playing time of each audio-video frame positioned after the target key frame in the video clip. The video clip comprises a plurality of key frames in all audio and video frames, the target key frame belongs to the plurality of key frames, the playing time corresponding to the target key frame is less than the skipping time, and the difference between the playing time corresponding to the target key frame and the skipping time is minimum. Specifically, the audio/video frame after the target key frame in the video clip is decoded to obtain the playing time of each audio/video frame after the target key frame.

In some embodiments, after the target key frame is acquired, all audio-video frames in the video clip that precede the target key frame are cleared.

In some embodiments, after the target key frame is obtained, the audio/video frames in the video clip, which are located after the target key frame and before the frame corresponding to the jump time, are removed.

S804, when the playing time of the first audio/video frame in the video clip is the same as the jumping time, the first audio/video frame is determined to be a target audio/video frame.

The controller 250 in the display device 10 compares the playing time of the audio-video frame in the video segment with the jump time, and when the playing time of the first audio-video frame in the video segment is the same as the jump time, the controller 250 determines that the first audio-video frame is the target audio-video frame.

And S805, starting to output video data to the display from the target audio and video frame, and simultaneously starting to output audio data to the loudspeaker from the target audio and video frame.

Specifically, the video processor 270 performs video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis of the video signal in accordance with a standard encoding protocol of the input signal from the jump time. Similarly, the audio processor 280 performs audio processing such as decompression, decoding, scaling, and noise reduction of the audio signal according to a standard encoding protocol of the input signal from the jump time.

The target audio-video frame includes a target video frame and a target audio frame having the same play time, and thus, the video processor 270 outputs video data to the display 275 from the target video frame, so that the display 275 starts playing video from the jump time. At the same time, the audio processor 280 outputs audio data to the speaker 286 from the target audio frame, so that the speaker 286 plays audio from the jump time.

In the method provided by the embodiment, after the video jump instruction and the specified jump time are obtained, the video segment to which the jump time belongs is obtained. And comparing the playing time of the audio and video frames in the video clip with the skipping time until a target audio and video frame is obtained (the playing time of the target audio and video frame is the same as the skipping time). After the audio/video data is outputted to the display 275 and the speaker 286 from the target audio/video frame, the display 275 and the speaker 286 start playing the audio/video from the jump time. Therefore, the problem that video playing is not smooth due to overlarge video skipping deviation can be solved, and the video watching experience of a user is improved.

Referring to fig. 9, the present application further provides a video skipping apparatus 30 for a display device, including:

the obtaining module 31 is configured to obtain a video jump instruction and a jump time specified by the video jump instruction.

The obtaining module 31 is further configured to determine a video segment to which the jump time belongs, where a playing start time of the video segment is less than the jump time, and a playing end time of the video segment is greater than or equal to the jump time.

The obtaining module 31 is further configured to determine a playing time of an audio and video frame in the video segment, where the audio and video frame is composed of a video frame and an audio frame with the same playing time.

And the processing module 32 is configured to determine that the first audio/video frame is the target audio/video frame when the playing time of the first audio/video frame in the video segment is the same as the jumping time.

And an output module 33, configured to output video data to the display from the target audio/video frame, and output audio data to the speaker from the target audio/video frame.

The obtaining module 31 is specifically configured to obtain a target key frame in the video clip, where the video clip includes multiple key frames in all audio and video frames, the target key frame belongs to the multiple key frames, a playing time corresponding to the target key frame is shorter than the skipping time, and a difference between the playing time corresponding to the target key frame and the skipping time is minimum; and determining the playing time of the audio and video frame positioned after the target key frame in the video clip.

The display device video skipping apparatus 30 further includes:

a clearing module 34, where the clearing module 34 is configured to clear all audio/video frames in the video segment before the target key frame after the target key frame is acquired.

The clearing module 34 is further configured to clear the audio-video frames in the video segment that are located after the target key frame and before the frame corresponding to the jump time.

The obtaining module 31 is specifically configured to decode the audio/video frame in the video segment after the target key frame, and obtain the playing time of each audio/video frame after the target key frame.

The obtaining module 31 is specifically configured to determine, starting from a starting audio/video frame of the video clip, a playing time of an audio/video frame in the video clip.

The apparatus provided in this embodiment may be used to perform the steps performed by the display device 10 in the embodiment shown in fig. 7, and the implementation principle and technical effects are similar, which are not described herein again.

It should be noted that the division of the modules of the above apparatus is only a logical division, and the actual implementation may be wholly or partially integrated into one physical entity, or may be physically separated. And these modules can be realized in the form of software called by processing element; or may be implemented entirely in hardware; and part of the modules can be realized in the form of calling software by the processing element, and part of the modules can be realized in the form of hardware. For example, the processing module may be a processing element separately set up, or may be implemented by being integrated in a chip of the apparatus, or may be stored in a memory of the apparatus in the form of program code, and a function of the processing module may be called and executed by a processing element of the apparatus. Other modules are implemented similarly. In addition, all or part of the modules can be integrated together or can be independently realized. The processing element here may be an integrated circuit with signal processing capabilities. In implementation, the steps of the method or the modules may be implemented by hardware integrated logic circuits in the controller element or instructions in software.

For example, the above modules may be one or more integrated circuits configured to implement the above methods, such as: one or more ASICs (Application Specific Integrated circuits), or one or more DSPs (Digital Signal processors), or one or more FPGAs (Field Programmable Gate arrays), etc. For another example, when some of the above modules are implemented in the form of processing element dispatcher code, the processing element may be a general purpose processor, such as a CPU or other processor that can invoke the program code. As another example, these modules may be integrated together and implemented in the form of a SOC (System-on-a-Chip).

In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer programs. The procedures or functions described in accordance with the embodiments of the application are all or partially generated when the computer program instructions are loaded and executed on a computer. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer program can be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, the computer program can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that includes one or more of the available media. The usable medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a Solid State Disk (SSD)), among others.

Embodiments of the present application further provide a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed by a processor, the method described in any of the above method embodiments is implemented.

The embodiment of the application also provides a display system, which comprises the display device 10 provided as above.

Embodiments of the present application further provide a computer program product, which includes a computer program stored in a computer-readable storage medium, from which the computer program can be read by at least one processor, and the computer program can be executed by the at least one processor, so as to implement the method provided by any of the above method embodiments.

Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and these modifications or substitutions do not depart from the scope of the technical solutions of the embodiments of the present application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, comprising:

a display configured to play video data;

a controller configured to:

and outputting video data to the display from the target audio and video frame, and simultaneously outputting audio data to a loudspeaker from the target audio and video frame.

2. The display device according to claim 1, wherein when the controller is configured to determine a play time of an audiovisual frame in the video clip, the controller is configured to:

acquiring target key frames in the video clips, wherein the audio and video frames in the video clips comprise a plurality of key frames, the playing time corresponding to the target key frames is less than the skipping time, and the difference between the playing time corresponding to the target key frames and the skipping time is minimum;

3. The display device of claim 2, wherein the controller is further configured to:

4. The display device according to claim 3, wherein when the controller is configured to determine a play time of an audiovisual frame of the video clip following the target key frame, the controller is configured to:

and decoding the audio and video frames positioned behind the target key frame in the video clip to obtain the playing time of the audio and video frames behind the target key frame.

5. The display device according to any one of claims 2-4, wherein the controller is further configured to:

6. The display device according to claim 1, wherein when the controller is configured to determine a play time of an audiovisual frame in the video clip, the controller is configured to:

7. A video skipping method for a display device, comprising:

8. The method of claim 7, wherein determining the playing time of the audio-video frame in the video segment comprises:

9. The method of claim 8, further comprising:

and after the target key frame is acquired, removing all audio and video frames in the video clip before the target key frame.

10. The method of claim 9, wherein obtaining the playing time of the audio/video frames in the video clip comprises: