CN118354156A

CN118354156A - Video playing method and display device

Info

Publication number: CN118354156A
Application number: CN202410537419.4A
Authority: CN
Inventors: 熊圣昌; 庄晓庆
Original assignee: Hisense Electronic Technology Shenzhen Co ltd
Current assignee: Hisense Electronic Technology Shenzhen Co ltd
Priority date: 2024-04-29
Filing date: 2024-04-29
Publication date: 2024-07-16

Abstract

The embodiment of the application discloses a video playing method and display equipment, wherein the method comprises the following steps: when the target video is live broadcast, responding to a pause instruction input by a user at a first moment, and pausing to play the target video; recording the target video from the pause node corresponding to the first moment; responding to a playing instruction input by a user at a second moment, displaying a first prompting page, wherein the first prompting page is used for prompting the user to select a target playing mode, and the target playing mode is one of a continuous playing mode and a real-time playing mode from a pause position; and if the target playing mode is the continuous playing mode from the pause position, playing back the recorded file of the target video. In this way, the display device does not depend on time shifting capability, and the video live broadcast can be played continuously from the pause point without configuring special time shifting device or time shifting service.

Description

Video playing method and display device

Technical Field

The present application relates to the field of display devices, and in particular, to a video playing method and a display device.

Background

The display device can carry out live video, and the video can be television programs of different channels or live media resources on a network. The live video is played in a media live stream mode, no existing physical media file exists, live video pictures and audio content are collected, transmitted and played in real time, unlike video on demand, the played content of the live video is often slightly elapsed, rollback and fast forward cannot be achieved, and secondary playing is not supported.

When watching live video, a user can pause playing video, and then when the user triggers a play button to resume playing video, based on the real-time characteristic of live video, the video generally directly jumps to live stream transmitted in real time and continues playing, so that the user misses to watch video content in a pause period. If the live video is to be continuously played from the pause point, the display device needs to have time shifting capability for live video, and time shifting means supporting operations such as pause, fast forward, reverse and the like of a user in the live video process, so that mobility of a play time point in live video is realized, and the play node of live video can be moved forward to a previous pause point through a time shifting technology. If the display device is to have live time shifting capability, a special time shifting device (e.g., a time shifting board) or a time shifting service needs to be configured.

Disclosure of Invention

Some embodiments of the present application provide a video playing method and a display device, which can realize continuous playing of live video from a pause point without configuring a special time shifting device (such as a time shifting board) or a time shifting service.

In a first aspect, some embodiments of the present application provide a display apparatus, including:

A display for displaying a user interface;

The user input interface is used for receiving an operation instruction input by a user;

A controller for performing:

When the target video is live broadcast, responding to a pause instruction input by a user at a first moment, and pausing to play the target video;

recording the target video from the pause node corresponding to the first moment;

Responding to a playing instruction input by a user at a second moment, and controlling a display to display a first prompting page, wherein the first prompting page is used for prompting the user to select a target playing mode, and the target playing mode is one of a continuous playing mode and a real-time playing mode from a pause position;

And if the target playing mode is the continuous playing mode from the pause position, playing back the recorded file of the target video.

In some embodiments, the controller is further configured to perform: if the target playing mode is the real-time playing mode, the playback function is not started, and the recording of the target video is stopped; and continuing to play the target video at the real-time live broadcast progress.

In some embodiments, after playback of the recorded file of the target video, the controller is further configured to: detecting the playback progress and the real-time live broadcast progress of the target video; stopping recording and playing back the target video if the playback progress levels up the real-time live broadcast progress; and continuing to play the target video at the real-time live broadcast progress.

In some embodiments, before recording the target video from the pause node corresponding to the first time, the controller is further configured to perform: responding to a pause instruction input by a user at a first moment, and starting a recording function in advance so as to reduce recording delay; the display is controlled to display a second prompt page, and the second prompt page is used for inquiring whether a user stores the live video content of the target video in the pause period or not; and if an operation instruction for storing the live video content of the target video in the pause period is received, recording the target video according to the live video data of the target video.

In some embodiments, before controlling the display to display the first hint page, the controller is further configured to: the playback function is started in advance to reduce the play-out delay of playback.

In some embodiments, the controller is further configured to perform: if an operation instruction for storing the video live broadcast content of the target video in the pause period is not received, pausing playing the target video, and closing the recording function; and responding to a playing instruction input by the user at the second moment, and continuing to play the target video from the real-time playing progress.

In some embodiments, after playback of the recorded file of the target video, the controller is further configured to: detecting the playback progress and the real-time live broadcast progress of the target video; if the playback progress is in the level of the real-time live broadcast progress, controlling a display to display a third prompt page, wherein the third prompt page is used for inquiring whether to stop recording the target video; responding to a recording stopping instruction input by a user, and closing the recording function to stop recording the target video; and responding to a recording continuing instruction input by a user, continuing recording the target video, and closing the recording function when the condition that the recording ending condition is met is detected.

In some embodiments, the controller is further configured to perform: responding to a recording stopping instruction input by a user based on the third prompting page, and controlling a display to display a fourth prompting page, wherein the fourth prompting page is used for inquiring whether the user deletes the first recorded file of the target video in the pause period; deleting the first recorded file in response to a deleting instruction input by a user; and responding to a reservation instruction input by a user, and not deleting the first recorded file stored in the preset storage position.

In some embodiments, the controller is further configured to perform: responding to a continuous recording instruction input by a user based on the third prompting page, and controlling a display to display a fourth prompting page, wherein the fourth prompting page is used for inquiring whether the user deletes the first recorded file of the target video in the pause period; deleting the first recorded file in response to a deleting instruction input by a user, and recording a second recorded file of the target video from a real-time playing progress;

Or responding to a deleting instruction input by a user, continuing to record the recorded file of the target video, splitting the recorded file into a first sub-file and a second sub-file according to the playing progress node corresponding to the second moment when the recording is finished, deleting the first sub-file, and storing the second sub-file in the preset storage position; the first subfile is a video file recorded in a pause period corresponding to the first time and the second time, and the second subfile is a video file recorded after the second time;

And responding to a reservation instruction input by a user, continuing recording the recorded file of the target video, and storing the recorded file in a preset storage position when the recording is finished.

In a second aspect, some embodiments of the present application further provide a video playing method, including:

Responding to a playing instruction input by a user at a second moment, displaying a first prompting page, wherein the first prompting page is used for prompting the user to select a target playing mode, and the target playing mode is one of a continuous playing mode and a real-time playing mode from a pause position;

In a third aspect, some embodiments of the present application also provide a computer storage medium having stored therein program instructions which, when run on a computer, cause the computer to perform the methods referred to in the above aspects and their respective implementations.

In the embodiments of the above aspects of the present application, for a live video scene, when a user pauses to play a target video, by starting a recording function, live video content of the target video in a lower pause period is saved, and when the user plays the target video, a first prompt page is displayed, so that more selectivity is provided for the user, and whether to continue the play mode from the pause or to play the target video in real time is selected according to viewing preferences. If the user selects to continue the play mode from the pause position, a playback function is started to play back the recorded file of the target video, so that the user can watch the live broadcast content of the target video in the pause period, the integrity and continuity of video watching are ensured, and the user is prevented from missing the highlight content in the pause period. The embodiment of the application does not depend on time shifting capability, so that continuous playing of video live broadcast from a pause point can be realized without configuring special time shifting equipment (such as a time shifting board) or time shifting service by display equipment.

Drawings

In order to more clearly illustrate some embodiments of the present application or the technical solutions in the prior art, the drawings that are needed in the embodiments or the description of the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained according to the drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic diagram of an operation scenario between a display device and a control device according to some embodiments of the present application;

fig. 2 is a schematic diagram of a hardware configuration of a display device according to some embodiments of the present application;

FIG. 3 is a schematic software configuration of a display device according to some embodiments of the present application;

fig. 4 is a schematic diagram of a process flow of live tv provided in some embodiments of the present application;

Fig. 5 is a schematic diagram of a user operation scene in a live video process according to some embodiments of the present application;

Fig. 6 is a flowchart of a first video playing method according to some embodiments of the present application;

Fig. 7 is a schematic diagram of a display device displaying a first prompt pop-up window according to some embodiments of the present application;

FIG. 8 is a schematic diagram of a video playback interface provided in some embodiments of the present application;

fig. 9 is a schematic diagram of a display device displaying a second prompt pop-up window according to some embodiments of the present application;

Fig. 10 is a schematic diagram of a display device according to some embodiments of the present application displaying a third prompt pop-up window;

fig. 11 is a flowchart of a second video playing method according to some embodiments of the present application;

fig. 12 is a schematic diagram of a display device displaying a first prompting page according to some embodiments of the present application.

Detailed Description

Reference will now be made in detail to the embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The embodiments described in the examples below do not represent all embodiments consistent with the application. Merely exemplary of systems and methods consistent with aspects of the application as set forth in the claims.

It should be noted that the brief description of the terminology in the present application is for the purpose of facilitating understanding of the embodiments described below only and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms first, second, third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that is capable of performing the function associated with that element.

In the embodiment of the present application, the display device 200 generally refers to a device having a screen display and a data processing capability. For example, display device 200 includes, but is not limited to, a smart television, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, and the like.

Fig. 1 is a schematic diagram of an operation scenario between a display device and a control device according to some embodiments of the present application. As shown in fig. 1, a user may operate the display device 200 through a touch operation, the mobile terminal 300, and the control device 100. Wherein the control device 100 is configured to receive an operation instruction input by a user, and convert the operation instruction into a control instruction recognizable and responsive by the display device 200. For example, the control device 100 may be a remote control, a stylus, a handle, or the like.

The mobile terminal 300 may serve as a control device for performing man-machine interaction between a user and the display device 200. The mobile terminal 300 may also be used as a communication device for establishing a communication connection with the display device 200 for data interaction. In some embodiments, the mobile terminal 300 may install a software application with the display device 200, implement connection communication through a network communication protocol, and achieve the purpose of one-to-one control operation and data communication. The audio/video content displayed on the mobile terminal 300 can also be transmitted to the display device 200, so as to realize the synchronous display function.

In some embodiments, the mobile terminal 300 or other electronic device may also simulate the functions of the control device 100 by running an application program that controls the display device 200.

As also shown in fig. 1, the display device 200 is also in data communication with the server 400 via a variety of communication means. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks.

The display device 200 may provide a broadcast receiving tv function, and may additionally provide an intelligent network tv function of a computer supporting function, including, but not limited to, a network tv, an intelligent tv, an Internet Protocol Tv (IPTV), etc.

Fig. 2 is a block diagram of a hardware configuration of the display device 200 of fig. 1 according to some embodiments of the present application.

In some embodiments, the display apparatus 200 may include at least one of a modem 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, a user input interface.

In some embodiments, the modem 210 may receive the broadcast television signal through a wired or wireless manner, and may perform a modulation and demodulation process such as amplification, mixing, and resonance, for demodulating an audio/video signal carried in a frequency of a television channel selected by a user and additional information (e.g., EPG data) from a plurality of wireless or wired broadcast television signals.

In some embodiments, the modem 210 is responsive to the frequency of the user selected television channel and the broadcast television signal carried by that frequency, as selected by the user, and as controlled by the controller 250.

In some embodiments, the tuner demodulator 210 may receive signals in a variety of ways depending on the broadcasting system of the broadcast television signal, including but not limited to: terrestrial broadcasting, cable broadcasting, satellite broadcasting, internet broadcasting, or the like; and according to different modulation types, a digital modulation mode or an analog modulation mode can be implemented; and the analog signal and the digital signal can be demodulated according to the kind of the received broadcast television signal.

In some embodiments, the modem 210 may also be in an external device, such as an external set-top box or the like. In this way, the set-top box outputs a broadcast television signal after modulation and demodulation, and transmits the signal to the display apparatus 200 through the device interface 240.

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; either the detector 230 comprises an image collector, such as a camera, which may be used to collect external environmental scenes, user attributes or user interaction gestures, or the detector 230 comprises a sound collector, such as a microphone or the like, for receiving external sounds.

In some embodiments, display 260 includes display functionality for presenting pictures, and a drive component that drives the display of images. The display 260 is used for receiving and displaying image signals output from the controller 250. For example, the display 260 may be used to display video content, image content, and components of menu manipulation interfaces, user manipulation UI interfaces, and the like.

In some embodiments, the communication apparatus 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display apparatus 200 may be provided with a plurality of communication devices 220 according to the supported communication manner. For example, when the display apparatus 200 supports wireless network communication, the display apparatus 200 may be provided with a communication device 220 including a WiFi function. When the display apparatus 200 supports bluetooth connection communication, the display apparatus 200 needs to be provided with a communication device 220 including a bluetooth function.

The communication means 220 may communicatively connect the display device 200 with an external device or the server 400 by means of a wireless or wired connection. Wherein the wired connection may connect the display device 200 with an external device through a data line, an interface, etc. The wireless connection may then connect the display device 200 with an external device through a wireless signal or a wireless network. The display device 200 may directly establish a connection with an external device, or may indirectly establish a connection through a gateway, a route, a connection device, or the like.

In some embodiments, the controller 250 may include at least one of a central processor, a video processor, an audio processor, a graphic processor, a power supply processor, first to nth interfaces for input/output, and the controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

In some embodiments, a user may input a user command through a graphical user interface (GRAPHICAL USER INTERFACE, GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI).

In some embodiments, audio output device 270 may be a speaker local to display device 200 or an audio output device external to display device 200. For an external audio output device of the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device may be connected to the display device 200 through the external audio output terminal to output sound of the display device 200.

In some embodiments, user input interface 280 may be used to receive instructions from user input.

To perform user interactions, in some embodiments, display device 200 may be run with an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system may control the display device to provide a user interface, for example, the operating system may directly control the display device to provide a user interface, or may run an application to provide a user interface. The operating system also allows a user to interact with the display device 200.

It should be noted that, the operating system may be a native operating system based on a specific operating platform, a third party operating system customized based on a depth of the specific operating platform, or an independent operating system specially developed for a display device.

The operating system may be divided into different modules or tiers depending on the functionality implemented, for example, as shown in FIG. 3, in some embodiments the system is divided into four layers, an application layer (simply "application layer"), an application framework layer (Application Framework) layer (simply "framework layer"), a system library layer, and a kernel layer, from top to bottom, respectively.

In some embodiments, the application layer is used to provide services and interfaces for applications so that the display device 200 can run applications and interact with users based on the applications. At least one application program can be run in the application program layer, and the application programs can be a Window (Window) program, a system setting program or a clock program of an operating system; or may be an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.

In some embodiments, referring to fig. 3, the application layer may run multiple applications, such as application 1, application 2, application 3, application 4, and so on. The embodiment of the application sets the application programs related to the functional configurations at the application layer aiming at the related programs running in the live video process, including but not limited to: TV live applications, video live applications, recording (Recording) applications, playback applications, time shift applications, and other applications. The controller (including at least one processor) may implement the technical solution of the embodiments of the present application by running at least one related application in the application.

The framework layer provides an application programming interface (Application Programming Interface, API) and programming framework for the application. The application framework layer includes a number of predefined functions. The application framework layer corresponds to a processing center that decides to let the applications in the application layer act. Through the API interface, the application program can access the resources in the system and acquire the services of the system in the execution.

Referring to fig. 3, in an embodiment of the present application, the application framework layer includes a view system (VIEW SYSTEM), a manager (Managers), a Content Provider (Content Provider), etc., where the view system may design and implement interfaces and interactions of the application, and the view system includes a list (lists), a network (grids), text boxes (text boxes), buttons (buttons), etc. The manager includes at least one of the following modules: an activity manager (ACTIVITY MANAGER) is used to interact with all activities running in the system; a Location Manager (Location Manager) for providing system services or applications with access to system Location services; a package manager (PACKAGE MANAGER) for retrieving various information about the application packages currently installed on the device; a notification manager (Notification Manager) for controlling the display and clearing of notification messages; a Window Manager (Window Manager) is used to manage icons, windows, toolbars, wallpaper, and desktop components on the user interface.

In some embodiments, the activity manager is used to manage the lifecycle of the individual applications as well as the usual navigation rollback functions, such as controlling the exit, opening, fallback, etc. of the applications. The window manager is used for managing all window programs, such as obtaining the size of a display screen, judging whether a status bar exists or not, locking the screen, intercepting the screen, controlling the change of the display window, for example, reducing the display window to display, dithering display, distorting display and the like.

In some embodiments, the system runtime layer may provide support for the framework layer, and when the framework layer is in use, the operating system may run instruction libraries, such as the C/C++ instruction library, contained in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a functional hierarchy between the hardware and software of the display device 200. The kernel layer can realize the functions of hardware abstraction, multitasking, memory management and the like. For example, as shown in fig. 3, a hardware driver may be configured in the kernel layer, and the driver included in the kernel layer may be at least one of the following drivers: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

It should be noted that the above examples are merely a simple division of functions of an operating system, and do not limit the specific form of the operating system of the display device 200 in the embodiment of the present application, and the number of levels and specific types of levels included in the operating system may be expressed in other forms according to factors such as the functions of the display device and the type of the operating system.

The live video is delivered in a media live stream mode, no existing physical media file exists, live video pictures and audio content are collected, transmitted and played in real time, unlike video on demand, the played content of the live video is often slightly elapsed, rollback, fast forward and time shift operation cannot be carried out, and even secondary playing is not supported.

Video live includes a variety of scenes including, but not limited to: live television programs of different channels (called live television for short), video live broadcast (called live webcast for short) and the like are carried out through a network. The network live broadcast can be realized through a browser or other application programs with video live broadcast capability.

Fig. 4 is a schematic diagram of a process flow of live tv broadcast according to some embodiments of the present application.

In some embodiments, taking a live tv as an example, referring to fig. 4, the display apparatus may receive an RF (Radio Frequency) signal of a broadcast television signal through a device such as a set top box, control a Tuner to convert the RF signal into an IF (INTERMEDIATE FREQUENCY intermediate Frequency) signal, and control a Demod to convert the IF signal into a TS (Transport Stream).

In some embodiments, with continued reference to fig. 4, the display device controls a Demux (demultiplexer) to separate video, audio, and subtitle data in the TS stream to obtain video stream, audio stream, and subtitle data.

In some embodiments, with continued reference to fig. 4, the display device sends a Video stream to a Video processor (specifically, a Video Decoder, VDEC for short), controls the Video processor to decode the Video stream, and transmits the decoded Video stream to a display screen (Panel) so that the Panel displays Video pictures.

In some embodiments, with continued reference to fig. 4, the display device outputs subtitle data to Panel through Graphic layer to cause Panel to display subtitle information.

In some embodiments, with continued reference to fig. 4, the display apparatus sends the Audio stream to an Audio processor (specifically, an Audio Decoder, ADEC for short), controls the Audio processor to perform decoding processing on the Audio stream, and transmits the decoded Audio stream to an Audio output device (e.g., speaker) so that the Audio output device plays the Audio content. Wherein video, audio and subtitles should remain synchronized for playback. As can be seen from the tv live procedure illustrated in fig. 4, the video live broadcast has the characteristics of real-time transmission and play.

Fig. 5 is a schematic diagram of a user operation scene in a live video process according to some embodiments of the present application.

In some embodiments, referring to view (a) of fig. 5, where the video live interface is playing the target video, the video live interface is provided with a play button 51, the play button 51 may assume two states, state 1 being a pause state and state 2 being a play state. The play button is in state 2 (play state) in view (a) of fig. 5, which is synchronized with the live video state.

In the state of the example of view (a) of fig. 5, the controller can pause playing the target video by running the relevant application (e.g., video live application), see view (b) of fig. 5, and switch the play button 51 to state 1 (pause state) in response to an operation instruction by the user to trigger the play button 51.

In the state of the view (b) example of fig. 5, in response to the user triggering the operation instruction of the play button 51 again, the controller may resume video live by running a related application program (for example, a video live application), and based on the real-time characteristic of the video live, the video will generally jump directly to a live stream transmitted in real time and continue to play, and see the view (c) of fig. 5, the video live interface displays a video picture at the current live progress of the target video, which may cause the user to miss the video content in the viewing pause period, resulting in discontinuous play content. Wherein the pause period is the time interval between two triggers of the play button 51 from the user.

If the live video is to be continuously played from the pause point, the display device needs to have time shifting capability for live video, and the time shifting capability supports operations such as pause, fast forward, reverse and the like in the live video process, so that the mobility of the play time point in live video is realized, and the play node can be moved forward to the previous pause point through a time shifting technology when live video is resumed. However, if the display device is to have live time-shifting capability, a special device (e.g., a time-shifting board) or time-shifting service needs to be configured.

The embodiment of the application provides a video playing method and a display device, which can realize continuous playing of video live broadcast from a pause point without configuring special time shifting devices (such as time shifting boards) or time shifting services.

Fig. 6 is a flowchart of a first video playing method according to some embodiments of the present application.

In some embodiments, the controller (including at least one processor) may execute the video playback method by running an associated application, see fig. 6, the method comprising:

step S61, when the target video is live-broadcast on the display device, the playing of the target video is paused in response to a pause instruction input by the user.

In some embodiments, referring to view (a) of fig. 5, while the play button 51 is in state 2 (play state), the user may trigger the play button 51 through a control device (e.g., a remote controller) to input a pause instruction. In response to the pause instruction, the controller can pause playing the target video by running the relevant application program, freezing the live view and masking the sound play, see view (b) of fig. 5, the live view being frozen to a frame of image at the pause node, while the play button 51 is switched to state 1 (pause state).

Step S62, recording the target video from the pause node.

In some embodiments, the controller may convert the RF signal of the target video into the IF signal through Tuner, convert the IF signal into the TS stream through Demod, and transmit the video stream, the audio stream, and the subtitle data separated from the TS stream through Demux to a Recorder (recording application) which records the TS file according to the video stream, the audio stream, and the subtitle data, and store the TS file.

In some embodiments, the controller may record and save the target video in a preset storage location by running a Recorder. The preset storage location is not limited, for example, the preset storage location is a local disk, and is a storage device (for example, a USB disk, a mobile hard disk, etc.) externally connected through a device interface (for example, a USB).

In some embodiments, when the live view is frozen, demux does not transmit the separated video stream to VDEC for decoding, does not transmit the separated subtitle data to Graphic layer, and transmits the video stream and subtitle data to Recorder. When masking sound playback, demux does not deliver the separated audio stream to ADEC for decoding, but instead delivers the audio stream to Recorder.

Step S63, responding to a playing instruction input by a user, and controlling the display to display a first prompt popup.

In some embodiments, referring to view (b) of fig. 5, when the play button 51 is in state 1 (pause state), the user may trigger the play button 51 again through a control device (e.g., a remote controller) to input a play instruction. The controller may control the display to display the first prompt pop-up window by running the associated application in response to the play instruction to enable the user to select a target play mode, the target play mode being one of a resume play mode from a pause and a real-time play mode.

Fig. 7 is a schematic diagram of a display device displaying a first prompt pop-up window according to some embodiments of the present application.

In some embodiments, referring to fig. 7, the first prompt pop-up 70 is configured to prompt the user to select a play mode, and the first prompt pop-up 70 further includes a first mode option button 71 and a second mode option button 72, where the first mode option button 71 corresponds to a play mode being continued from a pause, and the second mode option button 72 corresponds to a real-time play mode.

In some embodiments, if the user wants to continue playing the target video from the pause, ensuring continuity of the target video playback to avoid missing video content that has been played during the pause period, the first mode option button 71 may be triggered by the control device to select the continue play mode from the pause.

In some embodiments, if the user wants to skip video content that has been played during the pause period and watch the latest live content of the target video, the second mode option button 71 may be triggered by the control device to select the real-time play mode.

Step S64, judging whether the target playing mode is a continuous playing mode from the pause.

If the target play mode is a follow-up play mode from pause, then in step S65, a playback function is initiated to play back the recorded target video from the pause node.

In some embodiments, the controller may read the TS file from a preset storage location of the Recorder by running a playback application, and inject data of the TS file into the Demux, the Demux separates video stream, audio stream and subtitle data from the TS stream, decodes the video stream through the VDEC and then transmits the decoded video stream to a display (Panel), outputs the subtitle data through the Graphic layer to the display (Panel), and transmits the audio stream through the ADEC decoding process to an audio output device (e.g., speaker), thereby playing back the recorded file.

Fig. 8 is a schematic diagram of a video playback interface provided in some embodiments of the application.

In some embodiments, referring to fig. 8, the video playback interface 80 is configured to play the recorded video file after the playback function is started, and since the target video is recorded from the pause point, the playback start point is the pause node of the target video, so that the target video can be played from the pause node successively.

In some embodiments, referring to fig. 8, video playback interface 80 further includes play control 81, speed-doubling control 82, fast forward control 83, fast reverse control 84, and progress bar 85.

In some embodiments, play control 81 is used to play or pause playing/playback of recorded video files. For example, the user may have something halfway but not continuously watching, the play control 81 may be triggered to pause the playback progress, after which the user may trigger the play control 81 again. The controller continues playback of the target video from the pause position in response to an operation instruction by the user to trigger the play control 81.

In some embodiments, the speed doubling control 81 is used to enable the user to set the playback speed. The multiple speed options include, but are not limited to, 0.5 multiple speed (0.5X), 1 multiple speed (1.0X), 1.5 multiple speed (1.5X), 2 multiple speed (2.0X), 3 multiple speed (3.0X), and the like. The larger the double rate value is, the faster the playing speed is, which indicates that the playback progress can track down the real-time live progress faster, so that the user can set a relatively larger double rate if the playback time is to be reduced.

In some embodiments, the fast forward control 82 is used to speed up the playback progress for the user and the fast reverse control 83 is used to reverse the playback progress for the user.

In some embodiments, the display device is in a recording-while-playback operating state when the playback progress lags the real-time live progress. The progress bar 85 comprises a progress positioning mark 85a, the relative length of the progress positioning mark 85a is used for representing the relation between the playback progress and the video recording duration, the video recording duration T ₁＝t-T₀, wherein T is the current recording time before the playback progress is smoothed by the real-time playing progress, and T ₀ is the live broadcast pause time of the target video. Before the playback progress levels up with the real-time playback progress, T ₁ and T are both dynamic variables, and T ₀ is a constant.

In some embodiments, the user may adjust the playback progress by advancing or backing the progress-positioning tab 85a. For example, if the user wants to speed up the playback progress so that the playback progress will track down the live progress as soon as possible, the progress locator 85a may be moved forward.

In some embodiments, the playback progress tracks the real-time live progress, i.e., when the playback progress coincides with the real-time live progress, the progress locator 85a lines to the end/point of the progress bar 85.

Step S66, judging whether the playback progress is to track down the real-time live broadcast progress.

If the playback progress has been smoothed on the live progress, step S67 is performed. If the playback progress is not to be smoothed/delayed with respect to the live progress, the recorded file of the target video is continued to be played back, and step S66 is performed.

Step S67, stopping recording the target video, closing the playback function, and switching to the real-time playing mode.

In some embodiments, since the playback progress has smoothed the live progress in real time, the display device may exit the recording-while-playback operating state and resume to real-time play mode. The controller may switch to live in real time by running the associated application, stopping recording the target video (i.e., closing the recording function), and closing the playback function, by releasing the freezing of the live view and the masking of the sound play.

In some embodiments, when the live frame is unfrozen, demux may stop transmitting the separated video stream and subtitle data to the Recorder, and instead transmit the video stream to the VDEC for decoding, and output the subtitle data to the Panel through the Graphic layer. When the sound playing is unmasked, the Demux may stop transmitting the separated audio stream to the Recorder, but transmit the audio stream to the ADEC for decoding, so that the real-time video stream, the audio stream and the subtitle data may be synchronously played, thereby returning to the real-time playing mode.

If the target play mode is the real-time play mode, in step S68, the playback function is not started, the recording of the target video is stopped, and the target video is continued to be played at the real-time live progress.

In some embodiments, if the user selects the real-time play mode, indicating that the user skips video content that has been played during the pause period, the controller does not activate the playback function, causing Demux to decode the video stream to the VDEC by unfreezing the live view and masking the sound play, outputting the subtitle data to the Panel through the Graphic layer, and decoding the audio stream to the ADEC, thereby reverting to the real-time play mode.

Fig. 9 is a schematic diagram of a display device displaying a second prompt pop-up window according to some embodiments of the present application.

In some embodiments, before stopping recording the target video in step S67 and step S68, referring to fig. 9, the controller may control the display to display a second prompt pop 90 by running the related application, where the second prompt pop 90 is used to prompt that the real-time live progress has been smoothed, and ask the user whether to stop recording the target video. The second reminder pop-up 90 includes a stop recording button 91 and a continue recording button 92.

In some embodiments, if the user does not want to continue recording the target video, a stop recording button 91 may be triggered by a control device (e.g., remote control) to input a stop recording instruction. The controller may stop recording the target video by running the relevant application in response to an operation instruction by which the user triggers the stop recording button 91. Assuming that T ₀ is the live pause time of the target video and T ₁ is the time of stopping recording the target video, the Recorder records the live video content in the [ T ₀,T₁ ] period.

Fig. 10 is a schematic diagram of a display device according to some embodiments of the present application displaying a third prompt pop-up window.

In some embodiments, the controller may stop recording the target video by running the related application in response to an operation instruction of the user triggering the stop recording button 91, see fig. 10, and control the display to display a third prompt pop 100, where the third prompt pop 100 is used to inquire whether to delete the video file recorded in the live pause period, and the third prompt pop 100 includes a delete button 101 and a save button 102.

In some embodiments, if the display device previously played back video files recorded during a live pause period, the delete button 101 may be triggered by a control device (e.g., remote control) to enter a delete instruction if the user subsequently does not want to review/review. The controller deletes the TS file of the target video recorded by the Recorder by running the related application in response to the user's operation instruction to trigger the delete button 101.

In some embodiments, if the user selects the real-time play mode through the first prompt pop 70, the display device does not activate the playback function, so that the user does not watch video content that has been played during the pause period during the video live broadcast, the user may review the previously recorded video file during the pause period after the video live broadcast is completed, or the user may want to review the recorded video file repeatedly, and the reservation button 102 may be triggered by the control device (e.g., remote control) to input a reservation instruction. The controller does not delete/save the TS file of the target video recorded by the Recorder in response to an operation instruction of the user triggering the save button 102.

In some embodiments, when the display displays the second prompt pop-up window 90, if the user wants to continue recording the target video, the continue recording button 92 may be triggered by a control device (e.g., remote control). The controller may continue recording the target video by running the associated application in response to the user triggering an operation instruction to continue recording button 92. Assuming that T ₀ is the live pause time of the target video and T ₁ is the time of stopping recording the target video, the Recorder records live video content in the [ T ₀,T₁ ] period, and the difference between the user triggering the stop recording button 91 and the continue recording button 92 is that the time of T ₁ is different.

In some embodiments, the controller may continue recording the target video by running the associated application in response to a user triggering an operation instruction to continue recording button 92.

In some embodiments, if the controller detects that the target video is live ended, or in response to receiving a recording stopping instruction input by the user before the end of live, the recording of the target video may be stopped by running the relevant application program, and the recording function/application may be closed. The manner of inputting the recording stopping instruction by the user includes, but is not limited to: the user issues a voice command/gesture command for indicating "stop recording", the user triggers a preset key on the control device (e.g., remote control), etc.

In some embodiments, since the user selects to continue recording the target video based on the second prompt pop-up window 90, and the user may need to play back/review the target video later, the controller saves/does not delete the TS file of the target video recorded by the Recorder after stopping recording the target video.

In some embodiments, referring to fig. 9, when the display displays the second prompt pop-up window 90, if the user wants to continue recording the target video, a continue recording button 92 may be triggered by a control device (e.g., a remote controller) to input a continue recording instruction. The controller responds to the operation instruction of the user triggering the continue recording button 92, referring to fig. 10, and can also control the display to display the third prompt pop-up window 100 by running the related application program.

In some embodiments, the controller may delete the video file of the target video recorded during the pause period (abbreviated as a first recorded file) and restart recording the video file of the target video from the real-time playing progress (abbreviated as a second recorded file) by running the recording application in response to a deletion instruction input by the user based on the third prompt pop-up window 100. In this way, the method is equivalent to adopting a discontinuous recording mode/a segmented recording mode, and if the user pauses to play the target video at the time T ₀ and triggers the play button again at the time T _S, the first recording file in the pause period corresponding to the time T ₀ to the time T _S is deleted by taking the time T _S as the boundary point, the second recording file is continuously recorded from the time T _S, and the second recording file is stored in the preset storage position.

In some embodiments, the controller may continue to record the target video by running the recording application in response to the deletion instruction input by the user based on the third prompt pop-up window 100, until the recording end condition is met, obtain a recording file, divide/split the recording file according to the playing progress node corresponding to the time T _S, obtain a first sub-file and a second sub-file, where the first sub-file is a video file recorded in a pause period corresponding to the time T ₀ to the time T _S, and the second sub-file is a video file recorded in a live broadcast period corresponding to the time T _S to the time T _j, where the time T _j is the recording end time. In this way, a continuous recording mode is adopted first, the recording process is not interrupted until the recording is finished, the recording file is split into two sections of subfiles by taking the moment T _S as a partition point, and the controller can delete the first subfile by running the recording application program and store the second subfile to a preset storage position because the user has selected to delete the recording content in the live broadcast pause period, and the user can play back the second subfile by accessing the preset storage position.

In some embodiments, the controller may continue to record the target video by running the recording application in response to the reservation instruction input by the user based on the third prompt pop-up window 100, until the recording end condition is met, obtain a recording file, and save the recording file to the preset storage location. Because the user has selected to keep the recorded content in the live pause period, the segmented recording is not required, and the recorded file is not required to be segmented/split.

In some embodiments, for example, the user pauses playing the target video at time T ₀, the controller may start the recording function by running the associated application to record the target video during the pause period. Assuming that the user triggers the play button again at time T _S to resume playing of the target video, if the user selects to continue the play mode from the pause, the controller may start the play mode by running the related application program, play the video content of the target video recorded at time T ₀, and at this time, the display device is in the recording-while-playback state until the playback progress is smoothed with the real-time live progress. If the user selects the real-time play mode, the controller may decode and play the live stream received from time T _S by running the related application.

Fig. 11 is a flowchart of a second video playing method according to some embodiments of the present application.

In some embodiments, the controller may execute a second video playing method by running an associated application, see fig. 11, the method comprising:

In step S111, when the target video is live-broadcast on the display device, the target video is paused in response to a pause instruction input by the user.

Step S112, starting the recording function.

In some embodiments, the starting the recording function may include starting the recording application, initializing the recording application, and so on, so that the recording application is ready for recording in advance.

Step S113, the display is controlled to display a first prompt page.

Step S114, determining whether an operation instruction for saving the live video content in the pause period is received.

In some embodiments, referring to fig. 12, the first hint page 120 is used to query whether to save live video content during a pause period, the first hint page 120 includes a save control 121 and a skip control 122.

In some embodiments, if the user wants to review the live video content during the pause time to ensure the continuity of the video playing, the save control 121 may be triggered by the control device (e.g., remote control) to input an operation instruction to save the live video content during the pause time.

In some embodiments, if the user does not want to review live video content during the pause period, but instead desires to view the latest live video content, the skip control 122 may be triggered by a control device (e.g., remote control) to input an operation instruction that does not save live video content during the pause period.

In the embodiment of the present application, before the first prompt page is displayed, the recording function is started in advance, so that the recording application program completes the recording preparation work in advance, and if the user triggers the storage control 121 in the first prompt page 120, the controller can immediately record the target video by running the recording application program, without starting the recording application program at present, waiting for the initialization of the recording application program, etc., thereby improving the recording start speed, reducing the recording delay, and ensuring the integrity of the video content recording in the pause period.

And if an operation instruction for saving the live video content in the pause period is received, executing branch logic one. And otherwise, if the operation instruction of saving the live video content in the pause period is not received, or the operation instruction of not saving the live video content in the pause period is received, executing the branch logic II.

In some embodiments, referring to fig. 11, the spur logic one includes steps S115-S1110:

step S115, receiving the live broadcast data of the target video, suspending playing the target video, and starting recording the target video according to the live broadcast data.

In step S116, in response to a play instruction input by the user, a playback function is started.

In some embodiments, the starting the playback function may include starting a playback application, initializing the playback application, and the like, so that the playback application is ready for playback/play in advance.

Step S117, controlling the display to display a second prompt page.

In some embodiments, the second prompting page may refer to the first prompting pop 70 illustrated in fig. 7, i.e., the second prompting page is used to prompt the user to select a play mode, which includes continuing the play mode from a pause and a real-time play mode.

In some embodiments, since the user has previously input the operation instruction for saving the live video content in the pause period through the first prompt page 120, which indicates that the user desires to review the live video content in the pause period, so as to ensure continuity and integrity of the target video viewing and avoid missing the highlight in the pause period, the controller may start the playback function in advance before controlling the display to display the second prompt page in response to the user triggering the operation of the play button again based on the live video interface, so that the playback application program completes the preparation for playback/play in advance.

In this way, if the user selects to continue the play mode from the pause position based on the second prompt page, the controller can immediately play back the target video recorded from the pause position by running the playback application program without starting the playback application program at present and waiting for the initialization and other works of the playback application program, so that the play starting speed of playback is improved, the play starting delay of playback is reduced, the response speed of the target video from pause to resume play is improved, and the playback performance is optimized.

Step S118, it is determined whether the target play mode is a continuous play mode from the pause.

If the target playing mode is the continuing playing mode from the pause position, in step S119, playing back the recorded target video from the pause node until the playing back progress is smoothed by the real-time live progress, closing the recording function and the playing back function, and continuing playing back the target video from the real-time live progress.

If the target play mode is the real-time play mode, in step S1110, the playback function is turned off and the target video is continuously played from the real-time live progress.

Thus, if the live content of the target video in the previously recorded pause period, when the user resumes the playing of the target video, the controller can control the display to display a second prompt page by running the related application program, so that the user can select to continue the playing mode or the real-time playing mode from the pause. Even if the user selects the real-time playing mode based on the second prompt page, after the target video live broadcast is finished, the user can access a preset storage position (such as a USB flash disk) and play back the video live broadcast content recorded in the pause period.

In some embodiments, referring to fig. 11, the spur logic two includes steps S1111-S1112:

step S1111, pause playing the target video, and close the recording function.

In step S1112, in response to the play instruction input by the user, the target video is continuously played from the live broadcast schedule.

Thus, if the live content of the target video is not recorded in the pause period, when the user resumes the target video playing, the controller can release the freezing of the live image and the shielding of the sound playing by running the related application program, thereby returning to the real-time playing mode.

When the live broadcast is paused, the user can review the live video content in the pause period through the recording function and the playback function, the continuity and the integrity of the live video content are ensured, the user is prevented from missing the highlight, the scheme does not depend on time shifting capability, and the display equipment is not required to be configured with specific time shifting equipment or time shifting service. When resuming live broadcast, the user is provided with selectivity, so that the user can select to continue the playing mode from the pause or the real-time playing mode according to the requirement, rather than forcing the user to watch according to a certain default playing mode. When the video live broadcast content in the pause period is recorded, the recording time length depends on the time interval of triggering a play button (from play to pause and from pause to replay) twice by a user, the recording time length is not fixed, and the time shifting technology generally continuously records the video live broadcast content and the recording time length is fixed. In addition, by starting the recording function and the playback function in advance at the specially arranged nodes, the recording delay and the playing delay of playback can be reduced, on one hand, the integrity and the continuity of video recording in a pause period are ensured, the recording performance is optimized, on the other hand, the playing speed of playback can be improved, the response speed of a target video from pause to resume play is improved, and the playback performance is optimized.

The UI drawings and descriptions thereof provided by the embodiments of the present application are merely exemplary, and do not limit the actual interface presentation and design of the display device.

Some embodiments of the present application also provide a computer storage medium, which may store a program. When the computer storage medium is configured in the display device 200, the program may include program steps involved in the video playing method in at least one of the above embodiments when the program is executed. The computer storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), or the like.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. The illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the disclosure and to enable others skilled in the art to best utilize the embodiments.

Claims

1. A display device, characterized by comprising:

A display for displaying a user interface;

A controller for performing:

2. The display device of claim 1, wherein the controller is further configured to perform:

If the target playing mode is the real-time playing mode, the playback function is not started, and the recording of the target video is stopped;

and continuing to play the target video at the real-time live broadcast progress.

3. The display device of claim 1, wherein after playback of the recorded file of the target video, the controller is further configured to perform:

detecting the playback progress and the real-time live broadcast progress of the target video;

stopping recording and playing back the target video if the playback progress levels up the real-time live broadcast progress;

4. The display device of claim 1, wherein the controller is further configured to, prior to recording the target video from the pause node corresponding to the first time, perform:

responding to a pause instruction input by a user at a first moment, and starting a recording function in advance so as to reduce recording delay;

The display is controlled to display a second prompt page, and the second prompt page is used for inquiring whether a user stores the live video content of the target video in the pause period or not;

And if an operation instruction for storing the live video content of the target video in the pause period is received, recording the target video according to the live video data of the target video.

5. The display device of claim 4, wherein prior to controlling the display to display the first alert page, the controller is further to perform:

The playback function is started in advance to reduce the play-out delay of playback.

6. The display device of claim 4, wherein the controller is further configured to perform:

if an operation instruction for storing the video live broadcast content of the target video in the pause period is not received, pausing playing the target video, and closing the recording function;

And responding to a playing instruction input by the user at the second moment, and continuing to play the target video from the real-time playing progress.

7. The display device of claim 4, wherein after playback of the recorded file of the target video, the controller is further configured to perform:

if the playback progress is in the level of the real-time live broadcast progress, controlling a display to display a third prompt page, wherein the third prompt page is used for inquiring whether to stop recording the target video;

responding to a recording stopping instruction input by a user, and closing the recording function to stop recording the target video;

And responding to a recording continuing instruction input by a user, continuing recording the target video, and closing the recording function when the condition that the recording ending condition is met is detected.

8. The display device of claim 7, wherein the controller is further configured to perform:

responding to a recording stopping instruction input by a user based on the third prompting page, and controlling a display to display a fourth prompting page, wherein the fourth prompting page is used for inquiring whether the user deletes the first recorded file of the target video in the pause period;

Deleting the first recorded file in response to a deleting instruction input by a user;

and responding to a reservation instruction input by a user, and not deleting the first recorded file stored in the preset storage position.

9. The display device of claim 7, wherein the controller is further configured to perform:

Responding to a continuous recording instruction input by a user based on the third prompting page, and controlling a display to display a fourth prompting page, wherein the fourth prompting page is used for inquiring whether the user deletes the first recorded file of the target video in the pause period;

deleting the first recorded file in response to a deleting instruction input by a user, and recording a second recorded file of the target video from a real-time playing progress;

Or alternatively

Recording the recorded file of the target video continuously in response to a deleting instruction input by a user, splitting the recorded file into a first sub-file and a second sub-file according to a playing progress node corresponding to the second moment when the recording is finished, deleting the first sub-file, and storing the second sub-file in the preset storage position; the first subfile is a video file recorded in a pause period corresponding to the first time and the second time, and the second subfile is a video file recorded after the second time;

10. A video playing method, comprising: