WO2023130965A1

WO2023130965A1 - Display device, and audio and video data playing method

Info

Publication number: WO2023130965A1
Application number: PCT/CN2022/140803
Authority: WO
Inventors: 高雯雯; 陆世明
Original assignee: 海信视像科技股份有限公司
Priority date: 2022-01-06
Filing date: 2022-12-21
Publication date: 2023-07-13

Abstract

Provided in the embodiments of the present application are a display device, and an audio and video data playing method. The display device comprises a controller and a display, wherein the controller reads, in response to an operation of a user playing audio and video data, the type of the audio and video data; if the type is PVR, the controller calls a TV source interface to encapsulate the audio and video data, so as to obtain a video frame, wherein an underlying resource corresponding to the TV source interface is used for encapsulating the PVR-type audio and video data; if the type is not PVR, the controller calls a media center interface to encapsulate the audio and video data, so as to obtain a video frame; and the controller controls the display to present the video frame. The display device provided in the present embodiment is configured with different underlying resources, such that the display device can present and play PVR-type audio and video data and non-PVR-type audio and video data, and the user experience is thus better.

Description

A display device and method for playing audio and video data

Cross References to Related Applications

This application claims the priority of the Chinese patent application filed on January 06, 2022, with application number 202210010105.X; and filed on February 22, 2022, with application number 202210162881.1, the entire contents of which are incorporated in this application by reference .

technical field

The present application relates to the field of file audio and video data processing, in particular to a display device and a method for playing audio and video data.

Background technique

Since the display device can provide users with functions such as playing audio and video data, it has attracted widespread attention from users, wherein the audio and video data can include live broadcast data and network audio and video data. The existing display device can only play live data at a fixed time, and cannot play back the live data. In order to meet the needs of different users, some display devices are equipped with a recording module, and users can use the recording module to record and broadcast live data to obtain PVR files (Personal video recorder, personal video recording).

The display device is provided with a media center, and the media center can be used to play the locally stored network audio and video data. Because there are many differences between PVR files and traditional network audio and video data, for example, there are differences in encoding methods adopted by PVR files and network audio and video data. Therefore, the media center cannot play PVR files.

Contents of the invention

The embodiment of the present application shows a display device and a method for playing audio and video data.

The present application provides a display device, including: a display; a controller configured to: read the type of the audio and video data in response to the user's operation of playing the audio and video data; if the type is PVR, call the TVsource interface Encapsulate the audio and video data to obtain a video frame, and the underlying resource corresponding to the TVsource interface is used to encapsulate the audio and video data of the PVR type; if the type is not PVR, then call the media center interface to encapsulate the audio and video data to obtain a video frame; controls the display to display the video frame.

An embodiment of the present application provides a method for playing audio and video data, including: reading the type of the audio and video data in response to the user's operation of playing audio and video data; if the type is PVR, calling the TVsource interface to encapsulate the audio and video data Video data, obtain video frame, the underlying resources corresponding to the TVsource interface are used to encapsulate audio and video data of the PVR type; if the type is not PVR, then call the media center interface to encapsulate the audio and video data to obtain video frames; display the the video frame.

Description of drawings

FIG. 1 is a usage scenario of a display device according to some embodiments;

FIG. 2 is a block diagram of a hardware configuration of a control device 100 according to some embodiments;

FIG. 3 is a block diagram of a hardware configuration of a display device 200 according to some embodiments;

FIG. 4 is a software configuration diagram in a display device 200 according to some embodiments;

Fig. 5 is a flowchart of interaction between a display device and a user according to some embodiments;

Figure 6 is a schematic diagram of an initial interface according to some embodiments;

Figure 7 is a schematic diagram of a TAB according to some embodiments;

8 is a flow chart of the recording process of PVR-type audio and video data according to some embodiments;

9 is a flow chart of the recording process of PVR-type audio and video data according to some embodiments;

Fig. 10 is a flow chart of the playback process of audio and video data of the PVR type according to some embodiments;

Figure 11 is a schematic diagram of a display according to some embodiments;

Figure 12 is a schematic diagram of a display according to some embodiments;

Figure 13 is a schematic diagram of a display according to some embodiments;

Fig. 14 is a schematic diagram of changes in the display interface of the display during audio and video data playback according to some embodiments;

Fig. 15 is a schematic diagram of changes in the display interface of the display during audio and video data playback according to some embodiments;

Fig. 16 is a schematic diagram of changes in the display interface of the display during the playback of audio and video data according to some embodiments;

Fig. 17 is a schematic diagram of changes in the display interface of the display during the playback of audio and video data according to some embodiments;

Fig. 18 is a schematic diagram of changes in the display interface of the display during the playback of audio and video data according to some embodiments;

Fig. 19 is a schematic diagram of changes in the display interface of the display during the playback of audio and video data according to some embodiments;

Figure 20 is a flowchart of a method for playing audio and video data according to some embodiments;

Fig. 21 is a schematic diagram of changes in the display interface of the display during audio and video data playback according to some embodiments;

Fig. 22 is a schematic diagram of a corresponding user interface when a display plays video 1 according to some embodiments;

Figure 23 is a schematic flow diagram of creating a marker point according to some embodiments;

Figure 24 is a schematic diagram of a user interface for creating markers, according to some embodiments;

Fig. 25 is a schematic flowchart of modifying the name of a marker during the process of creating a marker according to some embodiments;

Fig. 26 is a schematic diagram of a display mode of marker points when the focus is not on the progress bar according to some embodiments;

Fig. 27 is a schematic diagram of a display mode of marker points when the focus is on the progress bar according to some embodiments;

Fig. 28 is a schematic diagram of previewing video screenshots of each marker point according to some embodiments;

Fig. 29 is a schematic diagram of the display mode of the mark point when the playback progress of the audio and video data reaches the mark point according to some embodiments;

Fig. 30 is a schematic diagram showing the corresponding relationship between markers and marker names according to some embodiments;

Fig. 31 is a schematic diagram showing the correspondence between markers and marker names according to some embodiments;

Fig. 32 is a schematic diagram of the data format of creation information of marker points according to some embodiments;

Fig. 33 is a schematic flow diagram of modifying creation information of marker points according to some embodiments;

Figure 34 is a schematic diagram of a user interface for modifying the name of a marker according to some embodiments;

Figure 35 is a schematic diagram of a user interface for deleting markers according to some embodiments;

36 is a schematic flow diagram of locating audio and video data content based on video screenshots of marker points according to some embodiments;

37 is a schematic diagram of a user interface for locating audio and video data content based on video screenshots of marker points according to some embodiments;

38 is a schematic flow diagram of locating audio and video data content based on creation information of marker points according to some embodiments;

Fig. 39 is a schematic diagram of a user interface for locating audio and video data content based on creation information of marker points according to some embodiments.

Detailed ways

In order to make the purpose and implementation of the application clearer, the exemplary implementation of the application will be clearly and completely described below in conjunction with the accompanying drawings in the exemplary embodiment of the application. Obviously, the described exemplary embodiment is only the present application. Claim some of the examples, not all of them.

It should be noted that the brief description of the terms in this application is only for the convenience of understanding the implementations described below, and is not intended to limit the implementations of this application. These terms are to be understood according to their ordinary and usual meaning unless otherwise stated.

Fig. 1 is a schematic diagram of a usage scenario of a display device according to some embodiments. As shown in FIG. 1 , the display device 200 also performs data communication with the server 400 , and the user can operate the display device 200 through the smart device 300 or the control device 100 .

In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of infrared protocol communication, Bluetooth protocol communication, and other short-distance communication methods, and the display device is controlled wirelessly or wiredly. Device 200. The user can control the display device 200 by inputting user instructions through at least one of buttons on the remote control, voice input, and control panel input.

In some embodiments, the smart device 300 may include any one of a mobile terminal, a tablet computer, a computer, a notebook computer, an AR/VR device, and the like.

In some embodiments, the smart device 300 can also be used to control the display device 200 . For example, the display device 200 is controlled using an application running on the smart device.

In some embodiments, the smart device 300 and the display device may also be used for data communication.

In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100 and the smart device 300. For example, the module for obtaining voice commands configured inside the display device 200 can directly receive the user's voice command control , the user's voice command control can also be received through the voice control device provided outside the display device 200 .

In some embodiments, the display device 200 also performs data communication with the server 400 . The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200 . The server 400 may be one cluster, or multiple clusters, and may include one or more types of servers.

FIG. 2 is a configuration block diagram of the control device 100 according to the exemplary embodiment. As shown in FIG. 2 , the control device 100 includes a controller 110 , a communication interface 130 , a user input/output interface 140 , a memory, and a power supply. The control device 100 can receive the user's input operation instruction, and convert the operation instruction into an instruction that the display device 200 can recognize and respond to, and play an intermediary role between the user and the display device 200 .

In some embodiments, the communication interface 130 is used for communicating with the outside, and includes at least one of a WIFI chip, a Bluetooth module, NFC or an alternative module.

In some embodiments, the user input/output interface 140 includes at least one of a microphone, a touch pad, a sensor, a button or an alternative module.

FIG. 3 is a block diagram showing a hardware configuration of a display device 200 according to an exemplary embodiment.

In some embodiments, the display device 200 includes a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface. at least one.

In some embodiments the controller includes a CPU, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an nth interface for input/output.

In some embodiments, the display 260 includes a display screen component for presenting images, and a drive component for driving image display, for receiving image signals output from the controller, and displaying video content, image content, and menu manipulation interface. Components and user manipulation of the UI interface, etc.

In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

In some embodiments, the tuner-demodulator 210 receives broadcast display device signals through wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast display device signals.

In some embodiments, the communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 can establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220 .

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, the detector 230 includes a light receiver, which is a sensor for collecting ambient light intensity; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environmental scenes, user attributes or user interaction gestures, or , the detector 230 includes a sound collector, such as a microphone, for receiving external sound.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: high-definition multimedia interface (HDMI), analog or data high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), Any one or more interfaces such as RGB ports. It may also be a composite input/output interface formed by the above-mentioned multiple interfaces.

In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different split devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box wait.

In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operations of the display device 200 . For example, in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any of selectable objects, such as hyperlinks, icons, or other operable operating areas. The operations related to the selected object include: displaying operations connected to hyperlink pages, documents, images, etc., or executing operations corresponding to the icon.

In some embodiments, the controller includes a central processing unit (Central Processing Unit, CPU), a video processor, an audio processor, a graphics processing unit (Graphics Processing Unit, GPU), RAM Random Access Memory, RAM), ROM (Read- Only Memory, ROM), at least one of the first interface to the nth interface for input/output, a communication bus (Bus), and the like.

CPU processor. It is used to execute the operating system and application instructions stored in the memory, and to execute various applications, data and content according to various interactive instructions received from the outside, so as to finally display and play various audio and video contents. A CPU processor may include multiple processors. For example, including a main processor and one or more sub-processors.

In some embodiments, the graphics processor is configured to generate various graphic objects, such as at least one of icons, operation menus, and user input instruction display graphics. The graphics processor includes an arithmetic unit, which performs calculations by receiving various interactive instructions input by users, and displays various objects according to display attributes; it also includes a renderer, which renders various objects obtained based on the arithmetic unit, and the above-mentioned rendered objects are used to be displayed on the display.

In some embodiments, the video processor is used to receive an external video signal and perform video decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, etc. according to the standard codec protocol of the input signal. At least one of the processing can obtain a signal that can be directly displayed or played on the display device 200 .

In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like. Wherein, the demultiplexing module is used for demultiplexing the input audio and video data streams. The video decoding module is used to process the demultiplexed video signal, including decoding and scaling. An image synthesis module, such as an image synthesizer, is used to superimpose and mix the graphic generator with the zoomed video image according to the GUI signal input by the user or generated by itself, so as to generate an image signal available for display. The frame rate conversion module is used for converting the input video frame rate. The display formatting module is used to convert the received frame rate to the video output signal, and change the signal to conform to the display format signal, such as outputting RGB data signal.

In some embodiments, the audio processor is used to receive an external audio signal, perform decompression and decoding according to the standard codec protocol of the input signal, and perform at least one of processing such as noise reduction, digital-to-analog conversion, and amplification processing , to obtain a sound signal that can be played on a loudspeaker.

In some embodiments, the user can input user commands through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives user input commands through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.

In some embodiments, the user input interface 280 is an interface that can be used to receive control input (such as: physical buttons on the display device body, or others).

As shown in FIG. 4 , the system of the display device may include a kernel (Kernel), a command parser (shell), a content system, and an application program. Together, the kernel, shell, and content system make up the basic operating system structure that allows users to manage content, run programs, and use the system. After power-on, the kernel starts, activates the kernel space, abstracts hardware, initializes hardware parameters, etc., runs and maintains virtual memory, scheduler, signal and inter-process communication (IPC). After the kernel starts, the Shell and user applications are loaded. After the application is started, it is compiled into machine code to form a process.

As shown in FIG. 4 , the system of the display device is divided into three layers, which are application layer, middleware layer and hardware layer (which may also be referred to as the system operation layer in this embodiment) from top to bottom.

The application layer mainly includes commonly used applications on the display device, as well as the application framework (Application Framework), among which, commonly used applications are mainly applications developed based on the browser Browser, such as: HTML5 APPs; and native applications (Native APPs);

Application Framework (Application Framework) is a complete program model that has all the basic functions required by standard application software, such as: content access, data exchange..., and the user interfaces of these functions (toolbar, status bar, menu, etc.) , dialog).

Native APPs can support online or offline, message push or local resource access.

The middleware layer includes middleware such as various display device protocols, multimedia protocols, and system components. Middleware can use the basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, so as to achieve the purpose of resource sharing and function sharing.

The hardware layer mainly includes the HAL interface, hardware and drivers. Among them, the HAL interface is a unified interface for all display device chips to be connected, and the specific logic is implemented by each chip. Drivers mainly include: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

In some embodiments, after the display device is started, it can directly enter the display interface of the signal source selected last time, or the signal source selection interface, wherein the signal source can be a preset video-on-demand program, or an HDMI interface, and the live display device At least one of the interfaces, etc., after the user selects different signal sources, the display can display the content obtained from different signal sources.

In order to meet the needs of different users, some display devices are provided with a recording module, and the user can use the recording module to record and broadcast the live data to obtain a PVR file (also referred to as PVR type audio and video data in this embodiment). The existing display device is provided with a media center, and the media center can be used to play the locally stored network audio and video data. Because there are many differences between PVR files and traditional network audio and video data, for example, there are differences in encoding methods adopted by PVR files and network audio and video data. Therefore, the media center cannot play PVR files.

Considering the above technical problems, the embodiments of the present application provide a display device. For the structure of the display device and the functions of each part, reference may be made to the above embodiments. In addition, on the basis of the display device shown in the above embodiments, this embodiment further optimizes some functions of the display device. For details, please refer to FIG. 5 , which shows the interaction between the display device and the user according to some embodiments. flow chart;

S51: displaying an initial interface on the display;

In this embodiment, the initial interface is used to display all data under the storage path, and the data includes at least audio and video data. The data can be displayed in the form of icons or folders on the initial interface. For example, the storage path "storage/8E67-6E/first-level folder/second-level folder/" includes video 1, video 2, video 3, video 4 and video 5. Then, the initial interface displays an icon corresponding to video 1, an icon corresponding to video 2, an icon corresponding to video 3, an icon corresponding to video 4 and an icon corresponding to video 5. The initial interface will be described below in conjunction with specific drawings. Figure 6 is a schematic diagram of an initial interface, according to some embodiments. It can be seen from the figure that all data under the storage path is displayed on the initial interface, and the data is displayed in the form of icons in this embodiment. It should be noted that FIG. 6 is only an exemplary display of a style of the initial interface, and the above style of the initial interface does not constitute a limitation, and the style of the initial interface can be set according to requirements during the actual application process.

As an implementation manner, the initial interface may further include a search interface 61, and the search interface 61 is configured to receive information input by the user, where the information input by the user may be but not limited to a file name. In some feasible embodiments, when the name of the information input by the user is the same as that of the data displayed on the initial interface, the controller controls the focus to move to the data. In some feasible embodiments, when the name of the information input by the user is the same as that of the data displayed on the initial interface, the controller may switch the display from the initial interface to the display interface of the data.

As an implementation manner, the initial interface may further include a file type drop-down box 62 . In response to the user's selection of the file type drop-down box 62, the display will display the type control, and the user can control the display to display the TAB by selecting the type control (the type control selected by the user in this embodiment can also be called the target type control). interface. In this embodiment, the TAB interface is used to display audio and video data conforming to the target type. The initial interface will be described below in conjunction with specific drawings. Figure 7 is a schematic diagram of a TAB, according to some embodiments. In this embodiment, the target type is PVR, and the TAB is used to display all audio and video data of the TAB type.

The initial interface can also include a sequence drop-down box 63. In response to the user's selection of the sequence drop-down box 63, the display will display a sequence control, and the user can select the sequence control (the sequence control selected by the user in this embodiment can also be called is the target sequence control), the displayer displays data according to the sequence corresponding to the target sequence control, wherein the sequence can be but not limited to name sequence, modification date sequence, etc.

As an implementation manner, the initial interface may further include a style drop-down box 64, and in response to the user's selection of the style drop-down box 64, the display will display a style control. In response to the user's selection of a style control (the style control selected by the user in this embodiment may also be referred to as the target style control), the display displays data according to the style corresponding to the target style control, wherein the style may be but not limited to large Icons, small icons, list details, etc.

S52: play audio and video data;

There are many ways to implement playing audio and video data. For example, when the focus moves to the icon corresponding to the audio and video data that the user wants to play, the user can play the audio and video data by selecting the "OK" button; as a feasible implementation, the display device can be equipped with a voice assistant, and the user can Audio and video data can be played by voice.

S53: In response to the user's operation of playing audio and video data, read the type of the audio and video data;

There are many implementations for reading the type of the audio and video data, and the controller can identify the type of the audio and video file by reading the suffix of the audio and video file. The controller can also identify the type of the audio and video file by analyzing the header file of the audio and video file.

S54: If the type is not PVR, call the media center interface to encapsulate the audio and video data to obtain video frames;

In the actual application process, there is a situation that the underlying resource corresponding to the media center interface cannot encapsulate audio and video data. For example, the media center only supports formats such as MP4, mp3, and ts (Transport Stream, the encapsulation format captured by a high-definition camera), while the playback audio and video data is in the hevc (High Efficiency Video Coding, video compression standard) format, and the interface of the media center corresponds to The underlying resource of cannot encapsulate the audio and video data. In order to improve the user experience, this embodiment further optimizes the display device. On the basis of the display device shown in the above embodiment, the controller is further configured to: if the media center interface corresponds to If the underlying resource cannot encapsulate the audio and video data, the display is controlled to display first prompt information, and the first prompt information is used to remind the user that the audio and video data cannot be played.

This embodiment does not limit the display form of the first prompt information. For example, the first prompt information may be displayed in the form of a window; for example, the first prompt information may be displayed in the form of a layer.

In this embodiment, the content of the first prompt information is not specifically limited, and any information that can remind the user that the audio and video data cannot be played can be used as the first prompt information in this embodiment. The first prompt information will be described below in conjunction with specific drawings. Fig. 7 is a schematic diagram of a display according to some embodiments, the display shows a first prompt message 71 "the current program cannot be played".

S55: If the type is PVR, call the TVsource interface to encapsulate the audio and video data to obtain a video frame.

In this embodiment, the underlying resources corresponding to the TVsource interface are used to encapsulate PVR-type audio and video data. The audio and video data of the PVR type may be the audio and video data recorded by the recording module when the user watches live TV.

The following describes the recording process of PVR-type audio and video data in conjunction with specific drawings. FIG. 8 is a flow chart of the recording process of PVR-type audio and video data according to some embodiments. Including S81～S82;

S81: In response to the user's operation of starting the video recording function, record the content displayed on the display to obtain PVR-type audio and video data;

There are several ways to implement the start recording function. For example, when the focus moves to the start recording control, the user can start the recording function by selecting the "confirm" button; for example, the display device can be configured with a voice assistant, and the user can start the recording function by voice.

S82: Store the audio and video data of the PVR type.

In this embodiment, in the process of encapsulating PVR type audio and video data, the storage path of PVR type audio and video data needs to be sent to the TVsource interface, so that the underlying resources corresponding to the TVsource interface can call the PVR type according to the storage path audio and video data.

In the process of practical application, the audio and video data of PVR type can be stored in a fixed database, so that in the process of encapsulating the audio and video data of PVR type, the audio and video data of PVR type can be called directly in the fixed database .

In the process of practical application, users hope that some files recorded by PVR can only be played on the currently recorded TV to achieve the effect of preventing cross-broadcasting. For example, some live programs broadcast by users on TV are paid channels or recorded with special encryption cards , all of which you don’t want to be seen by others, that is, you can only watch them on your own TV.

In order to achieve the above effect, the present embodiment provides a method for recording PVR-type audio and video data. For details, refer to FIG. 9 . FIG. 9 is a flowchart of the recording process of PVR-type audio and video data according to some embodiments, wherein, Including steps S91-S92.

S91: In response to the user's operation of starting the video recording function, read the identification information of the display device, where the identification information is used to uniquely identify the display device;

For the implementation manner of starting the recording function, reference may be made to the foregoing embodiments.

In this embodiment, the identification information is used to uniquely identify the display device, and may be but not limited to a device ID of the display device.

S92: Add the identification information to the audio and video data of the PVR type.

Fig. 10 is a flowchart of a playback process of PVR-type audio and video data according to some embodiments, wherein the process includes S101-S103.

S101: If the type is PVR, read the identification information corresponding to the audio and video data;

S102: If the identification information corresponding to the audio and video data is the same as the identification information of the display device, call the TVsource interface to encapsulate the audio and video data to obtain a video frame.

If the identification information corresponding to the audio and video data is the same as the identification information of the display device, it proves that the currently playing PVR type audio and video data is audio and video data recorded on the current display device and can be played on the current display device.

S103: If the identification information corresponding to the audio and video data is different from the identification information of the display device, control the display to display second prompt information, the second prompt information is used to remind the user that the display device is not capable of playing the Permissions for audio and video data.

If the identification information corresponding to the audio and video data is different from the identification information of the display device, it proves that the currently playing PVR type audio and video data is not the audio and video data recorded on the current display device and cannot be played on the current display device. In this application scenario, the display will pop up a second prompt message to remind the user that the display device does not have the right to play the audio and video data.

This embodiment does not limit the display form of the second prompt information, for example, the second prompt information may be displayed in the form of a window, and the second prompt information may be displayed in the form of a layer.

This embodiment does not specifically limit the content of the second prompt information, and any information that can remind the user that the display device does not have the authority to play the audio and video data can be used as the second prompt information in this embodiment example. The second prompt information will be described below in conjunction with specific drawings. Fig. 11 is a schematic diagram of a display according to some embodiments, the display shows a second prompt message 111 "the current display device does not have the right to play this program".

In the technical solution provided by this embodiment, only when the identification information corresponding to the audio and video data is the same as the identification information of the display device, the TVsource interface will be called to encapsulate the audio and video data, so that the files recorded by the PVR are only recorded in the current recording. The TV can play the effect of preventing cross-broadcasting.

S56: Control the display to display a play window, where the play window is used to display the video frame.

There are many ways to control the display to display the play window, and the display form of the play window will be described below with reference to specific drawings.

The playback window can be displayed on the monitor in a full-screen form. Fig. 12 is a schematic diagram of a display according to some embodiments, the display shows a playback window 121, and the playback window 121 is displayed on the display in a full-screen form.

The playback window can be displayed on the display in a small form. Fig. 13 is a schematic diagram of a display according to some embodiments, the display shows a playback window 131, and the playback window 131 is displayed on the display in the form of a small window.

The play window can be displayed on the display simultaneously with the initial interface. Please continue to refer to FIG. 13 , the display shows a play window 131 and an initial interface 132 , wherein the display priority of the play window 131 is higher than that of the initial interface 132 . As an optional implementation, when the display displays the playback window, the content displayed on the initial interface can be arranged. The specific arrangement can be that the playback window 131 does not block the content displayed on the initial interface. For details, please refer to 13, the content shown on the initial interface in FIG. 13 is located on the left side of the initial interface, and the play window 131 is located on the right side of the initial interface, so that the play window 141 does not block the content displayed on the initial interface.

In some implementations, the play window and the initial interface can be displayed on the display simultaneously. Specifically, referring to FIG. 13, the display shows a play window 131 and an initial interface 132. In response to the user's confirmation operation on the play window 131, the controller controls the display to display the play window in a full-screen form. For details, refer to FIG. 12.

In the process of displaying the video frame, in response to the user's return operation, the display is controlled to display the initial interface (S57).

There are many ways to implement the return operation. For example, the return operation may be that the user selects a "return" button on the remote control. For example, the display device may be provided with a voice assistant, and the return operation may be the user's voice of 'return to the initial interface'.

The solution shown in this application will be further described below in conjunction with specific examples.

Fig. 14 is a schematic diagram of changes in the display interface of the display during the playback of audio and video data according to some embodiments. In this embodiment, the display displays an initial interface, for details, refer to Effect 141. By clicking on the audio and video data 14A, the user triggers the controller to read the type of the audio and video data 14A. In this embodiment, the type of audio and video data 14A is PVR, and the controller invokes the TVsource interface to encapsulate the audio and video data to obtain video frames. The display displays the video frame. In this embodiment, the video frame is displayed in a full-screen manner. For details, please refer to Effect 142.

FIG. 15 is a schematic diagram showing changes in the display interface during audio and video data playback according to some embodiments. In this embodiment, the display displays an initial interface. For details, please refer to Effect 151 . By clicking on the audio and video data 15A, the user triggers the controller to read the type of the audio and video data 16A. In this embodiment, the type of audio and video data 15A is PVR, and the controller invokes the TVsource interface to encapsulate the audio and video data to obtain audio and video data frames. The display displays the audio and video data frames. In this embodiment, the audio and video data frames are displayed in a small window. For details, please refer to Effect 152.

FIG. 16 is a schematic diagram showing changes in the display interface during audio and video data playback according to some embodiments. In this embodiment, the display displays an initial interface. For details, please refer to Effect 161. By clicking on the audio and video data 16A, the user triggers the controller to read the type of the audio and video data 16A. In this embodiment, the type of audio and video data 16A is PVR, and the controller reads the identification information corresponding to the audio and video data. In this embodiment, the identification information corresponding to the audio and video data is different from the identification information of the display device, and the second prompt information displayed on the display can refer to effect 162 for details.

FIG. 17 is a schematic diagram of changes in the display interface of the display during audio and video data playback according to some embodiments. In this embodiment, the display displays an initial interface. For details, please refer to Effect 171. By clicking on the audio and video data 17A, the user triggers the controller to read the type of the audio and video data 17A. In this embodiment, the type of audio and video data 17A is not PVR, and the controller invokes the media center interface to encapsulate the audio and video data to obtain video frames. The display displays the video frame. In this embodiment, the video frame is displayed in a small window. For details, please refer to Effect 172. Clicking on a video frame by the user can control the video frame to be displayed in a full-screen manner. For details, refer to Effect 173.

Fig. 18 is a schematic diagram of changes in the display interface of the display during the playback of audio and video data according to some embodiments. In this embodiment, the display displays an initial interface, for details, please refer to Effect 181. By clicking on the audio and video data 18A, the user triggers the controller to read the type of the audio and video data 18A. The type of audio and video data 18A in this embodiment is hevc, and the display device media center provided by this embodiment only supports MP4, mp3, ts formats, so the underlying resources corresponding to the media center interface cannot encapsulate the audio and video data. Refer to effect 182 for details of displaying the first prompt message (the current program cannot be played).

Fig. 19 is a schematic diagram of changes in the display interface of the display during the playback of audio and video data according to some embodiments. In this embodiment, the display displays an initial interface, for details, please refer to Effect 191. By clicking on the audio and video data 19A, the user triggers the controller to read the type of the audio and video data 19A. In this embodiment, the type of audio and video data 19A is PVR, and the controller invokes the TVsource interface to encapsulate the audio and video data to obtain video frames. The display displays the video frame. In this embodiment, the video frame is displayed in a full-screen manner. For details, please refer to Effect 192. In response to the user's return operation, the display shows the initial interface, for details, refer to effect 193 .

The display device provided by this embodiment includes a controller and a display, wherein the controller, in response to the user's operation of playing audio and video data, reads the type of the audio and video data; if the type is PVR, then calls the TVsource interface package The audio and video data obtains video frames, and the underlying resources corresponding to the TVsource interface are used to encapsulate audio and video data of the PVR type; if the type is not PVR, then call the media center interface to encapsulate the audio and video data to obtain video frames ; Control the display to display the video frame. The display device provided in this embodiment is configured with different underlying resources, and can display and play PVR-type audio and video data and non-PVR-type audio and video data, and the user experience is better.

In some application scenarios, users need to play audio and video files sequentially. In order to meet the needs of users, this embodiment further optimizes the above-mentioned display device. For details, please refer to Figure 1. A method for playing audio and video data. For details, please refer to Figure 20. FIG. 20 is a flow chart of a method for playing audio and video data according to some embodiments, the process may include S201-S202:

S201: In response to the user's operation of sequentially playing audio and video data, record the storage path of the audio and video data;

This embodiment does not specifically limit the operation of sequentially playing audio and video data. For example, the user may set the audio and video playback mode to sequential playback.

S202: When the audio and video data ends, according to the storage order of the audio and video data in the storage path, read the type of the next audio and video data.

The following will be described in conjunction with specific examples.

FIG. 21 is a schematic diagram of changes of the display interface during audio and video data playback according to some embodiments. In this embodiment, the display displays an initial interface. For details, please refer to Effect 211. The user clicks on the audio and video data 21A to trigger the controller to read the type of the audio and video data 21A and the storage path of the audio and video data (/data/data/com.test.disk.tv/databases/tv.db). In this embodiment, the type of audio and video data 21A is PVR, and the controller invokes the TVsource interface to encapsulate the audio and video data to obtain video frames. The display displays the video frame. In this embodiment, the video frame is displayed in a full-screen manner. For details, please refer to Effect 212. When the audio and video data 21A is played, the controller reads the next audio and video data (audio and video data 21B) under /data/data/com.test.disk.tv/databases/tv.db, and reads the audio and video data 21B type.

An embodiment of the present application provides a method for playing audio and video data, including:

In response to the user's operation of playing audio and video data, read the type of the audio and video data;

If the type is PVR, call the TVsource interface to encapsulate the audio and video data to obtain a video frame, and the underlying resource corresponding to the TVsource interface is used to encapsulate the audio and video data of the PVR type;

If the type is not PVR, call the media center interface to encapsulate the audio and video data to obtain video frames;

Display the video frame.

The audio and video data playback method provided in this embodiment is suitable for display devices, and the display device includes a controller and a display, wherein the controller, in response to the user's operation of playing audio and video data, reads the type of the audio and video data; if Described type is PVR, then calls TVsource interface and encapsulates described audio-video data, obtains video frame, and the underlying resource corresponding to described TVsource interface is used for encapsulating the audio-video data of PVR type; If described type is not PVR, then calls media center The interface encapsulates the audio and video data to obtain a video frame; and controls the display to display the video frame. The method for playing audio and video data provided in this embodiment utilizes different underlying resources to display and play PVR-type audio-video data and non-PVR-type audio-video data, which provides better user experience.

When the user plays audio and video data through the display device, if he wants to look back at the audio and video data content he is interested in, since there is no corresponding record for the audio and video data content, the user can only fast forward and rewind frequently, or roughly adjust the progress. Adjust the playback progress of the audio and video data to the position corresponding to the content of the audio and video data. It can be seen that this method of locating audio and video data content is cumbersome to operate and inaccurate, resulting in poor viewing experience for users.

The user plays the audio and video data through the display device. In this embodiment, the played audio and video data can be local audio and video data, such as the audio and video data provided by U disk, mobile hard disk, etc., or network audio and video data, such as Audio and video data provided by the Internet, etc. It should be noted that the audio and video data mentioned in this embodiment all refer to being able to look back, that is, the audio and video data can be obtained again and played. 22 is a schematic diagram of a user interface corresponding to a display playing video 1 according to some embodiments, taking video 1 as the currently playing audio and video data (video 1 corresponds to the process of the sun rising in the east and setting in the west) as an example. The display provides a progress bar (progress bar) to indicate the playback progress of the audio and video data. In the present embodiment, the total length of the progress bar represents the total playback progress, the gray area represents the progress that has been played, and the circle represents the current playback progress. In one implementation, the progress bar can indicate the playing time, and the user can quickly grasp the total duration, the currently played duration, and the remaining playback duration of the audio and video data through the progress bar. In another implementation, the progress bar can indicate the proportion of the playing time. Through the progress bar, the user can quickly grasp the proportion of the currently played time of the audio and video data to the total time of the audio and video data, and the proportion of the remaining playing time to the total time of the audio and video data. The proportion of the total data duration. As shown in Figure 22, taking the progress bar indicating the playback time as an example, the total length of the progress bar indicates the total duration of video 1 (such as 10 minutes min), and the gray area on the progress bar indicates the duration of video 1 that has been played (such as 1min ), thus, it can also be considered that the playback progress indicated by the progress bar corresponds to the time point of video 1, and the corresponding audio and video data content is the title, such as the audio and video data name "sun movement".

In the process of watching video 1, the user finds the audio and video data content that he is interested in. For example, the audio and video data content displayed from the 2min of video 1 is "the sun rises from the east". If the user wants to watch the video Audio and video data content, or when the user plays video 1 again and wants to watch the audio and video data content, adjust the playback progress of video 1 by adjusting the fast forward and rewind options in the display, or by directly clicking the Progress bar to position the progress bar directly to the specified time point to adjust the playback progress of video 1. During the above adjustment process, the user needs to constantly judge whether the content of the audio and video data after adjusting the playback progress is "the sun rises from the east", and when the content of the audio and video data is judged to be "the sun rises from the east", the adjustment of the playback progress is completed . However, the above methods of adjusting the playback progress of the video 1 require multiple attempts by the user, that is, multiple interactions between the user and the display device 200 are required, and the operation is cumbersome. Moreover, whether the adjustment of the playback progress is completed is based on the user's subjective judgment on the content of the audio and video data after the adjustment of the playback progress, and the adjustment accuracy is relatively low.

Considering the above problems, the embodiment of the present application provides a method for marking audio and video data content to accurately mark the audio and video data content that the user is interested in, so that the user can quickly and accurately mark the content of the audio and video data based on the marking point. The playback progress is adjusted to the audio and video data content of interest. FIG. 23 is a schematic flow diagram of creating a marker point according to some embodiments. You can refer to the flow shown in FIG. 23 , and the specific steps are as follows:

S2301: Receive a playback pause instruction sent by a user.

The user plays video 1 through the display. At this time, the audio and video data content played is "the sun rises from the east" (in this application, the right side is taken as the east), and the corresponding playback progress is 2 minutes. The user finds that the audio and video data content If it is the audio and video data content of interest, the control device 100 may send a pause playback instruction to the display device 200 to instruct the display device 200 to pause the playback progress of Video 1 at 2 minutes. Using the remote control as the control device 100 , the user sends a playback pause instruction to the display device 200 by pressing a “pause” button on the remote control.

S2302: In response to the pause playback instruction, pause the currently played audio and video data, and acquire playback progress information corresponding to the pause of the audio and video data.

In response to the pause playback instruction, the display device 200 immediately pauses the currently playing audio and video data, that is, video 1. FIG. 24 is a schematic diagram of a user interface for creating a marker point according to some embodiments, as shown in ① in FIG. The playback progress is accurately paused at 2 minutes, which accurately corresponds to the audio and video data content "The Sun Rises from the East" that the user is interested in, so as to ensure that the subsequent mark points created based on the execution result can accurately correspond to the audio and video that the user is interested in Data content "the sun rises from the east".

After the video 1 is paused, the display device 200 acquires the corresponding playback progress information when the video 1 is paused. In this embodiment, the playback progress information includes time point information corresponding to when video 1 is paused and video screenshots corresponding to when video 1 is paused. Wherein, the corresponding time point information when video 1 pauses corresponds to the information indicated by the progress bar in the display, for example, if the progress bar indicates the playback time in the display, then the time point information refers to the corresponding played duration when video 1 pauses; If the progress bar in the display indicates the proportion of the playing time, the time point information refers to the ratio of the corresponding playing time when the video 1 is paused to the total time of the video 1. As shown in ① in FIG. 24 , taking the progress bar indicating the playing time as an example, the display device 200 acquires the corresponding time point information when the video 1 is paused as "2 minutes".

Based on the time point information, the display device 200 can accurately locate the playback progress corresponding to when the video 1 is paused, that is, the playback progress corresponding to the audio and video data content that the user is interested in.

The video screenshot corresponding to the pause of video 1 refers to the video frame corresponding to the pause of video 1. The image content contained in the video screenshot can represent the audio and video data content played by video 1 at this time point, as shown in Figure 24① As shown, at 2 minutes, the video screenshot corresponding to video 1 is "the sun rises from the east", and correspondingly, at 2 minutes, the audio and video data content corresponding to video 1 is "the sun rises from the east". Through the corresponding screenshot of the video when the video 1 is paused, the audio and video data content corresponding to the video 1 at the corresponding time point can be displayed very intuitively, that is, the audio and video data content that the user is interested in.

Based on the screenshot of the video, the user can quickly and accurately determine whether the content of the audio and video data there is the content of the audio and video data that he wants to watch, so as to accurately choose whether to start playing the video 1 from there.

In some embodiments, in addition to the playback progress information disclosed above, other playback progress information may also be included, such as the playback parameters used before the video 1 is paused.

S2303: Display a mark point creation window, where the mark point creation window includes creation information, where the creation information includes the playback progress information and the name of the mark point.

As shown in ② in FIG. 24 , the display device 200 displays a mark point creation window 2401 on the user interface, and the mark point creation window 2401 can be suspended at any position on the user interface. In one embodiment, since the video 1 is currently in a paused state, the blocking of the audio and video data content by the marker point creation window 2401 will not cause trouble for the user to watch. In order to facilitate the user to use the marker point creation window 2401 better, as shown in ② in FIG. 24 , the marker point creation window 2401 can be displayed at the center of the user interface, so as to facilitate the user to focus on the sight.

The marker point creation window 2401 is used to display creation information corresponding to the marker point to be created to the user. In this embodiment, the creation information includes the playback progress information obtained through S2302 and the name of the marker point. As shown in ② in Fig. 24, the video screenshot is displayed in the left area of the marker creation window 2401 (consistent with "the sun rises from the east" as shown in ① in Figure 24), and on the right side of the marker creation window 2401 The area displays time point information (consistent with 2min as shown in Figure 24 ①), and displays the name of the marker point (TAG1 shown in Figure 24 ②).

Among them, the playback progress information (video screenshots and time point information) in the creation information is automatically generated by the display device 200 based on the acquisition results, and cannot be manually edited, so as to ensure that the playback progress information can accurately represent the corresponding time of video 1 when it is paused. The audio and video data content, and then ensure that the marker points created based on the playback progress information can accurately locate the playback progress of the audio and video data content in the audio and video data. The area corresponding to the video screenshot and the time point information can be grayed out or unfocused to avoid users from performing invalid operations in this area. The name of the marker can be set as an option that can be manually edited, and the area corresponding to the name of the marker can be set as an operable form such as an input box that displays a cursor, so as to indicate to the user that the name of the marker can be modified. In some embodiments, an initial name is usually configured for the mark point, such as TAG N, where N≥1, wherein, for every mark point added in video 1, the value of N increases by 1 correspondingly. The initial name is automatically generated by the display device 200, and the user can directly use the initial name as the name of the created marker. At this time, the creation information shown in ② in FIG. 24 is the creation information corresponding to the marker point to be created.

In some embodiments, in order to facilitate users to quickly identify failed markers based on their names, the user can modify the initial name of the marker to a target name that is easier to identify or can represent the content of the audio and video data here. .

FIG. 25 is a schematic flowchart of modifying the name of a marker in the process of creating a marker according to some embodiments. The above-mentioned steps of modifying the name of a marker in the marker creation window 2401 can refer to FIG. 25 , and the details are as follows:

S2501: Receive an edit instruction sent by the user based on the marker creation window, where the edit instruction indicates a target name of the marker.

The user moves the focus to the input box corresponding to the name of the marked point by manipulating the remote control, and sends a control instruction to enter the input box to the display device 200 by pressing the “OK” button on the remote control. In response to the control instruction, the display device 200 adjusts the input box to a text input mode.

The user sends an editing instruction to the display device 200 by manipulating the remote control, and the editing instruction carries a key value corresponding to the target name, for example, a key value corresponding to "sunrise".

It should be noted that the names corresponding to each marker cannot be repeated to ensure a one-to-one mapping between markers and marker names, so that users can clearly distinguish different markers based on marker names without The marking points will be confused, and at the same time, it is also convenient for the display device 200 to manage each marking point.

S2502: Modify the current name of the mark point to the target name in response to the editing instruction.

In response to the editing instruction, the display device 200 obtains the key values carried by the editing instruction, and generates the corresponding text "sunrise" based on these key values, and then replaces the current name of the marker point, that is, the original name TAG1, with "日日". Click "Exit" to get the marker creation window 2402 after modifying the marker name as shown in ③ in Figure 24. At this time, the creation information shown in ③ in FIG. 24 is the creation information corresponding to the marker point to be created.

S2304: Receive a creation instruction sent by the user based on the marker creation window.

The marker creation window 2401 as shown in ② in FIG. 24 and the marker creation window 2402 as shown in ③ in FIG. 24 both have a “cancel” option and an “OK” option.

The user sends a creation instruction to the display device 200 based on the "confirm" option, so as to instruct the display device 200 to create a marker point.

In one embodiment, the user sends a creation instruction to the display device 200 based on the "Confirm" option in the marker creation window 2401. For example, the user moves the focus to the "Confirm" option by manipulating the remote control, and presses " key to send a creation instruction to the display device 200 (for ease of description, the creation instruction sent in this implementation is defined as the first creation instruction).

In another embodiment, the user sends the creation instruction to the display device 200 based on the "Confirm" option in the marker creation window 2402. For example, the user moves the focus to the "Confirm" option by manipulating the remote control, and presses " Confirm" button to send the creation instruction to the display device 200 (for ease of description, the creation instruction sent in this implementation is defined as the second creation instruction).

If the user does not want to continue to create a marker point, or the pause playback instruction sent to the display device 200 due to misoperation or simply wanting to pause video 1, the user sends a cancel creation instruction to the display device 200 based on the "Cancel" option to indicate The display device 200 cancels the creation of the marker point.

S2305: In response to the creation instruction, generate a marker point based on the creation information.

In response to the creation instruction sent by the user, the display device 200 generates a corresponding mark point, and the mark point indicates the corresponding playback progress when the video 1 is paused.

In one implementation manner, the display device 200 generates a corresponding mark point based on the first creation instruction. At this time, the creation information corresponding to the mark point is shown as ② in FIG. 24 . In another implementation manner, the display device 200 generates a corresponding mark point based on the second creation instruction. At this time, the creation information corresponding to the mark point is shown as (3) in FIG. 24 . The main difference between the markers generated by the above two implementations lies in the names of the markers.

In some embodiments, the display device 200 immediately closes the marker creation window after receiving the creation instruction or cancel creation instruction sent by the user. In this embodiment, the second creation instruction sent by the user is taken as an example. If the display device 200 receives the creation instruction sent by the user, the creation process is carried out in the background of the display device 200, so as to prevent the user from perceiving the time it takes for the display device 200 to generate the marker point, and create the effect of instantaneous marker point generation, improving The user's sense of interactive experience.

After the display device 200 closes the marker point creation window, it immediately continues to play from the corresponding playback progress when the video 1 is paused, so that the playback of the video 1 before and after the pause remains consistent, so as to improve the viewing experience of the user. As shown in ④ in Figure 24, after the display device 200 closes the marker point creation window, video 1 resumes the playback state. At this time, the playback progress of video 1 is 2 minutes, which is consistent with the corresponding playback progress when video 1 is paused, so that it can be guaranteed The process of displaying the marker point creation window by the display device 200 will not affect the continuity of playing the video 1, so that the user can still watch the complete and non-repetitive video 1.

In some embodiments, when the display device 200 generates a marker in response to the creation instruction, the display mode is configured for the marker:

In the first display mode, when the focus is on the progress bar, the marker is displayed; when the focus is not on the progress bar, the marker is not displayed.

The user created 3 markers for video 1, marker A, marker B and marker C. When playing video 1, these 3 markers are always displayed on the progress bar, for example, using a shape different from the progress bar, Color, brightness, etc. are used to display the marker points to use a shape different from the progress bar, such as a five-pointed star to indicate the marker point, and it is always displayed on the progress bar. When the user is watching video 1 normally, the attention is easily distracted by the markers, which reduces the viewing experience. At this time, configure the display mode of the marker point to display the marker point only when the trigger condition is met, and not display the marker point under other conditions. In this display mode, the trigger condition is set as the focus is on the progress bar, that is, the marker is displayed only when the focus is on the progress bar, otherwise the marker is not displayed.

FIG. 26 is a schematic diagram of a display mode of a marker point when the focus is not on the progress bar according to some embodiments. In the user interface shown in FIG. 26 , when video 1 is played, the display device 200 does not detect that the focus is on the progress bar. Then the mark point A, mark point B and mark point C are not displayed on the progress bar (the mark points are shown in dotted lines, and the text is shown in gray, which means hidden). FIG. 28 is a schematic diagram of previewing video screenshots of each marked point according to some embodiments. In the user interface shown in FIG. 28 , when playing video 1, the display device 200 detects that the focus moves to the progress bar (the focus is represented by a thick solid line ), then display marker A, marker B and marker C on the progress bar to show the user all markers corresponding to video 1 for the user to view and select. FIG. 27 is a schematic diagram of the display mode of the marker points when the focus is on the progress bar according to some embodiments. Further, when the display device 200 detects that the focus is removed from the progress bar, each marker point is hidden, that is, as shown in FIG. 27 Show.

In this way, when the user normally watches video 1 and does not generate a need to view and select a marker point, the display device 200 will not display the marker point, so as to avoid unnecessary display of marker points from distracting the user's attention, and when the user generates a view and selection When selecting the requirement of the marker point, the display device 200 can display the marker point in time, and in the process of displaying the marker point, it will not affect the normal playback of the video 1, allowing the user to watch the video 1 and check the marker point at the same time.

In the second display mode, based on the first display mode, when it is detected that the focus moves to the progress bar, the display device 200 further displays video screenshots corresponding to each marker in response to a preview instruction sent by the user. In this display mode, the preview command needs to be sent by the user based on the progress bar, that is, the preview command is only established when the focus is on the progress bar. If the focus is not on the progress bar, the key value carried in the preview command will correspond to other commands, or does not correspond to any command. For example, the user sends an instruction to the display device 200 by pressing the "up" button on the remote control, and the instruction carries the "up" key value. The display device 200 detects that the focus is on the progress bar, and recognizes the If the "up" key value is consistent with the key value of the preset preview command, it is determined that the command is a preview command, and in response to the preview command, video screenshots corresponding to each marked point are displayed. And if the display device 200 detects that the focus is not on the progress bar, it determines that the instruction is not a preview instruction. Further, the display device 200 recognizes that the "up" key value carried in the instruction is consistent with the preset key value of the instruction to move the focus upward, and then determines that the instruction is an instruction to move the focus upward, and then responds to the instruction of moving the focus upward, and moves the focus to Move up.

For example, in response to the preview instruction, the display device 200 displays video screenshots corresponding to marker point A, marker point B, and marker point C. For example, the video screenshot corresponding to marker point A is "the sun rises from the east", and marker point B corresponds to The screenshot of the video is "the sun is at its highest point", and the screenshot of the video corresponding to point C is "the sun sets from the west". Correspondingly display the marker points and video screenshots, as shown in FIG. 28 , display the corresponding video screenshots above each marker point, so as to clearly and accurately show the corresponding relationship between marker points and video screenshots. Thus, for audio and video data whose audio and video data content is quite different at each playback progress of the audio and video data, the user can directly determine whether the audio and video data content at the playback progress is what he needs to watch based on the picture content of the video screenshot Audio and video data content. However, for audio and video data where the difference in audio and video data content is small at each playback progress, or the audio and video data content appears cyclically, the content of the video screenshot and the playback progress indicated by the corresponding marker can be combined to jointly determine the audio and video data. Whether the audio and video data content is the audio and video data content that you need to watch, so as to ensure the accuracy of subsequent positioning of the audio and video data content through the marker points through the corresponding relationship.

In the third display mode, when it is detected that the playing progress of the audio and video data reaches the mark point, the name of the mark point is displayed. Fig. 29 is a schematic diagram of the display mode of the mark point when the playback progress of the audio and video data reaches the mark point according to some embodiments. As shown in Fig. 29, the play progress indicated by the mark point B is 5 minutes, and the video 1 is in the process of normal play, If the playback progress reaches the playback progress indicated by the mark point B, that is, the playback progress of video 1 is also 5 minutes. At this time, the name of marker B, such as TAG2, is displayed. By displaying the name of the marked point, the user's attention can be concentrated, and the user can be reminded that this is the audio and video data content of interest marked by him, and he can pay special attention to it when watching, so as to improve the user's viewing experience.

In some embodiments, as shown in FIG. 29 , the names of the displayed markers will cover the content of the audio and video data, which will affect the normal viewing of the audio and video data by the user. In order to solve this problem, set the name of the marker to display for a specified duration, such as 2s. After 2s, the name of the marker will not be displayed. In this way, by displaying the name of the marker for a short time, it is enough to remind the user to pay special attention to the corresponding playback progress. audio and video data content, and after the reminder, the name of the mark point can be closed in time to avoid affecting the normal viewing of the user by displaying the name of the mark point for a long time.

The above third display manner can be realized based on the first display manner. When the focus is on the progress bar, each mark point is displayed. At this time, if the playback progress of video 1 reaches mark point B, the name TAG2 of mark point B is displayed at the same time. When the focus is not on the progress bar, the mark point is not displayed. At this time, if the playback progress of the video 1 reaches the mark point B, only the corresponding name TAG2 is displayed on the mark point B.

In some embodiments, in order to more clearly show the correspondence between the markers and the names of the markers, so that users can quickly and accurately grasp the markers through the names of the markers and the correspondence between the markers, the markers The corresponding audio and video data content, as well as the playback progress indicated by the mark point, enable the user to more accurately determine whether to pay special attention to the audio and video data content at that location. In one implementation, if the focus is not on the progress bar, each mark point is not displayed. At this time, when the name of the mark point is displayed, the corresponding mark point can be displayed at the same time, so as to display the mark through the displayed mark point The correspondence between the point and the name of the marked point. As shown in Figure 29, the focus is not on the progress bar, and each mark point is not displayed. When the playback progress of video 1 reaches mark point B, the name TAG2 of mark point B is displayed above mark point B, and mark point B is displayed at the same time (star shown). Alternatively, the name of the marker is displayed in the indication box, and the indication box points to the location of the marker on the progress bar, so as to show the corresponding relationship between the marker and the name of the marker through the pointing relationship. Fig. 30 is a schematic diagram showing the corresponding relationship between a marker point and a marker point name according to some embodiments. As shown in Fig. 30 , the focus is on the progress bar (shown by a thick black solid line frame), and marker point A and marker point B are displayed , Mark point C (shown in a star shape), when the playback progress of video 1 reaches mark point B, TAG2 is displayed in the indicator box, and the indicator box points to mark point B. Alternatively, change the display mode of the marked point B. FIG. 31 is a schematic diagram showing the corresponding relationship between the marked point and the name of the marked point according to some embodiments. As shown in FIG. 31 , change the color (black) of the marked point B to be consistent with other Marking points are distinguished, indicating that marking point B corresponds to the name of the displayed marking point.

After the mark point is created, the display device 200 stores creation information corresponding to the mark point, so as to manage each mark point in the audio and video data. In this embodiment, the display device 200 may store each piece of creation information in the form of a data table. FIG. 32 is a schematic diagram of the data format of the creation information of a marker point according to some embodiments. As shown in FIG. 32 , the data table includes The table name (TAG_TABLE) is used to indicate the corresponding marking point of the data table; the identity document (ID) is used to identify the unique identity of the data table in the database, which can be represented by a variable-length string varchar; The mark point name field (TAG_NAME), used to indicate the name of the mark point, can be represented by varchar; the video screenshot field (TAG_BITMAP), used to indicate the video screenshot corresponding to the mark point, can be represented by a bitmap Bitmap; the time point field (TAG_TIME), used to indicate the time point information corresponding to the marker point, can be represented by a long integer.

In the process of viewing audio and video data, the user can manage the created marker points at any time. FIG. 33 is a schematic flow diagram of modifying the creation information of marker points according to some embodiments. Referring to the process shown in FIG. 33 , the specific steps are as follows:

S3301: Receive a control instruction sent by the user, where the control instruction is used to instruct to display a list of marked points.

In the process of viewing audio and video data, based on new needs, such as a new understanding of audio and video data content, easy management of markers, etc., the user can modify the creation information of the established marker points at any time, or delete the established marker points. mark point. When the user generates a new requirement, the user can send a control instruction to the display device 200 by pressing a designated button on the remote controller, so as to instruct the display device 200 to display the list of marked points. For example, the control instruction includes a first instruction and a second instruction. The user sends the first instruction to the display device 200 by pressing the "menu" button on the remote control to instruct the display device 200 to display a video menu. Click List Options. By manipulating the remote control, the user moves the focus to the marker list option, and presses the “OK” button to send a second instruction to the display device 200 to instruct the display device 200 to enter the marker list option, that is, to display the marker list. In some embodiments, a dedicated key may also be set for the marker list, and the user directly instructs the display device 200 to display the marker list by directly pressing the dedicated key.

S3302: Display the list of marked points on the user interface in response to the control instruction.

The display device 200 receives the control instruction sent by the user, and in response to the control instruction, displays a list of marked points on the user interface. Taking the case that the control command in S3301 includes the first command and the second command as an example, the display device 200 receives the first command sent by the user, and recognizes the "menu" key value carried by the first command, and responds to the Key value, Figure 34 is a schematic diagram of a user interface for modifying the name of a marker point according to some embodiments, as shown in ① in Figure 34, a video menu is displayed on the user interface. In this embodiment, the video menu includes options such as various parameters and functions corresponding to the audio and video data, among which at least includes an option of a list of markers.

The display device 200 receives the second instruction sent by the user, detects that the focus is on the mark point list option (as shown by the thick black solid line box in Figure 34), and recognizes the "confirm" key value, and responds to the key value , to display a list of markers. In this embodiment, as shown in ② in FIG. 34 , the marker list includes pre-stored creation information of each marker.

In response to the control instruction, the display device 200 obtains from the database the creation information of the currently played audio and video data, such as the marker point corresponding to video 1. It can be known from the way that the display device 200 stores the creation information above. The display device 200 can obtain from the database The data table corresponding to each marker point is obtained in the , and based on the fields in the data table, the creation information of the marker point (name of the marker point, video screenshot, time point information) is displayed. As shown in ② in Figure 34, the marker list corresponding to video 1 includes creation information of marker A, marker B and marker C.

S3303: Receive a modification instruction sent by the user based on the modification option, or receive a deletion instruction sent by the user based on the deletion option.

S3304: In response to the modification instruction, modify the name of the mark point, or, in response to the delete instruction, delete the indicated mark point and corresponding creation information.

Based on this marker list, the user can quickly grasp all the markers in Video 1 and the creation information corresponding to the markers, and based on these creation information, quickly grasp the content of the audio and video data corresponding to each marker and the content of the audio and video data in the audio and video data. The corresponding playback progress, so as to further determine the mark points that need to be modified and the mark points that need to be deleted.

For the process of modifying the name of a marker point by the user, the following specific description is given:

Based on the creation information of the marker, the user determines the creation information of the marker that needs to be modified, for example, determines to modify the creation information of marker B. By manipulating the remote control, as shown in ② in Figure 34, the user moves the focus to the option corresponding to the mark point B (shown in a thick black solid line frame), and presses the "confirm" button to instruct the display device 200 to enter the mark point B corresponds to the submenu. In this embodiment, as shown in (3) in FIG. 34 , the submenu corresponding to the marker contains multiple functional options, such as modification options, deletion options, and jump options. By manipulating the remote control, as shown in ③ in Figure 34, the user can move the focus to the modification option (shown in a thick black solid line box), and press the "confirm" button to send an instruction to the display device 200, and the display device 200 receives the command. When the command is detected, the focus is detected on the modification option, and the key value carried by the command is recognized as "Confirm", then in response to the key value, a menu corresponding to the modification option is displayed, and the menu can be as shown in Figure 24 ② The marker creation window 2401 shown and the marker creation window 2402 shown in ③ in FIG. 24 , and the menu 3401 shown in ④ in FIG. 34 , the creation information on the menu 3401 is the creation information corresponding to the marker B. The same as the mark point creation window, the area corresponding to the mark point name on the menu 3401 is an editable area for the user to modify the name of the mark point, and the area corresponding to the time point information and the video screenshot is an uneditable area. Avoid user modification, so as to ensure the accuracy of the creation information corresponding to the marker point. The user moves the focus to the area corresponding to the name of the marked point in the menu 3401 by controlling the remote control (shown in a thick black solid line frame), and presses the "confirm" button to instruct the display device 200 to adjust the area to the text input mode . The user sends the key value corresponding to the target name to the display device 200 by controlling the remote control to instruct the display device 200 to input the target name into the area, and the display device 200 will delete the current text content of the area in response to the key value, namely TAG2 , enter the text content corresponding to the key value, such as "midday". After the modification is completed, the user moves the focus to the "OK" option on the menu 3401 by controlling the remote control to instruct the display device 200 to complete the modification. In response to this instruction, the display device 200 closes the menu 3401, and as shown in ⑤ in FIG. The name was changed from "TAG2" to "Day China". In this way, the user can continue to modify the names of other markers by browsing the marker list without performing the procedures corresponding to S3301-S3302 again.

In some embodiments, during the above-mentioned process of modifying the name of the marker, the video 1 remains in a normal playing state, so that the user can continue to watch the video 1 while modifying the name of the marker.

For the process of users deleting markers, the following specific description is given:

The user determines the marker point to be deleted based on the creation information of the marker point, for example, the marker point C is determined to be deleted. The user manipulates the remote control. FIG. 35 is a schematic diagram of a user interface for deleting a marked point according to some embodiments. As shown in ① in FIG. 35 , move the focus to the option corresponding to the marked point C (shown in a thick black solid line box), And by pressing the “OK” button, the display device 200 is instructed to enter the submenu corresponding to the mark point C, as shown in ② in FIG. 35 , the submenu corresponding to the mark point C includes the delete option. The user can control the remote control, as shown in ② in Figure 35, move the focus to the delete option (shown in a thick black solid line box), and press the "confirm" button to send a delete command to the display device 200, and the display device 200 After receiving the delete command, detecting that the focus is on the delete option, and recognizing that the key value carried by the command is "confirm", in response to the key value, delete the creation information corresponding to the mark point C, and delete the key on the progress bar. Mark point C, and as shown in ③ in Figure 35, redisplay the mark point list, and the creation information of mark point C has been deleted in the mark point list at this time. In this way, the user can continue to modify the creation information of other markers by browsing the marker list without performing the procedures corresponding to S3301-S3302 again. Moreover, if the user moves the focus to the progress bar, the progress bar only displays markers A and B, and since marker C has been deleted, marker C will no longer be displayed to avoid vacancy (no corresponding creation information) The marked point misleads the user.

In some embodiments, during the process of deleting the above-mentioned markers, the video 1 remains in a normal playing state, so that the user can continue to watch the video 1 while deleting the markers.

Based on the above-mentioned marking method for audio and video data content, the user can mark the audio and video data content at any time during the process of watching the audio and video data, that is, create a mark point for the audio and video data content corresponding to a certain playback progress, so as to pass the mark The point accurately identifies the audio and video data content at the playback progress and the corresponding playback progress. Thus, an accurate playback progress is provided for the user to review the audio and video data content again, so that the user can quickly and accurately locate the playback progress to the marked point to play the audio and video data content. At the same time, the user can modify and delete the created mark points at any time during the process of watching the audio and video data, so that the mark points corresponding to the audio and video data can better meet the user's needs.

Based on the mark points created in the audio and video data by the above process, the user can determine the mark points corresponding to the audio and video data content of interest, as mentioned above, by sending a preview command to the display device 200 to display video screenshots of each mark point , and then determine the target mark point corresponding to the audio and video data content of interest through the video screenshot, or as mentioned above, by sending a control command to the display device 200 to display the mark point list, and then through each mark point in the mark point list Create information to determine the target marker point corresponding to the audio and video data content of interest. After determining the target mark point, the user can adjust the playback progress of the progress bar to coincide with the target mark point by manipulating the remote control, and then adjust the playback progress to the audio and video data content of interest.

However, the above method of adjusting the playback progress to the target mark point is less accurate because whether the play progress coincides with the target mark point is judged subjectively by the user. Moreover, during the process from determining the target mark point to adjusting the progress bar, the user is required to additionally close various menus (such as a list of mark points) and windows (such as a video screenshot) to display the operation of the display window, and the operation is cumbersome.

The embodiment of the present application provides a method for locating audio and video data content, so as to quickly and accurately locate the audio and video data content to be watched through the mark points created in the audio and video data.

example one

FIG. 36 is a schematic flow diagram of locating audio and video data content based on video screenshots of marker points according to some embodiments. Referring to the flow shown in FIG. 36 , the details are as follows:

S3601: Receive a preview instruction sent by the user based on the progress bar of the audio and video data, where the preview instruction is used to instruct to display a video screenshot corresponding to the marked point.

When the user wants to adjust the playback progress to the marked point, he can move the focus to the progress bar by controlling the remote control, based on the first display mode of the marked point disclosed above. When the display device 200 detects that the focus is on the progress bar, it displays each marked point. Still taking the user watching video 1 as an example, the user interface shown in FIG. 27 will not be described here.

Further, the user sends a preview instruction to the display device 200, for example, the user presses a designated button on the remote control, such as an "up" button, to send a preview instruction to the display device 200, and the preview instruction carries the key value "up" to Instructing the display device 200 to display a video screenshot corresponding to each marked point.

S3602: In response to the preview instruction, display a video screenshot corresponding to the marked point, and move the focus to the video screenshot.

The display device 200 receives the preview command, detects that the focus is on the progress bar, and recognizes that the preview command carries the key value "up", which is consistent with the key value of the preset preview command, determines that the command is a preview command, and then responds For the preview command, video screenshots corresponding to each marked point are displayed, such as the user interface shown in FIG. 28 , which will not be described here.

Further, the display device 200 automatically moves the focus to a video screenshot. FIG. 37 is a schematic diagram of a user interface for locating audio and video data content based on a marker point video screenshot according to some embodiments. As shown in ① in FIG. 37, the display device 200 automatically moves the focus to the video screenshot corresponding to the marker point A (shown in a thick black solid line frame). In an implementation manner, the display device 200 may move the focus to the video screenshot corresponding to the first marked point. In an implementation manner, the display device 200 may randomly move the focus to a video screenshot. In one implementation manner, the display device 200 may move the focus to a video screenshot that is located before the current playback progress and corresponds to the marker point closest to the current playback progress. In one implementation manner, the display device 200 may move the focus to a video screenshot that is located behind the current playback progress and corresponds to the marker point closest to the current playback progress. In one implementation manner, the display device 200 may move the focus to the video screenshot corresponding to the mark point with the most historical viewing times based on the historical viewing records of the user.

S3603: Receive a selection instruction sent by the user, where the selection instruction indicates a target video screenshot.

Users can quickly determine the audio and video data content they are interested in based on the video screenshots of each marker point. The target video screenshot corresponding to the video data content is the third video screenshot. As shown in ② in Figure 37, the user controls the remote control to move the focus to the target video screenshot (shown in a thick black solid line frame), and sends a selection command to the display device 200 by pressing the "confirm" button to indicate Watch the audio and video data content at the playback progress.

S3604: In response to the selection instruction, adjust the playback progress of the audio and video data to the mark point corresponding to the target video screenshot.

The display device 200 receives the selection instruction and detects that the focus is on the target video screenshot, and in response to the selection instruction, determines the marker point corresponding to the target video screenshot, that is, marker point C, and adjusts the playback progress of Video 1 to the marker point C. Point C, as shown in ③ among Fig. 37, the audio-video data content of playing at this moment is " the sun falls from the west ".

Thus, the user only needs to determine the audio and video data content he is interested in, and the display device 200 can automatically adjust the playback progress to the corresponding marker point based on the corresponding relationship between the video screenshot and the marker point, and the positioning is accurate. Moreover, after the user browses the screenshot of the video, there is no need to perform other operations, such as closing the screenshot of the video, to complete the positioning of the playback progress. The operation is simpler and faster, which can effectively improve the user experience.

In some embodiments, after the switching is completed according to steps such as S3601-S3604, as shown in ③ in Figure 37, it is still in the fast switching mode of marker points, that is, the video screenshots of each marker point are displayed, and the focus is on the previous switching operation The corresponding video screenshot, that is, the third video screenshot. In this way, the user can continue to quickly switch the playback progress to other markers based on the screenshot of the video.

In some embodiments, the user may send an exit command to the display device 200 by pressing the "return" button on the remote controller, and the display device 200 responds to the exit command and exits the marker fast switching mode. For example, as shown in Figure 27, the focus is still on the progress bar, and each marker point is displayed, but the video screenshot is not displayed. Or, the focus is no longer displayed, and it is restored as shown in FIG. 26 . At this time, it is equivalent to that the focus is not on the progress bar, and each mark point is not displayed. It is also possible to set a waiting time, for example 2s, if within the waiting time, the display device 200 does not receive the selection instruction sent by the user, it will directly exit the marker fast switching mode.

Example two

FIG. 38 is a schematic flow diagram of locating audio and video data content based on creation information of marker points according to some embodiments. Referring to the flow shown in FIG. 38 , the details are as follows:

S3801: Receive a control instruction sent by the user, the control instruction is used to instruct to display a list of markers, the list of markers includes creation information of all markers on the audio and video data, and corresponding function options, the Function options include modify options, delete options and jump options.

S3802: In response to the control instruction, display the marker list on the user interface, where the audio and video data is in a playing state.

For the process of the user sending a control command to the display device 200 and the display device 200 displaying the list of markers in response to the control command, reference may be made to the process shown in S3301-S3302 above, which will not be repeated here. Subsequent descriptions will be made by taking the marker list as shown in ② in Figure 34 as an example.

In this example, when the display device 200 executes the above process, the audio and video data is still in the playing state, so as to ensure that the user can watch the audio and video data and browse the marker list at the same time.

S3803: Receive a jump instruction sent by the user based on the jump option, where the jump instruction indicates a target mark point.

S3804: In response to the jump instruction, adjust the playback progress of the audio and video data to the target mark point.

In this embodiment, jumping refers to adjusting the playback progress of the audio and video data to the marked point. Based on the creation information of the marker, the user determines the audio and video data content of interest, and then determines the target marker to jump to, such as marker B. The user manipulates the remote control. FIG. 39 is a schematic diagram of a user interface for locating audio and video data content based on the creation information of a marker point according to some embodiments. As shown in ① in FIG. 39 , move the focus to the option corresponding to the marker point B (coarse black solid line box), and by pressing the “OK” button, the display device 200 is instructed to enter the submenu corresponding to the mark point B, as shown in ② in FIG. 39, the submenu corresponding to the mark point B contains jump options. The user can control the remote control, as shown in ② in Figure 39, move the focus to the jump option (shown in the thick black solid line box), and press the "confirm" button to send a jump command to the display device 200, and display The device 200 receives the jump command, detects that the focus is on the jump option, and recognizes that the key value carried by the command is "confirm", then adjusts the playback progress to the mark point B in response to the key value, and at this time , as shown in ③ in Figure 39, the audio and video data content corresponding to the mark point B is displayed "the sun is at the highest point".

In some embodiments, as shown in (3) in FIG. 39 , after adjusting the playback progress, the marker list is still displayed, so that the user can continue to adjust the playback progress based on the marker list without repeating the operation of opening the marker list. The user may also instruct the display device 200 to close the marker list by sending an exit instruction to the display device 200 . Alternatively, set a waiting time, such as 2s, within the waiting time, if the display device 200 does not detect a jump instruction sent by the user, the marker list will be automatically closed.

In some embodiments, when adjusting the playback progress based on the marker list, since the corresponding relationship between the marker list and the markers on the progress bar is not obvious, it is difficult for the user to quickly and accurately judge each marker on the marker list. The corresponding position on the progress bar. Thus, after the playback progress is adjusted, the name of the corresponding mark point is displayed at the adjusted playback progress. As shown in ③ in Figure 39, an indicator box is displayed at the marker point B, and the name of the marker point B is displayed in the indicator box, such as TAG2, to indicate that the playback progress has been adjusted to the marker point B, prompting the user to complete the playback progress adjustments to effectively interact with the user, improve the user's perception of the display device 200 responding to instructions, and thereby improve the experience. At the same time, in order to prevent the indicator frame from covering the video window for a long time, a waiting time is set, such as 2s, and the indicator box is no longer displayed after the waiting time is reached.

Thus, the user only needs to determine the content of audio and video data that he is interested in, and determine the target mark point to which he wants to jump. The display device 200 automatically adjusts the playback progress to the target mark point, and the positioning is accurate. Moreover, after the user determines the target marker, the playback progress can be positioned without performing other operations, such as closing the marker list, and the operation is simpler and faster, which can effectively improve the user's experience.

It can be seen from the above technical solution that the user plays the audio and video data through the display device, and when watching the audio and video data content of interest, sends a pause playback instruction to the display device, and the display device responds to the pause playback instruction sent by the user, and pauses the currently played video. Audio and video data, and display the marker point creation window to provide the user with creation information corresponding to the marker point creation. In response to the creation instruction sent by the user, the display device generates marker points based on the creation information to mark the corresponding playback progress when the audio and video data is paused. In this way, when the user needs to look back at the audio and video data content, he can directly determine the marker point corresponding to the audio and video data content of interest according to the creation information of the marker point, and directly adjust the playback progress of the audio and video data to the mark Click to play the audio and video data content quickly and accurately.

For convenience of explanation, the above description has been made in conjunction with specific implementation manners. However, the above exemplary discussion is not intended to be exhaustive or to limit the implementations to the precise forms disclosed above. Many modifications and variations are possible in light of the above teachings. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various modified embodiments suitable for specific use considerations.

Claims

A display device comprising:

monitor;

Controller, configured as:

In response to the user's operation of playing audio and video data, read the type of the audio and video data;

If the type is PVR, call the TVsource interface to encapsulate the audio and video data to obtain a video frame, and the underlying resource corresponding to the TVsource interface is used to encapsulate the audio and video data of the PVR type;

If the type is not PVR, call the media center interface to encapsulate the audio and video data to obtain video frames;

The display is controlled to display the video frames.
The display device according to claim 1, the video frame is displayed in the form of a small window.
The display device according to claim 1, the controller is further configured to:

If the underlying resource corresponding to the media center interface cannot encapsulate the audio and video data, the display is controlled to display first prompt information, and the first prompt information is used to prompt the user that the audio and video data cannot be played.
The display device according to claim 1, the controller is further configured to:

In response to the user's operation of starting the video recording function, record the content displayed on the display to obtain PVR-type audio and video data;

The audio and video data of the PVR type is stored.
The display device according to claim 1, the controller is further configured to:

In response to the user's operation of starting the video recording function, read the identification information of the display device, where the identification information is used to uniquely identify the display device;

Add the identification information for the audio and video data of the PVR type.
The display device according to claim 1, the controller is further configured to:

If the type is PVR, read the identification information corresponding to the audio and video data;

If the identification information corresponding to the audio and video data is the same as the identification information of the display device, then call the TVsource interface to encapsulate the audio and video data to obtain a video frame;

If the identification information corresponding to the audio and video data is not the same as the identification information of the display device, control the display to display second prompt information, the second prompt information is used to remind the user that the display device is not capable of playing the audio and video Data Permissions.
The display device according to claim 1, the controller is further configured to:

In response to the user's operation of playing audio and video data, record the storage path of the audio and video data;

In the process of displaying the video frame, in response to a user's return operation, the display is controlled to display an initial interface, and the initial interface is used to display all data under the storage path.
The display device according to claim 1, the controller is further configured to:

In response to the user's operation of sequentially playing the audio and video data, record the storage path of the audio and video data;

When the audio and video data ends, according to the storage order of the audio and video data in the storage path, the type of the next audio and video data is read.
According to the display device according to any one of claims 1-8, the controller is further configured to:

When the display displays the initial interface, in response to the user's selection operation on the target type, the display is controlled to display the TAB interface, and the TAB interface is used to display audio and video data conforming to the target type.
The display device according to claim 1, the controller is further configured to:

Receive the pause playback instruction sent by the user;

In response to the pause playback instruction, pause the currently played audio and video data, and obtain the corresponding playback progress information when the audio and video data is paused;

Displaying a mark point creation window, the mark point creation window includes creation information, wherein the creation information includes the playback progress information and the name of the mark point;

receiving the creation instruction sent by the user based on the marker creation window;

In response to the creation instruction, a mark point is generated based on the creation information, and the mark point indicates the corresponding playback progress of the audio and video data when it is paused, so that the user can play the audio and video data based on the creation information The playback progress of the data is directly adjusted to the marked point.
The display device according to claim 10, wherein the playback progress information includes time point information corresponding to when the audio and video data is paused, and video screenshots corresponding to when the audio and video data is paused.
According to the display device according to claim 11, before receiving the creation instruction sent by the user based on the marker point creation window, the controller is further configured to:

receiving an edit instruction sent by the user based on the mark point creation window, the edit instruction indicating the target name of the mark point;

In response to the edit instruction, modify the current name of the marker to the target name.
The display device according to claim 10, wherein the controller, in response to the creation instruction, generates marker points based on the creation information, and is configured to:

Set the display mode for the marker, where,

When it is detected that the focus is on the progress bar of the audio and video data, displaying the marked point, wherein, when receiving a preview instruction sent by the user, displaying a video screenshot corresponding to the marked point;

When it is detected that the focus is not on the progress bar of the audio and video data, the mark point is not displayed;

When it is detected that the playback progress of the audio and video data reaches the mark point, the name of the mark point is displayed.
The display device according to claim 10, after the controller generates the mark point based on the creation information in response to the creation instruction, it is further configured to:

storing said creation information;

The controller is also configured to:

receiving a control instruction sent by the user, where the control instruction is used to instruct to display a list of markers, the list of markers includes pre-stored creation information of each marker, and corresponding function options, wherein the function options include modifying options, delete options and jump options;

displaying the list of marked points on the user interface in response to the control instruction;

receiving a modification instruction sent by the user based on the modification option, or receiving a deletion instruction sent by the user based on the deletion option;

In response to the modification instruction, the name of the marker is modified, or, in response to the deletion instruction, the indicated marker and corresponding creation information are deleted.
The display device according to claim 10, the controller is further configured to:

In response to the creation instruction, or, based on the cancel creation instruction sent by the user based on the marker creation window, close the marker creation window, and start playing the audio and video data from the corresponding playback progress when the audio and video data is paused Audio and video data.
A method for playing audio and video data for a display device, comprising:

In response to the user's operation of playing audio and video data, read the type of the audio and video data;

If the type is PVR, call the TVsource interface to encapsulate the audio and video data to obtain a video frame, and the underlying resource corresponding to the TVsource interface is used to encapsulate the audio and video data of the PVR type;

If the type is not PVR, call the media center interface to encapsulate the audio and video data to obtain video frames;

Display the video frame.
The method of claim 16, said method comprising:

Receive the pause playback instruction sent by the user;

In response to the pause playback instruction, pause the currently played audio and video data, and obtain the corresponding playback progress information when the audio and video data is paused;

Displaying a mark point creation window, the mark point creation window includes creation information, wherein the creation information includes the playback progress information and the name of the mark point;

receiving the creation instruction sent by the user based on the marker creation window;

In response to the creation instruction, a mark point is generated based on the creation information, and the mark point indicates the corresponding playback progress of the audio and video data when it is paused, so that the user can play the audio and video data based on the creation information The playback progress of the data is directly adjusted to the marked point.