CN117714805A

CN117714805A - Display equipment and subtitle display method

Info

Publication number: CN117714805A
Application number: CN202211100434.XA
Authority: CN
Inventors: 金程贵; 陆华色
Original assignee: Hisense Electronic Technology Shenzhen Co ltd
Current assignee: Hisense Electronic Technology Shenzhen Co ltd
Priority date: 2022-09-08
Filing date: 2022-09-08
Publication date: 2024-03-15
Also published as: WO2024051030A1

Abstract

Some embodiments of the present application show a display device and a subtitle display method, where the method includes: acquiring first content, first display characteristics, first display start time and first display end time of a first subtitle fragment; when the first display starting time is reached, controlling the display to display the first content according to the first display characteristic; acquiring second content, second display characteristics and second display starting time of a second subtitle fragment; calculating a difference between the second display start time and the first display end time; and if the difference value is smaller than a preset value, when the first display ending time is reached, controlling the display to display second content according to the second display characteristic. In the embodiment of the application, when the display time interval of two adjacent fragments is shorter, blank content can not be displayed, the content of the next subtitle fragment is directly displayed, subtitle flickering is avoided, the content is not smooth enough, and user experience is improved.

Description

Display equipment and subtitle display method

Technical Field

The present disclosure relates to the field of display devices, and in particular, to a display device and a subtitle display method.

Background

TTML (Timed Text Markup Language, timing text markup language) has the advantages of good compatibility, simple configuration and convenient synchronization, and the ATSC3.0 broadcasting system breakthroughs in introducing TTML as a caption standard. However, TTML subtitles are small in fragments, more fragments are transmitted, the fragments are too short in intervals, and the hardware drawing performance cannot be kept up, so that subtitle flickering exists in the rapid multi-fragment transmission display process, and the experience is poor, such as insufficient smoothness of contents. For example: when TTML is displayed as a multi-slice, slice a content needs to be displayed first, then blank is displayed, and then slice B content is displayed. After displaying the blank, a whole processing flow is needed to be passed through until the fragment B is displayed again, and a certain time is consumed in the middle. When the time difference between the display start time of the segment B and the display end time of the segment a is smaller than the time taken from the display of the blank to the display of the segment B, the segment B is delayed to be displayed, i.e. the caption suddenly appears a small blank. If the content of the fragment A is the same as that of the fragment B, the subtitle can flash, and the user experience is poor.

Disclosure of Invention

Some embodiments of the present application provide a display device and a subtitle display method, where when a display time interval of two adjacent segments is shorter, blank content may not be displayed, and content of a next subtitle segment is directly displayed, so that a situation that a subtitle flickers and content is not smooth enough is avoided, and user experience is improved.

In a first aspect, some embodiments of the present application provide a display device, including:

a display;

a controller configured to:

acquiring first content, first display characteristics, first display start time and first display end time of a first subtitle fragment;

when the first display starting time is reached, controlling the display to display the first content according to the first display characteristic;

acquiring second content, second display characteristics and second display starting time of a second subtitle fragment;

calculating a difference between the second display start time and the first display end time;

and if the difference value is smaller than a preset value, when the first display ending time is reached, controlling the display to display second content according to the second display characteristic.

In some embodiments, the controller, upon reaching the first display end time, controls the display to display second content according to the second display characteristic, further configured to:

judging whether the first content is identical to the second content;

and if the first content is the same as the second content, controlling the display to display the second content according to the second display characteristic when the first display end time is reached.

In some embodiments, the controller is configured to:

and if the first content is different from the second content, clearing the first content when the first display end time is reached, and controlling the display to display the second content according to the second display characteristic.

In some embodiments, the controller is configured to:

if the first content is different from the second content, judging whether the first content and the second content have an association relation;

if the first content and the second content have an association relationship, when the first display end time is reached, controlling the display to display the second content according to the second display characteristic;

and if the first content and the second content do not have an association relationship, clearing the first content when the first display end time is reached, and controlling the display to display the second content according to the second display characteristic.

In some embodiments, the controller performing determining whether the first content has an association with the second content is further configured to:

judging whether the first content ends with a sentence end punctuation mark;

If the first content ends with the end punctuation mark, determining that the first content and the second content do not have an association relation;

and if the first content does not end with the end punctuation mark, determining that the first content and the second content have an association relation.

judging whether the first content is identical to the second content;

if the first content is the same as the second content, judging whether the first display characteristic is the same as the second display characteristic;

if the first display characteristic is the same as the second display characteristic, controlling the display to display second content according to the second display characteristic when the first display end time is reached;

and if the first display characteristic is different from the second display characteristic, clearing the first content when the first display end time is reached, and controlling the display to display second content according to the second display characteristic.

In some embodiments, the controller is configured to:

if the difference value is greater than or equal to a preset value, clearing the first content when the first display end time is reached;

and when the second display starting time is reached, controlling the display to display the second content according to the second display characteristic.

In a second aspect, some embodiments of the present application provide a subtitle display method, including:

In some embodiments, the step of controlling the display to display second content according to the second display characteristic when the first display end time is reached includes:

Judging whether the first content is identical to the second content;

In some embodiments, the method further comprises:

Some embodiments of the present application provide a display device and a caption display method, which determine a display interval time, i.e., a difference value, of two adjacent caption segments by acquiring a display start time and a display end time of the two adjacent caption segments, and compare the difference value with a preset value, where the preset value is time consumption required by hardware in a process of displaying a blank and displaying a next caption segment. If the difference value is smaller than the preset value, the hardware cannot finish the conversion between displaying the blank and displaying the next caption in the difference value in the preset time, so that the operation of displaying the blank can be canceled under the condition, the next caption can be directly displayed, the condition that the caption flicker occurs and the content is not smooth enough is avoided, and the user experience is improved.

Drawings

FIG. 1 illustrates an operational scenario between a display device and a control apparatus according to some embodiments;

fig. 2 shows a hardware configuration block diagram of the control device 100 according to some embodiments;

fig. 3 illustrates a hardware configuration block diagram of a display device 200 according to some embodiments;

FIG. 4 illustrates a software configuration diagram in a display device 200 according to some embodiments;

FIG. 5 illustrates a flow chart within a TTML module provided in accordance with some embodiments;

fig. 6 illustrates a schematic diagram of a first subtitle display effect provided in accordance with some embodiments;

fig. 7 illustrates a schematic diagram of a second subtitle display effect provided in accordance with some embodiments;

fig. 8 illustrates a system architecture diagram of a display device 200 provided in accordance with some embodiments;

FIG. 9 illustrates an interaction diagram associated with a TTML module provided in accordance with some embodiments;

FIG. 10 illustrates a schematic diagram of a live application setup interface provided in accordance with some embodiments;

FIG. 11 illustrates a schematic diagram of a live application subtitle setting interface provided in accordance with some embodiments;

FIG. 12 illustrates a flow chart within another TTML module provided in accordance with some embodiments;

FIG. 13 illustrates a flow chart within yet another TTML module provided in accordance with some embodiments;

FIG. 14 illustrates a flowchart of steps performed by a caption display control module provided according to some embodiments;

FIG. 15 illustrates a schematic diagram of a subtitle display personalization set user interface provided in accordance with some embodiments;

fig. 16 illustrates a schematic diagram of a third subtitle display effect provided in accordance with some embodiments;

fig. 17 illustrates a schematic diagram of a fourth subtitle display effect provided in accordance with some embodiments;

fig. 18 illustrates a schematic diagram of a fifth subtitle display effect provided according to some embodiments;

fig. 19 illustrates a schematic diagram of a sixth subtitle display effect provided according to some embodiments;

fig. 20 illustrates a schematic diagram of a seventh subtitle display effect provided according to some embodiments.

Detailed Description

For purposes of clarity and implementation of the present application, the following description will make clear and complete descriptions of exemplary implementations of the present application with reference to the accompanying drawings in which exemplary implementations of the present application are illustrated, it being apparent that the exemplary implementations described are only some, but not all, of the examples of the present application.

It should be noted that the brief description of the terms in the present application is only for convenience in understanding the embodiments described below, and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms first, second, third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The display device provided in the embodiment of the application may have various implementation forms, for example, may be a television, an intelligent television, a laser projection device, a display (monitor), an electronic whiteboard (electronic bulletin board), an electronic desktop (electronic table), and the like. Fig. 1 and 2 are specific embodiments of a display device of the present application.

Fig. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display device 200 through the smart device 300 or the control apparatus 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the display device 200 is controlled by a wireless or wired mode. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc.

In some embodiments, a smart device 300 (e.g., mobile terminal, tablet, computer, notebook, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on a smart device.

In some embodiments, the display device may receive instructions not using the smart device or control device described above, but rather receive control of the user by touch or gesture, or the like.

In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received through a module configured inside the display device 200 device for acquiring voice commands, or the voice command control of the user may be received through a voice control device configured outside the display device 200 device.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and function as an interaction between the user and the display device 200.

As shown in fig. 3, the display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

In some embodiments the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.

The display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, a component for receiving an image signal from the controller output, displaying video content, image content, and a menu manipulation interface, and a user manipulation UI interface.

The display 260 may be a liquid crystal display, an OLED display, a projection device, or a projection screen.

The display 260 further includes a touch screen, and the touch screen is used for receiving an action input control instruction such as sliding or clicking of a finger of a user on the touch screen.

The communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display device 200 may establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.

A user interface, which may be used to receive control signals from the control device 100 (e.g., an infrared remote control, etc.).

The detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; alternatively, the detector 230 includes an image collector such as a camera, which may be used to collect external environmental scenes, user attributes, or user interaction gestures, or alternatively, the detector 230 includes a sound collector such as a microphone, or the like, which is used to receive external sounds.

The external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, or the like. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

The modem 210 receives broadcast television signals through a wired or wireless reception manner, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

The controller 250 controls the operation of the display device and responds to the user's operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments the controller includes at least one of a central processing unit (Central Processing Unit, CPU), video processor, audio processor, graphics processor (Graphics Processing Unit, GPU), RAM Random Access Memory, RAM), ROM (Read-Only Memory, ROM), first to nth interfaces for input/output, a communication Bus (Bus), and the like.

The user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

A "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user, which enables conversion between an internal form of information and a user-acceptable form. A commonly used presentation form of the user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

As shown in fig. 4, the system of the display device is divided into three layers, an application layer, a middleware layer, and a hardware layer, from top to bottom.

The application layer mainly comprises common applications on the television, and an application framework (Application Framework), wherein the common applications are mainly applications developed based on Browser, such as: HTML5 APPs; native applications (Native APPs);

the application framework (Application Framework) is a complete program model with all the basic functions required by standard application software, such as: file access, data exchange, and the interface for the use of these functions (toolbar, status column, menu, dialog box).

Native applications (Native APPs) may support online or offline, message pushing, or local resource access.

The middleware layer includes middleware such as various television protocols, multimedia protocols, and system components. The middleware can use basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, so that the purposes of resource sharing and function sharing can be achieved.

The hardware layer mainly comprises a HAL interface, hardware and a driver, wherein the HAL interface is a unified interface for all the television chips to be docked, and specific logic is realized by each chip. The driving mainly comprises: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

TTML is an XML-based time sequential text markup language. It is intended for use in global cross-caption and subtitle delivery applications, thereby simplifying interoperability and maintaining consistency and compatibility with other subtitle file formats. Because of the characteristics of good compatibility, simple configuration and convenient synchronization of the TTML, the ATSC3.0 broadcasting system breakthroughly introduces the TTML as a caption standard.

In some embodiments, a flow chart internal to the TTML module is shown in fig. 5. The TTML module includes cc_interface (Closed Caption Interface), cc_partner (Caption syntax analysis program), cc_process (Caption Process) and cc_display_control (Caption Display Control module).

After receiving an instruction for starting TTML display, a DM (data manager) sends the acquired first caption fragment data to a caption grammar analysis program, and the caption grammar analysis program analyzes the first caption fragment data to obtain related information of the first caption fragment, wherein the related information comprises caption content, display starting time, display ending time, display characteristics and the like of the first caption fragment. The display characteristics include font type, font size, font transparency, font background, subtitle position, and the like of the subtitle. The display characteristics may be set by default or may be set by user personalization. The caption grammar analysis program preprocesses the first caption fragment data obtained by analysis and sends the first caption fragment data to a caption process, and the caption process sends the preprocessed first caption fragment data to a caption display control module. The preprocessing aims to sort the related information of the first subtitle fragments into a unified data structure and put the unified data structure into a queue, so that the subtitle data can be conveniently transmitted and acquired. And the caption display control module executes related operations with the display of the first caption fragment content after acquiring the preprocessed first caption fragment data. And ending displaying the content of the first subtitle fragments, namely displaying blank content, when the display ending time of the first subtitle fragments is reached.

The data management module sends the acquired second caption fragment data to a caption grammar analysis program, and the caption grammar analysis program analyzes the second caption fragment data to obtain relevant information of the second caption fragment. The caption grammar analysis program preprocesses the second caption fragment data obtained by analysis and sends the second caption fragment data to a caption process, and the caption process sends the preprocessed second caption fragment data to a caption display control module. And when the display start time of the second subtitle fragments is reached, the subtitle display control module executes related operations for displaying the second subtitle fragments and finishes displaying the second subtitle fragments when the display end time of the second subtitle fragments is reached.

However, TTML subtitles are small in fragments, more fragments are transmitted, the fragments are too short in intervals, and the hardware drawing performance cannot be kept up, so that subtitle flickering exists in the rapid multi-fragment transmission display process, and the experience is poor, such as insufficient smoothness of contents. I.e. limited to hardware performance, at least 40ms is required between displaying the blank content and displaying the second subtitle slice content again. If the difference between the display end time of the first subtitle fragment and the display start time of the second subtitle fragment is greater than or equal to 40ms, the display of the first subtitle fragment, the blank and the second subtitle fragment can be normally completed at the designated time. As shown in fig. 6, the content of the first subtitle segment is "beijing", the display time period is 1000ms-3000ms, the content of the second subtitle segment is "Shanghai", the display time period is 3100ms-5100ms, that is, the display blank time is 100ms, and the effects of displaying "beijing" → displaying blank→ displaying "Shanghai" can be completed according to the original time.

If the difference between the display end time of the first subtitle fragment and the display start time of the second subtitle fragment is less than 40ms, as shown in fig. 7, the content of the first subtitle fragment is "beijing", the display time period is 1000ms-3000ms, the content of the second subtitle fragment is "Shanghai", and the display time period is 3001ms-5000ms, that is, the display blank time is 1ms, the effect shown in effect 1 in fig. 7 is supposed to be achieved, but the display blank content according to 1ms is not completed, and only the effect shown in effect 2 in fig. 7 can be achieved. That is, the second subtitle fragment should be displayed at 3001ms, but only at 3040ms, displaying blank content at 3001ms-3040ms may cause subtitle pause for the user, and display is not smooth.

If the first subtitle fragment is in a contextual relationship with the second subtitle fragment, for example: the first subtitle slicing content and the second subtitle slicing content are in a sentence, and the display effect is that the upper half sentence and the lower half sentence suddenly appear a small blank, namely, the sentence is stopped.

If the first subtitle fragment and the second subtitle fragment have the same content, for example: the first subtitle fragment content and the second subtitle fragment content are the same content, the display effect is that the subtitle flashes on the screen, and if a plurality of fragments are the same content continuously, the same content flashes differently on the screen.

In summary, TTML subtitles may have some situations that affect the subtitle display effect due to hardware performance limitation and unreasonable sentence segmentation design of the subtitles, which further results in poor user experience.

In order to solve the above technical problems, the embodiments of the present application provide a display device 200, and the structure and the functions of each part of the display device 200 may refer to the above embodiments. In addition, on the basis of the display device 200 shown in the above embodiment, the present embodiment further improves some functions of the display device 200.

Fig. 8 is a system architecture diagram of the display apparatus 200. The system architecture of the display device 200 includes an Application (APP) layer, a Service (Service) layer, and a Hardware (HAL) layer. The application layer includes Live applications (Live Tv) and television Input channels (Tv Input). TTML subtitles are displayed on top of Live Tv pictures. The application layer is used for interacting with the TTML module to complete TTML display, stop display, setting and switching of display characteristics and the like.

The middleware layer includes a service layer. The service layer is the logical layer of TTML. The DFB (direct_fb, drawing engine module) of the same layer is used as a drawing service for drawing TTML subtitles. The TTML services include DM (data manager, data management module), GFXHAL (GRAPHICS Hardware astract layer, graphics hardware abstraction module) and TTML module at the service layer. The data management module is a TTML data convergence layer and is used for distributing TTML original data. The graphic hardware abstract module is used as a butt joint layer of the TTML subtitle display characteristics and is used for managing the drawing of various TTML lines, characters and rectangles. The TTML module is used for realizing TTML subtitle data analysis, prediction, data processing and display characteristics.

The hardware layer is a TTML display data source layer, and the TTML subtitle fragment data is sourced from the hardware layer. The hardware layer includes Demux (de-multiplexing module), which is a hardware module of the main chip for filtering various types of data, filtering TTML caption fragment data from the code stream, and transmitting the TTML caption fragment data to the data management module.

Fig. 9 is an interaction diagram associated with a TTML module. The TTML module comprises a caption interface, a caption grammar analysis program, a caption process and a caption display control module. The system interaction logic is as follows: livetv is used as a command setting source of the system to control the display and display attribute of the TTML subtitles. The data management module is used as a TTML subtitle data source and is used for inputting subtitle fragment data to the TTML module. The Player acts as a source of TTML synchronization clocks and is responsible for providing TTML synchronization time. The graphics hardware abstraction module is used as a drawing butt joint layer to realize the TTML content drawing display characteristic and is drawn by the drawing engine module. The performance of this part is greatly affected by the hardware.

In some embodiments, the user inputs an instruction to open a live application, wherein the live application is used to play a television live program, particularly an ATSC3.0 program. After the live application is opened, the TTML subtitle function is opened by default, the display device 200 receives the audio and video data and the subtitle fragments data, plays the audio and video data after processing, and displays the contents of the subtitle fragments on the corresponding video data.

In some embodiments, the TTML subtitle function is not turned on by default after the user opens the live application, but rather by setting a TTML subtitle function switch so that the user can choose to turn the TTML subtitle function on or off. Illustratively, the user opens a live application and presses a menu key of the control device 100 to display a user interface as shown in fig. 10, which includes the subtitle control 101. Receiving a user input instruction to select the subtitle control 101, a user interface as shown in fig. 11 is displayed. The user interface of fig. 11 includes a subtitle function control 111, and a user can control the opening or closing of a TTML subtitle function by selecting the subtitle function control 111. When receiving an instruction for starting the user TTML caption function, the caption interface starts TTML caption display.

In some embodiments, as shown in fig. 12, after the caption interface receives an instruction for starting the TTML caption function, the demultiplexing module sends the first caption fragment data filtered from the code stream to the data management module, the data management module sends the first caption fragment data to the caption syntax analysis program, and the caption syntax analysis program analyzes the first caption fragment data to obtain the related information of the first caption fragment. The caption grammar analysis program preprocesses the first caption fragment data obtained by analysis and sends the first caption fragment data to a caption process, and the caption process sends the preprocessed first caption fragment data to a caption display control module. The subtitle display control module performs the subsequent operation.

In the process of displaying the first caption fragment, the de-multiplexing module sends the second caption fragment data filtered from the code stream to the data management module, the data management module sends the second caption fragment data to the caption grammar analysis program, and the caption grammar analysis program analyzes the second caption fragment data to obtain the related information of the second caption fragment. The caption grammar analysis program preprocesses the second caption fragment data obtained by analysis and sends the second caption fragment data to a caption process, and the caption process sends the preprocessed second caption fragment data to a caption display control module. The subtitle display control module performs the subsequent operation.

In some embodiments, as shown in fig. 13, after the caption interface receives an instruction for starting the TTML caption function, the demultiplexing module sends the first caption slice data and the second caption slice data filtered from the code stream to the data management module together, the data management module sends the first caption slice data and the second caption slice data to the caption syntax analysis program, and the caption syntax analysis program analyzes the first caption slice data and the second caption slice data to obtain related information of the first caption slice and the second caption slice. The caption grammar analysis program preprocesses the first caption fragment data and the second caption fragment data which are obtained by analysis and sends the preprocessed first caption fragment data and the preprocessed second caption fragment data to the caption process, and the caption process sends the preprocessed first caption fragment data and the preprocessed second caption fragment data to the caption display control module. The subtitle display control module performs the subsequent operation.

The controller includes a caption display control module, as shown in fig. 14, which performs the steps of:

step S1401: acquiring first content, first display characteristics, first display start time and first display end time of a first subtitle fragment;

the caption display control module can acquire first contents of the first caption fragments from the preprocessed first caption fragment data sent by the caption process, and the first display characteristics, the first display starting time and the first display ending time. Wherein the first display characteristic includes a display position, a font type, a font size, transparency, a subtitle background, and the like of the first content. The display position of the first content may be parsed from the first subtitle fragment data, and the font type, font size, transparency, and subtitle background of the first content may be obtained from the Live Tv user setting file. If the display characteristics obtained by analyzing the first subtitle fragment data are different from the display characteristics set by the user, one of the first subtitle fragment data may be used as a reference. For example: the font type parsed from the first subtitle fragment data is different from the font type set by the user, and may be based on the font type parsed from the first subtitle fragment data or may be based on the font type set by the user.

The user may select to open a setup interface for the display characteristics at the live application setup interface, as shown in fig. 11. The user interface of fig. 11 also includes a caption display personalization control 112, and the user selects the caption display personalization control 112 and presses a confirm key of the control device 100 to display the user interface as shown in fig. 15. The user interface of fig. 15 includes a font type control 151, a font size control 152, a transparency control 153, and a caption background color control 154. The user can modify the display characteristics of the subtitles by selecting the corresponding controls.

Step S1402: when the first display starting time is reached, controlling the display to display the first content according to the first display characteristic;

the subtitle display control module sends the first content and the first display characteristic of the first subtitle fragment to the graphic hardware abstraction module, and the graphic hardware abstraction module sends the first content and the first display characteristic of the first subtitle fragment to the drawing engine module and draws the first content based on the first display characteristic by the drawing engine module.

When the first display start time is reached, the display 260 is controlled to display the first content drawn by the drawing engine module according to the first display characteristic at the position corresponding to the current playing interface.

It should be noted that, the player may perform time synchronization with the caption display control module periodically. Namely, every preset time length, the player sends the current time to the subtitle display control module, and the subtitle display control module calculates the difference value between the current time recorded by the player and the current time sent by the player. If the difference value is larger than the preset synchronous value, the self-recorded time is adjusted according to the time sent by the player so as to ensure the time synchronization of the player and the caption display control module, thereby enabling the audio and video data played by the player to correspond to the caption. If the difference is less than or equal to the preset synchronization value, the correlation operation with the time synchronization is not performed.

Step S1403: acquiring second content, second display characteristics, second display start time and second display end time of a second subtitle fragment;

the subtitle display control module may acquire second contents of the second subtitle fragments from the preprocessed second subtitle fragment data, a second display characteristic, a second display start time, and a second display end time. Wherein the second display characteristic includes a display position, a font type, a font size, transparency, a subtitle background, and the like of the second content.

Step S1404: calculating a difference between the second display start time and the first display end time;

step S1405: judging whether the difference value is smaller than a preset value or not;

the preset value is the time consumption required by hardware in the process of displaying blank and displaying the next caption.

If the difference is greater than or equal to the preset value, step S1406 is executed: when the display end time of the first subtitle fragment is reached, the first content is cleared;

the caption display control module sends an instruction for clearing the first content to the drawing engine module through the graphic hardware abstraction module, and the drawing engine module clears the first content, namely, displays blank content.

Step S1407: and controlling the display to display the second content according to the second display characteristic.

The subtitle display control module sends the second content and the second display characteristic of the second subtitle fragment to the graphic hardware abstraction module, and the graphic hardware abstraction module sends the second content and the second display characteristic of the second subtitle fragment to the drawing engine module and draws the second content and the second display characteristic of the second subtitle fragment by the drawing engine module. And when the second display starting time is reached, controlling the display 260 to display second content drawn by the drawing engine module according to the second display characteristic at the position corresponding to the current playing interface.

In some embodiments, obtaining a third content, a third display characteristic, a third display start time, and a third display end time of a third subtitle fragment;

and calculating a difference value between the third display starting time and the second display ending time, and determining the time for displaying the third subtitle fragment content according to the difference value.

In some embodiments, if the difference is smaller than a preset value, the display is controlled to display second content according to the second display characteristic when the display end time of the first subtitle fragment is reached.

The subtitle display control module sends the second content and the second display characteristic of the second subtitle fragment to the graphic hardware abstraction module, and the graphic hardware abstraction module sends the second content and the second display characteristic of the second subtitle fragment to the drawing engine module and draws the second content and the second display characteristic of the second subtitle fragment by the drawing engine module. And when the display end time of the first subtitle fragment is reached, controlling the display 260 to display the second content drawn by the drawing engine module according to the second display characteristic at the position corresponding to the current playing interface.

For example, as shown in fig. 16, if the content of the first subtitle fragment is beijing, the display period is 1000ms-3000ms, the content of the second subtitle fragment is Shanghai, the display period is 3100ms-5100ms, the difference value=3100-3000=100 ms, and since 100ms > 40ms, the content of the second subtitle fragment is displayed at 3100 ms. As shown in effect 2 in fig. 16, the subtitle display effect is: display "Beijing" →display blank→display "Shanghai →"

If the content of the first subtitle fragment is Beijing, the display time period is 1000ms-3000ms, the content of the second subtitle fragment is Shanghai, the display time period is 3001ms-5000ms, and the preset value is 40ms. The difference=3001-3000=1 ms, since 1ms < 40ms, the content of the second subtitle slice is displayed at 3000 ms. As shown in effect 1 in fig. 16, the subtitle display effect is: "Beijing" → "Shanghai" is shown.

When the difference is smaller than the preset value, the above embodiment simply removes the display of the blank content, which results in some display characteristics of TTML, for example: translation display, sentence breaking display, etc. are destroyed.

In some embodiments, if the difference is less than the preset value, step S1408 is performed: judging whether the first content is identical to the second content;

in some embodiments, if the first content is the same as the second content, when the first display end time is reached, the display 260 is controlled to display the second content drawn by the drawing engine module according to the second display characteristic at the position corresponding to the current playing interface.

If the first content is different from the second content, when the display end time of the first subtitle fragment is reached, the subtitle display control module sends an instruction for clearing the first content to the drawing engine module through the graphic hardware abstraction module, and the drawing engine module clears the first content, namely, displays blank content;

And when the display start time of the second subtitle fragment is reached, controlling the display 260 to display the second content drawn by the drawing engine module according to the second display characteristic at the position corresponding to the current playing interface.

As shown in fig. 17, the content of the first subtitle segment is "beijing", the display time period is 1000ms-3000ms, the content of the second subtitle segment is "beijing", the display time period is 3001ms-5000ms, and the preset value is 40ms. The difference=3001-3000=1 ms, and since 1ms < 40ms and the contents of the first subtitle slice and the second subtitle slice are the same as "beijing", the contents of the second subtitle slice are displayed at 3000 ms. As shown in effect 1 in fig. 17, the subtitle display effect is: "Beijing" → "Beijing" is displayed.

The content of the first subtitle fragments is Beijing, the display time period is 1000ms-3000ms, the content of the second subtitle fragments is Shanghai, the display time period is 3001ms-5000ms, and the preset value is 40ms. The difference=3001-3000=1 ms, and since 1ms < 40ms but the contents of the first subtitle slice and the second subtitle slice are different, a blank is displayed at 3000ms, and the contents of the second subtitle slice is displayed at 3040 ms. As shown in effect 2 in fig. 17, the subtitle display effect is: "Beijing" → "blank" → "Shanghai" is displayed.

According to the embodiment of the invention, the hardware performance limited time is taken as the partitioning point, when the fact that the adjacent caption partitioning difference value is smaller than the preset value is determined, the judgment of whether the display content is the same is further added, and only when the adjacent caption partitioning content is the same, redundant blank display is not needed to be inserted, and when the adjacent caption partitioning content is different, the effect of displaying the blank is still reserved, so that the effects of TTML sentence-breaking display and the like are not destroyed.

In some embodiments, if the first content is the same as the second content, step S1409 is performed: judging whether the first display characteristic is the same as the second display characteristic;

the display characteristics include a display position, a font type, a font size, transparency, a subtitle background, and the like, and the first display characteristic being the same as the second display characteristic may refer to a case where information such as the display position, the font type, the font size, the transparency, the subtitle background, and the like is the same. The first display characteristic may be the same as the second display characteristic, and may be at least one of information specifying a display position, a font type, a font size, transparency, and a subtitle background. For example: as long as the first display characteristic is the same as the display position in the second display characteristic, the first display characteristic is determined to be the same as the second display characteristic.

If the first display characteristic is the same as the second display characteristic, step S1410 is performed: and when the first display end time is reached, controlling the display to display second content according to the second display characteristic.

If the first display characteristic is different from the second display characteristic, step S1406 is executed, in which, when the display end time of the first subtitle fragment is reached, the subtitle display control module sends an instruction for clearing the first content to the drawing engine module through the graphic hardware abstraction module, and the drawing engine module clears the first content, that is, displays blank content;

As shown in fig. 18, the content of the first subtitle segment is "beijing", the display time period is 1000ms-3000ms, the content of the second subtitle segment is "beijing", the display time period is 3001ms-5000ms, and the preset value is 40ms. The difference=3001-3000=1 ms, and since 1ms < 40ms and the display positions of the first subtitle slice and the second subtitle slice are the same, the content of the second subtitle slice is displayed at 3000 ms. As shown in effect 1 in fig. 18, the subtitle display effect is: "Beijing" → "Beijing" is displayed.

The content of the first subtitle fragments is Beijing, the display time period is 1000ms-3000ms, the content of the second subtitle fragments is Beijing, the display time period is 3001ms-5000ms, and the preset value is 40ms. The difference=3001 to 3000=1 ms, and since 1ms < 40ms but the display positions of the first subtitle slice and the second subtitle slice are different, a blank is displayed at 3000ms, and the content of the second subtitle slice is displayed at 3040 ms. As shown in effect 2 in fig. 18, the subtitle display effect is: "Beijing" → "blank" → "Beijing" is displayed.

According to the method and the device, the judgment of whether the display characteristics are the same is further added under the condition that the adjacent fragments are the same in content, and when the adjacent subtitle fragments are the same in display characteristics, redundant blank display is not needed to be inserted, and when the adjacent subtitle fragments are different in display characteristics, the blank display effect is still reserved, so that the effects such as TTML translation display are not destroyed.

In some embodiments, if the first content is not the same as the second content, step S1411 is performed: judging whether the first content and the second content have an association relation or not;

in some embodiments, the step of determining whether the first content and the second content have an association relationship includes:

Judging whether the first content ends with a sentence end punctuation mark;

Wherein, the end punctuation mark comprises a period, a question mark, an exclamation mark, an ellipsis mark and the like. Punctuation marks in sentences include commas, dashes, semicolons, colon, double quotations, single quotations, and the like.

Exemplary, if the first content is acquired as "today weather is good-! "," where does you intend to go? "" I have completed My tasks today. Pandas, tigers and lions … … "are included in the zoo. When the first content is identified. "? ", I! Or … … is ending, it is determined that the first content does not have an association with the second content. If the first content is obtained as "I just see a child," "you do so simply by touching the stone with an egg" "" little red say: "" today mainly says the following three points: "" first point is to pay attention to hygiene; or "Critical to create City civilization". When the first content is identified as "," - ",": ""; and if the word is ending, determining that the first content and the second content have an association relationship.

In some embodiments, if the first content has an association relationship with the second content, that is, the association flag of the first content with the first subtitle fragment is set to 1, and if the first content does not have an association relationship with the second content, the association flag of the first subtitle fragment is set to 0.

The step of judging whether the first content and the second content have an association relationship or not includes:

judging whether the associated flag bit of the first subtitle fragment is 1,

if the association flag bit of the first subtitle fragment is 1, determining that the first content and the second content have an association relationship;

and if the association flag bit of the first subtitle fragment is not 1, determining that the first content and the second content do not have an association relationship.

If the first content has an association relationship with the second content, step S1410 is executed, in which, when the display end time of the first subtitle segment is reached, the display 260 is controlled to display the second content drawn by the drawing engine module according to the second display characteristic at the position corresponding to the current playing interface.

If the first content and the second content do not have an association relationship, step S1406 is executed, in which, when the display end time of the first subtitle fragment is reached, the subtitle display control module sends an instruction for clearing the first content to the drawing engine module through the graphic hardware abstraction module, and the drawing engine module clears the first content, that is, displays blank content;

Illustratively, as shown in fig. 19, the first subtitle fragment has the content of "i just see a child," and the display period is 1000ms-3000ms, and the second subtitle fragment has the content of "she pulls a lovely dog. ", the display time period is 3001ms-5000ms, and the preset value is 40ms. The difference=3001-3000=1 ms, and since 1ms < 40ms and the first subtitle slice and the second subtitle slice have an association relationship, the second subtitle slice is displayed at 3000 ms. As shown in effect 1 in fig. 19, the subtitle display effect is: display "I just see a child," → "show" she is pulling an lovely dog. ".

The content of the first subtitle clip is "today's weather fine". The display time period is 1000ms-3000ms, and the content of the second subtitle fragment is tomorrow weather. ", the display time period is 3001ms-5000ms, and the preset value is 40ms. The difference=3001-3000=1 ms, since 1ms < 40ms but the contents of the first subtitle slice and the second subtitle slice have no association. Therefore, a blank is displayed at 3000ms, and the content of the second subtitle slice is displayed at 3040 ms. As shown in effect 2 in fig. 19, the subtitle display effect is: showing "today's weather is sunny". "→show blank→show" open day weather. "

According to the method and the device, under the condition that adjacent segmented contents are different, judgment of the relevance of the adjacent segmented contents is further increased, redundant blank display is not needed to be inserted only when the adjacent subtitle segmented contents have the relevance, and when the adjacent subtitle segmented contents do not have the relevance, the effect of displaying the blank is still reserved, so that effects such as TTML sentence-breaking display are not destroyed.

In some embodiments, "when the first display end time is reached," controlling the display to display second content according to the second display characteristic "may be replaced with" when the second display start time is reached, "controlling the display to display second content according to the second display characteristic. "

The content of the first subtitle fragment is "Beijing", the display time period is 1000ms-3000ms, the content of the second subtitle fragment is "Shanghai", the display time period is 3001ms-5000ms, and the preset value is 40ms. The difference=3001-3000=1 ms, since 1ms < 40ms, the content of the second subtitle slice is displayed at 3001 ms. As shown in fig. 20, the subtitle display effect is: "Beijing" → "Shanghai" is shown.

Some embodiments of the present application provide a subtitle display method, the method being applicable to a display device including a display and a controller configured to: acquiring first content, first display characteristics and display ending time of a first subtitle fragment; controlling the display to display the first content according to the first display characteristic; acquiring second content, second display characteristics and display starting time of a second subtitle fragment; calculating a difference between the display start time and the display end time; and if the difference value is smaller than a preset value, controlling the display to display second content according to the second display characteristic when the display ending time is reached. When the display time interval of two adjacent fragments is shorter, blank content can not be displayed, the content of the next fragment can be directly displayed, subtitle flickering is avoided, the content is not smooth enough, and user experience is improved.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A display device, characterized by comprising:

a display;

a controller configured to:

2. The display device of claim 1, wherein the controller, when the first display end time is reached, to control the display to display second content according to the second display characteristic, is further configured to:

judging whether the first content is identical to the second content;

3. The display device of claim 2, wherein the controller is configured to:

4. The display device of claim 2, wherein the controller is configured to:

5. The display device of claim 4, wherein the controller performing determining whether the first content has an association with the second content is further configured to:

Judging whether the first content ends with a sentence end punctuation mark;

6. The display device of claim 1, wherein the controller, when the first display end time is reached, to control the display to display second content according to the second display characteristic, is further configured to:

judging whether the first content is identical to the second content;

7. The display device of claim 1, wherein the controller is configured to:

8. A subtitle display method, comprising:

9. The method of claim 8, wherein the step of controlling the display to display second content according to the second display characteristic when the first display end time is reached comprises:

Judging whether the first content is identical to the second content;

10. The method of claim 8, wherein the method further comprises: