CN117615199A

CN117615199A - Subtitle display method and display equipment

Info

Publication number: CN117615199A
Application number: CN202310946289.5A
Authority: CN
Inventors: 卢平光
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2023-07-28
Filing date: 2023-07-28
Publication date: 2024-02-27

Abstract

The embodiment of the application discloses a subtitle display method and a display device, wherein when first video data transmitted by a signal source device are received, a first player is started to acquire a first aspect ratio of the first video data; if the first aspect ratio is larger than the aspect ratio of the display device, starting the second player, and controlling the second player to acquire first subtitle data matched with the first video data from the external storage device; controlling a first player to create a first window according to the first aspect ratio, and displaying first video data in the first window, wherein the height of the first window is smaller than the height of a screen; and controlling the second player to create a second window between the first window and the screen frame, and displaying the first subtitle data in the second window. According to the embodiment of the application, independent control and separate display of the wide-view video and the caption are realized, the caption does not cover video content, caption data can be displayed by fully utilizing a black area, and the display effect of a picture and the watching experience of a user are improved.

Description

Subtitle display method and display equipment

Technical Field

The present disclosure relates to the field of software technologies, and in particular, to a subtitle display method and a display device.

Background

The display apparatus may be connected to the signal source apparatus through an external device interface (e.g., HDMI), and the signal source apparatus may include a DVD, a computer, etc., so that the display apparatus may receive and display video data transmitted by the signal source apparatus.

The display device has a fixed aspect ratio (e.g., 16:9), the signal source device may transmit wide-view video having an aspect ratio greater than the aspect ratio, e.g., the wide-view video may have an aspect ratio of 21:9, 32:9, etc. Thus, the display device side needs to generate a video playing window adapting to the aspect ratio of the wide-view video, video data sent by the display signal source device is loaded in the video playing window, and the film source subtitle information is displayed in the video playing window in a superposition manner with the video data. In the wide-view video playing scene, the height of the video playing window is smaller than the screen height, the area outside the video playing window is set to be background color, for example, the area is commonly called as a black edge when the area is set to be black, and the display effect of the video playing interface for users to watch is poor.

Disclosure of Invention

The embodiment of the application provides a caption display method and display equipment, when the display equipment receives a wide-view video transmitted by signal source equipment, a first player is controlled to display the wide-view video in a first window, a second player is controlled to display caption data of the wide-view video in a second window, the display of the wide-view video and the caption data is independently controlled by different players, and the wide-view video and the caption data are separately displayed in different windows, wherein the caption data occupy a black area, namely, the coverage of the caption data to video content is avoided, the caption data can be displayed by fully utilizing the black area, and the display effect and the user watching experience of pictures are improved.

In a first aspect, an embodiment of the present application provides a display device, including:

a display;

an external device interface including a first interface for connecting a signal source device for transmitting video data to a display device and a second interface for connecting an external storage device for storing subtitle data;

a controller for performing:

starting a first player when receiving first video data transmitted by the signal source equipment, and acquiring a first aspect ratio of the first video data;

if the first aspect ratio is larger than the aspect ratio of the display device, starting a second player, and controlling the second player to acquire first subtitle data matched with the first video data from the external storage device;

controlling the first player to create a first window according to the first aspect ratio, and controlling a display to display the first video data in the first window; wherein the height of the first window is smaller than the height of the screen;

and controlling the second player to create a second window between the first window and the screen frame, and controlling a display to display the first subtitle data in the second window.

In some embodiments, after starting the first player, the controller is further configured to perform: and acquiring media description information from a transmission protocol of the first interface, wherein the media description information comprises the first aspect ratio and content type information set by the signal source device, the content type information is used for indicating the content type of data transmitted by the signal source device, and the content type comprises a no-data type, a movie type and a game type.

In some embodiments, before starting the second player, the controller is further configured to perform: if the content type is not the movie type, not starting the second player; starting the second player when the content type is changed to the movie type; wherein the movie type is set by the source device when the first video data starts playing.

In some embodiments, after starting the second player, the controller is further configured to perform: and closing the second player and the second window when the content type is detected to be changed into a non-film type, and not displaying the subtitle data in the external storage device.

In some embodiments, the controller is further configured to perform: when the first player plays the first video data, acquiring a play time stamp of the first video data; and controlling the second player to synchronously control the display of the first subtitle data according to the play starting time stamp.

In some embodiments, the controller is further configured to perform: controlling the first player to detect the playing state of the first video data; when detecting that the continuous multi-frame video frames in the first window are unchanged, sending a pause instruction to the second player; the pause instruction comprises a pause time stamp, and the pause instruction is used for instructing the second player to pause playing the first subtitle data; and when detecting that two adjacent frames of video pictures in the first window change, sending a play resuming instruction to the second player, wherein the play resuming instruction is used for indicating the second player to continue playing the first subtitle data at the subtitle frame corresponding to the pause timestamp.

In some embodiments, the controller is further configured to perform: when the second player inquires that the external storage device comprises a plurality of subtitle data, controlling a display to display a subtitle list page, wherein the subtitle list page comprises subtitle information mapped by the plurality of subtitle data contained in the external storage device; and controlling the second player to acquire first subtitle data mapped by the target subtitle information from the external storage device in response to the operation of selecting the target subtitle information in the subtitle list page by a user.

In some embodiments, the controller is further configured to perform: when the second player inquires that the external storage equipment does not comprise the subtitle data, the display is controlled to display first prompt information, and the first prompt information is used for prompting a user to import first subtitle data matched with the first video data into the external storage equipment.

In some embodiments, the controller is further configured to perform: controlling the display to display a time stamp setting page in response to a first operation of clicking the synchronous correction button by a user; the synchronization correction button is a button arranged in the second window by the second player, and the first operation is an operation input by a user when the playing delay of the first subtitle data lagging behind the first video data is larger than a preset threshold; receiving a target timestamp input by a user through the timestamp setting page; and controlling the second player to play the first subtitle data according to the target time stamp so as to reduce or eliminate the play delay.

The embodiment of the application also provides a subtitle display method, which comprises the following steps:

starting a first player when receiving first video data transmitted by a signal source device, and acquiring a first aspect ratio of the first video data;

If the first aspect ratio is larger than the aspect ratio of the display device, starting a second player, and controlling the second player to acquire first subtitle data matched with the first video data from an external storage device;

controlling the first player to create a first window according to the first aspect ratio, and displaying the first video data in the first window; wherein the height of the first window is smaller than the height of the screen;

and controlling the second player to create a second window between the first window and the screen frame, and displaying the first subtitle data in the second window.

In a third aspect, embodiments of the present application further provide a computer-readable storage medium having stored therein program instructions that, when run on a computer, cause the computer to perform the methods involved in the above aspects and their respective implementations.

In the embodiment of the application, aiming at the scene of overlapping display of the wide-view video and the caption and invalid display of the 'black side' area, different players are utilized to independently control display of the wide-view video and the caption data, wherein a first player generates a first window according to the aspect ratio of the wide-view video, and controls the first window to only display the wide-view video and not display the caption; the second player generates a second window in the black area, and controls the second window to display the plug-in subtitle acquired from the external storage device, so that the separation display of the wide-view video and the subtitle data is realized through different windows. On one hand, no interference and conflict exist between the first window and the second window, the caption data does not cover the video content, a user can browse a video picture without the caption in the first window, and on the other hand, an invalid black edge area has availability so as to present the externally hung caption synchronous with the video, thereby improving the display effect of the picture and the watching experience of the user.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is an operation scenario between a display device and a control apparatus 100 provided in some embodiments of the present application;

fig. 2 is a block diagram of a hardware configuration of a control device 100 according to some embodiments of the present application;

fig. 3 is a block diagram of a hardware configuration of a display device 200 provided in some embodiments of the present application;

fig. 4 is a software configuration diagram of a display device 200 according to some embodiments of the present application;

fig. 5 is a schematic diagram of a display device according to some embodiments of the present application displaying a wide-angle video;

fig. 6 is a flowchart of a subtitle display method according to some embodiments of the present application;

fig. 7 is a schematic diagram two of a display device according to some embodiments of the present application for displaying a wide-angle video;

fig. 8 is a schematic diagram III of a display device according to some embodiments of the present application for displaying wide-angle video;

FIG. 9 is an interaction logic diagram of a first player and a second player according to some embodiments of the present application;

FIG. 10 is a schematic diagram of a user interface for delay compensation by a user according to some embodiments of the present application;

FIG. 11 is a schematic diagram of a user interface displayed by a display device when an external storage device provided in some embodiments of the present application does not have a subtitle file;

fig. 12 is a schematic diagram of a display device displaying a subtitle list page according to some embodiments of the present application.

Detailed Description

For the purposes of making the objects, technical solutions and advantages of the exemplary embodiments of the present application more apparent, the technical solutions in the exemplary embodiments of the present application will be clearly and completely described below with reference to the drawings in the exemplary embodiments of the present application, and it is apparent that the described exemplary embodiments are only some embodiments of the present application, but not all embodiments.

All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present application, are intended to be within the scope of the present application based on the exemplary embodiments shown in the present application. Furthermore, while the disclosure has been presented in terms of an exemplary embodiment or embodiments, it should be understood that various aspects of the disclosure can be practiced separately from the disclosure in a complete subject matter.

It should be understood that the terms "first," "second," "third," and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate, such as where appropriate, for example, implementations other than those illustrated or described in accordance with embodiments of the present application.

Furthermore, the terms "comprise" and "have," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to those elements expressly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The display device provided in the embodiment of the application may have various implementation forms, for example, may be a television, an intelligent television, a laser projection device, a display (monitor), an electronic whiteboard (electronic bulletin board), an electronic desktop (electronic table), and the like. Fig. 1 and 2 are specific embodiments of a display device of the present application.

Fig. 1 is a schematic diagram of an operation scenario between a display device and a control device provided in an embodiment of the present application. As shown in fig. 1, a user may operate the display device 200 through the smart device 300 or the control apparatus 100.

In some implementations, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or bluetooth protocol communication, and other short-range communication methods, and the display device 200 is controlled by a wireless or wired method. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc.

In some implementations, the smart device 300 (e.g., mobile terminal, tablet, computer, notebook, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on a smart device.

In some implementations, the display device may not receive instructions using the smart device or control device described above, but rather receive control of the user by touch or gesture, or the like.

In some implementations, the display device 200 may also perform control in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received through a module configured inside the display device 200 device for acquiring a voice command, or the voice command control of the user may be received through a voice control apparatus configured outside the display device 200 device.

In some implementations, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

Fig. 2 is a block diagram of a configuration of a control device 100 according to an embodiment of the present application. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and function as an interaction between the user and the display device 200.

Fig. 3 is a hardware configuration block diagram of a display device 200 provided in an embodiment of the present application. As shown in fig. 3, the display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

In some implementations the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.

The display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, a component for receiving an image signal from the controller output, displaying video content, image content, and a menu manipulation interface, and a user manipulation UI interface.

The display 260 may be a liquid crystal display, an OLED display, a projection device, or a projection screen.

The communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

A user interface, which may be used to receive control signals from the control device 100 (e.g., an infrared remote control, etc.).

The detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; alternatively, the detector 230 includes an image collector such as a camera, which may be used to collect external environmental scenes, user attributes, or user interaction gestures, or alternatively, the detector 230 includes a sound collector such as a microphone, or the like, which is used to receive external sounds.

The external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

In some embodiments, the display apparatus may be connected to the signal source apparatus through a first interface (e.g., HDMI) of the external device interfaces, and to the external storage apparatus through a second interface (e.g., USB) of the external device interfaces. The signal source device is used for transmitting the video signal to be displayed to the display device, and the signal source device includes, but is not limited to, a DVD (Digital Video Disc ), a computer, and the like. The external storage device is used for storing files and data, and the display device can read and write the external storage device through the second interface, and the external storage device comprises but is not limited to: USB flash disk, mobile hard disk, card reader, etc.

The modem 210 receives broadcast television signals through a wired or wireless reception manner, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some implementations, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the host device in which the controller 250 is located, such as an external set-top box or the like.

The controller 250 controls the operation of the display device and responds to the user's operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some implementations, the controller includes at least one of a central processing unit (Central Processing Unit, CPU), a video processor, an audio processor, a graphics processor (Graphics Processing Unit, GPU), RAM Random Access Memory, RAM), ROM (Read-Only Memory, ROM), first to nth interfaces for input/output, a communication Bus (Bus), and the like.

The user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

A "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user, which enables conversion between an internal form of information and a user-acceptable form. A commonly used presentation form of the user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

Fig. 4 is a software configuration diagram of a display device 200 according to an embodiment of the present application. As shown in fig. 4, in some implementations, the system is divided into four layers, from top to bottom, an application layer (application layer), an application framework layer (Application Framework layer), a An Zhuoyun row (Android run) and a system library layer (system runtime layer), and a kernel layer, respectively.

In some implementations, at least one application program is running in the application program layer, where the application programs may be a Window (Window) program of an operating system, a system setup program, or a clock program, etc.; or may be an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.

The framework layer provides an application programming interface (application programming interface, API) and programming framework for the application. The application framework layer includes a number of predefined functions. The application framework layer corresponds to a processing center that decides to let the applications in the application layer act. Through the API interface, the application program can access the resources in the system and acquire the services of the system in the execution.

As shown in fig. 4, the application framework layer in the embodiment of the present application includes a manager (manager), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used to interact with all activities that are running in the system; a Location Manager (Location Manager) is used to provide system services or applications with access to system Location services; a Package Manager (Package Manager) for retrieving various information about an application Package currently installed on the device; a notification manager (Notification Manager) for controlling the display and clearing of notification messages; a Window Manager (Window Manager) is used to manage bracketing icons, windows, toolbars, wallpaper, and desktop components on the user interface.

In some implementations, an activity manager is used to manage the lifecycle of the individual applications as well as the usual navigation rollback functions, such as controlling the exit, opening, fallback, etc. of the applications. The window manager is used for managing all window programs, such as obtaining the size of the display screen, judging whether a status bar exists or not, locking the screen, intercepting the screen, controlling the change of the display window (for example, reducing the display window to display, dithering display, distorting display, etc.), etc.

In some implementations, the system runtime layer provides support for an upper layer, the framework layer, and when the framework layer is used, the android operating system runs the C/C++ libraries contained in the system runtime layer to implement the functions to be implemented by the framework layer.

In some implementations, the kernel layer is a layer between hardware and software. As shown in fig. 4, the kernel layer contains at least one of the following drivers: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

For devices of the same or similar hardware and software configuration as the display devices described above, having a fixed aspect ratio, the aspect ratio may typically be set to 16:9. When a video is taken or recorded on a carrier such as an optical disc, the first aspect ratio of the video may be larger than the aspect ratio of the display device, and such video may be referred to as "wide view video", e.g., the first aspect ratio is 21:9, 32:9, etc.

In some embodiments, to adapt the display device side to display the wide-view video, the signal source device may convert the first aspect ratio of the wide-view video to an aspect ratio, and then output a video signal to the display device according to the aspect ratio; the display device receives the video signal and displays the video signal in terms of the aspect ratio. When the video width is equal to the screen width and the height of the wide-view video is smaller than the screen height, the signal source device can set filling data with a certain height on the upper side and the lower side of the wide-view video, so that the sum of the height of the filling data and the height of the video is equal to the screen height, the filling data can be a solid-color picture, if the solid-color picture is set to be black, the filling data are presented as black edges, and the display device can take the black edges as a part of video signals in the scene, namely, the display device cannot sense that the black edges are invalid areas filled by the signal source device.

In some embodiments, the signal source device may output a video signal to the display device according to the first aspect ratio, so that after the display device receives the wide-view video, a video playing window adapted to the wide-view video is generated, a width of the video playing window may be equal to a screen width and a height of the video playing window is smaller than the screen height, a region between the video playing window and a frame of the screen may display a solid background image, and when the solid background image is black, a black border region is formed. The display device can clearly distinguish which part of the screen is a video playing window and which is a black area.

Fig. 5 is a schematic diagram of a display device according to some embodiments of the present application displaying a wide-angle video. Referring to fig. 5, a video playing interface 50 includes a video playing area 51 and a black border area 52. The video playing area 51 is an area for effectively playing video with a wide angle of view, and the black area 52 is an unused area. The video playing area 51 may be centrally displayed in a longitudinal direction such that both upper and lower sides of the video playing area 51 have black side areas 52 of equal height.

In some embodiments, when playing video, the subtitle type may include an embedded subtitle, a plug-in subtitle, and so on, often accompanied by synchronous presentation of the subtitle. The embedded subtitle refers to a subtitle which is embedded in the video, so that the display device does not need to download subtitle data when downloading the video. The external subtitle (srt format subtitle) refers to a subtitle which is not embedded into a video, namely, a video file and a subtitle file are separated, a user can pre-guide the subtitle file to be displayed into an external storage device, the display device reads the subtitle file to be displayed from the external storage device when playing the video, and synchronous playing of the video and the external subtitle is realized according to a time stamp alignment principle. Referring to fig. 5, the display apparatus superimposes caption information 511 at a preset position (e.g., bottom of picture) on a video picture within a video play area 51 after parsing a caption file. This subtitle display mode has at least the following problems:

Problem one: the caption information is displayed on the video picture in a superimposed manner, so that a partial region of the video picture can be covered, and the video watching effect of a user is affected, for example, key contents in the video are blocked by the caption.

And a second problem: the video playing interface is provided with the black edge area 52, the black edge area 52 does not display video or other contents, a user can perceive the division of the video playing area 51 and the black edge area 52, especially when the conditions of brighter video pictures, larger color saturation and the like occur, the black edge area 52 is more abrupt, the display effect of the video playing interface is poor, and the user viewing experience is affected.

To solve the first and second problems, an embodiment of the present application provides a subtitle display method, referring to fig. 6, which may be executed by the controller 250, including the steps of:

step S61, when receiving the first video data transmitted by the source device, starting the first player to obtain the first aspect ratio of the first video data.

In some embodiments, the display device may be connected to the signal source device through a first interface, such as HDMI. And after the cable of the signal source equipment is correctly connected to the first interface and the signal source equipment is started, the first video data can be transmitted to the display equipment.

In some embodiments, the display device may obtain media description information (AVI Info) from a transmission protocol (e.g., HDMI protocol) of the first interface, where the AVI Info may include a first aspect ratio instance of the first video data. As used herein, "aspect ratio" refers to the ratio of width to height, e.g., a first aspect ratio is the ratio of the width to height of a video frame and an aspect ratio is the ratio of the width to height of a display device screen.

In some embodiments, the display device is configured with a first player, the first player being associated with at least the first interface, the first player being configured to play control of the first video data transmitted by the signal source device, including but not limited to: after receiving the first video data, invoking a decoder to decode the first video data, creating a first window to display the decoded first video data, and executing operations such as playing, pausing playing, resuming playing and the like on the first video data.

Step S62, determining that the first aspect ratio is greater than the aspect ratio of the display device.

The first aspect ratio case is not smaller than the aspect ratio case, and the step S62 is performed for determining whether the signal source device is currently transmitting the wide view video. If the first aspect ratio is greater than the aspect ratio, indicating that the signal source device is currently transmitting wide view video, then step S63 is performed; if the first aspect ratio case is equal to the aspect ratio case, indicating that the aspect ratio case of the first video data is adapted to the screen of the display device, step S66 is performed.

Step S63, the second player is started, and the second player is controlled to acquire first subtitle data matched with the first video data from the external storage device.

In some embodiments, the display device may be connected to the external storage device through a second interface, such as USB. After the cable of the external storage device is correctly connected to the second interface, the display device can perform read-write operation on the external storage device. The external storage device may store first subtitle data, which is a plug-in subtitle type.

In some embodiments, the display device is further configured with a second player, the second player being associated with the second interface, the second player being configured to read the first subtitle data from the external storage device and play control the first subtitle data, including but not limited to: after receiving the first caption data, analyzing the first caption data, creating a second window to display the first caption data, controlling the caption to be synchronous with the video playing, and executing operations such as playing, pausing playing, resuming playing and the like on the first caption data.

Step S64, the first player is controlled to create a first window according to the first aspect ratio, and the display is controlled to display the first video data in the first window. Wherein the height of the first window is less than the screen height.

Step S65, the second player is controlled to create a second window between the first window and the screen frame, and the display is controlled to display the first subtitle data in the second window.

In some embodiments, when the first player creates the first window according to the first aspect ratio, the width of the first window may be set equal to the screen width, and the height of the first window is smaller than the screen height, so as to ensure that the video frame can be completely displayed in the screen. Thus, there is a remaining area between the first window and the screen frame, assuming that the screen area is R ₁ The area of the first window is R ₂ The residual area is R ₃ Then there is R ₃ ＝R ₁ -R ₂ The remaining area is actuallyIs a so-called "black-sided" area, and the second player may create and display a second window in the remaining area and display the first subtitle data in the second window. The size and display position of the second window are not limited, and may be set with reference to the remaining area.

Fig. 7 is a schematic diagram of a display device according to some embodiments of the present application for displaying a wide-angle video. As shown in fig. 7, in the video playing interface, the first window 71 may be displayed centrally in the longitudinal direction or slightly offset from the lateral center line of the screen, so that two residual areas are formed between the first window 71 and the frame of the screen, including a first residual area 721 between the first window 71 and the frame of the screen, and a second residual area 722 between the first window 71 and the frame of the screen. The second player may display the second window 73 in the first or second residual area 721 or 722, and fig. 7 illustrates a scene in which subtitles are displayed in the second residual area 722.

Fig. 8 is a schematic diagram III of a display device according to some embodiments of the present application for displaying a wide-angle video. As shown in fig. 8, in the video playing interface, the upper edge of the first window 71 may coincide with the upper screen frame, or the lower edge of the first window 71 may coincide with the lower screen frame, so that only a single remaining area 72 is formed between the first window 71 and the screen frame, and the second player may display the second window 73 in the remaining area 72. The display layout of the first window 71 and the second window 72 is not limited to the embodiment of the present application.

In some embodiments, the second player is further configured to set and adjust a display style of subtitle text in the second window, where the display style includes, but is not limited to: fonts, font sizes, fonts, colors, character special effects and the like, so that the subtitles are not limited to monotone fixed patterns, and a better subtitle browsing effect is provided for users. The second player is also used to set the background color of the second window, e.g., the background color of the second window may be solid (e.g., white, black, etc.) or colored.

In some embodiments, when the first player plays the first video data, the controller may obtain a play time stamp of the first video data, where the play time stamp may be a time stamp corresponding to a video frame (for example, a first frame), so that the controller may control the second player to locate to a start subtitle frame corresponding to the play time stamp, and play the first subtitle data from the start subtitle frame, so as to realize synchronous play of the wide-view video and the plug-in subtitle, and since the relative time of the subsequent video and the subtitle is consistent, real-time synchronicity of the video and the subtitle on a play time axis can be maintained, and the problem that the subtitle and the video content are not matched is avoided.

In step S66, the first player is controlled to display the first video data on the video playing interface, and the first subtitle data is displayed in an overlapping manner on the video playing interface.

In some embodiments, the first player may display the first video data on the entire screen of the video playback interface when the first aspect ratio is equal to the aspect ratio, and the controller may detect whether subtitles are included in the first video data. If the first video data includes subtitles, that is, the first subtitle data is of an embedded subtitle type, the controller may control the first player to play the first video data, and automatically display the first subtitle data synchronously in an overlapping manner on the video playing interface. If the first video data does not include subtitles, the first player may read the first subtitle data from the external storage device, that is, the first subtitle data is of a plug-in subtitle type, and then overlay-display the plug-in first subtitle data on the video playing interface. The effect of displaying the subtitle overlaid on the video picture in step S66 may be referred to as an example of fig. 5.

Aiming at a scene of invalid display in a black area of overlapping display of a wide-view video and a caption, the embodiment of the application independently controls display of the wide-view video and caption data by using different players, wherein a first player generates a first window according to a first aspect ratio example of the wide-view video, and controls the first window to only display the wide-view video and not display the caption; the second player generates a second window in the residual area, and controls the second window to display the plug-in subtitles acquired from the external storage device, so that the separation display of the wide-view video and the subtitles is realized through different windows, and the wide-view video and the plug-in subtitles are controlled by different players and activities (activities), so that the adjustment of the display style of the subtitles is supported. On one hand, no interference and conflict exist between the first window and the second window, the caption data does not cover the video content, a user can browse a video picture without the caption in the first window, and on the other hand, an invalid black edge area has availability so as to present the externally hung caption synchronous with the video, thereby improving the display effect of the picture and the watching experience of the user.

The first player and the second player can realize independent display control of videos and subtitles, and interaction and cooperative work between the players can be performed through inter-process communication. Fig. 9 is an interactive logic diagram of a first player and a second player according to some embodiments of the present application, referring to fig. 9, after the first player is started, the first player receives first video data transmitted by a signal source device, and obtains a first aspect ratio case, and if the first aspect ratio case is greater than the aspect ratio case, obtains Content Type information (Content Type) from AVI Info of a transmission protocol of a first interface.

In some embodiments, the content type information is set by the source device side to indicate the content type of the Data transmitted by the source, and the content type includes, but is not limited to, no Data type (No Data), drawing type (Graphics), photo type (Photo), movie type (Cinema), game type (Game), and the like.

In some embodiments, the content type information may include three parameters, ITC, CN1, and CN0, respectively, and the content type may be accurately identified by attribute values of (ITC, CN1, CN 0). For example, if (ITC, CN1, CN 0) = (0, 0), the content type is No Data, characterizing that the signal source device has No Data output; if (ITC, CN1, CN 0) = (1, 0), the content type is Graphics, which indicates that the content output by the signal source device is combined according to the general IT practice (i.e. without considering Nyquist criteria), and is not suitable for analog reconstruction or filtering; if (ITC, CN1, CN 0) = (X, 0, 1), the content type is Photo, indicating that the content output by the signal source device originates from a digital still picture; if (ITC, CN1, CN 0) = (X, 1, 0), the content type is Cinema, indicating that the content output by the source device originates from movie material; if (ITC, CN1, CN 0) = (X, 1), the content type is Game, indicating that the content output by the signal source device originates from the Game machine material.

In some embodiments, the signal source device may set (ITC, CN1, CN 0) to (X, 1, 0) upon starting to enter the video play mode, and upon exiting the video play mode, the signal source device may overwrite (ITC, CN1, CN 0) such that (ITC, CN1, CN 0) is not equal to (X, 1, 0), e.g., may cause (ITC, CN1, CN 0) = (0, 0). In the video play mode corresponding to (ITC, CN1, CN 0) = (X, 1, 0), the signal source device allows the aspect ratio of the output video data to be greater than or equal to the aspect ratio of the display device.

In some embodiments, if the first player inquires that the content type indicated by the AVI Info is not Cinema (film type), naturally, there is no subtitle played synchronously with the video, and thus the second player is not started.

In some embodiments, the first player, upon querying that the content type is (or changes to) Cinema, may create a first window, control the first window to prepare to play the first video data, and initiate a second player process by inter-process communication, broadcast a play time stamp and first window information (including, but not limited to, size and location coordinates of the first window, etc.) to the second player.

In some embodiments, referring to fig. 9, after the second player is started, the first caption data is acquired from the external storage device, a second window is created according to the first window information, the starting caption frame is positioned according to the starting time stamp, and the second window is controlled to play the first caption data from the starting caption frame.

In some embodiments, when the first player detects that the content type indicated by the AVI Info is changed to a non-movie type, i.e., (ITC, CN1, CN 0) is not equal to (X, 1, 0), the second player process may be closed by inter-process communication, so that the video playing interface no longer displays the second window and the first subtitle data.

In some embodiments, when the first player detects that the content type indicated by the AVI Info is changed to a non-movie type, the first player may control the presentation of the played content according to the changed content type. For example, if the content type is changed to Game, the first player may display a Game interface; if the content type is changed to No Data, the first player can be closed, so that the first player is prevented from occupying system resources.

For the above subtitle display scheme, abnormal situations that may occur include:

abnormal case one: referring to the interactive logic of fig. 9, the first player controls the second player to start up through inter-process communication, the second player creates a second window, and displays the first subtitle data in the second window according to the play-up time stamp, so that there is a certain lag time from when the first video data is played from the first player until the second player displays the first subtitle data. If the lag time is large, the user may perceive that the video is not synchronous with the subtitle, and the viewing experience of the user is affected.

Abnormal situation two: if the user wants to pause playing the current video, the user can press a pause/play key on a remote controller matched with the signal source device to input a pause instruction to the signal source device, so that the signal source device responds to the pause instruction to pause playing the current video, for example, can pause transmitting the video code stream to the display device. Because the display device end cannot receive the pause instruction, the first player and the second player cannot accurately and timely sense that the signal source device pauses to play the current video, the first player cannot receive the video code stream from the signal source device, the video picture of the first window can be controlled to stay at the last frame received before the pause to play, and because the video and the externally hung subtitle are independently controlled by using different players and activities, the second player can still read and play the subtitle from the external storage device, the phenomenon that the video pauses and the subtitle normally plays is presented, and the playing states of the video and the subtitle are not synchronous.

Abnormal situation three: the first player cannot acquire video information (such as video names, video IDs and the like) from a transmission protocol of the first interface, and video information is not carried in a video code stream transmitted to the display device by the signal source device, so that when the external storage device is imported into a plurality of subtitle files, the second player cannot determine which subtitle file is matched with the current video; if the external storage device does not include the subtitle file, the second player cannot display the valid subtitle in the second window.

In some embodiments, the first solution to the above-mentioned abnormal situation may be to compensate for the delay time, so as to eliminate the delay time, or reduce the delay time to an extent that the user cannot perceive, for example, the delay time reaches 1 second, and the user may advance the playing progress of the subtitle by 1 second.

Fig. 10 is a schematic diagram of a user interface when a user performs delay compensation according to some embodiments of the present application. As shown in view (a) of fig. 10, the second player may set a sync-correction button 731 in the second window 73, the sync-correction button 731 should not obscure subtitle text. If the user perceives that the playback delay of the first subtitle data lags behind the first video data by more than a preset threshold, the control device 100 may click the synchronization correction button 731, where the preset threshold may be set according to the perception degree of the delay by the user, for example, the preset threshold is 500ms. The controller may control the display to display the time stamp setting page 101, in response to the user clicking the sync correction button 731, see view (b) of fig. 10.

In some embodiments, referring to view (b) of fig. 10, the timestamp setting page 101 may include a play progress bar 101a and a timestamp positioning slider 101b. In this way, the user can position the slider 101b by advancing or retreating the time stamp by the play progress bar 101a while observing whether the video and the subtitle are corrected for synchronization. If the user perceives that the video and the caption have achieved playing synchronization, stopping moving the timestamp positioning slider 101b, determining a target timestamp corresponding to the parking position according to the parking position of the timestamp positioning slider 101b on the playing progress bar 101a by the second player, and playing the first caption data according to the target timestamp. For example, the second player acquires the target caption frame corresponding to the target timestamp, controls the second window to jump to the target caption frame, and continues to play the target caption frame and the caption frames after the target caption frame, thereby reducing or eliminating the delay between the video and the caption, realizing the compensation of the caption delay, and ensuring the synchronism of the video and the caption playing.

In some embodiments, the timestamp setting page 101 may set a time input control, the time unit of which is not limited, e.g., seconds, milliseconds, etc. For example, when the user inputs-1 s through the time input control, the second player advances the play progress of the subtitle (direction leading the current time) for 1 second; when the user inputs +0.5s, the second player shifts back the progress of the playback of the subtitle (in a direction lagging the current time) by 500 ms. The time stamp setting page 101 is not limited to the design of the embodiment of the present application.

In some embodiments, the solution for the above-described exception case two may be: the first player detects the playing state of the first video data in real time, and decides whether to inform the second player to pause the subtitle according to the playing state, wherein the playing state comprises a playing state and a pause playing state.

In some embodiments, when the first player detects that two adjacent frames of video frames in the first window are different, that is, recognizes that the playing state of the first video data is a playing state, the first player normally plays the first video data, and the second player synchronously plays the first subtitle data.

In some embodiments, when the first player detects that the video frames of consecutive N frames (N is greater than 1, for example, 3 frames) in the first window are unchanged, that is, it is identified that the playing state of the first video data is switched to a pause playing state, which indicates that the source device side has paused playing the first video data, the first player may send a pause instruction to the second player through inter-process communication, where the pause instruction may include a pause timestamp, where the pause timestamp is a timestamp corresponding to the first target video Frame, where the first target video Frame is a video Frame with the smallest timestamp in the unchanged N frames, and assuming that n=3, and the video frames of consecutive frames 1, 2, and 3 are unchanged, the timestamp of Frame1 is taken as the pause timestamp. The second player receives the pause instruction, can save the pause time stamp and pause the first subtitle data, so that the problem of asynchronous playing caused by continuous playing of the subtitles when the video is paused is avoided.

In some embodiments, when the first player detects that two adjacent frames of video frames in the first window change, that is, it is identified that the playing state of the first video data is changed from the pause playing state to the play state, which indicates that the signal source device has resumed playing of the first video data, the first player may send a resume playing instruction to the second player through inter-process communication. And the second player receives the play resuming instruction and continues to play the first caption data at the caption frame corresponding to the pause time stamp.

In this way, the first player recognizes the playing state of the first video data by monitoring the changing condition of the video picture in the first window in real time, and when the signal source equipment pauses to play the first video data, the second player is informed to pause to play the first subtitle data, and when the signal source equipment resumes to play the first video data, the second player is informed to continue to play the first subtitle data according to the pause timestamp, so that the video and the subtitle keep consistent playing state and playing progress, and the synchronism of video playing and subtitle playing is realized.

In some embodiments, if the user knows that the first video data played by the signal source device has no subtitle, the user imports the first subtitle data matched with the first video data into the external storage device, so that the display device can accurately read the external subtitle, and the user only stores the first subtitle data into the external storage device and does not store other subtitle files unrelated to the first video data. During use by the user, the first subtitle data may not be stored in the external storage device, or a plurality of subtitle files may be stored, thereby generating the above-described abnormal situation three.

In some embodiments, the solution to the above-described exception case three may be: the second player may access the external storage device through the second interface and inquire of the number M of subtitle files included in the external storage device. If m=1, the only subtitle file stored in the default external storage device is the first subtitle data.

Fig. 11 is a schematic diagram of a user interface displayed by a display device when an external storage device provided in some embodiments of the present application does not have a subtitle file. If m=0, indicating that the user does not store the subtitle file in the external storage device, referring to fig. 11, the controller may control the display to display the first prompt information 111, where the first prompt information 111 is used to prompt the user to import the first subtitle data matching the first video data into the external storage device. For example, the first hint information 111 in the example of fig. 11 is presented as "no subtitle file in the U disc, please import the subtitle file of the current video into the U disc". In this way, after the user browses the first prompt information 111, the first subtitle data may be autonomously stored in the external storage device, so that the second player may read and control subtitle display.

Fig. 12 is a schematic diagram of a display device displaying a subtitle list page according to some embodiments of the present application. If M is greater than 1, indicating that the external storage device includes a plurality of subtitle files, referring to fig. 12, the controller may control the display to display a subtitle list page 121, and the subtitle list page 121 may include subtitle information mapped by the M subtitle files included in the external storage device, including but not limited to: subtitle names (which may be the same name as video names), subtitle formats (e.g., srt), subtitle duration, subtitle file size, etc., to facilitate user selection.

In some embodiments, referring to fig. 12, the subtitle list page 121 may further include: each subtitle information corresponds to a selection control 121a, a confirmation selection control 121b, and a cancel control 121c. The M selection controls 121a have mutual exclusion display, that is, when any one of the selection controls 121a is in a selected state, the M-1 selection controls 121a are in an unselected state, so that the user can only select one subtitle file as the first subtitle file matched with the current video, that is, multiple selections of the user are not supported.

In some embodiments, after the user switches the selection control 121a corresponding to the target subtitle information in the subtitle list page 121 to the selected state, the user may click the confirm selection control 121b, so that the user inputs the operation of selecting the target subtitle information. The controller controls the second player to read the subtitle file mapped by the target subtitle information from the external storage device in response to the operation of selecting the target subtitle information by the user, thereby acquiring the first subtitle data. In this way, when the plurality of caption files are included in the external storage device, and the second player does not know which caption file is matched with the current video, the selector is handed to the user, and the user selects the first caption data by himself, so that the accuracy of caption display is improved, and the problems of false display or no display of captions and the like are avoided.

In some embodiments, the controller responds to the operation that the user clicks the cancel control 121c, that is, the user does not specify the first subtitle data, the second player cannot obtain the accurate and effective subtitle data to be played, at this time, the controller may control the display to display the second prompt information for prompting "unable to play the subtitle, please reselect; alternatively, the controller may display third hint information for hinting at "delete subtitle file in the external storage device that is not related to the current video"; alternatively, the controller may pause the second player to run or shut down to free up system resources occupied by the second player. Note that the caption list page 121 is not limited to the design of the embodiment of the present application.

In the embodiment of the application, aiming at the scene of overlapping display of the wide-view video and the caption and invalid display of the 'black side' area, different players are utilized to independently control display of the wide-view video and the caption data, wherein a first player generates a first window according to the aspect ratio of the wide-view video, and controls the first window to only display the wide-view video and not display the caption; the second player generates a second window in the black edge area, and controls the second window to display the plug-in subtitle acquired from the external storage device, so that the separation display and the independent display control of the wide-view video and the subtitle data are realized through different players, windows and activities, and the matching property and the synchronism of the video and the subtitle display are controlled based on a play timestamp alignment mechanism. On the one hand, no interference and conflict exist between the first window and the second window, the caption data cannot cover the video content, a user can browse video pictures without captions in the first window, and the user can browse caption information in the second window independently; on the other hand, the invalid black edge area is made available for presenting the plug-in subtitle synchronous with the video, so that the display effect of the picture and the viewing experience of the user are improved.

According to the method and the device, through interaction and cooperation of the first player and the second player, accurate control of the plug-in subtitles is achieved, the playing state and the playing progress of videos and the subtitles are kept synchronous, the first player obtains AVI Info through a transmission protocol of a first interface and is used for determining content types, playing and playing of first video data are controlled based on the content types, and state operation and subtitle display control of the second player are coordinated and assisted. In addition, the embodiment of the application provides a solution to various abnormal conditions, can compensate the lag time delay of the caption relative to the video, controls the second player to synchronously adjust the playing state of the caption according to the playing state adjustment of the signal source equipment to the current video, and enables the second player to acquire accurate first caption data according to the storage condition of the external storage equipment, thereby improving the accuracy of caption playing and avoiding abnormal problems such as false display or no display of the caption.

The drawings provided in the embodiments of the present application are merely exemplary, and layouts of the first window and the second window, view settings of each window, and designs of related pages such as subtitle display style, prompt information, popup window, etc. are not limited to the embodiments of the present application.

In some implementations, embodiments of the present application also provide a computer storage medium, which may store a program. When the computer storage medium is configured in the display device 200, the program may include some or all of the program steps of the subtitle display method referred to in the above embodiments when executed. The computer storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), or the like.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the disclosure and to enable others skilled in the art to best utilize the embodiments.

Claims

1. A display device, characterized by comprising:

a display;

a controller for performing:

2. The display device of claim 1, wherein after starting the first player, the controller is further configured to perform:

and acquiring media description information from a transmission protocol of the first interface, wherein the media description information comprises the first aspect ratio and content type information set by the signal source device, the content type information is used for indicating the content type of data transmitted by the signal source device, and the content type comprises a no-data type, a movie type and a game type.

3. The display device of claim 2, wherein the controller is further configured to perform, prior to starting the second player:

if the content type is not the movie type, not starting the second player;

starting the second player when the content type is changed to the movie type; wherein the movie type is set by the source device when the first video data starts playing.

4. A display device according to claim 3, wherein after starting the second player, the controller is further configured to perform:

and closing the second player and the second window when the content type is detected to be changed into a non-film type, and not displaying the subtitle data in the external storage device.

5. The display device of claim 1, wherein the controller is further configured to perform:

when the first player plays the first video data, acquiring a play time stamp of the first video data;

and controlling the second player to synchronously control the display of the first subtitle data according to the play starting time stamp.

6. The display device of claim 1, wherein the controller is further configured to perform:

controlling the first player to detect the playing state of the first video data;

when detecting that the continuous multi-frame video frames in the first window are unchanged, sending a pause instruction to the second player; the pause instruction comprises a pause time stamp, and the pause instruction is used for instructing the second player to pause playing the first subtitle data;

and when detecting that two adjacent frames of video pictures in the first window change, sending a play resuming instruction to the second player, wherein the play resuming instruction is used for indicating the second player to continue playing the first subtitle data at the subtitle frame corresponding to the pause timestamp.

7. The display device of claim 1, wherein the controller is further configured to perform:

When the second player inquires that the external storage device comprises a plurality of subtitle data, controlling a display to display a subtitle list page, wherein the subtitle list page comprises subtitle information mapped by the plurality of subtitle data contained in the external storage device;

and controlling the second player to acquire first subtitle data mapped by the target subtitle information from the external storage device in response to the operation of selecting the target subtitle information in the subtitle list page by a user.

8. The display device of claim 1, wherein the controller is further configured to perform:

when the second player inquires that the external storage equipment does not comprise the subtitle data, the display is controlled to display first prompt information, and the first prompt information is used for prompting a user to import first subtitle data matched with the first video data into the external storage equipment.

9. The display device of claim 1, wherein the controller is further configured to perform:

controlling the display to display a time stamp setting page in response to a first operation of clicking the synchronous correction button by a user; the synchronization correction button is a button arranged in the second window by the second player, and the first operation is an operation input by a user when the playing delay of the first subtitle data lagging behind the first video data is larger than a preset threshold;

Receiving a target timestamp input by a user through the timestamp setting page;

and controlling the second player to play the first subtitle data according to the target time stamp so as to reduce or eliminate the play delay.

10. A subtitle display method, comprising: