CN112752156A - Subtitle adjusting method and display device - Google Patents

Subtitle adjusting method and display device Download PDF

Info

Publication number
CN112752156A
CN112752156A CN202011585396.2A CN202011585396A CN112752156A CN 112752156 A CN112752156 A CN 112752156A CN 202011585396 A CN202011585396 A CN 202011585396A CN 112752156 A CN112752156 A CN 112752156A
Authority
CN
China
Prior art keywords
subtitle
display
page
user
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011585396.2A
Other languages
Chinese (zh)
Inventor
高雯雯
胡存芳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hisense Visual Technology Co Ltd
Original Assignee
Hisense Visual Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hisense Visual Technology Co Ltd filed Critical Hisense Visual Technology Co Ltd
Priority to CN202011585396.2A priority Critical patent/CN112752156A/en
Publication of CN112752156A publication Critical patent/CN112752156A/en
Priority to PCT/CN2021/119628 priority patent/WO2022121436A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47217End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/485End-user interface for client configuration
    • H04N21/4858End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/488Data services, e.g. news ticker
    • H04N21/4884Data services, e.g. news ticker for displaying subtitles

Abstract

When a user watches video resources with subtitles by using the display equipment, if the sound is found not to be matched with the subtitles, a page display instruction can be input to the display equipment, and then the controller controls the display to display a subtitle adjustment page; after watching the subtitle adjustment page, a user can input a subtitle adjustment instruction for selecting a certain time offset to the display equipment, and the controller responds to the instruction and calculates a target playing progress time point; and finally, the controller controls the display to play the target subtitle content corresponding to the target playing progress time point while playing the video resource corresponding to the target playing progress time point. Therefore, the technical scheme of the application can provide a display page with adjustable subtitles for a user, and adjust the occurrence time of the subtitles according to the operation instruction of the user so as to solve the problem that the sound and the subtitles do not correspond to each other.

Description

Subtitle adjusting method and display device
Technical Field
The present application relates to the field of display technologies, and in particular, to a subtitle adjusting method and a display device.
Background
When a user plays a video by using the display device, if the video source contains corresponding subtitle information, the display device can display subtitle content while playing the video so as to realize the correspondence between sound and subtitles, and the user can intuitively experience the content of the video from two aspects of hearing and vision.
However, in the actual situation of video playing, some problems of mismatching of subtitles and sound usually occur. This kind of problem is mostly caused by improper production when producing the film source caption; or due to problems with the display device player itself. When such a situation occurs, the sound and subtitles played on the display device do not correspond to each other, which easily affects the viewing experience of the user.
Disclosure of Invention
The application provides a subtitle adjusting method and display equipment, which are used for solving the problem that sound played on the existing display equipment does not correspond to subtitles.
In a first aspect, the present application provides a display device comprising:
a display configured to play a video resource and subtitle content in the video resource;
a controller configured to:
responding to a page display instruction input by a user, and controlling a display to display a subtitle adjustment page; the subtitle adjustment page provides a time offset option for adjusting subtitle display time for a user;
responding to a subtitle adjustment instruction input after a user watches the subtitle adjustment page, and adding the time offset selected by the user and the current playing progress time point of the video resource to obtain a target playing progress time point;
and controlling a display to play the target subtitle content corresponding to the target playing progress time point while playing the video resource corresponding to the target playing progress time point.
In some embodiments, the controller is further configured to:
the method comprises the steps that when a display is controlled to play video resources and subtitle contents in the video resources, a menu display instruction input by a user is responded, and a menu page is controlled to be displayed by the display; the menu page includes a subtitle setting option;
responding to a setting page display instruction which is input by a user after the user watches the menu page and used for selecting the subtitle setting option, and controlling a display to display a subtitle setting page; the subtitle setting page comprises a playing adjustment option;
and controlling a display to display a subtitle adjustment page in response to a page display instruction for selecting the playing adjustment option input after the user watches the subtitle setting page.
In some embodiments, the controller is further configured to:
analyzing a subtitle file in a video resource to obtain all subtitle contents in the video resource and a subtitle time period displayed by each subtitle content;
and storing the caption content and the caption time period in a content array and a time array respectively.
In some embodiments, the controller is further configured to:
detecting whether the target playing progress time point exists in any subtitle time period of the time array or not;
taking the subtitle time period containing the target playing progress time point as a target time period under the condition that the target playing progress time point exists in any subtitle time period;
and acquiring the target subtitle content corresponding to the target time period from the content array.
In some embodiments, the controller is further configured to:
sequentially setting a plurality of increasing positive time offsets with equal intervals from the zero time offset to the positive direction of the zero time offset, and sequentially setting a plurality of decreasing negative time offsets with equal intervals from the zero time offset to the negative direction of the zero time offset; wherein, the positive time offset is used for representing the time length of fast forward when the caption content is played, and the negative time offset is used for representing the time length of backward when the caption content is played;
controlling the display to display the positive time offset and the negative time offset on the caption adjustment page.
In some embodiments, the controller is further configured to:
and under the condition that the target playing progress time point does not exist in any subtitle time period, controlling a display to play the video resource corresponding to the target playing progress time point and simultaneously not play any subtitle content.
In a second aspect, the present application further provides a subtitle adjusting method, including:
responding to a page display instruction input by a user, and controlling a display to display a subtitle adjustment page; the subtitle adjustment page provides a time offset option for adjusting subtitle display time for a user;
responding to a subtitle adjustment instruction input after a user watches the subtitle adjustment page, and adding the time offset selected by the user and the current playing progress time point of the video resource to obtain a target playing progress time point;
and controlling a display to play the target subtitle content corresponding to the target playing progress time point while playing the video resource corresponding to the target playing progress time point.
In some embodiments, the step of controlling the display to display the subtitle adjustment page in response to the page display instruction input by the user includes:
the method comprises the steps that when a display is controlled to play video resources and subtitle contents in the video resources, a menu display instruction input by a user is responded, and a menu page is controlled to be displayed by the display; the menu page includes a subtitle setting option;
responding to a setting page display instruction which is input by a user after the user watches the menu page and used for selecting the subtitle setting option, and controlling a display to display a subtitle setting page; the subtitle setting page comprises a playing adjustment option;
and controlling a display to display a subtitle adjustment page in response to a page display instruction for selecting the playing adjustment option input after the user watches the subtitle setting page.
In some embodiments, the method further comprises:
analyzing a subtitle file in a video resource to obtain all subtitle contents in the video resource and a subtitle time period displayed by each subtitle content;
and storing the caption content and the caption time period in a content array and a time array respectively.
In some embodiments, the method further comprises:
detecting whether the target playing progress time point exists in any subtitle time period of the time array or not;
taking the subtitle time period containing the target playing progress time point as a target time period under the condition that the target playing progress time point exists in any subtitle time period;
and acquiring the target subtitle content corresponding to the target time period from the content array.
As can be seen from the above, the technical solution of the present application provides a subtitle adjustment method and a display device, when a user uses the display device to watch a video resource with subtitles, if it is found that sound is not matched with the subtitles, a page display instruction can be input to the display device, and then a controller of the display device controls a display to display a subtitle adjustment page; after watching the subtitle adjustment page, a user can input a subtitle adjustment instruction for selecting a certain time offset to the display equipment, and the controller responds to the subtitle adjustment instruction and adds the time offset selected by the user and the current playing progress time point of the video resource to obtain a target playing progress time point; and finally, the controller controls the display to play the target subtitle content corresponding to the target playing progress time point while playing the video resource corresponding to the target playing progress time point. Therefore, the technical scheme of the application can provide a display page with adjustable subtitles for a user, and adjust the occurrence time of the subtitles according to the operation instruction of the user so as to solve the problem that the sound and the subtitles do not correspond to each other.
Drawings
In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 illustrates a schematic diagram of a usage scenario of a display device according to some embodiments;
fig. 2 illustrates a hardware configuration block diagram of the control apparatus 100 according to some embodiments;
fig. 3 illustrates a hardware configuration block diagram of the display apparatus 200 according to some embodiments;
FIG. 4 illustrates a software configuration diagram in the display device 200 according to some embodiments;
FIG. 5 illustrates a schematic diagram of an interaction between the controller 250 and a user, according to some embodiments;
FIG. 6 illustrates a schematic diagram of a subtitling page, according to some embodiments;
FIG. 7 illustrates a schematic diagram of a menu page in accordance with some embodiments;
FIG. 8 illustrates a schematic diagram of a subtitle setting page according to some embodiments;
FIG. 9 illustrates a control flow diagram for controller 250 according to some embodiments;
fig. 10 illustrates a flow diagram of a method of subtitle adjustment according to some embodiments.
Detailed Description
To make the purpose and embodiments of the present application clearer, the following will clearly and completely describe the exemplary embodiments of the present application with reference to the attached drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, and not all of the embodiments.
It should be noted that the brief descriptions of the terms in the present application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.
The terms "first," "second," "third," and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.
The terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements expressly listed, but may include other elements not expressly listed or inherent to such product or apparatus.
The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.
FIG. 1 illustrates a schematic diagram of a usage scenario of a display device according to some embodiments. As shown in fig. 1, the display apparatus 200 is also in data communication with a server 400, and a user can operate the display apparatus 200 through the smart device 300 or the control device 100.
In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes at least one of an infrared protocol communication or a bluetooth protocol communication, and other short-distance communication methods, and controls the display device 200 in a wireless or wired manner. The user may control the display apparatus 200 by inputting a user instruction through at least one of a key on a remote controller, a voice input, a control panel input, and the like.
In some embodiments, the smart device 300 may include any of a mobile terminal, a tablet, a computer, a laptop, an AR/VR device, and the like.
In some embodiments, the smart device 300 may also be used to control the display device 200. For example, the display device 200 is controlled using an application program running on the smart device.
In some embodiments, the smart device 300 and the display device may also be used for communication of data.
In some embodiments, the display device 200 may also be controlled in a manner other than the control apparatus 100 and the smart device 300, for example, the voice instruction control of the user may be directly received by a module configured inside the display device 200 to obtain a voice instruction, or may be received by a voice control apparatus provided outside the display device 200.
In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers.
In some embodiments, software steps executed by one step execution agent may be migrated on demand to another step execution agent in data communication therewith for execution. Illustratively, software steps performed by the server may be migrated to be performed on a display device in data communication therewith, and vice versa, as desired.
Fig. 2 illustrates a block diagram of a hardware configuration of the control apparatus 100 according to some embodiments. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction from a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200.
In some embodiments, the communication interface 130 is used for external communication, and includes at least one of a WIFI chip, a bluetooth module, NFC, or an alternative module.
In some embodiments, the user input/output interface 140 includes at least one of a microphone, a touchpad, a sensor, a key, or an alternative module.
Fig. 3 illustrates a hardware configuration block diagram of a display device 200 according to some embodiments.
In some embodiments, the display apparatus 200 includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, a user interface.
In some embodiments the controller comprises a central processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an nth interface for input/output.
In some embodiments, the display 260 includes a display screen component for displaying pictures, and a driving component for driving image display, a component for receiving image signals from the controller output, displaying video content, image content, and menu manipulation interface, and a user manipulation UI interface, etc.
In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.
In some embodiments, the tuner demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio/video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.
In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.
In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; alternatively, the detector 230 includes an image collector, such as a camera, which may be used to collect external environment scenes, attributes of the user, or user interaction gestures, or the detector 230 includes a sound collector, such as a microphone, which is used to receive external sounds.
In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, and the like. The interface may be a composite input/output interface formed by the plurality of interfaces.
In some embodiments, the controller 250 and the modem 210 may be located in different separate devices, that is, the modem 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.
In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.
In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other actionable control. The operations related to the selected object are: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to the icon.
In some embodiments the controller comprises at least one of a Central Processing Unit (CPU), a video processor, an audio processor, a Graphics Processing Unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory), a first to nth interface for input/output, a communication Bus (Bus), and the like.
A CPU processor. For executing operating system and application program instructions stored in the memory, and executing various application programs, data and contents according to various interactive instructions receiving external input, so as to finally display and play various audio-video contents. The CPU processor may include a plurality of processors. E.g. comprising a main processor and one or more sub-processors.
In some embodiments, a graphics processor for generating various graphics objects, such as: at least one of an icon, an operation menu, and a user input instruction display figure. The graphic processor comprises an arithmetic unit, which performs operation by receiving various interactive instructions input by a user and displays various objects according to display attributes; the system also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.
In some embodiments, the video processor is configured to receive an external video signal, and perform at least one of video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to a standard codec protocol of the input signal, so as to obtain a signal displayed or played on the direct display device 200.
In some embodiments, the video processor includes at least one of a demultiplexing module, a video decoding module, an image composition module, a frame rate conversion module, a display formatting module, and the like. The demultiplexing module is used for demultiplexing the input audio and video data stream. And the video decoding module is used for processing the video signal after demultiplexing, including decoding, scaling and the like. And the image synthesis module is used for carrying out superposition mixing processing on the GUI signal input by the user or generated by the user and the video image after the zooming processing by the graphic generator so as to generate an image signal for display. And the frame rate conversion module is used for converting the frame rate of the input video. And the display formatting module is used for converting the received video output signal after the frame rate conversion, and changing the signal to be in accordance with the signal of the display format, such as an output RGB data signal.
In some embodiments, the audio processor is configured to receive an external audio signal, decompress and decode the received audio signal according to a standard codec protocol of the input signal, and perform at least one of noise reduction, digital-to-analog conversion, and amplification processing to obtain a sound signal that can be played in the speaker.
In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on display 260, and the user input interface receives the user input commands through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.
In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include at least one of an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc. visual interface elements.
In some embodiments, user interface 280 is an interface that may be used to receive control inputs (e.g., physical buttons on the body of the display device, or the like).
In some embodiments, a system of a display device may include a Kernel (Kernel), a command parser (shell), a file system, and an application program. The kernel, shell, and file system together make up the basic operating system structure that allows users to manage files, run programs, and use the system. After power-on, the kernel is started, kernel space is activated, hardware is abstracted, hardware parameters are initialized, and virtual memory, a scheduler, signals and interprocess communication (IPC) are operated and maintained. And after the kernel is started, loading the Shell and the user application program. The application program is compiled into machine code after being started, and a process is formed.
Referring to fig. 4, in some embodiments, the system is divided into four layers, which are an Application (Applications) layer (abbreviated as "Application layer"), an Application Framework (Application Framework) layer (abbreviated as "Framework layer"), an Android runtime (Android runtime) and system library layer (abbreviated as "system runtime library layer"), and a kernel layer from top to bottom.
In some embodiments, at least one application program runs in the application program layer, and the application programs may be windows (windows) programs carried by an operating system, system setting programs, clock programs or the like; or an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.
The framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer includes a number of predefined functions. The application framework layer acts as a processing center that decides to let the applications in the application layer act. The application program can access the resources in the system and obtain the services of the system in execution through the API interface.
As shown in fig. 4, in the embodiment of the present application, the application framework layer includes a manager (Managers), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used for interacting with all activities running in the system; the Location Manager (Location Manager) is used for providing the system service or application with the access of the system Location service; a Package Manager (Package Manager) for retrieving various information related to an application Package currently installed on the device; a Notification Manager (Notification Manager) for controlling display and clearing of Notification messages; a Window Manager (Window Manager) is used to manage the icons, windows, toolbars, wallpapers, and desktop components on a user interface.
In some embodiments, the activity manager is used to manage the lifecycle of the various applications as well as general navigational fallback functions, such as controlling exit, opening, fallback, etc. of the applications. The window manager is used for managing all window programs, such as obtaining the size of a display screen, judging whether a status bar exists, locking the screen, intercepting the screen, controlling the change of the display window (for example, reducing the display window, displaying a shake, displaying a distortion deformation, and the like), and the like.
In some embodiments, the system runtime layer provides support for the upper layer, i.e., the framework layer, and when the framework layer is used, the android operating system runs the C/C + + library included in the system runtime layer to implement the functions to be implemented by the framework layer.
In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 4, the core layer includes at least one of the following drivers: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.) and power drive etc..
When the user plays the video by using the display device 200, if the video source itself contains the corresponding subtitle information, the display device 200 displays the subtitle content while playing the video, so as to realize the correspondence between the sound and the subtitle, and the user can intuitively experience the content of the video from both the auditory sense and the visual sense.
However, in the actual situation of video playing, some problems of mismatching of subtitles and sound usually occur. This kind of problem is mostly caused by improper production when producing the film source caption; or due to problems of the display device 200 player itself. When this occurs, the sound and subtitles played on the display device 200 do not correspond, and the viewing experience of the user is easily affected.
Based on the above, the embodiment of the present application provides a subtitle adjusting method and a display device 200, which can provide a display page with an adjustable subtitle for a user, and adjust the occurrence time of the subtitle according to an operation instruction of the user, so as to solve the problem that sound does not correspond to the subtitle.
As described in the foregoing embodiments, the display device 200 in the embodiment of the present application may include the display 260 and the controller 250. The user can use the display device 200 to normally play the video resource he wants to see, and usually if the video resource has a subtitle file, the controller 250 parses the subtitle file and synchronously displays the obtained subtitle content on the display 260 so that the subtitle content matches the video sound content.
FIG. 5 illustrates a schematic diagram of an interaction between a controller 250 and a user, according to some embodiments.
When the subtitle content on the display 260 does not match the video sound, for example, the playing content of the video sound is faster than the subtitle display content or the playing content of the video sound is slower than the subtitle display content, the user may adjust the timing of displaying the subtitle on the display 260, so that the subtitle content matches the video sound.
In a specific manner, as shown in fig. 5, the user may input a page display instruction to the display device 200, so that the controller 250 controls the display 260 to display the subtitle adjustment page in response to the page display instruction. After the user watches the subtitle adjustment page, the user selects the time offset to be adjusted, and further inputs a subtitle adjustment instruction to the display device 200, and in response to the instruction, the controller 250 needs to calculate at what time point the currently played subtitle content should be displayed after adjustment, that is, the time offset selected by the user is added to the current playing progress time point of the video resource, and the obtained target playing progress time point is the time point at which the adjusted subtitle should be displayed. Finally, the controller 250 controls the display 260 to play the target subtitle content corresponding to the target play progress time point while playing the video resource corresponding to the target play progress time point. The adjusted target subtitle content and the video resource are played synchronously, and then the matching of the subtitle and the sound can be realized.
In addition, the user may input the instruction to the display apparatus 200 by operating a key of the remote controller, or may input the instruction to the display apparatus 200 equipped with the voice module by voice.
FIG. 6 illustrates a schematic diagram of a subtitling page, according to some embodiments.
As shown in fig. 6, on the subtitle adjustment page, several time offset options for adjusting the subtitle display time have been provided to the user through a previous setting. Wherein the different time offsets represent the time at which the user can adjust the display of the subtitle in advance (fast forward) or in delay (backward) at a time, e.g. 0.5s means that the user can display the subtitle in advance for 0.5s, -0.5s means that the user can display the subtitle in delay for 0.5 s.
FIG. 7 illustrates a schematic diagram of a menu page according to some embodiments. Fig. 8 illustrates a schematic diagram of a subtitle setting page according to some embodiments.
In some embodiments, the display device 200 may also provide a plurality of play functions or services for the current video asset when displaying the video asset, and these functions or services may be displayed on a general menu page, which may include options regarding subtitle settings, as shown in fig. 7. Moreover, the subtitle setting is not limited to the function of adjusting the subtitle playing time, and there may be some other functions of subtitle language setting or subtitle selection, which are also displayed on a general subtitle setting page, as shown in fig. 8. When the user selects the play adjustment option on the subtitle setting page, the display 260 displays the final subtitle adjustment page.
It can be seen that in some embodiments, the user needs to select different pages step by step to view the caption adjustment page. In this case, each operation of selecting a function option by the user may be regarded as inputting a control instruction, for example, a menu display instruction, a setting page display instruction, a page display instruction, or the like, to the display apparatus 200. Then, the controller 250 of the display apparatus 200 controls the display 260 to display a menu page in response to a menu display instruction input by the user; and in response to a set page display instruction, controlling a display to display a subtitle set page; and then controls the display 260 to display a caption adjustment page in response to the page display instruction.
In some embodiments, the setting of the time offset may be set differently according to service requirements, user requirements, etc. of the display device 200, and the time offset needs to be divided into positive and negative, where a positive time offset is used to indicate a duration of fast forward when the subtitle content is played, and a negative time offset is used to indicate a duration of rewind when the subtitle content is played. In some embodiments, it is desirable to set a number of equally spaced increasing positive time offsets in sequence from zero time offset to its positive direction and a number of equally spaced decreasing negative time offsets in sequence from zero time offset to its negative direction, e.g., 0.5s apart, then the number of time offsets set may be 2.5s, 2.0s, 1.5s, 1.0s, 0.5s, 0.0s, -0.5s, -1.0s, -1.5s, -2.0s, -2.5s, etc.
FIG. 9 illustrates a control flow diagram for controller 250 according to some embodiments.
As described in the foregoing embodiment, the premise that the user can adjust the subtitle is: the played video resources carry subtitle files. In order to accurately match the caption content with the content of the sound in the video, in some embodiments, as shown in fig. 9, the controller 250 may also parse the caption file in the video resource to obtain all the caption content in the video resource and the caption time period displayed by each caption content. And storing the caption content and the caption time period in a content array and a time array, respectively.
For example, the original subtitle file may be in the form of:
00:00:00,000-->00:05:00,000
That girl thinks that she's so fine;
(which may be indicated as "That girl thronks That she's so fine" is shown on the display 260 within the first 5.0s of the video);
00:06:00,000-->00:08:00,000
That soon she'll have my mind;
(which may be expressed as displaying a "That song shot'll have my mind" on the display 260 within 6.0s-8.0s of the video);
00:09:00,000-->00:11:00,000
That girl thinks that she's so smart;
(which may be expressed as "That girl thinks That she's so smart" displayed on the display 260 within 9.0s-11.0s of the video);
00:13:00,000-->00:15:00,000
That soon she'll have my heart;
(which may be expressed as displaying a "That song shot'll have my heart" on the display 260 within 13.0s-15.0s of the video);
after the parsing and grouping by the controller 250, the caption contents are respectively stored in the content array a [00:00:00,000- >00:05:00,000, 00:06:00,000- >00:08:00,000, 00:09:00,000- >00:11:00,000, 00:12:00,000- >00:15:00,000 ].
After the content array and the time array are stored, the controller 250 responds to a control instruction of a user, and obtains the target subtitle content corresponding to the target playing progress time point from the content array according to the corresponding relation between the time period and the subtitle content. The specific method can be that whether the target playing progress time point exists in any subtitle time period of the time array is detected; and taking the subtitle time period containing the target playing progress time point as a target time period under the condition that the target playing progress time point exists in any one subtitle time period; since the caption time periods correspond to the caption contents in the content array one to one, the controller 250 may also obtain the target caption content corresponding to the target time period from the content array.
For example, if the offset selected by the user is 2.5s, and the current playing progress time point of the video resource is 4.0s, then the calculated target playing progress time point is 6.5s, and the controller 250 detects That 6.5s exists in 00:06:00,000- >00:08:00,000 in the time array B, where 00:06:00,000- >00:08:00,000 is a target time period, and the controller 250 acquires the target subtitle content "That son shell' live my mind" corresponding to the target time period from the content array. For another example, if the offset selected by the user is-1.0 s, the current play progress time point of the video resource is 4.0s, then the calculated target play progress time point is 3.0s, and the controller 250 detects That 3.0s exists in 00:00:00,000- - >00:05:00,000 in the time array B, where 00:00:00,000- - >00:05:00,000 is a target time period, and then the controller 250 acquires the target subtitle content "thin girl thin skin" s fine "corresponding to the target time period from the content array.
Finally, the controller 250 controls the display 260 to play the target subtitle content corresponding to the target time period while playing the video resource corresponding to the target play progress time point.
In addition, if the time offset selected by the user is too large, the target playing progress time point does not exist in any subtitle time period, which indicates that the adjustment range of the user is too large, and the adjusted subtitle display time point cannot be matched with any subtitle content, so that the controller 250 controls the display 260 to play the video resource corresponding to the target playing progress time point, and at the same time, no subtitle content is played.
In some embodiments, the present application may provide a subtitling page as shown in fig. 6 for a user, and show each time offset option in a list on the subtitling page, where 0.0s represents a default value. In other embodiments, the application may also provide a subtitle adjustment page capable of autonomously filling in a time offset for the user, after the controller 250 obtains the time offset filled by the user, the target playing progress time point is obtained through the calculation as described in the above embodiments, the corresponding target subtitle content is obtained according to the manner described in the above embodiments, and finally, the controller 250 controls the display 260 to play the target subtitle content corresponding to the target playing progress time point while playing the video resource corresponding to the target playing progress time point.
As can be seen from the above, the display device 200 provided in the embodiment of the present application may provide a subtitle adjustment function for a user, and when the user uses the display device 200 to watch a video resource with subtitles, if it is found that sound is not matched with subtitles, a page display instruction may be input to the display device 200, and then the controller 250 of the display device 200 controls the display 260 to display a subtitle adjustment page; after watching the subtitle adjustment page, the user may input a subtitle adjustment instruction for selecting a certain time offset to the display device 200, and the controller 250 adds the time offset selected by the user to the current play progress time point of the video resource in response to the subtitle adjustment instruction to obtain a target play progress time point; finally, the controller 250 controls the display 260 to play the target subtitle content corresponding to the target play progress time point while playing the video resource corresponding to the target play progress time point. Therefore, the embodiment of the application can provide a display page with adjustable subtitles for a user, and adjust the occurrence time of the subtitles according to the operation instruction of the user so as to solve the problem that the sound and the subtitles do not correspond to each other.
Fig. 10 illustrates a flow diagram of a method of subtitle adjustment according to some embodiments.
The subtitle adjusting method provided in this embodiment of the present application may be applied to the controller 250 or some components that may implement the control function, as shown in fig. 10, where the method may include the following steps:
in step S101, in response to a page display instruction input by the user, the display 260 is controlled to display a subtitle adjustment page.
The subtitle adjustment page provides a time offset option for adjusting subtitle display time for a user; as shown in fig. 6 in particular, the different time offsets represent the time at which the user can adjust the subtitle display in advance (fast forward) or in delay (rewind) at a time.
Step S102, responding to a caption adjusting instruction input after a user watches a caption adjusting page, adding the time offset selected by the user and the current playing progress time point of the video resource to obtain a target playing progress time point.
Still taking the contents of the foregoing embodiment as an example, if the offset selected by the user is 2.5s and the current play progress time point of the video asset is 4s, the calculated target play progress time point is 6.5 s.
Step S103, controlling the display 260 to play the target subtitle content corresponding to the target playing progress time point while playing the video resource corresponding to the target playing progress time point.
For example, in the content array, the target subtitle content corresponding to 6.5s is "That soon she'll have my mind". Finally, the controller 250 controls the display 260 to display "That sound shot'll have my mind" at 6.5s of the video playing progress.
In some embodiments, the step of controlling the display 260 to display the subtitle adjustment page in response to the page display instruction input by the user may include:
in step S201, while controlling the display 260 to play the video resource and the subtitle content in the video resource, the display 260 is controlled to display a menu page in response to a menu display instruction input by a user.
The menu page may specifically include options such as subtitle setting, as shown in fig. 7.
In step S202, in response to a setting page display instruction for selecting a subtitle setting option input after the user views the menu page, the display 260 is controlled to display a subtitle setting page.
The subtitle setting page may specifically include options such as play adjustment, as shown in fig. 8.
In step S203, in response to a page display instruction for selecting a play adjustment option input after the user views the subtitle setting page, the display 260 is controlled to display a subtitle adjustment page.
In some embodiments, the present application may provide a caption adjustment page as shown in fig. 6 for the user, and show each time offset option in a list form on the caption adjustment page, where 0.0s represents a default value. In other embodiments, the application may also provide a subtitling page for the user that may autonomously fill in the time offset.
In some embodiments, the subtitle adjusting method may further include:
step S301, analyzing the caption file in the video resource, and obtaining all the caption contents in the video resource and the caption time periods displayed by each caption content.
Step S302, the caption content and the caption time quantum are respectively stored in a content array and a time array.
In some embodiments, the subtitle adjusting method may further include:
step S401, detecting whether the target playing progress time point exists in any subtitle time period of the time array.
In step S402, when the target play progress time point exists in any one of the subtitle time periods, the subtitle time period including the target play progress time point is set as the target time period.
In step S403, the target subtitle content corresponding to the target time period is acquired from the content array.
In some embodiments, the subtitle adjusting method may further include:
in step S501, a plurality of increasing positive time offsets with equal intervals are sequentially provided from the zero time offset toward the positive direction thereof, and a plurality of decreasing negative time offsets with equal intervals are sequentially provided from the zero time offset toward the negative direction thereof.
Wherein the positive time offset is used to indicate a duration of fast forward while playing the subtitle content, and the negative time offset is used to indicate a duration of rewind while playing the subtitle content.
In step S502, the display 260 is controlled to display the positive time offset and the negative time offset on the caption adjustment page.
In some embodiments, the subtitle adjusting method may further include:
and under the condition that the target playing progress time point does not exist in any subtitle time period, controlling the display 260 not to play any subtitle content while playing the video resource corresponding to the target playing progress time point.
Since the subtitle adjusting method described in this embodiment of the present application may be applied to the controller 250 described in the foregoing embodiment, for other contents of the subtitle adjusting method in this embodiment of the present application, reference may be made to the contents of the foregoing embodiment, which is not described herein again.
Finally, it should be noted that: the above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.
The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims (10)

1. A display device, comprising:
a display configured to play a video resource and subtitle content in the video resource;
a controller configured to:
responding to a page display instruction input by a user, and controlling a display to display a subtitle adjustment page; the subtitle adjustment page provides a time offset option for adjusting subtitle display time for a user;
responding to a subtitle adjustment instruction input after a user watches the subtitle adjustment page, and adding the time offset selected by the user and the current playing progress time point of the video resource to obtain a target playing progress time point;
and controlling a display to play the target subtitle content corresponding to the target playing progress time point while playing the video resource corresponding to the target playing progress time point.
2. The display device of claim 1, wherein the controller is further configured to:
the method comprises the steps that when a display is controlled to play video resources and subtitle contents in the video resources, a menu display instruction input by a user is responded, and a menu page is controlled to be displayed by the display; the menu page includes a subtitle setting option;
responding to a setting page display instruction which is input by a user after the user watches the menu page and used for selecting the subtitle setting option, and controlling a display to display a subtitle setting page; the subtitle setting page comprises a playing adjustment option;
and controlling a display to display a subtitle adjustment page in response to a page display instruction for selecting the playing adjustment option input after the user watches the subtitle setting page.
3. The display device according to any one of claims 1-2, wherein the controller is further configured to:
analyzing a subtitle file in a video resource to obtain all subtitle contents in the video resource and a subtitle time period displayed by each subtitle content;
and storing the caption content and the caption time period in a content array and a time array respectively.
4. The display device of claim 3, wherein the controller is further configured to:
detecting whether the target playing progress time point exists in any subtitle time period of the time array or not;
taking the subtitle time period containing the target playing progress time point as a target time period under the condition that the target playing progress time point exists in any subtitle time period;
and acquiring the target subtitle content corresponding to the target time period from the content array.
5. The display device according to any one of claims 1-2, wherein the controller is further configured to:
sequentially setting a plurality of increasing positive time offsets with equal intervals from the zero time offset to the positive direction of the zero time offset, and sequentially setting a plurality of decreasing negative time offsets with equal intervals from the zero time offset to the negative direction of the zero time offset; wherein, the positive time offset is used for representing the time length of fast forward when the caption content is played, and the negative time offset is used for representing the time length of backward when the caption content is played;
controlling the display to display the positive time offset and the negative time offset on the caption adjustment page.
6. The display device of claim 4, wherein the controller is further configured to:
and under the condition that the target playing progress time point does not exist in any subtitle time period, controlling a display to play the video resource corresponding to the target playing progress time point and simultaneously not play any subtitle content.
7. A method for adjusting subtitles, comprising:
responding to a page display instruction input by a user, and controlling a display to display a subtitle adjustment page; the subtitle adjustment page provides a time offset option for adjusting subtitle display time for a user;
responding to a subtitle adjustment instruction input after a user watches the subtitle adjustment page, and adding the time offset selected by the user and the current playing progress time point of the video resource to obtain a target playing progress time point;
and controlling a display to play the target subtitle content corresponding to the target playing progress time point while playing the video resource corresponding to the target playing progress time point.
8. The method of claim 7, wherein the step of controlling the display to display the subtitle adjustment page in response to the page display instruction input by the user comprises:
the method comprises the steps that when a display is controlled to play video resources and subtitle contents in the video resources, a menu display instruction input by a user is responded, and a menu page is controlled to be displayed by the display; the menu page includes a subtitle setting option;
responding to a setting page display instruction which is input by a user after the user watches the menu page and used for selecting the subtitle setting option, and controlling a display to display a subtitle setting page; the subtitle setting page comprises a playing adjustment option;
and controlling a display to display a subtitle adjustment page in response to a page display instruction for selecting the playing adjustment option input after the user watches the subtitle setting page.
9. The method according to any one of claims 7-8, further comprising:
analyzing a subtitle file in a video resource to obtain all subtitle contents in the video resource and a subtitle time period displayed by each subtitle content;
and storing the caption content and the caption time period in a content array and a time array respectively.
10. The method of claim 9, further comprising:
detecting whether the target playing progress time point exists in any subtitle time period of the time array or not;
taking the subtitle time period containing the target playing progress time point as a target time period under the condition that the target playing progress time point exists in any subtitle time period;
and acquiring the target subtitle content corresponding to the target time period from the content array.
CN202011585396.2A 2020-12-11 2020-12-28 Subtitle adjusting method and display device Pending CN112752156A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202011585396.2A CN112752156A (en) 2020-12-28 2020-12-28 Subtitle adjusting method and display device
PCT/CN2021/119628 WO2022121436A1 (en) 2020-12-11 2021-09-22 Subtitle adjustment method and display device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011585396.2A CN112752156A (en) 2020-12-28 2020-12-28 Subtitle adjusting method and display device

Publications (1)

Publication Number Publication Date
CN112752156A true CN112752156A (en) 2021-05-04

Family

ID=75646497

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011585396.2A Pending CN112752156A (en) 2020-12-11 2020-12-28 Subtitle adjusting method and display device

Country Status (1)

Country Link
CN (1) CN112752156A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113992960A (en) * 2021-10-27 2022-01-28 海信视像科技股份有限公司 Subtitle previewing method on display device and display device
WO2022121436A1 (en) * 2020-12-11 2022-06-16 海信视像科技股份有限公司 Subtitle adjustment method and display device
CN117319738A (en) * 2023-12-01 2023-12-29 飞狐信息技术(天津)有限公司 Subtitle delay method and device, electronic equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103067678A (en) * 2011-10-20 2013-04-24 四川长虹电器股份有限公司 Television subtitle display method and device
CN104104990A (en) * 2014-07-29 2014-10-15 小米科技有限责任公司 Method and device for adjusting subtitles in video
US20160086636A1 (en) * 2014-09-18 2016-03-24 Mstar Semiconductor, Inc. Subtitle processing device and associated method and subtitle parsing method
CN106804011A (en) * 2017-02-10 2017-06-06 深圳创维数字技术有限公司 The method and system of loading caption file during a kind of broadcasting video
CN107105352A (en) * 2017-05-16 2017-08-29 青岛海信电器股份有限公司 Captioning synchronization method and device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103067678A (en) * 2011-10-20 2013-04-24 四川长虹电器股份有限公司 Television subtitle display method and device
CN104104990A (en) * 2014-07-29 2014-10-15 小米科技有限责任公司 Method and device for adjusting subtitles in video
US20160086636A1 (en) * 2014-09-18 2016-03-24 Mstar Semiconductor, Inc. Subtitle processing device and associated method and subtitle parsing method
CN106804011A (en) * 2017-02-10 2017-06-06 深圳创维数字技术有限公司 The method and system of loading caption file during a kind of broadcasting video
CN107105352A (en) * 2017-05-16 2017-08-29 青岛海信电器股份有限公司 Captioning synchronization method and device

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022121436A1 (en) * 2020-12-11 2022-06-16 海信视像科技股份有限公司 Subtitle adjustment method and display device
CN113992960A (en) * 2021-10-27 2022-01-28 海信视像科技股份有限公司 Subtitle previewing method on display device and display device
CN117319738A (en) * 2023-12-01 2023-12-29 飞狐信息技术(天津)有限公司 Subtitle delay method and device, electronic equipment and storage medium
CN117319738B (en) * 2023-12-01 2024-03-08 飞狐信息技术(天津)有限公司 Subtitle delay method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN114302219B (en) Display equipment and variable frame rate display method
CN112672195A (en) Remote controller key setting method and display equipment
CN112153446B (en) Display device and streaming media video audio and video synchronization method
CN112752156A (en) Subtitle adjusting method and display device
CN112019782B (en) Control method and display device of enhanced audio return channel
CN111836115B (en) Screen saver display method, screen saver skipping method and display device
CN112995551A (en) Sound control method and display device
CN113421532B (en) Backlight adjusting method and display device
CN112243141B (en) Display method and display equipment for screen projection function
CN112118400B (en) Display method of image on display device and display device
CN113014939A (en) Display device and playing method
CN113473241A (en) Display equipment and display control method of image-text style menu
CN112055245B (en) Color subtitle realization method and display device
CN114302021A (en) Display device and sound picture synchronization method
CN113593488A (en) Backlight adjusting method and display device
CN112214190A (en) Display equipment resource playing method and display equipment
CN112601109A (en) Audio playing method and display device
CN114095769A (en) Live broadcast low-delay processing method of application-level player and display equipment
CN113064691B (en) Display method and display equipment for starting user interface
CN112911371B (en) Dual-channel video resource playing method and display equipment
CN112118476B (en) Method for rapidly displaying program reservation icon and display equipment
CN114007119A (en) Video playing method and display equipment
CN114302070A (en) Display device and audio output method
CN112668546A (en) Video thumbnail display method and display equipment
CN112363683A (en) Method for supporting multi-layer display of webpage application and display equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20210504

RJ01 Rejection of invention patent application after publication