WO2020135192A1 - 一种多字幕显示方法、智能终端及存储介质 - Google Patents

一种多字幕显示方法、智能终端及存储介质 Download PDF

Info

Publication number
WO2020135192A1
WO2020135192A1 PCT/CN2019/126441 CN2019126441W WO2020135192A1 WO 2020135192 A1 WO2020135192 A1 WO 2020135192A1 CN 2019126441 W CN2019126441 W CN 2019126441W WO 2020135192 A1 WO2020135192 A1 WO 2020135192A1
Authority
WO
WIPO (PCT)
Prior art keywords
subtitle
subtitles
target
user
original
Prior art date
Application number
PCT/CN2019/126441
Other languages
English (en)
French (fr)
Inventor
李其浪
Original Assignee
深圳Tcl新技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳Tcl新技术有限公司 filed Critical 深圳Tcl新技术有限公司
Priority to US17/258,646 priority Critical patent/US20210274262A1/en
Priority to EP19902454.8A priority patent/EP3905663A4/en
Publication of WO2020135192A1 publication Critical patent/WO2020135192A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker
    • H04N21/4884—Data services, e.g. news ticker for displaying subtitles
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/40—Processing or translation of natural language
    • G06F40/58—Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/62—Text, e.g. of license plates, overlay texts or captions on TV images
    • G06V20/635—Overlay text, e.g. embedded captions in a TV program
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440236—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H04N21/4856—End-user interface for client configuration for language selection, e.g. for the menu or subtitles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H04N21/6582—Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8126—Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts
    • H04N21/8133—Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/278—Subtitling

Definitions

  • It relates to the field of computer technology, in particular to a multi-caption display method, an intelligent terminal and a storage medium.
  • Internet TV is no longer a new thing. Because of its rich program resources and convenient and fast playback methods, it is more and more popular, even It has had a big impact on the traditional way of broadcasting TV programs, bringing more colorful information and TV programs to people.
  • the languages spoken by users within a certain viewing range may be diverse.
  • the subtitles that accompany TV programs are relatively simple, and generally only provide subtitles in one language, which cannot be provided to users. Provides an opportunity to choose, which prevents users from choosing subtitles that suit them.
  • the current video subtitle presentation method is mainly to extract the subtitle content from the corresponding subtitle file, present the corresponding subtitle fragment to the corresponding video fragment according to time, and also encode the subtitle information together with the video image itself. Become a part of the video, the two are presented together when the video is decoded and displayed, but if you want to load the target subtitles, such as target subtitles, it may appear to be superimposed with the subtitles in the source video file, causing visual confusion, but affecting the user’s Watch.
  • the present disclosure provides a multi-subtitle display method, an intelligent terminal, and a storage medium, which are designed to translate original subtitles into target subtitles selected by the user, by avoiding the original
  • the display area of the subtitle content displays the target subtitles that the user wants to watch in other areas of the screen at the same time, to avoid the mutual interference of the two subtitles, according to the user's choice from a variety of subtitles to play suitable subtitles for users to facilitate Subtitles to watch the show.
  • a method for displaying multiple subtitles includes:
  • the subtitle information includes original subtitles and coordinate information of the original subtitles in the video frame;
  • the target subtitle is displayed in a display area other than the original subtitle display area according to the coordinate information.
  • the method for displaying multiple subtitles wherein the step of translating the original subtitles into corresponding target subtitles includes:
  • the original subtitle is translated into the target subtitle through a translation application installed locally on the terminal.
  • the method for displaying multiple subtitles wherein the step of translating the original subtitles into corresponding target subtitles includes:
  • the method for displaying multiple subtitles, wherein the uploading of the original subtitles to a server for the server to translate the original subtitles into the target subtitles specifically includes:
  • the target subtitle language is selected from multiple languages provided in advance, and the server selects The target subtitle language, translate all the subtitle information in real time to get the text information corresponding to the target subtitle language.
  • the method for displaying multiple subtitles wherein all the subtitle information acquired in each video frame is uploaded to the server, and a user's selection instruction for selecting a target subtitle language is received. Select from multiple languages, and the server translates all subtitle information in real time to obtain text information corresponding to the target subtitle language according to the target subtitle language selected by the user, including:
  • the subtitle selection request is sent to the server, the server stores a variety of subtitle files corresponding to the TV programs played by the smart TV, and the subtitle selection request is received Then select the subtitle file to which the selected subtitle points, and receive the subtitle file selected by the server according to the selected subtitle.
  • the server pre-stores a variety of subtitle files corresponding to the program.
  • the method for displaying multiple subtitles further comprises:
  • the server uploads all caption information to a third-party server that provides online translation services, and directly translates the third-party server to obtain text information in the target language specified by the user.
  • the method for displaying multiple subtitles wherein, before including the translation of the original subtitles into corresponding target subtitles, the method further includes:
  • the method for displaying multiple subtitles wherein the step of receiving a user's selection instruction for selecting the target subtitle language includes:
  • a list of subtitles containing multiple types of subtitles is displayed on the interface for the user to select, and a selection instruction for the user to select the target subtitle language is received.
  • the multi-subtitle display method wherein, when it is detected that the user needs to select a target subtitle, a list of subtitles containing multiple types of subtitles is displayed on the interface for the user to select, and receives the user's selection of the target subtitle language Instructions, including:
  • Receiving a pre-selection command input by the user displaying a list of subtitles containing multiple types of subtitles according to the pre-selection command, receiving a selection command input by the user, and generating a selection instruction containing the selected subtitles according to the selection command.
  • the selection instruction includes selected subtitles reflecting the user's wishes.
  • the multi-subtitle display method wherein the step of displaying the target subtitle in a display area other than the original subtitle display area according to the coordinate information when playing the video frame includes:
  • the target subtitle is displayed in a display area other than the original subtitle display area according to the coordinate information.
  • the method for displaying multiple subtitles further comprises:
  • the method for displaying multiple subtitles further comprises:
  • the manner in which the target subtitle is displayed in a display area other than the original subtitle display area includes: the target subtitle is displayed in a horizontal manner and the target subtitle is displayed in a vertical manner.
  • An intelligent terminal wherein the intelligent terminal includes: a memory, a processor, and a multi-caption display program stored on the memory and executable on the processor, the multi-caption display program is used by the processor When executed, the steps of the multi-subtitle display method described above are realized.
  • a storage medium wherein the storage medium stores a multi-caption display program, and when the multi-caption display program is executed by a processor, the steps of the multi-caption display method described above are implemented.
  • the present disclosure discloses a multi-subtitle display method, an intelligent terminal, and a storage medium.
  • the method includes: acquiring a video frame after video decoding, and extracting subtitle information in the video frame, the subtitle information including original subtitles and Coordinate information of the original subtitles in the video frame; translate the original subtitles into corresponding target subtitles; when playing the video frame, display the target subtitles in addition to the original according to the coordinate information
  • the display area outside the caption display area avoids the display area of the original subtitle content, and simultaneously displays the target subtitles that the user wants to watch in other areas of the screen, and plays subtitles suitable for him from various subtitles according to the user's choice, so that the user Watch the show.
  • FIG. 1 is a flowchart of a preferred embodiment of the multi-subtitle display method of the present disclosure
  • FIG. 2 is a schematic diagram of an example of extracting video frames for video decoding in a preferred embodiment of the multi-caption display method of the present disclosure
  • FIG. 3 is a schematic diagram of translating the original subtitles in FIG. 2 into a target subtitle language in a preferred embodiment of the multi-subtitle display method of the present disclosure
  • step S30 is a flowchart of step S30 in the preferred embodiment of the multi-caption display method of the present disclosure
  • FIG. 5 is a schematic diagram of two kinds of subtitles displayed simultaneously in a video frame in a preferred embodiment of a multi-subtitle display method of the present disclosure
  • FIG. 6 is a schematic diagram of an operating environment of a preferred embodiment of an intelligent terminal of the present disclosure.
  • the multi-subtitle display method includes the following steps:
  • Step S10 Obtain a video frame after video decoding, and extract subtitle information in the video frame, where the subtitle information includes original subtitles and coordinate information of the original subtitles in the video frame.
  • the displayed subtitles are not suitable for reading, there is a need to display the target subtitles (other subtitle languages).
  • the original subtitles of "Good Morning, China", the original subtitles here are only examples and can be other subtitle content in the video.
  • the subtitle information includes original subtitles and coordinate information of the original subtitles in the video frame, for example, "Good Morning, China” in Figure 2, and analyze Record the coordinate information (x1, y1) of the subtitle content, for example, the coordinate information (x1, y1) of “Good Morning, China” in FIG. 2.
  • Step S20 Translate the original subtitles into corresponding target subtitles.
  • a user selection instruction to select the target subtitle language is received, and the language corresponding to the target subtitles is determined according to the selection instructions. That is to say, when it is detected that the user needs to select a target subtitle, a list of subtitles containing multiple types of subtitles is displayed on the interface for the user to select, and receives a user's selection instruction to select the target subtitle language.
  • the subtitle selection instruction contains selected subtitles reflecting the user's wishes, for example, the target subtitle language is English, that is, the selected subtitles that the user wants to be able to see.
  • the translation of the original subtitles into the target subtitles by the server can be achieved through the following process:
  • the target subtitle language is selected from multiple languages provided in advance.
  • the server selects the target subtitle language according to the user , Translate all subtitle information in real time to get the text information corresponding to the target subtitle language.
  • the disclosure can translate all subtitle information in real time to obtain text information corresponding to the target subtitle language, and can also upload the text information to a third-party server that provides online translation services.
  • the server directly translates the text information in the target language specified by the user, that is, the original subtitle information needs to be translated into the subtitle information in the language selected by the user.
  • the conversion of the subtitle information in FIG. 2 is shown in FIG. 3. "Good morning, China” is translated as "Good Morning China”.
  • a subtitle list is displayed on the display interface.
  • the subtitle list includes multiple subtitle types, including Chinese, Subtitles in English, French, German or minority languages. If the user further selects at this time, the selection command input by the user is received. After receiving the selection command, a subtitle selection instruction containing the selected subtitle is generated according to the selection command. The subtitle is the subtitle pointed to by the above selection command, and sends the subtitle selection request to the server.
  • the original subtitles On the basis of the original subtitles, it can only be converted into a certain selective language at a time, for example, the video itself is Chinese, and the user can only choose to translate into one of English, Korean, Japanese, French and other languages at a time , So that subtitles in two languages can be displayed on the screen at the same time.
  • the subtitle selection request is sent to a server (such as a subtitle server) of the smart TV playback system, for example, the server stores various types of TV programs corresponding to the TV programs played by the smart TV.
  • Subtitle file which selects the subtitle file pointed to by the selected subtitle after receiving the subtitle selection request, and receives the subtitle file selected by the server according to the selected subtitle, that is, the server pre-stores a variety of subtitle files corresponding to the program
  • the subtitle file pointed to by the selected subtitle is selected from a variety of subtitle files, and the text information is translated into the text information of the target subtitle according to the subtitle file.
  • Step S30 When playing the video frame, display the target subtitle in a display area other than the original subtitle display area according to the coordinate information.
  • FIG. 4 is a flowchart of step S30 in the multi-subtitle display method provided by the present disclosure.
  • the step S30 includes:
  • the coordinate area (x1, y1) of the display area of the original subtitle is avoided, at other locations ,
  • the display area at the location (x2, y2) displays the second type of text information (target subtitles).
  • target subtitles For example, in Figure 5, the Chinese characters "Good Morning, China” (original subtitles) and "Good Morning” China (target subtitles) At the same time, it is displayed in the video screen.
  • “Good Morning” China (target subtitle) is displayed at the top of the screen.
  • “Good morning, China” (original subtitle) is still retained at the bottom of the video screen. Both subtitles can be simultaneously. They are displayed on the video screen without interference with each other.
  • the text information of the target subtitles sent by the server is received and the display area is allocated, the text information of the target subtitles is played together with the currently playing program.
  • the user can also receive the switching instruction for switching the target subtitle in real time, and according to the switching instruction, switch the current target subtitle to the newly selected target subtitle, that is, according to the user's Willing to switch target subtitles in real time.
  • the display method of the text information of the target subtitle on the screen includes horizontal display and vertical display, that is, the method of displaying the target subtitle in a display area other than the original subtitle display area includes: the target subtitle is displayed in a horizontal manner And the target subtitles are displayed vertically.
  • the display mode in FIG. 5 is horizontal display (horizontal display above the video screen), of course, it may also be displayed in vertical mode, for example, vertical display on the left or right side of the video screen.
  • the present disclosure also correspondingly provides a smart terminal (eg, smart TV, smart tablet, smart phone, etc.), the smart terminal includes a processor 10 and a memory 20 And monitor 30.
  • FIG. 6 only shows some components of the smart terminal, but it should be understood that it is not required to implement all the components shown, and more or fewer components may be implemented instead.
  • the memory 20 may be an internal storage unit of the smart terminal, such as a hard disk or a memory of the smart terminal.
  • the memory 20 may also be an external storage device of the smart terminal, such as a plug-in hard disk equipped on the smart terminal, a smart memory card (Smart Media, Card, SMC), and a secure digital (Secure Digital, SD) card, flash card (Flash Card), etc.
  • the memory 20 may also include both an internal storage unit of the smart terminal and an external storage device.
  • the memory 20 is used to store application software and various types of data installed on the smart terminal, such as the program code of the smart terminal installation.
  • the memory 20 may also be used to temporarily store data that has been or will be output.
  • the multi-subtitle display program 40 is stored on the memory 20, and the multi-subtitle display program 40 can be executed by the processor 10, thereby implementing the multi-subtitle display method in the present application.
  • the processor 10 may be a central processing unit (CPU), a microprocessor, or other data processing chip, which is used to run the program code or process data stored in the memory 20, for example Perform the multi-subtitle display method and the like.
  • CPU central processing unit
  • microprocessor or other data processing chip, which is used to run the program code or process data stored in the memory 20, for example Perform the multi-subtitle display method and the like.
  • the display 30 may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode, organic light emitting diode) touch device, or the like.
  • the display 30 is used to display information on the smart terminal and to display a visual user interface.
  • the components 10-30 of the intelligent terminal communicate with each other through a system bus.
  • the subtitle information includes original subtitles and coordinate information of the original subtitles in the video frame;
  • the target subtitle is displayed in a display area other than the original subtitle display area according to the coordinate information.
  • the step of translating the original subtitles into corresponding target subtitles includes:
  • the original subtitle is translated into the target subtitle through a translation application installed locally on the terminal.
  • the step of translating the original subtitles into corresponding target subtitles includes:
  • the uploading of the original subtitles to the server for the server to translate the original subtitles into the target subtitles includes:
  • the target subtitle language is selected from multiple languages provided in advance, and the server selects The target subtitle language, translate all the subtitle information in real time to get the text information corresponding to the target subtitle language.
  • the subtitle selection request is sent to the server, the server stores a variety of subtitle files corresponding to the TV programs played by the smart TV, and upon receiving the subtitle selection request Then select the subtitle file to which the selected subtitle points, and receive the subtitle file selected by the server according to the selected subtitle.
  • the server pre-stores a variety of subtitle files corresponding to the program.
  • the method for displaying multiple subtitles further includes:
  • the server uploads all caption information to a third-party server that provides online translation services, and directly translates the third-party server to obtain text information in the target language specified by the user.
  • the method further includes:
  • the step of receiving the user's selection instruction to select the target subtitle language includes:
  • a list of subtitles containing multiple types of subtitles is displayed on the interface for the user to select, and a selection instruction for the user to select the target subtitle language is received.
  • a list of subtitles containing various types of subtitles is displayed on the interface for the user to select, and receives a user's selection instruction to select the target subtitle language, specifically including:
  • Receiving a pre-selection command input by the user displaying a list of subtitles containing multiple types of subtitles according to the pre-selection command, receiving a selection command input by the user, and generating a selection instruction containing the selected subtitles according to the selection command.
  • the selection instruction includes selected subtitles reflecting the user's wishes.
  • the step of displaying the target subtitle in a display area other than the original subtitle display area according to the coordinate information when playing the video frame includes:
  • the target subtitle is displayed in a display area other than the original subtitle display area according to the coordinate information.
  • the method for displaying multiple subtitles further includes:
  • the method for displaying multiple subtitles further includes:
  • the manner in which the target subtitle is displayed in a display area other than the original subtitle display area includes: the target subtitle is displayed in a horizontal manner and the target subtitle is displayed in a vertical manner.
  • the present disclosure also provides a storage medium, wherein the storage medium stores a multi-caption display program, and when the multi-caption display program is executed by a processor, the steps of the multi-caption display method described above are implemented.
  • the present disclosure provides a multi-caption display method, an intelligent terminal, and a storage medium.
  • the method includes: acquiring a video frame after video decoding, and extracting caption information in the video frame, the caption information Including original subtitles and coordinate information of the original subtitles in the video frame; translating the original subtitles into corresponding target subtitles; when playing the video frame, displaying the target subtitles according to the coordinate information A display area other than the original subtitle display area.
  • the present disclosure displays the target subtitles that the user wants to watch in other areas of the screen at the same time by circumventing the display area of the original subtitle content, and plays the subtitles suitable for them from a variety of subtitles according to the user's choice, so that the user Watch the show.
  • a computer program instructing relevant hardware (such as a processor, a controller, etc.), and the program can be stored in a
  • the program may include the processes of the foregoing method embodiments when executed.
  • the storage medium may be a memory, a magnetic disk, an optical disk, and so on.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

公开了一种多字幕显示方法、智能终端及存储介质，所述方法包括：获取经视频解码后的视频帧，并提取所述视频帧中的字幕信息，所述字幕信息包括原始字幕以及所述原始字幕于所述视频帧中的坐标信息；将所述原始字幕翻译成对应的目标字幕；在播放所述视频帧时，根据所述坐标信息将所述目标字幕显示在除所述原始字幕显示区域之外的显示区域。本公开通过规避原始字幕内容的显示区域，将用户想要观看的目标字幕同时显示在屏幕的其他区域，根据用户的选择从多种字幕中播放适合自己的字幕，方便用户通过适合自己的字幕来观看节目。

Description

一种多字幕显示方法、智能终端及存储介质
优先权
所述PCT专利申请要求申请日为2018年12月24日，申请号为201811585018.7的中国专利优先权，本专利申请结合了上述专利的技术方案。
技术领域
涉及计算机技术领域，尤其涉及一种多字幕显示方法、智能终端及存储介质。
背景技术
随着互联网技术的发展和普及，各种智能终端发展迅速，例如网络电视已经不再是新鲜事物，其因为丰富的节目资源，方便快捷的播放方式，越来越多地得到人们的欢迎，甚至已经对传统的电视节目播放方式产生了较大的冲击，为人们带来了更加丰富多彩的资讯和电视节目。
由于目前人们的流动性非常高，处于一定收视范围内的用户所操的语言可能多种多样，然而伴随电视节目所播放的字幕且较为单一，一般只会提供一种语言的字幕，无法给用户提供选择的机会，造成用户无法选择适合自己的字幕。
目前的视频字幕呈现方式主要是从对应的字幕文件中提取字幕内容，将对应字幕片段根据时间呈现到对应的视频片段上，另外就是将字幕信息与视频图像本身一起编码，该处理方式字幕信息将成为视频的一部分，在视频播放解码并显示的时候两者一起同时呈现，但是如果要加载目标字幕，比如目标字幕，将可能出现与源视频文件中的字幕叠加，造成视觉混乱，反而影响用户的观看。
因此，现有技术还有待于改进和发展。
发明内容
本公开要解决的技术问题在于，针对现有技术中的上述缺陷，本公开提供一种多字幕显示方法、智能终端及存储介质，旨在将原始字幕翻译成用户选择的目标字幕，通过规避原始字幕内容的显示区域，将用户想要观看的目标字幕同时显示在屏幕的其他区域，避免两种字幕的相互干扰，根据用户的选择从多种字幕中播放适合自己的字幕，方便用户通过适合自己的字幕来观看节目。
本公开解决技术问题所采用的技术方案如下：
一种多字幕显示方法，其中，所述多字幕显示方法包括：
获取经视频解码后的视频帧，并提取所述视频帧中的字幕信息，所述字幕信息包括原始字幕以及所述原始字幕于所述视频帧中的坐标信息；
将所述原始字幕翻译成对应的目标字幕；
在播放所述视频帧时，根据所述坐标信息将所述目标字幕显示在除所述原始字幕显示区域之外的显示区域。
所述的多字幕显示方法，其中，所述将所述原始字幕翻译成对应的目标字幕的步骤包括：
通过终端本地安装的翻译应用将所述原始字幕翻译成所述目标字幕。
所述的多字幕显示方法，其中，所述将所述原始字幕翻译成对应的目标字幕的步骤包括：
将所述原始字幕上传至服务器，以供所述服务器将所述原始字幕翻译成所述目标字幕。
所述的多字幕显示方法，其中，所述将所述原始字幕上传至服务器，以供所述服务器将所述原始字幕翻译成所述目标字幕，具体包括：
将在每个视频帧中获取的字幕信息全部上传到所述服务器，接收用户选择目标字幕语言的选择指令，所述目标字幕语言从预先提供的多种语言中进行选择，所述服务器根据用户选择的目标字幕语言，将所有的字幕信息实时翻译得到目标字幕语言对应的文字信息。
所述的多字幕显示方法，其中，所述将在每个视频帧中获取的字幕信息全部上传到所述服务器，接收用户选择目标字幕语言的选择指令，所述目标字幕语言从预先提供的多种语言中进行选择，所述服务器根据用户选择的目标字幕语言，将所有的字幕信息实时翻译得到目标字幕语言对应的文字信息，具体包括：
在接收到用户输入的字幕选择请求后，将所述字幕选择请求发送到服务器，所述服务器中存储有与智能电视所播放的电视节目对应的多种字幕文件，在接收到所述字幕选择请求后从中选取所述选定字幕所指向的字幕文件，接收服务器根据选定字幕选取的字幕文件，所述服务器预先存储有节目对应的多种字幕文件，在接收到所述字幕选择请求后，从多种字幕文件中选取选定字幕所指向的字幕文 件，根据字幕文件将文字信息翻译成目标字幕的文字信息。
所述的多字幕显示方法，其中，所述多字幕显示方法还包括：
所述服务器将所有的字幕信息上传到提供在线翻译服务第三方服务器，通过所述第三方服务器直接翻译得到用户指定目标语言的文字信息。
所述的多字幕显示方法，其中，所述将所述原始字幕翻译成对应的目标字幕的包括之前，还包括：
接收用户选择所述目标字幕语言的选择指令，并很据所述选择指令确定所述目标字幕对应的语言。
所述的多字幕显示方法，其中，所述接收用户选择所述目标字幕语言的选择指令的步骤包括：
检测到用户需要选择目标字幕时，将包含多种字幕种类的字幕列表显示在界面上供用户进行选择，并接收用户选择所述目标字幕语言的选择指令。
所述的多字幕显示方法，其中，所述检测到用户需要选择目标字幕时，将包含多种字幕种类的字幕列表显示在界面上供用户进行选择，并接收用户选择所述目标字幕语言的选择指令，具体包括：
接收用户输入的预选择命令，根据所述预选择命令显示包含多个字幕种类的字幕列表，接收用户输入的选择命令，根据所述选择命令生成包含所选定字幕的选择指令。
所述的多字幕显示方法，其中，所述选择指令包含有反映用户意愿的选定字幕。
所述的多字幕显示方法，其中，所述在播放所述视频帧时，根据所述坐标信息将所述目标字幕显示在除所述原始字幕显示区域之外的显示区域的步骤包括；
获取所述原始字幕于所述视频帧中的坐标信息和翻译得到的所述目标字幕；
在播放所述视频帧的过程中，根据所述坐标信息将所述目标字幕显示在除所述原始字幕显示区域之外的显示区域。
所述的多字幕显示方法，其中，所述多字幕显示方法还包括：
实时接收用户切换目标字幕的切换指令，并很据所述切换指令将当前目标字幕切换到最新选择的目标字幕。
所述的多字幕显示方法，其中，所述多字幕显示方法还包括：
所述目标字幕在除所述原始字幕显示区域之外的显示区域显示的方式包括：目标字幕以水平方式显示和目标字幕以垂直方式显示。
一种智能终端，其中，所述智能终端包括：存储器、处理器及存储在所述存储器上并可在所述处理器上运行的多字幕显示程序，所述多字幕显示程序被所述处理器执行时实现如上所述的多字幕显示方法的步骤。
一种存储介质，其中，所述存储介质存储有多字幕显示程序，所述多字幕显示程序被处理器执行时实现如上所述的多字幕显示方法的步骤。
本公开公开了一种多字幕显示方法、智能终端及存储介质，所述方法包括：获取经视频解码后的视频帧，并提取所述视频帧中的字幕信息，所述字幕信息包括原始字幕以及所述原始字幕于所述视频帧中的坐标信息；将所述原始字幕翻译成对应的目标字幕；在播放所述视频帧时，根据所述坐标信息将所述目标字幕显示在除所述原始字幕显示区域之外的显示区域。本公开通过规避原始字幕内容的显示区域，将用户想要观看的目标字幕同时显示在屏幕的其他区域，根据用户的选择从多种字幕中播放适合自己的字幕，方便用户通过适合自己的字幕来观看节目。
附图说明
图1是本公开多字幕显示方法的较佳实施例的流程图；
图2是本公开多字幕显示方法的较佳实施例中提取视频解码的视频帧举例的示意图；
图3是本公开多字幕显示方法的较佳实施例中将图2中的原始字幕进行翻译转换成目标字幕语言的示意图；
图4是本公开多字幕显示方法的较佳实施例中步骤S30的流程图；
图5是本公开多字幕显示方法的较佳实施例中两种字幕在视频画面中同时显示的示意图；
图6为本公开智能终端的较佳实施例的运行环境示意图。
具体实施方式
为使本公开的目的、技术方案及优点更加清楚、明确，以下参照附图并举实施例对本公开进一步详细说明。应当理解，此处所描述的具体实施例仅仅用以解 释本公开，并不用于限定本公开。
实施例一
本公开较佳实施例所述的多字幕显示方法，如图1所示，所述多字幕显示方法包括以下步骤：
步骤S10、获取经视频解码后的视频帧，并提取所述视频帧中的字幕信息，所述字幕信息包括原始字幕以及所述原始字幕于所述视频帧中的坐标信息。
具体地，例如当用户收看电视节目时，如果显示的字幕不适合自己阅读时，就出现了需要显示目标字幕(其他字幕的语言)的需求，可以通过获取经视频解码后的视频帧，并提取所述视频帧中的字幕信息，如图2所示，提取了智能电视某一视频中的某一帧，此处未显示画面内容，任何画面均可，此处只给出了当前视频帧中的原始字幕“早安，中国”，此处的原始字幕仅仅为示例，可以为视频中的其他字幕内容。
提取每个视频帧中的字幕信息(文字信息)，所述字幕信息包括原始字幕以及所述原始字幕于所述视频帧中的坐标信息，例如图2中的“早安，中国”，并分析记录字幕内容的坐标信息(x1，y1)，例如图2中的“早安，中国”的坐标信息(x1，y1)。
步骤S20、将所述原始字幕翻译成对应的目标字幕。
具体地，在将所述原始字幕翻译成对应的目标字幕的包括之前，接收用户选择所述目标字幕语言的选择指令，并很据所述选择指令确定所述目标字幕对应的语言。也就是说，当检测到用户需要选择目标字幕时，将包含多种字幕种类的字幕列表显示在界面上供用户进行选择，并接收用户选择所述目标字幕语言的选择指令。
例如可以具体通过如下步骤实现：接收用户输入的预选择命令，根据所述预选择命令显示包含多个字幕种类的字幕列表，接收用户输入的选择命令，根据所述选择命令生成包含所选定字幕的选择指令；通过接收目标字幕的选择指令，该字幕选择指令包含有反映用户意愿的选定字幕，例如目标字幕语言为英语，即用户希望能够看到的选定字幕。
本公开中，将所述原始字幕翻译成对应的目标字幕的方式主要有两种，一种是通过终端本地安装的翻译应用(例如本地安装的翻译软件)将所述原始字幕翻 译成所述目标字幕，另一种是将所述原始字幕上传至服务器，以供所述服务器将所述原始字幕翻译成所述目标字幕。
例如，通过服务器将所述原始字幕翻译成所述目标字幕可以通过如下过程实现：
将在每个视频帧中获取的字幕信息全部上传到服务器，接收用户选择目标字幕语言的选择指令，所述目标字幕语言从预先提供的多种语言中进行选择，服务器根据用户选择的目标字幕语言，将所有的字幕信息实时翻译得到目标字幕语言对应的文字信息。
进一步地，本公开可以通过服务器根据用户选择的目标字幕语言，将所有的字幕信息实时翻译得到目标字幕语言对应的文字信息，还可以将文字信息上传到提供在线翻译服务第三方服务器，通过第三方服务器直接翻译得到用户指定目标语言的文字信息，也就是需要将原始字幕的信息翻译转换成用户选择的语言的字幕信息，例如图2中的字幕信息的转换如图3所示，将中文的“早安，中国”翻译得到“Good Morning China”。
首先接收用户输入的预选择命令，该命令预示用户想要选择适合自己的字幕，在接收到预选择命令后，在显示界面上显示字幕列表，该字幕列表上包括多个字幕种类，包括汉语、英语、法语、德语或少数民族语言的字幕，如果此时用户进一步选择，则接收用户输入的选择命令，在接收到选择命令后，根据该选择命令生成包含选定字幕的字幕选择指令，选定字幕为上述选择命令所指向的字幕，将字幕选择请求发送到服务器。
在原有字幕的基础上，每次仅仅可以转换成某一种选择性的语言，比如视频本身是中文的，用户每次只能选择翻译成英文、韩文、日本、法文等语言中的某一种，使得屏幕上可以同时显示两种语言的字幕。
进一步地，在接收到用户输入的字幕选择请求后，将该字幕选择请求发送到智能电视播放系统的服务器(例如字幕服务器)，例如服务器中存储有与智能电视所播放的电视节目对应的多种字幕文件，其在接收到该字幕选择请求后从中选取该选定字幕所指向的字幕文件，接收服务器根据选定字幕选取的字幕文件，也就是说，服务器预先存储有节目对应的多种字幕文件，在接收到字幕选择请求后，从多种字幕文件中选取选定字幕所指向的字幕文件，根据字幕文件将文字信息翻 译成目标字幕的文字信息。
步骤S30、在播放所述视频帧时，根据所述坐标信息将所述目标字幕显示在除所述原始字幕显示区域之外的显示区域。
具体过程请参阅图4，其为本公开提供的多字幕显示方法中步骤S30的流程图。
如图4所示，所述步骤S30包括：
S31、获取所述原始字幕于所述视频帧中的坐标信息和翻译得到的所述目标字幕；
S32、在播放所述视频帧的过程中，根据所述坐标信息将所述目标字幕显示在除所述原始字幕显示区域之外的显示区域。
具体地，根据原始字幕内容的坐标信息，例如图2中的“早安，中国”的坐标信息(x1，y1)，避开原始字幕的显示区域的坐标区域(x1、y1)，在其他位置，例如位置(x2、y2)的显示区域显示第二种文字信息(目标字幕)，例如图5中，将中文的“早安，中国”(原始字幕)和“Good Morning China”(目标字幕)同时显示在视频画面中，图5中将“Good Morning China”(目标字幕)显示在了画面的上方，“早安，中国”(原始字幕)依旧保留在视频画面的下方，两种字幕可以同时互不干扰的显示在视频画面中，当接收服务器发送的目标字幕的文字信息并分配显示区域后，将目标字幕的文字信息与当前正在播放的节目一起播放。
另外，在播放了用户当前选择的目标字幕时，还可以实时接收用户切换目标字幕的切换指令，并很据所述切换指令将当前目标字幕切换到最新选择的目标字幕，也就是可以根据用户的意愿实时切换目标字幕。
进一步地，目标字幕的文字信息在屏幕上的显示方式包括水平显示和垂直显示，即所述目标字幕在除所述原始字幕显示区域之外的显示区域显示的方式包括：目标字幕以水平方式显示和目标字幕以垂直方式显示。例如图5中的显示方式是水平显示(水平显示在视频画面的上方)，当然也可以是垂直方式显示，例如垂直显示在视频画面的左侧或者右侧。
实施例二
进一步地，如图6所示，基于上述多字幕显示方法，本公开还相应提供了一种智能终端(例如智能电视、智能平板、智能手机等)，所述智能终端包括处理 器10、存储器20及显示器30。图6仅示出了智能终端的部分组件，但是应理解的是，并不要求实施所有示出的组件，可以替代的实施更多或者更少的组件。
所述存储器20在一些实施例中可以是所述智能终端的内部存储单元，例如智能终端的硬盘或内存。所述存储器20在另一些实施例中也可以是所述智能终端的外部存储设备，例如所述智能终端上配备的插接式硬盘，智能存储卡(Smart Media Card,SMC)，安全数字(Secure Digital,SD)卡，闪存卡(Flash Card)等。进一步地，所述存储器20还可以既包括所述智能终端的内部存储单元也包括外部存储设备。所述存储器20用于存储安装于所述智能终端的应用软件及各类数据，例如所述安装智能终端的程序代码等。所述存储器20还可以用于暂时地存储已经输出或者将要输出的数据。在一实施例中，存储器20上存储有多字幕显示程序40，该多字幕显示程序40可被处理器10所执行，从而实现本申请中多字幕显示方法。
所述处理器10在一些实施例中可以是一中央处理器(Central Processing Unit,CPU)，微处理器或其他数据处理芯片，用于运行所述存储器20中存储的程序代码或处理数据，例如执行所述多字幕显示方法等。
所述显示器30在一些实施例中可以是LED显示器、液晶显示器、触控式液晶显示器以及OLED(Organic Light-Emitting Diode，有机发光二极管)触摸器等。所述显示器30用于显示在所述智能终端的信息以及用于显示可视化的用户界面。所述智能终端的部件10-30通过系统总线相互通信。
在一实施例中，当处理器10执行所述存储器20中多字幕显示程序40时实现以下步骤：
获取经视频解码后的视频帧，并提取所述视频帧中的字幕信息，所述字幕信息包括原始字幕以及所述原始字幕于所述视频帧中的坐标信息；
将所述原始字幕翻译成对应的目标字幕；
在播放所述视频帧时，根据所述坐标信息将所述目标字幕显示在除所述原始字幕显示区域之外的显示区域。
所述将所述原始字幕翻译成对应的目标字幕的步骤包括：
通过终端本地安装的翻译应用将所述原始字幕翻译成所述目标字幕。
所述将所述原始字幕翻译成对应的目标字幕的步骤包括：
将所述原始字幕上传至服务器，以供所述服务器将所述原始字幕翻译成所述目标字幕。
所述将所述原始字幕上传至服务器，以供所述服务器将所述原始字幕翻译成所述目标字幕，具体包括：
将在每个视频帧中获取的字幕信息全部上传到所述服务器，接收用户选择目标字幕语言的选择指令，所述目标字幕语言从预先提供的多种语言中进行选择，所述服务器根据用户选择的目标字幕语言，将所有的字幕信息实时翻译得到目标字幕语言对应的文字信息。
所述将在每个视频帧中获取的字幕信息全部上传到所述服务器，接收用户选择目标字幕语言的选择指令，所述目标字幕语言从预先提供的多种语言中进行选择，所述服务器根据用户选择的目标字幕语言，将所有的字幕信息实时翻译得到目标字幕语言对应的文字信息，具体包括：
在接收到用户输入的字幕选择请求后，将所述字幕选择请求发送到服务器，所述服务器中存储有与智能电视所播放的电视节目对应的多种字幕文件，在接收到所述字幕选择请求后从中选取所述选定字幕所指向的字幕文件，接收服务器根据选定字幕选取的字幕文件，所述服务器预先存储有节目对应的多种字幕文件，在接收到所述字幕选择请求后，从多种字幕文件中选取选定字幕所指向的字幕文件，根据字幕文件将文字信息翻译成目标字幕的文字信息。
所述多字幕显示方法还包括：
所述服务器将所有的字幕信息上传到提供在线翻译服务第三方服务器，通过所述第三方服务器直接翻译得到用户指定目标语言的文字信息。
所述将所述原始字幕翻译成对应的目标字幕的包括之前，还包括：
接收用户选择所述目标字幕语言的选择指令，并很据所述选择指令确定所述目标字幕对应的语言。
所述接收用户选择所述目标字幕语言的选择指令的步骤包括：
检测到用户需要选择目标字幕时，将包含多种字幕种类的字幕列表显示在界面上供用户进行选择，并接收用户选择所述目标字幕语言的选择指令。
所述检测到用户需要选择目标字幕时，将包含多种字幕种类的字幕列表显示在界面上供用户进行选择，并接收用户选择所述目标字幕语言的选择指令，具体 包括：
接收用户输入的预选择命令，根据所述预选择命令显示包含多个字幕种类的字幕列表，接收用户输入的选择命令，根据所述选择命令生成包含所选定字幕的选择指令。
所述选择指令包含有反映用户意愿的选定字幕。
所述在播放所述视频帧时，根据所述坐标信息将所述目标字幕显示在除所述原始字幕显示区域之外的显示区域的步骤包括；
获取所述原始字幕于所述视频帧中的坐标信息和翻译得到的所述目标字幕；
在播放所述视频帧的过程中，根据所述坐标信息将所述目标字幕显示在除所述原始字幕显示区域之外的显示区域。
所述多字幕显示方法还包括：
实时接收用户切换目标字幕的切换指令，并很据所述切换指令将当前目标字幕切换到最新选择的目标字幕。
所述多字幕显示方法还包括：
所述目标字幕在除所述原始字幕显示区域之外的显示区域显示的方式包括：目标字幕以水平方式显示和目标字幕以垂直方式显示。
实施例三
本公开还提供一种存储介质，其中，所述存储介质存储有多字幕显示程序，所述多字幕显示程序被处理器执行时实现如上所述的多字幕显示方法的步骤。
综上所述，本公开提供一种多字幕显示方法、智能终端及存储介质，所述方法包括：获取经视频解码后的视频帧，并提取所述视频帧中的字幕信息，所述字幕信息包括原始字幕以及所述原始字幕于所述视频帧中的坐标信息；将所述原始字幕翻译成对应的目标字幕；在播放所述视频帧时，根据所述坐标信息将所述目标字幕显示在除所述原始字幕显示区域之外的显示区域。本公开通过规避原始字幕内容的显示区域，将用户想要观看的目标字幕同时显示在屏幕的其他区域，根据用户的选择从多种字幕中播放适合自己的字幕，方便用户通过适合自己的字幕来观看节目。
当然，本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程，是可以通过计算机程序来指令相关硬件(如处理器，控制器等)来完成，所 述的程序可存储于一计算机可读取的存储介质中，所述程序在执行时可包括如上述各方法实施例的流程。其中所述的存储介质可为存储器、磁碟、光盘等。
应当理解的是，本公开的应用不限于上述的举例，对本领域普通技术人员来说，可以根据上述说明加以改进或变换，所有这些改进和变换都应属于本公开所附权利要求的保护范围。

Claims (15)

  1. 一种多字幕显示方法，其特征在于，所述多字幕显示方法包括：
    获取经视频解码后的视频帧，并提取所述视频帧中的字幕信息，所述字幕信息包括原始字幕以及所述原始字幕于所述视频帧中的坐标信息；
    将所述原始字幕翻译成对应的目标字幕；
    在播放所述视频帧时，根据所述坐标信息将所述目标字幕显示在除所述原始字幕显示区域之外的显示区域。
  2. 根据权利要求1所述的多字幕显示方法，其特征在于，所述将所述原始字幕翻译成对应的目标字幕的步骤包括：
    通过终端本地安装的翻译应用将所述原始字幕翻译成所述目标字幕。
  3. 根据权利要求1所述的多字幕显示方法，其特征在于，所述将所述原始字幕翻译成对应的目标字幕的步骤包括：
    将所述原始字幕上传至服务器，以供所述服务器将所述原始字幕翻译成所述目标字幕。
  4. 根据权利要求3所述的多字幕显示方法，其特征在于，所述将所述原始字幕上传至服务器，以供所述服务器将所述原始字幕翻译成所述目标字幕，具体包括：
    将在每个视频帧中获取的字幕信息全部上传到所述服务器，接收用户选择目标字幕语言的选择指令，所述目标字幕语言从预先提供的多种语言中进行选择，所述服务器根据用户选择的目标字幕语言，将所有的字幕信息实时翻译得到目标字幕语言对应的文字信息。
  5. 根据权利要求4所述的多字幕显示方法，其特征在于，所述将在每个视频帧中获取的字幕信息全部上传到所述服务器，接收用户选择目标字幕语言的选择指令，所述目标字幕语言从预先提供的多种语言中进行选择，所述服务器根据用户选择的目标字幕语言，将所有的字幕信息实时翻译得到目标字幕语言对应的文字信息，具体包括：
    在接收到用户输入的字幕选择请求后，将所述字幕选择请求发送到服务器，所述服务器中存储有与智能电视所播放的电视节目对应的多种字幕文件，在接收到所述字幕选择请求后从中选取所述选定字幕所指向的字幕文件，接收服务器根据选定字幕选取的字幕文件，所述服务器预先存储有节目对应的多种字幕文件， 在接收到所述字幕选择请求后，从多种字幕文件中选取选定字幕所指向的字幕文件，根据字幕文件将文字信息翻译成目标字幕的文字信息。
  6. 根据权利要求3所述的多字幕显示方法，其特征在于，所述多字幕显示方法还包括：
    所述服务器将所有的字幕信息上传到提供在线翻译服务第三方服务器，通过所述第三方服务器直接翻译得到用户指定目标语言的文字信息。
  7. 根据权利要求1所述的多字幕显示方法，其特征在于，所述将所述原始字幕翻译成对应的目标字幕的包括之前，还包括：
    接收用户选择所述目标字幕语言的选择指令，并很据所述选择指令确定所述目标字幕对应的语言。
  8. 根据权利要求7所述的多字幕显示方法，其特征在于，所述接收用户选择所述目标字幕语言的选择指令的步骤包括：
    检测到用户需要选择目标字幕时，将包含多种字幕种类的字幕列表显示在界面上供用户进行选择，并接收用户选择所述目标字幕语言的选择指令。
  9. 根据权利要求8所述的多字幕显示方法，其特征在于，所述检测到用户需要选择目标字幕时，将包含多种字幕种类的字幕列表显示在界面上供用户进行选择，并接收用户选择所述目标字幕语言的选择指令，具体包括：
    接收用户输入的预选择命令，根据所述预选择命令显示包含多个字幕种类的字幕列表，接收用户输入的选择命令，根据所述选择命令生成包含所选定字幕的选择指令。
  10. 根据权利要求9所述的多字幕显示方法，其特征在于，所述选择指令包含有反映用户意愿的选定字幕。
  11. 根据权利要求2或3所述的多字幕显示方法，其特征在于，所述在播放所述视频帧时，根据所述坐标信息将所述目标字幕显示在除所述原始字幕显示区域之外的显示区域的步骤包括；
    获取所述原始字幕于所述视频帧中的坐标信息和翻译得到的所述目标字幕；
    在播放所述视频帧的过程中，根据所述坐标信息将所述目标字幕显示在除所述原始字幕显示区域之外的显示区域。
  12. 根据权利要求11所述的多字幕显示方法，其特征在于，所述多字幕显示 方法还包括：
    实时接收用户切换目标字幕的切换指令，并很据所述切换指令将当前目标字幕切换到最新选择的目标字幕。
  13. 根据权利要求1所述的多字幕显示方法，其特征在于，所述多字幕显示方法还包括：
    所述目标字幕在除所述原始字幕显示区域之外的显示区域显示的方式包括：目标字幕以水平方式显示和目标字幕以垂直方式显示。
  14. 一种智能终端，其特征在于，所述智能终端包括：存储器、处理器及存储在所述存储器上并可在所述处理器上运行的多字幕显示程序，所述多字幕显示程序被所述处理器执行时实现如权利要求1-13任一项所述的多字幕显示方法的步骤。
  15. 一种存储介质，其特征在于，所述存储介质存储有多字幕显示程序，所述多字幕显示程序被处理器执行时实现如权利要求1-13任一项所述的多字幕显示方法的步骤。
PCT/CN2019/126441 2018-12-24 2019-12-19 一种多字幕显示方法、智能终端及存储介质 WO2020135192A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US17/258,646 US20210274262A1 (en) 2018-12-24 2019-12-19 Multi-subtitle display method, intelligent terminal and storage medium
EP19902454.8A EP3905663A4 (en) 2018-12-24 2019-12-19 METHOD OF DISPLAYING MULTIPLE SUBTITLES, INTELLIGENT DEVICE AND STORAGE MEDIA

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811585018.7 2018-12-24
CN201811585018.7A CN111356025A (zh) 2018-12-24 2018-12-24 一种多字幕显示方法、智能终端及存储介质

Publications (1)

Publication Number Publication Date
WO2020135192A1 true WO2020135192A1 (zh) 2020-07-02

Family

ID=71128361

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/126441 WO2020135192A1 (zh) 2018-12-24 2019-12-19 一种多字幕显示方法、智能终端及存储介质

Country Status (4)

Country Link
US (1) US20210274262A1 (zh)
EP (1) EP3905663A4 (zh)
CN (1) CN111356025A (zh)
WO (1) WO2020135192A1 (zh)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113723342A (zh) * 2021-09-08 2021-11-30 北京奇艺世纪科技有限公司 一种字幕显示方法、装置、电子设备及可读存储介质
CN116634218A (zh) * 2023-05-25 2023-08-22 优酷网络技术（北京）有限公司 推广信息显示方法及装置

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112667178B (zh) * 2020-12-18 2023-03-07 威创集团股份有限公司 一种文字显示方法、系统、电子设备和存储介质
CN113891168B (zh) * 2021-10-19 2023-12-19 北京有竹居网络技术有限公司 字幕处理方法、装置、电子设备和存储介质

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003122751A (ja) * 2001-10-12 2003-04-25 Alps Electric Co Ltd 翻訳装置
CN2772159Y (zh) * 2005-01-20 2006-04-12 英业达股份有限公司 字幕翻译装置
CN102170553A (zh) * 2010-02-26 2011-08-31 夏普株式会社 会议系统、信息处理装置、会议辅助方法及信息处理方法
WO2012035590A1 (ja) * 2010-09-17 2012-03-22 株式会社Ｆｉｃｐ 多言語訳文表示装置
CN103067775A (zh) * 2013-01-28 2013-04-24 Tcl集团股份有限公司 一种音视频终端的字幕显示方法、音视频终端及服务器
CN107484002A (zh) * 2017-08-25 2017-12-15 四川长虹电器股份有限公司 智能翻译字幕的方法
CN110134973A (zh) * 2019-04-12 2019-08-16 深圳壹账通智能科技有限公司 基于人工智能的视频字幕实时翻译方法、介质和设备

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1645470A (zh) * 2005-01-25 2005-07-27 英特维数位科技股份有限公司 调整字幕显示位置的装置及其方法
JP4871635B2 (ja) * 2006-04-28 2012-02-08 キヤノン株式会社 デジタル放送受信装置及びその制御方法
JP4247291B1 (ja) * 2007-12-20 2009-04-02 株式会社東芝 再生装置および再生方法
US8786781B2 (en) * 2009-04-09 2014-07-22 Ati Technologies Ulc Detection and enhancement of in-video text
EP2827586B1 (en) * 2012-03-14 2019-05-08 Panasonic Corporation Receiver apparatus, broadcast/communication-cooperation system, and broadcast/communication-cooperation method
US20140003792A1 (en) * 2012-06-29 2014-01-02 Kourosh Soroushian Systems, methods, and media for synchronizing and merging subtitles and media content
CN103051945B (zh) * 2012-12-31 2016-02-03 广东欧珀移动通信有限公司 一种视频播放终端的字幕翻译方法、系统
CN203327190U (zh) * 2013-02-28 2013-12-04 青岛海尔电子有限公司 电视节目字幕处理系统及广播系统
CN104093085B (zh) * 2014-04-22 2016-08-24 腾讯科技（深圳）有限公司 信息显示方法和装置
CN104219459A (zh) * 2014-09-30 2014-12-17 上海摩软通讯技术有限公司 视频语言翻译方法、系统及智能显示设备
CN105681890A (zh) * 2016-01-26 2016-06-15 广东欧珀移动通信有限公司 一种视频播放终端的字幕显示方法及装置

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003122751A (ja) * 2001-10-12 2003-04-25 Alps Electric Co Ltd 翻訳装置
CN2772159Y (zh) * 2005-01-20 2006-04-12 英业达股份有限公司 字幕翻译装置
CN102170553A (zh) * 2010-02-26 2011-08-31 夏普株式会社 会议系统、信息处理装置、会议辅助方法及信息处理方法
WO2012035590A1 (ja) * 2010-09-17 2012-03-22 株式会社Ｆｉｃｐ 多言語訳文表示装置
CN103067775A (zh) * 2013-01-28 2013-04-24 Tcl集团股份有限公司 一种音视频终端的字幕显示方法、音视频终端及服务器
CN107484002A (zh) * 2017-08-25 2017-12-15 四川长虹电器股份有限公司 智能翻译字幕的方法
CN110134973A (zh) * 2019-04-12 2019-08-16 深圳壹账通智能科技有限公司 基于人工智能的视频字幕实时翻译方法、介质和设备

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3905663A4

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113723342A (zh) * 2021-09-08 2021-11-30 北京奇艺世纪科技有限公司 一种字幕显示方法、装置、电子设备及可读存储介质
CN113723342B (zh) * 2021-09-08 2023-09-29 北京奇艺世纪科技有限公司 一种字幕显示方法、装置、电子设备及可读存储介质
CN116634218A (zh) * 2023-05-25 2023-08-22 优酷网络技术（北京）有限公司 推广信息显示方法及装置
CN116634218B (zh) * 2023-05-25 2024-04-02 优酷网络技术（北京）有限公司 推广信息显示方法、装置、设备、介质

Also Published As

Publication number Publication date
EP3905663A1 (en) 2021-11-03
CN111356025A (zh) 2020-06-30
US20210274262A1 (en) 2021-09-02
EP3905663A4 (en) 2022-08-31

Similar Documents

Publication Publication Date Title
WO2020135192A1 (zh) 一种多字幕显示方法、智能终端及存储介质
TWI538520B (zh) 視頻資訊添加方法及裝置、視頻資訊顯示方法及裝置
WO2021109340A1 (zh) Epg用户界面的显示方法及设备
US7213228B2 (en) Methods and apparatus for implementing a remote application over a network
JP5658790B2 (ja) 外部電子デバイスと接続されたマルチメディアデバイス及びその制御方法
WO2020000972A1 (zh) 视频访问方法、客户端、装置、终端、服务器和存储介质
US20140201636A1 (en) Methods and apparatus for rendering user interfaces and display information on remote client devices
US20200007946A1 (en) Selectively delivering a translation for a media asset based on user proficiency level in the foreign language and proficiency level required to comprehend the media asset
WO2015075850A1 (ja) 情報処理装置
US10212481B2 (en) Home menu interface for displaying content viewing options
US20170171629A1 (en) Display device and method for controlling the same
US9544656B1 (en) Systems and methods for recognition of sign language for improved viewing experiences
CN103546813A (zh) 基于Android平台的视频预览方法及智能电视
WO2022134555A1 (zh) 视频处理方法及终端
CN112580302B (zh) 一种字幕校正方法及显示设备
US20170139904A1 (en) Systems and methods for cloud captioning digital content
WO2015041402A1 (en) Image display apparatus, driving method thereof, and image display method
US9851842B1 (en) Systems and methods for adjusting display characteristics
CN103748586B (zh) 智能电视
CN111726673A (zh) 一种频道切换方法及显示设备
WO2018010338A1 (zh) 显示方法和装置
WO2019157965A1 (zh) 界面显示方法、装置、设备以及存储介质
US20120060190A1 (en) Method for zapping contents and display apparatus for implementing the same
WO2021109489A1 (zh) 显示设备和电子节目指南的呈现方法
CN112272331A (zh) 一种节目频道列表快速展示的方法及显示设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19902454

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2019902454

Country of ref document: EP

Effective date: 20210726