CN112584209A - Display method, display device, storage medium and smart television - Google Patents

Display method, display device, storage medium and smart television Download PDF

Info

Publication number
CN112584209A
CN112584209A CN202011404027.9A CN202011404027A CN112584209A CN 112584209 A CN112584209 A CN 112584209A CN 202011404027 A CN202011404027 A CN 202011404027A CN 112584209 A CN112584209 A CN 112584209A
Authority
CN
China
Prior art keywords
display
video image
subtitles
screen
auxiliary screen
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011404027.9A
Other languages
Chinese (zh)
Inventor
徐立
熊跃平
潘伟雄
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Skyworth RGB Electronics Co Ltd
Original Assignee
Shenzhen Skyworth RGB Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Skyworth RGB Electronics Co Ltd filed Critical Shenzhen Skyworth RGB Electronics Co Ltd
Priority to CN202011404027.9A priority Critical patent/CN112584209A/en
Publication of CN112584209A publication Critical patent/CN112584209A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4122Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439Processing of audio elementary streams
    • H04N21/4398Processing of audio elementary streams involving reformatting operations of audio signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/488Data services, e.g. news ticker
    • H04N21/4884Data services, e.g. news ticker for displaying subtitles

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The invention discloses a display method, a display device, a storage medium and a smart television, which are applied to the smart television comprising a main screen and at least one auxiliary screen; the method comprises the following steps: when a main screen plays a video image, acquiring a display caption displayed on the video image; if the display subtitles do not exist on the video image, acquiring audio corresponding to the video image, and converting the audio into the display subtitles; and displaying the display caption on an auxiliary screen so as to play the display caption through the auxiliary screen. The invention displays the video image played by the main screen of the television on the auxiliary screen in a subtitle mode, thereby meeting various requirements of users.

Description

Display method, display device, storage medium and smart television
Technical Field
The invention relates to the technical field of computers, in particular to a display method, a display device, a storage medium and an intelligent television.
Background
With the enrichment of television programs, more and more televisions are connected with a secondary screen, and a small screen is hung below a main screen of the television or externally hung on the main screen of the television and used for displaying information such as weather, channel names and the like.
However, these information cannot interact with the currently played content, for example, the user wants to learn english, watch an english movie, and has no english caption, which causes trouble to the user.
Accordingly, there is a need for improvements and developments in the art.
Disclosure of Invention
The technical problem to be solved by the present invention is to provide a display method, device, storage medium and smart tv to solve the problem that the existing tv display cannot meet the user's requirement and is inconvenient for the user to use.
In order to achieve the purpose, the invention adopts the following technical scheme:
in a first aspect, an embodiment of the present invention provides a display method, which is applied to a smart television including a main screen and at least one auxiliary screen; the method comprises the following steps:
when a main screen plays a video image, acquiring a display caption displayed on the video image;
if the display subtitles do not exist on the video image, acquiring audio corresponding to the video image, and converting the audio into the display subtitles;
and displaying the display caption on an auxiliary screen so as to play the display caption through the auxiliary screen.
As a further improved technical solution, the display method further includes:
and if the display subtitles exist on the video image, displaying the display subtitles on an auxiliary screen so as to play the display subtitles through the auxiliary screen.
As a further improved technical solution, the displaying the display subtitles on an auxiliary screen, so as to play the display subtitles through the auxiliary screen specifically includes:
acquiring a first language corresponding to the display subtitles;
and when the first language is consistent with a preset target language, displaying the display caption on an auxiliary screen so as to play the display caption through the auxiliary screen.
As a further improved technical solution, the display method further includes:
and when the first language is not consistent with the target language, translating the display subtitles according to the target language, and displaying the translated display subtitles on an auxiliary screen so as to play the display subtitles through the auxiliary screen.
As a further improved technical solution, when the main screen plays the video image, the acquiring the display subtitles displayed on the video image specifically includes:
when the main screen plays the video image, the video image is identified through a pre-trained subtitle model so as to obtain the display subtitle displayed on the video image.
As a further improved technical solution, the display subtitles corresponding to each frame of the video image are displayed synchronously with the frame of the video image.
In a second aspect, an embodiment of the present invention further provides a display device, where the display device includes:
the device comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring display subtitles displayed on a video image when the video image is played on a main screen;
the conversion module is used for acquiring audio corresponding to the video image if the display caption does not exist on the video image, and converting the audio into the display caption;
and the display module is used for displaying the display subtitles on an auxiliary screen so as to play the display subtitles through the auxiliary screen.
As a further improved technical solution, the display module further includes:
the language acquisition module is used for acquiring a first language corresponding to the display subtitles;
and the language comparison module is used for displaying the display caption on an auxiliary screen when the first language is consistent with a preset target language so as to play the display caption through the auxiliary screen.
In a third aspect, the present invention also provides a computer-readable storage medium, where one or more programs are stored, and the one or more programs are executable by one or more processors to implement the steps in the display method described in any one of the above.
In a fourth aspect, an embodiment of the present invention further provides a smart television, which includes: a processor and memory and a communication bus; the memory has stored thereon a computer readable program executable by the processor;
the communication bus realizes connection communication between the processor and the memory;
the processor, when executing the computer readable program, implements the steps in the display method as described in any one of the above.
Has the advantages that: compared with the prior art, the invention provides a display method, a device storage medium and a smart television, which are applied to the smart television comprising a main screen and at least one auxiliary screen; the method comprises the following steps: when a main screen plays a video image, acquiring a display caption displayed on the video image; if the display subtitles do not exist on the video image, acquiring audio corresponding to the video image, and converting the audio into the display subtitles; and displaying the display caption on an auxiliary screen so as to play the display caption through the auxiliary screen. The invention displays the video image played by the main screen of the television on the auxiliary screen in a subtitle mode, thereby meeting various requirements of users.
Drawings
Fig. 1 is a flowchart of a display method provided in the present invention.
Fig. 2 is a schematic structural diagram of a display device provided in the present invention.
Fig. 3 is a schematic structural diagram of the smart television provided by the present invention.
Detailed Description
The invention provides a display method, a display device, a storage medium and a smart television, and in order to make the purpose, technical scheme and effect of the invention clearer and clearer, the invention is further described in detail below by referring to the attached drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
As used herein, the singular forms "a", "an", "the" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element or intervening elements may also be present. Further, "connected" or "coupled" as used herein may include wirelessly connected or wirelessly coupled. As used herein, the term "and/or" includes all or any element and all combinations of one or more of the associated listed items.
It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the prior art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
The invention will be further explained by the description of the embodiments with reference to the drawings.
The embodiment provides a display method, which is applied to a smart television comprising a main screen and at least one auxiliary screen, as shown in fig. 1, and the method comprises the following steps:
s100, when the main screen plays the video image, acquiring the display subtitles displayed on the video image.
In this embodiment, when the main screen plays a video image, each frame of the video image may be captured, and then subtitles in a subtitle region may be performed on the captured image through a pre-trained subtitle model detection model, and the subtitle region in the image is found and divided, so that one or more subtitle regions may be obtained. Therefore, the invention can identify and judge each frame of the video image through the pre-trained subtitle model, thereby determining whether the display subtitle is displayed on the video image of each frame.
S200, if the display subtitles do not exist on the video image, acquiring the audio corresponding to the video image, and converting the audio into the display subtitles.
In this embodiment, if the display subtitles are not displayed on the video image, the audio data corresponding to the video image may be obtained, and the audio data is converted into the corresponding subtitle information, so that the user may interact with the currently played content according to the converted subtitle information, thereby bringing better experience to the user and satisfying various requirements of the user. Meanwhile, the user can learn the characters (subtitles) corresponding to the video image and the audio conveniently.
Furthermore, the display subtitles corresponding to each frame of the video image are displayed synchronously with the frame of the video image, so that the effect of watching the display subtitles by a user can be improved. In practical application, the invention can translate and convert the audio corresponding to the played video image through the pre-trained translation model, thereby obtaining the display caption which is accurate and matched with the audio characters, and bringing better viewing experience to the viewing user.
Illustratively, when a user wants to learn English and watch English movie videos, the main television screen does not display English subtitles, so that the converted display subtitles are displayed on the auxiliary screen by converting the audio of the movie videos, and the user can learn through the English subtitles on the auxiliary screen, thereby meeting various requirements of the user. Meanwhile, for some users with poor hearing, the subtitle display mode can be watched by watching the auxiliary screen, and great convenience is brought.
And S300, displaying the display subtitles on an auxiliary screen so as to play the display subtitles through the auxiliary screen.
In this embodiment, the display subtitles may be displayed on the sub-screen, or the converted display subtitles may be displayed on the sub-screen after the display subtitles are converted into the target language (language type). Correspondingly, in an implementation manner of this embodiment, the displaying the display subtitles on the secondary screen to play the display subtitles through the secondary screen specifically includes:
s301, acquiring a first language corresponding to the display subtitles;
s302, when the first language is consistent with a preset target language, displaying the display subtitles on an auxiliary screen so as to play the display subtitles through the auxiliary screen;
and S303, when the first language is not consistent with the target language, translating the display subtitles according to the target language, and displaying the translated display subtitles on an auxiliary screen so as to play the display subtitles through the auxiliary screen.
Specifically, the target language refers to a language subtitle that the user wants to view on the secondary screen, the first language is corresponding to the actual displayed subtitle obtained in the above step, and in practical applications, the target language may be arbitrarily set according to the user's requirements, for example, the target language of the user may be selected through a setting option on a television host or a language option on a remote controller, so that when the target language selected by the user is consistent with the first language corresponding to the displayed subtitle, the displayed subtitle may be displayed on the secondary screen for playing, thereby meeting the actual requirements of the user. Of course, when the first language is not consistent with the target language, the display subtitles may be translated into the target language, and then the translated subtitles are displayed on the secondary screen, so as to play the display subtitles through the secondary screen. For example, a user wants to learn English and watch an English movie, but the movie does not have English subtitles and does not have corresponding Chinese subtitles, so that the user can select corresponding languages according to the actual needs of the user by translating the audio of the movie into the English subtitles and then translating the English subtitles into the Chinese subtitles, and the English subtitles and the Chinese subtitles can be displayed on the auxiliary screen to meet various needs of the user, so that the user can watch the movie better and know the story line of the movie.
Therefore, the program watching in the invention can display the playing content of the program in a text mode by using the auxiliary screen, and synchronously provide translations corresponding to different countries, thereby bringing good experience and convenience to users.
In summary, compared with the prior art, the embodiment of the invention has the following advantages:
the invention discloses a display method, which comprises the following steps: the method is applied to the smart television comprising a main screen and at least one auxiliary screen; the method comprises the following steps: when a main screen plays a video image, acquiring a display caption displayed on the video image; if the display subtitles do not exist on the video image, acquiring audio corresponding to the video image, and converting the audio into the display subtitles; and displaying the display caption on an auxiliary screen so as to play the display caption through the auxiliary screen. The invention displays the video image played by the main screen of the television on the auxiliary screen in a subtitle mode, thereby meeting various requirements of users.
Based on the display method, the present invention further provides a display device, as shown in fig. 2, the device including:
an obtaining module 41, configured to obtain a display subtitle displayed on a video image when the video image is played on a main screen;
the conversion module 42 is configured to, if there is no display subtitle on the video image, obtain an audio corresponding to the video image, and convert the audio into a display subtitle;
and a display module 43, configured to display the display subtitles on the secondary screen, so as to play the display subtitles through the secondary screen.
Further, the display module further includes:
the language acquisition module is used for acquiring a first language corresponding to the display subtitles;
and the language comparison module is used for displaying the display caption on an auxiliary screen when the first language is consistent with a preset target language so as to play the display caption through the auxiliary screen.
It should be noted that, as can be clearly understood by those skilled in the art, the specific implementation processes of the display device and the modules may refer to the corresponding descriptions in the foregoing display method embodiments, and for convenience and brevity of description, no further description is provided herein.
The display device may be implemented in the form of a computer program that can run on the smart tv as shown in fig. 3.
Based on the display method, the present invention also provides a computer-readable storage medium storing one or more programs, which are executable by one or more processors to implement the steps in the display method according to the above embodiment.
Based on the display method, the present invention further provides a smart tv, as shown in fig. 3, which includes at least one processor (processor) 20; a display screen 21; and a memory (memory)22, and may further include a communication Interface (Communications Interface)23 and a bus 24. The processor 20, the display 21, the memory 22 and the communication interface 23 can communicate with each other through the bus 24. The display screen 21 is configured to display a user guidance interface preset in the initial setting mode. The communication interface 23 may transmit information. The processor 20 may call logic instructions in the memory 22 to perform the methods in the embodiments described above.
Furthermore, the logic instructions in the memory 22 may be implemented in software functional units and stored in a computer readable storage medium when sold or used as a stand-alone product.
The memory 22, which is a computer-readable storage medium, may be configured to store a software program, a computer-executable program, such as program instructions or modules corresponding to the methods in the embodiments of the present disclosure. The processor 20 executes the functional application and data processing, i.e. implements the method in the above-described embodiments, by executing the software program, instructions or modules stored in the memory 22.
The memory 22 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal device, and the like. Further, the memory 22 may include a high speed random access memory and may also include a non-volatile memory. For example, a variety of media that can store program codes, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, or an optical disk, may also be transient storage media.
In addition, the specific processes loaded and executed by the storage medium and the instruction processors in the smart television are described in detail in the method, and are not stated herein.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (10)

1. A display method is characterized in that the display method is applied to a smart television comprising a main screen and at least one auxiliary screen; the method comprises the following steps:
when a main screen plays a video image, acquiring a display caption displayed on the video image;
if the display subtitles do not exist on the video image, acquiring audio corresponding to the video image, and converting the audio into the display subtitles;
and displaying the display caption on an auxiliary screen so as to play the display caption through the auxiliary screen.
2. The display method according to claim 1, wherein the display method further comprises:
and if the display subtitles exist on the video image, displaying the display subtitles on an auxiliary screen so as to play the display subtitles through the auxiliary screen.
3. The display method according to claim 1 or 2, wherein the displaying the display subtitle on the secondary screen to play the display subtitle through the secondary screen specifically comprises:
acquiring a first language corresponding to the display subtitles;
and when the first language is consistent with a preset target language, displaying the display caption on an auxiliary screen so as to play the display caption through the auxiliary screen.
4. The display method according to claim 3, further comprising:
and when the first language is not consistent with the target language, translating the display subtitles according to the target language, and displaying the translated display subtitles on an auxiliary screen so as to play the display subtitles through the auxiliary screen.
5. The display method according to claim 1, wherein the acquiring, when the main screen plays the video image, the display subtitles displayed on the video image specifically comprises:
when the main screen plays the video image, the video image is identified through a pre-trained subtitle model so as to obtain the display subtitle displayed on the video image.
6. The method of claim 1, wherein the subtitles for each frame of the video image are displayed synchronously with the frame of the video image.
7. A display device, characterized in that the device comprises:
the device comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring display subtitles displayed on a video image when the video image is played on a main screen;
the conversion module is used for acquiring audio corresponding to the video image if the display caption does not exist on the video image, and converting the audio into the display caption;
and the display module is used for displaying the display subtitles on an auxiliary screen so as to play the display subtitles through the auxiliary screen.
8. The display device according to claim 7, wherein the display module further comprises:
the language acquisition module is used for acquiring a first language corresponding to the display subtitles;
and the language comparison module is used for displaying the display caption on an auxiliary screen when the first language is consistent with a preset target language so as to play the display caption through the auxiliary screen.
9. A computer-readable storage medium storing one or more programs, the one or more programs being executable by one or more processors to implement the steps in the display method according to any one of claims 1 to 6.
10. An intelligent television, comprising: a processor and memory and a communication bus; the memory has stored thereon a computer readable program executable by the processor;
the communication bus realizes connection communication between the processor and the memory;
the processor, when executing the computer readable program, implements the steps in the display method of any of claims 1-6.
CN202011404027.9A 2020-12-04 2020-12-04 Display method, display device, storage medium and smart television Pending CN112584209A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011404027.9A CN112584209A (en) 2020-12-04 2020-12-04 Display method, display device, storage medium and smart television

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011404027.9A CN112584209A (en) 2020-12-04 2020-12-04 Display method, display device, storage medium and smart television

Publications (1)

Publication Number Publication Date
CN112584209A true CN112584209A (en) 2021-03-30

Family

ID=75127115

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011404027.9A Pending CN112584209A (en) 2020-12-04 2020-12-04 Display method, display device, storage medium and smart television

Country Status (1)

Country Link
CN (1) CN112584209A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104219459A (en) * 2014-09-30 2014-12-17 上海摩软通讯技术有限公司 Video language translation method and system and intelligent display device
CN107484002A (en) * 2017-08-25 2017-12-15 四川长虹电器股份有限公司 The method of intelligent translation captions
CN110134973A (en) * 2019-04-12 2019-08-16 深圳壹账通智能科技有限公司 Video caption real time translating method, medium and equipment based on artificial intelligence
CN110769265A (en) * 2019-10-08 2020-02-07 深圳创维-Rgb电子有限公司 Simultaneous caption translation method, smart television and storage medium
CN111683266A (en) * 2020-05-06 2020-09-18 厦门盈趣科技股份有限公司 Method and terminal for configuring subtitles through simultaneous translation of videos
CN211906792U (en) * 2020-03-31 2020-11-10 深圳创维-Rgb电子有限公司 Display device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104219459A (en) * 2014-09-30 2014-12-17 上海摩软通讯技术有限公司 Video language translation method and system and intelligent display device
CN107484002A (en) * 2017-08-25 2017-12-15 四川长虹电器股份有限公司 The method of intelligent translation captions
CN110134973A (en) * 2019-04-12 2019-08-16 深圳壹账通智能科技有限公司 Video caption real time translating method, medium and equipment based on artificial intelligence
CN110769265A (en) * 2019-10-08 2020-02-07 深圳创维-Rgb电子有限公司 Simultaneous caption translation method, smart television and storage medium
CN211906792U (en) * 2020-03-31 2020-11-10 深圳创维-Rgb电子有限公司 Display device
CN111683266A (en) * 2020-05-06 2020-09-18 厦门盈趣科技股份有限公司 Method and terminal for configuring subtitles through simultaneous translation of videos

Similar Documents

Publication Publication Date Title
WO2021068558A1 (en) Simultaneous subtitle translation method, smart television, and storage medium
CN111277881A (en) Control method for audio data stream output in display equipment and display equipment
US20120098771A1 (en) Operational terminal device, display control device, method of operating terminal device, method of operating display control device, and system
CN111479152A (en) Display device
EP3550847A1 (en) Smart television signal source-based method for displaying floating menu and smart television
RU2582070C1 (en) Method of controlling external input and broadcast receiver
US20180160069A1 (en) Method and system to temporarily display closed caption text for recently spoken dialogue
US8184941B2 (en) Information recording and reproducing apparatus and method for changing setting language of the same
EP3905663A1 (en) Multi-subtitle display method, intelligent terminal and storage medium
JP2012109901A (en) Data presentation device
CN112580302B (en) Subtitle correction method and display equipment
CN103634651B (en) The display methods and system of the source preview image of Android television
US20120092558A1 (en) Television and displaying method for information source thereof
US20060078283A1 (en) Method for recording service data depending on service type in digital TV complex machine
CN201585036U (en) STB based on SD card and supporting function of e-book read
US9686587B2 (en) Playback method and apparatus
CN112738621A (en) Wireless screen projection method, device and system for non-smart television
US8311803B2 (en) Method and device for providing display of E-manual in a specific language in display device
CN112584209A (en) Display method, display device, storage medium and smart television
CN111541924B (en) Display apparatus and display method
US8130318B2 (en) Method and audio/video device for generating response data related to selected caption data
CN103034405A (en) Display method for screen display frames
CN114710707A (en) Display device and video thumbnail acquisition method
US20100128071A1 (en) System and method for fully-automatically aligning quality of image
CN112565915A (en) Display apparatus and display method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20210330