RU2668721C1 - Method for displaying subtitles in the process of playing media content (options) - Google Patents

Abstract

FIELD: display of subtitles.SUBSTANCE: invention relates to a display area of subtitles. Method for displaying subtitles comprises the steps of: obtaining subtitles in the original language; the conversion of the received subtitles to a format of the processed subtitles, the conversion comprising: tokenization; the establishment of parts of speech for parts of the received subtitles; lemmatization; search for lemmatized words and word combinations in the dictionary of words and phrases; adding the meaning of a word or phrase, or the identifier of the meaning of a word, or a word combination, or words and phrases, or a word or phrase identifier, where the value identifier specifies an entry for a value or word, or word combinations in the dictionary of words and phrases; Add time markup for parts of subtitles; the display of the processed subtitles in the media content playback means; display the translation of a portion of the subtitle.EFFECT: technical result is an increase in the efficiency of processing subtitles in a foreign language when playing media content used in the teaching of a foreign language.20 cl, 8 dwg

Description

FIELD OF TECHNOLOGY

[001] The present invention relates to computer systems and, more specifically, to systems and methods for displaying subtitles in the process of playing media content.

BACKGROUND

[002] Currently, there are many ways to learn foreign languages, in the particular case of non-native languages, for a person who is studying or seeking to learn foreign languages, for example, different from his native language, of which he is a native speaker.

[003] Scientists have proved that a person involuntarily reads the subtitles that are displayed during the demonstration of media content to him, in the particular case of the video presented, regardless of whether he knows (and understands) the speech that accompanies the video in the form of an audio recording, audio stream) , thereby juxtaposing audio information and video information. There is a known method of teaching "Same language subtitling" (SLS), which allows you to learn a language by demonstrating subtitles in the same language as in media content. The researchers further proved that if in the process of demonstrating media content in a language that a person understands, show him subtitles in a foreign language, then this approach allows you to learn a foreign language (in particular, the language in which subtitles are shown).

[004] Thus, one of the methods of learning languages (in particular, foreign languages) is a method of learning languages using media content, for example, by watching films in a foreign language with the subtitles displayed during the movie demonstration, and the subtitles can be displayed to the user on any language, including the ability to display subtitles in several languages at once. For example, if a student (in a particular case, a user) is a native speaker of the Russian language and wants to learn English, then if the actors in the film speak English (i.e. the film is English, the film is in English), then the user may be subtitles in English and / or in Russian are displayed. Thus, the student can display subtitles in the language of the media content being demonstrated (in particular, video / movie) and subtitles in the user's native language, which in a particular case is a translation of the subtitle text in the language of the media content being displayed.

[005] The disadvantages of existing methods of studying by demonstrating to the student media content, in particular, video with sound (sound next, audio stream, audio track, sound track, etc.) in one language and displaying subtitles in another language include the lack of translation part of the subtitle or translation of the value of the part of the subtitle, which is highlighted by the user who plays the media content, as well as the ability to add user parts of the subtitle to the user's dictionary with the translation added part of subtitles. Also, the disadvantages of existing solutions include the inability to display the translation of values due to the lack of subtitle formats that allow the conversion and storage of subtitles in such a way that it is possible to get the translation of parts of subtitles and values of parts of subtitles from a dictionary containing words and phrases, in particular, parts subtitles, with translation, as well as containing translation of words and phrases and translation of the meanings of words and phrases, in the particular case, corresponding to the parts of the subtitles. Also, the disadvantage of existing solutions is the impossibility of user interaction with subtitles and their parts, in order to add them to the user’s dictionary, which contains the saved parts of the subtitles and the corresponding translation or translation of the values specified by the user of the parts of the subtitles, and the dictionary is displayed to the user during playback media content or at any other time at the request of the user. Elimination of the disadvantages described above, in particular, improves the quality of perception by the user / student of information, which allows the user to more effectively learn foreign languages.

[006] Accordingly, based on an analysis of the current state of the art and capabilities, there is a need in the art for a system and method for displaying subtitles in a media content reproduction process.

SUMMARY OF THE INVENTION

[007] The technical result of the present invention is to increase the efficiency of processing subtitles in a foreign language when reproducing media content used in the process of teaching a foreign language.

[008] According to one embodiment, a method for displaying subtitles is provided, comprising the steps of: obtaining subtitles in the original language; converting the received subtitles to the format of the processed subtitles, the conversion includes: tokenizing the received subtitles; establishing part of the speech for parts of the received subtitles; lemmatization of parts of the received subtitles, for which a part of speech has been established; search for lemmatized words and phrases corresponding to the parts of the received subtitles in the dictionary of words and phrases containing words and phrases and meanings of words and phrases in the language of the received subtitles and at least one translation and / or meanings for such words and phrases; adding the meaning of the word or phrase or identifier of the meaning of the word or phrase or word and phrase or identifier of the word or phrase for at least one part of the subtitles, where the value identifier defines a record for the value or word or phrase in the dictionary of words and phrases; adding a time stamp for parts of the subtitle, defining the time at which parts of the subtitle are displayed; displaying processed subtitles in a media content reproducing means; display the translation of at least one part of the subtitle part when playing media content; add to the user dictionary the specified part of the subtitle and translation for the specified part of the subtitle from the dictionary of words and phrases.

[009] In one of the private options for implementation, additionally translate the received subtitles into a language different from the language of the original subtitles, and display the translated subtitles to the user.

[010] In one particular embodiment, subtitle translation options are created from words and phrases and / or from the meanings of words and phrases contained in the dictionary of words and phrases depending on the level of complexity.

 [011] In one particular embodiment, when translating at least one part of the received subtitles and / or when displaying a translation of a part of the subtitles specified by the user, words and / or phrases and / or meanings of words and phrases and translation for words are used and / or phrases and / or translation for the meanings of words and phrases from the dictionary of words and phrases.

[012] In one particular embodiment, the method further includes converting the received subtitles into converted subtitles in a language other than the original subtitle language using a dictionary of words and phrases and translating when converting the received subtitles to the processed subtitle format.

[013] In one particular embodiment, it further includes tagging a portion of speech in converted subtitles for a portion of speech of a portion of subtitles when converting the received subtitles to a processed subtitle format.

[014] In one particular embodiment of the word and phrase and / or translation of words or phrases, and / or at least one part of the subtitles are adjusted in the dictionary of words and phrases based on corrections proposed by the user through feedback from the user.

[015] In one of the private embodiments, the translation options indicated by the user of the subtitle part are selected in the dictionary of words and phrases depending on the level of complexity.

[016] In one of the private embodiments, the user is presented with a list of words and phrases with at least one translation option of such words and phrases that are contained in the subtitles displayed to the user and which will potentially cause the user to have difficulty translating, depending on the level set difficulties.

[017] In one particular embodiment, the user dictionary contains words or phrases, the meaning of words or the meaning of words or phrases, or said identifiers added by the user to the dictionary of words and phrases when interacting with at least one web resource or application, which displays media content and / or subtitles.

[018] According to another embodiment, a method for displaying subtitles is provided, comprising the steps of: launching a media content reproducing means implemented as a program code or application; loading media content into a media content reproducing means; search for subtitles for downloaded media content in the language of media content; if there are subtitles for the loaded media content, subtitles are loaded into the media content display means; in the absence of subtitles for the downloaded media content, search for subtitles of a different subtitle format; in the absence of subtitles of a different subtitle format, display media content without subtitles; if there are subtitles of a different subtitle format, a subtitle conversion of another format is performed, including: tokenizing at least one part of the subtitles of another format; establishing part of the speech, at least for one part of the subtitles of a different format; lemmatization, at least for one part of subtitles of another format, for which part of speech is established; search for lemmatized words and phrases corresponding to at least one part of the subtitles of a different format in the dictionary of words and phrases containing words and phrases and meanings of words and phrases in the subtitle language; adding the meaning of a word or phrase from the dictionary of words and phrases or the identifier of the meaning of the word or phrase or word and phrasing from the dictionary of words and phrases or the identifier of the word or phrasing for at least one part of the subtitle of another format, where the identifier defines a record for the word value or phrases or for a word or phrase in a dictionary of words and phrases; Adding a time marking for parts of the subtitles of a different format that defines the time at which parts of the subtitles are displayed displaying at least one part of the subtitles of a different format after said conversion in the media content reproducing means; displaying the translation of the user-specified part of the subtitle when playing media content, and for the translation of the user-specified part of the subtitles, the aforementioned identifiers or values of the word or phrase, or word and phrase are used; add to the user dictionary the specified part of the subtitle and / or translation for the specified part of the subtitle from the dictionary of words and phrases or the identifier of the meaning of the word or phrase, or the identifier of the word or phrase.

[019] In one particular embodiment, the translation of at least one part of the subtitles comprises a translation for words and / or phrases and / or a translation for the meanings of words and phrases from a dictionary of words and phrases.

[020] In one particular embodiment, when performing a subtitle conversion of another format, it further includes tagging part of speech in the converted subtitles for part of the speech of part of the subtitles when converting the received subtitles to the processed subtitle format.

[021] In one particular embodiment of the word and phrase and / or translation of words or phrases, and / or at least one part of the subtitles are adjusted in the dictionary of words and phrases based on corrections proposed by the user through feedback from the user.

[022] In one of the private options for implementation, additionally translate the subtitles of a different format into a language different from the language of the subtitles of a different format, and display translated subtitles to the user.

[023] In one of the private embodiments, subtitle translation options are created from words and phrases and / or from the meanings of words and phrases contained in the dictionary of words and phrases depending on the established level of complexity.

[024] In one particular embodiment, when translating at least one part of a subtitle of a different format and / or when displaying a translation of a part of a subtitle specified by a user, words and / or phrases and / or meanings of words and phrases and translation are used for words and / or phrases and / or translation for the meanings of words and phrases from the dictionary of words and phrases.

[025] In one of the private embodiments, the user is shown a list of words and phrases with at least one translation option for such words and phrases that are contained in the subtitles displayed to the user and which will potentially cause the user to have difficulty translating, depending on the level set difficulties.

[026] In one of the private embodiments, they additionally search for subtitles containing a translation for the downloaded media content, and display the subtitles with the translation to the user.

[027] In one particular embodiment, the user dictionary contains words or phrases, the meaning of words or the meaning of words or phrases, or said identifiers added by the user to the dictionary of words and phrases when interacting with at least one web resource or application, which displays media content and / or subtitles.

BRIEF DESCRIPTION OF THE DRAWINGS

[028] Additional objectives, features and advantages of the present invention will be apparent from reading the following description of an embodiment of the invention with reference to the accompanying drawings, in which:

FIG. 1 illustrates an exemplary embodiment of the present invention with an example of a media player;

FIG. 2 illustrates exemplary display modes of raw and / or converted original subtitles, translated subtitles, and original and translated subtitles;

FIG. 3 illustrates exemplary options for displaying unprocessed and / or converted original subtitles and displaying complex parts of subtitles (compound words, compound phrases, etc.), display mode of unprocessed and / or converted original subtitles with replacing complex parts of subtitles (compound words , complex phrases, etc.) and the display mode of the complex parts of the subtitles (complex words, complex phrases, etc.) with standard text transparency, and the rest of the subtitles in the form of translucent wow text;

FIG. 4 illustrates a flowchart of a process implementing the method described in the framework of the present invention;

FIG. 5 illustrates an exemplary embodiment of a system implementing the present invention;

FIG. 6 illustrates an example embodiment of displaying a list of subtitles of media content in a mode of pausing playback of media content;

FIG. 7 illustrates a block diagram of an exemplary processing option;

FIG. 8 illustrates an example of a general purpose computer system.

DESCRIPTION OF EMBODIMENTS OF THE INVENTION

[0107] The objects and features of the present invention, methods for achieving these objects and features will become apparent by reference to exemplary embodiments. However, the present invention is not limited to the exemplary embodiments disclosed below, it can be embodied in various forms. The essence described in the description is nothing more than the specific details provided to assist the specialist in the field of technology in a comprehensive understanding of the invention, and the present invention is defined only in the scope of the attached claims.

FIG. 1 illustrates an exemplary embodiment of the present invention as an example of a media player. In FIG. 1 shows an exemplary embodiment of a media player 100 for displaying a video image (video) and / or at least one audio track, for example, an audio track of a video, and subtitles according to the present invention. A media player (media player, multimedia player, multimedia player) 100 is a computer program designed to play multimedia content / media content files (video files and / or audio files) by recording video images (video) 105 of any known type and format (e.g., AVI, QuickTime MOV, QT, OGG, DV, MPEG-4, DivX, Xvid, MPEG-1 MPEG-2, Video CD, SVCD, DVD, etc.) and play sound in any known format (for example, WAV digital audio formats, ARE, MP3, Ogg, AIFF, AAC, DVD-Audio, AC3, CD and others), accompanying deo (e.g., contained in a multimedia content / entertainment content, or separately downloadable audio file file), and display the subtitles (subtitle untreated and / or converted subtitles described below).

[0109] The media player can also be implemented by a web player / web player (eg. Web player), for example, “lwplayer”, and can also be implemented by a flash player (in particular, Adobe Flash Player, a multimedia platform for playing vector animation , videos / videos in web pages and applications, including games and advertisements), as well as any other well-known tools, applications, services (for example, YouTube service), methods and technologies for reproducing media content, including, but not limited to, HTML technologies / HTML5, JavaScript, FL ASH and others, as well as supporting various protocols, for example, streaming video, in particular RTPM (English Real Time Messaging Protocol, streaming data transfer protocol), HTTP pseudo-stream.

[0110] It is worth noting that the media player can be implemented in any known form, for example, as an application (for example, Media Player Classic, Windows Media Player, KMPlayer and others), including applications for mobile platforms (Android, iOS), in the form web-player, and can also be part of the application (including mobile applications), or can be accessed from the application in an external browser for the application (web browser) or through a browser built into the application.

[0111] The media player may include or be associated with a menu of controls for the media player 115, which may include controls for media content (in particular, media player menu items), with subtitles, for example, a media content playback trigger through which, for example, a media player user can control the stop of media content playback, pause media content playback, etc.). The control menu of the media player 115 may include at least one subtitle control 120, in particular, various subtitle display modes (110) in the media player 100 can be selected by the element 120, which will be described later. The control menu of the media player 115 may also include elements for selecting a difficulty level, in particular a user difficulty level and / or subtitles, including a difficulty level of the original subtitles and translated subtitles and / or a difficulty level of the translated parts of the subtitles, for example, translation words 182, 184, 186 displayed in one way or another, at least in one of the subtitle modes described below, and / or translated words, for example, indicated by input devices, for example, by computer manipulation mouse, for example, mouse cursor 185, in particular, the words contained in the original subtitles, and / or the complexity of the translation words, and / or the complexity of the subtitles: the original 180 and / or translated 190, and / or the complexity of any text and / or parts thereof, including phrases and well-known phrases and sentences contained in the text of the subtitles, in the following dictionary 528 in FIG. 5 words (in particular, words and phrases, for example, part of subtitles and / or translation of part of subtitles, etc.), in the text of the interface of the media player, etc., as will be described later. The media player menu may contain a control element for the playback speed of media content and / or subtitles (150), and may also contain a control element for the quality of video content (for example, video resolution 160 or audio quality, as well as audio / audio volume 170), user feedback control elements ( as will be described later in the description of the present invention) and / or other media content and / or media player controls, including a menu of media player controls 115, select appearing within and / or outside the window of the media player, for example, automatically after any action by the user (for example, a student or teacher), in particular with elements of the media player or elements of the system described in the framework of the present invention (for example, the user dictionary 560, translated words, translated words, feedback form, etc.), either depending on the content of the media content and / or subtitles, or as a result of a timer that determines the time when menu controls 115, either when starting playback or stopping, or pausing playback of media content or displaying subtitles.

[0112] Subtitles are known to be textual accompaniment of a video / video sequence / video stream / video image and can be stored, for example, in media files or in separate files (subtitle files), in particular text files. Subtitles can be stored in various subtitle formats, for example, in srt format - subtitles of the SubRip program, smi (smil) format - subtitle format based on SGML (English Standard Generalized Markup Language), s2k-format subtitles of the Sasami program, ssa-format of subtitles programs Sub Station Alpha, sub / idx format for graphic subtitles extracted from DVD using a special program and other formats. It is worth noting that subtitles can include tags (text / subtitle markup elements, identifier for categorizing, describing, searching for data and setting the internal structure) of various formats, for example, tags in ass-format (tag \ shad - change the shadow, \ fn - change font, \ fsc -scaling characters along axes, etc.) or tags in any other known format that allow you to change the color, size, slope, distance between subtitle words, etc. Also, subtitles can include HTML tags, for example, the <i> tag, which is responsible for italicizing the font of the subtitle section (subtitle text) highlighted by this tag, the <b> tag, which is responsible for displaying part of the subtitles in bold / bold text, the <font >, responsible for setting the color of the selected section of subtitles and other tags.

[0113] It is also worth noting that the subtitle file includes an indication of the time (time stamp / time stamp) when one or another part of the subtitles should appear (be displayed) on the screen and the time when it is necessary to finish displaying this part of the subtitles (or the time stamp can be implemented in the form of an indication of the time elapsed from the beginning of the video and the duration of the display of a given part of the subtitles, for example, in seconds), in particular, in a media player (media player window), for example, to match the sound (audio track, audio track) accompanying the video, or correspond to certain images in the video, for example, captions, etc. It is worth noting that there are various ways of temporarily marking up subtitles. The following is an example of subtitles in the “srt” format mentioned earlier, in particular, in a raw subtitle format:

[0114] 1

[0115] 00: 01: 45.024 -> 00: 01: 47.064

[0116] Man's voice: <i> A bad compromise is better than a good lawsuit. </i>

[0117] 2

[0118] 00: 02: 10,299 -> 00: 02: 11,999

[0119] Man's voice: <i> Do you remember? </i>

[0120] 3

[0121] 00: 03: 01,029 -> 00: 03: 10,000

[0122] Road Sign <i> "Attention!" </i>

[0123] ...

[0124] where:

 [0125] “1”, “2”, “3” are the sequence numbers of the subtitles;

[0126] “<i>” and “</i>” are tags (as described above), in this case, the tag for highlighting text in “italics”;

[0127] “00: 01: 45,024 -> 00: 01: 47,064”, “00: 02: 10,299 -> 00: 02: 11,999”

[0128] is the previously described time marking in the format: “00: 01: 45,024” - the start time for displaying part of the subtitles “1” (ie <i> A bad compromise is better than a good lawsuit. </i>) and the end time of the subtitle display ("00: 01: 47.064"), calculated from the start of the video or sound, and the time is recorded in the format hours: minutes: seconds, milliseconds;

[0129] “A bad compromise is better than a good lawsuit.”, “Man's voice: Do you remember?” Are the subtitle text, which may include replicas of the characters “A bad compromise is better than a good lawsuit.”, “Do you remember?)), comments for users or translators, for example, inscriptions on objects in the scene of the film “Road Sign“ Attention! ”(Road sign“ Attention! ”), the name of the actor who pronounces the phrase, or the gender of the person to whom belongs to a phrase, for example, “Man's voice:” (male voice) and other texts encountered when playing multimedia content / media file.

[0130] The above one of the standard subtitle formats is raw subtitles (raw subtitle file format) containing, in the particular case, original subtitles (original subtitles, main subtitles), i.e. subtitles stored, for example, in one of the standard / well-known formats, and the subtitle language, as a rule, corresponds to the language of the film (the language of the main subtitles 180), in particular, the language the actors speak, voice-overs, the text of the inscriptions / captions in the video scene, etc. It is worth noting that the subtitles (raw subtitles and / or the converted subtitles described below) may include text in original subtitles other than the language, for example, phrases pronounced in Latin, or spoken by persons speaking a language other than the main language of the video participants / actors, inscriptions in fantastic, ancient languages, etc.

[0131] In the above example, the original language is English, therefore, the language of the original subtitles is also (or may be, as will be described below) English.

 [0132] The original subtitles (text of the original subtitles) 180 may be displayed to the user during the video demonstration (mode 110 (A) in FIG. 2).

[0133] The original subtitles 180 can be translated into another language, for example, into Russian (and recorded as translated subtitles / translation subtitles / translated subtitle text in the same file or in a different file containing the original subtitles), and shown ( in the form of translated subtitles) to a student, for example, a person who wants to study / learn (or improve his knowledge) the original / main language of the film, in particular, the language of the original subtitles. In this case, the video (film) can be shown to a Russian-speaking student in order to increase his level of knowledge of a foreign language, in particular, English, by demonstrating translated subtitles 190 (subtitle display mode 110 (B) in FIG. 2), i.e. . subtitles translated from the language of the original subtitles, in particular, subtitles in a foreign language for the student learning 180 (foreign subtitles / main subtitles).

[0134] The original subtitles 180 may also be displayed together with the translated subtitles 190, for example, such translated subtitles may be displayed below, above, next to the main subtitles 180 and / or in any other area belonging to (or outside of) the video being shown to the user ( in particular, the media player window), as well as on a separate layer, relative to the layer on which the video and / or main subtitles are shown, in the media player, as well as in a separate application window and / or in a separate application (another application or a copy of the same application, for example, a media player, in a particular case, an application running on the same device that plays the video and / or displays at least one set of subtitles: a set of original subtitles or translated subtitles, or application and / or application instance on another device, in relation to the device on which the video is played). The aforementioned arrangement modes and subtitle display can be adjusted by at least one menu item 115.

[0135] Also, before displaying the subtitles, the raw subtitles (subtitles in the raw format), in particular, the original subtitles and / or translated subtitles, can be modified into converted subtitles by means of a parser (a parser that converts input data, usually text, into structured format) implemented in the form of program code, and the parser performs at least parsing of the text of the subtitles, for example, the text of the raw subtitles and / or the text translated subtitle Peraser can include various tools for analyzing and modifying subtitle text in a converted format, for example, it can use programs for symbolic and statistical processing of natural languages, such as the Natural Language Toolkit (NTLK), Stanford CoreNLP and others. Natural Language Processing (NLP) is a general area of artificial intelligence and mathematical linguistics that studies the problems of computer analysis and synthesis of natural languages, for example, analysis means understanding the language, and synthesis means generating competent text. In the framework of the present invention, raw subtitles (raw subtitle text) are downloaded / transmitted as input to the parser, for example, data from a file containing raw subtitles, and the output from the parser is converted subtitles. In the process of the parser, the downloaded text of the raw subtitles is subjected to the tokenization process, during which the downloaded text of the subtitles is divided into parts into words and phrases, with possible intermediate splitting into sentences. It is worth noting that data (in a particular case, data in text format) from a raw subtitle file can be loaded with time stamps and tags that can be saved and used in the converted subtitle file.

[0136] After breaking the downloaded subtitle data into words, the part of speech to which it corresponds can be set using the parser, and a tag of part of speech can be assigned to each such word, i.e. tag corresponding to a specific part of speech for a given word. Further, by means of the parser, the lemmatization operation (the process of reducing the word form to a lemma — its normal / dictionary form) is performed for such words in order to establish the initial form of the word depending on the recognized part of the speech to which it corresponds, for example, the word “jumped” the loaded subtitles corresponds to the dictionary the form “jump”, the dictionary form “strong” corresponds to the word “strong” of the text of the downloaded subtitle data, the dictionary form “walk” is a lemma for the word “walking”, etc.

[0137] After the tagging part of the speech and lemmatization operation for at least one word loaded in the subtitle parser, the parser queries the dictionary of words and phrases 528 for a value (for example, the most popular value) for a given word or phrase, in particular a value identifier words from the dictionary of words and phrases that will be described later. The dictionary of words and phrases 528 stores words and phrases with the translation of these words and phrases in at least one language. Almost every word (or phrase) can refer to at least one part of speech. Each word relating to a specific part of speech can have at least one meaning. So, for example, the word “play” can be a verb, or it can be a noun. The noun “play” can mean “play”, “game”, “move”, “play”, “entertainment”, etc. The verb “play” can also have at least one meaning, for example, “play”, “speak”, “play”, etc.

[0138] As mentioned above, the parser can request in the dictionary of words and phrases the value (identifier of the value) for a particular word (or phrase), and such a word (or phrase) can be the most popular meaning of the word (or phrase). The popularity / frequency of the meaning of a word (or phrase) can be determined by how often a particular meaning of a word (or phrase) of a specific (requested by the parser) part of speech stored in the dictionary of words and phrases is found in texts (in texts of a particular subject, analyzed texts for calculating the popularity of a word, etc.). It is worth noting that the parser can request in the dictionary of words and phrases the most popular meaning (identifier of the value) of a word or phrase. Also, the parser can request the value (identifier of the value) of a word or phrase in the dictionary of words and phrases, and the dictionary of words and phrases can return the most popular value (identifier of the value) of a word or phrase. The popularity (frequency, frequency of occurrence, frequency of presence) of a word or phrase can be calculated experimentally, for example, by analyzing texts contained on the Internet. It is worth noting that the frequency of a word or phrase of a certain part of speech can depend on the frequency of the word or phrase (i.e. how often such a word or phrase appears in texts, regardless of the part of speech), for example, the frequency of parts of speech can be calculated. Then, the frequencies of the values of words and phrases of parts of speech can be calculated, after which such frequencies of the values of words and phrases of parts of speech can be normalized to the frequency of a certain part of speech obtained earlier.

величина популярности значения местоимения "Я" в два раза превышает величину популярности значения существительного "Йод", например, слову

парсером была ошибочно назначена часть речи 'существительное' вместо 'местоимение' и передана в составе запроса от парсера к словарю слов и словосочетаний, то словарь слов и словосочетаний вернет в ответ на запрос парсеру значение 'Я', а не значение 'Йод', поскольку величина популярности/частотности местоимения гораздо выше величины популярности/частотности йода, и совпадение частей речи в меньшей степени учитывается при возврате парсеру значения для слова или словосочетания указанной части речи.[0139] It is also worth noting that when a dictionary returns words and phrases the meaning (value identifier) of a word or phrases, the difference in popularity / frequency values of the word value and phrases for different parts of speech can be taken into account, for example, if the popularity / frequency value (value determining the popularity / frequency) of the value of one part of speech exceeds the value of popularity / frequency of the value of a word or phrase of one part of speech by a certain value (for example, defined by a person responsible for the content of the dictionary of words and phrases), then, regardless of the part of speech, a value (identifier of a value) with a maximum value of popularity / frequency can be transmitted as a response to the parser. So, for example, if, for example, for the word

the popularity value of the pronoun "I" is twice the value of the popularity of the noun "Iodine", for example, the word

the part of the speech “noun” instead of “pronoun” was mistakenly assigned by the parser and transferred as part of the request from the parser to the dictionary of words and phrases, the dictionary of words and phrases will return the value “I” rather than the value “Iodine” in response to the request to the parser, since the value of the popularity / frequency of the pronoun is much higher than the value of the popularity / frequency of iodine, and the coincidence of the parts of speech is less taken into account when the parser returns the value for a word or phrase of the specified part of speech.

[0140] It is worth noting that the magnitude of the popularity / frequency of the values of words or phrases can be calculated from the collected statistical data of the user's interaction with words and phrases (for example, how often a user displays a particular value of a word or phrase), for example, with parts of subtitles, as described in the framework of the present invention, either with words and phrases with which it interacts on the Internet or in other applications, of which statistics of user interaction with words and phrases and their meanings can be processed, and the data of such statistics can be converted into popularity / frequency values.

[0141] A dictionary of words and combinations contains words and phrases with their translation (meanings) into at least one language. A dictionary of words and combinations contains identifiers of words and / or phrases (by which a specific word or phrase can be found in the dictionary of words and phrases, for example, a parser), as well as identifiers of values (which are described below) for words and / or phrases. Also, the dictionary contains the popularity / frequency value for the meanings of words and phrases that have been described above. Also, a dictionary of words and phrases can contain any other information that can be used, for example, by a parser or dictionary tools, which can be used, for example, to more accurately select the meaning of a specific word, in particular, when requesting values by a parser from a dictionary of words and phrases . Also, the dictionary of words and phrases may contain the number of user complaints (for example, through the feedback tool described below) on the specific meaning of the word and phrases. Also, in the dictionary of words and phrases for each word or phrase, the corresponding complexity (level of complexity) can be affixed, which is used, for example, by the parser to create converted subtitles of a certain level of complexity corresponding to the selected level of complexity, for example, through menu item 140. Also, the level the complexity of the word or phrase can be used (for example, the subtitle module 545A, 545B, FIG. 5) when displaying complex words in the corresponding subtitle display modes, n For example, mode 110 (D), 110 (D), 110 (E), described below. Also, the complexity of words in the dictionary of words and phrases can be used, for example, by the module of the dictionary of words and phrases 548A, 548B (FIG. 5), to display the translation to the user of a certain complexity, in particular, when the user indicates the parts of the displayed subtitles, as will be described later .

[0142] After the parser receives the value (value identifier) for the word currently being processed, the parser adds to this word (or phrase) the identifier of the word value (or phrase) from the dictionary of words and phrases (for example, “meaning-id” in the file converted subtitles, as shown below identifies a value identifier), for example, “73035”.

[0143] It is also worth noting that, to words in the converted subtitle file, the parser adds a word identifier / local word identifier identifying a given word or phrase in a particular converted subtitle file and is unique to the entire converted subtitle text (for example, in the example below, “ local-id "is the unique identifier of the word).

[0144] Also, the parser can add the identifier of a part of speech in a dictionary of words and phrases (“pos-tag” in the example below) to a word in modifiable subtitles.

[0145] It is also worth noting that instead of the identifier of the meaning of the word or phrase, the meaning of the word or phrase may be used.

[0146] If the parser does not receive from the dictionary of words and phrases the values of the requested word or phrases (for example, the dictionary of words and phrases returned “NULL” to the request of the parser), then the requested word does not receive assignment / assignment of an identifier and, in a particular case, , when such a word is indicated by the user with the composition of the subtitle text, such a word will not display a translation from the dictionary of words and phrases 528, instead, the user may be offered (for example, by means of the feedback module and / or means user module of the user dictionary, and / or means of the subtitle module, or any other component of the system described in the framework of the present invention).

[0147] The following is an exemplary version of the subtitles in raw format:

[0148] "

[0149] 1

[0150] 00: 01: 45.024 -> 00: 01: 47.064

[0151] Man's voice: <i> Wake up, Dolores. </i>

[0152] "

[0153] The following is an exemplary embodiment of the data contained in the converted subtitle file (parts of the subtitles in the converted format) modified from the exemplary embodiment of the raw subtitles above:

 [0154] "00: 01: 45.024 -> 00: 01: 47.064

[0155] <vim-sentence> <vim-word local-id- "10001" meaning-id- "73035" pos-tag = "n" sentence-id- "1"> Man </vim-word> <vim -word grammar-point-ids = "0" local-id- "10002" meaning-id-'200864 "pos-tag =" v "sentence-id =" 1 "> 's </vim-word> <vim -grammar-point> <vim-word local-id = "10003" meaning-id = "150200" pos-tag = "n" sentence-id = "l"> voice </vim-word>: <i> < vim-word local-id- "10005" meaning-id = "17484" pos-tag- "v" sentence-id = "1"> Wake </vim-word> <vim-word local-id = "10006" meaning-id = "144575" pos-tag = "x" sentence-id- "1"> up </vim-word>, <vim-word local-id = "10008" meaning-id = "0" pos- tag = "n" sentence-id = "1"> Dolores </vim-word>. </i> </vim-sentence> », where

[0156] - “<i>” and “</i>” are the tags (mentioned above), in this case, the tag for highlighting the text in “italics”;

[0157] - “00: 01: 45,024 -> 00: 01: 47,064” ”is the previously described time marking;

[0158] - "<vim-sentence>" is a tag indicating the beginning of a sentence;

[0159] - "</vim-sentence>" is a tag indicating the end of a sentence;

[0160] - "local-id" is the local identifier of a word or phrase;

[0161] - "meaning-id" is an identifier of the meaning of a word or phrase in a dictionary of words and phrases;

[0162] - “pos-tag” is an identifier of a part of speech for a given word or phrase in a dictionary of words and phrases;

[0163] - “sentence-id” is an identifier of a sentence to which a word or phrase refers.

[0164] Thus, the parser can convert the data from the original subtitles to the converted subtitle format and transmit such data, including data in the converted subtitle format to the media player either after modifying the entire file containing the original subtitles, or in parts, i.e. modifying the original subtitles into converted subtitles on the fly, as will be described later.

[0165] It is worth noting that the described tags can differ both in spelling, format, and functionality, for example, instead of the <i> tag, at least one <ii>, <italic>, <italic tag can be used > etc., in particular, describing the functionality of the tag, for example, the action that performs the given tag (the action performed by the system, for example, described in the framework of the present invention, in this case, the change in the slope of the characters displayed on the screen as a subtitle ) If the described system encounters an unknown tag (which, for example, is not contained in the list of tags that the parser and / or system element recognizes and processes, for example, shown in FIG. 5) or a bunch of tags, the system may skip and not display such tags and content enclosed in tags (e.g. words and phrases), i.e. ignore such tags and / or content enclosed in such tags (framed by such tags). Also, at any time (for example, before, after the start and / or during playback of media content, display of subtitles, translation of user-selected words, etc.), the subtitle format can be converted to another format, for example, to the subtitle format “ understood "(capable of processing) by the system or by at least one element of the system (including plug-ins, program code, etc., installed for example on a media resource, web resource, etc.) and / or at least , one component associated with a system or system element, realizes a specific plug-in, program code, application, etc. related to a media resource, a web resource, an application, for example, in which subtitles are displayed, media content is played, translation of words, user dictionary is displayed, etc. It is worth noting that the subtitle format may include the described change in the process of tagging, changing the format of tags (including adding new tags and / or deleting existing tags). In this case, the parser, one of the above (and other components mentioned in the description of the present invention) components, as well as other modules of the system (system elements) described in the framework of the present invention (an example of which is shown in FIG. 5), for example, subtitle software module 545A, 545B, subtitle translation module 520 and others, can be modified, changed, added, etc. (for example, by a programmer, a person who moderates a web resource / web portal, user application, etc.) in order to support (the ability to be processed by the described system or at least one of its modules or a related module, component and etc.), subtitles in at least one “old” and / or at least one “new” format.

[0166] It is also worth noting that the described system, if it encounters an unknown tag, can inform programmers, system developers, resource moderators, etc., for example, through the functionality of the built-in code, about the fact of the presence of such a tag. Such transmitted information can be used to add such unknown tags to one of the modules of the system, as well as to convert the subtitles in which the system met such a tag to another subtitle format, for example, to a newer subtitle format. It is also worth noting that the user can inform programmers, developers, moderators, etc. through the feedback module 555A, 555B. the presence of such tags in the subtitles, for example, if such a tag was seen in the displayed subtitles. Also, the user can inform (developers, etc.), for example, one of the methods indicated in the description of the present invention, about the presence of tags in the displayed subtitles, for example, if the subtitles contain an opening tag, but do not contain a closing tag, or if subtitles contain a closing tag, but do not contain an opening tag, or duplication of opening or closing tags is contained.

[0167] As mentioned above, at least one subtitle (original and / or translated) can be displayed in at least one of the subtitle display modes when displaying / playing media content to a user. In addition, the user can be displayed a translation of at least one of the parts of the subtitles (original and / or translated) displayed to the user, for example, the translation of one word, phrase, phrase, part of the sentence, the whole sentence, etc., for example , when the user indicates such a part of the subtitles. The translation of part of the subtitles for display to the user (student, group of students, teacher, etc.) is selected from the dictionary 560 (FIG. 5) of words and phrases, and the translation of part of the subtitles can be displayed to the user depending on the level selected (for example, by the user) complexity, in particular, through menu item 140, as will be described later. It is worth noting that in a particular embodiment of the present invention, when a translation of a part of subtitles is displayed to a user, for example, indicated by the user, the user can view (the user can be displayed) options for translating part of the subtitles, for example, by setting the level of complexity. It is also worth noting that the complexity of the displayed translation of these words can be determined in accordance with the set complexity mode, so that a translation with a certain level of complexity (with a certain complexity) embedded in the dictionary can be displayed to the user. Having selected the difficulty level, the user can view the translation of a part of the subtitles corresponding to the selected level of complexity, for example, an easier or more complex translation of a part of the subtitles can be displayed to the user. It is also worth noting that the playback of media content can be suspended automatically described by the system (for example, media player tools), so that the user can take the time of the translated part of the subtitles, as well as, for example, add a part of the subtitles and / or transfer part of the subtitles to at least one user dictionary as described below. It is also worth noting that a translation display of a part of subtitles can be initiated by a user, for example, by a user indicating a part of subtitles whose translation he would like to see, and / or a translation display of a part of subtitles can be initiated by the system described in this invention, for example, at least , one of its parts, in particular, a media player and / or dictionary module 548A, 548B (FIG. 5), for example, depending on the selected display mode of the subtitles 110 and / or the selected level of complexity of the means m member 140, as will be described hereinafter. The user can indicate at least one part of the subtitles (in particular, to display the translation of the specified part of the subtitles) can be done through user interaction, for example, with the displayed raw and / or converted subtitles (original subtitles and / or translated subtitles) using various input devices, for example, a mouse, keyboard, joysticks, devices equipped with eye tracking, etc., as well as by touching and gesturing using Niemi devices providing or supporting a touch input information, such as touch screens or devices panel. The user can select a part of the subtitles by pointing the pointer of the input device (in particular, the mouse cursor) to the part of the subtitles, by highlighting the part of the subtitles (for example, the user can circle the part of the subtitles, the translation of which he wants to see) using the cursor or by gesture when using devices with touch a screen or a touch panel (touchpad - from the English touchpad), or by means of eye movements monitored, for example, by cameras installed in an eye position reader (e.g. Goog le glasses) around the part of the subtitle that interests the user or by focusing the user's gaze on the part of the subtitles and through any other devices, in particular, data input (input / output) devices, interaction devices that allow interacting in one way or another (for example, select, highlight, indicate, etc.) with data, in particular with subtitles, video, and / or other elements of the system described in the framework of the present invention.

[0168] It is worth noting that when displaying the translation of a part of the subtitles, for example, indicated by the user, the time of interaction between the user and one or another part of the subtitles can be taken into account, for example, the time that the user touches the screen with a touch screen can be taken into account (holding the finger on the user for a while time) or the time spent by the pointer (in particular, the mouse cursor) for some time on top of the subtitle part, etc. Thus, when it is established that it is necessary to provide / display a translation of a part of subtitles, a subtitle translation can be displayed when playing media content, in particular to a user in a media player, for example, above / above, instead, above and / or in any other way and in any other area reproduced media content or outside it (including display in other windows of the application in which the media content is played, or in another application, on another device, etc.) of at least one part with subtitles identified by the system described in the framework of the present invention, as part of the subtitle for which you must provide a translation, in particular, display the translation of such a part of the subtitle.

[0169] It is worth noting that the translation of part of the subtitles and / or part of the subtitles is added to the user’s dictionary if the specified part of the subtitles and / or the translation of the specified part of the subtitles is not in the user’s dictionary, and the presence of the specified part of the subtitles and / or the translation of the specified parts of the subtitles in the user dictionary can be performed using tools (for example, implemented as program code) of the user dictionary module 555A, 555B (FIG. 5) and / or by means of tools (for example, implemented in ie code) dictionary module 548A, 548B (FIG. 5) words and phrases.

[0170] Before the translated subtitles are displayed to the user, they can be translated from the original subtitle language to at least one of the languages other than the original subtitle language, or already translated subtitles can be used, for example, from available sources of translated subtitles or from available resources containing translation of media content. Original subtitles can be obtained and converted by the system described in the present invention from various subtitle sources, for example, web resources, in particular websites on which original subtitles can be stored, or servers, including local servers, web servers, and subtitles on such resources can be stored in databases of various formats, either in the form of files, for example, in the format of subtitles or in any other binary or text format, in tables, etc.

[0171] Translation (and / or modification of the original subtitles to converted subtitles) of the original subtitles can be performed on the server 505 or on a computing device on which media content will be played or already started, or on any other computing device, such as a computer or mobile device (in particular, a smartphone, tablet, etc.) of the user.

[0172] Translation of the original subtitles into at least one language different from the language of the original subtitles can be done by human and / or computer translators (in particular systems, automatic / machine translation, for example, Google translator or Yandex translator and etc.). It is worth noting that subtitles translated by translator programs (or translated by people) can be edited by people translators, including, upon request from a user who displays subtitles, for example, through user feedback, as will be described later.

[0173] Subtitles (translated in the original language of media content) can have several levels of difficulty. Depending on the difficulty level, in particular, selected by the user through the menu control 140 (FIG. 1), the user can be displayed subtitles of the corresponding level. If in the described system, for example, in the database of converted subtitles 530 (FIG. 5) or in the database of raw subtitles 515 (FIG. 5) there are no subtitles corresponding to the selected difficulty level, then subtitles of the closest difficulty level can be displayed to the user, for example, Subtitles with difficulty levels above or below the selected level. If in the system subtitles of only one level are available for display in the media player, then subtitles of only the available difficulty level are displayed in the media player.

[0174] It is also worth noting that if original subtitles cannot be found for a specific media content, translated subtitles (as well as original subtitles) can be created using technologies that allow you to convert sound to text, i.e. through speech / voice recognition systems. As a source for creating translated and / or original subtitles, audio content accompanying video content or corresponding to video content can be used (for example, an audio track for a movie can be recorded together with video, i.e. make up one media content, or an audio track for video can be written as a separate file). Such speech recognition systems can be used to create subtitle files (original and / or translated) in the subtitle format or in any other format (including text format) with the automatic creation of time stamps (time stamps) in the subtitle file, which are described above and will be described Further. Timestamps can be determined in the process of speech recognition of audio content (audio stream, audio track of media content), for example, by the start time of a phrase in audio content (or media content) and by the end time of a phrase, and timestamps can be shifted forward in the timeline or backward in some the limits defined by the settings of the speech recognition system and / or the system for converting subtitles to the subtitle format (for example, the format of the converted subtitles). The magnitude of the offset of the beginning and end of the display of subtitles (time stamps) may depend on the size (length) of the subtitles, in particular, the number of words and / or letters in one phrase, etc. The amount of timestamp offset can be set by the translator and / or the moderator of the resource on which media content is displayed (will be displayed), or by the person responsible for the process of creating and / or converting and / or translating subtitles. The user can also change the offset amount of time stamps, for example, by means of menu items 115, for example, to set the duration for displaying subtitles, in particular, before playing or already in the process of playing media content and / or displaying subtitles. The system described in the present invention can also change the duration of the display of subtitles during or before the playback of medical content and / or display of subtitles by means of a program code, for example, located on a server on which media content is played, or by a program code executed on a third-party computing device using relative to the device on which the media content is played, and / or executed on the computing device of the user on which the honey is played akontent and / or subtitles are displayed or which is connected to the device (via wired network, wireless network, or by any other known method), where the media content is reproduced and / or subtitles.

[0175] Also, subtitles accompanying media content can be converted to software subtitle format (in particular, to text subtitle format) by means of recognition systems for subtitle text contained in “sewn” into media content (also called Hard Subtitles, also called hard or hardsubs ) subtitles or contained in prerendered subtitles (English prerendered subtitles). Software subtitles (also called soft subtitles - from the English. Soft subtitles), as a rule, are a text, in particular, with markup elements, as described earlier, and as will be described later. A special case of software subtitles is the original subtitles and converted subtitles, although they are not limited to software subtitles and the original and / or converted subtitles can be stored in any format (for example, be embedded, rendered, etc.) or be modified in such formats.

[0176] It is worth noting that the translation of the subtitles by at least one of the methods described above can be carried out “on the fly”, i.e. in parallel with starting playback of media content, or playback of media content may not be delayed for some time so that the system (and / or translator and / or the person responsible for the translation and / or for the modification of subtitles into converted subtitles described below, etc.) described in the framework of the present invention, managed to perform an initial analysis of the incoming information (subtitles, audio, video, etc.) and / or to translate some of the incoming information, for example, translation of the original subtitles or recognition of part of audio, subtitles, etc., i.e., for example, part of the described actions associated with the translation and / or conversion / modification of subtitles, and / or any other actions associated with the display and / or interaction with subtitles and / or media content, for example, part of the parser’s operations.

[0177] As mentioned above, the original subtitles can be uploaded to a server on which the subtitles are translated in order to obtain translated subtitles and / or on which the original subtitles are modified to obtain converted subtitles. It is worth noting that translated subtitles can also be modified to converted subtitles (to the converted subtitle format).

[0178] It is worth noting that if the media player does not support subtitle playback, then the subtitle display functionality can be added to the media player by using program code, for example, in JavaScript, which, for example, using the API (application programming interface, application programming interface) a media player allows you to display subtitles, in particular, from a subtitle file transmitted to a service device (for example, an Internet service implemented as a website on which It becomes a media player that uses a media player to display the media content) or by reading the subtitles with the server 505 or any other device, including a user device such as a smartphone, a personal computer, etc. The described functionality for adding subtitles to reproduced media content can be implemented in the form, for example, of a browser extension or application for a computing device, for example, in the form of at least one add-on, plug-in, extension ( extention) etc. or combinations thereof, in particular, installed on a device or in a service on which media content is reproduced. Also, program code that implements the ability to display subtitles can be added (in a particular case, downloaded) to a device or web resource on which media content and / or subtitles are played, or on which display of reproduced media content and / or subtitles and / or such program code can be accessed, for example, via the HTTP protocol, if such program code cannot be added to such web resources and devices.

[0179] It is also worth noting that to implement the display of subtitles during the playback of media content can be used (in the particular case, run), for example, on a server, a web resource and / or on a user's device, etc., program code, capable of intercepting media content (in particular, a video stream and / or audio stream), for example, using the functionality (and / or API) provided by a media player and / or application, in particular a browser, and displaying subtitles together with a media stream or a separate layer, for example, in browser Here, or in a separate application, in particular, with a transparent background on which subtitles can be displayed.

[0180] As mentioned above, the media player is capable of displaying raw or converted subtitles, as well as translating part of the subtitles. In FIG. 2 shows example embodiments of the aforementioned display modes of raw and / or converted original subtitles 110 (A), translated subtitles 110 (B), and original and translated subtitles 1 (B).

[0181] In mode 110 (A), subtitles in the original subtitle language (or in the language of media content) 180 are displayed. Said subtitles in mode 110 (A) can be displayed when subtitles in the original subtitle language are available, and can be downloaded from a file, containing subtitles in a converted format.

[0182] In mode 110 (B), subtitles are displayed in a language other than the language of the original subtitles (or the language of the media content) 190, for example, translating subtitles (translated subtitles) into a language other than the language of the media content. Mentioned subtitles in 110 (B) mode can be displayed when the translation of the original subtitles is available or when subtitles are available in one of the languages other than the media content language, and the subtitles can be downloaded from a file containing subtitles (translation, subtitles in one of the mentioned languages etc.) in a converted format.

[0183] In mode 110 (B), subtitles are displayed in the original subtitle language (or media content) 180 and a language other than the original subtitle language (or media content language) 190. Said subtitles in mode 110 (B) can be displayed when subtitles are available in the language of the original subtitles and subtitles in one of the languages other than the language of the media content (in particular, the language of the original subtitles), and the subtitles in the language of the original subtitles (or in the language of the media content) and in a language other than the language of the original subtitles of the file containing the subtitles in the converted format. It is worth noting that subtitles can be downloaded from at least one subtitle file.

[0184] FIG. Figure 3 shows exemplary options for displaying unprocessed and / or converted original subtitles and displaying complex words, displaying unprocessed and / or converted original subtitles with replacing complex words in them and displaying complex words with standard text transparency, and the rest of the subtitles in the form translucent text.

[0185] In the 110 (D) mode, subtitles are displayed in the language of the original subtitles (or media content) 180 or in a language different from the language of the original subtitles (or media content) 190, and with a translation display 184 (for example, as mentioned above, above translatable parts of the subtitles) of at least one part of the subtitles (in particular words, phrases, etc.) of at least one of the displayed subtitles (set of subtitles) into a language other than the language of the displayed or original subtitles, particular complex parts of subtitles (compound words , complex phrases, phraseological units, etc.), and the user can choose the level of complexity, as described above and as will be described later. Subtitles in 110 (D) mode can be displayed when subtitles are available in the language of the original subtitles (or any other language, in particular, the language studied by the student or the language the student speaks) and complex words (described above) and / or levels are available difficulties.

[0186] In mode 110 (E), subtitles are displayed in the language of the original subtitles (or media content) 180 or in a language different from the language of the original subtitles (or language of the media content) 190, wherein, with a translation of 184 of at least one part of the subtitles by replacing such a part of the subtitles by translating such parts of the subtitles of at least one of the displayed subtitles into a language different from the language of the displayed or original subtitles, in particular complex parts of the subtitles, and the user can select the level of complexity, as described ano above and as will be described hereinafter. Subtitles in 110 (D) mode can be displayed when subtitles are available in the original subtitle language (or any other language, in particular, the language studied by the student or the language the student speaks) and complex words and / or difficulty levels are available.

[0187] In the 110 (E) mode, subtitles are displayed in the original subtitle language (or media content) 180 or in a language different from the original subtitle language (or media content language) 190, moreover, with the display of complex parts of the subtitles with standard text transparency 382 ,, and the rest of the subtitles in the form of a translucent text 384. Subtitles in 110 (E) mode can be displayed when subtitles are available in the language of the original subtitles (or any other language, in particular, the language studied by the student or the language the student speaks) and are availablefalse words, and / or levels of complexity. Transparency parameters for translucent original subtitles (subtitle text in the original language of media content) and for a part of subtitles displayed with standard transparency (complex parts of subtitles) can be set by the user or by the person responsible for the operation of the media player, web resource (in particular, the website ), etc., for example, through the subtitle module 545A, 545B. or by means of a media player. In this case, the standard transparency of subtitles (subtitle text) is understood as zero transparency of the subtitle text (completely opaque text), although any transparency / translucency can be set (transparency level, for example, expressed as a percentage in relation to completely opaque text), allowing the user comfortably view reproduced media content and displayed subtitles.

[0188] It is worth noting that the subtitles can be stored in at least one subtitle file, for example, subtitles in the original language and the translation of the subtitles can be stored in a single file or in separate files. For example, subtitles in the original language can be stored in one file, and a translation of subtitles in at least one of the languages can be stored in at least another file, and translations of subtitles in different languages can also be stored in different files. As mentioned above, subtitles in the original language and / or translation (or translations) of the subtitles can be stored in the format of the converted subtitles.

[0189] It is worth noting that, mentioned above, the menu item for selecting / setting the difficulty level 140 can be displayed (or can be active) in the menu 115 or can be hidden (made inactive) in the menu 115 depending on the presence of the mentioned complex words and / or difficulty levels.

[0190] It is also worth noting that subtitles can be displayed in at least one of the subtitle display modes, for example, in mode 110 (A) or mode 110 (B), or in any combination of available modes, for example, in 110 (A) together with mode 110 (B) (which is a special case of mode 110 (B)) either in mode 110 (B) together with mode 110 (D) (FIG. 3) or mode 110 (D) (FIG. 3).

[0191] Also, the user can interact through input devices (as described above) with subtitles displayed in any of the above modes or a combination thereof. So, for example, a user can interact with subtitles in the original subtitle language or with translated subtitles downloaded, for example, from a subtitle file containing converted subtitles (subtitles in a converted format).

[0192] Types of user interaction with subtitles may include referring to a part of the subtitle by the user in order to display the translation of the specified part of the subtitles, as described above, depending on the selected level of complexity and the presence of complex words and / or difficulty levels.

[0193] It is worth noting that the user can also interact with information displayed as a result of user interaction with subtitles and their parts. So, for example, if the user is shown the translation of the part of the subtitles indicated by the user, then the user can interact (through the mentioned input devices) with the translation displayed to him, in particular, the user can add the selected part of the subtitles and translate the selected part of the subtitles into the user dictionary 560 ( FIG. 5).

[0194] When a user interacts with the input devices (and / or the input / output interface) with the subtitles or at least one of their parts of the subtitles, the playback of media content and / or the display of the subtitles can be paused (for example, paused) , for example, by means of a media player. So, for example, when a user indicates a part of subtitles to display a translation of a specified part of subtitles, or when a translation is specified to add a specified translation of a part of subtitles to a user's dictionary 560, playback of media content and / or subtitles can be paused, for example, so that the user does not miss (not overlooked) part of the reproduced media content and, for example, could focus on the translation of the subtitle displayed to him or on adding the translation and the translated part of the subtitles to the dictionary user, or to add a translation option for the selected part of the subtitles or to transfer part of the subtitles if there is no translation of the selected part of the subtitles, etc.

[0195] It is worth noting that the text of the translation of part of the subtitles (in particular, specified by the user), as well as the text of the subtitles in the original language or in a language other than the language of the original subtitles (or media content) can be voiced, for example, using software capable of receiving at the input, text, and at the output, play or write text to a file in audio format, i.e. thus “voicing” the text transmitted to such software, the text in audio format being reproduced by the user. Thus, the user can be reproduced, for example, the translation of part of the subtitles and / or all of the entire subtitles during the playback of media content and / or subtitles (including the translation of at least one part of the subtitles on the fly, i.e. after starting the playback of media content preliminary conversion of the text into an audio file and its subsequent storage on the server and / or user device and / or web resource on which the media stream is played) or when the media content is played and / or subtitle paused.

[0196] FIG. 4 is a flowchart of an exemplary embodiment of the method described in the framework of the present invention. The process describing the implementation of the method described in the framework of the present invention begins in step 410 with downloading a media player, for example, downloading a media player on a website or loading a media player in an application (including mobile applications), with launching a media player implemented, for example, as a separate applications. Next, the process proceeds to step 414, in which at least one of the subtitle display modes is selected, for example, by the user through the menu items of the media player 115. Also, the subtitle display mode (s) can be selected / set by the media player. So, for example, the default subtitle display mode can be selected, for example, the first list mode in the list of subtitle display modes. Also, the subtitle display mode can be selected / set by external systems with respect to the system in which the media player is displayed and / or launched, for example, the selection of the subtitle mode can be set by the user training system, which, for example, implements the user training process by viewing media content ( in particular, with subtitle display) and interaction with it and / or with displayed subtitles, user dictionary, etc. Such a user training system can be located on the server 505 (FIG. 5) or on any other computing device that modifies and / or translates the subtitles and / or plays media content and / or subtitles, moreover, the playback of media content and / or display of subtitles, including selection of subtitle display modes, as well as interaction with subtitles (in particular, subtitle parts), translation of parts of subtitles, media content, words stored in the user dictionary, m elements diaproigryvatelya and / or media content can be realized by user training system (particularly, the trainee), e.g., by the user, in particular, the GUI interface.

[0197] After step 414, the process proceeds to step 418, in which, depending on the selected subtitle mode (110, FIG. 1) and the need to display the subtitles, the system is checked (for example, on server 505 or on the device on which playback is being performed) media content, or on a website on which media content is played) of converted subtitles, for example, previously created and stored, for example, on server 505 or on a computing device or web resource on which media content is played NTA. If the converted subtitles were found by the process, the process proceeds to step 420, in which the converted subtitles are loaded, for example, into the subtitle module, in the particular case being part of the media player, after which the process proceeds to step 430. It should be noted that depending on the selected mode, at least one of the steps 418, 420, 422, 424, 426 may be skipped. So, for example, if the media content playback mode without subtitles is selected, the process goes from step 414 to step 430. Also, if the display mode of only translated subtitles is selected, then steps 418, 420, 422, 424, 426 can be replaced by the step of downloading translated subtitles, for example, from a file containing raw subtitles.

[0198] If no converted subtitles were found in step 418, the process proceeds to step 422, in which the original subtitles to the media content from at least one source and / or resource are loaded into the parser in the system (shown in FIG. 5) subtitle 510 (FIG. 5), moreover, the original subtitle can be pre-loaded, for example, on a server 505, or a computing device or web resource (website) on which media content is played, or on any other computing device or device for storing data associated with the system shown in FIG. 5 or its elements / components. After step 422, the process proceeds to step 424, in which the received subtitles are translated from the original language into at least one language different from the language of the original subtitles. It is worth noting that step 424 is optional, because, for example, if the user selects a mode in which translation / translated subtitles are not displayed (for example, display modes 110 (A), 110 (D) - 110 (E), FIG. 2 and FIG. 3), then step 424 may be skipped.

[0199] The translated subtitles may be stored on a server, for example, in a database of original subtitles and / or in a database of translated subtitles, and / or in a database of converted and translated subtitles (530, FIG. 5), and / or in RAM or temporary files of server 505 or computing device 570 or a web resource on which media content is played.

[0200] It is worth noting that the translation of the subtitles may not be fully completed, ie only part of the subtitle text can be translated. The percentage of translated subtitle text (percentage of translated subtitles, part of the translated subtitles) can be set by a person, for example, the person responsible for the translation of the subtitles, the moderator of the resource on which the media content will or will be played, etc. The untranslated part of the subtitles is automatically inserted into the translated part of the subtitles, so that the translated subtitles can be displayed to the user in a partially translated version or the user can only see sentences that have been fully translated, and the technology for determining fully translated sentences can include the beginning and end of a sentence, for example, by the capital letter of the first word of the sentence and the point at the end of the sentence and before starting a new one or by a new line in the sub file iters, etc., and the presence of untranslated words in a sentence can be determined, for example, by the presence of at least one letter, word or part of a word in a language other than the subtitle language or by affixing special tags characterizing untranslated sections in the subtitle file subtitle text in the process of translating subtitles with their subsequent reading, for example, by subtitle module 545A, 545B. in the process of displaying subtitles and / or playing media content.

[0201] It is worth noting that the translation of the subtitles may not be fully completed, i.e. only part of the subtitle text can be translated. The percentage of translated subtitle text (percentage of translated subtitles, part of the translated subtitles) can be set by a person, for example, the person responsible for the translation of the subtitles, the moderator of the resource on which the media content will or will be played, etc. The untranslated part of the subtitles is automatically inserted into the translated part of the subtitles, so that the translated subtitles can be displayed to the user in a partially translated version or the user can only see sentences that have been fully translated, and the technology for determining fully translated sentences can include the beginning and end of a sentence, for example, by the capital letter of the first word of the sentence and the point at the end of the sentence and before starting a new one or by a new line in the sub file iters, etc., and the presence of untranslated words in a sentence can be determined, for example, by the presence of at least one letter, word or part of a word in a language other than the subtitle language or by affixing special tags characterizing untranslated sections in the subtitle file subtitle text in the process of translating subtitles with their subsequent reading, for example, by subtitle module 545A, 545B. in the process of displaying subtitles and / or playing media content.

[0202] It is worth noting that translated subtitles can be downloaded together with the original subtitles in step 422, if they are found, for example, those contained in the file with the original subtitles, either on the resource with subtitles 510, or on the server 505. In this case, the step 424 may be skipped.

[0203] After step 424, the process proceeds to step 426, in which the process of modifying the subtitles into converted subtitles is started using at least the parser described above, and the process proceeds to step 430. It is worth noting that after the modification, at least , of one part of the original subtitles into converted subtitles, the contents of the converted subtitles can be displayed together with the reproduced media content, and the modification of the original subtitles into converted subtitles can continue in the background In the process of playing media content, for example, until all original subtitles are converted to converted subtitles or until the media player is closed, or until other media content is selected for playback in the media player (although in this case, modifying the original subtitles into converted subtitles may be continued to obtain converted subtitles, which can then be stored on a data storage device, for example, on a data storage device a rver 528, and / or a computing device and / or a web resource on which media content is played). Also, the process depicted in FIG. 4, you can wait until the entire content of the original subtitles has been modified to converted subtitles, and then go to step 430.

[0204] It is also worth noting that after converting at least one portion of the original subtitles to converted subtitles (or after converting all of the original subtitles to converted subtitles), such a modified portion of the converted subtitles can be stored on the data storage device, as described above, and, for example, can be further used in step 420, for example, after the media content to which the converted subtitles correspond is opened by the same or another user. Also, a file with converted subtitles containing at least one part of the modified original subtitles can be supplemented with at least one part of the modified subtitles not contained in the file of modified subtitles, for example, the process can append data during the modification of the original subtitles to a file with converted subtitles.

[0205] It is worth noting that the media content can be assigned a unique identifier that can be used by the system described in the framework of the present invention, for example, to match the media content of the converted subtitles. Thus, after downloading media content that has been assigned a unique identifier in the media player, the system is able to find the converted subtitles using this identifier in step 418. If no unique identifier has been assigned to media content, then a unique identifier is assigned to such media content. It is also worth noting that if a unique identifier has not been assigned to media content, the described system can search for converted subtitles for such media content, for example, by its name, in particular by the name of the movie, after which, after the correspondence of the converted subtitles to media content is established, such media content may be assigned a unique identifier for the corresponding converted subtitles.

[0206] It is worth noting that the original subtitles (for example, in raw format) 512 can be stored in the raw subtitle database 515 (FIG. 5), implemented, for example, as a set of files in the format received on the data server, or can be converted to at least one text file, or can be saved in a single file, or can be converted to a database format, in particular, can be converted to tables, trees (for example, B-trees) and saved subtitles can be are interconnected. It is also worth noting that the subtitles downloaded to the server can be stored in the RAM (in particular, in RAM - Random Access Memory) of the server or in temporary files, in particular, while waiting for at least one of the steps illustrated in FIG. . 4, for example, until they are modified and stored in a database of converted and translated subtitles (530, FIG. 5).

[0207] In step 430, the media content selected by the user is either loaded by the user’s training system into the media player or loaded into the media player by a third-party system, for example, by opening a web link containing the path to the media content with automatic launch of the media player, or it can be loaded into the media player and / or opened in a media player in any other way. Next, in step 435, the subtitle is displayed in one of the previously selected subtitle display mode. It is worth noting that the subtitle display can be started simultaneously with the playback of media content, i.e. step 430 and step 435 can be initiated at the same time, or step 435 can be initiated (started) before step 430. In the particular case, step 430 and step 435 can be performed asynchronously or can be synchronized with each other, for example, the subtitle display speed may adjusted during the playback of media content, in particular by changing the synchronization of displaying subtitles and media content.

[0208] Next, in step 440, the system checks whether the user specified a portion of the subtitles in the displayed subtitles (translation, subtitles in the language of the media content and / or in a language other than the language of the media content), for example, to display a translation of the specified portion of the subtitles into the language, different from the language of the selected portion of the subtitles. If the user did not specify a part of the subtitles in step 440, then the process proceeds to step 450. If the user specified the part of the subtitles in step 440 (for example, as described above), the process proceeds to step 445, in which the user is shown the translation of the part indicated by the user subtitles, in particular, from the dictionary 528 (FIG. 5) of words and phrases by means of tools (for example, by instructions, in particular, implemented as program code) of the dictionary module 548A, 548B (FIG. 5) of words and phrases, and the process proceeds to step 450. Art. It should be noted that when it is established that the user indicates a part of the subtitles and / or when displaying a translation of the specified part of the subtitles, the playback of media content and / or the display of subtitles can be stopped or paused, or the playback speed of the media content and / or display of subtitles can be slowed down automatically, for example, by means of media player and / or means described in the framework of the present invention, in particular, means (for example, instructions, program code, etc.) of the subtitle module ov. It should be noted that the playback speed of the media stream and / or its part and / or display of subtitles or their part can be automatically adjusted by the system, for example, depending on the selected / set level of complexity. Also, after the translation of the specified part of the subtitles is displayed, the user can stop or pause (pause), or change the playback speed of the media content and / or display the subtitles (in particular, slow down the playback speed or slow down the display speed of the subtitles), for example, using the controls media player menu.

[0209] In step 450, the process verifies that the user has interacted with the translation of the subtitle portion of the user, for example, by indicating the translation of the selected subtitle portion, in particular in order to add the provided translation of the subtitle portion (and the specified portion of the subtitle) to the user dictionary 560 (FIG. 5) by means of tools (in particular, instructions implemented in the form of program code) provided by the user dictionary module 555A, 555B (FIG. 5) and / or by means of tools (in particular, instructions n, implemented as a program code) of a dictionary module 548A, 548B (FIG. 5) of words and phrases.

[0210] It is worth noting that the translation of the selected part of the subtitles can be provided to the system described in the framework of the present invention, with subsequent display to the user from the user dictionary 560 (FIG. 5), which, in turn, can be associated with a dictionary of words and phrases 528, for example, by means of a user dictionary module 555A, 555B (FIG. 5) and / or by means of a dictionary module 548A, 548B (FIG. 5) of words and phrases.

[0211] If the step 450 did not establish the fact of adding the translation of the selected part of the subtitles (and the specified part of the subtitles), for example, by the user, to the user dictionary 560 (FIG. 5), then the process proceeds to step 460. If in step 450 it was installed the fact of adding or the fact of the user’s intention to add the translation of the specified part of the subtitles (and part of the subtitles) to the user dictionary 560 (FIG. 5), the process proceeds to step 455, in which the user-specified part of the subtitles and the translation of the specified part of the subtitles are added to the user’s dictionary m of the user dictionary module 555A, 555B (FIG. 5) and / or through the dictionary module 548A, 548B (FIG. 5) of words and phrases. In the particular case of the implementation of the present invention, words and phrases are identical entities for the described parser and / or at least one of the vocabulary mentioned in the present invention, and / or for at least one of the constituent parts (in particular, modules) described in within the framework of the present invention, a system, an exemplary embodiment that is presented in FIG. 5 (for example, a media player, a subtitle conversion module, a subtitle translation module, a word and phrase dictionary module, a subtitle module, a user dictionary module, etc.). Under the identity of entities in a particular case, it is understood that the phrase can be translated as a whole word or as words that are related in meaning, for example, when forming a translation of a word or phrase. So, for example, in one of the implementations of the invention, the phrase is more priority for the translation, and not the individual words of this phrase. Thus, at least one of the modules described in the framework of the present invention can put down weights for words and phrases that (weights) can be used to display the translation to the user. So, in a particular case, the phrase can be put more weight than the words of which it consists, and in this case the phrase will be translated in its entirety, rather than individual words of the phrase. It is also worth noting that individual words of a phrase can be translated separately, without regard to context (which in this case can be a phrase and its meaning or part of the text surrounding a word or phrase). So, for example, the method described in the present invention, implemented by the described system, may include additional functionality, for example, in the form of a flag in a media player, which determines the need to translate individual words of a word combination, and not the whole word. Also, it is worth noting that the functional of translating individual words can be used on the basis of various factors and conditions, such as, for example, the level of complexity described in the framework of the present invention, the level of preparedness (level of knowledge) of the user, frequency, etc.

[0212] Next, the process proceeds to step 460, in which the process checks whether the user has proposed corrections and / or additions to the displayed subtitles and / or translation of a part of the subtitles, for example, the specified part of the subtitles or the whole set of subtitles. Such corrections and additions may include corrections in the translation of the specified part of the subtitles, for example, if the user believes that he has found an error in the translation of part of the subtitles, or the user has found an error in the displayed subtitles (in the language of media content and / or in a language other than the language of media content ) Such errors may include stylistic, lexical, phraseological, morphological, syntactic, spelling, punctuation and other types of errors, incorrectly translated parts of subtitles, in particular, words, phrases, phrases, aphorisms, etc., as well as errors in synchronization of displayed subtitles and media content, for example, the lag of subtitles from media content (video content and / or audio content) or advancing media content with subtitles.

[0213] If a correction / addition request from the user was not set in step 460, the process proceeds to step 465, otherwise the process proceeds to step 462, in which the corrections and / or additions proposed by the user are fixed in the system by using, for example , feedback module 550A, 550B (FIG. 5) for the purpose of their further correction in the translation, dictionary 528 (FIG. 5) of words and phrases, or in a file of converted subtitles, etc., depending on the correction / additions proposed and user approved on example, after verification by the person responsible for the translation of the subtitles or the person responsible for the content of the dictionary of words and phrases, or the moderator of the resource (in particular, a web resource, for example, a website), or the author of the application in which the media content is played, or any other person responsible for making corrections / additions to the subtitles, translation and / or dictionary of words and phrases. Additions may include, for example, translation options for some of the subtitles, in particular words, phrases, phraseologisms, etc., as well as additions to subtitles if, for example, the user notices that the text of the subtitles is different from the text spoken by the actor, or subtitles do not contain all the text spoken by the actor, etc. It is worth noting that the mentioned corrections and / or additions can be automatically adopted by the system described in the framework of the present invention without prior moderation (moderation) and / or verification, for example, if such corrections / additions were received from more than one user. After fixing the request in step 462, the process proceeds to step 465, in which the process checks the fact of the end of the media content and / or subtitles.

[0214] If it was determined in step 465 that the media content has ended (for example, the end of the video or audio being played by the media player has reached the end) or the subtitles have ended, in particular, the media player has stopped playing the media content and / or displaying the subtitles, for example, due to the end of the playback file / media content stream or subtitle file, then the process ends in step 470, otherwise the playback of media content and / or display of the subtitles continues and the process returns to step 430.

[0215] As mentioned above, the user can pause the playback of media content (for example, pause the media player), for example, using the control 120, and the subtitle / subtitle list (including subtitle and subtitle transfer to original language of media content) that were and / or will be displayed to the user during the playback of media content.

[0216] FIG. 5 shows an exemplary embodiment of a system implementing the present invention and data flows between the constituent parts of the described system and the parts / components associated with the described system. The system may include at least one server 505, which can store a database of raw subtitles 515 (which stores the mentioned subtitles from resources 510 containing subtitles), which can be stored, for example, on a storage device, for example, on, at least one hard disk drive, at least one solid state drive, etc. The system described in the framework of the present invention also includes modules implemented in the form of program modules located on the server 505 or connected to the server 505 by devices, for example, a computing device 570 or a computing device, access to the data of which and / or on which the content is located, at least of at least one website is carried out through a browser (in a particular case, through a web browser) 535. Thus, the said modules include at least one of the following modules: subtitle ode 520; subtitle conversion module (subtitle modification module) 525; vocabulary and phrase module 548B, 548A; subtitle module 545A, 545B; feedback module 550A, 550B; user dictionary module 555A, 555B.

[0217] Also described in the framework of the present invention, the system may include a user dictionary 560, a dictionary of words and phrases 528, as well as a database of translated and translated subtitles 530, which can be stored, for example, on a storage device, for example, at least at one hard disk drive, at least one solid state drive, etc. It is worth noting that a single database can be used to store raw subtitles, translated subtitles and converted subtitles. Also, translated subtitles and converted subtitles can be stored each in its own database.

[0218] It is also worth noting that the user dictionary 560 and the dictionary of words and phrases 528 can be stored on a storage device (for example, at least one hard disk drive, at least one solid state drive, etc.) moreover, the user dictionary 560 and / or the dictionary of words and phrases 528 can be stored in at least one database, moreover, the dictionary 560 can be stored in one database, and the dictionary 528 can be stored in another database.

[0219] The system described in the framework of the present invention may also include a media player 540A, 540B.

[0220] FIG. 6 shows an exemplary embodiment of displaying a list of subtitles of media content in pause mode. After the media content is paused in the media player (for example, on at least one separate layer, i.e. a layer other than the layer on which the media content, subtitles or media player controls are displayed, or in a separate application window or other application other than from an application in which, for example, media content is played) the user can be shown the history of dialogs, i.e. a list of subtitles that were and / or can be displayed to the user, for example, on at least one interaction element 615 with subtitles in pause mode, can be displayed. Such an element of interaction with subtitles may contain, for example, information elements 620, in particular, an image / photo of the actor and / or character to which the displayed phrase in subtitles belongs, and / or information about such an actor and / or character, for example, his name, age, etc., and such information elements can be interactive, i.e. the user can interact with them, for example, to obtain additional information, for example, about an actor, hero, film, etc., in a media player or in a separate application or program window, for example, in a browser window (in particular, an Internet browser) . Also, the information element can be made in the form of a link (628) or contain a link to additional content / information implemented in a particular case in the form of a web link (for example, an HTTP link).

[0221] The content of said information elements can be edited and / or added manually, for example, by a person responsible for modifying subtitles, a moderator of a media player and / or resource (in particular, a web resource) and / or a device on which media content is played. Also, the content of information elements can be edited and / or added automatically, for example, by using information from at least one subtitle file. In the event that the text in the subtitle file contains the name (or any identifier, for example, identification number) of the actor (and / or the name of the hero) pronouncing the phrase recorded in the form of subtitles, then such an actor name and / or hero name can be used to search and display of information / data about the actor, including, but not limited to, his photo, biography, etc., moreover, the search for such information / data may include a search on the Internet, in the database of stored information on the server or other resources. Also, such information / information about the actor can be found by the name (and / or identifier) of the hero, and information / data about the hero can be found by the name / identifier of the actor.

[0222] It should be noted that in the pause mode of the media player, a translation of a part of the subtitles, for example, specified by the user, as described above, may be displayed to the user.

[0223] It is also worth noting that the user can select one of the elements for interacting with subtitles 615 to start playing media content from the place to which the subtitles contained in the user-specified media content and / or subtitles control correspond. The time from which the playback of media content according to the selected element of interaction with subtitles (according to the selected subtitles) can start can be set and used by the media player tools by using the time marking contained in the subtitle file. When a user indicates an interaction element with subtitles, the content of interaction elements with subtitles (for example, an image and / or text on an interaction element with subtitles) can change. So, for example, when you hover the mouse over one of the elements for interacting with subtitles, the image of the actor can be changed to images of arrow 625, symbolizing the ability to play media content from a specified location / time, in particular, determined by the time marking in the downloaded or used file converted and / or raw subtitles.

[0224] FIG. 7 shows an example of a user interacting with a media player, in particular with subtitles, and an example display of a user dictionary 720. As mentioned above, in the process of displaying subtitles, for example, in the process of playing media content and / or while pausing playback of media content, the user can specify at least one part of the displayed subtitles and / or translation of a part of the subtitles (for example, specified by the user or depending on the subtitle display mode), for example, h To add such a part of subtitles to the user dictionary 560, part of which (or the entire dictionary) can be displayed during the playback of media content and / or during the display of subtitles, for example, in a separate window of the media player and / or other application, as a separate layer in the media player and / or another application, for example, in one of the applications previously described, in particular, blocking part of the reproduced media content (or other displayed images and / or data) or not overlapping part of the reproduced of media content (or other displayed images and / or data), for example, the side (top, bottom, etc.) of the displayed media content, etc.

[0225] It is worth noting that the dictionary of the user 560, or at least one part of it, relating to one media content (for example, one video, in particular a movie) or to all media content that has been viewed or is available for playback to a user, can be displayed to the user in a separate application, or on a web page (or website), etc., access to which is provided to at least one user.

[0226] User dictionary 560 may contain at least one dictionary (sub-dictionary), consisting, in the particular case, of a set of words, phrases, aphorisms, etc., both for one media content and for all parts of subtitles added previously, and the contents of one such dictionary or the entire user dictionary (all user sub-dictionaries) may be displayed. So, for example, a user dictionary can be a single dictionary or several sub-dictionaries, in particular, such a single dictionary can contain subtitle parts added to it for all media content viewed by the user (for example, several films), and the dictionary can contain user-added subtitle parts of one media content (e.g. movie). Also, the user's dictionary or dictionaries may contain a set of words that the user can add from other services (in particular, Internet services), applications, etc., for example, from different media players from different websites, or, for example, from applications (software) for learning languages, which may include performing written tasks by the user using software that implements similar functionality, including the ability to add a set of words to the user's dictionary 560. Also, use the caller can independently enter words into the dictionary with translation, for example, through a user interface that provides text input by the user and then added to the user dictionary, in particular, using the controls 115 and the dictionary module 548A, 548B of words and phrases.

[0227] It is worth noting that a user dictionary 560 may include several sub-dictionaries similar to dictionary 560, i.e. in a particular case, the user dictionary 560 may be a global user dictionary containing several user dictionaries 560. In this case, each of the user dictionaries of the global user dictionary may contain a set of words (and / or phrases), for example, saved by the user, for individual media content viewed by the user, and / or a set of words stored by the user on one media resource (for example, an Internet site), in particular, stored during the reproduction of at least one copper content, and / or may comprise words and / or phrases stored in the user-process interaction with any application, such as an application that plays media content, or be a training application in which the user can be saved keywords and (/ or) combinations. Also, user dictionaries in the global user dictionary can be collected in one user dictionary, where each word can be added with the identifier of the media resource, application, etc., in which they were saved by the user. Also, as described in the framework of the present invention, words can be stored both by the user and by means of the system with which the user interacts, for example, as described in the framework of the present invention, for example, based on an analysis of current and / or previous and / or alleged user actions information collected about the user, as well as based on previously saved words and phrases in the user dictionary of the current user or from the user’s dictionary, at least another user, or user dictionary STUDIO another user created for another user account at least one of the resources, in particular, media assets and / or application, in particular, referred to in the present izoreteniya, e.g., the user associated with the training process. It is worth noting that in the particular case, user dictionary 560 can represent a local user dictionary (stored on server 505, on a web server connected to a website on which the user interacts with media content and / or training materials, etc. , on a user's device, for example, a user's mobile device (smartphone, tablet, etc.) and / or personal computer, etc.), which may include saved (selected for saving) by the user and / or system tools, as described in frame present invention, combinations of words and collected in the collection of words and phrases (local collections of words and phrases). It is also worth noting that the aforementioned analysis of current and / or previous and / or expected user actions may include user actions on social networks, for example, actions when the user shares materials (for example, educational materials or media content, including links to resources, media resources, applications, etc.), puts marks and / or marks “Like” to resources and / or media content, educational materials. The number of user visits of various resources and other user interactions, in particular, with elements of the system described in the framework of the present invention, an example of which is shown in FIG. 5. It is also worth noting that the user or the person responsible for moderating a resource (in particular, one of the described media resources described in the framework of the present invention) can combine user dictionaries and also link, for example, with links (any type of records in a document (for example, representing a user's dictionary, or in another application linking, for example, user / user dictionaries and / or global user dictionaries, and / or a dictionary of words and phrases 528), pointing to another part of this document enta or another document) various dictionaries (for example, user / user dictionaries), for example, to supplement one of the dictionaries (user / user dictionaries and / or global user dictionaries, and / or dictionary of words and phrases 528) with words and phrases from at least one of the other dictionaries. To ensure analysis and collection of the aforementioned current and / or previous and / or prospective actions of the user, the means of the system shown in FIG. 5 (and / or by means of systems associated with the specified system, for example, user training systems mentioned in the framework of the description of the present invention), implemented, for example, as separate services, in particular, program code located on a media resource, website, device user, web server, etc., and / or use third-party services, for example, analytical services and statistics services, various tools and services of web analytics (Web analytics), as well as other tools and services, for example, Google Analytics, Komfo, Tweriod, Statigr.am, Pi qora, Simply Measured, Wobot, various social network parsers and others, as well as APIs (application programming interface, application programming interface, from the English application programming interface) of various resources (in particular, web resources) and applications that allow collecting and processing information about the user and his interaction with devices, resources, etc. Such collected sattistics and analytics can be used, for example, to implement one of the functionalities of the method and system described in the framework of the present invention, for example, to display to the user words and / or phrases that, for example, are found in subtitles and which the user is not likely to knows. So, the assumption that the user does not know the words that appear in the subtitles can be built / created based on the collected statistics about the user and his actions, as well as, for example, depending on the complexity, for example, the complexity of the media content (for example, determined on the basis of the number of compound words found in the subtitles), the selected complexity in the media player, etc. Thus predicted words and phrases (in particular, potentially unknown to the user and / or translation of which the user can request from the system described in the framework of the present invention, an exemplary embodiment of which is shown in FIG. 5, using the methods described in the present description of the invention, for example , by hovering over part of the subtitles, or words and phrases that are necessary for the user to remember, repeat, learn, etc., for example, as part of the learning process device, etc.) can be stored in at least one user dictionary 560, the global user dictionary, or in any other form and manner, for example, in the memory of the Random Access Memory (RAM) of the Server, user device, etc. , or on another storage device (magnetic hard disk drive, memory cards, etc.), in particular in the form of text files, database tables, etc. Such sets of words and phrases can be displayed to the user before, after and / or at the time of viewing the media content and / or the aforementioned user / user training process, for example, in an application, on a website, a media player, etc., in particular, areas 720, 105 or any other area of the media player, website and / or application.

[0228] It is also worth noting that the color of the displayed part of the subtitles (including subtitles displayed in the pause mode (in the history of dialogs)) added to the dictionary can be changed to a different color from the default subtitle display, for example, to indicate to the user the fact that this part already exists in the user dictionary. After adding part of the subtitles to the user’s dictionary, the user may be shown a message stating that some of the subtitles have been added to the user’s dictionary, or an error adding part of the subtitles. Also, a message may be displayed to the user stating that some of the subtitles have been added to the user’s dictionary earlier, for example, when the user tries to add some of the subtitles already contained in the user’s dictionary, in particular highlighted, as described above.

[0229] Also, interaction with part of the subtitles and / or media content, for example, to add part of the subtitles to the dictionary, may cause the display to display an additional menu of interaction with part of the subtitles (in particular, the specified part of the subtitles), media content, etc. or translation of the specified part of the subtitles. Such an additional menu may contain points for managing the dictionary or part of the subtitles, for example, “Add to the dictionary” (allowing you to add part of the subtitles or translations to the user's dictionary), “View the difficulty level” (allowing you to see the difficulty level of the part of the subtitles), “Select the dictionary”, “Select Dictionary 1”, “Add to Dictionary 1”, “Add to Dictionary” (allowing you to select a dictionary to which parts of the subtitles will be added), “New translation of some subtitles” (allowing you to offer a new translation of some subtitles or decree inaccurate translation of part of the subtitles, as described above, for example, through the feedback module 550A, 550B (FIG. 5) and / or user dictionary module 555A, 555B (FIG. 5)) or any other elements that allow interacting with subtitles , media content, or user dictionary.

[0230] It is worth noting that when the user specifies a part of the subtitles, such a part of the subtitles and / or at least one component thereof (for example, a part of the subtitles may be a word, phrase or at least two not necessarily adjacent words , and a part of the subtitle part, in a particular case, can be a word, a phrase, etc.) can be automatically added by the system to the user's dictionary (for example, by using algorithms implemented by at least one of the system modules 5), or the user can be shown a message, in the particular case a text message, about the user's ability to add a part of the subtitles and / or its component to the user’s dictionary, and the message can be implemented as an interactive element / component, for example , media player, web resource, etc.

[0231] It is also worth noting that the system described in the framework of the present invention can collect statistics on user interaction with media content, subtitles, translation of a part of subtitles, etc., for example, a statistics module, in particular, implemented in the form of executable program code that can be downloaded and executed on the server 505 and / or computing device 570 and / or in the browser 535. Thus, if the user repeatedly indicates part of the subtitles during the playback of media content and / or display of subtitles, n for example, in the process of a single viewing by a user of media content (and / or subtitles) and / or when viewing at least one media content and / or at least one subtitle (in particular, one set of subtitles) for a certain period of time (weeks , months, 48 hours, etc.) the user's actions, for example, the user indicating part of the subtitles, can be recorded and saved (for example, in RAM or in the data storage of server 505 and / or device 570, and / or in a browser, in particular, in the memory area of RAM allocated for storage nnyh browser or application in which the playback of media content and / or display of subtitles in particular, media player), in particular, statistics module. The collected statistics on the user’s interaction with the subtitles or part thereof can be used, for example, to add at least one part of the subtitles specified by the user to the user dictionary described by the system (for example, the user dictionary module and / or the subtitle module, etc.) in particular, the part of the subtitles with which the user interacted more than once (for example, hovering (pointing) at such a part of the subtitles with the mouse cursor), and adding a part of the subtitles to the user's dictionary can It is be accomplished by the user specifying parts of the subtitles, e.g., the second or third or fourth, etc. time.

[0232] It is also worth noting that the statistics collected may include statistics on user actions related to indicating parts of the subtitle, for example, to obtain their translation, and based on such statistics, a word that the user, for example, indicated more than once, but did not add in the user dictionary, can be added to the user dictionary by means of the user dictionary module automatically.

[0233] It is worth noting that the user can delete words or phrases from the user dictionary 560, for example, from the displayed contents of the user dictionary 720, in particular by indicating at least one displayed user dictionary entry.

[0234] It is also worth noting that a word or phrase from the user dictionary can be automatically (for example, by means of the user dictionary module) deleted, for example, if the user has marked such a word or phrase in the user dictionary as a word or phrase that it is excellent knows or remembered his translation. Such automatically deleted words or phrases can be moved to a temporary folder (temporary user dictionary), from which the words and phrases that are in it can be deleted by the user or after a certain time, for example, specified by the user or specified by the system described in the framework of the present invention, for example , using the tools of the user dictionary module, or manually set, for example, by the moderator of the server 505, by the person who is responsible for providing the subty display service To play and play media content on a web resource, the User’s Temporary Dictionary can be opened and viewed by the user in order to delete the words / phrases contained in it or in order to move such words and phrases back to the user dictionary 560.

[0235] It is also worth noting that the user can specify at least one displayed user dictionary entry and report it (for example, to server 505 or to one of the persons responsible for the content of the subtitles, translation, etc., as described above ) about incorrect from his point of view translation and / or writing of the contents of the user dictionary, for example, through the feedback module 550A, 550B (FIG. 5) and / or the module of the user dictionary 555A, 555B (FIG. 5).

[0236] In FIG. Figure 8 shows an example of a general-purpose computer system that includes a multi-purpose computing device in the form of a computer 20 or a server including a processor 21, a system memory 22, and a system bus 23 that couples various system components, including the system memory to the processor 21.

[0237] The system bus 23 may be any of various types of bus structures, including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures. System memory includes read-only memory (ROM) 24 and random access memory (RAM) 25. The ROM 24 stores the basic input / output system 26 (BIOS), consisting of basic routines that help exchange information between elements within the computer 20, for example, at the time of launch.

[0238] Computer 20 may also include a hard disk drive 27 for reading from and writing to a hard disk, not shown, a magnetic disk drive 28 for reading from or writing to a removable magnetic disk 29, and an optical disk drive 30 for reading from or writing to a removable optical disc 31 such as a CD, a digital video disc, and other optical means. The hard disk drive 27, the magnetic disk drive 28, and the optical disk drive 30 are connected to the system bus 23 by means of the hard disk drive interface 32, the magnetic disk drive interface 33, and the optical drive interface 34, respectively. Storage devices and their respective computer-readable means provide non-volatile storage of computer-readable instructions, data structures, program modules and other data for computer 20.

[0239] Although the typical configuration described here uses a hard disk, a removable magnetic disk 29, and a removable optical disk 31, one skilled in the art will appreciate that other types of computer-readable media that can store data that are accessible with using a computer, such as magnetic cassettes, flash memory cards, digital video discs, Bernoulli cartridges, random access memory (RAM), read-only memory (ROM), etc.

[0240] Various software modules, including operating system 35, may be stored on a hard disk, magnetic disk 29, optical disk 31, ROM 24, or RAM 25. Computer 20 includes a file system 36 associated with the operating system 35 or included in it, one or more software applications 37, other program modules 38 and program data 39. The user can enter commands and information into the computer 20 using input devices such as a keyboard 40 and pointing device 42. Other input devices (not shown) may include yuchat a microphone, joystick, game pad, satellite dish, scanner, or any other.

[0241] These and other input devices are connected to the processor 21 often via a serial port interface 46 that is connected to the system bus, but can be connected via other interfaces, such as a parallel port, a game port, or a universal serial bus (USB). A monitor 47 or other type of visual display device is also connected to the system bus 23 via an interface, such as a video adapter 48. In addition to the monitor 47, personal computers typically include other peripheral output devices (not shown), such as speakers and printers.

[0242] Computer 20 may operate in a networked environment through logical connections to one or more remote computers 49. The remote computer (or computers) 49 may be another computer, server, router, network PC, peer device, or other node on a single network, and also typically includes most or all of the elements described above with respect to computer 20, although only an information storage device 50 is shown. Logical connections include a local area network (LAN) 51 and a global computer network (GCS) 52. Such network environments are commonly found in institutions, corporate computer networks, intranets, and the Internet.

[0243] A computer 20 used in a LAN network environment is connected to a local area network 51 via a network interface or an adapter 53. A computer 20 used in a GKS network environment typically uses a modem 54 or other means to establish communication with a global computer network 52, such like the internet.

[0244] The modem 54, which may be internal or external, is connected to the system bus 23 via the serial port interface 46. In a networked environment, program modules or parts thereof described with reference to computer 20 may be stored on a remote information storage device. It should be noted that the network connections shown are typical, and other means may be used to establish communication communication between computers.

[0245] In conclusion, it should be noted that the information provided in the description are examples that do not limit the scope of the present invention defined by the claims. One skilled in the art will recognize that there may be other embodiments of the present invention consistent with the spirit and scope of the present invention.

Claims (47)

1. A method for displaying subtitles, comprising stages in which: receive subtitles in the original language; converting the received subtitles to the format of the processed subtitles, the conversion includes: tokenization of received subtitles; establishing parts of speech for parts of subtitles obtained; lemmatization of parts of the received subtitles, for which a part of speech has been established; search for lemmatized words and phrases corresponding to the parts of the received subtitles in the dictionary of words and phrases containing words and phrases and meanings of words and phrases in the language of the received subtitles and at least one translation and / or meanings for such words and phrases; adding the meaning of the word or phrase, or the identifier of the meaning of the word or phrase or word and phrase or the identifier of the word, or collocation, for at least one part of the subtitles, where the identifier of the value defines the record for the value or word, or collocation in the dictionary of words and phrases; adding a time stamp for parts of the subtitle, defining the time at which parts of the subtitle are displayed; displaying processed subtitles in a media content reproducing means; display translation of at least one part of the subtitles when playing media content; add to the user dictionary the specified part of the subtitle and translation for the specified part of the subtitle from the dictionary of words and phrases. 2. The method according to p. 1, characterized in that it further translates the received subtitles into a language other than the language of the original subtitles, and displays the translated subtitles to the user. 3. The method according to claim 2, characterized in that the subtitle translation options are created from words and phrases and / or from the meanings of words and phrases contained in the dictionary of words and phrases depending on the established level of complexity. 4. The method according to claim 1 or 2, characterized in that when translating at least one part of the received subtitles and / or when displaying a translation of a part of the subtitles specified by the user, words and / or phrases and / or meanings of words are used and phrases and translation for words and / or phrases and / or translation for the meanings of words and phrases from the dictionary of words and phrases. 5. The method according to p. 1, which further includes converting the received subtitles to converted subtitles in a language other than the language of the original subtitles, using a dictionary of words and phrases and translation when converting the received subtitles to the processed subtitle format. 6. The method according to p. 1, which further includes tagging the part of speech in the converted subtitles for the part of the speech of the part of the subtitles when converting the received subtitles to the processed subtitle format. 7. The method according to claim 1, characterized in that the words and phrases and / or translation of words or phrases, and / or at least one part of the subtitles are adjusted in the dictionary of words and phrases based on corrections proposed by the user using feedback with the user. 8. The method according to p. 1 characterized in that the translation options for the user-specified part of the subtitles are selected in the dictionary of words and phrases depending on the established level of complexity. 9. The method according to claim 1, characterized in that the user is shown a list of words and phrases with at least one translation option for such words and phrases that are contained in the subtitles displayed to the user and which will potentially cause the user to have difficulty translating, depending from the established level of difficulty. 10. The method according to p. 1, characterized in that the user's dictionary contains words or phrases, the meaning of words or the meaning of words or phrases, or the identifiers added by the user to the dictionary of words and phrases when interacting with at least one web resource or An application that displays media content and / or subtitles. 11. A method for displaying subtitles, comprising the steps of: launching media content playback means implemented in the form of program code or application; loading media content into a media content reproducing means; search for subtitles for downloaded media content in the language of media content; if there are subtitles for the downloaded media content, subtitles are loaded into the media content display means; in the absence of subtitles for the downloaded media content, a subtitle search of a different subtitle format is performed; in the absence of subtitles of a different subtitle format, the media content is displayed without subtitles; if there are subtitles of a different subtitle format, a subtitle conversion of another format is performed, including: tokenization of at least one part of the subtitle of a different format; establishing part of the speech, at least for one part of the subtitles of a different format; lemmatization, at least for one part of subtitles of another format, for which part of speech is established; search for lemmatized words and phrases corresponding to at least one part of the subtitles of a different format in the dictionary of words and phrases containing words and phrases and meanings of words and phrases in the subtitle language; adding the meaning of a word or phrase from the dictionary of words and phrases or the identifier of the meaning of the word or phrase or word and phrasing from the dictionary of words and phrases or the identifier of the word or phrasing for at least one part of the subtitle of another format, where the identifier defines a record for the word value or phrases or for a word or phrase in a dictionary of words and phrases; Adding a time marking for parts of the subtitles of a different format that defines the time at which parts of the subtitles are displayed displaying at least one part of the subtitles of a different format after said conversion in the media content reproducing means; displaying the translation of the user-specified part of the subtitle when playing media content, and for the translation of the user-specified part of the subtitles, the aforementioned identifiers or values of the word or phrase, or word and phrase are used; add to the user dictionary the specified part of the subtitle and / or translation for the specified part of the subtitle from the dictionary of words and phrases or the identifier of the meaning of the word or phrase, or the identifier of the word or phrase. 12. The method according to p. 11, characterized in that the translation of at least one part of the subtitles contains a translation for words and / or phrases and / or translation for the meanings of words and phrases from the dictionary of words and phrases. 13. The method according to p. 11, which when converting subtitles of a different format further includes tagging the part of speech in the converted subtitles for the part of the speech of the part of the subtitles when converting the received subtitles to the processed subtitle format. 14. The method according to claim 11, characterized in that the words and phrases and / or translation of words or phrases, and / or at least one part of the subtitles are adjusted in the dictionary of words and phrases based on corrections proposed by the user using feedback with the user. 15. The method according to p. 11, characterized in that it further translates the subtitles of a different format into a language different from the language of the subtitles of a different format, and displays the translated subtitles to the user. 16. The method according to p. 15, characterized in that the subtitle translation options are created from words and phrases and / or from the meanings of words and phrases contained in the dictionary of words and phrases depending on the established level of complexity. 17. The method according to p. 11 or 15, characterized in that when translating at least one part of the subtitles of a different format and / or when displaying a translation of part of the subtitles specified by the user, words and / or phrases and / or meanings of words are used and phrases and translation for words and / or phrases and / or translation for the meanings of words and phrases from the dictionary of words and phrases. 18. The method according to claim 11, characterized in that the user is presented with a list of words and phrases with at least one translation option for such words and phrases that are contained in the subtitles displayed to the user and which potentially cause the user difficulty in translating, depending from the established level of difficulty. 19. The method according to p. 11, characterized in that it further searches for subtitles containing the translation for the downloaded media content, and displays the user the subtitles with the translation. 20. The method according to p. 11, characterized in that the user's dictionary contains words or phrases, the meaning of words or the meaning of words or phrases or the identifiers added by the user to the dictionary of words and phrases when interacting with at least one web resource or An application that displays media content and / or subtitles.

Images