KR102414993B1 - Method and ststem for providing relevant infromation - Google Patents

Abstract

The present invention relates to a method and system for providing related information using a video. In order to solve the above problems, the method for providing related information according to the present invention includes the steps of playing a video including subtitles in a first area of a display unit, and in a second area of the display unit, a portion of text constituting the subtitles outputting a graphic object comprising: and providing related information related to the text of the part based on a selection signal related to the graphic object, wherein the text of the part of the subtitle is the text of the other part It is characterized in that it is highlighted and displayed so as to be distinguished from the .

Description

Method and system for providing relevant information

The present invention relates to a method and system for providing related information using a video.

As technology develops, the utilization of digital devices is increasing. In particular, electronic devices (eg, smartphones, tablet PCs, etc.) are equipped with various functions such as web surfing using the Internet, listening to music, and viewing video content, as well as communication functions such as phone calls and text messages. .

Thanks to the popularization of these electronic devices, the consumption of content made of multimedia is rapidly increasing, and in particular, the consumption of video (or video content) is gradually increasing.

Furthermore, due to the development of contents using electronic devices, users tend to prefer to consume more visualized contents such as videos rather than contents consisting of only text.

Accordingly, in accordance with this trend, service development for a method of providing useful information to a user using a video format is being actively developed.

An object of the present invention is to provide a method and system for providing related information that can provide useful information to a user by utilizing a video format.

Furthermore, the present invention is to provide a method and system for providing related information for building a user environment that can provide related information for content made of moving pictures.

Furthermore, the present invention relates to a method and system for providing related information that can provide in-depth information more intuitively and organically in connection with content consisting of moving pictures.

In order to solve the above problems, the method for providing related information according to the present invention includes the steps of: reproducing video content including subtitles in a first area of a display unit; outputting a graphic object including a part, and providing related information related to the text of the part based on a selection signal related to the graphic object, wherein the text of the part of the subtitle is of another part It is characterized in that it is highlighted and displayed so as to be distinguished from the text.

Furthermore, the related information providing system according to the present invention provides a communication unit, a display unit including a display area divided into a first area and a second area, and a video content including subtitles in the first area, and the second area a control unit for controlling the display unit to output a graphic object including a portion of text constituting the subtitle in a region, wherein the control unit is configured to relate to the partial text based on a selection signal for the graphic object The display unit is controlled to output information, and the text of the part of the subtitles is highlighted and displayed so as to be distinguished from the text of the other part.

Furthermore, the program, which is executed by one or more processes in the electronic device according to the present invention, and can be stored in a computer-readable medium, includes the steps of: reproducing video content including subtitles in a first area of the display unit; Outputting a graphic object including a portion of text constituting the subtitle to a second area and providing related information related to the partial text based on a selection signal related to the graphic object commands, and the text of the part of the subtitles is highlighted and displayed so as to be distinguished from the text of the other part.

As described above, the method and system for providing related information according to the present invention divide the display area of the display unit into a plurality of regions, and display video content in one area and information related to information provided in the video content in another area. can provide Accordingly, the user can more intuitively use information related to the information provided from the video content at any time even while using the video content. As a result, the user can reduce the hassle of searching for information by entering a separate function to search for related information.

Furthermore, the method and system for providing related information according to the present invention can provide information provided in video content as a caption, and provide information related to text included in the caption. That is, in the present invention, by visually providing related information that can be provided to a user through a caption, the user can more easily access the related information.

Furthermore, the method and system for providing related information according to the present invention can provide a user environment in which page conversion is performed to provide related information while video content is being played. Through this, the present invention can provide related information in the entire display area, and in this case, it is possible to provide a GUI for controlling the reproduction of video content. Accordingly, the user may be provided with related information and, at the same time, continue to use the sound information provided from the video content, and thus may be provided with various information in a complex manner.

1 is a conceptual diagram for explaining a system for providing related information according to the present invention.
2 is a flowchart illustrating a method for providing related information according to the present invention.
3 is a conceptual diagram for explaining a method for entering a function for a related information method and system according to the present invention.
4A, 4B, 4C, 4D, 4E, and 4F are conceptual diagrams for explaining a method for providing related information in a method and system for providing related information according to the present invention.
5A, 5B, 5C, 6A and 6B are conceptual diagrams for explaining a video content playback function in the method and system for providing related information according to the present invention.

Hereinafter, the embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings, but the same or similar components will be given the same reference numbers regardless of reference numerals, and redundant descriptions thereof will be omitted. The suffixes "module" and "part" for components used in the following description are given or mixed in consideration of only the ease of writing the specification, and do not have distinct meanings or roles by themselves. In addition, in describing the embodiments disclosed in the present specification, if it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed in this specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in the present specification, and the technical idea disclosed herein is not limited by the accompanying drawings, and all changes included in the spirit and scope of the present invention , should be understood to include equivalents or substitutes.

Terms including an ordinal number such as 1st, 2nd, etc. may be used to describe various elements, but the elements are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another.

When an element is referred to as being “connected” or “connected” to another element, it is understood that it may be directly connected or connected to the other element, but other elements may exist in between. it should be On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that the other element does not exist in the middle.

The singular expression includes the plural expression unless the context clearly dictates otherwise.

In the present application, terms such as “comprises” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

An object of the present invention is to provide a method and system for providing related information that can provide useful information to a user by utilizing a video format. In particular, an object of the present invention is to provide a method and system for providing related information for building a user environment that can provide information related to content provided through a video together with a video.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. 1 is a conceptual diagram for explaining a system for providing related information according to the present invention.

As shown in FIG. 1 , the related information providing system 100 according to the present invention may be configured to include at least one of a communication unit 110 , a storage unit 120 , and a control unit 130 . At this time, the related information providing system 100 according to the present invention is not limited to the above-described components, and may further include components performing the same or similar roles as the functions according to the description of the present specification.

Meanwhile, the related information providing system 100 according to the present invention may operate in conjunction with the electronic device 10 . Here, the electronic device 10 includes at least one of a smart phone, a mobile phone, a tablet PC, a kiosk, a computer, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), and a portable multimedia player (PMP). may include.

Meanwhile, the related information providing system 100 according to the present invention may be implemented as an application or software. In this case, the application or software according to the related information providing system 100 may be installed in the electronic device 10 and perform a process according to the user authentication method described below.

For example, the communication unit 110 , the storage unit 120 , and the control unit 130 of the system 100 for providing related information according to the present invention utilize the hardware configuration of the electronic device 10 to provide a series for user authentication. can perform the function of For example, the communication unit 110 configures a communication module (eg, a mobile communication module, a short-range communication module, a wireless Internet module, a location information module, a broadcast reception module, etc.) provided in the communication unit of the electronic device 10 . By using it, data may be transmitted/received to and from at least one external server (eg, the database (DB) server 140 or cloud server shown in FIG. 1 ).

Furthermore, the storage unit 120 uses a memory provided (or inserted) in the electronic device 10 or an external server 140 (eg, a cloud server), and provides video content and video content according to the present invention. It may be made to store information associated with the.

At least a portion of the storage unit 120 may refer to an external server (at least one of a cloud server and a database (DB)). That is, it can be understood that the storage unit 120 suffices as long as a space in which information necessary for providing related information according to the present invention is stored, and there is no restriction on the physical space. Accordingly, hereinafter, the configuration of the storage unit 120 and the external server 140 is not divided, and the cloud server 210 and the database 220 are not separately divided, and both are expressed as the storage unit 120 . In this case, the cloud server may mean “cloud storage”. Meanwhile, access to the external server may be made through the communication unit 110 .

The controller 130 may utilize at least one of a CPU and a cloud server provided in the electronic device 10 to perform control of each configuration and overall control related to the present invention. Furthermore, in order to carry out the present invention, the controller 130 may have control authority for at least one of the components of the electronic device 10 . Furthermore, the control unit 130 may control the display unit 11 of the electronic device 10 to provide video content and related information provided in the present invention on the display unit 11 . In this case, the control unit 130 directly controls the display unit 11 or indirectly controls the display unit 11 by transmitting a control command to the control unit of the electronic device 10 that controls the display unit 11 . can do.

As described above, in the present invention, it is possible to provide related information related to the moving picture content together with the moving picture content.

In the present invention, moving picture content is content having a moving picture (video) format, and contents constituting moving picture content may be very diverse. As an example, the video content according to the present invention may be composed of not only a news article, a newspaper article, a magazine article, or a body of a book, but also content about a specific subject.

Furthermore, such video content may consist of content included in a post posted (or posted) on a site accessible through the Internet (eg, a blog, a video content providing site, other web page, etc.).

In this case, the type of post is not limited, and the post may be configured to include at least one of an image, sound, text, and video. Here, the image may be at least one of a static image and a dynamic image.

Meanwhile, the moving image content according to the present invention may be configured to include image data, audio data, and caption data. Here, the image data may be composed of at least one of a static image and a dynamic image.

For example, if the moving image content includes video data corresponding to a static image and caption data, the moving image content according to the present invention includes content in which text corresponding to caption data is overlapped with a still image corresponding to a static image. can be composed of

On the other hand, when the video content according to the present invention is reproduced in the electronic device 10, two equators among the video, audio, and subtitles may be combined and output together.

The video content according to the present invention may be generated by the controller 130 according to the present invention or may be generated by a third entity (eg, an image producer or a content producer).

As an example of a method for generating video content according to the present invention, the controller 130 may generate video content by converting text into voice based on a Test to Speech (TTS) technology. In this case, the converted voice may be audio data of moving image content, and the text to be converted may be subtitle data of moving image content. In this case, the controller 130 may utilize, as image data, a static image or a dynamic image included in a document including the text to be converted or having content related to the text to be converted. Furthermore, the controller 130 may use an arbitrary image preset to be used when generating the moving image content as image data of the moving image content.

Meanwhile, the controller 130 may control the sync between the caption data and the audio data to generate moving image content so that, when the audio data is output from the electronic device 10 , the related caption data is output.

In this way, when video content is generated based on TTS, the text to be converted is text included in a document written to provide information on a specific subject, such as a news article, newspaper article, magazine article, or book body. can be

As another example of the method for generating moving image content according to the present invention, the controller 130 may generate the moving image content according to the present invention by generating subtitle data for audio data of an existing moving image file. .

In this case, the controller 130 may convert audio data included in a video file into text based on Speech to Text (STT) technology, and generate subtitle data using the converted text. And, by inserting the generated caption data into a moving picture file, moving picture content according to the present invention can be generated.

In this case, the video file may be a video file having various topics.

As described above, the moving picture content according to the present invention is an image including subtitle data, and in the present invention, for convenience of explanation, the subtitle data or subtitles will be collectively referred to as “subtitles or captions”. The subtitles may be formed of at least one of letters, numbers, and symbols, and may be configured to match or correspond in sync with audio data provided in video content.

Furthermore, as described above, the subtitles included in the video content according to the present invention may be created or inserted in various ways.

Meanwhile, in the following, description will be made on the assumption that there is video content including subtitles without distinguishing between the above-described methods for generating video content.

Meanwhile, the controller 130 according to the present invention may provide information related to or related to a portion of the text included in the subtitle. In the present invention, for convenience of description, this is called “related information”. The related information may be content related to a portion of the text included in the subtitle.

In this case, the partial text may correspond to a word included in the subtitle. A word is a word that can be separated and written independently, or a word equivalent thereto, and when it is said that a text is divided into word units, it may correspond to a part excluding a proposition.

Meanwhile, in the present invention, the partial text may be text that matches or corresponds to a keyword stored (or registered) in a preset database. Here, the preset database is a database in which information (or content) related to keywords is stored, and there is no limitation in its type.

In the preset database, related information related to a keyword corresponding to the part of the text may be stored and stored by matching the keyword. Information stored in a preset database may be classified in units of keywords. Here, the keyword may also be expressed as a tag or a representative word.

Meanwhile, the preset database (hereinafter, referred to as “DB”) may be composed of a language dictionary DB, a knowledge encyclopedia DB, a music information DB, a person information DB, and the like.

In examples of related information provided based on such a preset DB, person information corresponding to a part of text, dictionary definition encyclopedia definition, search information in a preset search engine, issue information, news information, newspaper information, and article information etc. can be

Meanwhile, information (eg, individual content) constituting the preset database may be matched with at least one keyword. Each individual content may be matched with a plurality of keywords.

In addition, even the same keyword may be matched to each of different individual contents. For example, the keyword corresponding to the person information of “Hong Gil-dong” is a review of the first individual content (eg, person information content) and the second individual content (eg, a store having a trade name of “Hong Gil-dong”). content), respectively.

The controller 130 may determine whether a portion of the text included in the subtitle is the same as or similar to a keyword registered in a preset DB.

The controller 130 may classify the text constituting the subtitle by word unit, and may extract a word having a meaning from the divided word word by excluding the proposition. Then, it is possible to search from a preset DB whether there is related information corresponding to the word.

On the other hand, as described above, when there are a plurality of contents (or related information) linked to the keyword, the controller 130 searches for contents having high relevance to video contents as related information based on an algorithm related to a preset weight. can do.

In this way, the controller 130 may search for whether or not related information corresponding to the part of the text exists in the preset DB. The controller 130 may search whether related information exists in a preset DB by using the partial text as a search word (or keyword). Here, the partial text may be understood as a word included in the subtitle.

For example, if the text of the part is “arrest warrant” and there is related information (eg, definition of the word “arrest warrant”) with “arrest warrant” as a keyword in the knowledge encyclopedia DB, the control unit 130 may determine that there is related information corresponding to the part of the text.

Furthermore, when the keyword registered in the preset DB and the partial text included in the subtitle correspond, the controller 130 may display the partial text separately from the text in the other part of the subtitle. In the present invention, displaying the partial text separately from the text of the other part may be expressed as "highlighting" the partial text.

Methods of highlighting the text of the part may be various, and the controller 130 may display the visual appearance of the text of the part to be distinguished from the visual appearance of the text of the other part.

The highlighting treatment can be: i) blinking where it should be emphasized, ii) bolding it, iii) increasing the contrast, iv) inverting the video i.e. inverting the black and white parts of the screen, v) underlining, or , vii) may refer to software processing such as displaying different colors.

That is, by displaying at least one of the color, size, display thickness, and font type of the part of the text differently from the text of the other part, the controller 130 informs the user that there is information related to the part of the text. can be recognized

Furthermore, the controller 130 may perform a highlighting process on the partial text by displaying a graphic object on a portion of the subtitle where the partial text is located.

Accordingly, the word corresponding to the “warrant of arrest” in the examples discussed above may be displayed to have a different visual appearance from the text in other parts.

As such, in order to provide related information related to the text of a part of the subtitle and allow the user to intuitively access the related information with the related information, the controller 130 informs the user of the existence of related information about the part of the text in various ways. can inform

Meanwhile, in the present invention, the controller 130 may organically provide video content and related information by switching between a plurality of pages having different characteristics in order to provide related information on video content.

Hereinafter, a method for providing related information according to the present invention will be described in more detail with accompanying drawings. 2 is a flowchart for explaining a method for providing related information according to the present invention, and FIG. 3 is a conceptual diagram for explaining a method for entering a function for a related information method and system according to the present invention. Furthermore, FIGS. 4A, 4B, 4C, 4D, 4E, and 4F are conceptual diagrams for explaining a method for providing related information in a method and system for providing related information according to the present invention. 5A, 5B, 5C, 6A, and 6B are conceptual diagrams for explaining a video playback function in the method and system for providing related information according to the present invention.

First, as shown in FIG. 2 , according to the method for providing related information according to the present invention, a process of reproducing a video (or video content) including a caption in the first area may be performed ( S210 ).

First, the entry into the video content playback function in the present invention may be made through various routes.

The control unit 130 may reproduce video content based on various types of user inputs to the electronic device 10,

As an example, as shown in FIG. 3A , the controller 130 may reproduce video content based on a user's voice input. The controller 130 may control the electronic device 10 to reproduce the video content based on an spoken word (command, start-up, or start-up word) matched with the reproduction of the video content. For example, when “tell me the news” 301 is set as the spoken word, the controller 130 may reproduce the video content based on the user's utterance of a voice according to the set spoken word.

Meanwhile, in the electronic device, an application or program corresponding to the method for providing related information according to the present invention may be in a running state.

As another example, as shown in (b) and (c) of FIG. 3, the control unit 130, based on the selection of the preset icons 302 and 304 output to the electronic device 10, video content can play Here, the preset icons 302 and 304 are output on the entry page of the specific application, as shown in (b) of FIG. 3, or as shown in (c) of FIG. It may be output on a page (eg, a function providing page, an information providing page, etc.).

At this time, as shown in (b) and (c) of FIG. 3 , the controller 130 may provide guide information 303 and 305 informing that video content can be provided on the display unit 11 . have. Through this, the user can directly access the video content providing function by recognizing that the video content can be played.

Meanwhile, in the present invention, as shown in (a) and (b) of FIG. 4A , the controller 130 controls a page including a first area (a) and a second area (b) (hereinafter referred to as “first area”). page”) to play video content.

As shown in (a) and (b) of FIG. 4A , the first area (a) may be an area in which video content is played, and the second area (b) may be an area in which related information related to video content is provided. have. As described above, in the second area (b), related information related to texts 401 and 402 of a portion of subtitles included in video content may be provided.

On the other hand, as shown in (a) and (b) of FIG. 4A , the moving picture content reproduced in the first area (a) is configured to include subtitles, and among subtitles, a portion of the subtitles having related information in the preset DB is Text (or words) (eg, forced molestation 401, Hong Gil-dong 402) may be highlighted and displayed.

Furthermore, as shown in (a) of FIG. 4B , in the first area (a), a progress bar (or time) indicating the degree of reproduction of the video content (or video) reproduced in the first area (a) is displayed. A time line 410 may be further included.

The progress bar 410 may provide information on the playback progress relative to the total playback time of the video content being played, and the playback progress based on the current playback time.

Meanwhile, in the present invention, the progress bar 410 may be configured to include at least one indicator (indicator, 410a, 410b). The control unit 130 specifies, in the progress bar 410 , a position corresponding to an output point (or a playback point, a playback time) of a portion of the text in which the related information exists, and an indicator 410a, 410b) may be included. The controller 130 may match the indicator with the partial text (or word), respectively. Accordingly, when a selection signal for selecting the indicators 410a and 410b is received, the controller 130 may control the reproduction of the video content so that a portion including a portion of the text matched with the selected indicator as a subtitle is reproduced. Based on the selection of the indicator, the controller 130 may control the display unit 11 to play the video content from a point where the text of a part that is matched with the selected indicator and has been highlighted is included as a subtitle.

Meanwhile, when the first page is output to the display unit 11 or a separate control command for stopping playback of the video content is not received, the controller 130 continues the video content in the first area (a). The display unit 11 may be controlled to reproduce. The controller 11 may continuously reproduce video content having a predetermined playback time in the first area (a).

In this case, the types or themes of video content reproduced in the first area (a) may be very diverse. The controller 130 may select a type or subject of video content reproduced in the first area (a) under the user's selection, user's preference, context information, and the control of the controller.

As an example, the controller 130 may reproduce video content related to a topic of interest (eg, current affairs, economy, etc.) of the user based on user history information. In this case, the controller 130 may reproduce different video contents having a subject of interest of the user in the first area (a). On the other hand, the user history information may exist to match the user account information.

As another example, the controller 130 may provide video content for a type or subject input from the user. A method for receiving input of a type or subject from a user may be very diverse, and as shown in FIG. 3A , a type or subject for a video content to be played back can be received from the user through a voice recognition method. .

Furthermore, when information on a type or subject is input by the user, the controller 130 may select video content corresponding to the input information.

The controller 130 may specify video content to be provided in the first area (a) based on a preset criterion. Here, the preset criteria may be set in various ways.

As an example, when a user requests to provide news together with an input for a specific keyword, the controller 130 may control video content corresponding to a preset number (eg, 10) of news related to the specific keyword. can be specified. In this case, the controller 130 may specify the number of videos of a preset number based on indicators such as the number of views, the number of impressions, and the popularity.

As another example, when a user requests to provide news, the control unit 130 may include a preset number for each of various categories constituting the news (eg, politics, economy, society, IT, life, world category, etc.) of each video content can be specified.

As another example, when a user requests to provide popular news by category, the controller 130 may specify a preset number of video content corresponding to the most viewed (or exposed) news by category. .

As another example, when a user requests to provide news for a search term with high real-time popularity, the controller 130 may specify video content for news related to a real-time popular search term (or keyword).

As another example, when a user requests to provide the latest news, the controller 130 may specify video content based on the latest uploaded news.

As another example, when a user requests to provide news to a specific media company, the controller 130 may specify video content for the news provided by the specific media company.

As another example, the controller 130 may select the type or subject of the provided video content based on the context information.

Here, the type of context information may be very diverse. For example, the context information may include time information (or time zone information), place information, device connection information, weather information, and the like.

This situational information is when the video content is provided. Video content, such as a location where an electronic device that provides video content is located, and a device (for example, a device (speaker, etc.) connected through wireless communication (for example, blue communication) connected to the electronic device that provides video content It may be context information related to the provision of , or a device through which video content is provided.

As an example, the controller 130 may provide different types of video content according to a time period in which the video content is provided (eg, a time period in which a user requests to provide the video content). The controller 130 may specify video content of different types or topics for different time zones. For example, the control unit 130 transmits video content having a topic related to weather, traffic conditions, a front page article in a newspaper article, news viewed a lot during the night, etc. to the electronic device 10 in the first time zone (eg, morning time). It can be specified as content to be provided to In this case, the controller 130 may continuously provide video content for the topics to the electronic device.

In addition, the controller 130 may specify, as content to be provided to the electronic device 10 , video content having a topic related to cooking, news viewed a lot today, and the like in the second time zone (eg, evening time).

As another example, when the electronic device 10 communicates with a device (eg, a speaker of the vehicle) included in the vehicle, the controller 130 may display video content having a subject related to traffic information, the electronic device ( 10) can be specified as content to be provided.

As another example, the control unit 130 may include screen information output from the electronic device 10 , a function most recently executed on the electronic device 10 , or screen information most recently output from the electronic device 10 , and Moving image content having a related type (or subject) can be specified as content to be provided to the electronic device 10 .

Accordingly, even if the user inputs the same user input for providing video content to the electronic device 10 , video content of different types or topics appropriate to the current situation may be provided.

Meanwhile, in addition to the user's request, the control unit 130 may specify video content according to the criteria according to the various examples described above in the controller 130 itself, and provide the specified video content in the first area (a). .

Furthermore, in the present invention, a process of displaying graphic objects for some texts included in the subtitles in the second area b may be performed ( S220 ).

Here, some text (or partial texts, 401 and 402 ) may correspond to a highlighted portion of subtitles included in the video content reproduced in the first area (a).

As illustrated in (a) of FIG. 4A , the graphic objects 404 and 407 may be configured to include highlighted portions of text 401 and 405 . Through this, the user can recognize which part of the relevant information exists.

The controller 130 may include at least one of partial text and additional text included in the caption in the graphic objects 404 and 407 .

Here, the additional text is guidance information for drawing the user's interest in the partial text, and as shown in FIG. 4A, the text corresponding to the question format (for example, will you tell me the person information of **? What is the exact meaning of ?, **, etc.).

The controller 130 may generate additional text according to a type, subject, or category (hereinafter, collectively referred to as “attribute”) related to the partial text. For example, when the related information is person information, as shown in (a) of FIG. 4A , the controller 130 includes a keyword (person information) corresponding to the related information and additional text (person information of **) Can you tell me?) For another example, when the related information is information corresponding to a dictionary definition, as shown in (a) of FIG. 4A , the control unit 130 includes a keyword (meaning) corresponding to the related information and additional text ( Would you like to know the person information of **?) can be created.

As such, the controller 130 generates additional text (or a question) including a keyword corresponding to the attribute of the related information according to the attribute of the related information, and uses the second text together with the partial text included in the subtitle. It can be provided on area (b). Through this, the user can directly access information that is curious or of interest.

Meanwhile, the graphic objects 404 and 407 output to the second region b may be configured to include at least one of letters, symbols, numbers, and images.

Furthermore, as illustrated in (a) of FIG. 4A , when there are a plurality of texts of a part highlighted in the subtitle (401, 402), a graphic object ( 404 and 407) may be output.

Meanwhile, the second area (b) may include a graphic object including information related to the moving picture content output from the first area (a) as well as a graphic object including a partial text included in the subtitle. In this case, the information related to the video content may be information in the form of a question or a command. The controller 130 may generate information in the form of a question or command based on the content of the video content output to the first area (a), and output it to the second area (b). At this time, the information in the form of a question or command is to induce the output of other content related to the video content output to the first area (a) (eg, news article, social network service (SNS) post, blog post, etc.) It may be information for

When other content related to the video content output in the first region (a) exists, the controller 130 may provide information in the form of a question or a command to the second region (b).

For example, the information output in the second area (b) includes “Tell me about the background of this case”, “What is the controversial point?”, “How was the judgment in this case?” Likewise, it may be composed of information that can induce access to other content.

In this case, the controller 130 may analyze the content of the video content output to the first area (a) based on a preset algorithm, and generate information in the form of an appropriate question or command based on the analyzed content.

Furthermore, the controller 130 may generate information in the form of an appropriate question or command according to content included in other content related to the video content output to the first area (a). For example, as another content, if there is content about the background event of the video content output to the first area (a), the controller 130 generates information in the form of “Tell me about the background of this event” and output this to the second area (b).

The controller 130 may generate information in the form of a question or command related to the video content output to the first area (a) based on a deep learning or artificial intelligence-based algorithm.

Meanwhile, the controller 130 may provide the other content on the electronic device 10 based on selection of the graphic object including the information in the form of a question or a command. Since it can be configured in the same way as in the embodiment in which information (or content) is output based on the selection of “a graphic object including a partial text included in the subtitle”, which will be described later along with the step S230 for explanation of this, A detailed description of the will be replaced with the description in the later part.

Furthermore, the second area (b) may include various information in addition to information related to subtitles. As shown in (a) of Figure 4a and (a) of Figure 4f, the second area (b) is a graphic object for receiving the user's preference information for the video content being reproduced in the first area (a). (403, 460, 461, 462) may be included.

When a user input is received through the graphic objects 403, 460, 461, 463 shown in (a) of 4a and (a) of FIG. 4f, the controller 130 may update the user's history information. have.

The controller 130 may update the user's history information so that user preference information for an attribute (eg, type, topic, or category, etc.) related to the video content being reproduced is reflected in the user's history information.

Furthermore, the controller 130 may select (or specify) the video content to be played in the first area (a) by using the user's history information including the user's preference information.

For example, when the "I'm interested" graphic object 461 is selected through the second area b, the controller 130 sets a property related to the video content being reproduced as the user's preference (or interest) information. can In this case, the controller 130 may reproduce the video content related to the property of the currently playing video content when the next video content is played after the currently played video content is reproduced.

On the contrary, when the “I am not interested” graphic object 462 is selected through the second area b, the controller 130 sets the attribute related to the video content being reproduced as the user's non-preference (or non-interest) information. can be set. In this case, after the playback of the currently played video content is completed, when the next video content is played, the controller 130 may play back video content having a property different from that of the currently playing video content.

Furthermore, as shown in (b) of FIG. 4F , the controller 130 may provide information on a subject of interest to the user on the second area (b). The controller 130 may count the number of times the user inputs interest (or preference) information on a topic of interest. And, by providing such counting information to the user, the control unit 130 can accurately recognize the user's level of interest and inform that it is being monitored.

In addition, various information related to video content provided in the first area (a) may be included in the second area (b).

On the other hand, the graphic object output to the second area (b) is changed in association with the change of the subtitle in the video content output in the first area (a), or is changed in association based on the change of the video content can be That is, when the highlighted text is changed as the subtitle is changed in the first area (a), a graphic object corresponding to the changed text may be output in connection with this in the second area (b). As the video content is reproduced, the controller 130 may change the information output to the second region b in association with the change of the subtitle.

Furthermore, in the present invention, based on the selection of the graphic object output to the second area (b), a process of displaying information related to a portion of the text included in the subtitle may be performed ( S230 ).

The controller 130 may provide related information related to the partial text on the display 11 based on a selection signal for a graphic object related to the partial text included in the subtitle.

As described above, the related information is information stored in a preset DB, and may include content related to the highlighted portion of the text.

The control unit 130 provides the related information 409 and 414 on the second region (b) as shown in (b) and (b) of FIG. 4A, or in FIG. 4B (c). As shown, the relevant information may be provided on a new page 415 .

In the present invention, the new page 415 is a page different from the first page including the first area (a) and the second area (b), and is referred to as a “second page”.

The controller 130 may convert the first page to the second page 415 in order to provide information related to the partial text. The controller 130 may control the display 11 to output the second page 415 based on the selection signal for the graphic object. The second page 415 may include related information related to a part of the text.

Meanwhile, the related information output to the second area b may correspond to at least a part of the related information output to the second page 415 . The controller 150 may provide at least a portion of the related information on the second area b based on the selection of the graphic object, and provide the related information on the second page based on the additional selection signal. .

For convenience of description, the related information provided on the second area (b) is called “first related information”, and the related information provided on the second page 415 is called “second related information”. to do it

The controller 150 may sequentially output the first and second related information based on the sequentially input selection signal. Here, the selection signal may correspond to a user input (eg, a touch input, etc.) to the display unit 11 . In the case of age, the first relational information may correspond to at least a portion of the second relational information.

In the present invention, the selection signal related to the graphic object corresponding to the highlighted portion of the text among the subtitles may include the first selection signal and the second selection signal.

Here, the first selection signal is, as shown in FIGS. 4a (a) and 4b (a), before the related information for a portion of the text (eg, Hong Gil-dong, arrest warrant) is output, It may be a selection signal for selecting the graphic object (404, 406, 411, 413). On the basis of this first selection signal, the control unit 130 shows the first related information 409 for the part of the text (eg, Hong Gil-dong, arrest warrant) in FIGS. 4a (b) and 4b (b). , 414) may be output on the second area b of the first page. The first related information may be output as voice information at a user's request or under the control of the controller 130 .

Meanwhile, as shown in (b) of FIG. 4B , the second selection signal may be a selection signal related to the graphic object 412 in a state in which the first related information 414 is output. The second selection signal may be a user input (eg, a touch input, etc.) for any one of the graphic object 412 and the first related information 414 . When the second selection signal related to the graphic object 412 is input, the control unit 130, as shown in (c) of FIG. 4B, a second association related to a portion of the text (eg, arrest warrant) The second page 415 including information may be output on the display unit 11 .

That is, the controller 130 may convert the first page output to the display unit to the second page based on the second selection signal. In this way, the controller 130 may sequentially display the first and second related information based on the first and second selection signals. In this case, when the user wants to know in more detail about the contents of the first related information, by inputting the second selection signal, the second related information may be provided.

Meanwhile, as shown in (a) and (b) of FIG. 4C , the second page 422 selects a preset function icon 421 as well as a selection signal for a graphic object related to a partial text. Based on , it can be output. In this case, the controller 130 may output information related to a graphic object related to a partial text or information related to a video content (eg, a news article, etc.) through the second page 422 .

On the other hand, as shown in FIGS. 4B and 4C , when the second pages 415 and 422 are output to the display unit 11 , the video content being reproduced in the first area (a) of the first page continues. can be played back. That is, even when the second pages 415 and 422 are output to the display unit 11 , the controller 130 may control the electronic device 10 to maintain the reproduction of the video content being reproduced in the first area. . In this case, the electronic device 10 may process the reproduction function of the moving picture content and the output function of the second pages 415 and 422 in a multi-tasking manner. In this case, the second pages 415 and 422 may be output to the display unit 11 of the electronic device 10 , and a sound corresponding to the audio data of the moving image content may be output from the sound output unit of the electronic device 10 . have.

On the other hand, when the first page being output to the display unit 11 is switched to the second pages 415 and 422 , the control unit 130 displays in one area of the display unit 11 , related to the control of video content. Images (or graphic objects or graphic user interface (GUI) objects, 416 and 423 ) may be output. The GUI objects 416 and 423 may also be called floating objects or floating icons.

4b (c) and 4c (b), in one area of the second pages 415 and 422, the control related to the control of the moving picture being reproduced in the first area (a) of the first page GUI objects 416 and 423 may be output.

The GUI objects 416 and 423 change at least one of an output position and an output size on the second page based on a user input (eg, a touch input) for the GUI objects 416 and 423 . can be

The GUI objects 416 and 423 serve as an intermediary with the first page on which video content is being played, and the controller 130 controls a user input (for example, , based on a user input (or touch input) of a preset method, the first page may be output to the display unit 11 . In this case, the second pages 415 and 422 being output to the display unit 11 may be switched to the first page based on the user input of the preset method.

Meanwhile, as shown in (a) of FIG. 5A , the controller 130 may use the GUI object 510 to provide related information on video content. As the video content is reproduced, the control unit 130 changes the caption for the video content, and when some text (or word) with related information exists, as shown in (a) of FIG. 5A , the GUI In the object 510 or around the GUI object 510 , a graphic object 511 for some text in which related information exists may be output. The controller 130 may provide the graphic object 511 on the display unit 11 when there is related information related to the moving picture content of the currently played part.

In this case, the graphic object 511 may include at least a portion of text (eg, the Supreme Court) included in the subtitle.

Furthermore, the control unit 130, based on the selection signal for the graphic object 511, as shown in (b) of Figure 5a, a portion of the text related to the graphic object 511 (eg, the Supreme Court) ) may be output on the display unit 11 . The control unit 130 changes the related information that was conventionally output on the second page, or through a new third page 502 , the association with the text (eg, the Supreme Court) of a portion related to the graphic object 511 . information can be provided.

Furthermore, the controller 130 may utilize the GUI object 510 as a control screen for receiving a control command for video content reproduced in the first area (a).

For example, as shown in FIG. 5B , the GUI object 510 displays menu screens 520 and 521 for selecting a property (eg, subject) of video content reproduced in the first area (a). may include When a specific topic is selected through the menu screen, the controller 130 may control the electronic device 10 to reproduce video content for the selected specific topic.

Furthermore, as shown in Figure 5c, the GUI object 510 controls the playback of the video content reproduced in the first area (a) (eg, pause, replay, adjust the volume, select the next video content, Previous video content selection, etc.) may include the following control menu screens 531 , 532 , 533 , and 534 .

Such a menu screen may be output around the graphic object 510 as illustrated, based on a user input (eg, a long touch input, etc.) of a preset method for the graphic object 510 . Furthermore, such a menu screen may be provided as a function key included in the graphic object 510 .

As described above, in the present invention, by maintaining the reproduction of the moving picture content and organically providing related information related to the moving picture content, the user can more intuitively access necessary information.

Meanwhile, in the above description, it has been seen that the video content according to the present invention can be generated by the controller 130 . The controller 130 may generate video content by converting text into voice based on a Test to Speech (TTS) technology. In this case, the converted voice may be audio data of moving image content, and the text to be converted may be subtitle data of moving image content. In this case, the controller 130 may utilize, as image data, a static image or a dynamic image included in a document including the text to be converted or having content related to the text to be converted. Furthermore, the controller 130 may use an arbitrary image (refer to FIG. 4D ) preset to be used when generating the moving image content as image data of the moving image content.

Like a city, the preset image may be an image including a human face. Like a city, the preset image may be an image of a real person's face, an avatar, or a character. As such, when an image corresponding to a human face is output, the user may feel as if an announcer or anchor is uttering voice data corresponding to video content.

Meanwhile, in this case, the voice data is generated by the TTS method, and the properties of the voice uttering the voice data may be changed based on a user's selection. As shown in FIG. 4E , the controller 130 provides a control area 452 for receiving a selection of the properties of the voice (eg, the atmosphere given by the voice, the gender of the virtual person uttering the voice, the voice, etc.) can do. When any one 453 of graphic objects matched to different voice properties is selected by the user through the control area 452, the control unit 130 is a voice matched to the selected one graphic object 453. Voice data corresponding to the attribute (eg, serious and professional feeling) may be provided to the electronic device 10 .

Furthermore, it is also possible for the controller 130 to change the image data output to the first region (a) based on the selection of the audio attribute. The controller 130 may provide a face image (or an avatar, or a character) matched to the properties of the selected voice as image data to the first region (a). Meanwhile, image data output to the first region (a) may include at least one of a static image and a dynamic image.

Meanwhile, in the present invention, the first area (a) may be used as an output area for providing moving picture content, and the first area (a) may be utilized as a control command input area. The controller 130 may perform a control related to video content based on a user input (eg, a touch input) for the first region (a).

In this case, the user input may be a preset type of touch input for the first area (a). In the present invention, different control commands may be matched for each of different preset types of touch inputs. The controller 130 may perform various controls related to the reproduction of video content based on a method of a touch input input to the first region (a).

As an example, as shown in (a) of FIG. 6A , the control unit 130 based on a drag touch input in a preset direction (eg, from the right to the left) in FIG. 6A ( As shown in b), the video content being provided in the first area (a) can be changed. Based on the drag touch input, the controller 130 terminates the reproduction of the first moving image content 641 being reproduced in the first area (a) as shown in (a) of FIG. 6A , and FIG. 6A . As shown in (b) of (b), the second video content 642 may be reproduced in the first area (a).

In this case, the subject of the second moving image content 642 may or may not be related to the subject of the first moving image content 641 .

As an example, as shown in (a) of FIG. 6B , the controller 130 selects the subject of the second video content 642 based on preference information received from the user with respect to the first video content 641 . You can choose. Such preference information may be input through the electronic device 10 while the first moving picture content 641 is being reproduced.

When receiving preference information indicating that the user is interested in the first video content 641 , the controller 130 sets the video content related to the subject or content of the first video content 641 to the second video content 642 . can be specified as

Contrary to this, when receiving non-preference information indicating that the user is not interested in the first video content 641 , the controller 130 sets the video content unrelated to the subject or content of the first video content 641 to the second video content. (642) can be specified.

Furthermore, different preset types of touch input for the first area (a) include: i) stopping playback of video content, ii) playback of previously played video content, iii) changing the type of voice that utters voice data and the like, may be respectively matched to various control commands related to video content.

On the other hand, when the control unit 130 can receive a control command corresponding to the touch input received from the user as a voice command, as shown in (b) of FIG. 6B , say “Next time, please say “next article” Guide information such as “!” can be output. Through this, the present invention can allow a user to more conveniently control video content.

As described above, the method and system for providing related information according to the present invention divide the display area of the display unit into a plurality of areas to provide video in one area and information related to information provided in the video in another area. can Accordingly, the user can more intuitively use information related to the information provided in the video at any time even while using the video. As a result, the user can reduce the hassle of searching for information by entering a separate function to search for related information.

Furthermore, the method and system for providing related information according to the present invention may provide information provided in a video as a caption and provide information related to text included in the caption. That is, in the present invention, by visually providing related information that can be provided to a user through a caption, the user can more easily access the related information.

Furthermore, the method and system for providing related information according to the present invention can provide a user environment in which a page conversion is performed in order to provide related information while a moving picture is being played. Through this, the present invention can provide related information in the entire display area, and in this case, it is possible to provide a GUI for controlling the reproduction of a moving picture. Accordingly, the user may be provided with related information and, at the same time, continue to use sound information provided from a video, and thus may receive various information in a complex manner.

Meanwhile, the computer-readable medium includes all types of recording devices in which data readable by a computer system is stored. Examples of computer-readable media include Hard Disk Drive (HDD), Solid State Disk (SSD), Silicon Disk Drive (SDD), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. There is this.

Furthermore, the computer-readable medium may be a server or a cloud storage that includes a storage and that an electronic device can access through communication. In this case, the computer may download the program according to the present invention from a server or cloud storage through wired or wireless communication.

Furthermore, in the present invention, the computer described above is an electronic device equipped with a processor, that is, a CPU (Central Processing Unit, Central Processing Unit), and there is no particular limitation on the type thereof.

On the other hand, the above detailed description should not be construed as restrictive in all aspects, but should be considered as exemplary. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present invention are included in the scope of the present invention.

Claims (17)

reproducing video content including subtitles in a first area of the display unit;
outputting, in a second area of the display unit, a graphic object including a partial text of which related information exists in a preset database among texts constituting the subtitle; and
based on a selection signal related to the graphic object, providing related information related to the part of the text;
Among the subtitles output from the first area, the partial text for which the related information exists in the preset database is highlighted and displayed so as to be distinguished from the other part of the text;
Information output from the second area so that a graphic object corresponding to the changed text is output in the second area when the highlighted text is changed as the subtitle is changed in the moving picture content output from the first area A method for providing related information, characterized in that the is changed. According to claim 1,
Further comprising the step of generating the subtitle,
In the step of generating the subtitle,
Searching for a part of the text included in the subtitle that corresponds to a keyword registered in a specific database exists;
and highlighting a portion of the text constituting the subtitle that corresponds to the previously registered keyword. 3. The method of claim 2,
The part of the text corresponds to a specific keyword previously registered in the specific database,
The method for providing related information, characterized in that the text of the part of the subtitle is displayed in a color different from that of the text of the other part. 4. The method of claim 3,
In the specific database,
The related information providing method, characterized in that the related information related to the specific keyword corresponding to the part of the text is stored by matching the specific keyword. According to claim 1,
A first page including a first area in which the moving picture content is reproduced and a second area in which the graphic object is displayed is displayed on the display unit;
The first page output to the display unit,
According to the selection signal for the graphic object, the related information providing method, characterized in that the conversion to a second page different from the first page. 6. The method of claim 5,
When the second page is output to the display unit,
A method for providing related information, characterized in that a GUI object related to control of video content being reproduced in the first area of the first page is output to one area of the second page. 7. The method of claim 6,
The method for providing related information, characterized in that even when the second page is output on the display unit, the moving picture content being played in the first area is continuously played. 8. The method of claim 7,
The GUI object is
Based on a user input to the GUI object, at least one of an output position and an output size on the second page is changed. 9. The method of claim 8,
The second page output to the display unit,
The method for providing related information, characterized in that switching to the first page based on a user input of a preset method for the GUI object. 6. The method of claim 5,
The selection signal associated with the graphic object includes a first selection signal and a second selection signal,
When the first selection signal related to the graphic object is input, first related information related to the text of the portion is outputted from the second area,
When the second selection signal related to the graphic object is input, the second page including second related information related to the part of the text is outputted. 11. The method of claim 10,
The first association information includes a part of the second association information. According to claim 1,
In the first area, a progress bar indicating the degree of reproduction of the video content is displayed,
and the progress bar includes an indicator indicating a playback point at which the highlighted text of the part is output. 13. The method of claim 12,
and controlling reproduction of the moving picture content so that, when a selection signal for selecting the indicator is received, the highlighted portion of the text is reproduced from the point where it is included as a caption. According to claim 1,
Relevant information, characterized in that the method further comprises the step of converting a first moving picture content being played back in the first area into a second moving picture content different from the first moving picture content based on a user input to the first area. How to provide. 15. The method of claim 14,
The method for providing related information, characterized in that the second moving image content reproduced in the first area based on the user input has a different subject from that of the first moving image content. communication department;
a display unit including a display area divided into a first area and a second area; and
The display unit may be configured to reproduce video content including subtitles in the first area, and output a graphic object including a text of a portion of which texts constituting the subtitles exist in a preset database among the texts constituting the subtitles in the second area. including a control unit to control,
Among the subtitles output from the first area, the partial text for which relevant information exists in the preset database is highlighted and displayed so as to be distinguished from other texts,
Information output from the second area so that a graphic object corresponding to the changed text is output to the second area when the highlighted text is changed as the subtitle is changed in the moving picture content output from the first area A system for providing related information, characterized in that it is changed. A program executable by one or more processes in an electronic device and storable in a computer-readable medium,
The program is
reproducing video content including subtitles in a first area of the display unit;
outputting, in a second area of the display unit, a graphic object including a partial text of which related information exists in a preset database among texts constituting the subtitle; and
Based on a selection signal related to the graphic object, providing related information related to the text of the part includes instructions to perform:
Among the subtitles output from the first area, the partial text for which relevant information exists in the preset database is highlighted and displayed so as to be distinguished from other texts,
Information output from the second area so that a graphic object corresponding to the changed text is output in the second area when the highlighted text is changed as the subtitle is changed in the moving picture content output from the first area A program storable in a computer-readable medium, characterized in that the is changed.

Images