KR102466219B1 - Method for providing of information related to content based on user behavior - Google Patents

Abstract

A method for providing content-related information is provided. A method for providing content-related information according to an embodiment of the present invention includes outputting a first area in which a part of information on multimedia content is displayed and a first user input for moving from the first area to the second area. Detected, but the direction of movement to the second area is according to the following order of the information displayed in the first area, and information related to the information displayed in the second area in response to detecting the first user input The method may include forming the first learning item in any one area within the second area.

Description

How to provide content-related information based on user behavior

The present invention relates to a method and apparatus for providing content related information. More particularly, it relates to a method of providing information related to user behavior and content content.

The content provided on the document viewer or the web viewer is not all output on the user interface screen because the amount of information is very large. Accordingly, since only a portion of the entire content is displayed, the user can acquire information about the entire content while moving the screen area while directly inputting a scroll.

If the user performs a plurality of scroll inputs to find desired information during the process of acquiring information, it is difficult to check the outline of the currently displayed content at a glance. In addition, when it is difficult for the user to understand the contents of the content currently displayed in the screen area, it is troublesome to execute a separate task window and search individually.

When the amount of content information is vast, navigation bars or navigation bars are widely used among the functions provided by existing document viewers or web viewers. It is not even equipped with a function to provide related information.

Korean Patent Publication No. 2016-0127590

The technical problem to be solved by the present invention is to provide a method and apparatus for supporting a user's content learning based on the user's behavior and content information.

Another technical problem to be solved by the present invention is to provide a method and an apparatus for enabling a user to efficiently acquire information in a process of learning about content.

The technical problems of the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the following description.

In order to solve the above technical problem, the method for providing content-related information according to an embodiment of the present invention includes outputting a first area in which a part of information about multimedia content is displayed, and the second area in the first area Sensing a first user input for moving to an area, wherein the moving direction to the second area is according to a next order of information displayed in the first area, in response to detecting the first user input The method may include forming a first learning item including information related to information displayed in the second area in any one area within the second area.

In an embodiment, the first learning item may provide at least one information link related to information displayed in the second area.

In an embodiment, in response to detecting the first user input, forming a first learning item including information related to information displayed in the second area in any one area in the second area includes: The method may include forming an index bar in an area adjacent to the first learning item, the index displayed on the index bar being changed in response to the first user input, and displaying the table of contents information of the second area.

In an embodiment, in response to detecting the first user input, forming a first learning item including information related to information displayed in the second area in any one area in the second area includes: The method may include forming an index bar in an area adjacent to the first learning item, and simultaneously forming, in the area of the index bar, a download item capable of obtaining data regarding the first learning item as the index bar.

In an embodiment, detecting a second user input for moving from the second area to the first area, wherein the second user input has a movement direction opposite to that of the first user input, the second user input The method may further include forming a hover control in response to detecting the

In an embodiment, the forming of the hover control in response to the sensing of the second user input may include forming a reference indicator in an area adjacent to the area where the hover control is formed.

In an embodiment, detecting a second user input for moving from the second area to the first area, wherein the second user input has a movement direction opposite to that of the first user input, the second user input In response to detecting information displayed in the moved area according to the detection result, and detecting that the displayed information is displayed again, in response to detecting the second user input, a second item including information related to the displayed information The method may include forming two learning items, wherein the second learning item is information deepened in the first learning item.

A method of providing content-related information according to another embodiment of the present invention for solving the above-described technical problem includes displaying a part of text for multimedia content, among the parts of the text, from a first point to a second point and displaying a highlight indicator bar indicating the length of the sentence from the first point to the second point in response to detecting a drag input for up to .

In an embodiment, the highlight indicator bar may indicate the length and position of the text from the first point to the second point based on the entire text for the multimedia content.

In an embodiment, displaying a highlight indicator bar indicating the length of a sentence from the first point to the second point in response to detecting a drag input from the first point to the second point among the part of the text may include automatically changing the length of the highlight indicator bar in response to a change in the length from the first point to the second point.

In an embodiment, displaying a highlight indicator bar indicating the length of a sentence from the first point to the second point in response to detecting a drag input from the first point to the second point among the part of the text may include displaying a sentence item capable of storing sentences from the first point to the second point.

A computer program for providing content-related information according to an embodiment of the present invention for solving the above-described technical problem comprises the steps of: outputting a first area in which a part of information about multimedia content is displayed; Sensing a first user input for moving to a second region, wherein the moving direction to the second region is according to a next order of information displayed in the first region, in response to detecting the first user input to form a first learning item including information related to information displayed in the second area in any one area within the second area, the recording medium may be stored in the recording medium.

A computer program for providing content-related information according to another embodiment of the present invention for solving the above-described technical problem comprises the steps of: displaying a part of text for multimedia content; It may be stored in the recording medium to execute the step of displaying a highlight indicator bar indicating the length of the sentence from the first point to the second point in response to detecting the drag input to the point.

1 is a diagram illustrating a structure of a computing device according to an embodiment of the present invention.
2 is a flowchart illustrating a method of providing content-related information according to an embodiment of the present invention.
3 is a diagram for explaining that a referenced learning item is displayed in some embodiments of the present invention.
4 is a diagram for explaining that a first learning item referenced in some embodiments of the present invention is displayed on a mobile screen.
5 is a flowchart illustrating a method of providing content related information according to another embodiment of the present invention.
6 is a diagram for explaining that a hover control, etc. referred to in some embodiments of the present invention is displayed.
7 is a diagram for explaining that a hover control or the like referenced in some embodiments of the present invention is displayed on a mobile screen.
8 is a diagram for explaining that a second learning item referenced in some embodiments of the present invention is displayed.
9 is a diagram for explaining that a second learning item referenced in some embodiments of the present invention is displayed on a mobile screen.
10 is a diagram for explaining that an index referenced in some embodiments of the present invention is displayed on a mobile screen.
11 is a flowchart illustrating a method of providing content related information according to another embodiment of the present invention.
12 is a flowchart of a reference indicator forming process referenced in some embodiments of the present invention.
13 is a diagram for explaining that a highlight indicator bar referred to in some embodiments of the present invention is displayed.
14 is a diagram for explaining that a highlight indicator bar referenced in some embodiments of the present invention is displayed on a mobile screen.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. Advantages and features of the present invention and methods of achieving them will become apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, and only these embodiments allow the disclosure of the present invention to be complete, and common knowledge in the technical field to which the present invention pertains It is provided to fully inform those who have the scope of the invention, and the present invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout.

Unless otherwise defined, all terms (including technical and scientific terms) used herein may be used with the meaning commonly understood by those of ordinary skill in the art to which the present invention belongs. In addition, terms defined in a commonly used dictionary are not to be interpreted ideally or excessively unless clearly defined in particular. The terminology used herein is for the purpose of describing the embodiments and is not intended to limit the present invention. In this specification, the singular also includes the plural, unless specifically stated otherwise in the phrase.

As used herein, "comprises" and/or "comprising" refers to the presence of one or more other components, steps, operations and/or elements mentioned. or addition is not excluded.

Hereinafter, some embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating a structure of a computing device according to an embodiment. 1 is only a computing device according to an embodiment, and the computing device according to the present invention may include fewer or more components than those illustrated in FIG. 1 .

The computing device 100 may be connected to an external device (not shown) using the mobile communication module 120 , the sub-communication module 130 , and the connector 165 . The external device may include at least one of another device (not shown), a mobile phone (not shown), a smart phone (not shown), a tablet PC (not shown), and a server (not shown).

Referring to FIG. 1 , a computing device 100 includes a screen 190 and a screen controller 195 . In addition, the computing device 100 includes a control unit 110 , a mobile communication module 120 , a sub communication module 130 , a multimedia module 140 , a camera module 150 , a GPS module 155 , an input/output module ( 160 ), a sensor module 170 , a storage unit 175 , and a power supply unit 180 . The sub communication module 130 includes at least one of a wireless LAN module 131 and a short-range communication module 132, and the multimedia module 140 includes a broadcast communication module 141, an audio reproduction module 142, and a video reproduction module. It may include at least one of (143). The camera module 150 includes at least one of a first camera 151 and a second camera 152 , and the input/output module 160 includes a button 161 , a microphone 162 , a speaker 163 , and vibration. It may include at least one of a motor 164 , a connector 165 , and a keypad 166 .

The control unit 110 stores signals or data input from the outside of the CPU 111 , the ROM 112 in which a control program for controlling the computing device 100 is stored, and the computing device 100 , or the computing device 100 . It may include a RAM 113 that is a memory used as a storage area for a work performed in the . The CPU 111 may include a plurality of processors such as single core, dual core, triple core, or quad core. The CPU 111 , the ROM 112 , and the RAM 113 may be interconnected through an internal bus BUS.

The control unit 110 includes a mobile communication module 120 , a sub communication module 130 , a multimedia module 140 , a camera module 150 , a GPS module 155 , an input/output module 160 , a sensor module 170 , and storage. It is possible to control the unit 175 , the power supply unit 180 , the screen 190 , and the screen controller 195 .

The mobile communication module 120 may allow the computing device 100 to be connected to an external device through mobile communication using at least one (one or a plurality of) antennas (not shown) under the control of the controller 110 . . The mobile communication module 120 includes a mobile phone (not shown), a smart phone (not shown), a tablet PC (not shown) or another device (not shown) having a phone number input to the computing device 100 and It can transmit/receive a wireless signal for transmitting a voice call, video call, text message (SMS) or multimedia message (MMS).

The sub communication module 130 may include at least one of a wireless LAN module 131 and a short-range communication module 132 . For example, it may include only the wireless LAN module 131 , only the short-range communication module 132 , or both the wireless LAN module 131 and the short-range communication module 132 .

The wireless LAN module 131 may connect to the Internet at a location in which a wireless access point (AP) (not shown) is installed under the control of the controller 110 . The wireless LAN module 131 may support the IEEE802.11x wireless LAN standard of the American Institute of Electrical and Electronics Engineers (IEEE). The short-range communication module 132 may perform wireless short-range communication between the computing device 100 and the image forming apparatus (not shown) under the control of the controller 110 . The short-distance communication method may include Bluetooth, infrared data association (IrDA), Zig-bee, and the like.

The computing device 100 may include at least one of a mobile communication module 120 , a wireless LAN module 131 , and a short-range communication module 132 according to performance.

The multimedia module 140 may include a broadcast communication module 141 , an audio playback module 142 , or a video playback module 143 . The broadcast communication module 141 includes a broadcast signal (eg, a TV broadcast signal, a radio broadcast signal, or a data broadcast signal) transmitted from a broadcast station through a broadcast communication antenna (not shown) under the control of the controller 110 and broadcast Additional information (eg, an electric program guide (EPG) or an electric service guide (ESG)) may be received. The audio reproduction module 142 may reproduce a stored or received digital audio file under the control of the controller 110 . The video playback module 143 may play a stored or received digital video file under the control of the controller 110 . The video reproduction module 143 may reproduce a digital audio file.

The multimedia module 140 may include an audio playback module 142 and a video playback module 143 excluding the broadcast communication module 141 . Also, the audio reproduction module 142 or the video reproduction module 143 of the multimedia module 140 may be included in the controller 100 .

The camera module 150 may include at least one of a first camera 151 and a second camera 152 for capturing still images or moving images under the control of the controller 110 . Also, the first camera 151 or the second camera 152 may include an auxiliary light source (not shown) that provides an amount of light required for photographing. The first camera 151 may be disposed on the front side of the computing device 100 , and the second camera 152 may be disposed on the back side of the computing device 100 . Alternatively, the first camera 151 and the second camera 152 may be disposed adjacent to each other (eg, with an interval greater than 1 cm and less than 8 cm) to capture a 3D still image or a 3D moving picture.

The GPS module 155 receives radio waves from a plurality of GPS satellites (not shown) on Earth's orbit, and uses a time of arrival from the GPS satellites (not shown) to the display device 100 . Thus, the location of the computing device 100 may be calculated.

The input/output module 160 may include at least one of a plurality of buttons 161 , a microphone 162 , a speaker 163 , a vibration motor 164 , a connector 165 , and a keypad 166 .

The button 161 may be formed on the front, side, or back of the housing of the computing device 100 , and includes a power/lock button (not shown), a volume button (not shown), a menu button, a home button, and a return button. It may include at least one of a button (back button) and a search button (161).

The microphone 162 may generate an electrical signal by receiving a voice or sound under the control of the controller 110 .

The speaker 163 outputs sounds corresponding to various signals of the mobile communication module 120 , the sub communication module 130 , the multimedia module 140 , or the camera module 150 according to the control of the controller 110 to the computing device 100 . ) can be output externally. The speaker 163 may output a sound corresponding to a function performed by the computing device 100 . One or a plurality of speakers 163 may be formed at an appropriate location or locations in the housing of the computing device 100 .

The vibration motor 164 may convert an electrical signal into mechanical vibration under the control of the controller 110 . For example, the computing device 100 in the vibration mode may operate the vibration motor 164 when a voice call is received from another device (not shown). The vibration motor 164 may operate in response to a user's touch operation making contact on the screen 190 and a continuous movement of a touch input on the screen 190 .

The connector 165 may be used as an interface for connecting the computing device 100 and an external device (not shown) or a power source (not shown). Data stored in the storage unit 175 of the computing device 100 is transmitted to an external device (not shown) or an external device (not shown) through a wired cable connected to the connector 165 under the control of the controller 110 . data can be received from Power may be input from a power source (not shown) through a wired cable connected to the connector 165 or a battery (not shown) may be charged.

The keypad 166 may receive a key input from a user for controlling the computing device 100 . The keypad 166 includes a physical keypad (not shown) formed on the computing device 100 or a virtual keypad (not shown) displayed on the screen 190 . A physical cap (not shown) formed in the computing device 100 may be excluded depending on the performance or structure of the computing device 100 .

The sensor module 170 includes at least one sensor that detects the state of the computing device 100 . For example, the sensor module 170 is a proximity sensor that detects whether the user approaches the computing device 100 , an illuminance sensor (not shown) or a computing device that detects the amount of light around the computing device 100 . It may include a motion sensor (not shown) that detects the operation (eg, rotation of the computing device 100 , acceleration or vibration applied to the computing device 100 ). The sensor of the sensor module 170 may be added or deleted according to the performance of the computing device 100 .

The storage unit 175 includes a mobile communication module 120 , a sub communication module 130 , a multimedia module 140 , a camera module 150 , a GPS module 155 , and an input/output module according to the control of the controller 110 . A signal or data input/output corresponding to the operation of the 160 , the sensor module 170 and the screen 190 may be stored. The storage 175 may store control programs and applications for controlling the computing device 100 or the controller 110 .

The term “storage unit” may include a storage unit 175 , a ROM 112 in the control unit 110 , a RAM 113 , or a memory card (not shown) mounted in the computing device 100 . The storage unit may include a non-volatile memory, a volatile memory, a hard disk drive (HDD), or a solid state drive (SSD).

The power supply unit 180 may supply power to at least one battery (not shown) disposed in the housing of the computing device 100 under the control of the control unit 110 . Also, the power supply unit 180 may supply power input from an external power source (not shown) to each unit of the computing device 100 through a wired cable connected to the connector 165 .

The screen 190 may output a user interface corresponding to various services to the user. The screen 190 may transmit an analog signal corresponding to at least one touch input to the user interface to the screen controller 195 . The screen 190 may receive at least one touch input through the user's body (eg, a finger) or a touchable input means (eg, a stylus pen). Also, the screen 190 may receive continuous movement of at least one touch input. The screen 190 may transmit an analog signal corresponding to the continuous movement of the touch input to the screen controller 195 .

In the present invention, the touch input is not limited to input through contact between the screen 190 and the user's body or a touchable input means, and a non-contact input (for example, the distance between the screen 190 and the body is 1 mm or less) ) may be included. The detectable interval on the screen 190 may be changed according to the performance or structure of the computing device 100 .

The screen 190 may be implemented by, for example, a resistive method, a capacitive method, an infrared method, or an ultrasonic wave method.

The screen controller 195 may convert an analog signal received from the screen 190 into a digital signal (eg, X coordinate and Y coordinate) and transmit the converted analog signal to the controller 110 . The controller 110 may control the screen 190 using a digital signal received from the screen controller 195 . For example, the controller 110 may select an application execution icon (not shown) displayed on the screen 190 in response to a touch input or may execute an application. The screen controller 195 may be included in the screen 190 or the controller 110 .

Hereinafter, each step of the method for providing content related information according to some embodiments of the present invention may be performed by a computing device. For example, the computing device may be a desktop PC, a notebook computer, and a smart device. However, for convenience of description, the description of the operating subject of each step included in the method for providing the content-related information may be omitted.

2 is a flowchart illustrating a method of providing content-related information according to an embodiment of the present invention. However, this is only a preferred embodiment for achieving the object of the present invention, and it goes without saying that some steps may be added or deleted as needed.

The multimedia content is output to the screen area provided to the user (S201). The multimedia contents described in this specification refer to various information means such as various characters, symbols, and pictures that can be displayed in a screen area in order to provide information to a user. Since multimedia content includes a vast amount of information, a part of the information provided by multimedia may be displayed on the screen area provided to the user. Accordingly, the user may acquire information on multimedia content by moving the screen area through a keyboard or mouse operation, and when the computing device corresponds to a mobile device, the user may move the screen area through various gestures.

As a result of monitoring the user's input (S203), it is determined whether the user's input is the first user's input (S205). The first user input described in this specification is in accordance with a user's manipulation action to move the multimedia content in the order described by the user when a part of the multimedia content is displayed in the screen area. For example, the manipulation action may refer to an action of lowering a scroll bar, an action of scrolling a mouse wheel down, an action of inputting a gesture in one direction on the touch screen screen, and the like. Based on this manipulation behavior, it can be interpreted that the user is reading the text or the like provided by the content concentratingly.

When the sensed user input is the first user input, the first learning item is displayed in any one position of the screen area in response to detecting the first user input ( S207 ). In this case, the first learning item refers to a display object capable of supporting learning of text content displayed in the screen area moved by the first user input. For example, it may refer to all related information sharing means that can be displayed in the screen area, such as text for a pre-stored term description and an external link.

A method of providing content-related information according to an embodiment includes outputting a first area in which a part of information about multimedia content is displayed, and detecting a first user input for moving from the first area to the second area, , the direction of movement to the second area is according to the following order of information displayed in the first area, and a first including information associated with information displayed in the second area in response to detecting the first user input. The method may include forming the learning item in any one area within the second area. In light of a user action moving from the first area to the second area, it may be inferred that the user is learning through the text. Since the first learning item is automatically provided according to the first user input, it is possible to naturally increase the degree of understanding of the content that the user is viewing.

If it is sensed that the first user input is repeated after a predetermined time, it can be seen from FIG. 2 that the above-described steps are repeated.

Meanwhile, in FIG. 2 , a process related to a method of providing content related information has been described. Hereinafter, the display of a user interface implemented by the process described with reference to FIG. 2 will be described with reference to FIGS. 3 to 4 .

As shown in the upper part of FIG. 3 , a part of the long text is displayed in the area 1000 where the content is provided, and an index 1001 corresponding to the text content is displayed on the index bar 1010 . Here, the index bar 1010 may be an item capable of providing various functions such as a bookmark function and a download function. The index 1001 displayed on the index bar 1010 may be various sorting means such as a table of contents number, a subject name, and the like, a symbol, a figure, etc. that can distinguish a long text. When the subject of the text is changed according to a movement input of the user in the area 1000 in which the content is provided, the display of the index 1001 may be automatically changed.

In one embodiment, the first learning item 1012 may provide at least one information link associated with information displayed after movement. As shown in the lower part of FIG. 3 , a plurality of links are provided in an area where the first learning item 1012 is displayed so that a user can directly enter a site related to information.

In another embodiment, the download item 1011 may be formed in the area of the index bar 1010 . Data provided from the first learning item 1012 may be acquired through the download item 1011 .

In the state of the area 1000 shown in the upper part of FIG. 3 , when the first user input 11 which is an action of the user to move to the next text content is sensed, as shown in the lower part of FIG. 3 , the first user input 11 ), a first learning item 1012 related to the text information displayed in the current area is displayed, and an index 1002 matched with the changed text information is displayed. The first user input 11 may mean that the user is concentrating on reading the text displayed in the area 1000 . As a result of interpreting this meaning, the first learning item 1012 for supporting the user's learning is provided. The first learning item 1012 may indicate that necessary information can be acquired incidentally in the process of acquiring the changed text information. For example, as a result of performing similarity analysis on the displayed text, it may be an abbreviated representation of a definition of a related term, or a hyperlink through which information related to the text can be acquired. Therefore, it is possible to improve the comprehension of learning according to the process in which the user learns information about the current text.

Here, in order to more precisely analyze the user's behavior, whether to display the first learning item 1012 may be determined with reference to the scroll speed and acceleration. For example, when the scroll speed is faster than a predetermined speed, the first learning item 1012 may not be displayed. This is because, in this case, it is preferable that the user recognizes that the text is displayed as an action for skipping the area, and that the first learning item 1012 does not unnecessarily cover the area 1000 in which the content is provided. For another example, if the scroll speed is slower than a predetermined speed, the first learning item 1012 is displayed. In this case, it is necessary for the user to identify as an action for learning in the area where the text is displayed, and to support learning by providing information related to the displayed text.

In one embodiment, the step of forming the first learning item 1012 in response to detecting the first user input 11 includes forming the index bar 1010 in an area adjacent to the first learning item 1012 ; , the index 1002 displayed on the index bar 1010 may be changed in response to the first user input 11 .

Meanwhile, the process of displaying the learning item described in FIG. 3 may be applied to a desktop PC or the like having a relatively wide screen area to which content is provided. In the description of FIG. 4, an example implemented in a mobile device having a relatively narrow screen area will be described.

4 is a diagram for explaining that a first learning item referenced in some embodiments of the present invention is displayed on a mobile screen.

As shown in FIG. 4 , the first user input 21 , which is a trigger for displaying a learning item 2012 in a mobile screen area 2000 in which content is provided, may be different from the case of FIG. 3 . Of course, even in the mobile screen area 2000, the first user input 21 may be defined through various gestures input to the scroll bar. Defining the first user input 21 through the input may be a means for utilizing the characteristics of the mobile device.

Referring to FIG. 4 , the first learning item 2012 may be displayed in response to detecting an input of a gesture moving in one direction in the movement control 2003 . The first learning item 2012 may be displayed in any one position of the mobile screen area 2000 . For example, the first learning item 2012 may be displayed side by side in an area adjacent to the movement bar 2001 . This is because the sensing object (eg, a finger) is at the position of the movement control 21 at the moment when a manipulation with respect to the movement control 21 is sensed, so that the selection input for the first learning item 2012 is performed at a proximate position. can provide

The interaction related to the first user input described so far relates to a case in which the user moves the contents in the order of the contents. Hereinafter, an interaction regarding a second user input, which is a user action opposite to the first user input, will be described. Here, the second user input refers to a manipulation input in which the user moves in the reverse order of contents.

5 is a flowchart illustrating a method of providing content related information according to another embodiment of the present invention. However, this is only a preferred embodiment for achieving the object of the present invention, and it goes without saying that some steps may be added or deleted as needed.

As a result of monitoring the user's input (S501), it is determined whether the user's input is the second user's input (S503). The second user input described in this specification is opposite to the first user input, and when a part of the multimedia content is displayed in the screen area, the user's manipulation action to move the multimedia content content in the reverse order of the description will follow For example, the manipulation action may refer to an action of raising a scroll bar in an upward direction, an action of scrolling a mouse wheel upward, and an action of inputting a gesture in one direction on the touch screen screen. Based on such a manipulation action, the user may interpret the previously read text or the like to be re-searched or to move to an area in which another text is displayed.

When the sensed user input is the second user input, in response to detecting the second user input, at least one of the hover control and the reference indicator is output to any one position of the screen area (S505). The hover control refers to an interface GUI that can quickly move the display area of multimedia content. Accordingly, when the hover control is provided to the user, it is possible to quickly move the display area according to the user's hover control manipulation input. When a user operation for the displayed hover control is received (S507), the display area of the text can be changed at a high speed according to the user's operation (S509). The reference indicator refers to an interface GUI that can indicate a place highlighted by other users among texts that are changed as the display area of the multimedia content moves. For example, when a frequently highlighted display area appears in the display area while the user is scrolling, a reference indicator for notifying the user may be displayed in any one position of the screen area.

In step S503, when the detected user input is the second user input, as a result of confirming the area in which the displayed multimedia content is provided (S511), it is determined that the displayed multimedia content is the previously output area of the multimedia content (S513), a second learning item is displayed in response to detecting the second user input (S515). The second learning item refers to a display object provided with a higher level of in-depth information than information provided from the first learning item according to the first user input. This has the effect of maximizing the comprehension of the content when the user learns all the texts provided from the multimedia content in order through a scroll input and then repeats the same content again. In addition, as a result of performing steps S503 and S511 to S515 again, a higher level of information than the information provided by the second learning item may be provided.

Meanwhile, in FIG. 5 , a process related to a method of providing content related information has been described. Hereinafter, the display of a user interface implemented by the process described with reference to FIG. 5 will be described with reference to FIGS. 6 to 9 .

6 is a diagram for explaining that a hover control, etc. referred to in some embodiments of the present invention is displayed.

As shown in the upper part of FIG. 6 , it can be confirmed that some of the long text is displayed in the area 1000 where the content is provided, and an index 1008 corresponding to the displayed text is displayed.

In the state of the area 1000 shown in the upper part of FIG. 6 , if the second user input 12 that is an action for the user to move to the previous text content is detected, as shown in the lower part of FIG. 6 , the second user input 12 ), at least one of the hover control 1014 and the reference indicator 1013 is displayed in the current area. The position at which the hover control 1014 and the reference indicator 1013 are displayed may be any one position in the area 1000 where the content is provided.

For example, the hover control 1014 may be displayed at the position of the previously displayed moving bar or at a position adjacent to the moving bar, and the position of the reference indicator 1013 may be located adjacent to the hover control 1014 in the horizontal and vertical directions. can be displayed In this case, even when the user moves through the hover control 1014 to the area 1000 where the content is provided at high speed, the reference indicator 1013 immediately passes through the area highlighted by other users as important sentences. ) to notify the user. Therefore, even when the user searches quickly, important content is not missed.

7 is a diagram for explaining that a hover control or the like referenced in some embodiments of the present invention is displayed on a mobile screen. Note that the concept of interaction described in FIG. 6 may be applied.

Referring to FIG. 7 , a hover control 2501 and a reference indicator 2500 are displayed in response to detecting the second user input 22 . Due to the characteristics of the mobile device, positions at which the hover control 2501 and the reference indicator 2500 are displayed may be different from those of FIG. 6 . For example, the hover control 2501 may be located on the right side of the mobile screen area 2000 , and the reference indicator 2500 may be displayed adjacent to a position where an index is displayed. However, it should be noted that the positions of the hover control 2501 and the reference indicator 2500 are not necessarily limited to the above-described example.

8 is a diagram for explaining that a second learning item referenced in some embodiments of the present invention is displayed.

In the state of the region 1000 shown in the upper part of FIG. 8 , the second user input 12 is sensed, and as a result of checking the region where the multimedia content is provided, if it is determined that the displayed multimedia content has been previously output, the second learning Display the item 1015 . For a detailed definition of the second learning item 1015 displayed here, refer to the description of FIG. 5 .

9 is a diagram for explaining that a second learning item referenced in some embodiments of the present invention is displayed on a mobile screen.

In FIG. 9 , the definition of interaction described in FIG. 4 may be applied. However, unlike FIG. 4 , in FIG. 9 , the second learning item 2015 is displayed in response to detecting an input of a gesture moving in one direction in the movement control 2003 . For a description of the second learning item 2012, refer to the description of FIG. 5 .

10 is a diagram for explaining that an index referenced in some embodiments of the present invention is displayed on a mobile screen.

As shown in FIG. 10 , in response to detecting the second user input 21 , the mobile screen area 2000 changes to a dim mode and simultaneously displays a plurality of indices 2004, 2005, and 2005. display first. Accordingly, when the re-search process according to the second user input 22 is performed, an overview of the entire content can be checked through the index display.

11 is a flowchart illustrating a method of providing content related information according to another embodiment of the present invention. However, this is only a preferred embodiment for achieving the object of the present invention, and it goes without saying that some steps may be added or deleted as needed.

As a result of monitoring the user input ( S1001 ), it is determined whether the user input is a third user input. The third user input described in this specification means a trigger that can be detected when a user finds meaningful content in a screen area where multimedia is provided. For example, the third user input may be an input when no input is detected, when a drag input is performed with respect to text, and when a specific area is captured.

When the sensed user input is the third user input (S1105), the user's highlight input is received (S1105). Here, the highlight input refers to highlighting and displaying a part of the text as a result of the user dragging the text with respect to an important sentence. According to the reception result, a highlight indicator bar, which is an indicator for checking the length of the highlighted text, is output to a certain position (S1107). A detailed user interface screen will be described in detail with reference to FIGS. 13 to 14 .

Next, FIG. 12 is a flowchart of a reference indicator forming process referenced in some embodiments of the present invention. However, this is only a preferred embodiment for achieving the object of the present invention, and it goes without saying that some steps may be added or deleted as needed.

A text is extracted from the multimedia content (S1201), and the number of times other users highlight a part of the extracted text is calculated (S1203). For example, when the user performs a drag input from a first point to a second point in the text and performs highlighting, the number of times of highlighting from the first point to the second point is calculated, and the calculated number of times is stored. Based on the stored result, when the predetermined number of times or more is exceeded, a reference indicator is displayed on the screen area where the multimedia content is provided (S1205). For the position where the reference indicator is displayed, refer to the description of FIGS. 6 to 7 .

13 is a diagram for explaining that a highlight indicator bar referred to in some embodiments of the present invention is displayed.

Referring to FIG. 13 , a highlight area 1301 for a part of text in the area 1000 in which content is provided may be checked. At this time, the highlight indicator 1300 is displayed adjacent to the movement bar 1200 displayed in the movement bar area 1100 of the area 1000 in which the content is provided. The highlight indicator 1300 may be variably displayed to reflect the length of the highlight region 1301 , and is positioned at any one of the moving bar region 1100 to indicate the position of the highlight region 1301 with respect to the entire text. can do.

Also, when a user drags a portion of text before highlighting, a user interface in which the length of the highlight indicator 1300 is changed in real time according to the changed length may be provided.

According to an embodiment, a method for providing content-related information includes displaying a part of text for multimedia content and in response to detecting a drag input from a first point to a second point among the text parts, A highlight indicator bar 1300 indicating the length of the section from the first point to the second point may be displayed.

In another embodiment, the step of displaying the highlight indicator bar 1300 may include displaying a sentence item 1400 capable of storing sentences from the first point to the second point and selecting the area highlighted through the sentence item 1400 . You can save text.

In another embodiment, the sentences from the first point to the second point may be automatically stored in response to detecting the user's drag input from the first point to the second point.

14 is a diagram for explaining that a highlight indicator bar referenced in some embodiments of the present invention is displayed on a mobile screen.

Referring to FIG. 14 , a highlight area 2301 for a part of text in the mobile screen area 2000 may be checked. The difference from FIG. 12 is that the highlight area 2301 in the mobile screen area 2000 is displayed according to the user's input by a long touch gesture and a drag gesture. For the concept of interaction between the moving bar area 2100 , the moving bar 2200 , and the highlight indicator 2300 that are user interfaces implemented on the mobile screen, refer to the description of FIG. 12 described above.

The concepts of the present invention described so far with reference to FIGS. 1 to 14 may be implemented as computer-readable codes on a computer-readable medium. The computer-readable recording medium may be, for example, a removable recording medium (CD, DVD, Blu-ray disk, USB storage device, removable hard disk) or a fixed recording medium (ROM, RAM, computer-equipped hard disk). can The computer program recorded in the computer-readable recording medium may be transmitted to another computing device through a network such as the Internet and installed in the other computing device, thereby being used in the other computing device.

Although acts are shown in a particular order in the drawings, it should not be understood that the acts must be performed in the specific order or sequential order shown, or that all depicted acts must be performed to obtain a desired result. In certain circumstances, multitasking and parallel processing may be advantageous. Moreover, the separation of the various components in the embodiments described above should not be construed as necessarily requiring such separation, and the program components and systems described may generally be integrated together into a single software product or packaged into multiple software products. It should be understood that there is

Although embodiments of the present invention have been described above with reference to the accompanying drawings, those of ordinary skill in the art to which the present invention pertains can realize that the present invention can be embodied in other specific forms without changing the technical spirit or essential features. can understand Therefore, it should be understood that the embodiments described above are illustrative in all respects and not restrictive.

Claims (13)

A method for providing information associated with target content in a computing device, the method comprising:
displaying a first portion of the target content on the screen of the computing device;
detecting a first user input for moving the target content displayed on the screen from the first part to a second part, wherein the second part is a part located closer to the end of the target content than the first part; ; and
In response to the first user input, comprising the step of displaying a first learning item providing information related to the second portion on a partial area of the screen,
How to provide content-related information. The method of claim 1,
The first learning item,
providing a link to information related to the content of the second part;
How to provide content-related information. The method of claim 1,
The target content is text content,
Further comprising the step of displaying an index bar providing the table of contents information of the text content,
The table of contents information of the index bar is changed from the table of contents information of the first part to the table of contents information of the second part in response to the first user input,
How to provide content-related information. The method of claim 1,
Displaying a download item providing a download function for a predetermined material in a position adjacent to the first learning item,
wherein the predetermined material is for information associated with the second part;
How to provide content-related information. The method of claim 1,
detecting a second user input for moving the target content displayed on the screen from the second part to the first part; and
In response to the second user input, further comprising the step of displaying a hover control that provides a fast movement function to the target content,
How to provide content-related information. 6. The method of claim 5,
In response to the second user input, further comprising the step of displaying a reference indicator at a position adjacent to the hover control,
The reference indicator provides a display function for content highlighted by another user among the content of the second part displayed on the screen,
How to provide content-related information. The method of claim 1,
Displaying the first part of the target content comprises:
displaying a second learning item providing information associated with the first portion of the target content;
detecting a second user input for moving the target content displayed on the screen from the second part back to the first part; and
Displaying a third learning item providing information related to the first part only when the moving speed according to the second user input is less than or equal to a reference value;
the information provided by the third learning item is different from the information provided by the second learning item,
When the moving speed according to the second user input exceeds the reference value, the third learning item is not displayed,
How to provide content-related information. The method of claim 1,
The target content is text content,
detecting a drag input for the text of the second part displayed on the screen; and
In response to the drag input, further comprising the step of displaying a highlight indicator indicating the dragged section in the text of the second portion,
How to provide content-related information. 9. The method of claim 8,
The highlight indicator is
providing length information of the dragged section,
How to provide content-related information. 10. The method of claim 9,
The length information of the dragged section is provided through the length of the highlight indicator displayed on the screen,
The length of the highlight indicator is automatically changed as the length of the dragged section is changed,
How to provide content-related information. 9. The method of claim 8,
In response to the drag input, further comprising the step of displaying a sentence item providing a storage function for the text of the dragged section,
How to provide content-related information. In combination with a computing device,
displaying a first portion of the target content on the screen of the computing device;
detecting a first user input for moving the target content displayed on the screen from the first part to a second part, wherein the second part is a part closer to the end of the target content than the first part; and
in response to the first user input, stored in a computer-readable recording medium to execute the step of displaying a first learning item providing information related to the second portion on a partial area of the screen,
computer program. 13. The method of claim 12,
The target content is text content,
detecting a drag input for the text of the second part displayed on the screen; and
In response to the drag input, stored in a computer-readable recording medium to further execute the step of displaying a highlight indicator indicating the dragged section in the text of the second part,
computer program.

Images