KR101139688B1 - Method for offering additional information of vedeio service by on-screen in a mobile terminal, and computer readable recording medium storing programs for the same - Google Patents

Abstract

PURPOSE: A method for providing additional information for a moving picture of an on screen type on a mobile terminal and a computer readable recording media with a program for the same are provided to easily identify additional information with the moving picture. CONSTITUTION: A control unit displays a sub screen mark with a moving picture(S500). The control unit generates an internal structure for displaying the information about a sub screen(S502). The control unit displays the sub screen mark with a first sub screen with the on screen type(S504) moving picture. Given specific phrases on the first sub screen, the control unit performs an on screen display of a second sub screen(S506, S508).

Description

TECHNICAL FOR OFFERING ADDITIONAL INFORMATION OF VEDEIO SERVICE BY ON-SCREEN IN A MOBILE TERMINAL, AND COMPUTER READABLE RECORDING MEDIUM STORING PROGRAMS FOR THE SAME}

The present invention relates to a method for providing additional information on a mobile screen in a mobile terminal and a recording medium recording a program therefor. In particular, the mobile terminal has a relatively narrow display size such as a smart phone, a smart pad, and a PMP. The present invention relates to a method and a recording medium thereof for effectively providing additional information of a moving image on a screen.

Recently, with the development of mobile communication technology, various additional functions have been added to the mobile terminal, and now the mobile terminal has a function that is virtually close to the computer in the hand. Representative examples of such mobile terminals are smart phones such as an iPhone and smart pads such as an iPad. Smartphones or smart pads are equipped with a variety of applications to provide a variety of convenience to the user. Looking at these applications, there are various games, real-time text chat, DMB service, Internet search, applications for providing video services.

Among these services, the function of providing a video service in a smart phone has been gradually developed from the form of simply providing a video service, and has been developed in the form of providing various services such as language learning using the video service. As such, in order to provide various video services including language learning through video, an appropriate method is required. This is because, unlike a personal computer (PC), a smartphone or a smart pad has a relatively small size of the display screen to secure portability.

That is, in the case of a personal computer, since the display screen is wide, the user can be provided with this service without any inconvenience even if the user displays the additional information (subtitle or textbook contents) related to language learning while allocating a space next to the video while watching a video. Can be performed. However, in the case of a mobile terminal, since the size of the display screen is relatively narrow, when a language learning information is provided as in a general PC, a video is displayed very small or it is difficult to accurately identify additional information provided.

Accordingly, the present invention provides a method and a recording medium for efficiently identifying additional information provided with a video when providing various video services in a mobile terminal having a narrow display size such as a smart phone or a smart pad. .

The present invention also provides a method for easily using the additional information provided when providing a video service in a mobile terminal including a smart phone or a smart pad and a recording medium therefor.

According to an aspect of the present invention, there is provided a method for displaying a video and additional information in a mobile terminal, including: displaying a sub-screen mark for displaying additional information on the video together with the played video; Generating an internal structure for displaying information on the sub screen in an on-screen form on the video; While the video is being played, a first sub screen for displaying additional information corresponding to the video being played is formed in response to an operation input to the sub screen mark, and the screen is displayed on a portion of the video screen being played. And overlaying and displaying the same.

According to an embodiment of the present invention, a recording medium includes: means for displaying an auxiliary screen mark for displaying additional information on the video together with the video played when the mobile terminal plays back the video; Means for generating an internal structure for the mobile terminal to display information on the sub-screen on the video in an on-screen form; While the video is being played, a first sub screen for displaying additional information corresponding to the video being played is formed in response to an operation input to the sub screen mark, and the screen is displayed on a portion of the video screen being played. And means for overlaying and displaying the computer readable recording medium having recorded the program.

The mobile terminal according to the present invention can easily and efficiently check the additional information provided when providing a video service, which can be more easily implemented using a smartphone. In addition, in displaying the additional information, the video may be provided with minimal disruption to the basically provided video.

FIG. 1 is an example of capturing a displayed screen when providing video information in a smartphone.
2 is a diagram illustrating a screen of switching activities using a display device of a smartphone;
3 is a block diagram illustrating the internal functional block of a smartphone terminal as a mobile terminal according to an embodiment of the present invention;
4 is a conceptual diagram for explaining an on-screen according to an embodiment of the present invention;
5 is a control flowchart when additional information is displayed by an on-screen method while a video is displayed according to an embodiment of the present invention;
6 is a diagram illustrating an auxiliary screen mark and a playing time in a video in which a display screen of a mobile terminal is displayed on-screen;
7 is an exemplary diagram in which a main screen and a first sub screen are provided in an on-screen form when playing a video on a mobile terminal according to an embodiment of the present invention;
8 is an exemplary diagram in which a main screen, a first sub screen, and a second sub screen are provided in an on-screen form when a video is played on a mobile terminal according to an embodiment of the present invention;
9 is an exemplary diagram in which a third sub-screen is provided in an on-screen form together with a main screen when playing a video on a mobile terminal according to an embodiment of the present invention.

Hereinafter, the present invention will be described with reference to the accompanying drawings. The accompanying drawings of the present invention are provided below to provide an understanding of the present invention, it should be noted that the present invention is not limited to the form or arrangement illustrated in the drawings of the present invention. Equivalent or extension of additional embodiments to the drawings attached to the present invention will be understood through the description with reference to the drawings.

Prior to describing the present invention, a case in which video information is provided by a PC and a video information is provided by a mobile terminal will be described in more detail.

First of all, in the case of a PC, since a display screen has a large display screen, various additional information may be displayed by dividing an area displaying the video information. For example, English lecture / sports broadcast / drama / movie video is displayed in 1024 size and various information (English companion contents / player data / drama information / movie subtitles / other T-commerce related contents) is displayed on the right and bottom sides. I can display it.

However, since a mobile terminal including a smart phone has a small display screen, it is inappropriate to display areas separately therein. Therefore, it is a basic concept of software design in smart phone (iPhone, Android phone) to divide information into small units and display the information of individual units while switching screens.

To this end, the Android platform, one of the systems adopted by smartphones, adopts the concept of activity. The iPhone, one of the other smart platforms, uses the same concept, except for terminology. Activity refers to the basic unit process for displaying a screen on the Android platform. A similar concept is 'task'. However, when providing additional information based on activity switching or screen switching while watching a video, the efficiency of the service is generally lowered by lowering the concentration of viewers.

1 illustrates an example of capturing a displayed screen when providing video information in a smartphone.

The main screen of the English lecture video is shown in [Figure 1]. The animation shown in FIG. 1 captures a scene of a 'Tarzan' video. As shown in FIG. 1, a user must watch a separate English textbook while watching a video using a mobile terminal. In a PC environment, the text of the English textbook was displayed on the right or the bottom by splitting the screen, but in a mobile terminal environment including a smartphone, the video becomes too small, and the text of the English textbook is hard to see. Therefore, when a user watches a video and needs information, the user must move to another screen to find the content. An example of moving to another screen as described above will be described with reference to FIG. 2.

2 is a diagram illustrating a screen of switching activities using a display device of a smartphone.

Each reference numeral added to FIG. 2 will be described. Reference numeral 100 is a part indicating the function of the terminal in the mobile terminal. For example, it is an area for displaying basic information indicating the current time, remaining battery power, signal strength from a base station, a mode such as vibration / bell, and the like. The other part displays additional information corresponding to the video.

Reference numeral 101 denotes a selected foreign language and a meaning thereof, reference 102 denotes an area for displaying a dialogue of a foreign language, reference 103 denotes a translated content of an dialogue, and reference numeral 104 denotes a mobile terminal. This is an area for searching for a meaning or meaning of a foreign language or explaining a method of operating a mobile terminal. In addition, the lower portion of the automatic translation 105 is an area set to automatically translate the currently displayed subtitles or dialogue, and the video play (Play Viedo) 106 is an area for executing the video again, The area of the description view 107 is an area configured to view additional descriptions.

As described above, when the software is configured in an activity method using a smartphone or an Android phone, the screen for viewing additional information of a video as illustrated in FIG. Falls too

Therefore, the present invention intends to configure a technology for providing additional information of a video in an on-screen method instead of a conventional screen switching method in a mobile terminal including a smart phone or a smart pad. The term "on screen" or "layer screen" used in the present invention is a similar concept, and means a method of displaying another screen on one display screen. In the following description, the concepts of on screen and layer screen are collectively referred to as 'on screen'. In addition, the method for the on-screen will be described in more detail with reference to the accompanying drawings.

3 is a block diagram illustrating an internal functional block of a smartphone terminal as a mobile terminal according to an embodiment of the present invention.

The radio unit 301 converts a baseband signal to be transmitted into a radioband signal to transmit a signal to a base station for communication between the mobile terminal and the base station, and amplifies and outputs the signal through an antenna. In addition, when the wireless unit 301 receives a signal from the base station through the antenna band-down conversion of the received signal and outputs.

The modem unit 303 modulates and outputs data to be transmitted, and demodulates and outputs the received data. In this case, when the received signal is a voice signal, audio demodulation is performed, and the audio demodulated signal is provided to a speaker SPK. On the other hand, in the case of a data signal, the received data is provided to the controller 305. In addition, when the signal to be transmitted is a voice signal, the electrical voice signal received from the microphone (MIC) is voice-modulated and provided to the wireless unit 301. When transmitting a data signal, the wireless unit 301 is modulated according to the data format. To provide.

The controller 305 controls not only basic communication of the mobile terminal (smartphone) but also various operations according to the on-screen or layer screen of the video according to the present invention. The controller 305 performs an operation according to the on-screen or layer screen according to the present invention using the data stored in the memory 307. A detailed operation thereof will be described in more detail with reference to a control flowchart to be described below and the accompanying drawings.

The touch sensing unit 309 detects and provides the user's touch information to the controller 305 so that the user can input desired data in place of the keypad input in the touch screen-enabled mobile terminal. The keypad 311 obtains information on a key value input by the user, and provides it to the controller 305.

The memory 307 stores various application information to be driven by the controller 110, and stores an application for providing video information by applying an on-screen or layer screen according to the present invention. In addition, the memory 307 may further include an area for storing video information and additional information to be provided together with the video information. If the memory 307 does not have an area for storing moving picture information and additional information, the mobile terminal further includes an external memory connection unit (not shown) to obtain such information from an external memory.

Generally, only one of the keypad 311 and the touch sensing unit 309 may be employed in the mobile terminal, and both may be employed. However, in the present invention, it is assumed that both are employed. .

The display unit 313 is composed of a liquid crystal display panel (LCD) and the like, and is a part for providing visual information to the user. The display unit 313 may visually provide various information to the user under the control of the controller 305. In addition, when the touch sensing unit 309 is adopted, the display unit 313 may display information for touch together. In addition, the display unit 313 may support an on-screen or layer screen according to the present invention.

4 is a conceptual diagram illustrating an on-screen according to an embodiment of the present invention.

4 shows three layers (layers). The first layer 410 is a rare layer on which a video is displayed. If necessary, the second layer 420 and the third layer 430 may be displayed together. In this case, transparency of the second layer 420 and the third layer 430 may be adjusted as necessary. That is, the first layer 410 may be adjusted to be visible or to some extent. If necessary, only the first layer 410 and the second layer 420 may be displayed, or the third layer 430 may be displayed together. You can also have more rare. Such a layer structure can be arrange | positioned suitably as needed. In addition, each rare layer may be arbitrarily adjusted by the user.

In addition, as shown in FIG. 4, one layer may have a size corresponding to the entire display screen. Alternatively, the layer may be configured to have a limited size in a specific position and a specific area. For example, the second layer may correspond to half of the screen, may be located on the right side, and the third layer may correspond to half of the screen, and may be positioned on the left side. In this case, it may be understood that a single layer is divided into two, or two layers or three layers may constitute one screen. This example will be described further with reference to the drawings described below.

5 is a control flowchart when additional information is displayed by an on-screen method while a moving image is displayed according to an exemplary embodiment of the present invention.

The controller 305 displays the mark of the subscreen while playing the video at step S500. Displaying the marks of the sub-screen while playing the video can be displayed in one layer as shown in Fig. 4 described above. This will be described with reference to the attached [Fig. 6].

FIG. 6 is a diagram illustrating an auxiliary screen mark and a playing time in a video in which a display screen of a mobile terminal is displayed on-screen.

As shown in FIG. 6, the selection area 600 for displaying the sub screen is a part for displaying the sub screen when the user inputs a touch or a key for selecting a corresponding area. Also, the play time region 602 of the video is an area for displaying the time at which the video information is being played.

Referring to FIG. 5 again, while playing a video as shown in FIG. 6, the controller 305 proceeds to step S502 to generate an internal structure for displaying sub-screens on the screen. In this case, the subscreens may be composed of one subscreen, or may be composed of a plurality of subscreens. Hereinafter, it will be described on the assumption that it is composed of a plurality of sub-screens more than the description. First, the sub screens will be divided into 'first sub screen', 'second sub screen', and 'third sub screen' for convenience of explanation.

Using the generated auxiliary screens, the control unit 305 according to the present invention displays the sub-screen mark and the first sub-screen together with the video on the screen in step S504.

This will be described with reference to FIG. 4 described above.

First, the first sub screen may be a screen displayed on the second layer 420 described in FIG. 4, and the first layer 410 may be a main screen on which a video (eg, an English learning video) is displayed. have. Accordingly, the first sub screen may be displayed in an on-screen form on the main screen, and contents related to a video may be provided on the screen in a list format. As such, when displayed on the screen in a list format, a list of all video contents is displayed together with the video, so that it is easy to grasp the entire contents of the video. In addition, the video may be moved by touching a corresponding list or by inputting a key corresponding to the corresponding list. In addition, in synchronization with the play time of the video main screen, the main screen may be automatically synchronized and displayed. Thus, the form in which the first sub picture is provided will be described with reference to FIG. 7.

7 is an exemplary diagram in which a main screen and a first sub screen are provided in an on-screen form when playing a video on a mobile terminal according to the present invention.

Reference numeral 700 and reference numeral 702 are set in the same manner as the example of FIG. 6 described above. That is, it is an area for selecting an auxiliary screen and an area for displaying a playing time of a video. In addition, the first sub-screen according to the present invention is configured to be located on the right side of the main screen. On the right side of the video, there is a learning material corresponding to the playing time of the video along with the playing time of the video. Such learning material information may be individually associated with the second sub-screen. FIG. 7 illustrates the data 720 of the first subscreen selected to be linked to the second subscreen and the data 710 of the first subscreen not selected to be linked to the second subscreen.

First, data of the first sub-screen is displayed while changing with the progress of the main screen. At this time, the data of the first sub-screen is displayed together with time information of the video provided on the main screen and information that can be associated with the second sub-screen (indicated by '>>' in the drawing). The data of the first sub picture may be a subtitle file such as an SMI extension file, a SUB extension file, an SRT extension file, or the like, which is generally used as a moving image subtitle data format file. The controller 305 analyzes the files and stores the video information, the video time information, the data of the first subscreen, the second subscreen data, and the subtitle type together.

As such, while displaying the video and the first subscreen together, the controller 305 checks whether a specific phrase of the first subscreen is selected in step S506. If a specific phrase of the sub-screen is selected in operation S506, the controller 305 proceeds to operation S508 and displays the second sub-screen in an on-screen format.

The controller 305 proceeds to step S508 and looks at the case where the second sub-screen is displayed in the on-screen form with reference to FIG. 8.

8 is an exemplary diagram in which a main screen, a first sub screen, and a second sub screen are provided in an on-screen form when playing a video on a mobile terminal according to the present invention.

The phrase 800 selected on the first sub-screen may be displayed in a different color to indicate that the corresponding data is selected. Alternatively, you can make the text bold. This can increase visibility and intuition. However, if unnecessary in the user's setting or program process, it may not be separately indicated.

In addition, the second sub-screen may additionally display additional information on the phrase selected by the user on the screen providing the video. That is, this may be the third layer 430 described with reference to FIG. 4. The content displayed on the third layer 430 may basically display the selected data and additional information corresponding to the selected data. That is, the selected data is displayed to have a certain transparency on the main screen using the third layer 430 as shown by reference numeral 820. In addition, additional information corresponding to the selected data may be indicated by reference numeral 822. Additional information may also be displayed to have a certain transparency on the main screen by using the third layer 430.

In addition, a category, that is, a description view 810, lecture information 812, and a video lecture 814, may further include an area for selecting another category.

The second sub-screen may be composed of HTML, video, picture, and text data (HTML, Text, Graphic, Video) capable of displaying various multimedia information as data to be displayed in association with the main screen and the content of the first sub-screen. . In addition, in the examples of FIGS. 7 and 8, the first subscreen and the second subscreen may be divided into different areas on the main screen, or the first subscreen and the second subscreen may be divided into two types. As shown in FIG. 4, each layer predetermined portion may be included together by configuring three layers so that the layer is set to be transparent. In addition, if necessary, the transparency of the first sub-screen and the second sub-screen may be configured so that a user may change it arbitrarily.

This will be described again with reference to FIG. 5. After displaying the second sub screen in the on-screen format, the controller 305 proceeds to step S510 to check whether a predetermined time has elapsed or there is a removal touch. Here, the predetermined time is a time set for removing the second sub-screen from the state displayed on the main screen, and may be set in advance for the convenience of the user or at the time of producing the program. In addition, when the touch is a touch screen type mobile terminal, a touch for removing the second sub-screen is made. When the touch screen is used, a key pad for removing may be input.

The controller 305 removes the second sub-screen again when a predetermined time elapses or when there is a touch for removing the second sub-screen or a key input for removing the second sub-screen. Proceed to step S504.

On the other hand, if the predetermined time has not elapsed, the controller 305 proceeds to step S512 to check whether the third sub-screen is selected.

Subsequently, the controller 305 proceeds to step S514 when the sub screen is selected based on the result of the check in step S512. Otherwise, the controller 305 continues to perform step S508.

When the controller 305 proceeds to step S514, the controller 305 displays data of the third sub-screen associated with the second sub-screen in an on-screen format. As such, the third subscreen may be configured with another layer not described in FIG. 4. That is, the third sub screen may be configured through the fourth layer. In contrast, the third sub-screen may be configured as a separate screen without being displayed on the screen where the video is played.

In the present invention, it will be described on the assumption that the third sub-screen is composed of the fourth layer, and this will be described with reference to the attached [Fig. 9].

9 is an exemplary diagram in which a third sub-screen is provided in an on-screen form together with a main screen when playing a video on a mobile terminal according to the present invention.

As shown in FIG. 9, the data 900 selected on the first sub-screen is preferably displayed in a color-changed form, and the description view 910 and the lecture information (the categories provided on the second sub-screen) are provided. 912 and video lectures 914 are included. Also included is an area 920 for re-displaying the data selected on the first subscreen provided on the second subscreen. On top of this, various additional functions provided by the third sub-screen may be additionally displayed. In other words, the user can perform a desired search through a search site of the web as needed, and can be configured to review the search result along with a video.

In this way, while displaying the data of the third sub-screen in the on-screen format, the controller 305 proceeds to step S516 to check whether a predetermined time has elapsed or if there is a touch for removing the third sub-screen. If the predetermined time elapses or if there is a touch for removal, the controller 305 removes the third sub-screen and proceeds to step S504. In this case, the second sub screen and the third sub screen may be removed together.

Alternatively, when the removal time of the third subscreen elapses, only the third subscreen is removed, and the second subscreen is not removed, and the second subscreen is removed only when a predetermined time elapses or when the remove touch exists. You may. This part may be configured by the designer to selectively design the program or set by the user at convenience. Therefore, if only the third sub-screen is configured to be removed, it may be proceeded to step (S508) if the removal is necessary in the inspection of step (S516).

The above description is merely illustrative of the technical idea of the present invention, and those skilled in the art may make various modifications and changes without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present invention.

301: wireless unit
303: modem unit
305: control unit
307: memory
309: touch detection unit
311: keypad
313: display unit

Claims (6)

As a method for displaying a video and additional information on the screen together in a mobile terminal,
Playing a video on a full screen screen of the mobile terminal;
Displaying an auxiliary screen mark for displaying additional information corresponding to the played video;
Generating an internal structure for displaying information on the sub screen in an on-screen form on the video;
While the video is playing, a first sub screen for displaying additional information corresponding to the video being played is formed in response to a manipulation input to the sub screen mark, and the first sub screen is displayed on a preset one region of the played video full screen screen. Overlaying and displaying the first sub-screen on the screen;
Method for providing additional information on the screen of the video in a mobile terminal comprising a.
The method according to claim 1,
While displaying the first sub-screen, when a specific data is selected from the first sub-information displayed on the first sub-screen, a second sub-screen for displaying the second sub-information corresponding to the selected data is formed; Displaying an on-screen form and overlaying the remaining area that is not allocated to the first sub-screen among the full-screen screen of the played video;
Method for providing additional information on the screen of the video in a mobile terminal further comprising.
The method according to claim 1 or 2,
The first sub-screen is subtitle information of a video, the second additional information is commentary information of the first sub-screen, and the third additional information provides additional information related to data selected from the second sub-screen. Method for providing additional information on the screen of the video in a mobile terminal characterized in that the screen for.
Means for playing a video on a full screen screen of the mobile terminal;
Means for displaying an auxiliary screen mark for displaying additional information about the video together with the reproduced video;
Means for generating an internal structure for the mobile terminal to display information on the sub-screen on the video in an on-screen form;
While the video is playing, a first sub-screen for displaying additional information corresponding to the video being played is formed in response to an operation input to the sub-screen mark, and the preset screen of the full-screen screen of the video being played. Means for overlaying and displaying the area on-screen;
A computer-readable recording medium having recorded thereon a program.
The method of claim 4,
While displaying the first sub-screen, when a specific data is selected from the first sub-information displayed on the first sub-screen, a second sub-screen for displaying the second sub-information corresponding to the selected data is formed; And means for overlaying on the screen form of the full screen screen of the reproduced video, which is not allocated to the first sub-screen, and displayed on the screen;
A computer-readable recording medium having recorded thereon the program further comprising.
The method according to claim 4 or 5,
Means for displaying the entire contents of the video being played in the list subtitle which is the first sub-screen while the video is being played;
A computer-readable recording medium having recorded thereon the program further comprising.

Images