KR102319462B1 - Method for controlling playback of media contents and electronic device performing the same - Google Patents

Abstract

The present invention relates to a media content playback control method and an electronic device for performing the same, and more particularly, to a content playback method for playing back content in a moving picture or slide show format, and an electronic device performing the same. According to an aspect of the present invention, the method comprising: obtaining content including image data; obtaining event information regarding event points matched on a timeline of the content; Playing the content in any one of a video mode in which the content is reproduced as a moving image and a slide show mode in which a main scene of the content is sequentially displayed as a still image, wherein the main scene corresponds to the time of the event image to be; changing the play mode to the slide show mode when a first input of a first type is received while performing the video mode, wherein when entering the slide show mode from the video mode, a playback time is displayed on the timeline setting a first event time point adjacent to a reproduction time point when the first input is received, and displaying a main scene corresponding to the first event time point; and maintaining the play mode as the slide show mode and moving a play time point when the second input of the first type is received while performing the slide show mode, wherein when the second input is received on the timeline A method for controlling media content playback may be provided, comprising: moving the playback timing to a second event timing adjacent to the playback timing of , and displaying a main scene corresponding to the second event timing.

Description

MEDIA CONTENTS PLAYBACK CONTROL METHOD AND ELECTRONIC DEVICE FOR PERFORMING THE SAME

The present invention relates to a media content playback control method and an electronic device for performing the same, and more particularly, to a media content playback control method for reproducing content in a moving picture or slide show format, and an electronic device performing the same.

Today, with the development of communication technology and image processing technology, the use of multimedia contents is becoming a daily routine. Along with this trend, there is also a frequent demand for an intelligent user interface that allows viewers of various multimedia contents to select and view a desired scene of multimedia contents.

Users want to enjoy multimedia content from the point of time they want to watch, excluding advertisements included in the multimedia content, the part they have already watched, or the part they are not interested in. Because it was physically impossible, the user had to directly check and access the desired part using fast-forward, etc. Recently, due to the digital technology of multimedia content, it has become possible to directly access a desired playback point with high accuracy.

However, the FF/FR (Fast Forward/Fast Rewind) function used for high-speed navigation of these digital contents requires a lot of user input to move to the exact location desired by the user, and the user continues to Therefore, there is a problem in that the existing search method is not suitable not only to watch the playback of the media, but also when the user wants to quickly enjoy while skipping only the main scenes of the multimedia.

An object of the present invention is to provide a media content playback control method for selecting a main scene of content reproduced as a moving picture and playing it as a slide show, and an electronic device for performing the same.

The problem to be solved by the present invention is not limited to the above-mentioned problems, and the problems not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the present specification and the accompanying drawings. .

According to an aspect of the present invention, the method comprising: obtaining content including image data; obtaining event information regarding event points matched on a timeline of the content; Playing the content in any one of a video mode in which the content is reproduced as a moving image and a slide show mode in which a main scene of the content is sequentially displayed as a still image, wherein the main scene corresponds to the time of the event image to be; changing the play mode to the slide show mode when a first input of a first type is received while performing the video mode, wherein a playback time point when entering the slide show mode from the video mode is set on the timeline setting a first event time point adjacent to a reproduction time point when the first input is received, and displaying a main scene corresponding to the first event time point; and maintaining the play mode in the slide show mode and moving a play time point when the second input of the first type is received while performing the slide show mode, wherein when the second input is received on the timeline A method for controlling media content playback may be provided, comprising: moving the playback timing to a second event timing adjacent to the playback timing of , and displaying a main scene corresponding to the second event timing.

Solutions of the present invention are not limited to the above-described solutions, and solutions not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the present specification and the accompanying drawings. will be able

According to the present invention, by providing a slide show method in which main scenes are sequentially displayed as still images in addition to being reproduced as moving images for content that can be reproduced as moving images, the entire content can be viewed in a short time focusing on main scenes.

The effects of the present invention are not limited to the above-mentioned effects, and the effects not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the present specification and the accompanying drawings.

1 is a block diagram of an electronic device according to an embodiment of the present invention.
2 is a diagram showing the structure of a subtitle file according to an embodiment of the present invention.
3 is a diagram showing the contents of a subtitle file according to an embodiment of the present invention.
4 is a diagram illustrating an example of selection of a main scene according to an embodiment of the present invention.
5 is a diagram related to another example of selection of a main scene according to an embodiment of the present invention.
6 is a diagram related to another example of selection of a main scene according to an embodiment of the present invention.
7 is a diagram related to a slide movement according to an embodiment of the present invention.
8 is a diagram related to bookmark movement according to an embodiment of the present invention.
9 is a diagram illustrating entry into a slide mode according to an embodiment of the present invention.
10 is a diagram of a basic screen of a media content playback control method according to an embodiment of the present invention.
11 is a diagram of a user input for mode conversion according to an embodiment of the present invention.
12 is a diagram illustrating changes in subtitle properties in a slide show mode according to an embodiment of the present invention.
13 is a diagram illustrating a visual effect of a slide movement in a slide show mode according to an embodiment of the present invention.
14 is a diagram for omission of a slide icon in a slide show mode according to an embodiment of the present invention.
15 is a diagram for setting a bookmark in a slide show mode according to an embodiment of the present invention.
16 is a diagram related to a touch input for moving a bookmark according to an embodiment of the present invention.
17 is a display of a bookmark list according to an embodiment of the present invention.
18 is a diagram of a subtitle event browser according to an embodiment of the present invention.

The embodiments described in this specification are for clearly explaining the spirit of the present invention to those of ordinary skill in the art to which the present invention belongs, so the present invention is not limited by the embodiments described in this specification, and the present invention It should be construed as including modifications or variations that do not depart from the spirit of the present invention.

The terms used in the present specification are selected as widely used general terms as possible in consideration of the functions in the present invention, but they may vary depending on the intention, custom, or emergence of new technology of those of ordinary skill in the art to which the present invention belongs. can However, if a specific term is defined and used with an arbitrary meaning, the meaning of the term will be separately described. Therefore, the terms used in this specification should be interpreted based on the actual meaning of the terms and the contents of the entire specification, rather than the names of simple terms.

The drawings attached to this specification are for easy explanation of the present invention, and the shapes shown in the drawings may be exaggerated as necessary to help understand the present invention, so the present invention is not limited by the drawings.

In the present specification, when it is determined that a detailed description of a known configuration or function related to the present invention may obscure the gist of the present invention, a detailed description thereof will be omitted if necessary.

According to an aspect of the present invention, the method comprising: obtaining content including image data; obtaining event information regarding event points matched on a timeline of the content; Playing the content in any one of a video mode in which the content is reproduced as a moving image and a slide show mode in which a main scene of the content is sequentially displayed as a still image, wherein the main scene corresponds to the time of the event image to be; changing the play mode to the slide show mode when a first input of a first type is received while performing the video mode, wherein a playback time point when entering the slide show mode from the video mode is set on the timeline setting a first event time point adjacent to a reproduction time point when the first input is received, and displaying a main scene corresponding to the first event time point; and maintaining the play mode in the slide show mode and moving a play time point when the second input of the first type is received while performing the slide show mode, wherein when the second input is received on the timeline A method for controlling media content playback may be provided, comprising: moving the playback timing to a second event timing adjacent to the playback timing of , and displaying a main scene corresponding to the second event timing.

changing the playback mode to the video mode when a third input of the second type is received while performing the slide show mode, wherein a playback time point when entering the video mode from the slide show mode is set on the timeline The method may further include: setting a point in time earlier by a predetermined time interval from a playback point in time when the third input is received and playing the video from the previous point in time.

Displaying the first object and the second object on the left and right sides of the display screen, respectively; further comprising, wherein the first type user input includes a user input for selecting the first object or the second object can do.

When the first object is selected, an event time before the previous playback time is selected as the first event time on the timeline, and when the second object is selected, an event time after the previous playback time is selected on the timeline The first event time may be selected.

In the displaying, the first object and the second object may be displayed when a second type of user input is received in the video mode or when the slide show mode is entered.

In the displaying, the first object may not be deactivated or displayed when the current playback time is after the first event time, and the second object may be deactivated or not displayed if the current playback time is after the last event time.

The first type of input may be an input of dragging from a first point on the display screen to a second point having a different horizontal coordinate from the first point.

According to the drag direction, it is possible to determine whether a playback time point when entering the slide show mode is a previous event time or a subsequent event time among event times adjacent to the reproduction time when the first input is received.

The first point may be within a predetermined area of the display screen.

The predetermined area may be a caption display area.

The event information is caption information further including caption text to be output at the time of the event, and when the main scene is displayed in the slide show mode, the caption text of the event point corresponding to the main scene may be output together. .

In the slide show mode and the video mode, display properties of the subtitles may be set to be different from each other.

The event time may be set as the display time point of the subtitle, and a plurality of event time points may be set for the display time and the addition time for a specific subtitle having a subtitle length equal to or greater than a predetermined length.

The addition time may be a time after a predetermined time interval from the display time, or may be a time point at which the entire display time of the specific subtitle is divided into a plurality of pieces.

The display timing of the subtitles may be set as the event timing, but when the subtitle length between adjacent subtitles is less than or equal to a predetermined length, only the display timing of the preceding subtitle among the adjacent subtitles may be set as the event timing.

The event information is caption information, and the caption information includes information about caption text, and the caption text may be a character string or a blank.

The image data may include moving image data and image data for the main scene.

The image data may be moving image data, and the main scene may be a still image extracted from the moving image data.

In the acquiring of the content, image data for outputting the main scene may be acquired before image data for playing the content as a moving picture.

Among the image data for outputting the main scene, image data for a main scene adjacent to a current playback time may be acquired first.

Hereinafter, an electronic device 1000 according to an embodiment of the present invention will be described with reference to FIG. 1 .

1 is a block diagram of an electronic device 1000 according to an embodiment of the present invention. Referring to FIG. 1 , an electronic device 1000 according to an embodiment of the present invention may include an input unit 1100 , an output unit 1200 , a communication unit 1300 , a memory 1400 , and a controller 1500 . . Hereinafter, each component of the electronic device 1000 will be described.

The input unit 1100 may receive a user input from a user. The user input may be made in various forms, including a key input, a touch input, and a voice sound. Examples of the input unit 1100 that can receive such a user input include a traditional keypad, keyboard, and mouse, as well as a touch sensor that detects a user's touch, a microphone that receives a voice signal, and a gesture that recognizes a gesture through image recognition. A proximity sensor consisting of a camera, an illuminance sensor or infrared sensor that detects user approach, a motion sensor that recognizes a user's motion through an acceleration sensor or a gyro sensor, etc. It is a comprehensive concept that includes all input means. Here, the touch sensor may be implemented as a piezoelectric or capacitive touch sensor for detecting a touch through a touch panel or a touch film attached to the display panel, an optical touch sensor for detecting a touch by an optical method, and the like.

In addition, the input unit 1100 may be implemented in the form of an input interface (USB port, PS/2 port, etc.) that connects an external input device that receives a user input to the electronic device 1000 instead of a device that detects a user input by itself. may be

The output unit 1200 may output various information and provide it to the user. The output unit 1200 is a comprehensive concept including a display for outputting an image, a speaker for outputting sound, a haptic device for generating vibration, and other various types of output means. In addition, the output unit 1200 may be implemented in the form of a port-type output interface for connecting the above-described individual output means to the electronic device 1000 .

Here, as an example, the display may display text, a still image, or a video. The display includes a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, a flat panel display (FPD), and a transparent display. display), a curved display, a flexible display, a 3D display, a holographic display, a projector, and various types of devices capable of performing other image output functions. It is a concept meaning an image display device in a broad sense that includes all. Such a display may be in the form of a touch display integrated with the touch sensor of the input unit 1100 .

The communication unit 1300 may communicate with an external device. Accordingly, the electronic device 1000 may transmit/receive various types of information to and from an external device. Here, communication, that is, transmission and reception of data may be performed by wire or wirelessly. To this end, the communication unit 1300 includes a wired communication module that accesses the Internet through a local area network (LAN), a mobile communication module that accesses a mobile communication network through a mobile communication base station and transmits and receives data, and a WLAN such as Wi-Fi. (Wireless Local Area Network)-based communication method, short-distance communication module using WPAN (Wireless Personal Area Network) communication method such as Bluetooth and Zigbee, GNSS (Global Positioning System) such as GPS Navigation Satellite System) using a satellite communication module or a combination thereof.

The memory 1400 may store various types of information. The memory 1400 may temporarily or semi-permanently store data. Examples of the memory 1400 include a hard disk (HDD), a solid state drive (SSD), a flash memory (1400, flash memory), a read-only memory (ROM), and a random access memory (RAM). ), and so on. The memory 1400 may be provided in a form embedded in the electronic device 1000 or in a form detachable from the electronic device 1000 .

In the memory 1400 , an operating system (OS) for driving the electronic device 1000, content is reproduced as a moving picture or a slide show method according to a media content playback control method according to an embodiment of the present invention, which will be described later. Various data necessary or used to drive the electronic device 1000, such as an application program for displaying as , may be stored.

The controller 1500 controls the overall operation of the electronic device 1000 . To this end, the controller 1500 may perform calculation and processing of various types of information and may control operations of components of the electronic device 1000 .

The controller 1500 may be implemented as a computer or a similar device according to hardware software or a combination thereof. In hardware, the controller 1500 may be provided in the form of an electronic circuit that processes electrical signals to perform a control function, and in software, it may be provided in the form of a program for driving the controller 1500 in hardware.

Meanwhile, in the following description, unless otherwise specified, the operation of the electronic device 1000 may be interpreted as being performed under the control of the controller 1500 .

In the electronic device 1000 described above, the electronic device 1000 may retrieve content and reproduce it. Here, the content is multimedia content, and may be, for example, a video file encoded according to various MPEG or other various video codecs.

The electronic device 1000 may reproduce content according to two modes: a video mode in which such content is reproduced as a video and a slide show mode in which main scenes of the video are displayed as still images in a slide show manner. In addition, the electronic device 1000 may display the subtitles together with the image by referring to the subtitle file when the content is reproduced in the video mode or the slide show mode.

Hereinafter, a method of selecting a main scene for the slide show mode will be described.

In the present invention, the electronic device 1000 may select a main scene from content using a subtitle file. Before a detailed description of a method for selecting a main scene using a subtitle file, the structure of the subtitle file will be briefly described. decide to do

2 is a diagram showing the structure of a subtitle file according to an embodiment of the present invention, and FIG. 3 is a diagram showing contents of a subtitle file according to an embodiment of the present invention. Referring to FIG. 2 , the subtitle file may include a header and a body.

The header may include various information necessary for subtitle reproduction or other additional information. The information required to reproduce the subtitles may include the font type, size, style, color, and display position of the subtitle, and the additional information may include the title of the content, information on the subtitle maker, and the date of production. In FIG. 3 , it can be seen that various information and additional information required for the above-described subtitle reproduction are described between “[HEADER]” and “[EVENT]”.

The body may consist of a start field, an event field, and an end field. The start field and the end field indicate the start and end of the event field, respectively, and the event field contains information about a subtitle event during content reproduction. Here, the subtitle event refers to an event in which a subtitle is displayed when a video of content is reproduced.

Specifically, the event field may include bookmark check information, start time information, end time information, and text information. First, the text information relates to the subtitle text to be displayed, and generally takes the form of a character string. The start time information and the end time information refer to the time at which the subtitle is displayed. In other words, the character string of the subtitle text may be displayed from the start time to the end time. The bookmark check information is an identifier regarding whether the corresponding subtitle event is bookmarked. For example, according to the subtitle file of FIG. 3 , “Hello?” is displayed as a subtitle between “0:02:40.65” and “0:02:41.79” on the timeline of the content. Also, in the subtitle event section corresponding to “How much is these shoes?”, it can be seen that “MARKED” is written to indicate that the subtitle event is bookmarked.

Meanwhile, in some cases, there may be no text information in the event field or the text information may take a blank form without containing a character string. In this case, the corresponding subtitle event is a dummy event that does not have a subtitle display function. For example, since there is no text information in the subtitle event portion corresponding to “0:55:12.00” to “0:55:13.00” of FIG. 3 , this may correspond to a dummy subtitle event.

By using the above-described subtitle file, it is possible to select a main scene from the contents.

4 is a diagram illustrating an example of selection of a main scene according to an embodiment of the present invention. According to an example, as shown in FIG. 4 , as a main scene, a still image of a viewpoint corresponding to a subtitle event on a timeline of content may be selected. The electronic device 1000 may read information on the start time of the subtitle event from the subtitle file, and select a still image of a viewpoint corresponding to the start time of the subtitle event as a main scene on a timeline when the content is reproduced as a moving picture.

Meanwhile, in the above description, the still image corresponding to the start time of the subtitle event is selected as the main scene, but the main scene is not necessarily selected according to the start time. For example, in some cases, a still image corresponding to a time earlier or later by a predetermined time interval from the start time of the subtitle event is selected as the main scene, or a still image corresponding to the end time of the subtitle event is selected as the main scene. You can also select In particular, in general, since the start time of a subtitle event can be set a little earlier or later than the audio sync of the video corresponding to the subtitle, it is effective to pull or delay the viewpoint of the main scene by a certain time interval from the start of the last event. there may be

Meanwhile, in the above description, it has been described that the main scenes are selected in a one-to-one correspondence with each subtitle event. On the other hand, it is possible that fewer or more main scenes are selected than the subtitle events.

For example, one main scene may be selected for a plurality of subtitle events. For example, when subtitle events are densely located in time, that is, when subtitles are continuously displayed in a short time, instead of selecting a main scene for each subtitle event, one main scene for densely continuous subtitles It is possible to select Here, the closed caption events may be temporally densely located when there are a plurality of caption events within a predetermined time interval, or when a start time of a previous caption event and an end time of a subsequent caption event are the same.

5 is a diagram related to another example of selection of a main scene according to an embodiment of the present invention. FIG. 5 illustrates selection of one main scene for a plurality of subtitle events when subtitle events are densely present on the timeline. Specifically, for the subtitle events “#x1” and “#x2”, one main scene of “#x” is selected and the four subtitle events “#y1”, “#y2”, “#y3”, and “#y4” One main scene of “#y” can be selected for .

As another example, as opposed to selecting one main scene for a plurality of subtitle events, it is also possible to select a plurality of main scenes for one subtitle event. For example, if the length of the subtitle event, that is, the length from the start time to the end time of the subtitle event is longer than a predetermined time interval, several main scenes may be selected for the corresponding subtitle event. In this case, the main scene may be selected for each start time of the divided parts after dividing the entire length of the subtitle event into a predetermined number. Alternatively, the main scene may be selected according to the start time of the subtitle event and the time points that are later by a predetermined time interval from the start time.

6 is a diagram related to another example of selection of a main scene according to an embodiment of the present invention. 6, the main scene “#z1” is selected at the start time by dividing the long subtitle event “#z” into two on the timeline, and the main scene “#z2” is selected at the middle point between the start time and the end time. is shown to be selected.

On the other hand, it is also possible to select a main scene in consideration of the size of the text information of the subtitle event. For example, if the length of the character string included in the text information of the subtitle event is equal to or greater than a certain length, several main scenes may be selected for the corresponding subtitle event. For example, if one main scene is selected for every 30 characters, three main scenes may be selected for a subtitle event in which the character string is 80 characters. Conversely, if there are a plurality of subtitle events in which the length of the character string contained in the text information is equal to or less than a certain length, one main scene may be selected for them. For example, when five subtitle events having a character string length of four characters are consecutively arranged on the timeline, one main scene may be selected for these five subtitle events.

When the electronic device 1000 displays the selected main scene as described above, the electronic device 1000 may extract a still image of the main scene from the moving image and display it. Alternatively, the still image of the selected main scene is stored separately from the moving picture, and the electronic device 1000 may display the main scene by displaying the separately stored still image as a photo.

Hereinafter, a slide show mode in which the main scenes selected as described above are sequentially displayed as still images will be described.

In the slide show mode, main scenes may be sequentially displayed as still images in a slide show manner. Here, the slide show method may refer to a method in which a specific main scene is output as a still image, and in that state, a user input is received or automatically a next or previous main scene is output as a still image.

As described above, in the slide show mode, a slide movement function may be provided to sequentially output main scenes. 7 is a diagram related to a slide movement according to an embodiment of the present invention. Here, the slide movement means changing the still image from a specific main scene to the next or previous main scene. Referring to FIG. 7 , in the slide show mode, slide movement from a specific main scene to the next or previous main scene is shown. In such a slide show mode, movement between main scenes may be performed by referring to a subtitle file. Specifically, when a slide movement input is generated, the current playback time on the timeline is immediately from the subtitle file based on the playback time that was being played at that point on the timeline, for example, the start time of the subtitle file corresponding to the main scene. It is possible to perform a slide movement between main scenes by searching for a subtitle event immediately following or before and outputting a main scene corresponding to the retrieved subtitle event as a still image.

In addition, in the slide show mode, when the still image is output as described above, the subtitle text of the subtitle event corresponding to the corresponding main scene may be output together. If a plurality of subtitle events correspond to one main scene, when the main scene is output as a still image, the subtitle texts of the plurality of subtitle events may be displayed together on one screen. Conversely, when a plurality of main scenes correspond to one subtitle event, the subtitle text of the subtitle event may be divided and matched to each main scene.

In this way, the slide show mode allows the user to grasp the contents of the content in a short time while viewing the main scenes and subtitles without watching the entire video.

Meanwhile, in the slide show mode, instead of sequentially moving main scenes, a bookmark movement function may be provided in which the main scenes are moved while skipping between bookmarked scenes.

Here, the bookmarked main scene may be a main screen selected in response to the bookmarked subtitle event when the main scene is selected using the subtitle file.

Alternatively, in slide show mode, it is possible to set bookmarks for key scenes. Specifically, if a user input for setting a bookmark occurs while still images of a specific main scene are output in the slide show mode, the corresponding main scene may be set as a bookmarked main scene. In this way, when a user input for setting a bookmark occurs, information indicating that the caption event corresponding to the still image being output is a bookmark event may be recorded in the bookmark check field of the caption event.

It is also possible to set a bookmark at any point during playback in video mode. Specifically, when a user input for setting a bookmark occurs while content is being reproduced as a video, the video at the time of playback may be set as the main bookmarked video. In this way, when a bookmark is set at an arbitrary point in time, a caption event having the point in time as the starting point is generated in the caption file, and the caption event is recorded to reflect the bookmarked caption event in the bookmark check field. The text information of this caption event will be treated as blank (empty caption) or there will be no text information.

Meanwhile, when bookmarking, in addition to simply setting the bookmarked main scene, additional information on the bookmarked main scene may be generated. For example, when an input for setting a bookmark is received from the user, the electronic device 1000 may provide a text input window on the screen and receive a character string from the user. In this case, the input string may be stored as text information of a subtitle event corresponding to a main scene to be bookmarked. Accordingly, when displaying the bookmarked main scene thereafter, the character string input by the user in the form of a subtitle may be additionally displayed.

When bookmarks are set as described above, it is possible to move between bookmarks. 8 is a diagram related to bookmark movement according to an embodiment of the present invention. Referring to FIG. 8 , when an input requesting movement between bookmarked main scenes is generated, a bookmark immediately preceding or immediately following on the timeline from the subtitle file based on the current playback time that was being played at that time on the timeline The movement to the bookmarked main scene may be performed by searching for a closed caption event and outputting a main scene corresponding to the searched bookmarked caption event as a still image. Here, the search for whether the subtitle event is bookmarked may be performed by examining the bookmark check field of the subtitle event.

Hereinafter, the above-described mode switching between the slide show mode and the moving picture mode will be described.

In order to play the content in the slide show mode, the content may be played in the slide show mode from the beginning, but in some cases, it is also possible to convert the content playback mode to the slide show mode during playback in the video mode.

When playing in slide show mode from the beginning, the content is played by moving the slides by playing the still image from the most advanced main scene on the timeline among several main scenes. However, when an input requesting entry into the slide show mode is generated from the user during playback in the video mode, the playback mode is changed to the slide show mode.

As such, when the video mode is switched from the video mode to the slide show mode, a slide show is performed while outputting a still image of the main scene immediately following or immediately before the playback time on the timeline based on the playback time that was being played in the video mode as a still image. mode can be entered. 9 is a diagram illustrating entry into a slide mode according to an embodiment of the present invention. Referring to FIG. 9 , it can be seen that, when switching from the video mode to the slide show mode, the main scene immediately following or immediately before the playback point is reproduced as a still image on the timeline.

Hereinafter, various user interfaces used in the media content playback control method will be described.

Here, before examining various user interfaces in detail, a basic screen of a media content playback control method will be described first. The basic screen may be provided through the output unit 1200 of the electronic device 1000 .

10 is a diagram of a basic screen of a media content playback control method according to an embodiment of the present invention.

Referring to FIG. 10 , the basic screen may include a display window, a progressive bar, a control panel, a slide icon, and a bookmark icon.

A main scene may be displayed as a still image on the display window. Also, a caption area in which captions are displayed on a still image may be disposed on a part of the display window. Icons for various user inputs (video playback, playback stop, pause, rewind, forward, etc.) used in the video mode may be disposed on the control panel. In the progressive bar, a bar corresponding to the playback time of the entire video and an icon indicating the current playback time is positioned on the bar.

The slide icon may be disposed on the left and right of the display window. The slide icon relates to a user input for performing a slide movement in the slide show mode. Also, the bookmark icon relates to a user input for setting a bookmark.

Various operations may be performed in the media content playback control method through a user input or a touch input for selecting an icon provided on the basic screen.

First, the conversion from the video mode to the slide show mode may be performed as follows.

When a user input for selecting a slide icon is received from the user while content is being reproduced in the video mode, the electronic device 1000 may change the content playback mode from the video mode to the slide show mode. Specifically, when a user input for selecting the slide icon on the right is received, the slide show mode is entered while displaying the main scene immediately after on the timeline as a still image based on the time of playback in the video mode. When a user input for selecting a slide icon is received, a slide show mode is entered while displaying a previously existing main scene as a still image.

Alternatively, when a horizontal drag touch input is input in the video mode, the electronic device 1000 may convert the playback mode to the slide show mode. 11 is a diagram of a user input for mode conversion according to an embodiment of the present invention. The switching of the playback mode may be performed when a drag touch input is made within the caption area. Specifically, when the start point of the touch input is within the caption area, it may be determined that the drag touch input is within the caption area. Here, it may be determined whether to output the previous main scene as a still image or the next main scene as a still image from the playback time of the video when entering the slide show mode according to the horizontal movement direction of the drag touch input. . For example, as shown in FIG. 11 , when the direction of the touch input is made to the right, the next main scene on the timeline may be output from the playback time at the time of the touch input. Meanwhile, FIG. 11 also shows a slide movement by selecting a slide icon, so it will be referred to.

As described above, when entering the slide show mode from the video mode, some configurations of the basic screen may be changed. For example, in the slide show mode, subtitle properties may be different from those in the video mode. The subtitle attribute may mean the size, color, type of font, display position, and the like of the subtitle. 12 is a diagram illustrating changes in subtitle properties in a slide show mode according to an embodiment of the present invention. As an example, referring to FIGS. 11 and 12 , it can be seen that the subtitle size is increased while entering the slide show mode.

On the other hand, it is also possible to change the slide show mode to the video mode again. In this case, it is possible to play the video immediately from the playback point of the slide show, but unlike the slide show, it is possible to play the video from a point earlier by a predetermined time interval from the playback point of the slide show. It is also possible to play Accordingly, more natural video playback is possible.

The slide movement between key scenes within the slide show mode can be done in a similar way to switching modes. In other words, the slide movement may be performed by selecting the slide icon or by dragging touch in the horizontal direction.

In a slide movement between main scenes in such a slide show, a visual effect in which the screen is changed in a slide format may occur. 13 is a diagram illustrating a visual effect of a slide movement in a slide show mode according to an embodiment of the present invention. Referring to FIG. 13 , when a drag touch input is received in the slide show mode, the current main scene is moved in the direction of the drag touch in the display window, and the main scene to be displayed according to the slide movement is output in the remaining space. At this time, the degree of movement of the main scene is proportional to the length of the drag. In this state, when the moving distance of the main scene exceeds a predetermined distance, that is, when the end of the current main scene (the left end in FIG. 13) crosses the predetermined boundary line, the slide movement is performed. Conversely, if the distance of the drag touch input ends before the slide movement is made, the slide movement may not be performed.

If the slide movement is repeated in this way, as a result, the final main scene among several main scenes will be output. In this case, the main screen may inform that the current main scene is the last main scene. For example, when the final main scene is reached, the electronic device 1000 may omit the slide icon for moving to the next main scene from the basic screen. 14 is a diagram for omission of a slide icon in a slide show mode according to an embodiment of the present invention. In FIG. 14 , as a result of reaching the last main scene, it can be seen that the slide icon for moving to the next main scene is not displayed. Conversely, while the first main scene is being output, the slide icon for moving to the previous main scene may not be displayed.

Next, let's look at bookmark settings. 15 is a diagram for setting a bookmark in a slide show mode according to an embodiment of the present invention. According to FIG. 15 , when a user input for selecting a bookmark icon on the basic screen occurs, a bookmark may be set at the current playback time in the video mode or the slide show mode. When a bookmark is set in this way, the corresponding scene is set as a bookmarked main scene. Referring to FIG. 15 , it can be seen that a bookmark is set for a subtitle event for a corresponding main scene.

In addition, when setting a bookmark in this way, a character string input window for generating additional information may be provided. When a character string is inputted from the user in the corresponding window, the text may be displayed together with the corresponding subtitle. The text input as additional information may have different subtitle attributes from the original subtitle. On the other hand, when a bookmark is set in a position where there is no subtitle, a dummy subtitle event is generated.

The bookmark movement using the bookmark set in this way can be performed as follows. 16 is a diagram related to a touch input for moving a bookmark according to an embodiment of the present invention. The bookmark movement may be performed according to an input of a drag touch input in the horizontal direction. Here, it may be performed when a drag touch input is made within the caption area. However, the drag touch input may be moving a predetermined distance or more in the horizontal direction. In other words, the above-described slide movement and bookmark movement may be distinguished according to a drag distance. For example, when dragged to less than a predetermined distance, slide movement is once made, and if dragging is continued there again and dragged to more than a predetermined distance, bookmark movement may be performed. Whether the bookmark point to be moved is the previous bookmark or the subsequent bookmark may be set similarly to the slide movement according to the drag direction.

The electronic device 1000 may display a list of bookmarked main scenes. 17 is a display of a bookmark list according to an embodiment of the present invention. Referring to FIG. 17 , in the slide show mode, images of bookmarked main scenes may be listed and displayed. For example, when a drag touch input in a vertical direction (eg, from top to bottom) is input, the electronic device 1000 moves the display window downward according to the degree of dragging and lists the main images bookmarked in the remaining space above in chronological order. Up can be displayed.

In this state, if any one of the listed images is selected by the user, the playback time may be moved to the still image of the corresponding bookmarked main image and displayed.

On the other hand, when a drag touch in the horizontal direction occurs again while the bookmarks are displayed, the bookmark list-up may be released.

Also, the electronic device 1000 may provide a function of browsing all subtitle events. 18 is a diagram of a subtitle event browser according to an embodiment of the present invention. Referring to FIG. 18 , in the slide show mode, a subtitle event browser in which subtitle events are listed according to a user input may be displayed. A double touch may be used as a user input for this purpose. The subtitle event browser may include a start time, an end time, and text content for all subtitle events. Here, when a user input for selecting any one of the listed subtitle events occurs, the playback time may be moved to the viewpoint of the main image of the selected subtitle.

The slide show mode described above may be performed using the content pre-stored in the memory 1400 of the electronic device 1000, but in some cases, data related to the content is transmitted from an external device in a streaming manner. may be For example, data related to content is transmitted from an external device through the communication unit 1300 of the electronic device 1000 , and the electronic device 1000 may temporarily store the data in a buffer to play the content while reading the buffer.

Here, the electronic device 1000 may first receive a still image of a main scene to be displayed in the slide show mode. In general, in a video streaming service, image data for playing a video is sequentially received from a playback time point, but in the present invention, a still image of a main scene may be transmitted first. Since a still image of a main scene has a very small capacity compared to a moving picture, even when it is difficult to reproduce content as a moving image due to a low transmission speed, if the main scene is first transmitted, the electronic device 1000 may play the content in a slide show mode. Also, for this purpose, the electronic device 1000 may receive the subtitle file first.

In this case, when still images of a main scene are first acquired as described above, still images may be received in an order adjacent to the current playback time for smoother slide show progress.

Hereinafter, a method for controlling media content playback according to an embodiment of the present invention will be described.

First, the electronic device 1000 may acquire content. Specifically, the controller 1500 may read the content pre-stored from the memory 1400 or download and load the content from the outside through the communication unit 1300 . Here, the content may be image data. When loading content in a streaming method, still image data for a main scene can be downloaded prior to moving picture data. In this case, the main scenes can be downloaded in the order adjacent to the current playback time.

In addition, the electronic device 1000 may acquire event information regarding an event time. Here, the event is a concept including a dummy subtitle event having an empty subtitle as a subtitle event. In addition, the event time may be a start or end time of a subtitle event, and the event information may mean a subtitle file. The controller 1500 may read a subtitle file from an external device or read a subtitle file pre-stored in the memory 1400 .

The electronic device 1000 may reproduce content in a video mode. The controller 1500 may reproduce the content as a video by decoding the content using an appropriate video codec.

Also, the electronic device 1000 may reproduce content in a slide show mode. The electronic device 1000 may sequentially display main scenes corresponding to the event timing of the event information in a slide show manner. Here, the main scene may be displayed as a still image, and the still image may be extracted from a video of the content with respect to an event time point. Alternatively, the content may include still images of a main scene along with the moving picture. In this case, the content may be reproduced in a slide show manner by decoding the still image with a still image codec.

Mode switching is possible between movie mode and slide show mode. When the video mode is switched from the video mode to the slide show mode, the slide show mode is entered while outputting a main scene closest to the playback time in the video mode as a still image. Conversely, when entering the moving picture mode from the slide show mode, playback in the moving picture mode may be started at the playback time of the main scene or when the main scene is moved forward or backward by a predetermined time from the playback time.

Meanwhile, in the slide show mode, slide movement between main images is possible, which has been described in detail above.

The above description is merely illustrative of the technical spirit of the present invention, and various modifications and variations will be possible without departing from the essential characteristics of the present invention by those skilled in the art to which the present invention pertains. Accordingly, the embodiments of the present invention described above may be implemented separately or in combination with each other.

Therefore, the embodiments disclosed in the present invention are not intended to limit the technical spirit of the present invention, but to explain, and the scope of the technical spirit of the present invention is not limited by these embodiments. The protection scope of the present invention should be construed by the following claims, and all technical ideas within the equivalent range should be construed as being included in the scope of the present invention.

1000: electronic device
1100: input unit
1200: output
1300: communication department
1400: memory
1500: controller

Claims (20)

acquiring video content including a plurality of still images;
acquiring a plurality of text information matching on a timeline of the video content, wherein each of the plurality of text information includes a text and a start time, and the start time starts displaying the text on the timeline indicating a time point, wherein the plurality of still images include at least one main still image corresponding to the plurality of text information based on the timeline;
reproducing the video content together with the plurality of text information;
receiving a first input from a user at a first time point on the timeline while the video content is being played;
In response to receiving the first input, first text information including a start time immediately before the first time point on the timeline or second text including a start time immediately after the first time point on the timeline selecting one of the information;
selecting a first main still image corresponding to the selected text information in consideration of the selected text information; and
In response to the reception of the first input, instead of playing the video content, displaying the selected first main still image together with text included in the selected text information;
How to play video content.
According to claim 1,
wherein the at least one main still image is predetermined as still images matching the plurality of text information on the timeline among the plurality of still images.
How to play video content.

According to claim 1,
Displaying the first object and the second object on the left and right sides of the display screen, respectively; further comprising,
The first input includes a user input for selecting the first object or the second object
How to play video content.
4. The method of claim 3,
The step of selecting one of the first text information and the second text information comprises:
When the first object is selected at the first time point, the first text information is selected,
When the second object is selected at the first time point, the second text information is selected.
How to play video content.
According to claim 1,
The step of selecting one of the first text information and the second text information comprises:
Selecting text information having a start time closer to the first time point
How to play video content.
According to claim 1,
The step of selecting one of the first text information and the second text information comprises:
to select based on the type of the first input
How to play video content.
7. The method of claim 6,
The step of selecting one of the first text information and the second text information comprises:
When the first input is a drag input in the first direction, selecting the first text information,
selecting the second text information when the first input is a drag input in a second direction different from the first direction
How to play video content.
According to claim 1,
The first input is an input for dragging from a first point on the display screen to a second point having a different horizontal coordinate from the first point.
How to play video content.
According to claim 1,
The first main still image is a still image corresponding to a start time of the selected text information among the plurality of still images.
How to play video content.
According to claim 1,
The first main still image is a still image corresponding to a time after a predetermined time from the start time of the selected text information on the timeline.
How to play video content.
According to claim 1,
The first main still image is a still image corresponding to a time before a predetermined time from the start time of the selected text information on the timeline.
How to play video content.
According to claim 1,
receiving a second input from a user while displaying the first main still image together with the first text information when the first text information is selected;
selecting text information immediately after or immediately before the first text information in response to receiving the second input;
selecting a second main still image corresponding to the selected text information in consideration of the selected text information; and
Displaying the second main still image along with text included in text information corresponding to the second main still image on the timeline; further comprising
How to play video content.
According to claim 1,
receiving a second input from a user while displaying the first main still image together with the second text information when the second text information is selected;
selecting text information immediately after or immediately before the second text information in response to receiving the second input;
selecting a second main still image corresponding to the selected text information in consideration of the selected text information; and
Displaying the second main still image along with text included in text information corresponding to the second main still image on the timeline; further comprising
How to play video content.
According to claim 1,
receiving a third input from a user at a second time point on the timeline while the first main still image is displayed; and
reproducing the video content from the second viewpoint in response to receiving the third input; further comprising
How to play video content.
According to claim 1,
Each of the plurality of text information further includes an end time, wherein the end time indicates a time point at which display of the text on the timeline ends;
The step of selecting one of the first text information and the second text information comprises:
selecting the first text information when the first time point is between the start time and the end time of the first text information
How to play video content.
According to claim 1,
Each of the plurality of text information further includes an end time, wherein the end time indicates a time point at which display of the text on the timeline ends;
The step of selecting one of the first text information and the second text information comprises:
selecting the second text information when the first time point is between the end time of the first text information and the start time of the second text information
How to play video content.
delete delete delete delete

Images