KR20140016497A - Mobile terminal and method for controlling of the same - Google Patents

Abstract

A mobile terminal is disclosed. The mobile terminal recognizes one or more subjects from video content including one or more subjects and displays a subject progress bar independently controlling a frame including the recognized subject. The subject progress bar is controlled in a predetermined pattern so that the frame including the subject corresponding to the subject progress bar among the whole frames of the video content can be easily edited and stored. [Reference numerals] (AA) Start; (S110) Play video content; (S120) Display a first bar to control the playing of the video content; (S130) Stop the playing; (S140) Recognize at least one object; (S150) Display a second bar related to a frame including the recognized object

Description

TECHNICAL FIELD [0001] The present invention relates to a mobile terminal and a control method of the mobile terminal,

The present invention relates to a mobile terminal and a method for controlling the mobile terminal that provide a user interface for controlling playback of a video using an object included in the video.

BACKGROUND OF THE INVENTION As hardware and software technologies related to various electronic apparatuses including a mobile terminal have developed remarkably, electronic apparatuses can provide or store a wide variety of functions and information. Accordingly, various kinds of information are provided on the screen provided in the electronic device.

In addition, in the case of a mobile terminal having a touch screen, various information provided on the touch screen can be accessed only by a user's touch operation.

Recently, the electronic devices provide a function of easily playing and watching a video anytime and anywhere. However, in order to control a video while playing a video on a mobile terminal having a touch screen, it is common to operate while the corresponding menu or icon is displayed on the screen.

In particular, when only a specific frame is selected and enjoyed in the video, it is inconvenient to go through a process of directly searching for a desired frame in the entire video frame.

Accordingly, it is necessary to develop a user interface that can more intuitively control the video being played.

SUMMARY OF THE INVENTION An object of the present invention is to provide a mobile terminal and a method of controlling the mobile terminal capable of selecting and viewing a frame including a specific object through a more intuitive user interface in video content.

In particular, by recognizing a predetermined object in the video content, creating a progress bar or scroll bar unique to the recognized object, and using a simple user manipulation of the progress bar or scroll bar unique to the object, a frame containing the object desired by the user is created. It is to provide a mobile terminal and a mobile terminal that can be selectively provided.

In addition, according to an embodiment of the present invention, in a video content including at least one object, to provide a mobile terminal and a mobile terminal that can more easily edit the frame of the video content based on the recognized object will be.

According to an aspect of the present invention, there is provided a mobile terminal including: a touch screen displaying a playback screen of video content and a first bar for controlling playback of the video content; And stopping playback of the video content when an input for stopping playback of the video content is received, recognizing a specific object included in the screen where the playback is stopped, and including the specific object among all frames of the video content. And a controller configured to display a second bar associated with at least one frame on the touch screen.

The second bar may include a bar in which a plurality of frames including the specific object are grouped and indexed according to a playback order.

The first bar may include a progress icon indicating a current position in the video content.

The second bar may include a progress icon indicating that a frame including the specific object indicates a current position in the video content.

When the controller receives an input for moving the touch input to the progress icon of the second bar in a predetermined direction, the controller may display a frame corresponding to the position of the touch input on the touch screen.

The predetermined direction may move in a left and right direction along the second bar.

As the frame displayed on the touch screen is changed, the controller may change the position of the progress icon included in the first bar indicating the current position in the video content.

When the touch input of the progress icon of the second bar is released, the controller recognizes at least one object included in a frame displayed on the touch screen, and displays the second bar corresponding to the recognized object on the touch screen. Can be marked on.

The predetermined input may include an input for a playback stop icon displayed in the first bar or a voice command for stopping playback of moving image content.

The specific object may include at least one of at least one person, at least one object, a background included in the video content, and at least one object included in the background.

The recognized specific object may include at least two or more objects, wherein the controller moves the second bar corresponding to the first object to a second bar corresponding to the second object so that at least two or more second bars are mutually different. When overlapping, a user interface for generating a third bar corresponding to a new frame set generated by synthesizing the first object and the second object may be displayed on the touch screen.

Wherein the user interface comprises:

A first frame area including one of the first object and the second object, and a second frame area including the first object and the second object,

When the controller receives an input for moving a second bar corresponding to the first object to any one of the first to second frame areas, the controller maps the second bar to a third bar according to an area where the second bar is located. You can set different frames.

When the second bar corresponding to the first object is located in the first frame area, the generated third bar may be in a frame including any one of the first object and the second object of the video content. Can correspond.

When the second bar corresponding to the first object is located in the second frame area,

The generated third bar may correspond to a frame including the first object and the second object of the video content.

When the second bar corresponding to the first object enters any one of the first frame area and the second frame area, the controller may display display characteristics of the frame area in which the second bar enters the user interface. You can change it.

The third bar may include identification information for distinguishing a form in which the first object and the second object are synthesized.

The controller may modify and display the display characteristics of the first bar so that the frame section corresponding to the third bar among the frames corresponding to the first bar is distinguished from other frame sections.

When receiving a touch input for moving the second bar away from the touch screen, a frame including an object corresponding to the second bar may be removed from the video content.

The controller may display identification information for identifying that the frame including the object corresponding to the second bar has been removed from the video content on the touch screen.

According to another aspect of the present invention, a mobile terminal includes: a touch screen displaying a playback screen of video content and a progress bar for controlling playback of the video content; And a bar generated by recognizing at least one object and indexing at least one frame including the recognized object in a playback order when the playback of the video content is stopped. And a controller to display on the touch screen in association with at least one object.

When the controller receives an input for selecting a specific point of the bar, the controller may display a frame corresponding to the specific point among the grouped frames on the touch screen.

According to still another aspect of the present invention, there is provided a method of controlling a mobile terminal, the method including: displaying a playback screen of video content and a first bar for controlling playback of the video content on the touch screen; Receiving a predetermined input to the touch screen; Stopping playback of the video content in response to the predetermined input; Recognizing a specific object included in the screen on which playback is stopped; And displaying a second bar on the touch screen to control at least one frame including the specific object among the entire frames of the video content independently of the video content. have.

The details of other embodiments are included in the detailed description and drawings.

The control method of the mobile terminal and the mobile terminal according to an embodiment of the present invention has the following effects.

According to the present invention, a frame including a specific object can be selected and viewed through an intuitive user interface in the video content.

In particular, a predetermined object is recognized in the video content, a progress bar unique to the recognized object is generated, and a frame including an object desired by the user is provided by selection of a user's desired progress bar or scroll bar by simple user manipulation. can do.

In addition, according to the present invention, in the video content including at least one object, the frame of the video content can be easily edited based on the recognized object.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2 is a flowchart of a method of controlling a mobile terminal according to a first embodiment of the present invention.
3 to 5 are diagrams for describing a method for controlling a mobile terminal according to a first embodiment of the present invention.
6 is a flowchart of a method of controlling a mobile terminal according to a second embodiment of the present invention.
7 to 10 are diagrams for describing a method for controlling a mobile terminal according to a second embodiment of the present invention.
11 is a flowchart of a control method of a mobile terminal according to a third embodiment of the present invention.
12 to 14 are diagrams for describing a method for controlling a mobile terminal according to a third embodiment of the present invention.
15 is a flowchart illustrating a control method of a mobile terminal according to a third embodiment of the present invention in more detail.
16 to 20 are diagrams for describing a method for controlling a mobile terminal according to a third embodiment of the present invention.
21 is a flowchart of a control method of a mobile terminal according to a fourth embodiment of the present invention.
22 to 28 are diagrams for describing a method for controlling a mobile terminal according to a fourth embodiment of the present invention.
29 is a flowchart of a control method of a mobile terminal according to a fifth embodiment of the present invention.
30 to 31 are diagrams for describing a method for controlling a mobile terminal according to a fifth embodiment of the present invention.
32 is a diagram illustrating an example of storing an object progress bar generated according to the first to fifth embodiments of the present invention.

The foregoing objects, features and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Reference will now be made in detail to the preferred embodiments of the present invention, examples of which are illustrated in the accompanying drawings. Like numbers refer to like elements throughout. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail.

Hereinafter, a mobile terminal according to the present invention will be described in detail with reference to the drawings. The suffix "module" and "part" for constituent elements used in the following description are given or mixed in consideration only of ease of specification, and do not have their own standing or distinguishing meaning or role.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigation terminal and the like.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory unit 160, An interface unit 170, a control unit 180, a power supply unit 190, and the like. The components shown in Fig. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcasting signals using various broadcasting systems. In particular, the broadcasting receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) Only Digital Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems that provide broadcast signals as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory unit 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 refers to a module for wireless Internet access, and the wireless Internet module 113 can be embedded in the mobile terminal 100 or externally. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and the like can be used as the short distance communication technology.

The location information module 115 is a module for confirming or obtaining the location of the mobile terminal. A typical example of the location information module is a GPS (Global Position System) module. According to the current technology, the GPS module 115 calculates information on a distance (distance) from three or more satellites to one point (entity), information on the time when the distance information is measured, , Three-dimensional position information according to latitude, longitude, and altitude of one point (individual) in one hour can be calculated. Further, a method of calculating position and time information using three satellites and correcting the error of the calculated position and time information using another satellite is also used. The GPS module 115 continues to calculate the current position in real time and uses it to calculate speed information.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory unit 160 or may be transmitted to the outside through the wireless communication unit 110. [ The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, it may be responsible for a sensing function related to whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154, for example, for generating output related to visual, auditory, have.

The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display 3D display).

Some of these displays may be transparent or light transmissive so that they can be seen through. This may be referred to as a transparent display. A typical example of the transparent display is a transparent LCD or the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another, or may be disposed integrally with one another, and may be disposed on different surfaces, respectively.

The display unit 151 is connected to a display unit 151 and a sensor for sensing a touch operation (hereinafter, referred to as 'touch sensor') having a mutual layer structure It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. As a result, the controller 180 can know which area of the display unit 151 is touched.

Referring to FIG. 1, a proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is surrounded by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high frequency oscillation proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.

And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of allowing the pointer to be recognized without being in contact with the touch screen so that the pointer is located on the touch screen is referred to as a "proximity touch", and the touch The act of actually touching the pointer on the screen is called "contact touch." The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory unit 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 outputs an acoustic signal related to a function (e.g., a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 100. The audio output module 152 may include a receiver, a speaker, a buzzer, and the like. Also, the sound output module 152 may output sound through the earphone jack 116. The user can connect the earphone to the earphone jack 116 to hear the sound output.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The video signal or the audio signal may also be output through the display unit 151 or the audio output module 152.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may be configured to perform various functions such as an effect of stimulation by a pin arrangement vertically moving with respect to a contact skin surface, an effect of stimulation by air spraying force or suction force through a jet opening or a suction opening, A variety of tactile effects such as an effect of stimulation through contact of an electrode, an effect of stimulation by an electrostatic force, and an effect of reproducing a cold sensation using a heat absorbing or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to feel the tactile effect through the muscles of the user's finger or arm. The haptic module 154 may include two or more haptic modules 154 according to the configuration of the portable terminal 100.

The memory unit 160 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory unit 160 may store data related to vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory unit 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory unit 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or receives power from the external device to transfer the data to each component in the mobile terminal 100 or to transmit data in the mobile terminal 100 to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user to the cradle may be transmitted It can be a passage to be transmitted to the terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The control unit 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing functions. In some cases, And may be implemented by the control unit 180.

In a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that allow at least one function or operation to be performed. The software code may be implemented by a software application written in a suitable programming language. In addition, the software code may be stored in the memory unit 160 and executed by the controller 180.

Hereinafter, embodiments of the present invention will be described.

In the present invention, for convenience of description, it is assumed that the display unit 151 is a touch screen 151. As described above, the touch screen 151 may perform both an information display function and an information input function. However, it should be clear that the present invention is not limited thereto. In addition, the touch mentioned in the present document may include both a touch touch and a proximity touch.

Meanwhile, according to an embodiment of the present invention, a user interface for editing video clips may be provided. The user interface may be provided by a video editing software application installed in a computer system that allows a user to view, edit, or otherwise process a video by, for example, uploading a video clip at the user interface. The video clip may include a video file stored in a computer system on which a video editing software application is installed or a video file stored in a predetermined storage device operatively coupled to the computer system. In addition, the video file may include the entire video file or a part of the video file.

2 is a flowchart illustrating a control method of a mobile terminal according to the first embodiment of the present invention, and FIGS. 3 to 5 are diagrams for describing a control method of the mobile terminal according to the first embodiment of the present invention. The control method may be implemented under the control of the control unit 180 of the mobile terminal 100 illustrated in FIG.

Referring to FIG. 2, the controller 180 of the mobile terminal 100 may play video content (S110).

The moving picture content may include a file stored in the memory 160 of the mobile terminal 100 or an image file streamed from an external server.

The video content may be provided in various formats. For example, it may be provided in a format of Moving Picture Expert Group (MPEG), Quick Time Movie (MOCV), RealVideo, Avi, or the like.

The video content may include video content such as a movie or drama and music content in which simple music content is displayed together with the video.

When the video content is played, the controller 180 can display a playback screen of the video content on the touch screen 151.

Meanwhile, the controller 180 may display a first bar for controlling playback of the video content on the playback screen of the video content (S120).

The first bar is a graphical user interface (GUI) for controlling playback of video content and may be represented in a bar form. The first bar is called a progress bar because it has a function of providing location information on video content currently being played.

That is, the progress bar provides the user with location information on the current playback point among all the points of the continuous content played back by the user's playback command. Such location information may be marked and provided to the user to distinguish it from other parts of the progress bar. For example, a playing header may be located at the current playing point, and the current playing position information of the video content may be identified according to the relative position of the playing header among the entire sections of the progress bar.

Meanwhile, the progress bar may include at least one soft button corresponding to at least one function such as a playback, pause, fast forward, and fast rewind function of the video content. It may include. The mobile terminal 100 may control playback of the video content through an input to the at least one soft button.

Meanwhile, when the touch input for the touch screen 151 is received while the play screen of the video content is displayed on the touch screen 151, the mobile terminal 100 moves the progress bar to a region of the touch screen 151. I can display it.

When the controller 180 receives a predetermined input with respect to the predetermined area of the touch screen 151 on which the playback screen of the video content is displayed, the controller 180 may stop the playback of the video content (S130).

For example, the predetermined area may include a pause button included in a progress bar. When an input for the stop button is received, the controller 180 may display a screen (named a frame) in a state where content playback is stopped on the touch screen 151.

The controller 180 may recognize at least one object included in the screen while the playback of the video content is stopped (S140).

Here, the input for stopping the playback of the video content may include a long touch input for a pause button included in the progress bar. As the long touch input to the button is received, the controller 180 may enter an object recognition mode for recognizing at least one object included in a frame currently being played.

Meanwhile, when an input for simply selecting a pause button included in the progress bar is received, the controller 180 may control only the operation of stopping the video content currently being played is performed.

The video content may include at least one object. The object may include at least one of a person, an object other than a person, a background included in the video content, and at least one object included in the background. Meanwhile, the object to be recognized while the playback of the video content is stopped may be set in advance.

For example, when the video content is produced, it may include information on at least one specific object. The information on the specific object is, when the object is a person, the reference object (person) information for recognizing a person appearing in the video content is stored in the database, the object recognized on the screen where the playback of the video content is stopped It is determined whether the (person) is the same as the object (person) information stored in the database. Thereafter, when the same object (person) information exists, the user may be informed of the object (person) recognition result.

The controller 180 may display a second bar associated with a frame including the recognized object in the video content on the touch screen 151 based on the object recognized on the screen where the playback is stopped. It may be (S150).

Here, the second bar has a bar shape, and is a status bar grouped and indexed by a frame including the recognized object among frames included in the video content. It may include a scroll bar.

In addition, the second bar is a progress bar. When a touch and drag input is input in a predetermined direction with respect to the progress bar, the second bar is a specific bar on the progress bar recognized by the touch and drag input. The frame corresponding to the point may be displayed on the touch screen 151. The frame may be displayed on the front of the touch screen 151.

That is, the specific point of the second bar is associated with one frame containing the specific object. Thus, the first specific point of the second bar is associated with a first frame that includes the specific object, the second specific point of the second bar is associated with a second frame that includes the specific object, The Nth specific point of the two bars may be associated with the Nth frame including the specific object.

3 to 5, when the video content being played is paused, at least one object included in the video content is recognized and a second bar associated with the recognized object is touched. The process of displaying on the screen 151 will be described in more detail.

3 is an example of a video content reproduction screen for explaining S110 to S120 of FIG. 2.

Referring to FIG. 3, the controller 180 may display a playback screen C of the video content on the touch screen 151. In addition, when receiving a predetermined input (for example, a touch input to the playback screen) with respect to the playback screen C of the video content, the controller 180 is configured to control playback of the video content. A first bar 20 may be displayed on one region of the playback screen C of the video content. For convenience of description, the first bar will be referred to as a second progress bar.

The first progress bar 20 may include a progress icon 30 indicating which position of the entire frame corresponds to the frame of the video content currently being played.

In addition, the controller 180 includes a play button 11, a fast rewind (FR) button 12, and a fast forward (FF) button 13 of a content separately from the first progress bar 200, thereby providing a video. The additional control area 10 for controlling the playback of the content may be displayed on the touch screen 151.

Referring to FIG. 4, when receiving an input of long touching the play button 11 in the control area 10, the controller 180 temporarily stops the currently playing video content and stops the currently playing video content. The frame C (f1) is displayed on the touch screen 151.

The controller 180 may immediately perform an object recognition operation as the long touch input is received. In addition, the controller 180 temporarily stops the video content by selecting the play button 11, and then the touch screen 151 displaying the video content or a progress bar for controlling the playback of the video content. When receiving the long touch input, an object recognition operation may be performed.

The controller 180 recognizes at least one object OB1, OB2, OB3, or OB4 in the frame C (f1) of the video content. The controller 180 may apply at least one object recognition algorithm to recognize the objects OB1, OB2, OB3, and OB4, and the mobile terminal 100 selects a predetermined object from a still image among the object recognition algorithms. A well-known algorithm for recognizing may be used, and a detailed description of the object recognition algorithm will be omitted.

The controller 180 recognizes the objects OB1, OB2, OB3, and OB4 in the frame C (f1) where playback is stopped using the known object recognition algorithm, and the objects OB1, OB2, OB3, and OB4. ) By dividing the outline into a dashed closed curve, it is possible to control the display of the still image of the video content to identify the recognized object.

Referring to FIG. 5, the controller 180 may display a second bar associated with the recognized objects OB1, OB2, OB3, and OB4 on the touch screen 151. As described above, the second bar may have a function of a progress bar, and may function as a status bar indexed according to a play time order by grouping frames including a specific object. have. For convenience of description, the second bar may be referred to as an object progress bar.

Meanwhile, the object progress bar is distinguished from the first progress bar 20 described above. The first progress bar 20 is a bar for controlling playback of the entire video content, and the object progress bar is a bar for independently controlling a frame including a recognized specific object.

Meanwhile, the controller 180 may display identification information (eg, text and image information) of the recognized object on the touch screen 151 together with the object progress bar to identify the recognized object. have.

Identification information of the recognized object may be obtained through metadata of video content stored in a memory (160 of FIG. 1) of the mobile terminal.

The identification information of the recognized object may be displayed on the touch screen 151 by searching for information related to the specific object from the Internet or an external server when the specific object is recognized.

Meanwhile, the controller 180 may receive a voice command including identification information of the recognized object and perform a control operation according to the voice command. For example, the voice command may include a command to synthesize a first object and a second object among the recognized objects, a command to delete a frame including a specific object from the entire video content, and the like.

The controller 180 may display the object progress bars 31, 32, 33, and 34 corresponding to the objects OB1, OB2, OB3, and OB4 in the vicinity of the objects OB1, OB2, OB3, and OB4, respectively. . For example, the controller 180 may display the first object progress bar 31 corresponding to the frames including the recognized first object OB1 on the first object OB1. The controller 180 displays the second object progress bar 32 corresponding to the frames including the recognized second object OB2 on the second object OB2, and recognizes the third object OB3. The third object progress bar 33 corresponding to the frames including the second object OB3 is displayed above the second object OB3, and the second object progress corresponding to the frames including the recognized fourth object OB4. The bar 34 may be displayed on the second object OB4.

On the other hand, the object progress bar corresponding to a specific object is a progress icon (41, 42, 43, 44) for indicating the relative position of the frame currently displayed on the touch screen 151 of the entire frame including the specific object It may include.

For example, the first object progress bar 31 may include a progress icon 41 for indicating a position of a frame currently displayed on the touch screen 151 among all frames including the first object OB1. Can be. The same applies to the second to fourth object progress bars 32, 33, and 34.

As described above, the controller 180 of the mobile terminal 100 extracts a frame including a specific object from the video content and indexes the frames to an object progress bar of a bar shape to index the frames on the touch screen. I can display it. The display of a frame including the specific object may be controlled independently of the entire video content through a user manipulation of the object progress bar.

6 is a flowchart illustrating a method for controlling a mobile terminal according to a second embodiment of the present invention, and FIGS. 7 to 10 are diagrams for describing a method for controlling a mobile terminal according to a second embodiment of the present invention.

Referring to FIG. 6, in the above-described first embodiment, the controller 180 may receive an input for selecting an object progress bar (second bar) displayed on the touch screen 151 (S210).

The controller 180 may receive an input for moving the progress icon included in the object progress bar in a left and right direction (S220).

For example, referring to FIG. 7, a touch input for moving the progress icon 41 (a) to the left and right directions with respect to the first object progress bar 31 may be received. When the controller 180 receives the long touch input with respect to the first object progress bar 31, the controller 180 may enlarge and display the size of the first object progress bar 31. Accordingly, the user may scrub while moving the progress icon 41 (a) with respect to the enlarged first object progress bar 31.

In response to the scrubbing input, the controller 180 may search for a frame including the corresponding object among the entire video content frames and display the search result on the touch screen 151. That is, the controller 180 can display a frame corresponding to the position of the progress icon of the progress bar (second bar) on the touch screen 151 (S230).

Referring to FIG. 8, when receiving a touch input for moving the progress icon of the first object progress bar 31 from 41 (a) to 41 (b), the controller 180 may determine the position 41 (a). ) Can be displayed on the touch screen 151 by changing the frame (C (f1) of FIG. 5) to a frame (C (f2) of FIG. 8) corresponding to the position 41 (b).

Meanwhile, the first object progress bar 31 may be linked with the progress bar 20 that controls the playback of the video content. That is, when the position of the progress icon included in the first object progress bar 31 is changed as described above, the changed position is reflected in the progress bar 20 to be included in the progress bar 20. The position of the progress icon may be moved from 30 (a) to 30 (b). The position 40 (a) of the progress icon of the first object progress bar 31 corresponds to the position 30 (a) of the progress icon of the progress bar 20 and the position of the first object progress bar 31. The position 40 (b) of the progress icon corresponds to the position 30 (b) of the progress icon of the progress bar 20.

5 through 8 illustrate an example in which a frame corresponding to the scrub input position is displayed on the front surface of the touch screen 151 when an input of selecting an object progress bar and scrubbing in a predetermined direction is received. Explained.

However, the example of displaying a frame corresponding to the scrubbing input for the object progress bar is not limited to the above-described method.

For example, referring to FIG. 9, when receiving an input for scrubbing the progress icon 41 of the first object progress bar 31 in a predetermined direction, the controller 180 controls the entire frame of the video content. At least one frame including the first object may be displayed as a thumbnail image (Th) (1, 2, 3, 4,..., N).

The controller 180 may display a thumbnail image corresponding to the frame including the first object on the progress bar 20.

In addition, whenever a specific point of the first object progress bar 31 is scrubbed, the controller 180 may highlight and display a thumbnail image corresponding to the specific point. For example, referring to FIG. 9, the controller 180 may indicate what is the currently selected frame by highlighting a thumbnail image 4 corresponding to the position 41 of the progress icon.

The controller 180 controls a frame including the specific object independently of the entire video content in response to a user's manipulation of an object progress bar corresponding to the specific object. When control of the object progress bar is completed, the controller 180 may recognize an object included in a new scene, generate a recognized object progress bar, and display the object on the touch screen 151.

For example, referring to FIG. 10, in FIG. 8, the progress icon of the first object progress bar corresponding to the first object OB1 is moved from the first point 41 (a) to the second point 41 (b). When the touch input is released after receiving the touch input, the at least one object included in the screen corresponding to the second point 41 (b) may be recognized.

That is, the frame C (f2) displayed on the touch screen 151 of FIG. 8 is manipulated with respect to the progress bar 31 corresponding to the first object OB1 while only the first object OB1 is recognized. As a result, a frame including the first object OB1 is displayed on the touch screen 151.

However, referring to FIG. 10, it is assumed that the sixth object OB6 is recognized as an object in addition to the fifth object OB5 on the screen illustrated in FIG. 10.

Accordingly, the position of the touch input with respect to the first object progress bar 31 corresponding to the fifth object OB5 in the first frame (C (f1) in FIG. 5) is the first point 41 (a in FIG. 10). )) To the second point (41 (b) of FIG. 10), the touch screen 151 touches the second frame (C (f2) of FIG. 10) among the frames including the fifth object OB5. Can be marked on. In addition, when releasing a touch input with respect to the second point 41 (b) in the second frame (C (f2) of FIG. 10), the controller 180 may control the second frame C (f2). Perform a new object recognition operation.

As the object recognition operation is performed, the fifth object OB5 and the sixth object OB6 may be recognized. Thereafter, the controller 180 sets the fifth object progress bar 51 and the sixth object progress bar 52 corresponding to the fifth object OB5 and the sixth object OB6, respectively. Can be marked on.

As described above, each of the object progress bars 51 and 52 may include progress icons 61 and 62 for indicating a current position of the corresponding frame.

Thereafter, as shown in the above example, the display of the frame including each object may be controlled according to a user's manipulation of the fifth object progress bar 51 or the sixth object progress bar 61.

In the above description, in the first to second embodiments, when the playing video is paused while playing video content, at least one object included in the paused screen is recognized and the recognized object is recognized. A frame including an extracted object frame, an object progress bar indexing the extracted frame, and a frame including the recognized object among the entire frames of the video content through the object progress bar; We have seen an example of displaying bays on the screen.

Hereinafter, an example of editing a frame of video content through the object progress bar described above will be described with reference to FIGS. 11 through 14.

11 is a flowchart illustrating a method for controlling a mobile terminal according to a third embodiment of the present invention, and FIGS. 12 to 14 are diagrams for describing a method for controlling a mobile terminal according to a third embodiment of the present invention.

Referring to FIG. 11, the controller 180 of the mobile terminal 100 recognizes at least one object on a screen where playback is stopped (S140). Then, the controller 180 determines whether at least two recognized objects are present (310).

The controller 180 may display the first object progress bar corresponding to the first object and the second object progress bar corresponding to the second object among the recognized two or more objects on the touch screen 151 (S320).

The controller 180 may receive a touch input of overlapping the first object progress bar with the second object progress bar (S330). The touch input may include an input for selecting the first object progress bar and dragging the second object progress bar so that the two object progress bars overlap each other.

Then, the controller 180 may display a user interface for generating a third bar capable of independently controlling a new frame set generated by synthesizing the first object and the second object. Can be marked on.

In this document, a first bar, a second bar, and a third bar are status bars having different attributes. That is, the first bar is a progress bar for controlling pkayback of the entire video content, the second bar is an object progress bar corresponding to one object, and the third bar is composed of at least two objects. The object progress bar corresponding to the generated frame may be defined.

Referring to FIG. 12, when the controller 180 receives a long touch input or a double touch input to the first object progress bar 31, the controller 180 may enter an edit mode of the object progress.

Referring to FIG. 13, in response to the long touch input, the first object progress bar 31 corresponding to the first object OB1 is moved to another object progress bar 32, 33, 34, or touched. The guide information 71, 72, 73, 74, 75 indicating that the screen 151 can be moved out of the screen may be displayed on the touch screen 151.

The guide may be expressed in the form of arrows 71, 72, 73, 74, 75 indicating a movable path of the first object progress bar 31.

Referring to FIG. 14, by moving the first object progress bar 31 to the second object progress bar 32, the two object progress bars 31 and 32 may overlap each other. The user interface for synthesizing the first object and the second object by the overlapping and generating an object third bar corresponding to a frame including the first object and / or the second object. This will be described in more detail below.

15 is a flowchart illustrating a control method of a mobile terminal according to a third embodiment of the present invention in more detail, and FIGS. 16 to 20 illustrate a control method of a mobile terminal according to a third embodiment of the present invention. Figures for.

Referring to FIG. 15, the controller 180 may include a first screen area including a first object and a second object as a union, and a second frame area including the first object and the second object as an intersection. The display may be displayed on 151 (S350).

The first frame area including the first object and the second object as a union means a frame area including any one of the first object and the second object among the entire frames of the video content.

Also, the second frame area including the first object and the second object as an intersection means a frame area including both the first object and the second object among the entire frames of the video content.

According to one embodiment, a user interface for generating an object progress bar corresponding to a new set of frames by overlapping different object progress bars may be in the form of a Venn diagram as illustrated in FIGS. 16 to 17. Can have

Referring to FIG. 16, when the first object progress bar 31 and the second object progress bar 32 overlap, a user interface in the form of a band diagram 80 may be displayed on the touch screen 151. .

The van diagram type user interface may include first frame areas 81 and 82 corresponding to a frame including a first object and a second frame area 32 corresponding to a frame including a second object. Can be.

In a state where the user interface is displayed on the touch screen 151, the controller 180 may move the first object progress bar 31 overlapping the second object progress bar 32 in the first frame area 81. , 82) may receive an input for moving to at least one of the second frame area 83.

Then, the controller 180 may determine a composition method of the first object and the second object according to the area in which the first object progress bar 31 is moved.

For example, referring to FIG. 17, when the first object progress bar 31 is moved to the second frame area 83, the controller 180 may control the first object and the second object among the entire frames of the video content. You can create and display a new object progress bar that indexes frames that contain all objects.

For example, referring to FIG. 18, when the first object progress bar 31 is moved to the first frame area 81 or 82, the controller 180 may control the first frame among all frames of the video content. A new object progress bar that indexes frames including one of the first object and the second object may be generated and displayed.

The new object progress bar created by the overlap of the different object progress bars described above may be displayed as shown in FIG. 19.

Referring to FIG. 19, in the first object progress bar 31 to the fourth object progress bar 34, an area where each object progress bar is located is located at an upper end of the object. Therefore, it is possible to distinguish which object each object progress bar corresponds to. Meanwhile, the object progress bars may distinguish each object progress bar from each other by changing display characteristics, for example, color and transparency.

For example, the colors of the first object progress bar 31 and the fourth object progress bar 34 are different from each other.

Meanwhile, the new progress bar 90 generated by the overlap of two progress bars may include identification information (for example, 31 'and 34') for identifying an object corresponding to the two progress bars. have.

The new progress bar 90 may be displayed on the side of the main progress bar 20 for controlling the playback of the video content. When receiving a touch input (including a long touch input) for selecting the new progress bar 90, the controller 180 may set an attribute of the newly created progress bar 90 to the main progress bar ( 20) can be reflected.

For example, the new progress bar 90 is a progress bar corresponding to a frame including any one of the first object OB1 and the fourth object OB4. Therefore, upon receiving an input for selecting the progress bar 90, the controller 180 may select one of the first object OB1 and the fourth object OB4 from the main progress bar 20. The section 91 corresponding to the containing frame may be identified and displayed with the other section 92.

As illustrated in FIG. 20, when a scrubbing input for the progress bar 90 is received, an object of either the first object OB1 or the second object OB is included in response to the scrubbing input. Can be displayed on the touch screen 151.

According to the above-described embodiment, an example of performing an operation of extracting a frame including a desired object by controlling an object progress bar corresponding to the recognized object in the video content including the recognizable object has been described.

However, the method of extracting a desired object through the object progress bar is not limited to the above-described example and may be variously modified. For example, the embodiment disclosed through FIGS. 21 to 28 will be described.

21 is a flowchart illustrating a method for controlling a mobile terminal according to a fourth embodiment of the present invention, and FIGS. 22 to 28 are diagrams for describing a method for controlling a mobile terminal according to a fourth embodiment of the present invention.

Referring to FIG. 21, after recognizing at least one object in a state in which playback of video content is stopped (S140), the controller 180 may receive a long touch input for an arbitrary area of the touch screen 151. It may be (S410).

For example, referring to FIG. 22, in response to the long touch input, the controller 180 may display a query window 201 on the touch screen 151 that inquires whether to generate an object progress bar.

In addition, referring to FIG. 23, the controller 180 may generate an object progress bar not related to any object in which the object progress bar has not been determined. Can be marked on.

Referring back to FIG. 21, the controller 180 may receive an input for moving a first object to the object progress bar (S430).

Referring to FIG. 24, an input for moving a first object OB1 to an object progress bar 202 may be a touch and drag to drag the first object B1 to have an area overlapping the object progress bar. May contain input. Here, the first object OB1 is moved in the direction of the object progress bar 202 so that the area where the first object OB1 overlaps with the object progress bar 202 is increased. The external size can be reduced.

That is, when the first object OB1 overlaps the object progress bar 202, the controller 180 may recognize the object progress bar 202 as indexing the frames including the first object. Can be. Accordingly, only a frame including the first object OB1 may be selectively displayed by the user's manipulation of the object progress bar 202 (C).

Referring to FIG. 25, as described above, the first object OB1 moves to the object progress bar 202, whereby the object progress bar 202 is recognized as corresponding to the first object OB1. In this state, an input for moving the second object OB2 to the object progress bar 203 may be received (S440). Here, the input for moving the second object OB2 to the object progress bar 203 is also the same as that of the first object OB1.

The controller 180 may index the frames including the second object OB2 in the object progress bar 203. As a result, the object progress bar 203 may perform a function as a status bar indexing frames including the first object and / or the second object.

Referring to FIG. 26, the newly created object progress bar 204 according to the embodiment illustrated in FIGS. 24 and 25 corresponds to a frame including the first object OB1 and / or the second object OB2. do. Accordingly, in response to a scrubbing input for the object progress bar 204, only frames including the first object OB1 and / or the second object OB2 of the entire frame of the video content are extracted. Display on the touch screen 151. The controller 180 can sequentially display the extracted frames on the touch screen 151 based on the playback time.

In addition, when the controller 180 receives a long touch input to the object progress bar 204, the controller 180 may select frames including both attributes (first and second objects) of the object progress bar 204. The indexed progress bar) may be reflected in the main progress bar 20 for controlling the playback of the video content. As a result of the reflection, the controller 180 may display sections corresponding to a frame in which a first object and a second object are simultaneously included among all frames of the video content so as to be distinguished from other sections. For example, the controller 180 may shade and display a section corresponding to a frame including the first object and the second object at the same time.

Referring to FIG. 27, when the controller 180 receives a touch input for selecting the object progress bar 205, the controller 180 touches a menu window 206 for indicating attributes of the object progress bar 205. It can be displayed on the screen 151.

The menu window 206 may include at least one of object information OB1 and OB2 corresponding to the object progress bar 206, an item for selecting an object to be synthesized in addition to the object progress bar 206, and the object information. It may include an item for deleting one object.

For example, when receiving an input for deleting the first object OB1 from the menu window 206, the controller 180 displays a frame including the second object OB2 as shown in FIG. 28. It can be selectively displayed.

Accordingly, an object mapped to the object progress bar 205 may be added or deleted more easily.

29 is a flowchart illustrating a method for controlling a mobile terminal according to a fifth embodiment of the present invention, and FIGS. 30 to 31 are diagrams for describing a method for controlling a mobile terminal according to a fifth embodiment of the present invention.

Referring to FIG. 29, at least one object is recognized on a screen where playback of video content is stopped (S140). The controller 180 may display object progress bars 31, 32, 33, and 34 corresponding to the recognized at least one object OB1, OB2, OB3, and OB4 in the vicinity of each object.

When the controller 180 receives a gesture of throwing the first object progress bar 31 out of the screen on the playback screen of the video content, the controller 180 may control a frame including the first object OB1 among all frames of the video content. Can be. Therefore, the frame exiting from the first object OB1 may not be displayed while the video content is being played.

Referring to FIG. 31, when a long touch input to the first object progress bar 31 is received, a set symbol C may be displayed on an upper end portion of the first object progress bar 31. When receiving an input for moving the first object progress bar 31 to the filter set symbol C, the controller 180 receives a first object OB1 corresponding to the first object progress bar 31. The frame may be controlled to be deleted and played back during video content playback.

In addition, as illustrated in FIGS. 30 to 31, when a frame including a predetermined object is removed from the video content through the object progress bar, the frame may be reflected in the main progress bar for controlling playback of the video content. .

32 is a diagram illustrating an example of storing an object progress bar generated according to the first to fifth embodiments of the present invention.

According to an embodiment, the controller 180 may store an object progress bar.

Referring to FIG. 32, an input for overlapping the first object progress bar 31 with the second object progress bar 32 is received, and the first object progress bar 31 and the second object progress bar ( If 32) overlaps, touch the query window 210 to inquire whether to store a new object progress bar corresponding to at least one frame including the first object OB1 and / or the second object OB2. It can be displayed on the screen 151.

In addition, the controller 180 may provide a list of video contents stored in the mobile terminal 100. Extracts only a frame including a first video content 211 from the list of video contents and including both a first object OB1 and a second object OB2 during playback of the first video content 211 A new object progress bar 222 that can be shown may be included in the list of video content and displayed.

Here, the list of video content may include a play time 212 of the video content, and may include a content play time 223 that can be played through the object progress bar.

The above-described method of controlling a mobile terminal according to the present invention can be provided by being recorded in a computer-readable recording medium as a program for execution in a computer.

The control method of the mobile terminal according to the present invention can be executed through software. When executed in software, the constituent means of the present invention are code segments that perform the necessary tasks. The program or code segments may be stored in a processor readable medium or transmitted by a computer data signal coupled with a carrier wave in a transmission medium or a communication network.

A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored. Examples of the computer-readable recording device include a ROM, a RAM, a CD-ROM, a DVD 占 ROM, a DVD-RAM, a magnetic tape, a floppy disk, a hard disk, The computer-readable recording medium may also be distributed to networked computer devices so that computer readable code can be stored and executed in a distributed manner.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention. The present invention is not limited to the drawings. In addition, the embodiments described in this document can be applied to not only the present invention, but also all or some of the embodiments may be selectively combined so that various modifications can be made.

100: mobile terminal 151: touch screen
180:

Claims (21)

A touch screen displaying a playback screen of video content and a first bar for controlling playback of the video content; And
When the input for stopping the playback of the video content is received, the playback of the video content is stopped, recognizes a specific object included in the screen where the playback is stopped, and includes the specific object of the entire frame of the video content; A controller configured to display a second bar associated with at least one frame on the touch screen;
. The method of claim 1,
The second bar is,
And a plurality of frames including the specific object, which are grouped and indexed in the playback order. The method of claim 1,
The first bar includes a progress icon indicating a current position in the video content. The method of claim 1,
The second bar may include a progress icon indicating that a frame including the specific object indicates a current position in the video content. 5. The method of claim 4,
The control unit,
And a frame corresponding to the position of the touch input is displayed on the touch screen when receiving an input for moving the touch input to the progress icon of the second bar in a predetermined direction. The method of claim 5, wherein
The predetermined direction is a mobile terminal, characterized in that for moving in the horizontal direction along the second bar. The method of claim 5, wherein
The control unit,
And changing a position of a progress icon included in a first bar for indicating a current position in the video content as the frame displayed on the touch screen is changed. The method of claim 5, wherein
The control unit,
When the touch input to the progress icon of the second bar is released, a movement of recognizing at least one object included in a frame displayed on the touch screen and displaying a second bar corresponding to the recognized object on the touch screen terminal. The method of claim 1,
The predetermined input includes a voice command for stopping the playback of the video content or the input to the playback stop icon displayed on the first bar. The method of claim 1,
The specific object may include at least one of at least one person, at least one object, a background included in the video content, and at least one object included in the background. The method of claim 1,
The recognized specific object comprises at least two objects,
The control unit,
When the second bar corresponding to the first object is moved to the second bar corresponding to the second object, and the at least two or more second bars overlap each other, the second frame corresponding to the first object corresponds to a new frame set generated by synthesizing the first object and the second object. A mobile terminal for displaying on the touch screen a user interface for creating a third bar. The method of claim 11,
Wherein the user interface comprises:
A first frame area including one of the first object and the second object, and a second frame area including the first object and the second object,
The control unit,
When receiving an input for moving the second bar corresponding to the first object to any one of the first to second frame areas, the frame mapped to the third bar is different depending on the area where the second bar is located. Mobile terminal to set. 13. The method of claim 12,
When the second bar corresponding to the first object is located in the first frame area,
The generated third bar corresponds to a frame including any one of the first object and the second object of the video content. 13. The method of claim 12,
When the second bar corresponding to the first object is located in the second frame area,
The generated third bar corresponds to a frame including the first object and the second object of the video content. 13. The method of claim 12,
The control unit,
When the second bar corresponding to the first object enters any one of the first frame area and the second frame area, the mobile terminal changes the display characteristics of the frame area in which the second bar enters the user interface. . 13. The method of claim 12,
The third bar may include identification information for distinguishing a form in which the first object and the second object are synthesized. 13. The method of claim 12,
The control unit,
And a display section of the first bar is modified to display a frame section corresponding to the third bar among the frames corresponding to the first bar so as to be distinguished from other frame sections. The method of claim 1,
And when receiving a touch input for moving the second bar away from the touch screen, removing a frame including an object corresponding to the second bar from the video content. The method of claim 18,
The control unit,
And displaying identification information on the touch screen to identify that the frame including the object corresponding to the second bar has been removed from the video content. A touch screen displaying a playback screen of video content and a progress bar for controlling playback of the video content; And
When the reproduction of the video content is stopped, at least one object is recognized and at least one bar generated by indexing at least one frame including the recognized object in a playback order is recognized. And a controller which is displayed on the touch screen in association with one object.
The control unit,
When receiving an input for selecting a specific point of the bar, the mobile terminal to display a frame corresponding to the specific point of the grouped frame on the touch screen. Displaying a playback screen of video content and a first bar on the touch screen for controlling playback of the video content;
Receiving a predetermined input to the touch screen;
Stopping playback of the video content in response to the predetermined input;
Recognizing a specific object included in the screen on which playback is stopped; And
Displaying a second bar on the touch screen to control at least one frame including the specific object among all frames of the video content independently of the video content;
And transmitting the control information to the mobile terminal.

Images