KR102064219B1 - Mobile terminal and operation method thereof - Google Patents

Abstract

The present invention relates to a method of controlling an operation of a mobile terminal which provides a new video label instead of an existing thumbnail image when calling a video list, the method including: capturing a video by executing a camera application; Displaying a user interface screen for selecting a video label representative of the video file of which the shooting is ended when the video shooting ends; Generating the video label based on information selected through the user interface screen; And displaying a video label corresponding to the video file existing in the video folder when the video list is called.

Description

MOBILE TERMINAL AND OPERATION METHOD THEREOF

The present invention relates to a mobile terminal and a method for controlling the operation thereof, and more particularly, to a mobile terminal for providing a new video label instead of an existing thumbnail image when calling a video list and a method for controlling the operation thereof.

A mobile terminal is a portable device that is portable and has one or more functions of making voice and video calls, inputting and outputting information, and storing data. As the functions of the mobile terminals are diversified, the mobile terminals are equipped with complex functions such as taking a picture or a video, playing a music file or a video file, playing a game, receiving a broadcast, wireless internet, and sending and receiving a message. Is being implemented.

In the mobile terminal implemented in the form of such a multimedia device, a variety of new attempts have been applied in terms of hardware or software to implement complex functions. For example, a user interface environment for a user to search for or select a function easily and conveniently. In addition, while the mobile terminal is regarded as a personal portable device for expressing the personality of the user, various types of design changes such as a double-sided LCD (Liquid Crystal Display) and a front touch screen are also required.

Meanwhile, a conventional mobile terminal has a function of automatically storing video files photographed through a camera in a preset folder (eg, gallery folder) together with a video capturing function. Accordingly, the user of the mobile terminal visits the gallery folder in which the video file exists in order to view the captured video file again or share the captured video file with a third party.

By the way, a plurality of thumbnail images corresponding to a plurality of video files are listed in the conventional gallery folder, so that it is difficult for a user to find out what contents the plurality of video files contain. In addition, when a video file existing in the gallery folder is to be shared with a third party, the transmission often occurs due to the data capacity of the video file. Accordingly, there is a need for a method for allowing a user to easily identify a list of video files existing in a gallery folder. In addition, a method for efficiently transmitting a video file having a large data capacity to a third party is required.

The present invention provides a mobile terminal and a method for controlling the operation thereof, which provide a moving image label that can easily identify the contents of the moving image file existing in the gallery folder.

The present invention also provides a mobile terminal for extracting a highlight portion of a video file to generate a highlight image, and storing the highlight image in a gallery folder, and a method of controlling the same.

The present invention also provides a mobile terminal and an operation control method for automatically extracting a highlight image of the video file and transmitting the same to the counterpart terminal when the transmission of the video file to be transmitted fails.

The present invention comprises the steps of shooting a video by executing a camera application; Displaying a user interface screen for selecting a video label representative of the video file of which the shooting is ended when the video shooting ends; Generating the video label based on information selected through the user interface screen; And displaying a video label corresponding to the video file existing in the video folder when the video list is called.

According to an embodiment of the present invention, the mobile terminal displays a list of video files in the gallery folder by using a new video label, thereby allowing a user to easily identify contents of a plurality of video files existing in the gallery folder. .

According to another embodiment of the present invention, when the transmission fails due to the size of the video file, the mobile terminal extracts the highlight image of the video file and transmits it to the third party.

On the other hand various other effects will be disclosed directly or implicitly in the detailed description of the embodiments of the present invention to be described later.

1 is a block diagram of a mobile terminal according to one embodiment of the present invention;
2 is a front perspective view of a mobile terminal according to an embodiment of the present invention;
3 is a rear perspective view of the mobile terminal shown in FIG. 2;
4 is a flowchart illustrating an operation of a mobile terminal according to a first embodiment of the present invention;
5 to 11 are diagrams for describing a process of generating a video label representing a video file captured by a mobile terminal according to a first embodiment of the present invention;
12 is a diagram illustrating a process of displaying a video label corresponding to a video file according to a call of a video list in a mobile terminal according to a first embodiment of the present invention;
13 and 14 illustrate an operation of a mobile terminal according to a second embodiment of the present invention;
15 and 16 illustrate an operation of a mobile terminal according to a third embodiment of the present invention.

Hereinafter, with reference to the drawings will be described the present invention in more detail.

The mobile terminal described in the present specification includes a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a camera, a navigation, a tablet computer ( tablet computer, e-book terminal, and the like. In addition, the suffixes "module" and "unit" for the components used in the following description are merely given in consideration of ease of preparation of the present specification, and do not give particular meanings or roles by themselves. Therefore, the "module" and "unit" may be used interchangeably.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention. Referring to FIG. 1, a mobile terminal according to an embodiment of the present invention will be described in terms of components according to functions.

Referring to FIG. 1, the mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, and a memory. 160, an interface unit 170, a controller 180, and a power supply unit 190 may be included. Such components may be configured by combining two or more components into one component, or by dividing one or more components into two or more components as necessary when implemented in an actual application.

The wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 113, a wireless internet module 115, a short range communication module 117, and a GPS module 119.

The broadcast receiving module 111 receives at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel. In this case, the broadcast channel may include a satellite channel, a terrestrial channel, and the like. The broadcast management server may mean a server for generating and transmitting at least one of a broadcast signal and broadcast related information, or a server receiving at least one of the pre-generated broadcast signal and broadcast related information and transmitting the same to a terminal.

The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal. The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast related information may also be provided through a mobile communication network, and in this case, may be received by the mobile communication module 113. Broadcast related information may exist in various forms.

The broadcast receiving module 111 receives broadcast signals using various broadcast systems, and in particular, digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), and media forward link only (MediaFLO). ), Digital broadcast signals may be received using digital broadcasting systems such as DVB-H (Digital Video Broadcast-Handheld) and ISDB-T (Integrated Services Digital Broadcast-Terrestrial). In addition, the broadcast receiving module 111 may be configured to be suitable for all broadcast systems providing broadcast signals as well as such digital broadcast systems. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 113 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to voice call signal, video call signal, or text / multimedia message transmission and reception.

The wireless internet module 115 refers to a module for wireless internet access. The wireless internet module 115 may be embedded or external to the mobile terminal 100. Wireless Internet technologies may include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and the like.

The short range communication module 117 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), and the like may be used.

The GPS (Global Position System) module 119 receives position information from a plurality of GPS satellites.

The A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone (not shown). The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be provided according to the configuration aspect of the terminal.

The microphone (not shown) receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. The processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module 113 and output in the communication mode. As a microphone (not shown), various noise removing algorithms may be used to remove noise generated while receiving an external sound signal.

The user input unit 130 generates key input data input by the user for controlling the operation of the terminal. The user input unit 130 may be configured of a key pad, a dome switch, a touch pad (constant voltage / capacitance), etc. that may receive a command or information by a user's pressing or touch manipulation. In addition, the user input unit 130 may be configured as a jog wheel or a jog method or a joystick that rotates a key, a finger mouse, or the like. In particular, when the touch pad forms a mutual layer structure with the display unit 151 to be described later, this may be referred to as a touch screen.

The sensing unit 140 detects a current state of the mobile terminal 100 such as an open / closed state of the mobile terminal 100, a location of the mobile terminal 100, presence or absence of user contact, and the like to control the operation of the mobile terminal 100. Generate a sensing signal. For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, it may be responsible for sensing functions related to whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to an external device, and the like.

The sensing unit 140 may include a proximity sensor 141, a pressure sensor 143, a motion sensor 145, and the like. The proximity sensor 141 may detect the presence or absence of an object approaching the mobile terminal 100 or an object present in the vicinity of the mobile terminal 100 without mechanical contact. The proximity sensor 141 may detect a proximity object by using a change in an alternating magnetic field or a change in a static magnetic field, or by using a change rate of capacitance. Two or more proximity sensors 141 may be provided according to the configuration aspect.

The pressure sensor 143 may detect whether pressure is applied to the mobile terminal 100 and the magnitude of the pressure. The pressure sensor 143 may be installed at a portion requiring the detection of pressure in the mobile terminal 100 according to the use environment. If the pressure sensor 143 is installed in the display unit 151, a touch input through the display unit 151 and a greater pressure than the touch input are applied according to a signal output from the pressure sensor 143. The pressure touch input can be identified. In addition, according to the signal output from the pressure sensor 143, it can also know the magnitude of the pressure applied to the display unit 151 when the pressure touch input.

The motion sensor 145 detects the position or movement of the mobile terminal 100 using an acceleration sensor, a gyro sensor, or the like. The acceleration sensor that can be used for the motion sensor 145 is an element that converts an acceleration signal in one direction into an electrical signal, and is widely used with the development of micro-electromechanical systems (MEMS) technology.

Accelerometers measure the acceleration of a large value embedded in an airbag system of a car and used to detect a collision, and to measure the acceleration of a minute value used as an input means such as a game by recognizing a minute motion of a human hand. There are many different types. Accelerometers are usually configured by mounting two or three axes in one package. Depending on the environment, only one axis may be needed. Therefore, if for some reason it is necessary to use the acceleration sensor in the X-axis or Y-axis direction instead of the Z-axis direction, the acceleration sensor may be mounted on the main substrate using a separate engraving substrate.

In addition, the gyro sensor is a sensor for measuring the angular velocity, and may sense a direction returned to the reference direction.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display unit 151, an audio output module 153, an alarm unit 155, and a haptic module 157.

The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal 100 is in a call mode, the mobile terminal 100 displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the mobile terminal 100 is in a video call mode or a photographing mode, the mobile terminal 100 may display captured or received images respectively or simultaneously, and display a UI and a GUI.

Meanwhile, as described above, when the display unit 151 and the touch pad form a mutual layer structure and constitute a touch screen, the display unit 151 is an input device capable of inputting information by a user's touch in addition to the output device. May also be used.

If the display unit 151 is configured as a touch screen, the display unit 151 may include a touch screen panel and a touch screen panel controller. In this case, the touch screen panel is a transparent panel attached to the outside and may be connected to the internal bus of the mobile terminal 100. The touch screen panel keeps an eye on the contact result and sends corresponding signals to the touch screen panel controller when there is a touch input. The touch screen panel controller processes the signals and then transmits corresponding data to the controller 180 so that the controller 180 can determine whether there is a touch input and which area of the touch screen has been touched.

The display unit 151 may be composed of an electronic paper (e-Paper). Electronic paper (e-Paper) is a kind of reflective display that has excellent visual characteristics with high resolution, wide viewing angle and bright white background like conventional paper and ink. The e-paper can be implemented on any substrate such as plastic, metal, paper, etc., and the image is maintained even after the power is cut off, and there is no back light power, so the battery life of the mobile terminal 100 is long. Can be maintained. As the electronic paper, hemispherical twist balls filled with electrostatics may be used, or electrophoresis and microcapsules may be used.

In addition, the display unit 151 may include a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, and a three-dimensional display. It may include at least one of (3D display). In addition, two or more display units 151 may exist according to the implementation form of the mobile terminal 100. For example, an external display unit (not shown) and an internal display unit (not shown) may be simultaneously provided in the mobile terminal 100.

The sound output module 153 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. In addition, the sound output module 153 outputs a sound signal related to a function performed in the mobile terminal 100, for example, a call signal reception sound and a message reception sound. The sound output module 153 may include a speaker, a buzzer, and the like.

The alarm unit 155 outputs a signal for notifying occurrence of an event of the mobile terminal 100. Examples of events occurring in the mobile terminal 100 include call signal reception, message reception, and key signal input. The alarm unit 155 outputs a signal for notifying occurrence of an event in a form other than an audio signal or a video signal. For example, the signal may be output in the form of vibration. The alarm unit 155 may output a signal to inform the call signal when the call signal or the message is received. In addition, when the key signal is input, the alarm unit 155 may output the signal as a feedback to the key signal input. The user may recognize the occurrence of an event through the signal output from the alarm unit 155. The signal for notifying the event occurrence in the mobile terminal 100 may also be output through the display unit 151 or the sound output module 153.

The haptic module 157 generates various haptic effects that a user can feel. A representative example of the haptic effect generated by the haptic module 157 is a vibration effect. When the haptic module 157 generates vibration by the tactile effect, the intensity and pattern of the vibration generated by the haptic module 157 may be converted, and may be output by combining different vibrations or sequentially.

In addition to the vibration, the haptic module 157 may be operated by a pin array that vertically moves with respect to the contact skin surface, by the stimulation through the injection force or the suction force of the air through the injection or intake port, or by the stimulus that strikes the skin surface. Various tactile effects can be generated, such as effects of stimulation through contact of electrodes, effects of stimulation using electrostatic force, and effects of reproducing cold / warm feeling using elements capable of endothermic or exothermic heat. The haptic module 157 may not only deliver the haptic effect through direct contact, but also may realize the haptic effect through the muscle sensation of a user's finger or arm. Two or more haptic modules 157 may be provided according to a configuration aspect of the mobile terminal 100.

The memory 160 may store a program for processing and controlling the controller 180 and may provide a function for temporarily storing input or output data (for example, a phone book, a message, a still image, a video, etc.). It can also be done.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), RAM The storage medium may include at least one type of storage medium. In addition, the mobile terminal 100 may operate a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. Examples of external devices connected to the mobile terminal 100 include wired / wireless headsets, external chargers, wired / wireless data ports, memory cards, subscriber identification module (SIM) cards, and user identity module (UIM) cards. Card sockets, audio input / output (I / O) terminals, video input / output (I / O) terminals, and earphones. The interface unit 170 may receive data from such an external device or receive power and transfer the data to each component inside the mobile terminal 100, and allow the data inside the mobile terminal 100 to be transmitted to the external device. .

When the mobile terminal 100 is connected to an external cradle, the interface unit 170 becomes a passage through which power from the connected cradle is supplied to the mobile terminal 100, or various command signals input from the cradle are moved by the user. It may be a passage that is delivered to the terminal 100.

The controller 180 typically controls the operation of each unit to control the overall operation of the mobile terminal 100. For example, perform related control and processing for voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia playback module 181 for multimedia playback. The multimedia playback module 181 may be configured in hardware in the controller 180 or may be configured in software separately from the controller 180.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

The mobile terminal 100 having such a configuration may be configured to be operable in a communication system capable of transmitting data through a frame or packet, including a wired / wireless communication system and a satellite based communication system. have.

FIG. 2 is a perspective view of the mobile terminal according to an embodiment of the present invention, and FIG. 3 is a rear perspective view of the mobile terminal shown in FIG. 2. Hereinafter, referring to FIGS. 2 and 3, a mobile terminal related to the present invention will be described in terms of components according to appearance. In addition, hereinafter, for convenience of description, a bar type mobile terminal having a front touch screen among various types of mobile terminals such as a folder type, a bar type, a swing type, a slider type, and the like will be described as an example. However, the present invention is not limited to the bar type mobile terminal, but can be applied to all types of mobile terminals including the above-described type.

2, the case forming the exterior of the mobile terminal 100 is formed by the front case 100-1 and the rear case 100-2. Various electronic components are embedded in the space formed by the front case 100-1 and the rear case 100-2.

In the main body, specifically, the front case 100-1, the display unit 151, the first audio output module 153a, the first camera 121a, and the first to third user input units 130a, 130b, and 130c are provided. Can be arranged. In addition, a fourth user input unit 130d may be disposed on a side surface of the rear case 100-2, and a microphone (not shown) may be disposed on a lower surface of the rear case 100-2.

The display unit 151 may be configured such that the touch pad is overlapped in a layer structure so that the display unit 151 operates as a touch screen to input information by a user's touch.

The first sound output module 153a may be implemented in the form of a receiver or a speaker. The first camera 121a may be implemented in a form suitable for capturing an image or a video of a user or the like. In addition, the microphone (not shown) may be implemented in a form suitable for receiving a user's voice or other sound.

The first to fourth user input units 130a, 130b, 130c, and 130d and the fifth user input unit 130e to be described later may be collectively referred to as the user input unit 130, and are operated by the user while giving a tactile feeling. Any manner may be employed as long as it is in a tactile manner.

For example, the user input unit 130 may be implemented as a dome switch or a touch pad capable of receiving a command or information by a user's pressing or touch manipulation, or a manipulation method such as a wheel or jog or a joystick that rotates a key. Or the like.

In functional terms, the first user input unit 130a is a menu key for inputting a command for invoking a menu related to an application currently being executed, and the second user input unit 130b is a home key. It is for inputting a command for entering the idle screen regardless of the application, and the third user input unit 130c is for inputting a command for canceling the currently running application as a back key.

In addition, the fourth user input unit (i.e., side key 130d) acts as a key for switching between a sleep mode and a wake-up mode, or a special function in the mobile terminal 100. It can act as a hot-key to activate. Here, the sleep mode indicates a state in which the backlight of the display unit 151 is turned off to save battery consumption of the mobile terminal, and the wake up mode indicates a state in which the backlight of the display unit 151 is turned on.

Referring to FIG. 3, a second camera 121b may be additionally mounted on the rear of the rear case 100-2, and a fifth user input unit 130e is disposed on the side of the rear case 100-2. The interface unit 170 may be disposed on a lower surface of the rear case 100-2.

The second camera 121b may have a photographing direction substantially opposite to that of the first camera 121a, and may have different pixels from the first camera 121a. A flash (not shown) and a mirror (not shown) may be further disposed adjacent to the second camera 121b. In addition, another camera may be further provided adjacent to the second camera 121b to be used for capturing a 3D stereoscopic image.

The flash shines toward the subject when the subject is photographed with the second camera 121b. The mirror allows the user to see his / her own face or the like when photographing (self-photographing) the user using the second camera 121b.

A second sound output module (not shown) may be further disposed on the rear case 100-2. The second sound output module may implement a stereo function together with the first sound output module 153a and may be used for a call in the speakerphone mode.

The interface unit 170 may be used as a passage through which data is exchanged with an external device. In addition, an antenna (not shown) for receiving a broadcast signal may be disposed in one region of the front case 100-1 and the rear case 100-2. The antenna may be installed to be pulled out of the rear case 100-2.

The power supply unit 190 for supplying power to the mobile terminal 100 may be mounted on the rear case 100-2 side. The power supply unit 190 may be, for example, a rechargeable battery and may be detachably coupled to the rear case 100-2 for charging.

Meanwhile, in the present embodiment, the second camera 121b and the like have been described as being disposed in the rear case 100-2, but the present disclosure is not necessarily limited thereto. In addition, even if the second camera 121b is not separately provided, the first camera 121a may be rotatably formed to be able to photograph up to the photographing direction of the second camera 121b.

In the above, the configuration of the mobile terminal 100 according to the present invention has been described with reference to FIGS. 1 to 3. Hereinafter, according to an embodiment of the present invention, a mobile terminal for providing a video label for easily identifying the contents of a video file existing in a video folder and an operation control method thereof will be described in detail.

4 is a flowchart illustrating an operation of a mobile terminal according to a first embodiment of the present invention.

Referring to FIG. 4, the controller 180 captures a video by executing a camera application according to a user command (S405).

When the video recording is completed, the controller 180 checks whether there is a user request for generating a video label for the captured video file (S410). To this end, the controller 180 displays a pop-up window on the display unit 151 inquiring whether to generate a video label for the captured video file when the photographing ends. According to the user's selection command through the pop-up window, the controller 180 checks whether a user request for generating a video label is input.

Meanwhile, in the following exemplary embodiment, a process of generating a video label at the end of photographing is described, but the present invention is not limited thereto. That is, a process of generating a video label may be performed at the time of playing the corresponding video file for the first time in addition to the shooting end time. In addition, regardless of a specific time point, a process of generating a video label at a time point desired by a user may be performed through a separate setting menu.

As a result of checking in step 410, if there is no user request for generating a video label, the controller 180 automatically stores a video file photographed according to an existing method in a preset video folder (or gallery folder). At this time, the list of video files stored in the video folder is displayed in the form of a thumbnail image.

Meanwhile, as a result of checking in step 410, if there is a user request for generating a video label, the controller 180 displays a first user interface screen for allowing the user to select a label image representative of the captured video file. Displayed in the unit 151 (S415). In this case, the first user interface screen includes a predetermined number of thumbnail images automatically recommended by the mobile terminal 100 and an icon for directly selecting a label image by the user. Through various options provided through the first user interface screen, the user of the mobile terminal selects a label image representing the captured video file.

More specifically, the controller 180 automatically extracts and recommends a predetermined number of thumbnail images representing the video file photographed according to a predetermined selection criterion.

For example, when face tracking is automatically selected, the controller 180 extracts and recommends an image including a subject having a smiley face, a crying face, or a funny face from the captured video file. In addition, when pose tracking is automatically selected, the controller 180 extracts and recommends an image including a subject having a specific posture. Also, when group tracking is automatically selected, the controller 180 extracts and recommends an image in which all main subjects appear. In addition, in the case of using voice tracking as an automatic selection criterion, the controller 180 extracts and recommends an image of a point in time at which a loud sound is output. On the other hand, it will be apparent to those skilled in the art that in addition to the illustrated selection criteria, other selection criteria may be set to automatically recommend a moving image.

When any one of the automatically recommended images is selected, the controller 180 determines the image selected by the user as a label image representing the photographed video file.

Meanwhile, when a label image representing the video file is directly selected by the user, the controller 180 displays the plurality of thumbnail images on the display unit 151 at predetermined time intervals according to the total playback time of the captured video file. do. When any one of the plurality of images is selected, the controller 180 determines an image selected by the user as a label image representing the photographed video file.

When the selection of the label image is completed as described above, the controller 180 displays a second user interface screen on the display unit 151 for selecting the label text representing the captured video file (S420). In this case, the second user interface screen includes label texts automatically recommended by the mobile terminal 100 and a text input window for the user to directly input the label text. Through various options provided through the second user interface screen, the user of the mobile terminal selects the label text representing the captured video file.

More specifically, the controller 180 automatically recommends a plurality of label texts representing the video file by applying voice recognition and face recognition technology to the captured video file.

That is, the controller 180 recommends the label text by analyzing the voice of the recorded subject for a predetermined time before and after the image when the image (ie, the label image) representing the video file is captured. In addition, the controller 180 recommends label text by analyzing a voice of a photographer recorded for a predetermined time before and after the image based on a time point at which the image representing the video file is captured.

In addition, when it is impossible to extract the voice of the subject and the photographer for a predetermined time before and after the time when the image representing the video file is captured, the controller 180 determines the shooting date, the total playback time of the video file, and the shooting location. And label text including at least one of subject information. In this case, the location where the video is captured may be obtained through GPS information of the mobile terminal 100, and the subject information may be obtained by comparing the photograph image of the phone book data stored in the memory 160.

When any one of the automatically recommended label texts is selected, the controller 180 determines the text selected by the user as the label text representing the photographed video file.

Meanwhile, when a predetermined text is input through a text input window displayed on one area of the second user interface screen, the controller 180 determines the text directly input by the user as label text representing the photographed video file. .

When the selection of the label text is completed as described above, the controller 180 displays a third user interface screen on the display unit 151 for selecting the color of the selected video label through the above-described processes (S425). In this case, the third user interface screen includes a video label of a color automatically recommended by the mobile terminal 100 and an icon for selecting a color of the video label by the user. Through the options provided through the third user interface screen, the user of the mobile terminal selects the color of the video label representing the captured video file.

More specifically, the controller 180 automatically sets and recommends the color of the video label to match the overall color of the label image selected in step 415. When the automatically recommended color is selected in this way, the controller 180 determines the color automatically recommended by the mobile terminal as the color of the video label representing the captured video file.

Meanwhile, when the color of the video label is directly selected by the user, the controller 180 displays a popup window or a screen for selecting the color of the video label on the display unit 151. When a desired color is selected through the pop-up window or the screen, the controller 180 determines the color directly selected by the user as the color of the video label representing the captured video file.

When the selection of the color of the video label is completed as described above, the controller 180 displays a fourth user interface screen on the display unit 151 for determining whether to register a bookmark for the captured video file (S430). In this case, the fourth user interface screen includes an automatic registration item, a manual registration item, an unregistered item, and the like.

Through various options provided through the fourth user interface screen, the user of the mobile terminal may determine whether to register a favorite with respect to the captured video file.

When the bookmark registration process is completed, the controller 180 generates a video label based on the label image, text, and color selected to represent the captured video file, and stores the video label in the preset memory space (S435). Meanwhile, in another embodiment, a process of generating a video label representing the photographed video file may be performed without the above-described favorite registration process.

Thereafter, when the video list is called (S440), the controller displays the plurality of video labels corresponding to the plurality of video files existing in the video folder on the display unit 151 (S445). Accordingly, the user of the mobile terminal can easily identify the contents of each video file without having to play the video file through the video label displayed on the display unit 151.

As described above, the mobile terminal according to the first embodiment of the present invention displays a list of video files in the gallery folder using a new video label, thereby allowing a user to display the contents of a plurality of video files existing in the gallery folder. Make it easy to identify.

5 to 11, a process of generating a video label representing a video file captured by the mobile terminal according to the first embodiment of the present invention will be described in detail.

Referring to FIG. 5, when the camera application is executed according to a user command, the controller 180 displays a preview image 510 input through the camera lens on the display unit 151. Accordingly, the user of the mobile terminal 100 captures a video while watching the preview image 510 displayed on the display unit 151.

After the capturing of the video is completed, when the capturing stop button 515 is selected, the controller 180 may display a popup window 520 for inquiring whether to generate a video label for the captured video file in one region of the display unit 151. Mark on.

In the pop-up window 520, when the 'Yes' icon 525 is selected, the controller 180 selects a first user interface screen (or label image) for allowing the user to select a label image representative of the captured video file. The screen 530 is displayed on the display unit 151. In this case, the first user interface screen 530 may include a title icon 531 indicating a step of selecting a label image, a move icon 532 for moving to a label text selection step, which is a next step, and an automatic recommendation by the mobile terminal. Thumbnail images 533, and an icon 534 for directly selecting a label image by the user.

Referring to FIG. 6, the controller 180 automatically extracts thumbnail images 533_1 to 533_4 representing a video file photographed according to a preset selection criterion, and displays the thumbnail images 533_1 to 533_4 in one area of the display unit 151. In this case, as the preset selection criteria, face tracking, posture tracking, group tracking, voice tracking, and the like may be used.

For example, when face tracking is automatically selected, the controller 180 extracts and displays an image 533_1 including a subject having a smiley face, a crying face, or a funny face from the photographed video file. do. In addition, when pose tracking is an automatic selection criterion, the controller 180 extracts and displays an image 533_2 including a subject having a specific posture. In addition, when group tracking is automatically selected, the controller 180 extracts and recommends an image 533_3 in which all main subjects appear. In addition, in the case of using voice tracking as an automatic selection criterion, the controller 180 extracts and recommends an image 533_4 at the time when a loud sound is output.

When any one of the automatically recommended images is selected, the controller 180 determines the image 533_3 selected by the user as a label image representing the captured video file. Subsequently, when the moving icon 532 of the first user interface screen 530 is selected, the controller 180 moves to selecting a label text representing the captured video file.

Meanwhile, referring to FIGS. 7 and 8, when the first user interface screen 530 is displayed, when the icon 534 for directly selecting a label image instead of the automatically recommended thumbnail image is touched, the controller 180 The plurality of thumbnail images 535_1 to 535_15 and check boxes 536_1 to 536_15 are displayed on the display unit 151 at predetermined time intervals according to the total playback time of the captured video file.

When any one of the plurality of check boxes 536_1 to 536_15 is selected, the controller 180 labels a thumbnail image 535_2 corresponding to the check box 536_2 selected by the user to represent the photographed video file. Determined by the image.

Meanwhile, when any one of the plurality of thumbnail images 535_1 to 535_15 is selected instead of the check box, the controller 180 may perform a predetermined time before and after the time when the thumbnail image 535_2 selected by the user is captured. The video screen 540 for playing the video is displayed on the display unit 151. When a desired image is played on the video screen 540, the user presses the stop button 537 and then touchs the selection icon 538. Then, the controller 180 determines an image of the moment stopped by the user as a label image representing the captured video file. Thereafter, when the moving icon 532 of the first user interface screen 530 is selected, the controller 180 moves to selecting a label text representing the captured video file.

Referring to FIG. 9, the controller 180 displays, on the display unit 151, a second user interface screen (or a label text selection screen 550) for allowing a user to select a label text representing a captured video file. Display. In this case, the second user interface screen includes a title icon 551 indicating a step of selecting label text, a move icon 552 for moving to a label color selection step, and a label automatically recommended by the mobile terminal. Texts 553_1 to 553_3 and a text input window 554 for directly inputting label text by the user.

In this case, the controller 180 automatically recommends a plurality of label texts 553_1 to 553_3 representing the video file by applying voice recognition and face recognition technology to the captured video file.

For example, the controller 180 may recommend the label text 553_1 by analyzing the voice of the recorded subject for a predetermined time before and after the image when the image (that is, the label image) representing the video file is captured. Alternatively, the label text 553_2 is recommended by analyzing the voice of the recorded photographer for a predetermined time before and after the image based on the time point at which the image representing the video file is captured.

In addition, when it is impossible to extract the voice of the subject and the photographer for a predetermined time before and after the time when the image representing the video file is captured, the controller 180 determines the shooting date, the total playback time of the video file, and the shooting location. And label text 553_3 including at least one of subject information.

When any one of the automatically recommended label texts 553_1 to 553_3 is selected, the controller 180 determines the text 553_1 selected by the user as label text representing the photographed video file.

On the other hand, if a predetermined text is input through the text input window 554 displayed on one area of the second user interface screen 550, the controller 180 may represent the photographed video file with the text directly input by the user. Can be determined by the label text. Thereafter, when the moving icon 552 of the second user interface screen 550 is selected, the controller 180 moves to selecting a color of a video label representing the captured video file.

Referring to FIG. 10, the controller 180 displays a third user interface screen (or a label color selection screen 560) for allowing a user to select a color of a video label representing a captured video file. Mark on. In this case, the third user interface screen includes a title icon 561 indicating that the color of the video label is selected, a moving icon 562 for moving to the next step of registering a bookmark, and automatically recommended by the mobile terminal. A video label 563 of a predetermined color and an icon 564 for directly selecting a color of the video label by the user.

The controller 180 automatically sets and recommends the color of the video label to match the overall color of the label image selected by the user. In this state, when the moving icon 562 of the third user interface screen 560 is selected, the controller 180 determines the color automatically recommended by the mobile terminal as the color of the video label representing the captured video file. Then, go to the next step.

Meanwhile, when the icon 564 for directly selecting the color of the video label is touched while the third user interface screen 560 is displayed, the controller 180 opens a popup window 565 for selecting the color of the video label. Displayed on the display unit 151. When a desired color is selected through the pop-up window 565, the controller 180 displays the video label 566 to which the color selected by the user is applied, on the display unit 151. In this state, when the moving icon 562 of the third user interface screen 560 is selected, the controller 180 determines the color selected by the user as the color of the video label representing the captured video file, and then Move on to favorite registration step.

Referring to FIG. 11A, the controller 180 displays a fourth user interface screen (or a favorite registration screen 570) for allowing a user to determine whether to register a favorite with respect to a captured video file. (151). In this case, the fourth user interface screen 570 may include a title icon 571 indicating that it is a step of selecting whether to register a bookmark, a completion icon 572 for terminating the process of generating a video label, and an automatic registration item 573. ), A manual registration item 574, and an unregistered item 575.

When the automatic registration item 573 is selected while the fourth user interface screen 570 is displayed, the controller 180 determines that the number of times that the photographed video file is later played and shared exceeds the preset number of times. Set the video file to be automatically registered as a favorite.

When the manual registration item 574 is selected, the controller 180 directly registers the photographed video file as a favorite. In this case, the controller 180 may display an indicator indicating that the video file is registered as a favorite in one region of the video label. On the other hand, if the unregistered item 575 is selected, the controller 180 does not register the bookmark on the captured video file.

Referring to FIG. 11B, when any one of the items 573, 574, and 575 is selected, and a completion icon 572 is selected, the controller 180 controls the selected label image through the above-described process. Create a video label that represents the video file captured based on the label text and label color. In this case, the controller 180 may display a notification window 577 on one region of the display unit 151 for notifying the user that the video label is normally generated. In addition, the controller 180 stores the captured video file and a video level corresponding thereto in a preset memory space.

12 is a diagram illustrating a process of displaying a video label corresponding to a video file in response to a call of a video list in a mobile terminal according to the first embodiment of the present invention.

Referring to FIG. 12, when a gallery icon 1220 displayed on a home screen (not shown) or a menu screen 1210 is selected, the controller 180 controls a gallery screen including a photo folder, a video folder, a screen capture folder, and the like. Not shown) is displayed on the display unit 151.

In the gallery screen, when a video folder is selected, the controller 180 displays a video list screen 1230 including video labels corresponding to video files existing in the video folder on the display unit 151. Through the representative image and text of the video label displayed on the display unit 151, the user of the mobile terminal can easily identify the contents of each video file without having to play the video file.

Meanwhile, when there is a favorite registered video file in the video folder, the controller 180 displays an asterisk 1245 or the like in a region of the video label 1240 corresponding to the favorite registered video file. Accordingly, the user of the mobile terminal 100 can easily identify that the video file is a favorite registered.

13 and 14 illustrate an operation of a mobile terminal according to a second embodiment of the present invention.

13 and 14, when a video list is called from a user (S1310), the controller 180 may include a video list screen including a plurality of video labels respectively corresponding to a plurality of video files existing in the video folder. 1410 is displayed on the display unit 151 (S1320).

When the first user input 1425 is received with respect to a specific video file 1420 while the video list screen 1410 is displayed (S1330), the controller 180 controls a menu window 1430 related to the selected video file. Is displayed on one area of the display unit 151 (S1340). In this case, the menu window 1430 includes a shared item, a deleted item, a highlight storage item, a detailed information item, and the like. The first user input 1425 may be a long touch input for the specific video file 1420 or a short touch input of a predetermined number of times, without being limited thereto.

In the menu window 1430, when a second user input for selecting the highlight storage item 1430 is received (S1350), the controller 180 extracts a highlight portion of the selected video file and generates a highlight image. The generated highlight image is stored in a preset memory area (S1360). In this case, the controller 180 may generate a highlight image by extracting a video for a predetermined time before and after the thumbnail image (that is, a label image) representing the selected video file based on a time point at which the image is captured.

In addition, the controller 180 adds and displays the video label 1440 corresponding to the newly generated highlight image to the video list screen 1410 (S1370). In this case, the video label 1440 corresponding to the highlight image displays an indicator (eg, an 'H' mark 1445) that is preset in one region, so as to distinguish it from the video label 1420 corresponding to the original video file. Can be.

As described above, the mobile terminal according to the second embodiment of the present disclosure may extract and store the highlight portion of the specific video file separately according to a user request.

15 and 16 illustrate an operation of a mobile terminal according to a third embodiment of the present invention.

15 and 16, the controller 180 executes an application that can transmit or share at least one video file according to a user command (S1510). For example, the application includes a short message service (SMS) application, a multimedia message service (MMS) application, an instant message service (IMS) based chat application, a social network service (SNS) application, and the like. In the following embodiment, for convenience of description, it will be described on the assumption that the application is an IMS-based chat application.

While the operation screen 1610 of the chat application is running, when a request for transmitting a video file is received from the user (S1520), the controller 180 checks whether the video file can be transmitted (S1530).

As a result of the check, when the transmission of the video file is possible, the controller 180 immediately transmits the corresponding video file to the chat counterpart (S1540).

On the other hand, if the transmission is not possible due to the size of the video file, the controller 180 displays a popup window 1620 for inquiring whether to transmit the highlight image in one area of the operation screen 1610 (S1550). .

When the icon 1621 for requesting the transmission of the highlight image is selected while the popup window 1620 is displayed, the controller 180 automatically extracts the highlight portion of the video file to be transmitted and generates a highlight image (S1570). ). In this case, the controller 180 may generate a highlight image by extracting a video for a predetermined time before and after the thumbnail image (ie, a label image) representing the video file to be transmitted, based on a time point at which the video image is captured. have. In addition, the controller 180 may store the generated highlight image in a temporary memory.

Thereafter, as shown in FIG. 16B, the controller 180 transmits the highlight image 1630, which automatically extracts the highlight portion of the video file to be transmitted, to the chat counterpart (S1580).

As described above, the mobile terminal according to the third embodiment of the present invention automatically extracts a highlight image of the video file and transmits it to the counterpart terminal when the transmission fails due to the size of the video file to be transmitted. .

On the other hand, the present invention can be implemented as a processor-readable code in a processor-readable recording medium provided in the mobile terminal. The processor-readable recording medium includes all kinds of recording devices that store data that can be read by the processor. Examples of the processor-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like, and also include a carrier wave such as transmission through the Internet. The processor readable recording medium can also be distributed over network coupled computer systems so that the processor readable code is stored and executed in a distributed fashion.

In addition, although the preferred embodiment of the present invention has been shown and described above, the present invention is not limited to the above-described specific embodiment, the technical field to which the invention belongs without departing from the spirit of the invention claimed in the claims. Of course, various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical spirit or the prospect of the present invention.

100: mobile terminal 110: wireless communication unit
120: A / V input unit 130: user input unit
140: sensing unit 150: output unit
151: display unit 160: memory
170: interface unit 180: control unit

Claims (9)

Executing a camera application to capture a video;
Displaying a user interface screen for selecting a video label representing a video file of which the shooting is ended when the shooting of the video ends;
Displaying a third user interface screen for selecting a color of a video label representing the video file among the user interface screens;
Generating the video label based on the information selected through the user interface screen and the color selected through the third user interface screen; And
Displaying a video label corresponding to a video file existing in the video folder when a video list is called. The method of claim 1, wherein displaying the user interface screen comprises:
And displaying a first user interface screen for selecting a label image representing the captured video file. The method of claim 2,
The first user interface screen may include a predetermined number of thumbnail images automatically recommended by the mobile terminal and an icon for a user to directly select a label image. The method of claim 1, wherein displaying the user interface screen comprises:
And displaying a second user interface screen for selecting the label text representing the captured video file. The method of claim 4, wherein
The second user interface screen may include label texts automatically recommended by the mobile terminal and a text input window for directly inputting label text by the user. delete The method of claim 1,
The third user interface screen may include a video label of a color automatically recommended by the mobile terminal and an icon for a user to directly select a color of the video label. The method of claim 1, wherein displaying the user interface screen comprises:
And displaying a fourth user interface screen for determining whether to register a bookmark for the captured video file. The method of claim 1, wherein the generating of the video label comprises:
And generating the video label based on the label image, label text, and label color selected through the user interface screen.

Images