KR20150071498A - Mobile terminal and method for controlling the same - Google Patents

Abstract

The present invention discloses a mobile terminal and a control method thereof. According to various embodiments of the present invention, the mobile terminal includes: a display unit which outputs a specific image in an image view mode; an extraction unit which extracts a specific area in the specific image based on a touch gesture for the specific image; and a control unit which generates a thumbnail of the specific image with the specific area extracted by the extraction unit and outputs a thumbnail list displaying the generated thumbnail to be visually distinguished from thumbnails of other images when an image preview function is executed.

Description

[0001] MOBILE TERMINAL AND METHOD FOR CONTROLLING THE SAME [0002]

The present invention relates to a mobile terminal capable of displaying a thumbnail of a specific image and a control method thereof.

A terminal can be divided into a mobile / portable terminal and a stationary terminal depending on whether the terminal is movable. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

As the functions of the terminal are diversified, the terminal is implemented in the form of a multimedia device having a combination of functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, have. Further, in order to support and enhance the function of the terminal, it may be considered to improve the structural and software parts of the terminal.

In recent years, as the functions of the camera built in the mobile terminal have been improved and various media have been provided to the mobile terminal, the user can store more images in the memory. Accordingly, in order to alleviate the inconvenience of performing a plurality of operations in order to retrieve a specific image desired by the user from among the stored images, the stored image is reduced in size so that a large number of images are displayed at once.

On the other hand, the image reduced in size is made of the same image only with a size smaller than that of the original image, so that there is a disadvantage that the image or the person that the user does not want to show to another person is exposed. For this reason, when the image is locked, it becomes difficult to immediately recognize the image, and the user has to perform the operation for unlocking each time.

Generally, stored images are arranged in order according to the stored time or the captured time. In this case, if the stored images are very large, even if the images are reduced to a small size, The inconvenience to be repeated is not solved.

Embodiments of the present invention provide a mobile terminal and a method of controlling the mobile terminal in which only a specific portion desired by a user is displayed in a stored image and a thumbnail displayed only in a specific portion can be easily retrieved when the stored images are displayed as thumbnails It has its purpose.

In addition, embodiments of the present invention provide a mobile terminal that implements a method of recognizing a face of people included in a stored image and displaying thumbnails of stored images, or hiding a specific face or displaying only a specific face, and a control method thereof There is another purpose.

It is another object of the present invention to provide a mobile terminal and a control method thereof, in which similar images in a stored image are grouped so that only one representative thumbnail is displayed.

According to an aspect of the present invention, there is provided a mobile terminal including: a display unit configured to output a specific image in an image viewing mode; An extracting unit for extracting a specific region from the specific image based on the touch gesture for the specific image; And a controller for generating the extracted specific region as a thumbnail of the specific image and outputting a thumbnail list in which the generated thumbnail is visually distinguished from the thumbnails of other images when the image preview function is executed.

In one embodiment, the control unit recognizes a face included in the specific image and, if the recognized face coincides with the pre-stored face image, recognizes the graphic object recommending the recognized face area as the specific area, And outputting the resultant face area.

In one embodiment, the extracting unit extracts the obscured part of the area as the specific area, or extracts the remaining area excluding the obscured part of the area, according to the operation of the menu output by the touch gesture that covers a certain area of the specific image And extracts the specific region.

In one embodiment, the control unit recognizes a face included in the obscured area and, when the recognized face is designated to the first group, displays a thumbnail of the image including the face as a thumbnail And if the recognized face is designated to the second group, the thumbnail of the image including the face is changed to a thumbnail emphasizing the display of the recognized face.

In one embodiment, the image display apparatus further includes a user input unit for receiving a control command for executing one of a first mode and a second mode in which the display of the thumbnail list corresponding to the image preview function is changed, When the image preview function is executed in the first mode, the thumbnail list in which the faces belonging to the first group are hidden is outputted, and when the image preview function is executed in the second mode, the thumbnail list And outputs the output signal.

In one embodiment, when the image preview function is executed, the control unit controls the information related to the object included in the extracted specific area to be displayed on the generated thumbnail.

In one embodiment, if the object is a specific face, the controller searches for photo information of a pre-stored address book that matches the specific face, and displays profile information of the corresponding address book on the generated thumbnail.

In one embodiment, when the image preview function is executed, the controller outputs the generated thumbnail in a shape different from the thumbnail of the other image.

In one embodiment, when the image preview function is executed, the controller outputs a first thumbnail list arranged at the center of the display unit, and when a predetermined time elapses, the first thumbnail list is displayed And changing the generated thumbnail to a second thumbnail list moved to its original position.

In one embodiment, when the thumbnail list corresponding to the execution of the image preview function is scrolled and it is detected that the generated thumbnail has entered a preset area, the controller scrolls the thumbnail list And the speed of the scrolling is reduced.

In one embodiment, when the generated thumbnail is selected from the thumbnail list corresponding to the execution of the image preview function, the control unit enlarges the selected thumbnail to a preset size and outputs the enlarged thumbnail, And changes the image to an original image corresponding to the selected thumbnail.

In one embodiment, when the generated thumbnail is selected from a thumbnail list corresponding to the execution of the image preview function, the controller enlarges and outputs the selected thumbnail to a preset size, And outputs a folding indication.

In one embodiment, the control unit changes the enlarged image to an original image corresponding to the selected thumbnail in response to the touch input being detected in the direction indicated by the folding display.

In one embodiment, the control unit recognizes a face included in the enlarged image and sequentially outputs at least one thumbnail including the recognized face to an area distinguished from the area in which the enlarged image is displayed .

In one embodiment, the control unit groups the plurality of other images connected to the specific image into one group according to a predetermined criterion, and classifies the specific image or the specific image based on the touch gesture on the specific image belonging to the group A specific region of the specific image is generated as a group thumbnail of the group, and when the image preview function is executed, a thumbnail list in which the group thumbnail is visually distinguished from other thumbnails is output.

In one embodiment, when the image preview function is executed, the control unit controls time information indicating the number of images included in the group to be displayed on the generated group thumbnail.

In one embodiment, when the group thumbnail is selected from the thumbnail list corresponding to the execution of the image preview function, the control unit displays each thumbnail corresponding to the plurality of images included in the selected group thumbnail on the thumbnail list And the like.

In one embodiment, when one of the plurality of opened thumbnails is selected, the control unit collects the expanded plurality of thumbnails based on the selected thumbnails, and changes the group thumbnails before being expanded to the selected thumbnails .

According to another aspect of the present invention, there is provided a method of controlling a mobile terminal, including: outputting a specific image in an image viewing mode; Extracting a specific area from the specific image based on the touch gesture for the specific image; Generating the extracted specific region as a thumbnail of the specific image; When the image preview function is executed, outputting a thumbnail list in which the generated thumbnail is visually distinguished from a thumbnail of another image.

In one embodiment, in accordance with a predetermined touch input, performing scrolling on a thumbnail list corresponding to execution of the image preview function; And stopping the scrolling or decreasing the speed of scrolling corresponding to the touch input when the generated thumbnail enters the preset area of the display unit according to the scrolling.

Embodiments of the present invention may be implemented such that when a stored image is displayed as a thumbnail, only a specific portion desired by the user is displayed on the stored image, the stored image can be displayed without exposing an object or person, It provides convenience to recognize what it is.

In addition, a thumbnail displayed only on a specific portion of the image is visually distinguished from other thumbnails, and when the scrolling is performed, the thumbnail is used as a break point, so that even when a very large amount of images are stored, Can be easily found.

In addition, embodiments of the present invention shorten the overall length of the thumbnail list by displaying similar thumbnails when displaying stored images as thumbnails, by grouping similar images to display only one representative thumbnail. Accordingly, the display on the display unit is simplified and the number of movements for searching for a specific image is reduced.

1 is a block diagram illustrating a mobile terminal according to one embodiment disclosed herein.
2A and 2B are a front perspective view and a rear perspective view of a mobile terminal according to the present invention.
3 is a flowchart illustrating a method of controlling a mobile terminal according to an exemplary embodiment of the present invention.
4A and 4B are conceptual diagrams for explaining the control method of FIG.
5A is a conceptual diagram illustrating a method of generating a thumbnail in a specific region extracted based on a touch gesture according to an embodiment of the present invention.
FIG. 5B is a conceptual diagram for explaining a method of outputting a thumbnail list so that a face of a specific person is not exposed according to an embodiment of the present invention.
6A to 6C are conceptual diagrams illustrating a method of displaying thumbnails generated according to an embodiment of the present invention in a manner distinct from thumbnails of other images.
FIG. 7 is a conceptual diagram for explaining a method of using a thumbnail generated according to an embodiment of the present invention as a breakpoint of scrolling.
8A to 8C are conceptual diagrams illustrating a method of outputting an original image corresponding to a selected thumbnail when a generated thumbnail is selected according to an embodiment of the present invention.
9A to 9C are conceptual diagrams illustrating a method of grouping a plurality of images and displaying the images as one thumbnail according to an embodiment of the present invention.
10 is a diagram for explaining a method of generating and displaying a thumbnail of a moving image according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. In addition, it should be noted that the attached drawings are only for easy understanding of the embodiments disclosed in the present specification, and should not be construed as limiting the technical idea disclosed in the present specification by the attached drawings.

The mobile terminal described in this specification includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, a slate PC , A tablet PC (tablet PC), and an ultrabook (ultrabook). However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.

1 is a block diagram illustrating a mobile terminal according to one embodiment disclosed herein.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only And a Digital Broadcasting System (ISDB-T) (Integrated Services Digital Broadcast-Terrestrial). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The mobile communication module 112 is configured to implement a video communication mode and a voice communication mode. The video call mode refers to a state of talking while viewing a video of the other party, and the voice call mode refers to a state in which a call is made without viewing the other party's video. In order to implement the video communication mode and the voice communication mode, the mobile communication module 112 is configured to transmit and receive at least one of voice and image.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. Examples of the wireless Internet technology include a wireless LAN (WLAN), a wireless fidelity (WiFi) direct, a DLNA (Digital Living Network Alliance), a Wibro (Wireless broadband), a Wimax (World Interoperability for Microwave Access), HSDPA Can be used.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth ™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, NFC (Near Field Communication), etc. are used as short range communication technology .

The position information module 115 is a module for obtaining the position of the mobile terminal, and representative examples thereof include a Global Position System (GPS) module or a Wireless Fidelity (WiFi) module.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or may be transmitted to an external device through the wireless communication unit 110. In addition, The camera 121 may be provided in two or more depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data according to a control command for controlling the operation of the mobile terminal 100 applied by the user. The user input unit 130 may include a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The sensing unit 140 may sense the position of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence of the user, the orientation of the mobile terminal, And generates a sensing signal (or sensing signal) for sensing the current state and controlling the operation of the mobile terminal 100. For example, the sensing unit 140 may detect whether the slide phone is opened or closed when the mobile terminal 100 is in the form of a slide phone. The sensing unit 140 may sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like.

The output unit 150 may include a display unit 151, an audio output module 153, an alarm unit 154, a haptic module 155, and the like in order to generate output related to visual, auditory, have.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the display unit 151 displays the photographed and / or received video or UI and GUI.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, a 3D display, and an e-ink display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see the object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

Also, the display unit 151 may be configured as a stereoscopic display unit 152 for displaying a stereoscopic image.

Here, a stereoscopic image represents a 3-dimensional stereoscopic image, and a 3-dimensional stereoscopic image represents a progressive depth and reality in which objects are located on a monitor or a screen. It is an image that makes you feel the same as reality space. 3D stereoscopic images are implemented using binocular disparity. The binocular parallax means the parallax caused by the positions of the two separated eyes. When the two eyes see different two-dimensional images and the images are transmitted to the brain through the retina and fused, the depth and real feeling of the stereoscopic image can be felt do.

The stereoscopic display unit 152 may be applied to a three-dimensional display system such as a stereoscopic system (glasses system), an autostereoscopic system (no-glasses system), and a projection system (holographic system). The stereoscopic method, which is widely used in home television receivers, includes a Wheatstone stereoscopic method.

Examples of the autostereoscopic method include a parallax barrier method, a lenticular method, an integral imaging method, and a switchable lens method. The projection method includes a reflection type holographic method and a transmission type holographic method.

Generally, 3D stereoscopic images consist of left image (left eye image) and right image (right eye image). A top-down method of arranging a left image and a right image in one frame according to a method in which a left image and a right image are combined into a three-dimensional stereoscopic image, A checker board system in which pieces of a left image and a right image are arranged in a tile form, a left-to-right (right-side) Or an interlaced method in which rows are alternately arranged, and a time sequential (frame-by-frame) method in which right and left images are alternately displayed in time.

In addition, the 3D thumbnail image can generate a left image thumbnail and a right image thumbnail from the left image and right image of the original image frame, respectively, and combine them to generate one 3D thumbnail image. In general, a thumbnail means a reduced image or a reduced still image. The left image thumbnail and the right image thumbnail generated in this way are displayed on the screen with a left and right distance difference by a depth corresponding to the parallax between the left image and the right image, thereby exhibiting a three-dimensional spatial feeling.

The left and right images necessary for realizing the three-dimensional stereoscopic image can be displayed on the stereoscopic display unit 152 by a stereoscopic processing unit (not shown). The stereoscopic processing unit receives a 3D image and extracts a left image and a right image from the 3D image, or receives a 2D image and converts it into a left image and a right image.

On the other hand, when a display unit 151 and a sensor (hereinafter, referred to as 'touch sensor') that detects a touch operation form a mutual layer structure (hereinafter referred to as a 'touch screen' It can also be used as an input device in addition to the device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area where the touch object is touched on the touch sensor but also the pressure at the time of touch. Here, the touch object may be a finger, a touch pen, a stylus pen, a pointer, or the like as an object to which a touch is applied to the touch sensor.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

Referring to FIG. 1, a proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is surrounded by the touch screen. The proximity sensor 141 may be provided as an example of the sensing unit 140. The proximity sensor 141 measures the presence or absence of an object approaching a predetermined sensing surface It refers to a sensor that uses infrared rays to detect without mechanical contact. The proximity sensor 141 has a longer life than the contact type sensor and its utilization is also high.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection fluorescent light sensor, a mirror reflection fluorescent light sensor, a high frequency oscillation proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. When the touch screen is electrostatic, it is configured to detect the proximity of the pointer by a change of the electric field along the proximity of an object having conductivity (hereinafter, referred to as a pointer). In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch & The act of actually touching the pointer on the screen is called "contact touch. &Quot; The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor 141 detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

In the case where the three-dimensional display unit 152 and the touch sensor have a mutual layer structure (hereinafter referred to as a 'three-dimensional touch screen') or a three-dimensional sensor that detects the touch operation and the stereoscopic display unit 152 are combined with each other The stereoscopic display unit 152 may also be used as a three-dimensional input device.

The sensing unit 140 may include a proximity sensor 141, a three-dimensional touch sensing unit 142, an ultrasonic sensing unit 143, and a camera sensing unit 144 as an example of the three-dimensional sensor.

The proximity sensor 141 measures the distance between the sensing surface (for example, a user's finger or a stylus pen) to which the touch is applied without mechanical contact using the force of the electromagnetic field or infrared rays. The terminal recognizes which part of the stereoscopic image has been touched using the distance. In particular, when the touch screen is of the electrostatic type, the proximity of the sensing object is detected by a change of the electric field according to the proximity of the sensing object, and the touch on the three-dimensional is recognized using the proximity.

The stereoscopic touch sensing unit 142 senses the strength or duration of a touch applied to the touch screen. For example, the three-dimensional touch sensing unit 142 senses a pressure to apply a touch, and when the pressing force is strong, recognizes the touch as a touch to an object located further away from the touch screen toward the inside of the terminal.

The ultrasonic sensing unit 143 is configured to recognize the position information of the sensing target using ultrasonic waves.

The ultrasound sensing unit 143 may include, for example, an optical sensor and a plurality of ultrasound sensors. The light sensor is configured to sense light, and the ultrasonic sensor is configured to sense ultrasonic waves. Since light is much faster than ultrasonic waves, the time it takes for light to reach the optical sensor is much faster than the time it takes for the ultrasonic waves to reach the ultrasonic sensor. Therefore, it is possible to calculate the position of the wave generating source using the time difference with the time when the ultrasonic wave reaches the reference signal.

The camera sensing unit 144 includes at least one of a camera 121, a photo sensor, and a laser sensor.

For example, the camera 121 and the laser sensor are combined with each other to sense a touch of a sensing target with respect to a three-dimensional stereoscopic image. When the distance information detected by the laser sensor is added to the two-dimensional image photographed by the camera, three-dimensional information can be obtained.

As another example, a photosensor may be stacked on a display element. The photosensor is configured to scan the movement of the object proximate to the touch screen. More specifically, the photosensor mounts photo diodes and TRs (Transistors) in a row / column and scans the contents loaded on the photosensor using an electrical signal that varies according to the amount of light applied to the photo diode. That is, the photo sensor performs coordinate calculation of the object to be sensed according to the amount of light change, thereby acquiring position information of the object to be sensed.

The audio output module 153 can output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 153 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The sound output module 153 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 154 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events generated in the mobile terminal 100 include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 154 may output a signal for notifying the occurrence of an event by using a form other than the video signal or the audio signal, for example, vibration. The video signal or the audio signal may be output through the display unit 151 or the sound output module 153 so that the display unit 151 and the sound output module 153 may be classified as a part of the alarm unit 154 .

The haptic module 155 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 155 may be vibration. The intensity and pattern of the vibration generated by the hit module 155 can be controlled by the user's selection or setting of the control unit. For example, the haptic module 155 may combine and output different vibrations or sequentially output the vibrations.

In addition to the vibration, the haptic module 155 may be configured to perform various functions such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 155 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sense of the finger or arm. At least two haptic modules 155 may be provided according to the configuration of the mobile terminal 100.

The memory 160 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read- And may include a storage medium of at least one type of disk and optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, a port for connecting a device equipped with a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, An audio I / O port, a video I / O port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM) A universal subscriber identity module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Therefore, the identification device can be connected to the terminal 100 through the interface unit 170. [

The interface unit 170 may be a path through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, And various command signals may be transmitted to the mobile terminal 100. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal 100. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

 In addition, the control unit 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

In addition, if the state of the mobile terminal meets a set condition, the controller 180 can execute a lock state for restricting input of a control command of the user to the applications. In addition, the controller 180 may control the lock screen displayed in the locked state based on a touch input sensed through the display unit 151 in the locked state.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays , Microprocessors, microprocessors, microprocessors, and other electronic units for carrying out other functions. In some cases, the embodiments described herein may be implemented by the controller 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein.

The software code may be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

Hereinafter, a structure of a mobile terminal or a mobile terminal in which components of the mobile terminal or the mobile terminal according to an embodiment of the present invention shown in FIG. 1 are arranged will be described.

2A is a perspective view of a mobile terminal 100 according to an embodiment of the present invention.

The disclosed mobile terminal 100 includes a bar-shaped terminal body. However, the present invention is not limited thereto and can be applied to various structures such as a watch type, a clip type, a spectacle type, or a folder type, a flip type, a slide type, a swing type and a swivel type in which two or more bodies are movably coupled have.

The body includes a case (frame, housing, cover, etc.) which forms an appearance. In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. A battery cover 103 covering the battery 191 may be detachably attached to the rear case 102 have.

The cases may be formed by injection molding of synthetic resin, or may be formed of metal such as stainless steel (STS), aluminum (Al), titanium (Ti), or the like.

A first sound output module 153a, a first camera 121a, a first operation unit 131 and the like are disposed on the front surface of the terminal body, and a microphone 122, an interface unit 170 ), A second operation unit 132, and the like.

The display unit 151 is configured to display (output) information processed by the mobile terminal 100. The display unit 151 may include a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED) ), A flexible display, a 3D display, and an e-ink display.

The display unit 151 may include touch sensing means for receiving a control command by a touch method. When a touch is performed on any one of the display units 151, the touch sensing unit senses the touch and the content corresponding to the touched position is input. The content input by the touch method may be a letter or a number, an instruction in various modes, a menu item which can be designated, and the like.

The touch sensing means may be formed of a translucent material so that the visual information output from the display unit 151 can be seen, and a structure for enhancing the visibility of the touch screen in a bright place. 2A, the display unit 151 occupies most of the front surface of the front case 101.

A first sound output module 153a and a first camera 121a are disposed in an area adjacent to one end of both ends of the display unit 151 and a first operation unit 131 and a microphone 122 . The second operation unit 132 (see FIG. 3B), the interface unit 170, and the like may be disposed on the side of the terminal body.

The first sound output module 153a may be implemented in the form of a receiver for delivering a call sound to a user's ear or a loud speaker for outputting various alarm sounds or multimedia playback sounds.

The sound generated from the first sound output module 153a may be configured to be emitted along the assembly gap between the structures. In this case, the hole formed independently for the apparent acoustic output is hidden or hidden, so that the appearance of the mobile terminal 100 can be simplified. However, the present invention is not limited thereto, and a hole for emitting the sound may be formed in the window.

The first camera 121a processes an image frame such as a still image or moving image obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100 and may include first and second operation units 131 and 132. The first and second operation units 131 and 132 may be collectively referred to as a manipulating portion and may be any type of tactile manner such as touch, push, scroll, etc., .

In the figure, the first operation unit 131 is a touch key, but the present invention is not limited thereto. For example, the first operation unit 131 may be a mechanical key, or a combination of a touch key and a touch key.

The contents input by the first and / or second operation units 131 and 132 may be variously set. For example, the first operation unit 131 receives a command such as a menu, a home key, a cancellation, a search, and the like, and the second operation unit 132 adjusts the size of the sound output from the first sound output module 153a And a switch to the touch recognition mode of the display unit 151 and the like.

The microphone 122 is configured to receive a user's voice, other sounds, and the like. The microphone 122 may be provided at a plurality of locations to receive stereophonic sound.

The interface unit 170 is a path for allowing the mobile terminal 100 to exchange data with an external device. For example, the interface unit 170 may include a connection terminal for connecting to an earphone by wire or wireless, a port for short-range communication (for example, an IrDA port, a Bluetooth port, LAN Port) or the like, or power supply terminals for supplying power to the mobile terminal 100. [ The interface unit 170 may be implemented as a socket for receiving an external card such as a SIM (Subscriber Identification Module) or a UIM (User Identity Module) or a memory card for storing information.

FIG. 2B is a rear perspective view of the mobile terminal 100 shown in FIG. 2A.

Referring to FIG. 2B, a second camera 121b may be additionally mounted on the rear surface of the terminal body, that is, the rear case 102. The second camera 121b may have a photographing direction substantially opposite to that of the first camera 121a (see FIG. 3A), and may be a camera having different pixels from the first camera 121a.

For example, the first camera 121a has low pixels so that it is easy to capture a face of a user in the case of a video call or the like and transmit the face to the other party. The second camera 121b photographs a general object and immediately transmits It is preferable to have a high pixel. The first and second cameras 121a and 121b may be installed in the terminal body so as to be able to rotate or pop-up.

A flash 123 and a mirror 124 are further disposed adjacent to the second camera 121b. The flash 123 shines light toward the subject when the subject is photographed by the second camera 121b. The mirror 124 enables the user to illuminate the user's own face or the like when the user intends to photograph the user himself / herself (self-photographing) using the second camera 121b.

And a second sound output module 153b may be further disposed on the rear surface of the terminal body. The second sound output module 153b may implement the stereo function together with the first sound output module 153a (see FIG. 3A), and may be used for the implementation of the speakerphone mode during a call.

An antenna (not shown) for receiving a broadcast signal may be additionally disposed on the side of the terminal body in addition to an antenna for a call or the like. An antenna constituting a part of the broadcast receiving module 111 (see FIG. 1) can be installed to be able to be drawn out from the terminal body.

The terminal body is provided with a power supply unit 190 (see FIG. 1) for supplying power to the mobile terminal 100. The power supply unit 190 may include a battery 191 built in the terminal body or detachable from the outside of the terminal body. This figure illustrates that the battery cover 103 is coupled to the rear case 102 so as to cover the battery 191 to restrict the detachment of the battery 191 and to protect the battery 191 from external impact and foreign matter .

The extracted location information of the mobile terminal 100 may be transmitted to the mobile terminal 100 through the Wi-Fi location server 310 to obtain location information.

The mobile terminal 100 according to the embodiment of the present invention including at least one or more configurations as described above is configured to transmit at least one image to a predetermined storage space Lt; / RTI > At this time, in order to output the stored image, the gallery application can be executed according to the user input. When the gallery application is executed, the display unit 151 can output thumbnails of the stored plurality of images. The control unit 180 may enlarge and output the selected thumbnail based on the touch input applied to the display unit 151 to which the thumbnail is output, or may further reduce the selected thumbnail to output more thumbnails.

In addition, the mobile terminal 100 according to the embodiment of the present invention can extract a specific area (or a desired area to be displayed) other than the area to be hidden based on the touch gesture for the stored specific image. Then, the controller 180 generates the extracted specific region as a thumbnail of the corresponding image. That is, only a part of the original image is generated as a thumbnail. In the thumbnail list corresponding to the execution of the image preview function outputted to the display unit 151, the generated thumbnail is visually distinguished from thumbnails of other images.

Hereinafter, a method of displaying a specific region extracted from a stored specific image as a thumbnail of an image preview according to an embodiment of the present invention will be described in more detail with reference to FIG. 3 and FIGS. 4A and 4B.

FIG. 3 is a flowchart illustrating a method of controlling a mobile terminal according to an embodiment of the present invention. FIGS. 4A and 4B are conceptual diagrams illustrating the control method of FIG.

Referring to FIG. 3, the mobile terminal 100 according to an exemplary embodiment of the present invention may output a specific image to the display unit 151 when it enters the image viewing mode (S310).

Here, the image viewing mode refers to a state in which the stored specific image is displayed on the display unit 151 as the gallery application is executed according to the user's input, or the review screen is touched after the camera is shot.

At this time, there is no limitation on the type of the specific image stored in the display unit 151. For example, the specific image may include an image obtained by directly storing (i.e., capturing) screen information output to the display unit 151, an image containing only a picture or a picture included in a webpage, Screen image information of a possible video file, a picture file stored in advance by a carrier of the mobile terminal 100, a wall paper, an image downloaded from another external device, and the like. In addition, the pre-stored specific image may be an image displayed on a review screen after camera shooting.

When a specific gesture is displayed on the displayed specific image, a specific region can be extracted from the specific image (S320).

To this end, the control unit 180 may enter a thumbnail generation mode of a specific image displayed in response to the input of a specific key or a predetermined touch gesture being performed. In this way, when entering the thumbnail generating mode, the controller 180 can extract a specific area to be generated as a thumbnail from a specific image.

Here, the touch gesture for extracting a specific area means a predetermined touch input for specifying a portion of the displayed specific image that the user wants to expose as a thumbnail or a portion to hide in the thumbnail.

For example, the touch gesture may be a drag-touch input in which a user draws a portion to be extracted in a specific image displayed on a closed curve.

Also, for example, the touch gesture may be a touch gesture that hand-shakes a portion of the displayed specific image that it does not want to be exposed. In this case, the mobile terminal 100 can sense a sudden change in illuminance with respect to the obscured part through the sensing unit 140. [ Then, the controller 180 may output a graphic object (e.g., a focusing box) to the display unit 151 that recommends a portion where a sudden change in illumination is detected or a portion other than the detected portion as a specific region.

Also, for example, the touch gesture may be a gesture input for operating a pop-up focusing box by performing a long-touch input to one area of a specific image displayed.

In addition, there is no limitation on the size and the object of an area that can be extracted from a specific image. For example, the extracted region may be a specific object of an image, or may be a background image excluding a specific object selected. The extracted specific regions are stored in the memory 160 in time order, and may be output in a list form if necessary or automatically registered in the phone book according to the setting.

For example, referring to FIG. 4A, when a specific photo image 401 is displayed on the screen according to the execution of the gallery application, when the user enters the thumbnail creation mode, a focusing box ) 410 is displayed. The user can pinch-out two or more touches applied to the focusing box 410 to close each other or pinch-in the two or more touches to be distant from each other to adjust the size of the focusing box 410, The user can select a portion of the specific photographic image 401 to be exposed as a thumbnail by dragging the touch applied to the focusing box 410 to a desired position to adjust the position of the focusing box 410. [

Then, the controller 180 generates the extracted specific region as a thumbnail of the specific image (S330). Hereinafter, a partial thumbnail may be referred to as a partial thumbnail for the purpose of describing the generated thumbnail. On the other hand, in the case of other images in which a specific region is not extracted, the entire image is generated as a thumbnail.

At this time, even if the sizes of the extracted specific regions are different, the partial thumbnails are all formed in the same size or the same predetermined shape. For example, even if the first partial thumbnail is extracted as a 1/4 size area in the first image and the second partial thumbnail is extracted as a 1/10 size area in the first image, All thumbnails are created with the same size and shape.

For example, referring to FIG. 4A, when a partial image 401a is selected using a focusing box 410, except for a portion of the photographic image 401 that is desired to be hidden or hidden, the focusing box 410 ), It is possible to visually indicate that the partial image 401a is specified. In this state, when the user selects the 'thumbnail generation' key 450 displayed on the display unit 151, the partial image 401a is generated as a thumbnail for the photographic image 401. When a partial image is generated as a thumbnail, a thumbnail 401a " generated on one side of the corresponding photographic image 401 is displayed, as shown in (c) of FIG. 4A, so that the user can recognize the thumbnail. At this time, when the user touches the displayed thumbnail 401a ", the thumbnail 401a "is not enlarged but returns to the step of extracting the specific area shown in Fig. 4A again.

Meanwhile, in another embodiment of the present invention, a plurality of specific regions can be extracted from one image.

When there are a plurality of specific regions thus extracted, the controller 180 can generate a plurality of regions that the user desires to expose as thumbnails of the specific image. In this case, a plurality of thumbnails are generated for one image. Alternatively, when there are a plurality of extracted specific regions, the control unit 180 may synthesize a plurality of regions that the user desires to expose, and generate a single thumbnail.

When the image preview function is executed, the controller 180 outputs a thumbnail list in which the generated thumbnail is visually distinguished from thumbnails of other images in operation S340. Accordingly, the user can instantly recognize, while viewing the thumbnail list, whether each thumbnail is a reduced thumbnail in the original image, or a thumbnail generated only by a part of the thumbnail to be exposed.

Here, the image preview function is a function of displaying stored images as thumbnails each of which is reduced in size so that more images are displayed on one screen. Such an image preview function can be executed, for example, by loading a gallery application, selecting a specific file, or pushing a specific key (soft key or hard key).

Here, the visually distinguishable display means that the generated partial thumbnail and the color, frame, background color, luminance, resolution, transparency, size, etc. of the thumbnail of the other image are displayed differently from each other. Alternatively, in the thumbnail list, a highlighting effect (for example, flicker effect) may be displayed only in the generated partial thumbnail, or specific information may be displayed only in the generated partial thumbnail.

For example, referring to (a) of FIG. 4B, when a gallery application is executed and a specific folder 402 is selected, a photo preview function is executed. 4B, a thumbnail list 405 including only thumbnails having a reduced size of the original photographic images is output. However, in the embodiment of the present invention, as shown in FIG. 4B (c) The frame d 403 of the partial thumbnail 401a " generated by performing the steps of 4a is displayed in a shape different from the frame of other thumbnails. For example, the frame of the partial thumbnail 401a " , The highlighting effect is displayed and visually displayed. Accordingly, the user can immediately recognize the position of the partial thumbnail 401a ".

Meanwhile, although not shown, when a plurality of regions are extracted for one image and a plurality of thumbnails are generated as described above, when the image preview function is executed, as shown in FIG. 4B (c) At the corresponding thumbnail position, the generated plurality of thumbnails can be displayed alternately with each other.

Meanwhile, in an embodiment of the present invention, when a thumbnail list corresponding to the execution of the image preview function is output, in response to the detection of one-way flicking touch input in the thumbnail list output for searching for a specific image , Scrolling is performed. At this time, if the number of stored images is very large, the number of thumbnails corresponding to the number of thumbnails is increased, so that the number of touch input by the user for scrolling is increased.

Accordingly, in one embodiment of the present invention, when the generated partial thumbnail enters the predetermined area of the display unit 151 during the scrolling, the controller 180 stops scrolling the thumbnail list Or the speed of scrolling may be reduced to a preset or gradual level. That is, the position of the generated partial thumbnail may act as a break point of scrolling.

As described above, according to the embodiments of the present invention, when the images stored in the terminal are displayed as thumbnails, only a specific portion desired by the user is displayed on the stored image, so that an image or a person, It provides the convenience of knowing immediately what the stored image is. In addition, since the generated partial thumbnail is visually immediately distinguished from other thumbnails and is a break point in scrolling, the user can more easily and quickly search for a specific image using the partial thumbnail.

FIG. 5A illustrates a specific embodiment of a method for generating a specific region as a thumbnail based on a touch gesture on a photographic image according to an embodiment of the present invention.

On the other hand, in the embodiments described below, it is assumed that the face recognition function is executed in the mobile terminal 100. When the face recognition function is executed, the control unit 180 determines whether or not a face of the user is recognized based on the overall outline of the face, the skin tone information, and the feature information (e.g., : Length, position, angle, shape) can be detected from the image.

When the specific image is outputted in the photograph view mode, the controller 180 can recognize the face included in the specific image. If the recognized face matches the face image pre-stored in the phone book, address book, etc. of the terminal, a graphic object (e.g., a focusing box) recommending the recognized face area as a specific area is compared with the recognized face area Output.

For example, in (a) of FIG. 4A, the focusing box 410 may be initially displayed at a point corresponding to the user's touch gesture. However, if the face included in the photographic image matches the face image stored in the terminal It is possible to output the focusing box 410 to the corresponding face area and recommend this area as a specific area for generating thumbnails.

When the controller 180 detects a touch gesture that blurs a specific face in a specific photo image, the control unit 180 extracts a specific face hidden to a specific area for generating a thumbnail, or extracts an area excluding a hidden face as a specific area for generating a thumbnail Can be extracted.

For this purpose, the extracting unit 182 can extract a specific area based on the operation of the menu output by the touch gesture which is masked by the hand covering the partial area in the specific image. Here, the output menu may be a pop-up window for querying the processing for the hidden area.

For example, referring to FIG. 5A, when a touch gesture for masking a specific person is performed on the specific photographic image 501 output in FIG. 5A, (180) recognizes a specific person included in a region where the illuminance changes rapidly. Then, as shown in (b) of FIG. 5A, a pop-up window 550 for asking about the process for a specific person is output. When the user selects the 'view' key 550a in the pop-up window 500, a thumbnail list 570 is output to the lower region of the photo image 501 as shown in FIG. 5 (d) The thumbnail for the photographic image 501 is displayed only when a specific person is hidden (501b "). On the other hand, if the user selects the " hide " key 550b in the pop- Likewise, a thumbnail list 570 is output to the bottom area of the photographic image 501. At this time, the thumbnail for the photographic image 501 is displayed as an image excluding the specific person (501a ").

Meanwhile, although not shown, when a touch gesture that covers a specific area or a specific person is detected in a specific photograph image, the control unit 180 outputs not only a thumbnail but also an effect of folding based on a part where the corresponding photo image is hidden . In this case, the control unit 180 may correct the portion where the image is shifted according to the folding effect so as to appear natural, or may fold it only in one selected direction.

In addition, the control unit 180 can recognize a face included in a certain area hidden by a hand gesture that covers a certain area in a specific image.

At this time, the recognized face may be exposed or hidden only for the corresponding photographic image. However, as will be described below, the entire image stored in the specific folder or the entire image stored in the specific folder, An image taken at the same place, etc.).

Specifically, the control unit 180 displays a folder (hereinafter, referred to as 'first group') in which the recognized face is not displayed on the thumbnail, a folder designated to be exposed or emphasized on the thumbnail '). According to the user's selection, the recognized face can be extracted only to the specific area for the image, or can be specified to belong to the first group or the second group.

When the recognized face is designated to the first group, the controller 180 changes the thumbnails of the image including the face to a thumbnail with limited display of the recognized face.

In addition, when the recognized face is designated to the second group, the controller 180 changes the thumbnail of the image including the face to a thumbnail in which the recognized face is highlighted (or the recognized face is directly exposed) do.

On the other hand, if the face designated in the first group and / or the second group is deleted, changed or newly added, the controller 180 can update the thumbnails including the face at once or return to the previous thumbnails .

5B is a conceptual diagram for explaining a method of outputting a thumbnail list so that a face of a specific person is not exposed (or a face of a specific person is emphasized) according to an embodiment of the present invention.

As described above, the purpose of generating only a desired portion of a specific image as a thumbnail is to exclude a part of the specific image which is not desired to be exposed by a third party. Accordingly, in the mobile terminal 100 according to the embodiment of the present invention, when the user views the thumbnail list and when the third party views the thumbnail list, the display of the thumbnail list can be set to be different.

To this end, the user input unit 130 of the terminal has a first mode (hereinafter referred to as 'user mode') in which the display of the thumbnail list corresponding to the image preview function is displayed as the original image, A second mode in which only a part of the guest mode is displayed (hereinafter, referred to as " guest mode ").

In the guest mode, when the image preview function is executed, the controller 180 outputs a list of thumbnails whose faces belong to the first group (i.e., a folder designated by the recognized face not to be displayed on the thumbnail). Accordingly, the face designated in the first group is not displayed on the display unit 151. [

In the user mode, when the image preview function is executed, the controller 180 outputs a thumbnail list in which the face belonging to the first group (i.e., the folder designated by the recognized face is not displayed on the thumbnail) is still exposed. In this case, however, the partial thumbnails individually generated by the user are output as they are.

For example, if 'hidden group' 510 is selected as a sub-item of the gallery in FIG. 5B, thumbnails 511 and 522 of specific persons who desire not to be exposed to the user are displayed in the folder. 5B, the user selects the specific photo folder by executing the gallery application, and displays the 'guest mode' (FIG. 5B) in the display mode corresponding to the image preview function of the selected photo folder The thumbnails of the images including the faces 511 and 512 belonging to the hidden group are displayed as thumbnails in which the faces 511 and 512 are hidden as shown in (c) of FIG. 5B, (511-1, 511-2, 512-1). Also, although not shown, if the 'guest mode' icon 520 is touched, the user can immediately switch to the 'user mode' or pop up the cipher key input window for switching.

Hereinafter, with reference to step S340 described above with reference to FIG. 3, various embodiments will be described in which the generated thumbnails are distinguished from thumbnails of other images.

6A to 6C are conceptual diagrams illustrating a method of displaying thumbnails generated according to an embodiment of the present invention in a manner distinct from thumbnails of other images.

When at least one partial thumbnail is generated and the image preview function is executed, the controller 180 may output the generated thumbnail in a shape different from the thumbnail of the other image.

For example, as shown in FIG. 6A, in the thumbnail list 610 corresponding to the execution of the image preview function, the generated thumbnail is a 2 * 1 size thumbnail 603 or a 1 * 2 size thumbnail (605). At this time, the horizontal and vertical lengths of the generated thumbnails may be automatically determined in proportion to the area of the extracted specific area, or may be determined by user setting. In addition, although not shown, the frame of the generated thumbnail may be displayed in a different color and thickness than the frames of other thumbnails, and different frame colors may be displayed in the generated thumbnail.

In addition, when at least one partial thumbnail is generated, the control unit 180 displays information related to the object included in the extracted specific area on the generated thumbnail, .

At this time, if the object included in the specific area is a specific face, the controller 180 searches the photo information of the pre-stored address book matching the specific face and displays the profile information of the address book on the generated thumbnail have.

For example, referring to FIG. 6B, an indication that a frame of the generated thumbnail 606 is distinguishable from other thumbnails is output, and a profile name stored in address book information matched with a face included in the generated thumbnail 606, For example, 'my self' 606a may be displayed on the thumbnail 606.

In addition, when at least one partial thumbnail is generated, the controller 180 may output the first thumbnail list in which the generated thumbnail is arranged at the center of the display unit, when the image preview function is executed.

In other words, the thumbnail list is generally displayed in the order of stored time, as in the photo image corresponding to the thumbnail. In this case, the intention of the user who generated the partial thumbnail is determined to be highly interested, To be exposed at a certain position.

For example, as shown in FIG. 6C, the generated partial thumbnails 607 may be grouped at the center of the screen. When the predetermined time has elapsed, the control unit 180 generates the generated partial thumbnails 607 in the first thumbnail list 607 arranged in the group as shown in (b) of FIG. (607a, 607b, 607c), and changes to the second thumbnail list 611 arranged in the order of the original stored images. At this time, the user can easily see the original storage location of the image corresponding to the specific partial thumbnail 07a, 607b, or 607c by viewing the animation effect that the generated partial thumbnails 607 return to the original position.

In addition, although not shown, thumbnails of images that are determined to be highly interested in the user in addition to those generated by partial thumbnails can be displayed more prominently in the thumbnail list.

For this, the control unit 180 controls the number of times of viewing, in particular, the number of times of zoom-in, the number of hits, the time and the number of times the user's gaze detected through the camera 121 is fixed, History information about the number of similar photographs and the like can be generated.

The control unit 180 gives a weight score to the specific image based on the generated history information. If the weight score exceeds the reference value, the control unit 180 determines that the user's interest is high, and stores a thumbnail corresponding to the image It is possible to control the thumbnail list so that it is displayed in an area that the user can see more clearly, for example, in the center area or the first spot. Alternatively, the controller 180 may output a thumbnail list in a larger size so that thumbnails of images to which a weight score exceeding the reference value is more noticeable than other thumbnails.

At this time, when the image preview mode is executed, the display unit 151 displays a thumbnail determined to be highly interested in the user and a partial thumbnail generated by the user based on the generated history information so as to be visually distinguished have.

In addition, the display unit 151 displays a thumbnail having the highest degree of interest of the user on the most prominent area in the thumbnail list (e.g., a center point) based on the weight score received from the control unit 180, A thumbnail determined to be highly interested can be displayed in the next conspicuous area (e.g., the edge area of the center point).

If a predetermined input signal (e.g., input of a specific key) is detected in a state where the first thumbnail list in which the thumbnails determined to be highly interested by the user is arranged in a conspicuous area is output, It is possible to output a second thumbnail list in which thumbnails are arranged according to the original storage position of the image.

On the other hand, if the number of stored images is very large, the corresponding thumbnail list is also very long, so that the number of user's touch input for scrolling the desired image is increased.

Hereinafter, with reference to FIG. 7, a conceptual diagram for explaining a method of using a thumbnail generated according to an embodiment of the present invention as a breakpoint of scrolling will be described.

Here, scrolling means that when a screen output to the display unit 151 is filled with data to be displayed, a new line appears at the top or bottom of the screen, and all the data moves up or down one line at a time. For example, when scrolling by performing a flicking touch input in the downward direction, a new line appears at the bottom of the screen, all the data is moved up one line, and the top line disappears and disappears. In addition, for example, vertical scrolling means scrolling in the up or down direction, and horizontally scrolling means that the data moves in the lateral direction, such as left or right.

When at least one partial thumbnail is generated, the controller 180 may output a thumbnail list corresponding to the execution of the image preview function when the image preview function is executed. When the user performs the flicking touch input in one direction (vertical direction or horizontal direction) on the thumbnail list output by the user, the thumbnails are scrolled in the direction corresponding to the flicking touch input.

If it is detected that the generated thumbnail enters the predetermined area according to the scrolling of the thumbnail list corresponding to the execution of the image preview function, the controller 180 scrolls the thumbnail list Or reduce the speed of the scrolling.

For example, referring to FIG. 7, a thumbnail list 701 output to the display unit 151 in FIG. 7A is subjected to flicking touch input in the vertical direction, And the thumbnail list 701 is scrolled in proportion to the flicking touch input. At this time, if a specific partial thumbnail 711 is displayed on the screen and enters a predetermined area of the screen, for example, the screen central area 701a (FIG. 7B) Even if there is a flicking touch input, scrolling is immediately stopped and a bar 730 indicating the interruption of scrolling is displayed on the partial thumbnail 711, and a highlighting effect (e.g., flickering) is applied to the partial thumbnail 711 . On the other hand, if the flicking touch input is detected again after the interruption of the scrolling is stopped, the interrupted scrolling is performed again, and the bar 730 indicating the interruption of the scrolling disappears.

As described above, in the embodiment of the present invention, by using the generated partial thumbnail as a break point in scrolling, it is possible to easily find a thumbnail corresponding to a desired image even when a very large amount of images are stored.

Hereinafter, a method of outputting a corresponding image to a screen when a partial thumbnail is selected from a thumbnail list including a generated partial thumbnail will be described in detail.

8A to 8C are conceptual diagrams illustrating a method of outputting an original image corresponding to a selected thumbnail when a generated thumbnail is selected according to an embodiment of the present invention.

Specifically, when at least one partial thumbnail is generated and the generated thumbnail is selected in the thumbnail list corresponding to the execution of the image preview function, the controller 180 first enlarges the selected thumbnail to a preset size Output.

At this time, since the partial thumbnail is generated by only a part of the original image, it is common that the intention of the user who selected the partial thumbnail is also to see the part which is not exposed in the partial thumbnail.

Accordingly, in the first embodiment, the controller 180 may change the enlarged image to an original image corresponding to the selected thumbnail when a predetermined time has elapsed while the selected thumbnail is enlarged to a predetermined size. That is, the thumbnail is restored to the original image with a predetermined animation effect (e.g., a rotating effect) even if there is no next action of the user.

Meanwhile, in the second embodiment, when the selected thumbnail is enlarged to a preset size, the controller 180 may further output a folding indication in one area of the enlarged image. At this time, the position of the folding indication may be related to the position of the specific region extracted in the generation step of the partial thumbnail. Subsequently, the controller 180 may change the enlarged image to the original image corresponding to the selected thumbnail in response to the touch input being detected in the direction indicated by the folding display.

For example, referring to FIG. 8A, when a specific partial thumbnail 811 is selected according to a touch in the thumbnail list 801 in FIG. 8A, a specific partial thumbnail 811 Are displayed on the entire screen, and a plurality of folding marks 820a and 820b are displayed on both lower sides. When the user flicking touches the folded display 820b displayed on the lower right side in a direction opposite to the folded display, the hidden image is changed to an image in which the hidden specific character is displayed (812) as shown in FIG. 8 (c) The folded display 820b disappears. Subsequently, when the user touches the folding indication 820a displayed on the lower left side by flicking in the direction opposite to the folding indication, the image of the hidden specific character is changed to the image 813, and the folding indication 820a ). At this time, when the folded portion is unfolded, an animation effect such as paper spreading can be outputted.

In the third embodiment, when the selected thumbnail is enlarged to a predetermined size, the control unit 180 outputs a folding display to one area of the enlarged image, and when the touch input is detected in the direction indicated by the folding display , It may request a cryptographic key input to change the enlarged image to the original image. If the entered encryption key matches the preset password, the enlarged image is changed to the original image.

For example, in (b) of FIG. 8B, when the user flicking the folding display in one direction, a password pop-up window 830 for inputting a password with an Arabic numerals is displayed. If the number entered in the password pop-up window 830 matches the predetermined password, the enlarged image 811 is changed to the original image (812).

In addition, in the fourth embodiment, when the selected thumbnail is enlarged to a predetermined size, the controller 180 displays the enlarged image as a multitouch (pinch-out) pinch-out as shown in (b) Input can be performed to return to the original image ((c) of FIG. 8C).

Meanwhile, in the fifth embodiment, the controller 180 can recognize a face included in the enlarged image. Then, at least one thumbnail including the recognized face may be searched and output to an area distinguished from the area where the enlarged image is displayed, for example, the lower area. Accordingly, the user can receive a photographic image including the same person without any operation.

Further, in the embodiment according to the present invention, it is needless to say that at least one of the above-described first to fifth embodiments may be applied to one image or a plurality of images, respectively.

Meanwhile, the mobile terminal according to the embodiment of the present invention includes at least one camera 121 for capturing an image, and the user repeatedly captures the same scene several times when capturing a camera. At this time, since a thumbnail corresponding to each photographic image is generated, there is an inconvenience that more touch input is repeated to retrieve a specific photographic image from a thumbnail list having many similar photos.

Hereinafter, a method for generating and displaying a specific image desired by a user as a thumbnail by grouping a plurality of images will be described in more detail with reference to FIGS. 9A to 9C.

In detail, the controller 180 may group a plurality of different images connected to a specific image into one group according to a preset reference.

In this case, the preset reference may include a background, an object, a person, and a color having a high degree of similarity, or may be a case where the user belongs to a range of a drag-and-touch input in a thumbnail list corresponding to the execution of the image preview function have.

If the predetermined reference depends on the degree of similarity, the control unit 180 may analyze the images stored in the time order. For this purpose, the extracting unit 182 extracts an image of a specific image, a location of the external environment (background) of the subject, a person and an object included in the specific image, a situation of the background A plurality of images having a large degree of similarity may be selected and grouped into one group by assigning a weighted score to the image when the image includes at least a plurality of common configurations in an operation state of the object, can do.

Then, the control unit 180 may generate the specific image or a specific region of the specific image as a group thumbnail of the corresponding group based on the touch gesture for the specific image belonging to the same group.

Here, the touch gesture for a specific image may be the same as or similar to the above-described examples.

When the image preview function is executed, the controller 180 outputs a thumbnail list in which the group thumbnail is visually distinguished from other thumbnails.

At this time, when the image preview function is executed, the controller 180 displays time information (e.g., an icon indicating Arabic numerals equal to the number of images included in the group) indicating the number of images included in the group, And displayed on the generated group thumbnail.

When the group thumbnail is selected from the thumbnail list corresponding to the execution of the image preview function, the controller 180 displays thumbnails corresponding to the plurality of images included in the selected group thumbnail on the thumbnail list . That is, when the thumbnails of the partial thumbnails or other images are selected, the thumbnails are enlarged and displayed. However, when the group thumbnails are selected, all the thumbnails of the plurality of images belonging to the group are displayed.

On the other hand, if any one of the expanded thumbnails is selected (the selection at this time may be a long touch input distinguished from the touch input for displaying the enlarged image of the thumbnail) The thumbnails of the selected thumbnails can be collected based on the selected thumbnails and the group thumbnails before being expanded can be changed to the newly selected thumbnails.

For example, as shown in FIG. 9A, it can be seen that some thumbnails 910, 920, 930, 940 of the thumbnail list 901 correspond to group thumbnails. Numbers displayed at the bottom of each of the group thumbnails 910, 920, 930, and 940 indicate the number information of other photo images included in the group of the corresponding thumbnails. When a user short-touches a specific group thumbnail 910, a plurality of thumbnails 911, 912, 913, and 914 included in the group are displayed as shown in FIG. 9A. At this time, if the user selects the specific thumbnail 913 that has been expanded, i.e., double-Dutch, the selected thumbnail 913 is changed to the group thumbnail and the expanded thumbnails are collected again, as shown in FIG.

9B, when a user performs drag-and-touch input for a plurality of different groups, a point 910 where the drag-touch input is started and a corresponding drag-and-touch input Groups the terminated points 930 into one large group, and collectively displays the corresponding group thumbnails 910, 920, 930. At this time, the number displayed at the bottom of the large group thumbnail 910 " accumulates the numerical information displayed in all the group thumbnails grouped. When the group thumbnail 910 corresponding to the start point of the drag- It becomes a thumbnail of the group.

In addition, for example, as shown in FIG. 9C, when entering the generation mode of group thumbnails, all images belonging to the group are displayed in the lower area of the area where the specific image 911 belonging to the group is output A thumbnail list 910 of thumbnails is displayed. Based on the touch gesture, the user can extract a portion from a specific image 911 displayed and extract a portion from another image 912 to generate a combined image 910a as a group thumbnail.

As described above, when the stored images are displayed as thumbnails, similar images are grouped and only one representative thumbnail is displayed so that the total length of the thumbnail list is shortened. Accordingly, the display on the display unit is simplified and the number of movements for searching for a specific image is reduced.

Although a specific image has been described as an example of a photographic image for the purpose of explanation above, the present invention can be similarly applied to a moving image file stored in a gallery application. That is, a thumbnail for a moving image file is generated as a specific scene of a moving image according to a set reference regardless of a user's intention. In the embodiment of the present invention, a thumbnail of a moving image can be generated and displayed Do.

10 is a diagram for explaining a method of generating and displaying a thumbnail of a moving image according to an embodiment of the present invention.

Referring to FIG. 10 (a), a user can execute a gallery application to output a specific moving image 1010 to a screen. When the user enters the thumbnail creation mode and touches the 'play' key 1010a displayed at the center of the displayed moving image 1010, a moving image 1020 reproduced as shown in FIG. 10B is output, When the user operates the play key 1032 in the screen control menu 1030 displayed according to the touch applied to the screen, the moving image 1020 is temporarily suspended. If a signal for stopping the moving picture to be reproduced in the thumbnail generation mode is detected, a 'thumbnail generation' key 1050 is displayed at the bottom of the screen. When the user touches the 'thumbnail generation' key 1050, the corresponding moving image 1020 is changed to a moving image thumbnail.

On the other hand, during the reproduction of the moving image 1020, the user touches the moving element 1037 of the time bar indicator 1035 indicating the position of the moving image to be reproduced by the user in the screen control menu 1030 A thumbnail (not shown) of the moving image corresponding to the position indicated by the moving element 1037 is displayed in the upper area of the moving element 1037. [ Then, the user can drag and move the moving element 1037 to a desired position, and can quickly search for a desired scene by looking at a thumbnail (not shown) displayed on the top of the moving element 1037. A thumbnail (not shown) of a desired scene is displayed, and when the user selects a corresponding thumbnail (not shown), the currently reproduced moving image is directly changed to a scene corresponding to the selected thumbnail. In this state, when the user operates the playback key 1032, the moving image is temporarily suspended, and the scene corresponding to the selected thumbnail is changed to the moving image thumbnail as the user applies the touch to the 'thumbnail generation' key 1050 .

When the user enters the thumbnail creation mode and touches the 'play' key 1010a displayed at the center of the moving image 1010, the reproduced moving image 1020 is output as shown in FIG. 10 (b) When you touch

Subsequently, when the image preview function is executed, as shown in Fig. 10C, the suspended motion image scene is displayed as a moving image thumbnail 1020 ", and the moving image is recognized externally as a thumbnail generated by the user A thick frame is output to the moving image thumbnail 1020 " At this time, when the user selects the thumbnail 1020 ", the corresponding moving image is displayed from the first scene 1010 (or the last scene) of the corresponding moving image. Alternatively, in another embodiment, when the user selects the thumbnail 1020 " , The moving picture may be displayed from the scene corresponding to the corresponding thumbnail 1020 ".

As described above, according to the mobile terminal and its control method according to the embodiment of the present invention, when images stored in the terminal are displayed as thumbnails, only specific parts desired by the user are displayed as thumbnails, It does not expose an object or person that you do not want to show, but provides a convenient way of knowing what the corresponding image is. In addition, a thumbnail including only a specific portion of an image is visually distinguished from other thumbnails, and when a scrolling is performed, the thumbnail is used as a break point, so that even when a very large amount of images are stored, Can be easily found. In addition, when displaying stored images as thumbnails, similar images are grouped to display only one representative thumbnail, thereby providing an effect that the total length of the thumbnail list is shortened. Accordingly, the display on the display unit is simplified and the number of times of scrolling or moving for searching a specific image is reduced.

Further, according to the embodiment disclosed herein, the above-described method can be implemented as a code that can be read by a processor on a medium on which the program is recorded. Examples of the medium that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and may be implemented in the form of a carrier wave (e.g., transmission over the Internet) . Furthermore, the above-described image display apparatus and its control method are not limited to the configuration and the method of the embodiments described above, but the embodiments may be applied to all or part of the embodiments so that various modifications can be made. Some of which may be selectively combined.

Claims (20)

A display unit configured to output a specific image in an image view mode;
An extracting unit for extracting a specific region from the specific image based on the touch gesture for the specific image;
And a controller for generating the extracted specific area as a thumbnail of the specific image and outputting a thumbnail list in which the generated thumbnail is visually distinguished from a thumbnail of another image when the image preview function is executed . The method according to claim 1,
Wherein,
Recognizes a face included in the specific image and outputs the graphic object recommending the recognized face area as the specific area to the recognized face area if the recognized face matches the pre-stored face image . The method according to claim 1,
The extracting unit extracts,
Extracting the obscured part of the area as the specific area or extracting the remaining area excluding the obscured part as the specific area according to the operation of the menu output by the touch gesture that covers a part of the specific image. . The method of claim 3,
Wherein,
Recognizing a face included in the hidden area,
If the recognized face is designated to the first group, changes the thumbnail of the image including the face to a thumbnail with limited display of the recognized face,
If the recognized face is designated to the second group, changes the thumbnail of the image including the face to a thumbnail emphasizing the display of the recognized face. 5. The method of claim 4,
Further comprising a user input unit for receiving a control command for executing one of a first mode and a second mode in which a display of a thumbnail list corresponding to the image preview function is changed,
Wherein,
When the image preview function is executed in the first mode, outputs a thumbnail list in which faces belonging to the first group are hidden,
And when the image preview function is executed in the second mode, outputs a thumbnail list in which faces belonging to the first group are exposed. The method according to claim 1,
Wherein,
Wherein when the image preview function is executed, information related to an object included in the extracted specific area is displayed on the generated thumbnail. The method according to claim 6,
Wherein,
If the object is a specific face, searches the photo information of the pre-stored address book matching the specific face and displays the profile information of the address book on the generated thumbnail. The method according to claim 1,
Wherein,
Wherein when the image preview function is executed, the generated thumbnail is outputted in a shape different from a thumbnail of another image. The method according to claim 1,
Wherein,
When the image preview function is executed, the generated thumbnail outputs a first thumbnail list arranged at the center of the display unit,
And changes the first thumbnail list to a second thumbnail list moved to the original position when the predetermined time elapses. The method according to claim 1,
Wherein,
If it is detected that the generated thumbnail has entered a preset area according to the scrolling of the thumbnail list corresponding to the execution of the image preview function,
And stops the scrolling of the thumbnail list or reduces the speed of the scrolling. The method according to claim 1,
Wherein,
If the generated thumbnail is selected from the thumbnail list corresponding to the execution of the image preview function,
Enlarges the selected thumbnail to a preset size, and outputs the enlarged image to an original image corresponding to the selected thumbnail when a predetermined time elapses. The method of claim 1,
Wherein,
If the generated thumbnail is selected from the thumbnail list corresponding to the execution of the image preview function,
Enlarges the selected thumbnail to a predetermined size, and outputs the folded display to one area of the enlarged image. 13. The method of claim 12,
Wherein,
And changes the enlarged image to an original image corresponding to the selected thumbnail in response to the touch input being detected in the direction indicated by the folding display. 14. The method of claim 13,
Wherein,
Recognizes a face included in the enlarged image and sequentially outputs at least one thumbnail including the recognized face to an area distinguished from the area in which the enlarged image is displayed. The method according to claim 1,
Wherein,
Grouping a plurality of other images connected to the specific image into one group according to a predetermined criterion,
Generating a specific image or a specific area of the specific image as a group thumbnail of the group based on a touch gesture for a specific image belonging to the group,
When the image preview function is executed, outputs a thumbnail list in which the group thumbnail is visually distinguished from other thumbnails. 16. The method of claim 15,
Wherein,
Wherein when the image preview function is executed, time information indicating the number of images included in the group is displayed on the generated group thumbnail. 17. The method of claim 16,
Wherein,
Wherein when the group thumbnail is selected from the thumbnail list corresponding to the execution of the image preview function, the thumbnail list corresponding to the plurality of images included in the selected group thumbnail is expanded on the thumbnail list. . 18. The method of claim 17,
Wherein,
Wherein when one of the plurality of opened thumbnails is selected, the plurality of thumbnails are collected based on the selected thumbnails, and the group thumbnails before being expanded are changed to the selected thumbnails. Outputting a specific image in an image viewing mode;
Extracting a specific region from the specific image based on the touch gesture for the specific image;
Generating the extracted specific region as a thumbnail of the specific image; And
And outputting a thumbnail list in which the generated thumbnail is visually distinguished from a thumbnail of another image when the image preview function is executed. 20. The method of claim 19,
Performing scrolling on a thumbnail list corresponding to execution of the image preview function according to a preset touch input; And
Further comprising the step of stopping the scrolling or reducing the speed of scrolling corresponding to the touch input when the generated thumbnail enters the predetermined area of the display unit according to the scrolling. Control method.

Images