KR102135364B1 - Mobile terminal and method for controlling the same - Google Patents

Abstract

It is disclosed in a mobile terminal and a control method thereof. According to embodiments of the present invention, in an image viewing mode, a display unit configured to output a specific image, an extraction unit extracting a specific area from the specific image based on a touch gesture on the specific image, and the extracted specific It includes a control unit for generating an area as a thumbnail of the specific image, and outputting a list of thumbnails visually distinguishing the generated thumbnails from other image thumbnails when the image preview function is executed.

Description

Mobile terminal and its control method {MOBILE TERMINAL AND METHOD FOR CONTROLLING THE SAME}

The present invention relates to a mobile terminal capable of displaying a thumbnail of a specific image and a control method therefor.

Terminals may be divided into mobile/portable terminals and stationary terminals depending on whether they are portable. Again, the mobile terminal may be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry it.

As such functions are diversified, the terminal is implemented in the form of a multimedia player equipped with complex functions such as taking pictures or videos, playing music or video files, and receiving games and broadcasts. have. Furthermore, in order to support and increase the function of the terminal, it may be considered to improve the structural and software parts of the terminal.

Recently, as the functions of the camera embedded in the mobile terminal have been improved and various media are provided to the mobile terminal, the user can store more images in the memory. Accordingly, in order to alleviate the inconvenience of performing multiple manipulations in order to search for a specific image desired by a user among many stored images, the stored image is reduced to a small size to display a large number of images at once.

On the other hand, the image reduced to such a small size is smaller than the original image and is made of the same image, so there is a disadvantage in that the image or person that the user does not want to show to others is exposed as it is. To this end, when a lock is set on an image, it becomes difficult to immediately recognize what the corresponding image is, and there is a inconvenience in that a user must perform an operation for unlocking each time.

In addition, generally stored images are arranged in order according to the stored time or the recorded time. In this case, if there are too many stored images, several operations are performed until a specific image desired by the user is searched, even by small and reduced images. The inconvenience of repeating is not resolved.

Accordingly, embodiments of the present invention provide a mobile terminal and a control method thereof so that when a stored image is displayed as a thumbnail, a specific portion desired by a user is displayed on the stored image and only a specific portion is displayed. There is a purpose.

In addition, embodiments of the present invention, by recognizing the faces of the people included in the stored image, when showing the thumbnails of the stored image, provides a mobile terminal and a control method implemented to hide a specific face or display only a specific face There are other purposes.

In addition, embodiments of the present invention, there is another object to provide a mobile terminal and a control method thereof implemented so that only one representative thumbnail is displayed by grouping similar images among stored images.

To solve this, the mobile terminal according to an embodiment of the present invention, in the image viewing mode, a display unit configured to output a specific image; An extracting unit extracting a specific area from the specific image based on a touch gesture for the specific image; And a control unit for generating the extracted specific region as a thumbnail of the specific image, and outputting a thumbnail list in which the generated thumbnail is visually distinguished from the thumbnails of other images when the image preview function is executed.

In one embodiment, the control unit recognizes a face included in the specific image, and when the recognized face matches a pre-stored face image, recognizes a graphic object recommending the recognized face region as the specific region. Characterized in that the output to the face area.

In one embodiment, the extracting unit extracts some of the obscured areas as the specific area or extracts the remaining areas except for the obscured part of the area according to manipulation of a menu output by a touch gesture covering a part of the specific image It characterized in that the extraction to the specific region.

In one embodiment, the control unit recognizes a face included in the obscured partial region, and when the recognized face is assigned to the first group, a thumbnail of an image including the face is restricted to display the recognized face. And when the recognized face is assigned to the second group, the thumbnail of the image including the face is changed to a thumbnail in which the display of the recognized face is emphasized.

In one embodiment, further comprising a user input unit for receiving a control command for executing any one of the first mode and the second mode in which the display of the thumbnail list corresponding to the image preview function is different, the control unit, the When the image preview function is executed in the first mode, a thumbnail list of faces belonging to the first group is output, and when the image preview function is executed in the second mode, the thumbnail list of faces belonging to the first group is exposed. Characterized in that the output.

In one embodiment, the control unit is characterized in that when the image preview function is executed, information related to an object included in the extracted specific area is displayed on the generated thumbnail.

In one embodiment, if the object is a specific face, the control unit may search for photo information of a pre-stored address book matching the specific face and display profile information of the corresponding address book on the generated thumbnail.

In one embodiment, when the image preview function is executed, the controller outputs the generated thumbnail in a shape different from that of another image.

In one embodiment, when the image preview function is executed, the control unit outputs the first thumbnail list arranged in the center of the display unit when the image preview function is executed, and when the predetermined time has elapsed, the first thumbnail list is displayed. It is characterized in that the generated thumbnail is changed to a second thumbnail list moved to the original location.

In one embodiment, when the controller detects that the generated thumbnail has entered a predetermined region according to the scrolling of the thumbnail list corresponding to the execution of the image preview function, the controller performs scrolling on the thumbnail list. It is characterized by stopping or reducing the speed of the scrolling.

In one embodiment, when the generated thumbnail is selected from the thumbnail list corresponding to the execution of the image preview function, the control unit enlarges and outputs the selected thumbnail to a preset size, and enlarges when a predetermined time has elapsed. It is characterized in that the image is changed to the original image corresponding to the selected thumbnail.

In one embodiment, when the generated thumbnail is selected from the thumbnail list corresponding to the execution of the image preview function, the control unit enlarges and outputs the selected thumbnail to a predetermined size, and outputs it to a region of the enlarged image. It is characterized by outputting a folding indication.

In one embodiment, the controller is characterized in that in response to the touch input being sensed in the direction indicated by the fold display, the enlarged image is changed to an original image corresponding to the selected thumbnail.

In one embodiment, the control unit recognizes a face included in the enlarged image and outputs at least one thumbnail including the recognized face in order to an area distinct from the area where the enlarged image is displayed. It is characterized by.

In one embodiment, the controller groups a plurality of different images connected to the specific image into a group according to a preset criterion, and based on the touch gesture for the specific image belonging to the group, or It is characterized in that a specific region of the specific image is generated as a group thumbnail of a corresponding group, and when the image preview function is executed, a list of thumbnails visually distinguishing the group thumbnail from other thumbnails is output.

In one embodiment, the control unit is characterized in that when the image preview function is executed, the visual information indicating the number of images included in the corresponding group is displayed on the generated group thumbnail.

In one embodiment, when the group thumbnail is selected from the thumbnail list corresponding to the execution of the image preview function, the controller expands each thumbnail corresponding to a plurality of images included in the selected group thumbnail on the thumbnail list. It characterized in that the control.

In one embodiment, when one of the expanded plurality of thumbnails is selected, the controller collects the expanded plurality of thumbnails based on the selected thumbnail and changes the group thumbnail before expansion to the selected thumbnail. It is characterized by.

In addition, the control method of the mobile terminal according to an embodiment of the present invention, in the image viewing mode, outputting a specific image; Extracting a specific area from the specific image based on a touch gesture for the specific image; Generating the extracted specific region as a thumbnail of the specific image; When the image preview function is executed, a step of outputting a list of thumbnails visually distinguishing the generated thumbnails from other image thumbnails is performed.

In an embodiment, performing scrolling on a thumbnail list corresponding to execution of the image preview function according to a preset touch input; When the generated thumbnail enters a predetermined area of the display unit according to the scrolling, the scrolling may be stopped or the speed of scrolling corresponding to the touch input may be further reduced.

Embodiments of the present invention, when showing a stored image as a thumbnail, by implementing a user to display only a specific portion of the desired image from the stored image, the stored image without exposing an object or person not wanting to show to others in the stored image It provides convenience to recognize what it is.

In addition, by displaying a thumbnail that displays only a specific portion of the image visually different from other thumbnails, and using it as a break point when performing scrolling, a thumbnail corresponding to a desired image even when a very large amount of images are stored Can be easily found.

In addition, according to embodiments of the present invention, when showing stored images as thumbnails, similar images are grouped so that only one representative thumbnail is displayed, thereby reducing the overall length of the thumbnail list. This has the advantage of simplifying the display on the display unit and reducing the number of movements to search for a specific image.

1 is a block diagram illustrating a mobile terminal according to an embodiment disclosed herein.
2A and 2B are a front perspective view and a rear perspective view of a mobile terminal related to the present invention.
3 is a flowchart illustrating a control method of a mobile terminal according to an embodiment of the present invention.
4A and 4B are conceptual views for explaining the control method of FIG. 3.
5A are conceptual diagrams for explaining a method of generating a thumbnail as a specific region extracted based on a touch gesture, according to an embodiment of the present invention.
5B are conceptual diagrams for explaining a method of outputting a thumbnail list so that a face of a specific person is not exposed according to an embodiment of the present invention.
6A to 6C are conceptual views for explaining a method of displaying a thumbnail generated according to an embodiment of the present invention differently from other images.
7 is a conceptual diagram illustrating a method of using a thumbnail generated according to an embodiment of the present invention as a break point of scrolling.
8A to 8C are conceptual views illustrating a method of outputting an original image corresponding to a selected thumbnail when a thumbnail generated according to an embodiment of the present invention is selected.
9A to 9C are conceptual views illustrating a method of grouping a plurality of images and displaying them as a single thumbnail according to an embodiment of the present invention.
10 is a diagram for explaining a method of generating and displaying a thumbnail of a video image according to an embodiment of the present invention.

Hereinafter, exemplary embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings, but the same or similar elements are assigned the same reference numbers regardless of the reference numerals, and overlapping descriptions thereof will be omitted. The suffixes "modules" and "parts" for components used in the following description are given or mixed only considering the ease of writing the specification, and do not have meanings or roles distinguished from each other in themselves. In addition, in the description of the embodiments disclosed herein, when it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed herein, detailed descriptions thereof are omitted. In addition, it should be noted that the accompanying drawings are only for easy understanding of the embodiments disclosed in the present specification, and should not be interpreted as limiting the technical spirit disclosed in the present specification by the accompanying drawings.

Mobile terminals described herein include mobile phones, smart phones, laptop computers, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), navigation, and slate PCs. , A tablet PC, an ultrabook, and the like. However, it will be readily appreciated by those skilled in the art that the configuration according to the embodiments described herein may also be applied to fixed terminals such as digital TVs and desktop computers, except when applicable only to mobile terminals.

1 is a block diagram illustrating a mobile terminal according to an embodiment disclosed herein.

The mobile terminal 100 includes a wireless communication unit 110, an audio/video (A/V) input unit 120, a user input unit 130, a detection unit 140, an output unit 150, a memory 160, and an interface. It may include a unit 170, the control unit 180 and the power supply unit 190. The components shown in FIG. 1 are not essential, so a mobile terminal with more or fewer components may be implemented.

Hereinafter, the components will be described in turn.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include at least one of a broadcast reception module 111, a mobile communication module 112, a wireless Internet module 113, a short-range communication module 114, and a location information module 115. Can.

The broadcast receiving module 111 receives a broadcast signal and/or broadcast related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits broadcast signals and/or broadcast-related information or a server that receives previously generated broadcast signals and/or broadcast-related information and transmits them to a terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, and may also include a TV broadcast signal or a radio broadcast signal combined with a data broadcast signal.

The broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, it may exist in the form of an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or an Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111, for example, DMB-T (Digital Multimedia Broadcasting-Terrestrial), DMB-S (Digital Multimedia Broadcasting-Satellite), MediaFLO (Media Forward Link Only), DVB-H (Digital Video Broadcast) Digital broadcasting signals can be received using digital broadcasting systems such as -Handheld) and ISDB-T (Integrated Services Digital Broadcast-Terrestrial). Of course, the broadcast receiving module 111 may be configured to be suitable for other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and/or broadcast-related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives wireless signals to and from at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, or a text/multimedia message.

The mobile communication module 112 is configured to implement a video call mode and a voice call mode. The video call mode refers to a call state while viewing the other party's video, and the voice call mode refers to a call state without viewing the other party's video. In order to implement a video call mode and a voice call mode, the mobile communication module 112 is formed to transmit and receive at least one of voice and video.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built in or external to the mobile terminal 100. Wireless Internet technologies include WLAN (Wireless LAN), WiFi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), etc. This can be used.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth (Bluetooth™), Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), etc. may be used as short range communication technology. Can.

The location information module 115 is a module for acquiring the location of a mobile terminal, and typical examples thereof include a Global Position System (GPS) module or a Wireless Fidelity (WiFi) module.

Referring to FIG. 1, the A/V (Audio/Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by an image sensor in a video call mode or a shooting mode. The processed image frame may be displayed on the display unit 151.

The image frames processed by the camera 121 may be stored in the memory 160 or transmitted to an external device through the wireless communication unit 110. In addition, the user's location information, etc., may be obtained from the image frames acquired by the camera 121. Two or more cameras 121 may be provided according to the use environment.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, or a voice recognition mode, and processes it as electrical voice data. The processed voice data may be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 and output. Various noise reduction algorithms for removing noise generated in the process of receiving an external sound signal may be implemented in the microphone 122.

The user input unit 130 generates input data according to a control command for controlling the operation of the mobile terminal 100 applied from the user. The user input unit 130 may include a key pad, a dome switch, a touch pad (static pressure/power outage), a jog wheel, a jog switch, and the like.

The sensing unit (or sensing unit 140) of the mobile terminal 100, such as the open/closed state of the mobile terminal 100, the location of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, the acceleration/deceleration of the mobile terminal, etc. It senses the current state and generates a detection signal (or sensing signal) for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, the sensing unit 140 may detect whether the slide phone is opened or closed. In addition, the sensing unit 140 may detect whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled with external devices, or the like.

The output unit 150 is for generating output related to vision, hearing, or tactile sense, and may include a display unit 151, an audio output module 153, an alarm unit 154, and a haptic module 155. have.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, a UI (User Interface) or a GUI (Graphic User Interface) related to the call is displayed. When the mobile terminal 100 is in a video call mode or a photographing mode, the display unit 151 displays a photographed and/or received image, UI, or GUI.

The display unit 151 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display (flexible). display), a three-dimensional display (3D display), an electronic ink display (e-ink display).

Some of these displays may be of a transparent type or a light transmissive type so that the outside can be seen through them. This may be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparant OLED). The rear structure of the display unit 151 may also be configured as a light transmissive structure. With this structure, the user can see an object located behind the terminal body through an area occupied by the display unit 151 of the terminal body.

Two or more display units 151 may be present depending on the implementation form of the mobile terminal 100. For example, a plurality of display units may be spaced apart from one surface or integrally disposed in the mobile terminal 100, or may be disposed on different surfaces.

In addition, the display unit 151 may be configured as a stereoscopic display unit 152 displaying a stereoscopic image.

Here, the stereoscopic image represents a 3-dimensional stereoscopic image, and the 3-dimensional stereoscopic image represents the gradual depth and reality of objects on a monitor or screen. This video is made to feel the same as the real space. The 3D stereoscopic image is implemented using binocular disparity. Binocular parallax means parallax caused by the position of two separate eyes, and when two eyes see different two-dimensional images and the images are transferred to the brain through the retina and fused, they can feel the depth and realism of the stereoscopic image. do.

A three-dimensional display method such as a stereoscopic method (glasses method), an auto stereoscopic method (glasses-free method), or a projection method (holographic method) may be applied to the stereoscopic display unit 152. A stereoscopic method commonly used in home television receivers, etc., includes a Wheatstone stereoscope method.

Examples of the auto stereoscopic method include a paralex barrier method, a lenticular method, an integrated imaging method, and a switchable lens. The projection method includes a reflective holographic method and a transmissive holographic method.

In general, a 3D stereoscopic image is composed of a left image (left eye image) and a right image (right eye image). Depending on how the left and right images are combined into a 3D stereoscopic image, a top-down method of arranging left and right images up and down in one frame, left and right images in one frame L-to-R (left-to-right, side by side) method, which is arranged as a checker board method, which arranges pieces of left and right images in tile form, and left and right images in columns Or, it is divided into an interlaced method in which rows are alternately arranged, and a time sequential (frame by frame) method in which left and right images are alternately displayed by time.

In addition, the 3D thumbnail image may generate a left image thumbnail and a right image thumbnail from the left image and the right image, respectively, of the original image frame, and combine them to generate one 3D thumbnail image. Generally, a thumbnail refers to a reduced image or a reduced still image. The thus generated left image thumbnail and right image thumbnail can be displayed with a distance difference between left and right on the screen as much as a depth sense corresponding to the parallax between the left image and the right image.

The left and right images required for the realization of the 3D stereoscopic image may be displayed on the stereoscopic display unit 152 by a stereoscopic processing unit (not shown). The stereoscopic processing unit is configured to receive a 3D image and extract a left image and a right image therefrom, or receive a 2D image and convert it into a left image and a right image.

On the other hand, when the display unit 151 and a sensor for detecting a touch operation (hereinafter referred to as a “touch sensor”) form a mutual layer structure (hereinafter referred to as a “touch screen”), the display unit 151 outputs In addition to the device, it can also be used as an input device. The touch sensor may have, for example, a form of a touch film, a touch sheet, or a touch pad.

The touch sensor may be configured to convert changes in pressure applied to a specific portion of the display unit 151 or capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only the position and area where the touch object is touched on the touch sensor, but also pressure at the touch. Here, the touch object is an object that applies a touch to the touch sensor, and may be, for example, a finger, a touch pen or a stylus pen, a pointer, and the like.

If there is a touch input to the touch sensor, the corresponding signal(s) is sent to the touch controller. The touch controller processes the signal(s) and then transmits corresponding data to the controller 180. Accordingly, the control unit 180 can know which area of the display unit 151 has been touched, and the like.

Referring to FIG. 1, a proximity sensor 141 may be disposed in an inner region of a mobile terminal surrounded by the touch screen or near the touch screen. Proximity sensor 141 may be provided as an example of the sensing unit 140. The proximity sensor 141 is the presence or absence of an object approaching a predetermined detection surface or an object located in the vicinity of the electromagnetic force or Refers to a sensor that detects without mechanical contact using infrared rays. The proximity sensor 141 has a longer lifespan and a higher utilization than the contact sensor.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, and an infrared proximity sensor. When the touch screen is a capacitive type, it is configured to detect the proximity of the pointer by a change in electric field according to the proximity of an object having conductivity (hereinafter referred to as a pointer). In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of description, an action of making the pointer to be recognized as being positioned on the touch screen without touching the pointer on the touch screen is referred to as a “proximity touch”, and the touch The act of actually touching the pointer on the screen is referred to as "contact touch". The location on the touch screen that is a proximity touch with a pointer refers to a location where the pointer is perpendicular to the touch screen when the pointer is touched close.

The proximity sensor 141 detects a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

When the three-dimensional display unit 152 and the touch sensor form a mutual layer structure (hereinafter, referred to as a'stereoscopic touch screen'), or when the three-dimensional display unit 152 and the three-dimensional sensor for detecting a touch operation are combined with each other The stereoscopic display unit 152 may also be used as a three-dimensional input device.

As an example of the 3D sensor, the sensing unit 140 may include a proximity sensor 141, a three-dimensional touch sensing unit 142, an ultrasonic sensing unit 143, and a camera sensing unit 144.

The proximity sensor 141 measures a distance between a sensing target (eg, a user's finger or a stylus pen) and a detection surface that applies a touch without mechanical contact using an electromagnetic field force or infrared rays. The terminal recognizes which part of the stereoscopic image is touched using the distance. In particular, when the touch screen is a capacitive type, it is configured to detect the degree of proximity of the detection object by changing the electric field according to the proximity of the detection object, and to recognize a 3D touch using the proximity degree.

The three-dimensional touch sensing unit 142 is configured to sense the intensity or duration of touch applied on the touch screen. For example, the three-dimensional touch sensing unit 142 senses the pressure applied to the touch, and when the pressing force is strong, recognizes it as a touch on an object located farther from the touch screen toward the interior of the terminal.

The ultrasonic sensing unit 143 is configured to recognize location information of a sensing target using ultrasonic waves.

The ultrasonic sensing unit 143 may be formed of, for example, an optical sensor and a plurality of ultrasonic sensors. The optical sensor is formed to detect light, and the ultrasonic sensor is formed to detect ultrasound. Since light is much faster than ultrasound, the time for light to reach the optical sensor is much faster than the time for ultrasound to reach the ultrasonic sensor. Therefore, it is possible to calculate the position of the wave generating source by using the time difference from the time that the ultrasound reaches the light as a reference signal.

The camera sensing unit 144 includes at least one of a camera 121, a photo sensor, and a laser sensor.

For example, the camera 121 and the laser sensor are combined with each other to detect a touch of a sensing target for a 3D stereoscopic image. When the distance information detected by the laser sensor is added to the 2D image photographed by the camera, 3D information may be obtained.

As another example, a photo sensor may be stacked on a display element. The photo sensor is configured to scan the movement of the sensing object close to the touch screen. More specifically, the photo sensor mounts photo diodes and TRs (transistors) in rows/columns to scan the contents placed on the photo sensor using electrical signals that change according to the amount of light applied to the photo diode. That is, the photo sensor calculates the coordinates of the sensing object according to the amount of change in light, and thereby acquires the position information of the sensing object.

The audio output module 153 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, call mode or recording mode, voice recognition mode, broadcast reception mode, or the like. The sound output module 153 may also output sound signals related to functions (for example, call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. The sound output module 153 may include a receiver, a speaker, and a buzzer.

The alarm unit 154 outputs a signal for notifying the occurrence of an event in the mobile terminal 100. Examples of events generated in the mobile terminal 100 include call signal reception, message reception, key signal input, and touch input. The alarm unit 154 may output a signal for notifying the occurrence of an event by using other forms, for example, vibration, in addition to a video signal or an audio signal. The video signal or the audio signal may also be output through the display unit 151 or the sound output module 153, so that the display unit 151 and the sound output module 153 may be classified as part of the alarm unit 154. .

The haptic module 155 generates various tactile effects that the user can feel. A typical example of the tactile effect generated by the haptic module 155 may be vibration. The intensity and pattern of vibration generated by the haptic module 155 may be controlled by a user's selection or setting of a control unit. For example, the haptic module 155 may synthesize and output different vibrations or sequentially output them.

In addition to vibration, the haptic module 155 is used for stimulation such as pin arrangement that vertically moves with respect to the contact skin surface, jet or suction power of air through a jet or intake, grazing on the skin surface, contact with an electrode, and electrostatic force. Various tactile effects can be generated, such as the effect caused by and the effect of reproducing the feeling of cold and warm using an element capable of absorbing heat or generating heat.

The haptic module 155 may not only deliver the tactile effect through direct contact, but may also be implemented so that the user can feel the tactile effect through muscle sensations such as fingers or arms. Two or more haptic modules 155 may be provided according to a configuration aspect of the mobile terminal 100.

The memory 160 may store a program for the operation of the controller 180, and may temporarily store input/output data (eg, a phone book, a message, a still image, a video, etc.). The memory 160 may store data related to various patterns of vibration and sound output when a touch is input on the touch screen.

The memory 160 is a flash memory type, a hard disk type, a multimedia card micro type, a memory of a card type (for example, SD or XD memory), RAM (random access memory; RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic It may include a storage medium of at least one type of a disc and an optical disc. The mobile terminal 100 may be operated in connection with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a passage with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device, receives power, transfers it to each component inside the mobile terminal 100, or allows data inside the mobile terminal 100 to be transmitted to the external device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port connecting a device equipped with an identification module , An audio input/output (I/O) port, a video input/output (I/O) port, and an earphone port may be included in the interface unit 170.

On the other hand, the identification module is a chip that stores various information for authenticating the usage rights of the mobile terminal 100, a user identification module (UIM), a subscriber identity module (SIM), universal user authentication It may include a module (universal subscriber identity module; USIM). The device provided with the identification module (hereinafter referred to as an'identification device') may be manufactured in a smart card format. Accordingly, the identification device may be connected to the terminal 100 through the interface unit 170.

Further, when the mobile terminal 100 is connected to an external cradle, the interface unit 170 becomes a passage through which power from the cradle is supplied to the mobile terminal 100 or is input from the cradle by a user. Various command signals may be passages to the mobile terminal 100. Various command signals or power inputted from the cradle may be operated as signals for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The controller 180 controls the overall operation of the mobile terminal 100. For example, it performs control and processing related to voice calls, data communication, video calls, and the like. The controller 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the controller 180, or may be implemented separately from the controller 180.

In addition, the controller 180 may perform pattern recognition processing to recognize handwriting input or drawing input on the touch screen as characters and images, respectively.

In addition, when the state of the mobile terminal satisfies a set condition, the controller 180 may execute a locked state that limits the input of a user's control command to applications. In addition, the controller 180 may control the lock screen displayed in the locked state based on the touch input detected through the display unit 151 in the locked state.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power required for the operation of each component.

Various embodiments described herein can be implemented in a computer- or similar device-readable recording medium using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs) , It can be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions. In some cases, the embodiments described herein may be implemented by the control unit 180 itself.

According to the software implementation, embodiments such as procedures and functions described herein may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein.

The software code can be implemented as a software application written in a suitable programming language. The software code may be stored in the memory 160 and executed by the controller 180.

Hereinafter, a structure of a mobile terminal or a mobile terminal in which components of the mobile terminal or mobile terminals are disposed according to an embodiment of the present invention described with reference to FIG. 1 will be described.

2A is a perspective view of an example of a mobile terminal 100 related to the present invention as viewed from the front.

The disclosed mobile terminal 100 has a bar-shaped terminal body. However, the present invention is not limited to this, and can be applied to various structures such as a watch type, a clip type, a glasses type, or a folder type, a flip type, a slide type, a swing type, and a swivel type in which two or more bodies are movably coupled. have.

The body includes a case (frame, housing, cover, etc.) forming an exterior. In this embodiment, the case may be divided into a front case 101 and a rear case 102. Various electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102, and the battery cover 103 covering the battery 191 may be configured to be detachably attached to the rear case 102. have.

Cases may be formed by injection of synthetic resin or may be formed of metal, for example, stainless steel (STS), aluminum (Al), titanium (Ti), or the like.

A display unit 151, a first sound output module 153a, a first camera 121a, a first operation unit 131, etc. are disposed on the front of the terminal body, and a microphone 122 and an interface unit 170 are disposed on the side. ), the second operation unit 132 may be provided.

The display unit 151 is configured to display (output) information processed by the mobile terminal 100. The display unit 151 includes a liquid crystal display (LCD) for visually expressing information, a thin film transistor-liquid crystal display (TFT LCD), and an organic light-emitting diode (OLED). ), a flexible display, a 3D display, and an e-ink display.

The display unit 151 may include a touch sensing means to receive a control command by a touch method. When a touch is made to any one place on the display unit 151, the touch sensing means may be configured to detect this and input content corresponding to the touched position. The content input by the touch method may be a letter or a number, or an instruction or designable menu item in various modes.

The touch sensing means is formed to be translucent so that visual information output from the display unit 151 is visible, and a structure for enhancing visibility of the touch screen in a bright place may be included. According to FIG. 2A, the display unit 151 occupies most of the front surface of the front case 101.

A first sound output module 153a and a first camera 121a are disposed in an area adjacent to one end of both ends of the display unit 151, and in the area adjacent to the other end, the first operation unit 131 and the microphone 122 ) Is placed. The second operation unit 132 (see FIG. 3B), the interface unit 170, and the like may be disposed on the side of the terminal body.

The first sound output module 153a may be implemented in the form of a receiver that delivers a call sound to the user's ear or a loud speaker that outputs various alarm sounds or multimedia playback sounds.

The sound generated from the first sound output module 153a may be configured to be emitted along an assembly gap between structures. In this case, the appearance of the mobile terminal 100 can be made simpler because the holes formed independently for the sound output are not visible or hidden. However, the present invention is not limited to this, and a hole for emitting the sound may be formed in the window.

The first camera 121a processes image frames such as still images or moving images obtained by an image sensor in a video call mode or a shooting mode. The processed image frame may be displayed on the display unit 151.

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100, and may include first and second operation units 131 and 132. The first and second operation units 131 and 132 may also be collectively referred to as a manipulating portion, and any method is adopted as long as the user operates with a tactile feeling, such as touch, push, scroll, etc. Can be.

In this drawing, the first operation unit 131 is illustrated on the basis of the touch key, but the present invention is not limited thereto. For example, the first operation unit 131 may be a push key or a combination of a touch key and a push key.

Contents input by the first and/or second operation units 131 and 132 may be variously set. For example, the first operation unit 131 receives a command such as a menu, home key, cancel, search, etc., and the second operation unit 132 adjusts the volume of sound output from the first sound output module 153a or A command such as switching to the touch recognition mode of the display unit 151 may be input.

The microphone 122 is formed to receive a user's voice, other sounds, and the like. The microphone 122 may be provided at a plurality of locations and configured to receive stereo sound.

The interface unit 170 serves as a path through which the mobile terminal 100 can exchange data with external devices. For example, the interface unit 170 is a connection terminal for connecting with an earphone by wire or wireless, a port for short-range communication (for example, an infrared port (IrDA Port), a Bluetooth port, a wireless LAN port (Wireless LAN Port), etc., or at least one of power supply terminals for supplying power to the mobile terminal 100. The interface unit 170 may be implemented in the form of a socket that accommodates an external card such as a subscriber identification module (SIM) or a user identity module (UIM) or a memory card for storing information.

2B is a rear perspective view of the mobile terminal 100 shown in FIG. 2A.

Referring to FIG. 2B, a second camera 121b may be additionally mounted on the rear surface of the terminal body, that is, the rear case 102. The second camera 121b has a shooting direction substantially opposite to the first camera 121a (see FIG. 3A) and may be a camera having different pixels from the first camera 121a.

For example, the first camera 121a has a low pixel so that the user's face is captured and transmitted to the other party in the case of a video call, etc., and the second camera 121b photographs a general subject and does not immediately transmit it. In many cases, it is preferable to have a high pixel. The first and second cameras 121a and 121b may be installed on the terminal body to be rotatable or pop-up.

A flash 123 and a mirror 124 are additionally disposed adjacent to the second camera 121b. When the flash 123 photographs the subject with the second camera 121b, the light is directed toward the subject. The mirror 124 allows the user to see his/her face or the like when the user wants to photograph (self-photograph) himself using the second camera 121b.

A second sound output module 153b may be additionally disposed on the rear side of the terminal body. The second sound output module 153b may implement a stereo function together with the first sound output module 153a (refer to FIG. 3A), or may be used to implement a speakerphone mode during a call.

On the side of the terminal body, an antenna (not shown) for receiving a broadcast signal may be additionally disposed in addition to an antenna for a call. The antenna forming part of the broadcast receiving module 111 (refer to FIG. 1) may be installed to be withdrawn from the terminal body.

The terminal body is provided with a power supply unit 190 (see FIG. 1) for supplying power to the mobile terminal 100. The power supply unit 190 may include a battery 191 built in the terminal body or configured to be detachable from the outside of the terminal body. In this figure, the battery cover 103 is coupled to the rear case 102 so as to cover the battery 191 to limit the detachment of the battery 191 and illustrates that the battery 191 is protected from external shocks and foreign matter. .

Then, the location information of the extracted mobile terminal 100 is transmitted to the mobile terminal 100 through the Wi-Fi location positioning server 310 to obtain location information.

The mobile terminal 100 according to an embodiment of the present invention, which includes the above-described configuration including at least one configuration, stores at least one image in a predetermined storage space of the memory 160 based on a predetermined control command. Can be stored in. At this time, in order to output the stored image, the gallery application may be executed according to user input. When the gallery application is executed, the display unit 151 may output thumbnails of a plurality of stored images. Then, the controller 180 may enlarge or output the selected thumbnail based on the touch input applied to the display unit 151 on which the thumbnail is output, or further reduce the selected thumbnail to output more thumbnails.

In addition, the mobile terminal 100 according to an embodiment of the present invention may extract a specific area except for (or want to show) an area to hide, based on a touch gesture for a specific stored image. Then, the controller 180 generates a specific region extracted as a thumbnail of the corresponding image. That is, only a part of the original image is generated as a thumbnail. In addition, in the thumbnail list corresponding to the execution of the image preview function output to the display unit 151, the generated thumbnail is displayed visually distinct from other image thumbnails.

Hereinafter, with reference to FIGS. 3 and 4A and 4B, a method of displaying a specific region extracted from a stored specific image as a thumbnail of an image preview according to an embodiment of the present invention will be described in more detail.

3 is a flowchart illustrating a control method of a mobile terminal according to an embodiment of the present invention, and FIGS. 4A and 4B are conceptual views illustrating the control method of FIG. 3.

First, referring to FIG. 3, when the mobile terminal 100 according to an embodiment of the present invention enters an image viewing mode, a specific image may be output to the display unit 151 (S310 ).

Here, the image viewing mode means a state in which a specific image stored is displayed on the display unit 151 as a gallery application is executed according to a user input or when a review screen is touched after taking a camera.

At this time, there is no limitation on the type of the pre-stored specific image output to the display unit 151. For example, in the specific image, the screen information output on the display unit 151 is stored as it is (ie, a captured image), an image in which only a picture or picture included in a webpage is stored, and playback One screen information of a possible video file, a picture file pre-stored by the operator of the mobile terminal 100, wallpaper (wall paper), and images downloaded from other external devices may be all included. Also, the pre-stored specific image may be an image displayed on a review screen after the camera is photographed.

When a touch gesture for the displayed specific image is detected while the specific image is displayed as described above, a specific region may be extracted from the specific image (S320 ).

To this end, first, the controller 180 may enter a thumbnail generation mode of a specific image displayed in response to an input of a specific key or a preset touch gesture. As described above, when entering the thumbnail generation mode, the controller 180 may extract a specific area to be generated as a thumbnail from a specific image.

In addition, here, the touch gesture for extracting a specific area means a preset touch input for specifying a part that a user wants to expose as a thumbnail or a part that a user wants to hide in a thumbnail in a displayed specific image.

For example, the touch gesture may be a drag touch input that a user draws a portion to be extracted from a specific image displayed as a closed curve.

In addition, for example, the touch gesture may be a touch gesture that covers a part of the displayed specific image that is not desired to be exposed by hand. In this case, the mobile terminal 100 may detect a sudden change in illuminance with respect to the obscured portion through the sensing unit 140. Then, the controller 180 may output a graphic object (eg, a focusing box) recommending a portion except for the portion where the sudden change in illuminance is detected or a portion other than the detected portion to a specific area, to the display unit 151.

In addition, for example, the touch gesture may be a gesture input for manipulating a pop-up focusing box as long-touch input is performed on a region of a specific image displayed.

In addition, there are no restrictions on the size and object of an area that can be extracted from a specific image. For example, the region to be extracted may be a specific object of the image, or may be a background screen excluding the selected specific object. In addition, the specific area extracted as described above may be stored in the memory 160 in chronological order, and output in a list form if necessary, or may be automatically registered in a phonebook according to a setting.

For example, referring to (a) of FIG. 4A, when a specific photo image 401 is output on a screen according to execution of a gallery application, when entering a thumbnail generation mode, a focusing box in a specific photo image ) 410 is displayed. The user adjusts the size of the focusing box 410 by pinching out two or more touches applied in the focusing box 410 to close each other or by pinching in to move away from each other, and By dragging the touch applied in the focusing box 410 to a desired position, and adjusting the position of the focusing box 410, a portion to be exposed as a thumbnail in a specific photo image 401 can be selected.

Thereafter, the controller 180 generates a specific region extracted as a thumbnail of the specific image (S330 ). Hereinafter, it may be referred to as'partial thumbnail' for the purpose of describing the generated thumbnail. On the other hand, as for other images in which a specific region is not extracted, the entire image is generated as a thumbnail.

At this time, even if the sizes of the extracted specific regions are different, the partial thumbnails are all manufactured in the same size or in the same shape. For example, the first and second portions of the first and second portions of the first image are extracted from the first image, while the second portion of the thumbnail is the 1/10 region of the first image. Thumbnails are all created with the same size and shape.

For example, referring to (b) of FIG. 4A, when a partial image 401a excluding a portion to be exposed or desired to be hidden from the photo image 401 is selected using the focusing box 410, the focusing box 410 By darkening the area outside of ), it is possible to visually indicate that the partial image 401a is specified. In this state, when the user selects the'thumbnail generation' key 450 displayed on the display unit 151, the partial image 401a is generated as a thumbnail for the photo image 401. When the partial image is generated as a thumbnail, the thumbnail 401a" generated on one side of the corresponding photographic image 401 is displayed as shown in FIG. 4A(c) so that the user can recognize it. At this time, when the user touches the displayed thumbnail 401a", the corresponding thumbnail 401a" does not appear enlarged and returns to the step of extracting the specific region shown in (a) of FIG. 4A again.

Meanwhile, in another embodiment of the present invention, a plurality of specific regions may be extracted from one image.

When a plurality of specific regions are extracted as described above, the controller 180 may generate a plurality of regions to be exposed as thumbnails of the specific image, respectively. In this case, a plurality of thumbnails are generated for one image. Alternatively, when there are a plurality of extracted specific regions, the controller 180 may synthesize a plurality of regions to be exposed and generate them as a single thumbnail.

Subsequently, when the image preview function is executed, the controller 180 outputs a thumbnail list in which the generated thumbnail is visually distinguished from the thumbnails of other images (S340). Accordingly, the user can instantly recognize whether each thumbnail is a thumbnail that is reduced in size from the original image or a thumbnail that is generated only by a portion of the image to be exposed while viewing the thumbnail list.

Here, the image preview function refers to a function in which stored images are displayed as thumbnails that are respectively reduced in size, so that more images are displayed on one screen. Such an image preview function can be executed, for example, by running a gallery application, selecting a specific file, or pushing a specific key (soft key or hard key).

In addition, here, the visually distinct display indicates that the color, frame, background color, luminance, resolution, transparency, size, etc. of the generated partial thumbnail and the thumbnail of another image are displayed differently. Alternatively, in the thumbnail list, a highlighting effect (eg, a flickering effect) may be displayed only on the generated partial thumbnail, or it may be a case where specific information is displayed only on the generated partial thumbnail.

For example, referring to (a) of FIG. 4B, when a gallery application is executed and a specific folder 402 is selected, a photo preview function is executed. Then, in the prior art, a thumbnail list 405 including only thumbnails of a reduced size of the original photographic images as shown in (b) of 4b was output, but in an embodiment according to the present invention, as shown in FIG. 4B (c), FIG. The frame d 403 of the partial thumbnail 401a" generated by performing the steps of 4a is displayed in a different shape from that of other thumbnails. For example, the frames of the partial thumbnails 401a" have different colors, thicker thickness. It is displayed as a highlighting effect, and it is displayed visually. Accordingly, the user can immediately recognize the position of the partial thumbnail 401a".

On the other hand, although not shown, when a plurality of thumbnails are generated by extracting a plurality of regions for one image as described above, when the image preview function is executed, the corresponding image in FIG. At the corresponding thumbnail positions, a plurality of generated thumbnails may be displayed alternately.

On the other hand, in an embodiment according to the present invention, when a thumbnail list corresponding to the execution of the image preview function is output, in response to the detection of a flicking touch input in one direction in the output thumbnail list to search for a specific image, , Scrolling is performed. At this time, if the number of stored images is very large, the number of thumbnails corresponding to the image is very large, so the number of touch inputs by the user for scrolling is also increased.

Thus, in one embodiment according to the present invention, the controller 180 stops scrolling of the thumbnail list when the generated partial thumbnail enters a predetermined area of the display unit 151 during the scrolling. Alternatively, the speed of scrolling may be reduced by a predetermined amount or gradually. That is, the position of the generated partial thumbnail may act as a break point of scrolling.

As described above, according to embodiments of the present invention, when displaying images stored in the terminal as thumbnails, by implementing only a specific part desired by the user in the stored images, an image or person not wanting to be shown to others is not exposed. It provides the convenience to immediately recognize what the stored image is. In addition, since the generated partial thumbnail is visually immediately distinguished from other thumbnails and becomes a break point when scrolling is performed, the user can easily and quickly search for a specific image using the partial thumbnail.

5A illustrates a specific embodiment of a method of generating a specific area as a thumbnail based on a touch gesture on a photographic image according to an embodiment of the present invention.

Meanwhile, in the embodiments described below, it is assumed that the face recognition function is executed in the mobile terminal 100. When the face recognition function is executed, the controller 180, in order to recognize a specific face, the overall outline or skin tone information of the face and feature information about the components of the face such as eyes, nose, mouth, eyebrows, or ears (eg : Length, position, angle, shape) can be detected from the image.

When a specific image is output in the photo viewing mode, the controller 180 may recognize a face included in the specific image. Then, by comparing whether the recognized face matches a previously stored face image in the terminal's phone book, address book, or the like, and if it matches, a graphic object (eg, a focusing box) recommending the recognized face area as a specific area to the recognized face area Output.

For example, in FIG. 4A (a), the focusing box 410 may be initially output at a point corresponding to a user's touch gesture, but the face included in the photo image matches the face image stored in the terminal. If it is recognized that the focusing box 410 is output to the corresponding face area, the area may be recommended as a specific area for thumbnail generation.

In addition, when a touch gesture covering a specific face is detected in a specific photo image, the controller 180 extracts the specific face that is obscured as a specific area for generating thumbnails, or extracts an area other than the obscured specific face as a specific area for thumbnail generation. Can be extracted.

To this end, the extraction unit 182 may extract a specific area based on the manipulation of the menu output by a touch gesture that covers a part of the area in a specific image. Here, the output menu may be a pop-up window querying the processing of the hidden area.

For example, referring to FIG. 5A, when a touch gesture covering a specific person is performed in the specific photo image 501 output in (a) of FIG. 5A, according to the illumination information transmitted from the detector 140, the controller 180 recognizes a specific person included in the area where the illuminance has changed rapidly. Then, as shown in (b) of FIG. 5A, a pop-up window 550 asking the processing for the specific person who is hidden is output. When the user selects the'show' key 550a in the pop-up window 500, as shown in FIG. 5A (d), a thumbnail list 570 is output in the lower area of the photo image 501, at this time. As for the thumbnail for the photo image 501, only a specific person that is hidden is displayed (501b"). Meanwhile, when the user selects the'hidden' key 550b in the pop-up window 500, as shown in (c) of FIG. 5A. Likewise, the thumbnail list 570 is output in the lower area of the photo image 501, and the thumbnail for the photo image 501 is displayed as an image excluding a specific person being hidden (501a").

On the other hand, although not shown, the controller 180 outputs an effect of folding a photo based on a hidden part as well as a thumbnail when a touch gesture covering a specific area or a specific person is detected in a specific photo image. Can. In this case, the control unit 180 may correct a portion in which an image is displaced to look natural or fold only in one selected direction according to a folding effect.

Also, the controller 180 may recognize a face included in a part of the hidden area by a touch gesture covering a part of the area in a specific image.

At this time, the recognized face may be exposed or hidden only for the corresponding photographic image, but as described below, the entire stored image or the entire image stored in a specific folder, or set criteria (images taken in a certain period, It can be applied to all images that conform to the same location).

Specifically, the controller 180 specifies a folder (hereinafter referred to as a'first group') in which the recognized face does not appear in a thumbnail, and a folder designated such that the recognized face is exposed or emphasized in a thumbnail (hereinafter referred to as a'second group'). '). Then, according to the user's selection, the recognized face may be extracted into a specific area only for the corresponding image, or may be designated to belong to the first group or the second group.

When the recognized face is assigned to the first group, the controller 180 changes thumbnails of the images including the face to thumbnails with limited display of the recognized face.

In addition, when the recognized face is assigned to the second group, the controller 180 changes the thumbnail of the image including the face to a thumbnail in which the display of the recognized face is emphasized (or the recognized face is exposed as it is). do.

Meanwhile, when the faces assigned to the first group and/or the second group are deleted, changed, or newly added, the controller 180 can update thumbnails including the corresponding faces at once or return to the previous thumbnail. .

Hereinafter, FIG. 5B is a conceptual diagram illustrating a method of outputting a thumbnail list so that a face of a specific person is not exposed (or a face of a specific person is emphasized) according to an embodiment of the present invention.

As described above, the purpose of generating only a portion of a desired part of a specific image as a thumbnail is to exclude a portion of the specific image that is unwilling to be exposed by a third party. Accordingly, in the mobile terminal 100 according to an embodiment of the present invention, when the user views the thumbnail list and when the third party views the thumbnail list, the display of the thumbnail list may be set to be different.

To this end, the user input unit 130 of the terminal includes a first mode (hereinafter referred to as'user mode') in which the display of a thumbnail list corresponding to the image preview function is displayed as an original image, and at least some of the stored images are original images A control command for executing any one of the second mode (hereinafter referred to as a'guest mode') in which only a part of is displayed may be input.

In the guest mode, when the image preview function is executed, the controller 180 outputs a thumbnail list in which faces belonging to the first group (ie, a folder designated so that recognized faces do not appear in thumbnails) are hidden. Accordingly, the face designated in the first group is not displayed on the display unit 151.

In the user mode, when the image preview function is executed, the controller 180 outputs a thumbnail list in which faces belonging to the first group (that is, a folder designated so that the recognized faces do not appear in the thumbnails) are still exposed. However, even in this case, the partial thumbnails individually generated by the user are output as they are.

For example, when'hidden group' 510 is selected as a sub-item of the gallery in (a) of FIG. 5B, thumbnails 511 and 522 of specific persons that the user does not want to be exposed are output to the corresponding folder. And, as shown in (b) of FIG. 5B, the user selects a specific photo folder by running the gallery application, and the display mode corresponding to the image preview function of the selected photo folder is'guest mode' ( When 520) is executed, as shown in (c) of FIG. 5B, thumbnails of images including faces 511 and 512 belonging to the hidden group, and thumbnails in which the corresponding faces 511 and 512 are hidden The list of thumbnails changed to (511-1, 511-2, 512-1) is output. And, although not shown, when the'guest mode' 520 icon is touched, it is possible to immediately switch to the'user mode' or to pop up an encryption key input window for switching.

Hereinafter, various embodiments of displaying the generated thumbnail differently from the thumbnails of other images will be described with reference to step S340 described above with reference to FIG. 3.

6A to 6C are conceptual views for explaining a method of displaying a thumbnail generated according to an embodiment of the present invention differently from other images.

When the image preview function is executed while the at least one partial thumbnail is generated, the controller 180 may output the generated thumbnail in a shape different from that of another image.

For example, as illustrated in FIG. 6A, in the thumbnail list 610 corresponding to the execution of the image preview function, the generated thumbnail is a 2*1 sized thumbnail 603 or a 1*2 sized thumbnail. 605. At this time, the horizontal and vertical lengths of the generated thumbnails may be automatically determined in proportion to the area of the extracted specific area, or may be determined by user settings. In addition, although not shown, the frames of the generated thumbnails may be displayed in different colors and thicknesses from the frames of other thumbnails, and different frame colors may be displayed in the generated thumbnails.

In addition, when the image preview function is executed in a state where at least one partial thumbnail is generated, the control unit 180 displays information related to the object included in the extracted specific region on the generated thumbnail, and displays another thumbnail. Can be distinguished from.

At this time, if the object included in the specific area is a specific face, the controller 180 may search for photo information of a pre-stored address book matching the specific face, and display profile information of the corresponding address book on the generated thumbnail. have.

For example, referring to FIG. 6B, a display in which the frame of the generated thumbnail 606 is distinguished from other thumbnails is output, and the profile name stored in the address book information matching the face included in the generated thumbnail 606, For example,'our self' 606a may be displayed on the thumbnail 606.

In addition, when the image preview function is executed in a state where at least one partial thumbnail is generated, the controller 180 may output a first thumbnail list in which the generated thumbnail is disposed in the center of the display unit.

That is, the thumbnail list is generally displayed in the chronological order stored in the same way as the photo image corresponding to the thumbnail, but here, the user's intention to generate the partial thumbnail is determined to be of high interest, so that the user can view the thumbnail better. It was exposed to the location.

For example, as illustrated in (a) of FIG. 6C, the generated partial thumbnails 607 may be arranged in a group in the center of the screen. At this time, when a predetermined time has elapsed, the controller 180 displays the generated partial thumbnails 607 in the first thumbnail list 607 arranged in groups as shown in (b) of FIG. 6C. Move to (607a, 607b, 607c), and change to the second thumbnail list 611 arranged in the order of the original stored image. At this time, the user can easily determine the original storage location of the image corresponding to the specific partial thumbnails (07a, 607b, or 607c) by viewing the animation effect in which the generated partial thumbnails 607 return to the original position.

In addition, although not shown, in addition to being generated as partial thumbnails, thumbnails of images determined to have high user interest can be displayed more prominently in the thumbnail list.

To this end, the controller 180 reads the number of times for a specific image, in particular, the number of zoom-ins, the number of hits, the time and number of times the user's gaze is detected through the camera 121, and continuous shooting It is possible to generate history information about the number of similar pictures.

Then, based on the generated history information, the controller 180 assigns a weight score for a specific image, and if the weight score exceeds a reference value, determines that the user's interest is high, and selects a thumbnail corresponding to the image. In the thumbnail list, you can control which areas the user can see better, such as the central area or the first point. Alternatively, the controller 180 may allow a thumbnail of an image to which a weight score exceeding a reference value is assigned to be more prominent than other thumbnails, so that a larger size is output from the thumbnail list.

In this case, when the image preview mode is executed, the display unit 151 may display the thumbnails determined to have high user interest based on the generated history information and the partial thumbnails generated by the user so as to be visually distinguished. have.

In addition, the display unit 151 displays the thumbnail with the highest interest of the user on the most prominent area in the thumbnail list based on the weight score received from the controller 180 (eg, a central point), and then Thumbnails judged to be of high interest can then be displayed in a prominent area (eg, the edge area of the central point).

In addition, when a first thumbnail list in which a thumbnail determined to have high user interest is placed in a prominent area is output, the controller 180 detects a preset input signal (eg, input of a specific key). The second thumbnail list in which the thumbnails are arranged according to the original storage location of the image may be output.

On the other hand, if the number of stored images is very large, the corresponding thumbnail list is also very long, so the number of touch inputs by the user to scroll and search for the desired image is also increased.

Thus, hereinafter, with reference to FIG. 7, a conceptual diagram for explaining a method of using a thumbnail generated according to an embodiment of the present invention as a break point of scrolling.

Here, scrolling means that when the screen output on the display unit 151 is full of data to be displayed, new lines appear at the top or bottom of the screen, and all data is shifted up or down by one line. For example, in the case of scrolling by performing flicking touch input in the downward direction, a new line appears at the bottom of the screen, and all data is moved up one line at a time, and the line at the top disappears and becomes invisible. Further, for example, vertical scrolling means scrolling in the up or down direction, and horizontal scrolling means that data is moved in the lateral direction, such as left or right.

When the image preview function is executed while the at least one partial thumbnail is generated, the controller 180 may output a list of thumbnails corresponding to the execution of the image preview function. When the user performs flicking touch input in one direction (vertical or horizontal direction) in the output thumbnail list, thumbnails are scrolled in a direction corresponding to the flicking touch input.

As described above, when it is detected that the generated thumbnail has entered a predetermined area according to the scrolling of the thumbnail list corresponding to the execution of the image preview function, the controller 180 scrolls the thumbnail list. You can stop or reduce the speed of the scrolling.

For example, referring to FIG. 7, as the thumbnail list 701 output to the display unit 151 in FIG. 7A is flicked in the vertical direction, a vertical direction is applied to one side of the screen. The scroll bar 720 moving to is output, and the thumbnail list 701 is scrolled in proportion to the flicking touch input. At this time, when a specific partial thumbnail 711 is output to the screen and enters a predetermined area of the screen, for example, the center area 701a of the screen (FIG. 7(b)), shown in FIG. 7(c). As shown, even if there is a flicking touch input, scrolling is immediately stopped, and a bar 730 indicating a stop of scrolling is displayed on the partial thumbnail 711, so that a highlighting effect (for example, flickering) is applied to the corresponding partial thumbnail 711. Is output. On the other hand, if the flicking touch input is detected again after the scroll interruption is stopped, the interrupted scrolling is performed again, and the bar 730 indicating the scroll interruption disappears.

As described above, in the embodiment of the present invention, by using the generated partial thumbnail as a break point when performing scrolling, it is easy to find a thumbnail corresponding to a desired image even when a very large amount of images is stored.

Hereinafter, a method of displaying a corresponding image on a screen when a partial thumbnail is selected from a thumbnail list including the generated partial thumbnail will be described as a specific example.

In this regard, FIGS. 8A to 8C are conceptual views for explaining a method of outputting an original image corresponding to a selected thumbnail when a thumbnail generated according to an embodiment of the present invention is selected.

Specifically, when at least one partial thumbnail is generated and the generated thumbnail is selected from the thumbnail list corresponding to the execution of the image preview function, the controller 180 first enlarges the selected thumbnail to a preset size. Output.

At this time, since the partial thumbnail is generated only from a part of the original image, it is common for the user's intention to select the partial thumbnail to also view the part that is not exposed in the partial thumbnail.

Accordingly, in the first embodiment, when a predetermined time elapses while the selected thumbnail is enlarged to a predetermined size, the controller 180 may change the enlarged image to an original image corresponding to the selected thumbnail. That is, even if there is no user's next action, the thumbnail is restored to the original image with a predetermined animation effect (eg, a rotating effect).

Meanwhile, in the second embodiment, when the selected thumbnail is enlarged to a predetermined size, the control unit 180 may further output a folding display on an area of the enlarged image. At this time, the position of the folding display may be related to the position of a specific region extracted in the step of generating a partial thumbnail. Subsequently, the controller 180 may change the enlarged image to an original image corresponding to the selected thumbnail in response to the touch input being sensed in the direction indicated by the fold display.

For example, referring to FIG. 8A, when a specific partial thumbnail 811 is selected according to a touch in the thumbnail list 801 in FIG. 8A (a), a specific partial thumbnail 811 as shown in FIG. 8A (b). ) Is enlarged and displayed on the entire screen, and at this time, a plurality of folding marks 820a and 820b are displayed on both sides of the bottom. When the user flicks the folded display 820b displayed on the lower right in a direction opposite to the folded display, the hidden specific person is changed to an image in which the hidden specific person is displayed as shown in FIG. The folded display 820b disappears. Subsequently, when the user flicks the folding display 820a displayed on the bottom left in a direction opposite to the folded display, the hidden specific person is changed to an image shown (813), and the folding display displayed on the bottom left (820a) ). At this time, when the folded portion is unfolded, an animation effect as if the paper is unfolded can be output.

On the other hand, in the third embodiment, when the selected thumbnail is enlarged to a predetermined size, the controller 180 further outputs a folding display in an area of the enlarged image, and a touch input is sensed in a direction indicated by the folding display. In response, it may request to enter an encryption key to change the enlarged image to the original image. If the entered encryption key matches the preset password, the enlarged image is changed to the original image.

For example, in FIG. 8B (b), when the user flicks the folding display in one direction, a password pop-up window 830 for inputting a password using Arabic numerals is displayed. If the number entered in the password pop-up window 830 and the preset password match, the enlarged image 811 is changed to the original image (812).

In addition, in the fourth embodiment, when the selected thumbnail is enlarged to a preset size, the controller 180 multi-touches a pinch-out of the enlarged image as shown in (b) of FIG. 8C. The input can be performed to return to the original image (Fig. 8c (c)).

Meanwhile, in the fifth embodiment, the controller 180 may recognize a face included in the enlarged image. Then, at least one thumbnail including the recognized face may be searched and output in order to an area distinguished from an area where the enlarged image is displayed, for example, a lower area. Accordingly, the user can be provided with a photographic image containing the same person without any manipulation.

In addition, in the embodiment according to the present invention, it is a matter of course that a combination of at least one of the above-described first to fifth embodiments can be applied to one image or to multiple images, respectively.

On the other hand, the mobile terminal according to an embodiment of the present invention includes at least one camera 121 for photographing an image, and the user repeatedly photographs the same scene several times when the camera is photographed. At this time, since corresponding thumbnails are generated for each photographic image, there is a inconvenience in that more touch inputs are repeated to search for a particular photographic image in the list of thumbnails or thumbnails with many similar photographs.

Hereinafter, a method of generating and displaying a specific image desired by a user as a thumbnail by grouping a plurality of images will be described in more detail with reference to FIGS. 9A to 9C.

Specifically, the controller 180 may group a plurality of different images connected to a specific image into a group according to a preset criterion.

In this case, the preset criterion may include a background, an object, a person, and a color having a high degree of similarity, or a case in which a drag touch input is within an authorized range of a user in a thumbnail list corresponding to the execution of an image preview function. have.

When the preset criterion depends on the similarity, the controller 180 may analyze the stored images in chronological order. To this end, the extraction unit 182 includes a subject constituting a specific image, a place of an external environment (background) of the subject, a person and an object included in a specific image, a situation (such as day or night), the person and When the object operation state, the image includes at least a plurality of common components in the shooting or stored time, or the more common components, the weight score is given to select a plurality of images with high similarity and group them into one group. can do.

Then, the controller 180 may generate the specific image or a specific region of the specific image as a group thumbnail of the corresponding group, based on a touch gesture for a specific image belonging to the same group.

Here, the touch gesture for a specific image may be the same or similar to the examples described above.

When the image preview function is executed, the controller 180 outputs a list of thumbnails visually distinguishing the group thumbnails from other thumbnails.

At this time, when the image preview function is executed, the control unit 180 includes visual information indicating the number of images included in the corresponding group (eg, an icon representing an Arabic number equal to the number of images included in the group). It can be controlled to be displayed on the created group thumbnail.

In addition, when the group thumbnail is selected from the thumbnail list corresponding to the execution of the image preview function, the controller 180 expands each thumbnail corresponding to a plurality of images included in the selected group thumbnail on the thumbnail list. Control. That is, when the above-described partial thumbnail or thumbnail of another image is selected, the corresponding thumbnail is enlarged and displayed, but when the group thumbnail is selected, all thumbnails of a plurality of images belonging to the group are displayed.

On the other hand, if any one of a plurality of unfolded thumbnails is selected (the selection at this time may be a long touch input distinct from a touch input for displaying an enlarged image of the corresponding thumbnail), the controller 180, the unfolded plural The thumbnails of can be collected based on the selected thumbnail, and the group thumbnail before expansion can be changed to a newly selected thumbnail.

For example, as illustrated in (a) of FIG. 9A, it can be seen that some of the thumbnails 910, 920, 930, and 940 of the thumbnail list 901 correspond to a group thumbnail. The number displayed at the bottom of each group thumbnail (910, 920, 930, 940) indicates the number information of other photo images included in the group of the corresponding thumbnail. When a user short-touches a specific group thumbnail 910, a plurality of thumbnails 911, 912, 913, and 914 included in the corresponding group are shown as shown in FIG. 9A (b). At this time, when the user selects a specific thumbnail 913 that is expanded, that is, double-dutch, as shown in FIG. 9A (c), the selected specific thumbnail 913 is changed to a group thumbnail and the expanded thumbnails are collected again.

In addition, for example, as illustrated in (a) of FIG. 9B, when a user performs a drag touch input on a plurality of different groups, a point 910 at which the drag touch input is started and a corresponding drag touch input are The ended point 930 is grouped into one large group, and corresponding group thumbnails 910, 920, and 930 are collected and displayed. At this time, the number displayed at the bottom of the large group thumbnail 910" is a value obtained by accumulating the number information displayed on all grouped group thumbnails. And, the group thumbnail 910 corresponding to the starting point of the drag touch input is large. It becomes a group thumbnail.

In addition, for example, as shown in (a) of FIG. 9C, when entering the generation mode of the group thumbnail, all images belonging to the group in the lower region of the region where the specific image 911 belonging to the group is output. The thumbnail list 910 of the is displayed. Based on the touch gesture, the user may extract a part from the displayed specific image 911 and extract a part from the other image 912 to generate a synthesized image 910a as a group thumbnail.

As described above, when the stored images are displayed as thumbnails, similar images are grouped and implemented so that only one representative thumbnail is displayed, thereby reducing the overall length of the thumbnail list. As a result, the display on the display unit is simplified, and the number of movements for searching for a specific image is reduced.

On the other hand, for the purpose of explanation above, a specific image is described as an example of a photographic image, but the same may be applied to a video file stored in the gallery application. That is, a thumbnail for a video file is generated as a specific scene of a video according to a set criterion regardless of the user's intention. In an embodiment according to the present invention, it is possible to generate and display a thumbnail of a video with a specific scene desired by the user. Do.

10 is a view for explaining a method of generating and displaying a thumbnail of a video image according to an embodiment of the present invention.

Referring to (a) of FIG. 10, a user may display a specific video image 1010 by executing a gallery application. Entering the thumbnail generation mode, when the'play' key 1010a displayed in the center of the displayed video image 1010 is touched, a video image 1020 played as shown in FIG. 10(b) is output, When the user operates the playback key 1032 in the screen control menu 1030 displayed according to the touch applied to the screen, the video image 1020 is suspended. As described above, when a signal in which the video screen being played in the thumbnail generation mode is interrupted is detected, a'thumbnail generation' key 1050 is displayed at the bottom of the screen. Then, when the user applies a touch to the'thumbnail generation' key 1050, the corresponding video image 1020 is changed to a video thumbnail.

On the other hand, during playback of the video image 1020, the user touches the moving element 1037 of the time bar indicator 1035 indicating the location of the video image played by the user in the screen control menu 1030 displayed by touching the screen. When it does, a thumbnail (not shown) of the video image corresponding to the position indicated by the mobile element 1037 is displayed on the upper region of the mobile element 1037. Then, the user can move the mobile device 1037 by dragging it to a desired position, and view a thumbnail (not shown) displayed on the top of the mobile device 1037 to search for a desired scene more quickly. When a thumbnail (not shown) of the desired scene appears and the user selects the corresponding thumbnail (not shown), the currently played video image is immediately changed to a scene corresponding to the selected thumbnail. In this state, when the user operates the playback key 1032, the video image is suspended, and the scene corresponding to the selected thumbnail is changed to a video thumbnail as the user applies a touch to the'thumbnail generation' key 1050. .

In addition, when entering the thumbnail creation mode and touching the'play' key 1010a displayed in the center of the video image 1010, the played video image 1020 is output as shown in FIG. 10(b). If you touch

Subsequently, when the image preview function is executed, as shown in FIG. 10C, the suspended video scene is displayed as a video thumbnail 1020", and is recognized externally as a thumbnail generated by the user. A thick frame is output to the video thumbnail 1020" to make it possible. At this time, when the user selects the corresponding thumbnail 1020", the first scene 1010 (or the last scene) of the corresponding video is displayed. Or, in another embodiment, when the user selects the corresponding thumbnail 1020" , The video may be displayed from the scene corresponding to the thumbnail 1020".

As described above, according to a mobile terminal and a control method thereof according to an embodiment of the present invention, when displaying images stored in a terminal as thumbnails, a specific portion desired by a user is implemented to be displayed as a thumbnail, so that the stored image can be displayed to others It provides the convenience of easily recognizing what the corresponding image is, without exposing the object or person you do not want to show. In addition, by displaying a thumbnail containing only a specific part of the image visually distinct from other thumbnails, and using it as a break point when performing scrolling, a thumbnail corresponding to a desired image even when a very large amount of images are stored Can be easily found. In addition, when showing the stored images as thumbnails, similar images are grouped to display only one representative thumbnail, thereby providing an effect of reducing the overall length of the thumbnail list. This simplifies the display on the display unit and reduces the number of scrolling or movements to search for a specific image.

Furthermore, according to an embodiment disclosed in the present specification, the above-described method may be implemented as code readable by a processor on a medium on which a program is recorded. Examples of the medium readable by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like, and implemented in the form of a carrier wave (for example, transmission through the Internet). Includes. Furthermore, the image display device and the control method described above are not limited to the configuration and method of the above-described embodiments, and the above-described embodiments can be applied to all or each of the embodiments so that various modifications can be made. Some may be configured by selectively combining.

Claims (20)

In the image viewing mode, a display unit configured to output a specific image;
An extracting unit extracting a specific area from the specific image based on a touch gesture for the specific image;
And a control unit for generating the extracted specific region as a thumbnail of the specific image, and outputting a list of thumbnails visually distinguishing the generated thumbnail from other image thumbnails when the image preview function is executed,
The extraction unit,
Depending on the operation of the menu output by a touch gesture covering a portion of the specific image, a partial region that is obscured is extracted as the specific region, or a remaining region other than the obscured portion is extracted as the specific region,
The control unit,
The thumbnail list is controlled to be executed in one of the first mode in which the original image is displayed as it is and the second mode in which at least some of the pre-stored images are displayed in a part of the original image,
When the image preview function is executed in the second mode, the mobile terminal is characterized in that the thumbnail list is changed so that thumbnails of images including at least one predetermined person are not output. delete According to claim 1,
The extraction unit,
A movement characterized by extracting some of the obscured areas as the specific area or extracting the remaining areas except for the obscured part as the specific area according to the operation of the menu output by the touch gesture covering the partial area of the specific image. terminal. delete delete According to claim 1,
The control unit,
When the image preview function is executed, the mobile terminal characterized in that the information related to the object included in the extracted specific area is controlled to be displayed on the generated thumbnail. delete According to claim 1,
The control unit,
And when the image preview function is executed, outputting the generated thumbnail in a shape different from that of another image. According to claim 1,
The control unit,
When the image preview function is executed, the generated thumbnail outputs a first thumbnail list arranged in the center of the display unit,
When a predetermined time has elapsed, the mobile terminal characterized in that the first thumbnail list is changed to a second thumbnail list in which the generated thumbnail is moved to the original location. According to claim 1,
The control unit,
When it is detected that the generated thumbnail has entered a preset area according to the scrolling of the thumbnail list corresponding to the execution of the image preview function,
And stopping the scrolling of the thumbnail list or reducing the speed of the scrolling. delete According to claim 1,
The control unit,
When the generated thumbnail is selected from the thumbnail list corresponding to the execution of the image preview function,
A mobile terminal characterized in that the selected thumbnail is enlarged to a predetermined size and output, and a folding display is output on one area of the enlarged image. delete delete According to claim 1,
The control unit,
According to a preset criterion, a plurality of different images connected to the specific image are grouped into one group,
Based on a touch gesture on a specific image belonging to the group, the specific image or a specific region of the specific image is generated as a group thumbnail of the corresponding group,
When the image preview function is executed, a mobile terminal characterized by outputting a list of thumbnails visually distinguishing the group thumbnails from other thumbnails. delete delete delete In the image viewing mode, outputting a specific image;
Extracting some of the obscured areas as a specific area or extracting the remaining areas except for the obscured areas as a specific area according to manipulation of a menu output by a touch gesture covering a part of the specific image;
Generating the extracted specific region as a thumbnail of the specific image; And
And when the image preview function is executed, outputting a list of thumbnails in which the generated thumbnails are visually distinguished from thumbnails of other images.
The thumbnail list,
The first mode in which the original image is displayed as it is, and at least some of the pre-stored images are executed in one of the second modes in which only a portion of the original image is displayed,
When the image preview function is executed in the second mode, a control method of a mobile terminal, characterized in that a thumbnail list is changed so that thumbnails of images including at least one specific person set in advance are not output. delete

Images