KR20150019493A - Mobile terminal and method for controlling the same - Google Patents

Abstract

The present invention relates to a mobile terminal capable of securing the use of a terminal by considering the convenience of a user and a method for controlling the same. According to at least one embodiment of the present invention, provided is a control method of searching an image which a user wants to search by various methods in a large amount of image data stored in the memory of a mobile terminal.

Description

[0001] MOBILE TERMINAL AND METHOD FOR CONTROLLING THE SAME [0002]

The present invention relates to a mobile terminal and a control method thereof, in which usage of a terminal can be realized by further considering convenience of a user.

The terminal can move And can be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

In order to support and enhance the functionality of such terminals, it may be considered to improve the structural and / or software parts of the terminal.

Such terminals have recently been mass-produced and supplied in the form of a smart phone, and can process and / or store a large amount of data with high hardware performance. Also, the performance of the camera provided in the mobile terminal is improved. In other words, this improvement in hardware performance not only improves the amount of images stored through data reception, but also increases the amount of images stored through the camera.

Generally, a terminal provides a galleries application which is an application for browsing such image data. However, in these gallery applications, the images are generally arranged in the order of the date in which the data was received or the date taken in the camera, and the sorted images are sequentially displayed. Therefore, currently, there is a demand for a control method that allows the mobile terminals 100 to search an image to be searched by a user from a large amount of image data.

It is an object of the present invention to provide a mobile terminal and a control method therefor which allow a user to search desired image data among a large number of stored image data.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, unless further departing from the spirit and scope of the invention as defined by the appended claims. It will be possible.

According to an aspect of the present invention, there is provided an image processing apparatus including a memory for storing tag information corresponding to each of a plurality of image data and a plurality of image data, a user input unit for receiving a search key for searching image data, And searching for at least one image data having tag information corresponding to the search key.

According to another aspect of the present invention, there is provided an image processing method including storing tag information corresponding to a plurality of image data and image data, receiving a search key for searching image data, And retrieving at least one image data having tag information corresponding to the search key.

Effects of the mobile terminal and the control method according to the present invention will be described as follows.

According to at least one embodiment of the present invention, there is an advantage that it is possible to provide a user interface that can easily and conveniently search image data to be searched by a user among many image data.

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
FIG. 2 is a perspective view of a mobile terminal or a portable terminal according to the present invention, as viewed from the front.
3 is a rear perspective view of the portable terminal shown in FIG.
FIG. 4 is a rear perspective view showing a rear surface of a rear case of a mobile terminal according to an embodiment of the present invention. FIG.
5 is a conceptual diagram for performing a scan operation on a plurality of image data according to an embodiment of the present invention.
6 is a diagram illustrating a state diagram of a Gallary application according to an embodiment of the present invention.
7 is a diagram illustrating an example of a method for searching image data through a sketch search mode according to an embodiment of the present invention.
8 is a diagram illustrating a method for providing a sketch frame, in accordance with an embodiment of the present invention.
9 is a diagram showing an example of a method of outputting a retrieved image based on a sketch input, according to an embodiment of the present invention.
10 is a diagram showing an example of a control method capable of performing additional editing on a sketch input received from a user according to an embodiment of the present invention.
11 is a diagram showing an example of a method of searching for whether a form of image data is a horizontal form or a vertical form according to an embodiment of the present invention.
12 is a diagram showing the types of previously stored simple sketches, according to an embodiment of the present invention.
13 to 14 are diagrams showing an example of a method of providing a result of a plurality of image data searched according to an embodiment of the present invention.
15 is a diagram showing an example of a control method of performing a search by adding a text search condition according to an embodiment of the present invention.
16 is a diagram illustrating a method for setting additional search conditions based on handwritten input according to an embodiment of the present invention.
17 is a diagram showing an example of a method of retrieving image data in a text search mode according to an embodiment of the present invention.
18 is a diagram showing an example of a method of retrieving image data based on a sketch of a histogram, according to an embodiment of the present invention.
19 is a flowchart illustrating a method of controlling a mobile terminal having an image data search function according to an embodiment of the present invention.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), and navigation. However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules 1100 may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information means information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only (Mobile Broadcasting Business Management System), ISDB-T (Integrated Services Digital Broadcasting (ISDB-T)), Digital Multimedia Broadcasting (MBMS) Digital Broadcast-Terrestrial) or the like. Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 may comprise at least one of a base station, an external terminal, and a server on a mobile communication network such as Global System for Mobile communications (GSM), Code Division Multiple Access (CDMA), Wideband CDMA Transmits and receives wireless signals with one. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. Wireless Internet technologies include WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), GSM, CDMA, WCDMA, LTE Evolution (but not limited to) may be used.

The wireless Internet module 113, which performs wireless Internet access through the mobile communication network, is connected to the mobile communication module 110 through the mobile communication network, for example, from the viewpoint that the wireless Internet access by Wibro, HSDPA, GSM, CDMA, WCDMA, LTE, (112).

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for obtaining the position of the mobile terminal, and a representative example thereof is a Global Position System (GPS) module. According to the current technology, the position information module 115 calculates distance information and accurate time information from three or more satellites, and then applies a trigonometric method to the calculated information to obtain three-dimensional (3D) information according to latitude, longitude, The current position information can be accurately calculated. At present, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another satellite is widely used. In addition, the GPS module 115 can calculate speed information by continuously calculating the current position in real time.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a button 136 and a touch sensor (static pressure / static electricity) 137 located on the front and rear sides or side surfaces of the mobile terminal 100, and may include a keypad, A dome switch, a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. Examples of the sensing unit 140 include a gyroscope sensor, an acceleration sensor, and a geomagnetic sensor.

For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 is for generating output related to the visual, auditory or tactile sense and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154 .

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, and a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

(Hereinafter, referred to as a 'touch screen') in which a display unit 151 and a sensor for sensing a touch operation (hereinafter, referred to as 'touch sensor') form a mutual layer structure, It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller (not shown). The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

The proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is enclosed by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch" The act of actually contacting the pointer on the touch screen may be referred to as "contact touch. &Quot; The location where the pointer is proximately touched on the touch screen may refer to a position where the pointer corresponds vertically to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. In this case, the display unit 151 and the sound output module 152 may be a type of the alarm unit 153. The display unit 151 and the sound output module 152 may be connected to the display unit 151 or the sound output module 152, .

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the haptic module 154 are controllable. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, contact of an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. At least two haptic modules 154 may be provided according to the configuration of the mobile terminal 100.

The memory 160 may store a program for processing and controlling the control unit 180 and temporarily store the input / output data (e.g., telephone directory, message, audio, still image, For example. The memory 160 may store the frequency of use of each of the data (for example, each telephone number, each message, and frequency of use for each multimedia).

In addition, the memory 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Therefore, the identification device can be connected to the mobile terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user to the cradle may be transmitted And may be a passage to be transmitted to the terminal 100. The various command signals or the power source inputted from the cradle may be operated as a signal for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The battery may be an internal battery configured to be chargeable, and may be detachably coupled to the terminal body for charging or the like. The connection port may be configured as an example of the interface unit 170 in which an external charger for supplying power for charging the battery is electrically connected.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The embodiments described may be implemented by the control unit 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

Hereinafter, the display unit 151 will be described on the assumption that the touch screen 151 is used to describe the embodiment of the present invention. However, the embodiments of the present invention are not limited to the touch screen 151.

In addition, in the embodiment of the present invention, the touch gesture refers to a gesture realized by touching or touching the touch screen 151 in a touch manner, and the touch input means an input received by the touch gesture.

The touch gesture may be tapping, touching and dragging, flicking, press, multi-touch, pinch-in, pinch-out, .

Tapping refers to a touch gesture such as a click of a mouse on a general personal computer, which is an operation of lightly pressing and releasing the touch screen 151 once.

In addition, the touch drag may be an operation of moving to a specific position while keeping the touch on the touch screen 151, and when the object is dragged, the object may be continuously displayed according to the drag direction.

In addition, flicking refers to an operation of touching the touch screen 151 and then moving the contact in a specific direction (upward, downward, left, right or diagonal) and then releasing the contact point. The mobile terminal 100, The processing of the specific operation is performed based on the flicking direction, speed, and the like. For example, the page turning operation of the e-book can be performed based on the flicking direction.

In addition, the press refers to an operation of continuously holding the touch for a predetermined time or longer after touching the touch screen 151. [

In addition, the multi-touch means an operation of touching a plurality of points of the touch screen 151 at the same time.

In addition, the pinch-in refers to an operation of dragging the touch screen 151 in a direction in which a plurality of pointers that are multi-touching approach each other. That is, a drag that starts from at least one point among a plurality of points that are multi-touched on the touch screen 151 and occurs in a direction in which a plurality of points that are multi-touched approach each other.

In addition, the pinch-out refers to an operation of dragging the touch screen 151 in a direction in which a plurality of pointers in a multitouch direction move away from each other. That is, dragging starts from at least one point among a plurality of points that are multi-touched in the touch screen 151 and occurs in a direction in which a plurality of points that are multi-touched move away from each other.

FIG. 2 is a perspective view of a mobile terminal or a portable terminal according to the present invention, as viewed from the front.

The disclosed mobile terminal 100 includes a bar-shaped terminal body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

The body of the mobile terminal 100 includes a casing 101, 102, In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102.

In some cases, electronic components may be mounted on the surface of the rear case 102 as well. Electronic components mounted on the surface of the rear case 102 include a battery, a USIM card, a memory card, and the like which are detachable by the user. At this time, the rear case 102 may further include a rear cover 103 for covering the surface thereof. When the rear cover 103 is removed, the surface of the rear case 102 is exposed.

As shown in FIG. 2, when the rear cover 103 is coupled, only a part of the side surface of the rear case 102 may be exposed. When the size of the rear cover 103 is reduced, Some may also be exposed. And an opening 103 'for exposing the camera 121' or the sound output unit 152 'to the outside when the rear cover 103 covers the entire rear surface of the rear case 102.

The cases 101, 102 and 103 may be formed by injection molding of synthetic resin or may be formed of a metal material such as stainless steel (STS) or titanium (Ti).

The display unit 151, the sound output module 152, the camera 121, the user input units 130/131 and 132, the microphone 122, the interface unit 170, and the like may be disposed in the terminal cases 101 and 102 .

The display unit 151 occupies most of the main surface of the front case 101. A sound output module 152 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132 and the interface unit 170 may be disposed on the side surfaces of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100 and may include a plurality of operation units 131 and 132. The operation units 131 and 132 may be collectively referred to as a manipulating portion and may be employed in any manner as long as the user operates in a tactile manner.

The contents inputted by the first or second operation unit 131 or 132 may be variously set. For example, the first operation unit 131 receives a command such as start, end, scroll, and the like, and the second operation unit 132 inputs a command such as the adjustment of the sound output from the sound output module 152 And the third operation unit 133 can receive a command such as switching to the touch recognition mode of the display unit 151 or the like.

3 is a rear perspective view of the portable terminal shown in FIG.

Referring to FIG. 3, a camera 121 'may be further mounted on the rear surface of the terminal body, that is, the rear case 102. The camera 121 'may have a photographing direction substantially opposite to the camera 121 (see FIG. 2), and may be a camera having different pixels from the camera 121.

For example, the camera 121 may have a low pixel so that the face of the user can be photographed and transmitted to the other party in case of a video call or the like, and the camera 121 ' It is preferable to have a large number of pixels. The cameras 121 and 121 'may be installed in the terminal body so as to be rotatable or pop-upable.

A flash 123 and a mirror 124 are additionally disposed adjacent to the camera 121 '. The flash 123 illuminates the subject when the subject is photographed by the camera 121 '. The mirror 124 allows the user to illuminate the user's own face or the like when the user intends to shoot himself / herself (self-photographing) using the camera 121 '.

An acoustic output 152 'may be additionally disposed on the rear surface of the terminal body. The sound output unit 152 'may implement the stereo function together with the sound output unit 152 (see FIG. 2A), and may be used for the implementation of the speakerphone mode during a call.

In addition to the antenna for talking and the like, a broadcast signal reception antenna 116 may be additionally disposed on the side of the terminal body. The antenna 116, which forms part of the broadcast receiving module 111 (see FIG. 1), can be installed to be able to be drawn out from the terminal body.

FIG. 4 is a rear perspective view showing a rear surface of a rear case of a mobile terminal according to an embodiment of the present invention. FIG. 4, the front case 101, the rear case 102, the rear cover (or the battery cover) 103, the camera 121 ', the interface unit 170, the microphone 122, A battery 191, a battery mounting portion 104, a USIM card mounting portion 166, and a memory card mounting portion 167 are shown.

The rear case 102 may have a space on which external components such as the battery loading unit 104, the USIM card loading unit 105, and the memory card loading unit 106 may be mounted. In general, an external component mounted on the surface of the rear case 102 is used to extend the functions of the mobile terminal 100 in order to satisfy diversified functions of the mobile terminal 100 to be.

As the performance of the mobile terminal 100 is diversified, a battery 191 may be replaced with a battery 191 as shown in FIG. 4 to compensate for a large power consumption. In the case of the interchangeable type, a battery mounting portion 104 is formed on the surface of the rear case 102 so that a user can attach and detach the battery. The battery mounting portion 104 is provided with a connection terminal to be electrically connected to a component mounted inside the case.

4, the USIM card mounting portion 166 and the memory card mounting portion 167 may be formed on the side of the battery mounting portion 104 or on the bottom surface of the battery mounting portion 104, May be formed to be exposed to the outside. In this case, the size of the battery mounting portion 104 can be larger, and the size of the battery 191 can be increased.

4 shows a structure in which the USIM card mounting portion 166 and the memory card mounting portion 167 are mounted on the rear surface of the rear case 102. In addition, Do.

The rear cover 103 covers the surface of the rear case 103 to secure the battery 191, the USIM card, the memory card, and the like mounted on the rear case 102 so as not to be detached from the rear case 102, Thereby protecting the external component. A waterproof structure (not shown) for sealing the rear case 102 and the rear cover 103 when the rear case 102 and the rear cover 103 are coupled to each other to prevent water from being injected into the external components.

The mobile terminals 100 are mass produced and supplied in the form of a smart phone, and can process and / or store a large amount of data with high hardware performance. Also, the performance of the camera 121 provided in the mobile terminal is improved. In other words, this improvement in hardware performance not only improves the amount of images stored through data reception, but also increases the amount of images stored through the camera.

Generally, the mobile terminal 100 provides a galleries application which is an application for browsing such image data. However, in these gallery applications, the images are generally arranged in the order of the date in which the data was received or the date taken in the camera, and the sorted images are sequentially displayed. Therefore, the mobile terminal 100 does not provide an environment in which a user can search an image to be searched among a large amount of image data.

Accordingly, in one embodiment of the present invention, a control method that enables a user to quickly and quickly find image data to be searched among a plurality of image data stored in the mobile terminal 100 is proposed. Also, a mobile terminal for such a control method is provided.

In the control method according to an embodiment of the present invention, metadata is stored together for each of a plurality of images in order to easily search for an image. Metadata is data given to a content (for example, image data) in accordance with a certain rule in order to efficiently find and use the information found in a large amount of information. Here, the location and content of the content, information on the creator, rights condition, use condition, usage history, and the like are recorded. Personal computers usually use metadata for the purpose of expressing data and for the purpose of quickly finding data. In the following embodiments, the metadata of a predetermined image is referred to as " tag information " in order to emphasize that the metadata is specific image data.

On the other hand, in an embodiment of the present invention, it is proposed that the type of tag information is not limited to the above-described example, but includes additional information so as to be more suitable for retrieving image data. Examples of additional information on the tag information include 1) outline shape information 2) photographing position information via GPS / base station 3) image data attribute information set by the user 4) photographing mode information 5) storage path information and 6) And histogram information.

The outline shape information means information representing the outer shape of a predetermined object existing on the image formed by the image data. For example, in the case of image data in which a specific person is photographed, the outline shape information for the image data may be information indicating the outer shape of a specific person photographed. It is assumed that the control unit 180 can automatically acquire the above-described outline shape information through a predetermined algorithm capable of analyzing the image. In one embodiment of the invention, there is no limit to the algorithm for analyzing the image. Accordingly, the present invention can be applied to an embodiment of the present invention if it is an algorithm that can extract the outer shape of an object through image data.

The photographing position information may mean position information of the mobile terminal 100 when photograph data is photographed when the image data is photographed by the camera. Accordingly, the control unit 180 determines the position of the mobile terminal 100 based on the position information module 115, and uses the position information at the time of photographing as the tag information together with the image photographed through the camera 121 Can be stored.

Examples of the photographing mode information include a person, a sport, a night, a landscape, a night portrait, and a close-up photographing mode. Examples of the attribute information of the image data set by the user include a resolution setting of a photo, a flash setting, and a zoom-in / zoom-out setting.

The storage path information means identification information (for example, application name) of an application for storing image data in the memory 160. [ For example, when it is assumed that predetermined image data is stored through a camera application, the storage path information for the predetermined image data may be a "camera application ". The image data may be stored not only by photographing but also through data reception. In this case, the data transmission / reception application may be stored as storage path information. Furthermore, the storage path information may be function identification information (for example, a function name) of a predetermined application to be used at the time of storing the image data.

The histogram information may mean that the brightness information of a pixel of each image data is represented by a graph. In an embodiment of the present invention, it is proposed to search for image data by using such histogram information, and in order to provide such an embodiment, histogram information may be included as tag information.

The control unit 180 according to an embodiment of the present invention acquires the tag information of the photographed photograph when the photograph is photographed through the camera, stores the original image data of the photographed photograph, It can be stored in correspondence with the original image data. In the following description and claims of the present invention, when it is necessary to emphasize that the tag information is the tag information of the photograph taken through the camera, the tag information is referred to as photographed tag information. The photographing tag information may include at least one of the above-described examples of the tag information.

Meanwhile, the control unit 180 according to the embodiment of the present invention may shorten the search time of the image data by storing the tag information in a folder separate from the original of the image data.

However, in the case of image data other than the image data photographed through the camera, the tag information described above may not be stored together. For example, the image data photographed through the mobile terminal not according to the embodiment of the present invention or the image data stored through downloading from the web may not store the tag information. Accordingly, the controller 180 according to an embodiment of the present invention performs an operation for generating tag information on the image data for which the tag information is not stored , It is called a scan operation for the image). That is, the controller 180 according to another exemplary embodiment of the present invention performs a scan operation on a predetermined image, acquires tag information for the image, and stores the acquired tag information corresponding to the image . In the following description and claims, when it is necessary to emphasize that the tag information is the tag information acquired through the scan operation, the tag information is referred to as scan tag information. The scan tag information may include at least one of the above-described examples of the tag information.

On the other hand, the tag information that can be acquired through the scan operation may have some limitations. This is because the situation at the time of photographing (for example, the photographing mode or the positional information at the time of photographing) can not be obtained by only analyzing the image data. As tag information that can be acquired when analyzing the image data itself, there may be information on the contour of the image and the set resolution information of the image.

Accordingly, when performing a scan operation on a predetermined image, the controller 180 obtains at least one of outline shape information and set image resolution information for a predetermined image, and obtains the acquired tag information It is proposed to store it in correspondence with a predetermined image.

When performing the above-described scanning operation, the retrieval operation according to the embodiment of the present invention, which will be described in detail below, may be performed on the stored image data through the reception of data.

Hereinafter, embodiments related to a control method that can be implemented in the mobile terminal configured as above will be described with reference to the accompanying drawings.

The scan operation for the predetermined image may be performed on any one of the images, but it may be convenient to operate to scan the plurality of images. Accordingly, in one embodiment of the present invention, it is proposed to perform a scan operation on a plurality of image data among the image data stored in the mobile terminal 100. [ This embodiment will be described with reference to Fig.

5 is a conceptual diagram for performing a scan operation on a plurality of image data according to an embodiment of the present invention.

Referring to FIG. 5, a "Select All" option 501 for performing a scan operation on the entire image data for an image scan operation, a "Specific Folder" option 502 for performing a scan operation on image data stored in a specific folder And an "individual picture" option 503 that performs a scanning operation on individual pictures (image data).

The "Select All" option 501 is an option to perform a scan operation on all the image data stored in the mobile terminal 100 at present. Accordingly, the controller 180 can perform a scan operation on all the image data stored in the memory 160 when the scan operation operates as the "Select All"

The "specific folder" option 502 is an option to perform a scan operation on all image data stored in a specific folder. This option may be provided provided that the image data is managed in a folder format. Accordingly, when the scan operation is performed as the "specific folder" option 502, the control unit 180 can perform a scan operation on all the image data stored in the specific folder selected by the user. In the example of FIG. 5, it is assumed that folder 1 504 through folder 3 506 exist and folder 2 505 is selected by the user. In this case, the controller 180 may perform a scan operation on the image data stored in the selected folder 2 (505).

Option 503 is an option to receive a selection for at least one image by the user and perform a scan operation on the selected at least one image. That is, the control unit 180 may perform a scan operation on at least one image data selected by the user when the scan operation is performed with the "individual photo" option 503. In the example of FIG. 5, it is assumed that Photo 3 (506-3) is selected from the photo 1 (506-1) to the photo 3 (506-3) stored in the folder 3 (506). Then, the control unit 180 can perform a scan operation on the selected photo 3 (506-3) when the scan operation is performed with the "individual photo" option 503.

On the other hand, in the case of performing the scan operation on the plurality of image data, in the case of some image data having already stored tag information, the scan operation may not be performed. That is, if the previously stored tag information is the image data, the image data (that is, the image data in which the scan tag information is stored together) that has already been performed the scan operation more than once or the tag information And may be image data stored together.

In addition, when predetermined image data is stored through a predetermined application, the control unit 180 according to an embodiment of the present invention acquires the tag information of the predetermined image data, and stores the acquired tag information in correspondence with the predetermined image data . In the following detailed description and claims of the present invention, when it is necessary to emphasize that the tag information is the tag information of the photograph acquired through the predetermined application, the tag information is referred to as the storage tag information. The storage tag information may include at least one of the above-described examples of the tag information.

Up to now, a configuration for storing tag information together for retrieving image data has been described. Hereinafter, a specific method of searching for image data using the tag information will be described. The status of the mobile terminal for performing the operation of acquiring and storing the tag information is referred to as a tag storage mode and the state of the mobile terminal for searching image data using the stored tag information is referred to as a multi-search mode.

6 is a diagram illustrating a state diagram of a Gallary application according to an embodiment of the present invention. The control unit 180 provides a search icon 601 on the execution screen of the gallery application according to an embodiment of the present invention.

FIG. 6A shows an execution state diagram of the gallery application, which shows a first folder 600-1 to a fourth folder 600-4 including a plurality of image data. The control unit 180 may provide a search icon 601 for searching image data in one area of the execution state diagram of the gallery application.

The control unit 180 can output at least one of the sketch search icon 602, the voice search icon 603 and the text search icon 604 upon receiving the input 10f in which the search icon 601 is selected (b)). The sketch search icon 602, the voice search icon 603, and the text search icon 604 are icons for entering the respective search modes according to an embodiment of the present invention.

- sketch search mode

The sketch search mode refers to a mode of searching for and providing image data corresponding to the sketch input upon receipt of a sketch input for a rough shape of the image from the user through the touch screen 151. [ Upon receiving the sketch input from the user, the control unit 180 may search for and output the image data having the tag information corresponding to the received sketch input. In particular, the tag information used in the sketch search mode is the outline shape information, and the control unit 180 can retrieve the outline shape information corresponding to the received sketch input and output it through the touch screen.

- Voice search mode

In the voice search mode, a specific search condition is input via the microphone 122, and the image data can be filtered based on the specific search condition. For example, when receiving the search condition of "indoor" through the microphone 122, the controller 180 can output only the image data photographed in the room from the image data through filtering.

- Text search mode

In the text search mode, a specific search condition is input through typing, and the image data can be filtered based on a specific search condition input. For example, upon receiving a search condition of "indoor" through typing, the control unit 180 can output only the image data photographed in the room from the image data through filtering.

According to at least one embodiment among the embodiments of the present invention, among a plurality of image data stored in the memory 160, a search operation based on at least one of a predetermined touch gesture, a text input, Can be performed. Hereinafter, a sketch search mode, a voice search mode, and / or a text search mode that support such a search operation will be collectively referred to as a multi-search mode.

Hereinafter, the above-described search mode will be described in more detail with reference to the drawings.

7 is a diagram illustrating an example of a method for searching image data through a sketch search mode according to an embodiment of the present invention.

7A and 7B, when the controller 180 receives a predetermined touch gesture input 10a on the sketch search icon 602, the controller 180 displays a sketch input pop-up window 705, which is a window for receiving a sketch input from the user Can be output. That is, the control unit 180 receives the sketch input from the user through the output sketch input pop-up window 705, and can retrieve the image data based on the received sketch input. The predetermined touch gesture may be an input for touching the sketch search icon 602 and dragging the sketch search icon 602 in the upper direction while keeping the touch.

Meanwhile, the controller 180 according to the embodiment of the present invention can change the position at which the sketch input pop-up window 705 is output corresponding to the user's position change input. When the controller 180 receives an input for touching the sketch input pop-up window 705 and receives an input for dragging the touch to the desired position, the control unit 180 displays a sketch input pop-up window 705, You can change the output location to the touch release point after dragging.

7 (c) and 7 (d) are views for explaining the sketch input pop-up window 705 in more detail.

7C, the sketch input pop-up window 705 may include an input tool selection area 706, a shooting mode selection area 707, and a sketch input area 708. [

The input tool selection area 706 means an area for selecting a tool for sketching in the area 708. [ The input tool selection area 706 includes a pencil tool 706-1, a fill tool 706-2, an eraser tool 706-3, a color extraction tool 706-4, and a text input tool 706-5 And may include at least one.

The pencil tool 706-1 is a tool for drawing in the area 708. The pencil tool 706-1 displays a position where a user touches or taps the touch using a predetermined color. The fill tool 706-2 is a tool for changing the background color of the area 708 to a predetermined color. The eraser tool 706-3 is a tool for erasing the display by the pencil tool 706-1. The color extraction tool 706-4 is a tool for extracting colors from predetermined image data. The text input tool 706-5 is a tool for inputting text data.

The photographing mode selection area 707 is an area for selecting a predetermined photographing mode and filtering the image data based on the selected photographing mode. The photographing mode selection region 707 includes a portrait photographing mode 707-1, a landscape photographing mode 707-2, a macro mode 707-3, a night scenery photographing mode 707-4, and a histogram mode 707-5 ). ≪ / RTI > That is, when the specific shooting mode is selected through the shooting mode selection region 707, the control unit 180 can search only the image of the shooting mode selected from the stored image data through filtering.

The sketch input area 708 is an area for receiving a sketch input for providing a sketch search mode according to an embodiment of the present invention. The control unit 180 receives the sketch input through the sketch input area 708, searches at least one image data based on the received sketch input, and outputs the searched result.

The sketch input in the embodiment of the present invention means a shape formed by a display of a predetermined color when a touch position or a path of a touch drag received from a user through the touch screen 151 is displayed in a predetermined color can do. That is, the user can use the touch screen as a drawing sheet, and perform a sketch input in the form of drawing on the touch screen using the touch object.

A method of retrieving image data based on the received sketch input and outputting the retrieved result will be described later in detail with reference to the examples shown in FIGS. 8 to 9. FIG.

On the other hand, if there is a commonly used sketch type (or frame) in retrieving image data, it would be convenient if the types can be stored in advance and provided to the user. Therefore, in one embodiment of the present invention, it is proposed to provide a predetermined sketch frame according to the shooting mode selected in the shooting mode selection area 707 described above. Then, the user may perform image data search using only the provided sketch frame, or may perform image data search by further inputting additional sketches based on the sketch frame.

This embodiment will be described with reference to Fig.

8 is a diagram illustrating a method for providing a sketch frame, in accordance with an embodiment of the present invention.

8A, the controller 180 outputs a sketch input pop-up window 705, and it is assumed that the portrait mode 707-1 is selected in the photographing mode selection region 707. FIG. In response to the input 10b for which the portrait mode 707-1 is selected, the controller 180 may output at least one sketch frame list corresponding to the selected shooting mode. In the example of Fig. 8 (a), the control unit 180 may output the sketch frame list 801 associated with the selected portrait mode 707-1. As the sketch frame associated with the portrait mode 707-1, a sketch frame mainly related to the shape of a person can be provided. For example, as in the sketch frame list 801 shown in Fig. 8 (a), a sketch in which one or two people stand, a sketch in the form in which a person is running, and the like can be provided as a sketch frame.

The control unit 180 can output the selected sketch frame to the sketch input area 708 (see FIG. 8 (b)) upon receiving the input 10c from which any one of the sketch frame lists 801 is selected. The output sketch frame, by itself, can be used to retrieve the image data immediately, and further receive additional sketch input to the output sketch frame for use in image data retrieval.

9 is a diagram showing an example of a method of outputting a retrieved image based on a sketch input, according to an embodiment of the present invention.

Referring to FIG. 9A, it is assumed that a sketch input pop-up window 705 is being output and a sketch input is received from a user through a sketch input area 708. It is assumed that the sketch input is an input representing the shape of two persons. When the sketch input is input through the sketch input area 708 and the input 10d where the search icon is selected, the control unit 180 can search the image data corresponding to the sketch input and output the search result .

The image data corresponding to the sketch input may mean an image whose outer shape of an object existing on the image data is similar to a sketch input. The outer shape is stored in the form of the tag information described above, and the controller 180 can retrieve the image data by searching the tag information corresponding to the sketch input.

FIG. 9B is a diagram showing a state diagram in which a plurality of pieces of image data 901-1 to 901-6 are searched by the search in FIG. 9A and the searched result is output. The predetermined image data 901-1 is highlighted and displayed among the plurality of searched image data 901-1 to 901-6 and the remaining image data is sequentially output to the lower end of the predetermined image 901-1 have. The predetermined image 901-1 may be an image most similar to the sketch input. The user may scroll through the plurality of searched image data 901-1 to 901-6 through the up / down scroll operation, and sequentially check the searched results.

On the other hand, a method of providing results for a plurality of retrieved image data will not be limited to the case described with reference to FIG. Meanwhile, the control method according to an embodiment of the present invention proposes to adjust the size and position of a sketch input received from a user. This embodiment will be described with reference to Fig.

10 is a diagram showing an example of a control method capable of performing additional editing on a sketch input received from a user according to an embodiment of the present invention. Referring to FIG. 10 (a), a sketch input popup window 705 shows a sketch input 1010 received from a user. Upon receiving the instruction 10g for changing the size of the sketch input 1010, the control unit 180 can control to change the size of the sketch input 1010 in response to the instruction 10g (see Fig. 10 (a)) . An example of an instruction 10g that changes the size of the sketch input 1010 may be an input that touches an edge area of the sketch input 1010 and then drags the sketch input 1010 outward while maintaining the touch. The example of instruction 10g that changes the size of the sketch input 1010 will not be limited to this.

Referring to FIG. 10B, a sketch input popup window 705 shows a sketch input 1010 received from a user. Upon receiving the instruction 10h for moving the position of the sketch input 1010, the control unit 180 can control to change the size of the sketch input 1010 corresponding to the instruction 10h (see Fig. 10 (a)). . An example of an instruction 10h to move the position of the sketch input 1010 may be an input that touches one area in the center of the sketch input 1010 and then drags it to the desired location. An example of instruction 10h to move the position of the sketch input 1010 will not be limiting.

10, the size of the sketch input 1010 is changed or the position of the sketch input 1010 is changed. In addition, the controller 180 may perform the rotation operation of the sketch input 1010 or the aspect ratio adjustment operation .

Meanwhile, in an embodiment of the present invention, in searching for image data based on a sketch input, it is proposed that the image data is divided into a landscape format and a portrait format.

11 is a diagram showing an example of a method of searching for whether a form of image data is a horizontal form or a vertical form according to an embodiment of the present invention. 11 (a) shows a sketch input pop-up window 705 in the horizontal image search mode, and the sketch input area 708 in this mode can have a horizontal shape. When receiving the image search command in the horizontal image search mode, the control unit 180 can search for and output only the image in the horizontal format in the image data (see FIG. 11 (a)).

11B shows a sketch input pop-up window 705 in the vertical image search mode, and the sketch input area 708 in this mode can have a vertical shape. When receiving the image search command in the vertical image search mode, the control unit 180 can search for and output only the vertical image in the image data (see FIG. 11 (b)).

That is, the tag information further includes image ratio information that is information for identifying the horizontal or vertical of the image data. When the controller 180 receives the image search command in the horizontal image search mode, To perform image search.

On the other hand, since the sketch input input by the user is different for each person who inputs it, it may be difficult for the control unit 180 to clearly determine what the sketch input means. Accordingly, the control unit 180 according to an embodiment of the present invention proposes to store a simple sketch for a representative search object in advance, and to induce the user to input it using such a simple sketch. In other words, it is possible to provide a more convenient search environment by guiding the search of the image data through the simple sketch that is predetermined with the user of the mobile terminal 100.

12 is a diagram showing the types of previously stored simple sketches, according to an embodiment of the present invention.

The type of the simple sketch shown in Fig. 12 is illustrative, and will include all of the sketches recognizing a specific shape through a predetermined sketch previously promised. Referring to FIG. 12, it includes "human shape", "mountain shape", "car shape", and "smartphone shape".

For example, when the simple sketch of human shape is inputted, the control unit 180 can recognize the input simple sketch as a human shape and retrieve the image data. Furthermore, the control unit 180 may also perform the size change and / or the movement of the sketch input described in FIG. 10 with respect to the input simple sketch.

13 to 14 are diagrams showing an example of a method of providing a result of a plurality of pieces of image data retrieved according to an embodiment of the present invention.

Referring to FIG. 13, there is shown a state diagram for outputting a plurality of image data 1001-1 to 1001-6 searched corresponding to the sketch input in FIG. 9 (a). Among the plurality of image data 1001-1 to 1001-6, a predetermined image 1001-1 is highlighted and displayed, and the remaining image data is displayed blurred behind the predetermined image 1001-1.

Upon receipt of the left and right scroll input 10e through the touch screen 151, the control unit 180 can perform a scroll operation on the plurality of image data 1001-1 to 1001-6. Accordingly, the user can sequentially browse through the plurality of searched image data 901-1 through 901-6 through scrolling.

Fig. 14 shows an embodiment for displaying retrieved image data on a sketch input area 708 of a sketch input pop-up window 705. Fig. Likewise, among the plurality of searched image data 1001-1 to 1001-6, a predetermined image 1001-1 is highlighted on the sketch input area 708, and the remaining images are blurred on the back. Upon receipt of the left and right scroll input 10e through the touch screen, the control unit 180 can perform a scroll operation on the plurality of image data 1001-1 to 1001-6 (see FIG. 14 (b)). In addition, when a plurality of image data is searched as described above, the controller 180 may display the number of the searched image data (1103).

Fig. 14C is a diagram showing a method of displaying search results of image data according to another embodiment of the present invention. Fig. Referring to Fig. 14C, in the image thumbnail and folder output screen of the gallery application, the control unit 180 can generate a "search folder ", which is a new folder containing only a plurality of searched image data. And may be provided including a plurality of pieces of image data retrieved in a "search folder ".

15 is a diagram showing an example of a control method of performing a search by adding a text search condition according to an embodiment of the present invention. 15A, when a sketch input is made through a sketch input area 708, an additional search condition (an example of "KakaoTalk" in the example of FIG. 15A) is displayed through a text search icon 604 Condition) is input. That is, when receiving the input in which the search icon is selected (10d), the control unit 180 can search the image data based on the inputted text additional search condition when searching the image data corresponding to the sketch input. In the example of Fig. 15, in response to the additional search condition of "KakaoTalk ", the control unit 180 displays only the image data stored through the" KakaoTalk "application among the plurality of image data searched based on the sketch input . In this case, the control unit 180 may retrieve the stored image data through the "KakaoTalk" application using the storage path information described above among the tag information.

Fig. 15 (b) is a diagram showing a result of retrieving image data based on an additional search condition together with a sketch input according to an embodiment of the present invention described above. In the state diagram showing this search result, a plurality of pieces of image data are displayed, and a plurality of pieces of displayed image data can be scrolled by a vertical scroll input. Then, the controller 180 may display the number of the plurality of searched image data (1103).

On the other hand, in the embodiment described above with reference to FIG. 15, additional search conditions are set based on the text input entered on the text search icon 604. However, the present invention is not limited to this, and in another embodiment of the present invention, it is proposed to set additional search conditions on the basis of handwriting input on the sketch input area 708.

16 is a diagram illustrating a method for setting additional search conditions based on handwritten input according to an embodiment of the present invention.

Referring to FIG. 16 (a), the control unit 180 shows a state in which handwritten input is received from the user in the output sketch input area 708. The control unit 180 recognizes the handwriting input received in the sketch input area 708 and can set additional search conditions based on the recognized handwriting input. As in the example of Fig. 16 (a), when it is assumed that a handwritten word "Indoor" is input from the user, the control unit 180 can recognize the text "Indoor " Then, the control unit 180 may display only the image data photographed in the room among the plurality of image data searched based on the sketch input. The control unit 180 may utilize the tag information of the image data in determining whether the image is photographed indoors. In addition, when a plurality of pieces of image data are searched, the controller 180 may further display (1103) the number of the plurality of image data.

17 is a diagram showing an example of a method of retrieving image data in a text search mode according to an embodiment of the present invention.

FIG. 17A is a diagram showing an execution state diagram of the gallery application. It is assumed that a search keyword is input stepwise through a text search icon 604 as shown in FIG. 17B. In the example shown in Fig. 17 (a), it is assumed that the search keywords are sequentially inputted as "person (first stage)", "two persons (second stage)", and "room (third stage)". The control unit 180 may search image data based on sequentially inputted search keywords, and output the retrieved results. That is, in the above-described example, the controller 180 first searches the image data stored in the memory 160 for image data including tag information 'person' (step 1). Then, the controller 180 searches image data including tag information 'two persons' among the search results of the first stage (step 2). Finally, the controller 180 searches image data including tag information 'indoor' in the second step search result (step 3).

As a result, the control unit 180 may search the photographs taken by the two persons indoors through the entire process (steps 1 to 3) and provide the search result as shown in FIG. 17 (b) . The retrieved result may include a plurality of image data, and the plurality of image data may be scrolled by the scroll input of the user.

In the example of FIG. 17, a text search word is input through the text search icon 604, but the same operation can be provided through speech recognition. That is, when the search keyword is inputted after selecting the voice search icon 603, the control unit 180 can search the image data based on the keyword. The search keyword can be sequentially input , The control unit 180 may perform the same search operation as in Fig.

17, the search condition is set through the keyword input (input through text input or voice recognition). In addition, in another embodiment of the present invention, the frequently used search condition is output And suggests that the user can select from among the retrieved retrieval conditions and utilize them as retrieval conditions. For example, "1 person", "2 people" to "10 people" representing the number of people present on the image formed by the image data are output on the touch screen 151, When selected,

Up to now, a method of searching through sketches of keywords and outline shapes in retrieving image data has been described. In another embodiment of the present invention, a method of sketching the shape of the histogram and retrieving the image data based on the sketched shape will be described with reference to FIG.

18 is a diagram showing an example of a method of retrieving image data based on a sketch of a histogram, according to an embodiment of the present invention.

It is assumed that a sketch input pop-up window 705 is output in FIG. 18 (a), and a histogram mode 707 - 5 is selected in the photographing mode selection region 707.

The control unit 180 receives the sketch 1501 of the first histogram and the sketch 1502 of the second histogram from the user and displays the image data on the basis of the scales 1501 and 1502 of the first and second histograms (See Fig. 18 (b)).

The user of the mobile terminal 100 according to an exemplary embodiment of the present invention inputs a sketch of the histogram according to the degree of brightness of the image data and displays the histogram of the input histogram And search for image data based on the sketch can be performed.

19 is a flowchart illustrating a method of controlling a mobile terminal having an image data search function according to an embodiment of the present invention.

In step S1900, the control unit 180 executes the gallery application. When executing a gallery application, the control unit 180 may display at least one image thumbnail or at least one image folder.

In step S1901, the controller 180 selects whether to operate in the storage mode or the search mode. The control unit 180 according to an embodiment of the present invention operates in the search mode corresponding to the input of the search icon 601 for searching for image data and proceeds to step S1902. The control unit 180 may operate in the storage mode before the search icon 601 for searching image data is selected.

In step S1902, the control unit 180 may enter the multi-search mode in response to a predetermined input from the user. The above-described predetermined input may be an input for selecting the search icon 601 in Fig. 6 (a). The control unit 180 may output at least one of the sketch search icon 602, the voice search icon 603, and the text search icon 604 as shown in FIG. 6 (b) . Furthermore, when entering the multi-search mode, the control unit 180 outputs a sketch input pop-up window 705 including an input tool selection region 706, a shooting mode selection region 707, and a sketch input region 708 .

In step S1903, the controller 180 determines whether a sketch input is received from the user through the sketch input area 708. [ When the sketch input is received from the user, the control unit 180 proceeds to step S1904. If the sketch input is not received from the user, the control unit 180 proceeds to step S1905.

In step S1904, the control unit 180 may perform filtering on image data based on the sketch input received in step S1903. On the other hand, in the case of filtering based on the sketch input, the control unit 180 may filter based on the outer shape of the object included in the image data (the embodiment described in FIGS. 13 to 14) It may be filtered based on the histogram (the embodiment described in FIG. 18).

In step S1905, the control unit 180 determines whether a text keyword input is received from the user through the text search icon 604. If a text keyword input is received from the user, the control unit 180 proceeds to step S1906. If the text keyword input is not received from the user, the control unit 180 proceeds to step S1907.

In step S1906, the control unit 180 may perform filtering on the image data based on the input of the text keyword received in step S1905 (the embodiment described with reference to Figs. 15 to 17).

In step S1907, the control unit 180 determines whether a voice keyword input is received from the user through the voice search icon 603. If the voice keyword input from the user is received, the control unit 180 proceeds to step S1908, and if voice keyword input is not received from the user, the control unit 180 proceeds to step S1909.

In step S1908, the control unit 180 may perform filtering on the image data based on the input of the voice keyword received in step S1907 (the embodiment described with reference to Figs. 15 to 17).

In step S1909, the control unit 180 can output the results filtered in steps S1904, S1906, and S1908 (see Figs. 13 and 14).

If the control unit 180 enters the tag storage mode as in step S1910, the process may proceed to step S1911. In step S1911, the control unit 180 proceeds to step S1912 when the photographing instruction is received. If the photographing instruction is not received, the control unit 180 proceeds to step S1913.

In step S1912, the control unit 180 acquires the photograph tag information about the photographed photograph, and stores the acquired photograph tag information in the memory 160 in correspondence with the original data (image data) of the photographed photograph. Thereafter, the control unit 180 proceeds to step S1913.

In step S1913, the controller 180 determines whether a scan command is received. If the scan command is received, the process proceeds to step S1914. Otherwise, the process proceeds to step S1915.

In step S1914, the controller 180 acquires scan tag information from the image data of the scan target, and stores the acquired scan tag information in the memory 160 in association with the target image data. Thereafter, the control unit 180 proceeds to step S1915. The scan operation in step S1914 can be performed on a plurality of image data as described above.

In step S1915, the control unit 180 determines whether an image storage command is received during execution of a predetermined application. If the image storing command is received, the controller 180 may proceed to step S1916, and if the image storing command has not been received, the controller 180 may terminate the flowchart of the control method. In step S1916, the control unit 180 acquires the storage tag information from the target image data of the storage command, and stores the storage tag information in the memory 160 in association with the target image data of the storage command.

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

The present invention described above can be implemented as computer readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer-readable medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) . Also, the computer may include a control unit 180 of the terminal.

Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

100: mobile terminal 110: wireless communication unit
120: A / V input / output unit 130: user input unit
140: sensing unit 150: output unit
160: memory 170: interface section
180: control unit 190: power supply unit

Claims (20)

camera;
A memory for storing a plurality of image data and tag information corresponding to each of the plurality of image data;
A user input unit for receiving a search key for searching image data; And
And a controller for searching at least one image data having tag information corresponding to the search key,
Wherein the controller acquires photographing tag information, which is tag information of a photograph photographed through the camera, and stores the obtained photographing tag information in the memory in association with image data of the photographed photograph,
Mobile terminal. The method according to claim 1,
Wherein the tag information includes outer shape information that is information indicating an outer shape of a predetermined object existing on an image formed by the image data,
Mobile terminal. 3. The method of claim 2,
Wherein the user input unit includes a touch screen for receiving a touch & drag input,
Wherein the search key includes a sketch input based on a touch path corresponding to the touch drag input,
Wherein the control unit searches at least one image data having tag information corresponding to the sketch input,
Mobile terminal. The method of claim 3,
Wherein the search key further comprises information image ratio information for identifying a width or a length of the image data,
Wherein the control unit searches only image data identical to the image ratio information,
Mobile terminal. The method according to claim 1, wherein the photographing tag information includes at least one of photographing mode information of the camera at the time of receiving the photographing instruction, photographing position information of the photographing photographing,
Mobile terminal. 6. The method according to claim 5,
A flash function setting information of the camera at the time of receiving the photographing command, and resolution setting information of the photographed photograph,
Mobile terminal. The method according to claim 5 or 6,
The search key is a key-word for searching for the tag information,
Wherein the control unit searches at least one image data having tag information matching the keyword,
Mobile terminal. The apparatus of claim 1,
The image forming apparatus further acquires stored tag information, which is the tag information of the predetermined image data, upon receiving a storage command for predetermined image data during execution of a predetermined application, and associates the acquired stored tag information with the predetermined image data, To save,
Mobile terminal. 9. The method as claimed in claim 8,
And storage path information indicating identification information of the predetermined application,
Mobile terminal. The method according to claim 1,
Wherein the memory further stores at least one image data without the corresponding tag information,
Wherein the control unit further obtains scan tag information as tag information for each of the at least one image data when receiving a scan command for the at least one image data and transmits the acquired scan tag information to the at least one image Data in association with each of the data,
Mobile terminal. Storing tag information corresponding to each of the plurality of image data and the plurality of image data in a memory;
Receiving a search key for searching image data; And
Retrieving at least one image data having tag information corresponding to the search key,
Wherein the step of storing includes acquiring tag information of a photograph photographed through a camera in response to reception of a photographing instruction and storing the obtained tag information in the memory in association with image data of the photographed photograph Including,
A method of controlling a mobile terminal. 12. The method of claim 11,
Wherein the tag information includes outer shape information that is information indicating an outer shape of a predetermined object existing on an image formed by the image data,
A method of controlling a mobile terminal. 12. The method of claim 11,
The receiving of the search key comprises receiving a touch & drag input through a touch screen,
Wherein the search key includes a sketch input based on a touch path corresponding to the touch drag input,
Wherein the searching step comprises searching for at least one image data having tag information corresponding to the sketch input,
A method of controlling a mobile terminal. 14. The method of claim 13,
Wherein the search key further comprises information image ratio information for identifying a width or a length of the image data,
Wherein the searching step searches only image data identical to the image ratio information,
A method of controlling a mobile terminal. The information processing apparatus according to claim 11, wherein the tag information includes at least one of photographing mode information of the camera at the time of receiving the photographing instruction, photographing position information of the photographing photographing, property information of the photographing photographing, Lt; RTI ID = 0.0 > information,
A method of controlling a mobile terminal. 16. The method according to claim 15,
A flash function setting information of the camera at the time of receiving the photographing command, and resolution setting information of the photographed photograph,
A method of controlling a mobile terminal. 17. The method according to claim 15 or 16,
The search key is a key-word for searching for the tag information,
Wherein the control unit searches at least one image data having tag information matching the keyword,
A method of controlling a mobile terminal. 12. The method of claim 11,
The image processing method includes the steps of: acquiring storage tag information, which is tag information of the predetermined image data, when receiving a storage command for predetermined image data during execution of a predetermined application; storing the acquired storage tag information in the memory in association with the predetermined image data; ≪ / RTI >
A method of controlling a mobile terminal. 19. The method of claim 18,
And storage path information indicating identification information of the predetermined application,
A method of controlling a mobile terminal. 12. The method of claim 11,
Wherein the storing step comprises:
Storing at least one image data without the corresponding tag information; And
Wherein the control unit further acquires scan tag information, which is the tag information for each of the at least one image data, when receiving the scan command for the at least one image data, and associates the acquired scan tag information with each of the at least one image data Further comprising the steps < RTI ID = 0.0 > of: <
A method of controlling a mobile terminal.

Images