KR102160039B1 - Mobile terminal and method for controlling the same - Google Patents

Abstract

Disclosed are a mobile terminal and a control method thereof. A mobile terminal and a control method thereof according to the present invention include: a display unit; At least one camera; And a first image cluster generated from an image obtained through a first continuous shooting performed using the at least one camera and a second continuous shooting performed using the at least one camera. And a control unit for generating a combined image by combining the second image clusters generated as an image, and displaying the first and second image clusters in the generated combined image on the display unit. According to the present invention, by combining the first and second image clusters obtained through a plurality of continuous shooting. By displaying the first and second image clusters separately on the combined image, each of the plurality of continuous shooting can be easily identified.

Description

Mobile terminal and its control method {MOBILE TERMINAL AND METHOD FOR CONTROLLING THE SAME}

The present invention combines the first and second image clusters obtained through a plurality of continuous shooting. A mobile terminal capable of easily identifying each of a plurality of continuous shooting by displaying the first and second image clusters in a combined image It relates to the control method.

Terminals can be divided into mobile/portable terminals and stationary terminals depending on whether they can be moved. Again, mobile terminals can be divided into handheld terminals and vehicle mounted terminals depending on whether the user can directly carry them.

The functions of mobile terminals are diversifying. For example, there are functions of data and voice communication, taking pictures and videos through a camera, recording voice, playing music files through a speaker system, and outputting images or videos to the display unit. Some terminals add an electronic game play function or perform a multimedia player function. In particular, recent mobile terminals can receive multicast signals providing visual content such as broadcasting and video or television programs.

As the functions are diversified, such a terminal is in the form of a multimedia player with complex functions such as, for example, taking photos or videos, playing music or video files, and receiving games and broadcasts. It is being implemented.

In order to support and increase the function of the terminal, it may be considered to improve the structural part and/or the software part of the terminal.

In recent years, various methods for photographing an image using a mobile terminal have been proposed. For example, a method of continuously photographing still images has been introduced. Accordingly, there is a demand from users who want to conveniently and effectively display and manage still images taken continuously.

It is an object of the present invention to solve the above and other problems. Another object is to combine the first and second image clusters acquired through a plurality of continuous shots. Mobile terminal that allows easy identification of each of the plurality of continuous shots by displaying the first and second image clusters in a combined image. And the control method thereof.

According to an aspect of the present invention to achieve the above or other objects, a display unit; At least one camera; And a first image cluster generated from an image obtained through a first continuous shooting performed using the at least one camera and a second continuous shooting performed using the at least one camera. A control unit is provided to generate a combined image by combining the second image clusters generated as an image, and then to divide the first and second image clusters from the generated combined image and display them on the display unit.

In addition, according to another aspect of the present invention, the step of performing a first continuous shooting using a camera; Performing a second continuous shooting using the camera; Generating a first image cluster from the image acquired through the first continuous shooting; Generating a second image cluster from the image acquired through the second continuous shooting; Generating a combined image by combining the first and second image clusters; And separately displaying the first and second image clusters on the combined image.

The effects of the mobile terminal and the control method thereof according to the present invention will be described as follows.

According to at least one of the embodiments of the present invention, combining the first and second image clusters obtained through a plurality of continuous shooting. By separately displaying the first and second image clusters on the combined image, each of a plurality of continuous shooting can be easily performed. It has the advantage of being identifiable.

In addition, according to at least one of the embodiments of the present invention, there is an advantage in that the captured images can be easily managed by allowing the image captured through a plurality of continuous shooting to be managed as a combined image.

In addition, according to at least one of the embodiments of the present invention, there is an advantage in that the user's interest in the mobile terminal can be increased by continuously reproducing an image captured through a plurality of continuous shooting.

Further scope of applicability of the present invention will become apparent from the detailed description below. However, since various changes and modifications within the spirit and scope of the present invention can be clearly understood by those skilled in the art, specific embodiments such as the detailed description and preferred embodiments of the present invention should be understood as being given by way of example only.

1 is a block diagram illustrating a mobile terminal related to the present invention.
FIG. 2 is a flowchart showing the operation of the mobile terminal of FIG. 1.
3 to 5 are diagrams illustrating continuous shooting in the mobile terminal of FIG. 1.
6 to 8 are diagrams illustrating image cluster generation in the mobile terminal of FIG. 1.
9 and 10 are diagrams illustrating generation of a combined image in the mobile terminal of FIG. 1.
11A and 12 are diagrams illustrating a method of displaying a thumbnail of a combined image generated by the mobile terminal of FIG. 1.
13 to 15 are diagrams illustrating a method of reproducing a combined image generated by the mobile terminal of FIG. 1.
16 to 26 are diagrams illustrating operations on a combined image generated by the mobile terminal of FIG. 1.
27 and 28 are diagrams illustrating manipulation of a thumbnail of a combined image generated by the mobile terminal of FIG. 1.

Hereinafter, exemplary embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings, but identical or similar elements are denoted by the same reference numerals regardless of reference numerals, and redundant descriptions thereof will be omitted. The suffixes "module" and "unit" for components used in the following description are given or used interchangeably in consideration of only the ease of preparation of the specification, and do not have meanings or roles that are distinguished from each other by themselves. In addition, in describing the embodiments disclosed in the present specification, when it is determined that a detailed description of related known technologies may obscure the subject matter of the embodiments disclosed in the present specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are for easy understanding of the embodiments disclosed in the present specification, and the technical idea disclosed in the present specification is not limited by the accompanying drawings, and all modifications included in the spirit and scope of the present invention , It should be understood to include equivalents or substitutes.

Terms including ordinal numbers, such as first and second, may be used to describe various elements, but the elements are not limited by the terms. These terms are used only for the purpose of distinguishing one component from another component.

When a component is referred to as being "connected" or "connected" to another component, it is understood that it may be directly connected or connected to the other component, but other components may exist in the middle. Should be. On the other hand, when a component is referred to as being "directly connected" or "directly connected" to another component, it should be understood that there is no other component in the middle.

Singular expressions include plural expressions unless the context clearly indicates otherwise.

In the present application, terms such as "comprises" or "have" are intended to designate the presence of features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, but one or more other features. It is to be understood that the presence or addition of elements or numbers, steps, actions, components, parts, or combinations thereof, does not preclude in advance.

Mobile terminals described in this specification include mobile phones, smart phones, laptop computers, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), navigation systems, and slate PCs. , Tablet PC (tablet PC), ultrabook (ultrabook), wearable device (wearable device, for example, smartwatch, glass-type terminal (smart glass), HMD (head mounted display)), etc. may be included. have.

However, it will be readily apparent to those skilled in the art that the configuration according to the embodiment described in the present specification may also be applied to fixed terminals such as digital TVs, desktop computers, and digital signage, except when applicable only to mobile terminals. will be.

1A is a block diagram illustrating a mobile terminal related to the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an input unit 120, a sensing unit 140, an output unit 150, an interface unit 160, a memory 170, a control unit 180, and a power supply unit 190. ), etc. The components shown in FIG. 1A are not essential for implementing the mobile terminal, and thus, the mobile terminal described in the present specification may have more or fewer components than those listed above.

More specifically, among the components, the wireless communication unit 110 may be configured between the mobile terminal 100 and the wireless communication system, between the mobile terminal 100 and another mobile terminal 100, or between the mobile terminal 100 and an external server. It may include one or more modules that enable wireless communication between. In addition, the wireless communication unit 110 may include one or more modules for connecting the mobile terminal 100 to one or more networks.

The wireless communication unit 110 may include at least one of a broadcast reception module 111, a mobile communication module 112, a wireless Internet module 113, a short-range communication module 114, and a location information module 115. .

The input unit 120 includes a camera 121 or an image input unit for inputting an image signal, a microphone 122 for inputting an audio signal, or an audio input unit, and a user input unit 123 for receiving information from a user, for example, , A touch key, a mechanical key, etc.). The voice data or image data collected by the input unit 120 may be analyzed and processed as a user's control command.

The sensing unit 140 may include one or more sensors for sensing at least one of information in the mobile terminal, information on surrounding environments surrounding the mobile terminal, and user information. For example, the sensing unit 140 includes a proximity sensor 141, an illumination sensor 142, a touch sensor, an acceleration sensor, a magnetic sensor, and gravity. G-sensor, gyroscope sensor, motion sensor, RGB sensor, infrared sensor (IR sensor), fingerprint sensor (finger scan sensor), ultrasonic sensor (ultrasonic sensor) , Optical sensor (for example, camera (see 121)), microphone (microphone, see 122), battery gauge, environmental sensor (for example, barometer, hygrometer, thermometer, radiation detection sensor, It may include at least one of a heat sensor, a gas sensor, etc.), and a chemical sensor (eg, an electronic nose, a healthcare sensor, a biometric sensor, etc.). Meanwhile, the mobile terminal disclosed in the present specification may combine and utilize information sensed by at least two or more of these sensors.

The output unit 150 is for generating an output related to visual, auditory or tactile sense, and includes at least one of the display unit 151, the sound output unit 152, the hap tip module 153, and the light output unit 154 can do. The display unit 151 may implement a touch screen by forming a layer structure or integrally with the touch sensor. Such a touch screen can function as a user input unit 123 that provides an input interface between the mobile terminal 100 and a user, and can provide an output interface between the mobile terminal 100 and a user.

The interface unit 160 serves as a passage between various types of external devices connected to the mobile terminal 100. The interface unit 160 connects a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, and a device equipped with an identification module. It may include at least one of a port, an audio input/output (I/O) port, an input/output (video I/O) port, and an earphone port. The mobile terminal 100 may perform appropriate control related to the connected external device in response to the connection of the external device to the interface unit 160.

In addition, the memory 170 stores data supporting various functions of the mobile terminal 100. The memory 170 may store a plurality of application programs or applications driven by the mobile terminal 100, data for operation of the mobile terminal 100, and commands. At least some of these application programs may be downloaded from an external server through wireless communication. In addition, at least some of these application programs may exist on the mobile terminal 100 from the time of delivery for basic functions of the mobile terminal 100 (eg, incoming calls, outgoing functions, message reception, and outgoing functions). Meanwhile, the application program may be stored in the memory 170, installed on the mobile terminal 100, and driven by the controller 180 to perform an operation (or function) of the mobile terminal.

In addition to the operation related to the application program, the controller 180 generally controls the overall operation of the mobile terminal 100. The controller 180 may provide or process appropriate information or functions to a user by processing signals, data, information, etc. input or output through the above-described components or by driving an application program stored in the memory 170.

Also, in order to drive an application program stored in the memory 170, the controller 180 may control at least some of the components examined together with FIG. 1A. Furthermore, in order to drive the application program, the controller 180 may operate by combining at least two or more of the components included in the mobile terminal 100 with each other.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power to each of the components included in the mobile terminal 100. The power supply unit 190 includes a battery, and the battery may be a built-in battery or a replaceable battery.

At least some of the components may operate in cooperation with each other to implement an operation, control, or control method of a mobile terminal according to various embodiments described below. In addition, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 170.

Hereinafter, before examining various embodiments implemented through the mobile terminal 100 described above, the above-listed components will be described in more detail with reference to FIG. 1A.

First, referring to the wireless communication unit 110, the broadcast reception module 111 of the wireless communication unit 110 receives a broadcast signal and/or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching of at least two broadcast channels.

The broadcast management server may mean a server that generates and transmits a broadcast signal and/or broadcast-related information, or a server that receives and transmits a previously-generated broadcast signal and/or broadcast-related information to a terminal. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal in a form in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast signal may be encoded according to at least one of technical standards (or a broadcast method, for example, ISO, IEC, DVB, ATSC, etc.) for transmission and reception of digital broadcast signals, and the broadcast reception module 111 The digital broadcast signal can be received using a method suitable for the technical standards set by technical standards.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms, such as an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or an Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H). The broadcast signal and/or broadcast related information received through the broadcast reception module 111 may be stored in the memory 160.

The mobile communication module 112 includes technical standards or communication methods for mobile communication (eg, GSM (Global System for Mobile communication), CDMA (Code Division Multi Access), CDMA2000 (Code Division Multi Access 2000)), EV -DO (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), WCDMA (Wideband CDMA), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), etc.), transmits and receives radio signals with at least one of a base station, an external terminal, and a server on a mobile communication network.

The wireless signal may include a voice call signal, a video call signal, or various types of data according to transmission/reception of text/multimedia messages.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built-in or external to the mobile terminal 100. The wireless Internet module 113 is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

Examples of wireless Internet technologies include WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced), etc., and the wireless Internet module ( 113) transmits and receives data according to at least one wireless Internet technology in a range including Internet technologies not listed above.

From the point of view that wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A, etc. is made through a mobile communication network, the wireless Internet module 113 performs wireless Internet access through the mobile communication network. ) May be understood as a kind of the mobile communication module 112.

The short range communication module 114 is for short range communication, and includes Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and NFC. Near field communication may be supported by using at least one of (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies. The short-distance communication module 114 is, between the mobile terminal 100 and a wireless communication system, between the mobile terminal 100 and another mobile terminal 100, or between the mobile terminal 100 through a wireless area network (Wireless Area Networks). ) And a network in which another mobile terminal 100 or an external server is located may support wireless communication. The local area wireless communication network may be a wireless personal area network (Wireless Personal Area Networks).

Here, the other mobile terminal 100 is a wearable device capable of exchanging (or interlocking with) data with the mobile terminal 100 according to the present invention, for example, a smartwatch, a smart glasses. (smart glass), HMD (head mounted display)). The short-range communication module 114 may detect (or recognize) a wearable device capable of communicating with the mobile terminal 100 around the mobile terminal 100. Furthermore, when the sensed wearable device is a device that is authenticated to communicate with the mobile terminal 100 according to the present invention, the controller 180 transmits at least part of the data processed by the mobile terminal 100 to the short-range communication module ( 114) can be transmitted to the wearable device. Accordingly, a user of the wearable device can use data processed by the mobile terminal 100 through the wearable device. For example, according to this, when a call is received by the mobile terminal 100, the user performs a phone call through the wearable device, or when a message is received by the mobile terminal 100, the user receives the received call through the wearable device. It is possible to check the message.

The location information module 115 is a module for obtaining a location (or current location) of a mobile terminal, and representative examples thereof include a GPS (Global Positioning System) module or a WiFi (Wireless Fidelity) module. For example, if the mobile terminal utilizes the GPS module, it can acquire the location of the mobile terminal by using a signal transmitted from a GPS satellite. As another example, if the mobile terminal utilizes the Wi-Fi module, the mobile terminal may acquire the location of the mobile terminal based on information of the Wi-Fi module and a wireless access point (AP) that transmits or receives a wireless signal. If necessary, the location information module 115 may perform any function among other modules of the wireless communication unit 110 in order to obtain data on the location of the mobile terminal as a substitute or additionally. The location information module 115 is a module used to obtain the location (or current location) of the mobile terminal, and is not limited to a module that directly calculates or obtains the location of the mobile terminal.

Next, the input unit 120 is for inputting image information (or signal), audio information (or signal), data, or information input from a user. For inputting image information, the mobile terminal 100 Alternatively, a plurality of cameras 121 may be provided. The camera 121 processes an image frame such as a still image or a video obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 151 or stored in the memory 170. On the other hand, a plurality of cameras 121 provided in the mobile terminal 100 may be arranged to form a matrix structure, and through the camera 121 forming a matrix structure as described above, various angles or focal points are applied to the mobile terminal 100. A plurality of image information may be input. In addition, the plurality of cameras 121 may be arranged in a stereo structure to obtain a left image and a right image for implementing a stereoscopic image.

The microphone 122 processes an external sound signal into electrical voice data. The processed voice data may be variously utilized according to a function (or an application program being executed) being executed by the mobile terminal 100. Meanwhile, the microphone 122 may be implemented with various noise removal algorithms for removing noise generated in a process of receiving an external sound signal.

The user input unit 123 is for receiving information from the user, and when information is input through the user input unit 123, the controller 180 can control the operation of the mobile terminal 100 to correspond to the input information. . Such, the user input unit 123 is a mechanical (mechanical) input means (or a mechanical key, for example, a button located on the front, rear or side of the mobile terminal 100, a dome switch (dome switch), a jog wheel, Jog switch, etc.) and a touch-type input means. As an example, the touch-type input means comprises a virtual key, a soft key, or a visual key displayed on a touch screen through software processing, or a portion other than the touch screen On the other hand, the virtual key or the visual key can be displayed on the touch screen while having various forms. For example, graphic, text ), icon, video, or a combination thereof.

Meanwhile, the sensing unit 140 senses at least one of information in the mobile terminal, information on a surrounding environment surrounding the mobile terminal, and user information, and generates a sensing signal corresponding thereto. The controller 180 may control the driving or operation of the mobile terminal 100 or perform data processing, functions, or operations related to an application program installed in the mobile terminal 100 based on such a sensing signal. Representative sensors among various sensors that may be included in the sensing unit 140 will be described in more detail.

First, the proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing in the vicinity using the force of an electromagnetic field or infrared rays without mechanical contact. In the proximity sensor 141, the proximity sensor 141 may be disposed in an inner area of the mobile terminal surrounded by the touch screen as described above or near the touch screen.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, an infrared proximity sensor, and the like. When the touch screen is a capacitive type, the proximity sensor 141 may be configured to detect the proximity of the object by a change in the electric field according to the proximity of the conductive object. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of explanation, the action of allowing an object to be recognized as being positioned on the touch screen by being approached without contacting an object on the touch screen is called "proximity touch", and the touch The act of actually touching an object on the screen is referred to as "contact touch". A position at which an object is touched in proximity on the touch screen means a position at which the object is vertically corresponding to the touch screen when the object is touched in proximity. The proximity sensor 141 may detect a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.). have. Meanwhile, as above, the controller 180 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern sensed through the proximity sensor 141, and further, provides visual information corresponding to the processed data. It can be output on the touch screen. Furthermore, the controller 180 may control the mobile terminal 100 to process different operations or data (or information) according to whether a touch to the same point on the touch screen is a proximity touch or a touch touch. .

The touch sensor applies a touch (or touch input) to the touch screen (or display unit 151) using at least one of various touch methods such as a resistive film method, a capacitive method, an infrared method, an ultrasonic method, and a magnetic field method. To detect.

As an example, the touch sensor may be configured to convert a pressure applied to a specific portion of the touch screen or a change in capacitance generated at a specific portion of the touch screen into an electrical input signal. The touch sensor may be configured to detect a location, an area, a pressure upon touch, a capacitance upon touch, and the like at which a touch object applying a touch on the touch screen is touched on the touch sensor. Here, the touch object is an object that applies a touch to the touch sensor, and may be, for example, a finger, a touch pen, a stylus pen, or a pointer.

In this way, when there is a touch input to the touch sensor, the signal(s) corresponding thereto is transmitted to the touch controller. The touch controller processes the signal(s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can know whether an area of the display unit 151 is touched. Here, the touch controller may be a separate component from the controller 180 or may be the controller 180 itself.

Meanwhile, the controller 180 may perform different controls or perform the same control according to the type of the touch object by touching the touch screen (or a touch key provided in addition to the touch screen). Whether to perform different controls or to perform the same control according to the type of the touch object may be determined according to an operating state of the mobile terminal 100 or an application program being executed.

Meanwhile, the touch sensor and the proximity sensor described above are independently or in combination, and a short (or tap) touch, a long touch, a multi touch, and a drag touch on the touch screen. ), flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, etc. You can sense the touch.

The ultrasonic sensor may recognize location information of a sensing target by using ultrasonic waves. Meanwhile, the controller 180 may calculate the location of the wave generator through information sensed from the optical sensor and the plurality of ultrasonic sensors. The location of the wave generator may be calculated by using a property that the light is much faster than the ultrasonic wave, that is, the time that the light reaches the optical sensor is much faster than the time that the ultrasonic wave reaches the ultrasonic sensor. More specifically, the position of the wave generator may be calculated using a time difference between a time when the ultrasonic wave arrives using light as a reference signal.

On the other hand, the camera 121, viewed as the configuration of the input unit 120, includes at least one of a camera sensor (eg, CCD, CMOS, etc.), a photo sensor (or image sensor), and a laser sensor.

The camera 121 and the laser sensor may be combined with each other to detect a touch of a sensing target for a 3D stereoscopic image. The photosensor may be stacked on the display device, and the photosensor is configured to scan a motion of a sensing object close to the touch screen. More specifically, the photo sensor scans the contents placed on the photo sensor by mounting a photo diode and a transistor (TR) in a row/column and using an electrical signal that changes according to the amount of light applied to the photo diode. That is, the photosensor calculates the coordinates of the sensing target according to the amount of light change, and through this, the location information of the sensing target may be obtained.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, the display unit 151 may display execution screen information of an application program driven in the mobile terminal 100, or UI (User Interface) and GUI (Graphic User Interface) information according to such execution screen information. .

In addition, the display unit 151 may be configured as a three-dimensional display unit that displays a three-dimensional image.

A three-dimensional display method such as a stereoscopic method (glasses method), an auto stereoscopic method (no glasses method), and a projection method (holographic method) may be applied to the stereoscopic display unit.

The sound output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output unit 152 also outputs sound signals related to functions (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 100. The sound output unit 152 may include a receiver, a speaker, and a buzzer.

The haptic module 153 generates various tactile effects that a user can feel. A typical example of the tactile effect generated by the haptic module 153 may be vibration. The intensity and pattern of vibrations generated by the haptic module 153 may be controlled by a user's selection or setting of a controller. For example, the haptic module 153 may synthesize and output different vibrations or sequentially output them.

In addition to vibration, the haptic module 153 is used for stimulation such as an arrangement of pins that move vertically with respect to the contact skin surface, blowing force or suction force of air through the injection or inlet, grazing against the skin surface, contact of electrodes, and electrostatic force. It can generate various tactile effects, such as the effect by the effect and the effect by reproducing the feeling of cooling and warming using an endothermic or heat generating element.

The haptic module 153 may not only deliver a tactile effect through direct contact, but may also be implemented so that a user can feel the tactile effect through muscle sensations such as a finger or an arm. Two or more haptic modules 153 may be provided depending on the configuration aspect of the mobile terminal 100.

The light output unit 154 outputs a signal for notifying the occurrence of an event using light from a light source of the mobile terminal 100. Examples of events occurring in the mobile terminal 100 may include message reception, call signal reception, missed call, alarm, schedule notification, email reception, and information reception through an application.

The signal output from the light output unit 154 is implemented as the mobile terminal emits a single color or multiple colors of light to the front or rear. The signal output may be terminated when the mobile terminal detects the user's event confirmation.

The interface unit 160 serves as a passage for all external devices connected to the mobile terminal 100. The interface unit 160 receives data from an external device or receives power and transmits it to each component inside the mobile terminal 100, or transmits data inside the mobile terminal 100 to an external device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connecting a device equipped with an identification module. (port), an audio input/output (I/O) port, a video input/output (I/O) port, an earphone port, and the like may be included in the interface unit 160.

Meanwhile, the identification module is a chip that stores various types of information for authenticating the right to use the mobile terminal 100, and includes a user identification module (UIM), a subscriber identity module (SIM), and universal user authentication. It may include a module (universal subscriber identity module; USIM). A device equipped with an identification module (hereinafter,'identification device') may be manufactured in the form of a smart card. Accordingly, the identification device may be connected to the terminal 100 through the interface unit 160.

In addition, the interface unit 160 serves as a path through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, or is input from the cradle by a user. It may be a path through which various command signals are transmitted to the mobile terminal 100. Various command signals or the power input from the cradle may be operated as signals for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The memory 170 may store a program for the operation of the controller 180 and may temporarily store input/output data (eg, a phone book, a message, a still image, a video, etc.). The memory 170 may store data on vibrations and sounds of various patterns output when a touch input on the touch screen is performed.

The memory 170 is a flash memory type, a hard disk type, a solid state disk type, an SDD type, a multimedia card micro type. ), card-type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read (EEPROM) -only memory), programmable read-only memory (PROM), magnetic memory, magnetic disk, and optical disk. The mobile terminal 100 may be operated in connection with a web storage that performs a storage function of the memory 170 over the Internet.

Meanwhile, as described above, the controller 180 controls an operation related to an application program and, in general, an overall operation of the mobile terminal 100. For example, when the state of the mobile terminal satisfies a set condition, the controller 180 may execute or release a lock state limiting input of a user's control command for applications.

In addition, the controller 180 performs control and processing related to voice calls, data communication, video calls, etc., or performs pattern recognition processing capable of recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively. I can. Furthermore, in order to implement various embodiments described below on the mobile terminal 100 according to the present invention, the controller 180 may control any one or a combination of a plurality of components described above.

The power supply unit 190 receives external power and internal power under the control of the controller 180 to supply power necessary for the operation of each component. The power supply unit 190 includes a battery, and the battery may be a built-in battery configured to be rechargeable, and may be detachably coupled to a terminal body for charging or the like.

Further, the power supply unit 190 may include a connection port, and the connection port may be configured as an example of an interface 160 to which an external charger supplying power for charging a battery is electrically connected.

As another example, the power supply unit 190 may be configured to charge the battery in a wireless manner without using the connection port. In this case, the power supply unit 190 uses at least one of an inductive coupling method based on a magnetic induction phenomenon or a magnetic resonance coupling method based on an electromagnetic resonance phenomenon from an external wireless power transmitter. Power can be delivered.

Meanwhile, hereinafter, various embodiments may be implemented in a recording medium that can be read by a computer or a similar device using, for example, software, hardware, or a combination thereof.

Hereinafter, embodiments related to a control method that can be implemented in a mobile terminal configured as described above will be described with reference to the accompanying drawings. It is obvious to those skilled in the art that the present invention can be embodied in other specific forms without departing from the spirit and essential features of the present invention.

2 is a flowchart showing the operation of the mobile terminal of FIG. 1.

As shown, the controller 180 of the mobile terminal 100 according to an embodiment of the present invention may perform a step (S10) of performing a first continuous shooting and a second continuous shooting.

The first and second continuous shooting may be performed through the camera 121 of the mobile terminal 100. The camera 121 may be located on at least one surface of the mobile terminal 100. For example, the camera 121 may include a front camera (121a in FIG. 3) and a rear camera (121b in FIG. 3) located on the front of the mobile terminal 100. In general, when shooting an external image, a rear camera (121b in FIG. 3) may be used. However, in the present specification, the bottom camera (121a in FIG. 3) and the rear camera (121b in FIG. 3) are not distinguished from each other, unless a special distinction is required, and will be expressed as a camera 121.

The first and second continuous shooting may be an operation of performing a plurality of shooting within a predetermined time. For example, continuous shooting may be an operation of shooting 20 still images within a time period of 1 second. The time and/or the number of times the continuous shooting is performed may be changed.

A plurality of continuous shooting may be performed at regular intervals. For example, this means that the first continuous shooting may be performed for a preset time, and the second continuous shooting may be performed again for a preset time at a certain time interval.

The first and second continuous shooting may be performed by a user's manipulation and/or a control signal from the controller 180. For example, this means that the first continuous shooting may be performed while the touch to the shooting button is continued, and the second continuous shooting may be performed while the touch to the shooting button is continued again.

Steps S20 and S30 of generating a first image cluster by a first continuous shooting and a second image cluster by a second continuous shooting may be performed.

The image cluster may be a set of images generated by one continuous shooting. A specific number of images can be generated by one continuous shooting. For example, this means that 5 images with a slight time difference can be created. The five images may be slightly different images due to a slight time difference, but since the time difference is not large, a significant portion of the images may overlap each other.

The controller 180 may manage an image generated by one continuous shooting as one set. The controller 180 may manage an image generated by one continuous shooting as one image cluster. For example, this means that one image can be generated by overlapping portions of an image captured by one continuous shooting. Hereinafter, one image formed in this way will be referred to as an image cluster. Therefore, if continuous shooting is performed twice, two image clusters can be created.

The step (S40) of generating a combined image using the first and second image clusters may be performed.

As described above, the first and second image clusters may be a set of images captured by the first continuous shooting and the second continuous shooting.

The controller 180 may combine the first and second image clusters. For example, it means that a combined image in which regions overlapping each other in the first and second image clusters can be overlapped can be generated. The combined image, which will be described in detail in the corresponding part, may exhibit an animation effect such as moving a photographed object even though it is not a video.

The step S50 of dividing and displaying the first and second image clusters on the combined image may be performed.

The combined image may be a set of images by a plurality of continuous shooting. For example, it means that it may be a set of images by the first continuous shooting and the second continuous shooting.

The controller 180 may separate and display the first image cluster portion and the second image cluster portion on the combined image. Accordingly, the user can intuitively recognize the portion photographed by the first continuous shooting and the portion photographed by the second continuous shooting by looking at the displayed combined image.

3 to 5 are diagrams illustrating continuous shooting in the mobile terminal of FIG. 1.

As shown in these drawings, the mobile terminal 100 according to the exemplary embodiment of the present invention may acquire a continuous still image using the camera 121.

As shown in FIG. 3, the user can photograph the object OB using the mobile terminal 100. For example, it means that you can shoot a ball that falls to the floor and bounces several times.

The user may photograph the object OB using the rear camera 121b. In the case of using the rear camera 121b, the user can check the photographed image on the display unit 151 substantially simultaneously with the photographing.

Continuous shooting may be performed when a user touches the first button B displayed on the display unit 151. For example, continuous shooting may be performed while the first button B is pressed.

Continuous shooting may be started when the user touches the first button B. However, even if the touch continues, continuous shooting may be automatically terminated when a preset time and/or a preset number of shots elapse.

Continuous shooting may be performed multiple times discontinuously. For example, if the user touches the first button (B) and then touches the first button (B) again after the first continuous shooting is performed, the second continuous shooting is slightly different from the first continuous shooting. It means that shooting can be done.

The controller 180 may manage a plurality of consecutive photographing as if it were one continuous photographing. For example, it means that after the first continuous shooting is performed, a single combined image can be generated by bundling the second continuous shooting taken in a certain time range, the same object and/or the same place.

As shown in FIG. 4, the form of continuous shooting may be changed according to a user's selection.

As shown in FIG. 4A, a'Shot' button may be displayed on the display. If you select the Shot button with your finger (F), etc., continuous shooting can be performed. For example, it means that if the Shot button is touched for less than a certain period of time, normal image shooting is in progress, and if the Shot button is touched beyond a certain amount of time, continuous shooting can be performed.

The controller 180 may change the continuous shooting property according to the method of touching the shot button. For example, if the operation of dragging upward or downward while touching the shot button is performed, it means that the speed of continuous shooting and the duration of continuous shooting can be changed according to the degree of drag.

As shown in (b) of FIG. 4, in a normal situation, continuous shooting may be performed at a first interval IT1. That is, it means that photographing can be performed at intervals of t1, t2, t3, t4, and t5.

When a user's drag operation for the shot button is input, the controller 180 may change the shooting interval. For example, this means that photographing may be performed at intervals of the second interval IT2 faster than the first interval IT1. When photographing is performed at intervals of the second interval IT2, more images may be photographed at the same time.

As shown in FIG. 5, first to fifth images (I1 to I5) may be captured by a first continuous shooting, and 6 to 10 images (I6 to I10) may be captured by a second continuous shooting. .

The controller 180 generates the first image cluster IC1 using the first to fifth images I1 to I5 by the first continuous shooting, and the 6 to 10 images I6 to I5 by the second continuous shooting. I10) can be used to create a second image cluster IC2. The first and second image clusters IC1 and IC2 will be described in more detail in the corresponding section.

6 to 8 are diagrams illustrating image cluster generation in the mobile terminal of FIG. 1.

As shown in these drawings, the controller 180 of the mobile terminal 100 according to an embodiment of the present invention may generate an image cluster using images acquired through continuous shooting.

As shown in FIG. 6, the controller 180 may generate a first image cluster IC1 from first to fifth images I1 to I5 captured through a first continuous shooting.

The first image cluster IC1 may be generated by overlapping overlapping portions of the first to fifth images I1 to I5.

The first to fifth images I1 to I5 may be images continuously photographed at a relatively short interval, as described above. Accordingly, images adjacent to each other, such as the first image I1 and the second image I2, and the second image I2 and the third image I3, may have regions overlapping each other. The controller 180 may generate one image by overlapping regions that overlap each other, and the generated image is referred to as a first image cluster IC1.

As shown in FIG. 7, the controller 180 may generate the second image cluster IC2 from the sixth to tenth images I6 to I10 captured through the second continuous shooting. Since the method of generating the second image cluster IC2 is similar to that of the first image cluster IC1, a detailed description will be omitted.

As shown in FIG. 8, the controller 180 may generate image clusters in various ways. Hereinafter, the first image cluster IC1 will be described, but this method may also be applied to the second image cluster IC2.

As shown in (a) of FIG. 8, the first image cluster IC1 may be an image formed by overlapping the captured first to fifth images I1 to I5 with each other. Accordingly, the upper side and/or the lower side of the first image cluster IC1 may not be constant. That is, it means that the first image cluster IC1 having an irregular shape vertically may be generated depending on the location of the moment of photographing.

As shown in (b) of FIG. 8, the controller 180 may generate a first image cluster IC1 in which the upper side and/or the lower side are trimmed. For example, the actual size of the first to fifth images I1 to I5 may be larger than the screen displayed on the display unit 151. Accordingly, the first to fifth images I1 to I5 may have a large margin to be trimmed upward and/or downward based on the captured object.

The controller 180 may edit the upper side and/or the lower side of the first to fifth images I1 to I5 with room for trimming to generate the first image cluster IC1 having a substantially rectangular shape.

9 and 10 are diagrams illustrating generation of a combined image in the mobile terminal of FIG. 1.

As shown in these drawings, the controller 180 of the mobile terminal 100 according to an embodiment of the present invention may generate a combined image by combining a plurality of image clusters. Accordingly, a user can manage images captured through a plurality of continuous shooting as a single image file, and thus more conveniently reproduce and edit images captured through continuous shooting.

As illustrated in FIG. 9, the controller 180 may generate a combined image AI by combining the first image cluster IC1 and the second image cluster IC2.

The combined image AI may have a form in which a common region of the first image cluster IC1 and the second image cluster IC2 are overlapped. For example, this means that the end of the first image cluster IC1 and the start point of the second image cluster IC2 may overlap each other. Such overlapping may be made more clearly when the time and/or place at which the first continuous shooting is finished and the time and/or place at which the second continuous shooting is started are adjacent.

As shown in (a) of FIG. 10, the controller 180 may display the boundary between the first image cluster IC1 and the second image cluster IC2 on the combined image AI. For example, this means that the identifier SL can be displayed between the first and second image clusters IC1 and IC2.

The identifier SL may intuitively distinguish an area of the first image cluster IC1 and an area of the second image cluster IC2. Therefore, the user can perform operations such as separately reproducing the part corresponding to the first image cluster IC1 in the combined image AI, or separately editing the part corresponding to the first image cluster IC1. . For example, when touching the area of the first image cluster IC1 divided by the identifier SL, only the image corresponding to the first image cluster IC1 is played, not the entire combined image AI. It means that the operation may be possible.

As shown in (b) of FIG. 10, the controller 180 may also display the identifier SL in the combined image AI configured in a rectangular shape.

The identifier SL may be configured in various forms. For example, not only the line shape displayed at the boundary of the first and second image clusters IC1 and IC2, but also the color and brightness of the first and second image clusters IC1 and IC2, This means that at least one of the saturation may be different.

Figure 11 A and to 12 are diagrams showing how to display the thumbnail of the combined image generated by the mobile terminal 1.

As shown in these drawings, the controller 180 of the mobile terminal 100 according to an embodiment of the present invention is a preview image (PI) of an image stored in the memory 170 of the mobile terminal 100. Can be displayed in the form of a thumbnail. The controller 180 may display a combined image on an image in the form of a thumbnail.

11A, a plurality of preview images PI may be displayed on the display unit 151. The preview image PI may be a set of thumbnails for images stored in the memory 170 or the like. A thumbnail of the combined image AI may be included in the preview image PI.

The controller 180 may display an identification icon IC for easily recognizing the combined image AI among the preview images PI. The user can intuitively and easily recognize the combined image AI through the identification icon IC, and perform necessary manipulations on the image.

The combined image AI may be displayed in various forms. For example, it may be displayed in a square shape like the first combined image AI1. Alternatively, like the second combined image AI2, the upper and lower portions of the first captured image may be displayed in a non-trimmed form. In such a case, the user can more intuitively recognize that the corresponding image is an image by continuous shooting.

The combined image AI may be displayed in the form of a first combined image AI1 and/or a second combined image AI2 by selection of a user and/or a control operation of the controller.

As shown in (a) of FIG. 11B, the combined image AI may be displayed in a form in which upper and lower portions are not trimmed. In other words, it means that a thumbnail that can be intuitively sensed that it is an image by continuous shooting can be displayed on the preview screen.

As shown in (b) of FIG. 11B, the user may perform a touch operation of dragging in a predetermined direction with a finger F or the like. For example, it means that a drag operation can be performed in the left direction on a specific combined image AI.

As shown in (a) of FIG. 11C, the controller 180 may change the shape of the combined image AI in response to a dragging operation in a specific direction on the untrimmed thumbnail. For example, this means that a thumbnail whose top and bottom are not trimmed can be changed to a rectangular shape with top and bottom trimmed. As for the thumbnail shape, all thumbnails may be changed at once. Alternatively, only a specific thumbnail touched and dragged by the user may be changed.

The user can perform a drag operation in a direction opposite to the first on the rectangular thumbnail by trimming the top and bottom. For example, it means that the drag operation in the right direction can be performed.

As shown in (b) of FIG. 11C, in response to a drag operation in a specific direction, the controller 180 may change the rectangular thumbnail to a non-trimmed top and bottom thumbnail. Through such a change, the user's interest in the mobile terminal 100 can be increased.

As shown in FIG. 12, the controller 180 may display a thumbnail of the combined image AI in which the identifier SL is displayed. The user can easily recognize that the corresponding thumbnail is a combination of a plurality of image clusters through the identifier SL.

13 to 15 are diagrams illustrating a method of reproducing a combined image generated by the mobile terminal of FIG. 1.

As shown in these drawings, the controller 180 of the mobile terminal 100 according to an embodiment of the present invention can reproduce the selected combined image AI. The combined image (AI) is different from a typical video. That is, it is not a continuous image. However, the controller 180 may generate a combined image AI, which is an animation image with motion, by combining a plurality of images photographed at a predetermined interval. In other words, it means that the discontinuous motion of the object can be observed.

By generating the combined image (AI), it may be convenient to manage a plurality of images acquired through continuous shooting. For example, when 10 images are acquired, this means that it may be possible to manage only one combined image (AI) file rather than separately managing each image. For example, it means that it is possible to edit at least one of a plurality of images through manipulation of the combined image AI, and specific details will be described in a corresponding part.

As shown in (a) of FIG. 13, the user can select the combined image AI with a finger F or the like. The controller 180 may reproduce the selected combined image AI.

The user may select specific areas of the first and second image clusters IC1 and IC2 that can be known through the identifier SL of the combined image AI. For example, the user may select the first image cluster IC1 area. When only the first image cluster IC1 area is selected, the controller 180 can reproduce only the image corresponding to the first image cluster IC1 among the combined images AI.

As shown in (b) of FIG. 13, the controller 180 may provide a screen for reproducing the selected combined image AI. For example, a progress bar (PB) corresponding to the entire combined image (AI), an index indicating the current playback position (CI), a first button (B1) for selecting whether to play/stop, etc. can be displayed. Means there is.

As shown in FIG. 14A, the user may select the first button B1 with a finger F or the like. The first button B1 may be toggled between play and stop. For example, it means that it can be operated as a play button at first and as a stop button when it is played back.

As shown in (b) of FIG. 14, the controller 180 may reproduce the combined image AI. The playback of the combined image AI is different from the playback of a typical video as described above. In other words, reproduction of the combined image AI means that images photographed at a certain interval are reproduced discontinuously.

The controller 180 may change the position of the index CI according to the reproduction of the combined image AI. The user can intuitively recognize the current playback position in the entire combined image AI through the position of the index CI.

As shown in Fig. 15A, the user can arbitrarily change the playback position. For example, the user may touch the index CI with a finger F or the like. The user can drag the touched index CI to the left or right.

As shown in FIG. 15B, the controller 180 may change the display of the display unit 151 in response to a drag on the index CI.

16 to 24 are diagrams illustrating operations on a combined image generated by the mobile terminal of FIG. 1.

As shown in these drawings, the control unit 180 of the mobile terminal 100 according to an embodiment of the present invention is based on an input acquired from a user and/or a control signal from the control unit 180. ), you can edit at least part of it.

As shown in (a) of FIG. 16, a specific image of the combined image AI may be displayed on the display unit 151. The user can perform operations related to the specific displayed image. In order to manipulate an image, the user may perform an operation of touching a specific point on the display unit 151. For example, this means that a touch operation of touching the index CI and dragging upward can be performed.

As shown in (b) of FIG. 16, the combined image AI may be an image in which the first to ten images I1 to I10 are combined. The fourth image I4 may be currently being displayed on the display unit 151. In this state, when a touch operation of dragging the index CI upward is input, the controller 180 may delete the currently displayed fourth image I4. Since a specific image can be deleted through a touch at a specific location during playback of the combined image AI without manipulating each of the images constituting the combined image AI, it is possible to more effectively manage the continuously shot images.

As shown in (a) of FIG. 17, the user may perform a touch operation of touching the index CI and dragging downward.

As shown in FIG. 17B, in response to a touch operation of touching the index CI and dragging downward, the controller 180 may perform an operation of adding a specific image. For example, if the fourth image I4 is currently displayed, the controller 180 may add a fourth image I4 between the fourth image I4 and the fifth image I5. Means.

The fourth image I4 may be generated based on the fourth image I4 and the fifth image I5. For example, this means that the fourth image I4 can be generated based on a vector value for the motion of an object included in the image.

As shown in (a) of FIG. 18, the combined image AI may be unfolded by a user's manipulation and/or a control operation of the controller 180. For example, the controller 180 may detect a user's selection of the second button B2 displayed on the display unit 151.

As shown in (b) of FIG. 18, when detecting a selection for the second button B2, the controller 180 may open and display an image constituting the combined image AI that is currently being displayed. For example, it means that a thumbnail of the composition image SI of the combined image AI can be displayed. Since the thumbnail of the composition image SI is displayed, the user can observe each image in more detail.

As shown in FIG. 19A, the user may perform a touch operation on the display unit 151 on which the combined image AI is displayed. For example, this means that a touch operation in a direction in which the distance between the first and second fingers F1 and F2 is decreased can be performed.

As shown in FIG. 19B, in response to a user's specific touch operation, the controller 180 may display a configuration image SI on the display unit 151. The center of the configuration image SI displayed on the display unit 151 may be an image corresponding to a currently playing position.

The composition image SI may be displayed in a larger form than a typical thumbnail image. This configuration image (SI) is hereinafter referred to as a panel image (panel image).

As shown in (a) and (b) of FIG. 20, the user can perform an operation on the configuration image SI in the form of a displayed panel image. For example, it means that a touch operation of dragging a panel image upward or downward, left or right with a finger F or the like can be performed.

The controller 180 may perform a specific operation in response to a drag touch operation on a panel image. For example, when a touch operation of dragging a panel image upward is performed, the controller 180 may delete the corresponding panel image. When the corresponding panel image is deleted, the corresponding part may not be reproduced in the combined image AI in the future.

As shown in (a) of FIG. 21, the controller 180 may edit a specific image of the combined image AI. Among the images constituting the combined image AI, a specific image may be in a blurry state due to shaking during shooting. The user may touch the display unit 151 when a specific image is displayed. For example, this means that a long touch on the index (CI) or a touch operation such as rubbing while touching the display unit 151 can be performed.

As shown in (b) of FIG. 21, when a user's above-described touch operation is input, the controller 180 may perform candidate determination for a corresponding image. For example, it means that an operation such as correcting a blurry part more clearly can be performed by referring to an image before and/or after the corresponding image.

As shown in FIG. 22, the controller 180 may display the state of the combined image AI. For example, it means that the status icon (BI) can be displayed at a specific position on the progress bar (PB) corresponding to the combined image (AI).

The status icon BI may reflect a state of a specific image among images constituting the combined image AI. For example, when the quality of a specific image is lower than that of other images, the status icon BI may display the location. The status icon BI may indicate a boundary between image clusters. For example, when two status icons BI are displayed as shown, it can be intuitively recognized that the corresponding combined image AI is a combination of three image clusters.

As shown in (a) of FIG. 23, the controller 180 may adjust the position of the photographed specific object IG based on the user's selection. For example, the user may select a specific object IG from among objects displayed with a finger F or the like.

As shown in (b) of FIG. 23, the controller 180 may change and display the location of the selected specific object IG. For example, this means that a specific object IG can be displayed at the center of the display unit 151. That is, a specific object IG may be fixed to a specific center of the display unit 151 and the display unit 151 and an effect such as moving a background may be displayed.

FIG. 24 illustrates a difference between reproducing an image in a conventional manner and reproducing an image after fixing a specific object at a specific point.

As shown in (a) of FIG. 24, in the case of reproducing an image in a conventional manner, it can be observed that the position of the background object OI is changed according to the movement of the specific object IG. That is, as the specific object IG moves, it may be recognized that the relative position of the background object OI is changed.

As shown in (b) of FIG. 24, in the case of reproducing an image after fixing a specific object IG at a point, the position of the background object OI is moved while the specific object IG is stopped. Can be observed to be. That is, it means that it can be recognized that the screen changes as the background object OI moves. The mobile terminal 100 according to an exemplary embodiment of the present invention may reproduce a combined image AI based on a selected specific object IG so that a user may experience a feeling different from normal image reproduction.

25 and 26 are diagrams illustrating manipulation of a thumbnail of a combined image generated by the mobile terminal of FIG. 1.

As shown in these drawings, the controller 180 of the mobile terminal 100 according to an embodiment of the present invention can edit the combined image AI through direct manipulation on the thumbnail image displayed on the preview screen. .

As shown in (a) of FIG. 25, a plurality of thumbnail images PI may be displayed on the preview screen. The thumbnail image PI may include a thumbnail of the combined image AI. The user may select a thumbnail of the combined image AI displayed with a finger F or the like.

As shown in (b) of FIG. 25, when the thumbnail of the combined image AI is selected, the controller 180 can display each of the constituent images SI constituting the combined image AI in the form of a thumbnail. have.

As shown in (a) of FIG. 26, a preview screen may be displayed on the display unit 151. A combined image (AI) generated by continuous shooting may be displayed on the preview screen. The user can perform a specific touch operation on the combined image AI. For example, it means that a drag operation can be performed on the combined image AI.

As shown in (b) of FIG. 26, when a user's specific touch operation is input, the controller 180 may display the corresponding thumbnail in full screen. In this case, the controller 180 may display the upper and lower portions of the image on the display unit 151 in an untrimmed form. Accordingly, the user can more clearly recognize that the image is an image generated by continuous shooting.

As shown in (a) of FIG. 27, when a user's specific touch operation is input, the controller 180 may display the corresponding thumbnail in full screen. In this case, the controller 1800 may display the boundary of the first captured image even though the upper and lower portions of the image have been trimmed.

As shown in (a) of FIG. 2628, the user may perform an operation on a specific image among the displayed configuration images SI. For example, it means that a touch operation of touching a specific image among the displayed configuration images SI and dragging in a predetermined direction can be performed.

The controller 180 may perform an operation corresponding thereto according to the drag direction. For example, if a specific image is touched and then a drag touch operation is performed as if sending it to the outside of the display unit 151, an operation of deleting the corresponding image may be performed.

As shown in (b) of FIG. 2628, the controller 180 may delete a corresponding image in response to a user's touch operation. Other images constituting the combined image AI may be replaced at the location of the deleted image. For example, this means that the next image of the deleted image can be displayed.

The present invention described above can be implemented as a computer-readable code in a medium on which a program is recorded. The computer-readable medium includes all types of recording devices that store data that can be read by a computer system. Examples of computer-readable media include HDD (Hard Disk Drive), SSD (Solid State Disk), SDD (Silicon Disk Drive), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. There is also a carrier wave (e.g., transmission over the Internet). Also, the computer may include the controller 180 of the terminal. Therefore, the detailed description above should not be construed as restrictive in all respects and should be considered as illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

100: mobile terminal 110: wireless communication unit
120: input
140: sensing unit 150: output unit
160: interface unit 170: memory
180: control unit 190: power supply unit

Claims (15)

A display unit including a touch screen;
At least one camera; And
When entering the shooting mode, the speed and duration of continuous shooting are set based on at least one drag input with one point as a starting point and one point in another area as an end point on the touch screen, and the at least one Acquired through a second continuous shooting based on a first image cluster created with an image acquired through a first continuous shooting performed using a camera of and the setting performed using the at least one camera A mobile terminal comprising: a control unit for generating a combined image combining the second image clusters generated as one image, and displaying the first and second image clusters in the generated combined image on the display unit in a file format. The method of claim 1,
The control unit,
A mobile terminal configured to change at least one of at least one shooting speed among the first and second continuous shooting and the number of times of shooting at least one of the first and second continuous shooting according to a user's touch input to the display unit. The method of claim 1,
The control unit,
A mobile terminal that creates the first and second image clusters by overlapping an overlapped portion of the images acquired through the first and second continuous shooting. The method of claim 1,
The control unit,
By displaying an identifier including at least one of a change of at least one of a color, brightness, and saturation of at least one of the first and second image cluster boundary lines and the first and second image cluster regions, ,2 A mobile terminal that separates image clusters. The method of claim 1,
The control unit,
A mobile terminal that displays at least one image of another attribute stored in a memory and the combined image to be distinguished from each other. The method of claim 1,
The control unit,
A mobile terminal that continuously displays a plurality of images constituting the combined image on the display unit. The method of claim 1,
The control unit,
A mobile terminal configured to manipulate an image displayed on the display unit among a plurality of images constituting the combined image in response to a user's touch input to the combined image. The method of claim 7,
The above operation,
A mobile terminal comprising at least one of deleting the displayed image, adding a new image before or after the displayed image, and changing the sharpness of the displayed image. Setting a speed and duration of continuous shooting based on at least one drag input in which one point is a starting point and one point of another area is an end point on the touch screen when entering the shooting mode;
Performing a first continuous shooting using a camera based on the setting;
Performing a second continuous shooting using the camera based on the setting;
Generating a first image cluster from the image acquired through the first continuous shooting;
Generating a second image cluster from the image acquired through the second continuous shooting;
Generating a combined image by combining the first and second image clusters; And
And displaying the first and second image clusters on the combined image in a file format on a display unit. The method of claim 9,
The second continuous shooting,
A method of controlling a mobile terminal that satisfies at least one of a predetermined time range condition, a photographing condition for a common object, and a photographing condition at a common location after the end of the first continuous shooting. delete delete delete delete delete

Images