WO2015163548A1

WO2015163548A1 - Mobile terminal and control method therefor

Info

Publication number: WO2015163548A1
Application number: PCT/KR2014/009736
Authority: WO
Inventors: 손호원; 박선주; 김형섭; 김성엽
Original assignee: 엘지전자(주)
Priority date: 2014-04-24
Filing date: 2014-10-16
Publication date: 2015-10-29
Also published as: KR102160038B1; KR20150123117A

Abstract

Disclosed are a mobile terminal and a control method therefor. The present invention provides a mobile terminal and a control method therefor, the mobile terminal comprising: a camera; a sensing unit; and a control unit for displaying an image photographed through the camera together with at least one thumbnail corresponding to at least a part of the photographed image, wherein the at least one thumbnail is arranged according to an orientation of the photographing, which has been acquired through the sensing unit, and the control unit changes the display of an image corresponding to the at least one thumbnail on the basis of the manipulation of the at least one arranged thumbnail. According to the present invention, the mobile terminal can display different types of thumbnails according to an orientation at the time of photographing an image, and change the display of an image through the manipulation of the displayed thumbnails.

Description

Mobile terminal and its control method

The present invention relates to a mobile terminal capable of displaying different types of thumbnails according to the direction in which the image is taken, and changing the display of the image by manipulating the displayed thumbnails, and a control method thereof.

Terminals may be divided into mobile / portable terminals and stationary terminals according to their mobility. The mobile terminal may be further classified into a handheld terminal and a vehicle mounted terminal according to whether a user can directly carry it.

The functions of mobile terminals are diversifying. For example, data and voice communication, taking a picture and video with a camera, recording a voice, playing a music file through a speaker system, and outputting an image or video to a display unit. Some terminals have an electronic game play function or a multimedia player function. In particular, recent mobile terminals may receive multicast signals that provide visual content such as broadcasting, video, and television programs.

As the terminal functions are diversified, for example, such a terminal is a multimedia player having a complex function such as taking a picture or a video, playing a music or video file, playing a game, or receiving a broadcast. Is being implemented.

In order to support and increase the function of such a terminal, it may be considered to improve the structural part and / or the software part of the terminal.

In addition, a method for more effectively managing a moving picture or the like photographed using the terminal has been requested.

It is an object of the present invention to solve the above and other problems. It is still another object of the present invention to provide a mobile terminal and a method of controlling the same, which display thumbnails of different types according to the direction in which the image is taken and change the display of the image by manipulating the displayed thumbnails.

According to an aspect of the present invention to achieve the above or another object, a camera; Sensing unit; And displaying an image taken by the camera together with at least one thumbnail corresponding to at least a portion of the captured image, wherein the at least one thumbnail is obtained through the sensing unit. The controller may be arranged according to an orientation, and the controller may be configured to change the display of an image corresponding to the at least one thumbnail based on an operation on the arranged at least one thumbnail.

The directing direction of the photographing includes a first directing direction in which the mobile terminal is gripped in the horizontal direction and photographed, and a second directing direction in which the mobile terminal is gripped in the vertical direction and photographed. At least one of a shape and a color of the first thumbnail corresponding to the image photographed in the first direction and the second thumbnail corresponding to the image photographed in the second direction may be differently displayed. .

The controller may display the first thumbnail in a horizontal length and a short vertical length as compared with the second thumbnail.

The controller may change a display form of the at least one thumbnail based on a direction of the obtained touch input when the user inputs the touch input to the at least one thumbnail.

The at least one thumbnail may include a first thumbnail having an elongated shape corresponding to the first direction in which the mobile terminal is held in the horizontal direction and photographed, and a second direction in which the mobile terminal is held in the vertical direction and photographed. In response to the second thumbnail having a vertical form of the elongated shape, the control unit may change from one of the first and second thumbnails to the other form in response to the touch input.

The image includes a first image photographed in the first direction and a second image photographed in the second direction, and the controller is configured to substantially change the display of the at least one thumbnail. One or more of the at least one first and second images may be changed into another.

When the control unit changes from at least one of the first and second images to another form, the controller darkens a blank area according to a difference between the horizontal length of the first image and the horizontal length of the second image. Can be blacken.

The controller may change the display form of the entire thumbnail in the same manner based on the acquired touch direction.

The apparatus may further include a wireless communication unit, and the control unit may change the display direction of the image in another terminal sharing the image through the wireless communication unit, corresponding to the direction of orientation of the mobile terminal.

The controller may perform an operation of changing the shape of the at least one thumbnail in correspondence to the direction of the mobile terminal at the time of displaying the image.

Further, according to another aspect of the invention, the step of sensing the directing direction of the shooting to take an image; Displaying at least one thumbnail corresponding to at least a portion of the photographed image together with the photographed image in the directing direction; And changing the display of the image corresponding to the at least one thumbnail based on an operation on the at least one thumbnail.

The changing of the display may include photographing a first thumbnail corresponding to an image in a first direction in which the mobile terminal is gripped in a horizontal direction and the mobile terminal in a vertical direction among the at least one thumbnail. At least one of the shape and color of the second thumbnail corresponding to the image in the second direction may be differently displayed.

The method may further include acquiring a user's touch input to the at least one thumbnail, and the changing of the display may change the display form of the at least one thumbnail based on a direction of the acquired touch input. .

The changing of the display may include the first image photographed in the first direction and the second image photographed in the second direction, substantially together with the change of the display form of the at least one thumbnail. It can be changed from at least one form of the other.

The method may further include changing a display direction of the image in another terminal sharing the image, corresponding to the direction of the mobile terminal.

The effects of the mobile terminal and its control method according to the present invention are as follows.

According to at least one of the embodiments of the present invention, there is an advantage in that a thumbnail of a different form can be displayed according to the direction in which the image is taken, and the display of the image can be changed by manipulating the displayed thumbnail.

Further scope of the applicability of the present invention will become apparent from the following detailed description. However, various changes and modifications within the spirit and scope of the present invention can be clearly understood by those skilled in the art, and therefore, specific embodiments, such as the detailed description and the preferred embodiments of the present invention, should be understood as given by way of example only.

1A is a block diagram illustrating a mobile terminal related to the present invention.

1B and 1C are conceptual views of one example of a mobile terminal, viewed from different directions.

2 is a conceptual diagram illustrating another example of a deformable mobile terminal according to the present invention.

3 is a flowchart illustrating an operation of a mobile terminal according to an embodiment of the present invention.

4 to 6 are flowcharts specifically showing corresponding parts of the flowchart of FIG. 3.

7 and 8 illustrate an operation of a sensing unit of the mobile terminal of FIG. 3.

9 and 10 are diagrams illustrating image capturing using the mobile terminal of FIG. 3.

11 to 19 illustrate a method of displaying a thumbnail using the mobile terminal of FIG. 3.

20 to 24 are diagrams illustrating a thumbnail manipulation method.

25 to 29 are diagrams illustrating screen display according to an operation on a thumbnail.

30 to 32 are diagrams illustrating a relationship between a mobile terminal and another device.

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings, and the same or similar components are denoted by the same reference numerals regardless of the reference numerals, and redundant description thereof will be omitted. The suffixes "module" and "unit" for components used in the following description are given or used in consideration of ease of specification, and do not have distinct meanings or roles from each other. In addition, in describing the embodiments disclosed herein, when it is determined that the detailed description of the related known technology may obscure the gist of the embodiments disclosed herein, the detailed description thereof will be omitted. In addition, the accompanying drawings are intended to facilitate understanding of the embodiments disclosed herein, but are not limited to the technical spirit disclosed herein by the accompanying drawings, all changes included in the spirit and scope of the present invention. It should be understood to include equivalents and substitutes.

Terms including ordinal numbers such as first and second may be used to describe various components, but the components are not limited by the terms. The terms are used only for the purpose of distinguishing one component from another.

When a component is referred to as being "connected" or "connected" to another component, it may be directly connected to or connected to that other component, but it may be understood that other components may be present in between. Should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that there is no other component in between.

Singular expressions include plural expressions unless the context clearly indicates otherwise.

In this application, the terms "comprises" or "having" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof.

The mobile terminal described herein includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant, a portable multimedia player, a navigation, a slate PC , Tablet PCs, ultrabooks, wearable devices, such as smartwatches, glass glasses, head mounted displays, and the like. have.

However, it will be readily apparent to those skilled in the art that the configuration according to the embodiments described herein may also be applied to fixed terminals such as digital TVs, desktop computers, digital signages, etc., except when applicable only to mobile terminals. will be.

1A to 1C, FIG. 1A is a block diagram illustrating a mobile terminal according to the present invention, and FIGS. 1B and 1C are conceptual views of one example of the mobile terminal, viewed from different directions.

The mobile terminal 100 includes a wireless communication unit 110, an input unit 120, a sensing unit 140, an output unit 150, an interface unit 160, a memory 170, a controller 180, and a power supply unit 190. ) May be included. The components shown in FIG. 1A are not essential to implementing a mobile terminal, so that the mobile terminal described herein may have more or fewer components than those listed above.

More specifically, the wireless communication unit 110 of the components, between the mobile terminal 100 and the wireless communication system, between the mobile terminal 100 and another mobile terminal 100, or the mobile terminal 100 and the external server It may include one or more modules that enable wireless communication therebetween. In addition, the wireless communication unit 110 may include one or more modules for connecting the mobile terminal 100 to one or more networks.

The wireless communication unit 110 may include at least one of the broadcast receiving module 111, the mobile communication module 112, the wireless internet module 113, the short range communication module 114, and the location information module 115. .

The input unit 120 may include a camera 121 or an image input unit for inputting an image signal, a microphone 122 for inputting an audio signal, an audio input unit, or a user input unit 123 for receiving information from a user. , Touch keys, mechanical keys, and the like. The voice data or the image data collected by the input unit 120 may be analyzed and processed as a control command of the user.

The sensing unit 140 may include one or more sensors for sensing at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information. For example, the sensing unit 140 may include a proximity sensor 141, an illumination sensor 142, an illumination sensor, a touch sensor, an acceleration sensor, a magnetic sensor, and gravity. G-sensor, Gyroscope Sensor, Motion Sensor, RGB Sensor, Infrared Sensor, Infrared Sensor, Finger Scan Sensor, Ultrasonic Sensor Optical sensors (e.g. cameras 121), microphones (see 122), battery gauges, environmental sensors (e.g. barometers, hygrometers, thermometers, radiation detection sensors, Thermal sensors, gas sensors, etc.), chemical sensors (eg, electronic noses, healthcare sensors, biometric sensors, etc.). Meanwhile, the mobile terminal disclosed herein may use a combination of information sensed by at least two or more of these sensors.

The output unit 150 is used to generate an output related to sight, hearing, or tactile sense, and includes at least one of a display unit 151, an audio output unit 152, a hap tip module 153, and an optical output unit 154. can do. The display unit 151 forms a layer structure with or is integrally formed with the touch sensor, thereby implementing a touch screen. The touch screen may function as a user input unit 123 that provides an input interface between the mobile terminal 100 and the user, and may also provide an output interface between the mobile terminal 100 and the user.

The interface unit 160 serves as a path to various types of external devices connected to the mobile terminal 100. The interface unit 160 connects a device equipped with a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, and an identification module. It may include at least one of a port, an audio input / output (I / O) port, a video input / output (I / O) port, and an earphone port. In the mobile terminal 100, in response to an external device being connected to the interface unit 160, appropriate control associated with the connected external device may be performed.

In addition, the memory 170 stores data supporting various functions of the mobile terminal 100. The memory 170 may store a plurality of application programs or applications driven in the mobile terminal 100, data for operating the mobile terminal 100, and instructions. At least some of these applications may be downloaded from an external server via wireless communication. In addition, at least some of these application programs may exist on the mobile terminal 100 from the time of shipment for basic functions of the mobile terminal 100 (for example, a call forwarding, a calling function, a message receiving, and a calling function). The application program may be stored in the memory 170 and installed on the mobile terminal 100 to be driven by the controller 180 to perform an operation (or function) of the mobile terminal.

In addition to the operation related to the application program, the controller 180 typically controls the overall operation of the mobile terminal 100. The controller 180 may provide or process information or a function appropriate to a user by processing signals, data, information, and the like, which are input or output through the above-described components, or by driving an application program stored in the memory 170.

In addition, the controller 180 may control at least some of the components described with reference to FIG. 1A in order to drive an application program stored in the memory 170. Furthermore, the controller 180 may operate by combining at least two or more of the components included in the mobile terminal 100 to drive the application program.

The power supply unit 190 receives power from an external power source and an internal power source under the control of the controller 180 to supply power to each component included in the mobile terminal 100. The power supply unit 190 includes a battery, which may be a built-in battery or a replaceable battery.

At least some of the components may operate in cooperation with each other to implement an operation, control, or control method of the mobile terminal according to various embodiments described below. In addition, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 170.

Hereinafter, the components listed above will be described in detail with reference to FIG. 1A before looking at various embodiments implemented through the mobile terminal 100 described above.

First, referring to the wireless communication unit 110, the broadcast receiving module 111 of the wireless communication unit 110 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or switching of broadcast channels for at least two broadcast channels.

The mobile communication module 112 may include technical standards or communication schemes (eg, Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (CDMA2000), and EV). Enhanced Voice-Data Optimized or Enhanced Voice-Data Only (DO), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), LTE-A (Long Term Evolution-Advanced) and the like to transmit and receive a radio signal with at least one of a base station, an external terminal, a server on a mobile communication network.

The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.

The wireless internet module 113 refers to a module for wireless internet access and may be embedded or external to the mobile terminal 100. The wireless internet module 113 is configured to transmit and receive wireless signals in a communication network according to wireless internet technologies.

Examples of wireless Internet technologies include Wireless LAN (WLAN), Wireless-Fidelity (Wi-Fi), Wireless Fidelity (Wi-Fi) Direct, Digital Living Network Alliance (DLNA), Wireless Broadband (WiBro), and WiMAX (World). Interoperability for Microwave Access (HSDPA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), and the like. 113) transmits and receives data according to at least one wireless Internet technology in a range including the Internet technologies not listed above.

In view of the fact that the wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A, etc. is made through a mobile communication network, the wireless Internet module 113 for performing a wireless Internet access through the mobile communication network 113 ) May be understood as a kind of mobile communication module 112.

The short range communication module 114 is for short range communication, and includes Bluetooth ™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and NFC. (Near Field Communication), at least one of Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, Wireless USB (Wireless Universal Serial Bus) technology can be used to support short-range communication. The short-range communication module 114 may be configured between a mobile terminal 100 and a wireless communication system, between the mobile terminal 100 and another mobile terminal 100, or through the wireless area networks. ) And a network in which the other mobile terminal 100 (or an external server) is located. The short range wireless communication network may be short range wireless personal area networks.

Here, the other mobile terminal 100 is a wearable device capable of exchanging (or interworking) data with the mobile terminal 100 according to the present invention (for example, smartwatch, smart glasses). (smart glass), head mounted display (HMD). The short range communication module 114 may sense (or recognize) a wearable device that can communicate with the mobile terminal 100, around the mobile terminal 100. Further, when the detected wearable device is a device that is authenticated to communicate with the mobile terminal 100 according to the present invention, the controller 180 may include at least a portion of data processed by the mobile terminal 100 in the short range communication module ( The transmission may be transmitted to the wearable device through 114. Therefore, the user of the wearable device may use data processed by the mobile terminal 100 through the wearable device. For example, according to this, when a call is received by the mobile terminal 100, the user performs a phone call through the wearable device or when a message is received by the mobile terminal 100, the received through the wearable device. It is possible to check the message.

The location information module 115 is a module for obtaining a location (or current location) of a mobile terminal, and a representative example thereof is a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, when the mobile terminal utilizes the GPS module, the mobile terminal may acquire the location of the mobile terminal using a signal transmitted from a GPS satellite. As another example, when the mobile terminal utilizes the Wi-Fi module, the mobile terminal may acquire the location of the mobile terminal based on information of the wireless access point (AP) transmitting or receiving the Wi-Fi module and the wireless signal. If necessary, the location information module 115 may perform any function of other modules of the wireless communication unit 110 to substitute or additionally obtain data regarding the location of the mobile terminal. The location information module 115 is a module used to obtain the location (or current location) of the mobile terminal, and is not limited to a module that directly calculates or obtains the location of the mobile terminal.

Next, the input unit 120 is for inputting image information (or signal), audio information (or signal), data, or information input from a user. For input of image information, the mobile terminal 100 is one. Alternatively, the plurality of cameras 121 may be provided. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame may be displayed on the display unit 151 or stored in the memory 170. On the other hand, the plurality of cameras 121 provided in the mobile terminal 100 may be arranged to form a matrix structure, and through the camera 121 forming a matrix structure in this way, the mobile terminal 100 may have various angles or focuses. The plurality of pieces of image information may be input. In addition, the plurality of cameras 121 may be arranged in a stereo structure to acquire a left image and a right image for implementing a stereoscopic image.

The microphone 122 processes external sound signals into electrical voice data. The processed voice data may be variously used according to a function (or an application program being executed) performed by the mobile terminal 100. Meanwhile, various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in the process of receiving an external sound signal.

The user input unit 123 is for receiving information from a user. When information is input through the user input unit 123, the controller 180 may control an operation of the mobile terminal 100 to correspond to the input information. . The user input unit 123 may be a mechanical input unit (or a mechanical key, for example, a button, a dome switch, a jog wheel, or the like located at the front or rear or side of the mobile terminal 100). Jog switch, etc.) and touch input means. As an example, the touch input means may include a virtual key, a soft key, or a visual key displayed on the touch screen through a software process, or a portion other than the touch screen. The virtual key or the visual key may be displayed on the touch screen while having various forms, for example, graphic or text. ), An icon, a video, or a combination thereof.

Meanwhile, the sensing unit 140 senses at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information, and generates a sensing signal corresponding thereto. The controller 180 may control driving or operation of the mobile terminal 100 or perform data processing, function or operation related to an application program installed in the mobile terminal 100 based on the sensing signal. Representative sensors among various sensors that may be included in the sensing unit 140 will be described in more detail.

First, the proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without using a mechanical contact by using an electromagnetic force or infrared rays. The proximity sensor 141 may be disposed in an inner region of the mobile terminal covered by the touch screen described above or near the touch screen.

Examples of the proximity sensor 141 include a transmission photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high frequency oscillation proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. In the case where the touch screen is capacitive, the proximity sensor 141 may be configured to detect the proximity of the object by the change of the electric field according to the proximity of the conductive object. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of explanation, an action of allowing the object to be recognized without being in contact with the touch screen so that the object is located on the touch screen is referred to as a "proximity touch", and the touch The act of actually touching an object on a screen is called a "contact touch." The position at which the object is in close proximity touch on the touch screen means a position where the object is perpendicular to the touch screen when the object is in close proximity touch. The proximity sensor 141 may detect a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, and a proximity touch movement state). have. Meanwhile, the controller 180 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern detected through the proximity sensor 141 as described above, and further, provides visual information corresponding to the processed data. It can be output on the touch screen. Further, the controller 180 may control the mobile terminal 100 to process different operations or data (or information) according to whether the touch on the same point on the touch screen is a proximity touch or a touch touch. .

The touch sensor applies a touch (or touch input) applied to the touch screen (or the display unit 151) using at least one of various touch methods such as a resistive film method, a capacitive method, an infrared method, an ultrasonic method, and a magnetic field method. Detect.

As an example, the touch sensor may be configured to convert a change in pressure applied to a specific portion of the touch screen or capacitance generated at the specific portion into an electrical input signal. The touch sensor may be configured to detect a position, an area, a pressure at the touch, a capacitance at the touch, and the like, when the touch object applying the touch on the touch screen is touched on the touch sensor. Here, the touch object is an object applying a touch to the touch sensor and may be, for example, a finger, a touch pen or a stylus pen, a pointer, or the like.

As such, when there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can know which area of the display unit 151 is touched. Here, the touch controller may be a separate component from the controller 180 or may be the controller 180 itself.

Meanwhile, the controller 180 may perform different control or perform the same control according to the type of touch object that touches the touch screen (or a touch key provided in addition to the touch screen). Whether to perform different control or the same control according to the type of touch object may be determined according to the operation state of the mobile terminal 100 or an application program being executed.

Meanwhile, the touch sensor and the proximity sensor described above may be independently or combined, and may be a short (or tap) touch, a long touch, a multi touch, a drag touch on a touch screen. ), Flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, etc. A touch can be sensed.

The ultrasonic sensor may recognize location information of a sensing object using ultrasonic waves. On the other hand, the controller 180 can calculate the position of the wave generation source through the information detected from the optical sensor and the plurality of ultrasonic sensors. The position of the wave source can be calculated using the property that the light is much faster than the ultrasonic wave, that is, the time that the light reaches the optical sensor is much faster than the time when the ultrasonic wave reaches the ultrasonic sensor. More specifically, the position of the wave generation source may be calculated using a time difference from the time when the ultrasonic wave reaches the light as the reference signal.

On the other hand, the camera 121, which has been described as the configuration of the input unit 120, includes at least one of a camera sensor (eg, CCD, CMOS, etc.), a photo sensor (or image sensor), and a laser sensor.

The camera 121 and the laser sensor may be combined with each other to detect a touch of a sensing object with respect to a 3D stereoscopic image. The photo sensor may be stacked on the display element, which is configured to scan the movement of the sensing object in proximity to the touch screen. More specifically, the photo sensor mounts a photo diode and a transistor (TR) in a row / column and scans contents mounted on the photo sensor by using an electrical signal that varies according to the amount of light applied to the photo diode. That is, the photo sensor calculates coordinates of the sensing object according to the amount of light change, and thus, the position information of the sensing object can be obtained.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, the display unit 151 may display execution screen information of an application program driven in the mobile terminal 100 or user interface (UI) and graphical user interface (GUI) information according to the execution screen information. .

In addition, the display unit 151 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

The stereoscopic display unit may be a three-dimensional display method such as a stereoscopic method (glasses method), an auto stereoscopic method (glasses-free method), a projection method (holographic method).

The sound output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output unit 152 may also output a sound signal related to a function (for example, a call signal reception sound or a message reception sound) performed in the mobile terminal 100. The sound output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 153 generates various haptic effects that a user can feel. A representative example of the tactile effect generated by the haptic module 153 may be vibration. The intensity and pattern of vibration generated by the haptic module 153 may be controlled by the user's selection or the setting of the controller. For example, the haptic module 153 may synthesize different vibrations and output or sequentially output them.

In addition to vibration, the haptic module 153 may be used to stimulate pins that vertically move with respect to the contact skin surface, jetting force or suction force of air through the jetting or suction port, grazing to the skin surface, contact of electrodes, and electrostatic force Various tactile effects can be generated, such as effects by the endothermic and the reproduction of a sense of cold using the elements capable of endothermic heat generation.

The haptic module 153 may not only deliver a tactile effect through direct contact, but also may allow a user to feel the tactile effect through a muscle sense such as a finger or an arm. Two or more haptic modules 153 may be provided according to a configuration aspect of the mobile terminal 100.

The light output unit 154 outputs a signal for notifying occurrence of an event by using light of a light source of the mobile terminal 100. Examples of events occurring in the mobile terminal 100 may be message reception, call signal reception, missed call, alarm, schedule notification, email reception, information reception through an application, and the like.

The signal output from the light output unit 154 is implemented as the mobile terminal emits light of a single color or a plurality of colors to the front or the rear. The signal output may be terminated by the mobile terminal detecting the user's event confirmation.

The interface unit 160 serves as a path to all external devices connected to the mobile terminal 100. The interface unit 160 receives data from an external device, receives power, transfers the power to each component inside the mobile terminal 100, or transmits data inside the mobile terminal 100 to an external device. For example, a port connecting a device equipped with a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, and an identification module. The port, audio input / output (I / O) port, video input / output (I / O) port, earphone port, etc. may be included in the interface unit 160.

On the other hand, the identification module is a chip that stores a variety of information for authenticating the usage rights of the mobile terminal 100, a user identification module (UIM), subscriber identity module (SIM), universal user authentication And a universal subscriber identity module (USIM). A device equipped with an identification module (hereinafter referred to as an 'identification device') may be manufactured in the form of a smart card. Therefore, the identification device may be connected to the terminal 100 through the interface unit 160.

In addition, when the mobile terminal 100 is connected to an external cradle, the interface unit 160 may be a passage for supplying power from the cradle to the mobile terminal 100 or may be input from the cradle by a user. Various command signals may be a passage through which the mobile terminal 100 is transmitted. Various command signals or power input from the cradle may operate as signals for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The memory 170 may store a program for the operation of the controller 180 and may temporarily store input / output data (for example, a phone book, a message, a still image, a video, etc.). The memory 170 may store data regarding vibration and sound of various patterns output when a touch input on the touch screen is performed.

The memory 170 may include a flash memory type, a hard disk type, a solid state disk type, an SSD type, a silicon disk drive type, and a multimedia card micro type. ), Card-type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read It may include at least one type of storage medium of -only memory (PROM), programmable read-only memory (PROM), magnetic memory, magnetic disk and optical disk. The mobile terminal 100 may be operated in connection with a web storage that performs a storage function of the memory 170 on the Internet.

On the other hand, as described above, the controller 180 controls the operation related to the application program, and generally the overall operation of the mobile terminal 100. For example, if the state of the mobile terminal satisfies a set condition, the controller 180 may execute or release a lock state that restricts input of a user's control command to applications.

In addition, the controller 180 may perform control and processing related to voice call, data communication, video call, or the like, or may perform pattern recognition processing for recognizing handwriting input or drawing input performed on a touch screen as text and images, respectively. Can be. Furthermore, the controller 180 may control any one or a plurality of components described above in order to implement various embodiments described below on the mobile terminal 100 according to the present invention.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component. The power supply unit 190 includes a battery, and the battery may be a built-in battery configured to be rechargeable, and may be detachably coupled to the terminal body for charging.

In addition, the power supply unit 190 may be provided with a connection port, the connection port may be configured as an example of the interface 160 is electrically connected to the external charger for supplying power for charging the battery.

As another example, the power supply unit 190 may be configured to charge the battery in a wireless manner without using the connection port. In this case, the power supply unit 190 uses one or more of an inductive coupling based on a magnetic induction phenomenon or a magnetic resonance coupling based on an electromagnetic resonance phenomenon from an external wireless power transmitter. Power can be delivered.

Meanwhile, various embodiments of the present disclosure may be implemented in a recording medium readable by a computer or a similar device using, for example, software, hardware, or a combination thereof.

Hereinafter, embodiments related to a control method that can be implemented in the mobile terminal configured as described above will be described with reference to the accompanying drawings. It is apparent to those skilled in the art that the present invention can be embodied in other specific forms without departing from the spirit and essential features of the present invention.

3 is a flowchart illustrating an operation of a mobile terminal according to an embodiment of the present invention, and FIGS. 4 to 6 are flowcharts specifically showing corresponding parts of the flowchart of FIG. 3.

As shown in these drawings, the controller 180 of the mobile terminal 100 according to an embodiment of the present invention may manipulate and display an image based on an operation on a thumbnail of a captured image. Therefore, even if the orientation is changed during shooting, an effect of displaying an image in a direction desired by the user can be expected.

The controller 180 may perform an operation (S10) of capturing an image.

The photographing of the image may be performed through the camera 121 embedded in the mobile terminal 100. At least one camera 121 may be provided at a front side and / or a rear side of the mobile terminal 100. However, hereinafter, it will be described without distinguishing between the front side and the back side, except for the parts that are specifically described.

The step (S10) of capturing an image may include the step (S12) of initiating image capturing using the camera 121. For example, it means that the image of the front of the camera 121 can be captured by using the rear camera 121 of the mobile terminal 100.

The video may be a video. In other words, it means that video recording can be started. The image may be a still image. In other words, it means that the recording of one or more still images can be started.

The step S10 of capturing an image may include the step S14 of obtaining direction information of an image being captured by the sensing unit 140.

Orientation information may include information about the attitude of the mobile terminal 100 photographing an object. For example, the information may be information regarding whether the mobile terminal 100 is held vertically or horizontally.

The direction information may be sensed through the sensing unit 140 embedded in the mobile terminal 100. For example, it may be obtained based on information obtained through at least one of an acceleration sensor, a magnetic sensor, a gravity sensor, a gyroscope sensor, and / or a motion sensor.

The direction information may be detected based on the image photographed by the camera 121. For example, the direction of the mobile terminal 100 may be calculated based on the direction of the head, torso, etc. of the person photographed in the captured image.

The step S10 of capturing an image may include storing the obtained direction information together with the captured image (S16).

The controller 180 can store the obtained direction information together with the image. For example, the directional information may be combined with the image data and stored as one file. Alternatively, although the image data and the direction information are different files, the direction information may be synchronized when the image data is reproduced.

The controller 180 can perform a step (S30) of displaying the captured image together with the thumbnail.

The controller 180 may display an image photographed according to a user's selection and / or a control signal of the controller 180. For example, this means that the captured video can be played back.

The controller 180 may display a thumbnail for at least a predetermined time when playing back the captured image. For example, it means that a thumbnail of a corresponding video can be displayed together for a predetermined time from when the video is selected or when the video is played.

The displaying of the captured image together with the thumbnail (S30) includes starting the reproduction of the captured image (S32) and displaying at least one thumbnail based on the direction information at the time of capturing (S34). can do.

The controller 180 may display thumbnails according to the direction information of the photographing point. Therefore, when the orientation information is different, the display form of the thumbnail may be different. For example, a vertically long thumbnail indicates that image recording is performed while the mobile terminal 100 is in a vertical direction, and a horizontally long thumbnail is an image of the image when the mobile terminal 100 is in a horizontal direction. This may reflect the fact that the shooting is in progress.

Since the display of the thumbnail is changed according to the direction information of the shooting time, the user can expect the effect of intuitively recognizing the shooting state of the image. For example, it means that it is possible to intuitively recognize that the shooting direction of the image will be different at that point even if the image is not played up to the point. This is an effect unprecedented in the conventional display of thumbnails of the same type.

The controller 180 may perform an operation S50 of changing a display of an image based on an operation on a thumbnail.

The controller 180 can display thumbnails for at least a predetermined time with the image. The thumbnail may reflect the orientation information at the time of photographing. The user may change the display of an image corresponding to the thumbnail through an operation on the thumbnail.

In operation S50 of changing the display of the image based on an operation on the thumbnail, acquiring an operation signal of the user for at least one of the displayed thumbnails (S52) and changing the display of the thumbnail based on the obtained operation signal. It may include the step (S54).

The user can perform an operation on the displayed thumbnail. For example, this means that an operation such as touching a thumbnail may be performed.

The controller 180 may change the display of the thumbnail in response to the touch operation of the user. For example, this means that the thumbnails of the horizontally laid out form can be changed vertically, or the thumbnails of the vertically laid out form can be changed horizontally.

The step S50 of changing the display of the image based on an operation on the thumbnail may include changing the display of the image corresponding to the changed thumbnail (S56).

The controller 180 may change an image display of a part corresponding to a thumbnail whose shape is changed by a user's touch operation. For example, it means that the image can be rotated clockwise or counterclockwise to correspond to the direction of the thumbnail.

The image may be photographed in the horizontal direction or the vertical direction. That is, the mobile terminal 100 can be photographed horizontally or vertically.

The direction of the image may be changed during shooting. For example, it means that the mobile terminal 100 can be rotated in the vertical direction while photographing in the horizontal direction. When the direction is changed during shooting, the direction of the image may be changed at the time of reproduction of the image. For example, in the case of playing a video changed in the vertical direction while playing in the horizontal direction on the horizontal view screen, the upper side of the image is initially the upper side of the horizontal screen, but from the time when the image is taken in the vertical direction, the upper side of the image is the left side of the horizontal screen Can be. This means that the image can be lying on its side. Therefore, the user must rotate the mobile terminal that is being viewed so that the user can view normal video.

If the mobile terminal 100 is rotated horizontally or vertically several times during shooting, the user may need to rotate the mobile terminal 100 several times horizontally or vertically while viewing the image. However, the controller 180 of the mobile terminal 100 according to an embodiment of the present invention can provide an environment in which a user can view the image more conveniently by changing the display of the image in response to an operation on the thumbnail. .

As shown in these figures, the mobile terminal 100 according to an embodiment of the present invention may include a sensing unit 140 that can detect the current direction of orientation of the mobile terminal 100.

As shown in FIGS. 7A and 7B, the mobile terminal 100 may be in a vertical or horizontal orientation.

The sensing unit 140 may detect a direction of the mobile terminal 100 in real time. For example, when the mobile terminal 100 is erected vertically as shown in FIG. 7A and when the mobile terminal 100 is laid horizontally as shown in FIG. By generating another signal, it means that the controller 180 can recognize the current state of the mobile terminal 100.

As shown in FIG. 8, the orientation direction of the mobile terminal 100 may change from time to time. For example, it was a horizontal direction up to the time point t1, but changed to a time point t1 to become a vertical direction up to the time point t2, and a horizontal direction again from the time point t2 to the time point t3.

The change of the orientation direction of the mobile terminal 100 may also be performed while capturing an image using the mobile terminal 100. If the direction of orientation of the mobile terminal 100 is changed while capturing the image, the captured image may also be affected by the up, down, left, and right sides.

As shown in these figures, the imaging of the image using the mobile terminal 100 according to an embodiment of the present invention can proceed.

As illustrated in FIG. 9, imaging of the object OB may be performed. For example, it means that the photographing may be performed in the portrait mode V or the landscape mode H of the mobile terminal 100. The change from the portrait mode V to the landscape mode H or vice versa may be made during imaging of the object OB.

In the portrait mode V, an upper portion of the object OB to be photographed may be positioned above the longitudinal direction of the display 151. In the landscape mode V, the upper side of the object BO to be photographed may be positioned above the width direction of the display 151. That is, even if the same object (OB) is photographed in accordance with the change in the direction of orientation of the mobile terminal 100 may be photographed in a vertically long form or horizontally long form. If the image is changed to a long form or a long form while shooting, the screen may return to the left or right side when the image is played back. The mobile terminal 100 according to the exemplary embodiment of the present invention may easily change the direction change of the image due to the rotation of the mobile terminal 100 when photographing.

As shown in FIG. 10, video data photographed using the camera 121 and direction information may be stored in synchronization with each other. For example, it means that the fact that the orientation direction of the mobile terminal 100 photographing has been changed at the time points t1, t2, t3, and t4 can be stored. In other words, the video data and / or direction is changed to the vertical mode (V) at t1, the horizontal mode (H) at t2, the vertical mode (V) at t3, and the horizontal mode (H) at t4. It may be stored in the direction information.

11 to 17 illustrate a thumbnail display method using the mobile terminal of FIG. 3.

As shown in these drawings, the controller 180 of the mobile terminal 100 according to an embodiment of the present invention may display the captured image with the thumbnail T for at least a predetermined time.

As shown in FIG. 11A, a thumbnail T corresponding to an image may be displayed. Some of the thumbnails T may be different from the other thumbnails T due to the change in the direction of orientation during shooting. For example, the first, second, fourth, and fifth thumbnails T1, T2, T4, and T5 may include a vertical image, and the third, fifth, and six thumbnails T3, T5, and T6 may include a horizontal image. have.

As shown in FIG. 11B, an image related to the third thumbnail T3 may be displayed during the reproduction of the image. When capturing an image corresponding to the third thumbnail T3, a photographing direction may be different from capturing an image corresponding to the first and second thumbnails T1 and T2. Accordingly, when the image corresponding to the third thumbnail T3 is played, the direction of the image may be changed, unlike the reproduction of the image corresponding to the first thumbnail T1. For example, the image may be displayed in the left and right directions instead of the vertical directions.

As shown in FIG. 12A, the user may perform an operation on a specific thumbnail T with a finger F or the like. For example, it means that the operation of touching the third thumbnail T3 may be performed. The touch operation may be a drag touch operation in a direction in which the third thumbnail T3 is erected vertically.

As shown in (b) of FIG. 12, when the thumbnail T is manipulated, an image corresponding to the thumbnail T may be changed. For example, it means that the image in the horizontal direction can be converted to the vertical direction. Therefore, the user can enjoy the image more conveniently regardless of the direction of orientation when shooting.

As illustrated in FIG. 13, the display unit 151 may be provided with an image display area DA, an operation area CA, and a thumbnail area TA.

In the image display area DA, an image photographed in response to a user's manipulation of the manipulation area CA may be displayed. For example, when a touch on the manipulation area CA is input, the image is played, and when it is touched again, the playback may be stopped.

In the thumbnail area TA, a thumbnail T associated with an image displayed on the image display area DA may be displayed. For example, a thumbnail T is extracted from an image extracted at regular intervals from the entire image, an image extracted from a portion where a major event occurs, and / or an image extracted from a portion in which a direction of the mobile terminal 100 is changed during shooting. It can be displayed as.

In the thumbnail area TA, a playback indicator PI may be displayed. The playback indicator PI may indicate the position of the portion of the entire video that is currently displayed on the video display area DA.

The thumbnail T may be displayed in different forms according to the orientation of the mobile terminal 100 at the time of capturing the image. The shape of the thumbnail T may vary depending on whether the mobile terminal 100 is photographed in the landscape mode or the portrait mode. For example, the first, second, fourth, and seventh thumbnails T1, T2, T4, and T7 have horizontally long thumbnails T, and the third, fifth, sixth, and third thumbnails T3, T5, and T6. As shown in FIG. 1, the thumbnail T may be divided into long thumbnails T.

Due to the change in the shape of the thumbnail T, the user can intuitively recognize which event occurred at what time even the thumbnail T report only. For example, looking at the current thumbnail (T) it can be seen that the first time was taken in landscape mode, and then changed to portrait mode once again to shoot in landscape mode, and then went back to portrait mode.

As shown in FIG. 14A, when playback of an image starts, a stored video may be displayed in the image display area DA. When the video is played, the play indicator (PI) gradually moves to inform the current position of the entire video.

Based on the position of the playback indicator PI, it can be seen that an image related to the second thumbnail T2 is currently being played back in the image display area DA. In addition, the user may intuitively recognize that the current display image is an image captured in the landscape mode by the shape of the second thumbnail T2 having a horizontal shape.

Since the image captured in the landscape mode is reproduced in the landscape mode, the image displayed on the image display area DA may be displayed upward even in a direction that the user views. That is, the image may be displayed in a state in which the user holding the mobile terminal 100 horizontally is convenient for viewing.

As illustrated in (b) of FIG. 14, playback of a moving image is performed so that an image related to the third thumbnail T3 may be displayed on the image display area DA. By displaying the third thumbnail T3 having a vertical shape, the user may intuitively recognize that the image related to the third thumbnail T3 is an image captured in the portrait mode.

Since the image photographed in the portrait mode is reproduced in the landscape mode, the image displayed on the image display area DA may be displayed in the form of lying horizontally on the image. That is, it means that a user holding the mobile terminal 100 horizontally may display an image in a somewhat uncomfortable state for viewing. Such a phenomenon may occur when a direction in capturing an image and a direction in reproduction are different. The controller 180 of the mobile terminal 100 according to an exemplary embodiment of the present invention displays the thumbnails T displayed in different forms so that the user can intuitively recognize the direction of image capture. Therefore, based on the shape of the displayed thumbnail T and / or the position of the playback indicator PI, the user may rotate the mobile terminal 100 horizontally or vertically at an appropriate time to allow the image to be played back in an optimal direction. .

As illustrated in FIGS. 16 and 17, the controller 180 may select the thumbnail T to be displayed based on a preset criterion.

As illustrated in FIG. 16, the controller 180 may extract the thumbnail T from the video data.

The controller 180 may determine the direction of the extracted thumbnail T based on the orientation information when the mobile terminal 100 is photographed. For example, it means that the thumbnail T in the horizontal or vertical direction can be generated depending on whether the image is horizontal or vertical at the time of photographing.

The controller 180 can extract the thumbnail T at regular time intervals. For example, it means that the thumbnail T can be extracted at regular intervals regardless of the direction of orientation at the time of photographing. By extracting irrespective of the directing direction, the thumbnail T in the horizontal or vertical direction may be extracted in duplicate.

As illustrated in FIG. 17, the controller 180 may extract the thumbnail T in relation to the directing direction. For example, it means that a thumbnail of a view point changed in a specific direction can be extracted. In such a case, the time intervals between the thumbnails T may be different from each other. For example, a time interval between the first thumbnail T1 and the second thumbnail T2 and a time interval between the second thumbnail T2 and the third thumbnail T3 may be different from each other. Although the time intervals are different from each other, the thumbnail T in the horizontal direction or the vertical direction allows the user to intuitively recognize that the orientation direction has been changed at a specific point in time.

As shown in FIG. 18, the horizontal thumbnail TH and the vertical thumbnail TV may be visually distinguished.

The first horizontal length W1 and the first vertical length H1 of the horizontal thumbnail TH may be different from the second horizontal length W2 and the second vertical length H2 of the vertical thumbnail TV. . That is, the first horizontal length W1 may be longer than the second horizontal length W2, and the first vertical length H1 may be longer than the second vertical length H2.

Due to the difference in the horizontal and vertical lengths of the horizontal thumbnail (TH) and the vertical thumbnail (TV), when the horizontal thumbnail (TH) and the vertical thumbnail (TV) are arranged, the user can easily recognize the difference visually. Can be. Therefore, it can be intuitively recognized at what time point the image was taken in the horizontal or vertical direction.

As shown in FIG. 19, the controller 180 may reflect the state at the time of photographing in various forms.

As shown in FIG. 19A, the controller 180 may make the third vertical length H3 of the thumbnail the same. The controller 180 may vary the width W3 of the thumbnail. For example, the third horizontal length W3 of the first, fourth, and fifth thumbnails T1, T4, and T5 that are the horizontal thumbnails TH, and the second, third, and sixth thumbnails that are the vertical thumbnails TV, This means that the fourth horizontal length W4 of the T2, T3, and T6 may be different. In other words, the thumbnails have the same height but have different horizontal lengths. Even in such a form, the user can intuitively recognize that the photographing direction has been changed at a specific point in time.

As illustrated in FIG. 19B, the controller 180 may add an icon reflecting a specific state of the mobile terminal 100. For example, the first icon HI indicating that the thumbnail is horizontal and the second icon VI indicating vertical direction may be added. The thumbnail itself may have the same fourth vertical length H4 and the fourth horizontal length W4. Due to the first and second icons HI and VI, the user can easily recognize the photographing direction even if the shape of the thumbnail is the same.

20 to 24 are diagrams illustrating a thumbnail manipulation method.

As shown in these drawings, the controller 180 of the mobile terminal 100 according to an embodiment of the present invention may edit an image corresponding to the thumbnail T through an operation on the thumbnail T.

As shown in FIG. 20A, a thumbnail T for a specific image may be displayed. The thumbnail T may be arranged in the horizontal direction or the vertical direction according to the direction at the time of photographing.

The user may perform a touch operation on a specific thumbnail T by using the finger F or the like. For example, the user may perform a touch operation on the third thumbnail T3 in the vertical direction.

The touch operation on the thumbnail T may be a drag touch operation such as lying down or standing the corresponding thumbnail T. For example, it may be a drag touch operation in a direction of lying down the third thumbnail T3 in the vertical direction.

As shown in FIG. 20B, the controller 180 may change the thumbnail T on which the user performs the drag touch operation so as to correspond thereto. For example, the third thumbnail T3 may be switched from the vertical direction to the horizontal direction so as to correspond to the touch operation in the lying down direction.

The controller 180 may change an image corresponding to the shape of the thumbnail T when the shape of the thumbnail T is changed. For example, it means that the image taken in the vertical direction can be changed in the horizontal direction or vice versa.

As shown in FIG. 21A, the captured image may be reproduced in the image display area DA. As can be seen from the position of the playback indicator PI, an image of a region related to the second thumbnail T2 may be currently being played. The third thumbnail T3 may be in a state switched from the vertical to the horizontal direction by the above-described operation.

As illustrated in (b) of FIG. 21, the controller 180 may change and display the direction of the image corresponding to the thumbnail T whose direction is changed. That is, it means that the direction of the image displayed in the image display area DA can be switched so as to correspond to the third thumbnail T3 switched from the vertical direction to the horizontal direction. This may be more clearly understood in contrast with FIG. 12B, which shows an image before the direction of the third thumbnail T3 is changed. That is, before the direction of the third thumbnail T3 is changed, the image in which the upper direction is toward the left side of the display unit 151 is displayed. After the direction of the third thumbnail T3 is changed, the upper direction is displayed in the display unit 151. Means that it can be switched to face upwards.

By changing the reproduction direction of the image corresponding to the thumbnail T by manipulating the thumbnail T, the user can conveniently enjoy the image. Such a point may be a function that can increase the convenience of use in consideration of the fact that viewing in the normal direction is required only when the mobile terminal 100 that is being played is switched horizontally or vertically when the direction of the image is not changed. . In addition, when watching a video using a fixed terminal such as a TV may be a method that can be edited and viewed more conveniently.

22 to 24, the controller 180 of the mobile terminal 100 according to an embodiment of the present invention may reflect a user's input to a thumbnail in various ways.

As shown in FIG. 22A, the user may touch a specific thumbnail T by using the finger F or the like. For example, the user may perform a touch operation as if raising the fourth thumbnail T4 in the horizontal direction.

As illustrated in FIG. 22B, the controller 180 may change the fourth thumbnail T4 to which the touch operation is input from the user. In other words, it can be changed from horizontal to vertical. The controller 180 may change the shape of the fourth thumbnail T4 and may also change the playback direction of the image corresponding to the fourth thumbnail T4.

As shown in FIG. 23A, the user may perform an operation of touching a specific thumbnail T with a finger F or the like. For example, the touch operation may be performed as if the fourth thumbnail T4 is raised.

As shown in FIG. 23B, when a touch operation with respect to one of the thumbnails T is input, the controller 180 may perform the same operation with respect to the other thumbnails T. For example, the first, second, and seventh thumbnails T1, T2, and T7 in the horizontal direction may also be changed in the vertical direction to correspond to the touch operation on the fourth thumbnail T4.

As shown in FIG. 24A, thumbnails T in a horizontal direction and a vertical direction may be disposed. That is, it can be seen that the mobile terminal 100 has been switched vertically and horizontally at the time of photographing.

As shown in (b) of FIG. 24, the user may switch the mobile terminal 100 in the horizontal direction during image playback. When the mobile terminal 100 is switched in the horizontal direction, the controller 180 can switch the thumbnail T to correspond thereto. For example, it means that the entire thumbnail (T) can be switched in the horizontal direction.

As shown in FIG. 24C, the user may switch the mobile terminal 100 in the vertical direction during image playback. When the mobile terminal 100 is switched in the vertical direction, the controller 180 may switch the thumbnail T in the vertical direction to correspond thereto.

As shown in these figures, the controller 180 of the mobile terminal 100 according to an embodiment of the present invention may edit the related video in response to an operation on the thumbnail T.

As shown in FIG. 25A, the second and fourth thumbnails T2 and T4 may be in a horizontal direction, and the third thumbnail T3 may be in a vertical direction. When the image corresponding to the third thumbnail T3 is reproduced, when the mobile terminal 100 is in the horizontal direction, the image may be reproduced in a horizontally laid down state. That is, since the image is photographed in the vertical direction when the image is captured, it may be displayed lying on the display 151 according to the horizontal length RV1 and the vertical length RW1 when the image is taken.

As shown in FIG. 25B, the third thumbnail T3 may be converted to the horizontal direction by an operation on the thumbnail T. As shown in FIG. The controller 180 may change the direction of the image in response to an operation on the third thumbnail T3. However, due to the horizontal length RV1 at the time of capturing the stored image and the vertical length RW1 at the time of capturing the stored image, the converted video may be the editing vertical length RV2 and the editing width RW2. The controller 180 may edit the area smaller than the horizontal length of the display unit 151 as the dark processing area VA.

As shown in FIGS. 26A and 26B, when the third thumbnail T3 in the vertical direction is changed in the horizontal direction, the first and third playbacks are performed as shown in FIG. 26C. The second playback image DA2 having the dark processing area VA may be inserted between the images DA1 and DA3.

As shown in FIG. 27A, an image whose direction is changed may be edited to correspond to the image display area DA. For example, an operation of enlarging the entire original image OI to correspond to the image display area DA may be performed.

As shown in FIG. 27B, an enlarged second reproduced image DA2 may be inserted between the first and third reproduced images DA1 and DA3. When the image is enlarged, the dark processing region may not exist.

As shown in (a) of FIG. 28, the thumbnail T may be present in an oblique form while being switched from the horizontal direction to the vertical direction. For example, like the third thumbnail T3, it means that the image of the photographed portion may exist in an inclined form while being switched from the horizontal direction to the vertical direction.

As shown in FIG. 28B, an oblique image corresponding to the third thumbnail T3 may be displayed in the image display area DA.

As shown in FIG. 29A, the user and / or the controller 180 may change the direction of the third thumbnail T3.

As illustrated in (b) of FIG. 29, the image CA corresponding to the third thumbnail may be edited to correspond to the image display area DA. The editing may be performed along the virtual center line CL such that the object included in the image CA is vertical. That is, the editing of the image may be performed so that the final image may be easily viewed by the user. When the image CA is also vertical, the dark treatment area VA may be present in a portion of the image display area DA according to the angle of the image originally photographed.

As illustrated in FIG. 29C, an image edited to correspond to the change of the direction of the third thumbnail T3 may be displayed in the image display area DA.

As shown in these figures, the controller 180 of the mobile terminal 100 according to an embodiment of the present invention can control the direction of the image displayed on the fixed terminal 200.

As shown in FIG. 30, the mobile terminal 100 and the fixed terminal 200 may be in a state where communication is possible. For example, it means that the content of the mobile terminal 100 may be in a state of being transmitted to the TV which is the fixed terminal 200.

As shown in FIG. 31, while the content of the mobile terminal 100 is transmitted to the fixed terminal 200 and displayed on the display unit 215 of the fixed terminal 200, the direction of the content image is not appropriate for viewing. There may be a situation. For example, when the image is switched from the horizontal direction to the vertical direction or from the vertical direction to the horizontal direction during the capturing of the image, a phenomenon in which the direction of the image displayed on the display unit 215 may lie on the side. When such a situation occurs, the user may change the direction of the mobile terminal 100. For example, if the current state is horizontal, it means that the direction of the mobile terminal 100 can be changed in the vertical direction.

As illustrated in FIG. 32, when the direction of the mobile terminal 100 is changed, the controller 180 may switch the display direction of the image and transmit the image to the fixed terminal 200. Therefore, regardless of the direction of the captured image, the user can expect the effect that can conveniently enjoy the screen.

The present invention described above can be embodied as computer readable codes on a medium in which a program is recorded. The computer-readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of computer-readable media include hard disk drives (HDDs), solid state disks (SSDs), silicon disk drives (SDDs), ROMs, RAMs, CD-ROMs, magnetic tapes, floppy disks, optical data storage devices, and the like. This also includes implementations in the form of carrier waves (eg, transmission over the Internet). In addition, the computer may include the controller 180 of the terminal. Accordingly, the above detailed description should not be construed as limiting in all aspects and should be considered as illustrative. The scope of the invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the invention are included in the scope of the invention.

Claims

camera;

Sensing unit; And

Display the image taken by the camera with at least one thumbnail (thumbnail) corresponding to at least a portion of the captured image,

The at least one thumbnail,

And a controller arranged according to an orientation of the photographing obtained through the sensing unit and changing a display of an image corresponding to the at least one thumbnail based on an operation on the arranged at least one thumbnail. Mobile terminal.
According to claim 1,

The directing direction of the shooting,

A first directing direction photographed by holding the mobile terminal in a horizontal direction and a second directing direction photographed by holding the mobile terminal in a vertical direction;

The control unit,

Among the at least one thumbnail, at least one of a shape and a color of a first thumbnail corresponding to the image photographed in the first direction and a second thumbnail corresponding to the image photographed in the second direction are differently displayed. Mobile terminal.
The method of claim 2,

The control unit,

And displaying the first thumbnail in a horizontal length and a short vertical length in comparison with the second thumbnail.
According to claim 1,

The control unit,

When a user's touch input for the at least one thumbnail is acquired,

And a display form of the at least one thumbnail based on the obtained direction of the touch input.
The method of claim 4, wherein

The at least one thumbnail,

A first thumbnail having a long horizontal shape corresponding to the first directing direction photographed by holding the mobile terminal in a horizontal direction, and having a vertical length corresponding to a second directing direction photographed by holding the mobile terminal vertically Contains a second thumbnail for,

The control unit,

And a mobile terminal for changing from one of the first and second thumbnails to the other in response to the touch input.
The method of claim 4, wherein

The video,

A first image photographed in the first direction and a second image photographed in the second direction;

The control unit,

And changing the display of the at least one thumbnail substantially from at least one of the at least one first and second images to the other.
The method of claim 6,

The control unit,

When changing from at least one of the first and second images to the other one,

The mobile terminal blacken the blank area according to the difference between the vertical length of the first image and the horizontal length of the second image.
The method of claim 4, wherein

The control unit,

And changing the display form of the entire thumbnail in the same manner based on the acquired touch direction.
According to claim 1,

Further comprising a wireless communication unit,

The control unit,

And a display direction of the image in another terminal sharing the image through the wireless communication unit in response to the direction of the mobile terminal.
According to claim 1,

The control unit,

And changing the shape of the at least one thumbnail in correspondence with the direction of orientation of the mobile terminal at the time of displaying the image.
Sensing an orientation of the photographing and capturing an image;

Displaying at least one thumbnail corresponding to at least a portion of the photographed image together with the photographed image in the directing direction; And

And changing a display of the image corresponding to the at least one thumbnail based on an operation on the at least one thumbnail.
The method of claim 11, wherein

The step of changing the display,

Among the at least one thumbnail, a first thumbnail corresponding to an image of a first direction in which the mobile terminal is gripped in a horizontal direction and a second direction in which the mobile terminal is gripped in a vertical direction and taken in the image correspond to a first thumbnail. The control method of the mobile terminal for differently displaying at least one of the shape, color of the second thumbnail.
The method of claim 11, wherein

Acquiring a user's touch input for the at least one thumbnail;

The step of changing the display,

And controlling the display form of the at least one thumbnail based on the acquired direction of the touch input.
The method of claim 13,

The step of changing the display,

Substantially together with a change in the display form of the at least one thumbnail,

And changing the image from at least one of the first image photographed in the first direction and the second image photographed in the second direction to the other.
The method of claim 11, wherein

And changing the display direction of the image in another terminal sharing the image, corresponding to the direction of the mobile terminal.