KR20140081087A - Mobile terminal and controlling method thereof - Google Patents

Abstract

A mobile terminal including a display unit that displays a dynamic image as a first screen; and a control unit that controls so that a first partial image including a selected desired object is enlarged when the desired object is selected in the dynamic image for the enlarged first partial image to be displayed with the first screen as a second screen, the pre-enlargement first partial image in the first screen is displayed with the enlarged first partial image in the second screen, a second partial image including the moved desired object is enlarged when the desired object is moved in the first screen after the selection of the desired object for the enlarged second partial image to be displayed as the second screen, and the pre-enlargement second partial image in the first screen is displayed with the enlarged second partial image in the second screen, can provide an interface which enlarges the object included in the dynamic image in real time.

Description

[0001] MOBILE TERMINAL AND CONTROLLING METHOD THEREOF [0002]

The present invention relates to a mobile terminal for displaying a part of a dynamic image displayed on a mobile terminal together with an original image and a control method thereof.

The terminal can move And can be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

In order to support and enhance the functionality of such terminals, it may be considered to improve the structural and / or software parts of the terminal.

In such a mobile terminal, a technique of displaying a dynamic image such as a moving image or a moving image outputted from a camera preview screen on the display unit is applied. Conventionally, when only a specific portion of a dynamic image displayed on a mobile terminal is enlarged, a position of an area selected for enlargement is fixed. As a result, when an object in the dynamic image moves out of the area by moving, details to be viewed are not maintained in an enlarged state.

In addition, when enlarging only a specific portion of the dynamic image, the balance of the screen displayed by the enlarged portion is broken, and the before-enlargement of the specific portion is disappeared.

SUMMARY OF THE INVENTION The present invention has been proposed in order to meet the above-mentioned need, and it is an object of the present invention to provide an image display apparatus which continuously displays an enlarged image of an enlargement target even when a specific portion of a dynamic image to be displayed is enlarged, And an object of the present invention is to provide a mobile terminal and its control method capable of displaying the enlarged state together.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, unless further departing from the spirit and scope of the invention as defined by the appended claims. It will be possible.

According to an aspect of the present invention, there is provided a display apparatus including: a display unit for displaying a dynamic image on a first screen; And enlarging a first partial image including the selected desired object when the desired object is selected in the dynamic image, and displaying the enlarged first partial image together with the first screen as a second screen, A first partial image before enlargement in the first screen is displayed together with an enlarged first partial image in the second screen; and a control unit for controlling, when the desired object moves within the first screen after the selection of the desired object, The second partial image including the desired object is enlarged to display the enlarged second partial image as the second screen, and the second partial image before the enlargement in the first screen is enlarged, And a control unit for controlling the display unit to display the image together with the image.

According to another aspect of the present invention, there is provided a method of displaying a dynamic image, the method comprising: displaying a dynamic image as a first screen; Enlarging a first partial image including the selected desired object when the desired object is selected in the dynamic image; Displaying the enlarged first partial image as a second screen, displaying a first partial image before enlargement in the first screen together with an enlarged first partial image in the second screen; Enlarging a second partial image including the moved desired object when the desired object moves within the first screen after the selection of the desired object; And displaying the enlarged second partial image as a second screen and displaying a second partial image before enlargement in the first screen together with an enlarged second partial image in the second screen, Control method.

Effects of the mobile terminal and the control method according to the present invention will be described as follows.

According to at least one of the embodiments of the present invention, the user can continuously magnify a specific object included in the dynamic image displayed on the mobile terminal. At the same time, the magnified view of the specific object is displayed simultaneously with the magnified view, so that the user can conveniently compare the magnified view of the specific object with the magnified view. In addition, since the first screen, which is a dynamic image before the specific object is enlarged, is maintained as it is, the user can observe other objects or backgrounds around the specific object while enlarging and observing the specific object in detail, Convenience is enhanced.

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2 is a front perspective view of a mobile terminal according to an embodiment of the present invention.
3 is a rear perspective view of a mobile terminal according to an embodiment of the present invention.
4 is a control flowchart of a mobile terminal according to an embodiment of the present invention.
5 is an exemplary view illustrating an example of a display method of a mobile terminal according to an embodiment of the present invention.
6 is a diagram illustrating an example of a case where another desired area is selected in the mobile terminal according to another embodiment of the present invention.
FIG. 7 is a diagram illustrating an example of a case where a size of a desired area is changed in a mobile terminal according to another embodiment of the present invention.
FIG. 8 and FIG. 9 are views illustrating various examples in which a magnification ratio of a desired object is changed in a mobile terminal according to another embodiment of the present invention.
10 is an exemplary view illustrating an example of a display method of a mobile terminal when the first screen is a camera preview screen according to another embodiment of the present invention.
FIG. 11 and FIG. 12 illustrate various examples of a case where a face of a person is extracted and enlarged from a camera preview screen by performing a speech recognition function together with the mobile terminal according to the embodiment of FIG.
FIG. 13 is a diagram illustrating examples of images stored when moving images or still images are stored in a mobile terminal according to the embodiment of FIG.
14 is an exemplary view showing an example in which an enlarged partial image is displayed as a first screen according to still another embodiment of the present invention.
Figs. 15 and 16 are diagrams showing examples of various examples in which a dynamic image before enlargement is displayed as a second screen in the mobile terminal according to the embodiment of Fig. 14; Fig.

Hereinafter, a mobile terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), and navigation.

However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention. The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information means information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only (Mobile Broadcasting Business Management System), ISDB-T (Integrated Services Digital Broadcasting (ISDB-T)), Digital Multimedia Broadcasting (MBMS) Digital Broadcast-Terrestrial) or the like. Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 may be coupled to a base station, an external terminal, or a server on a mobile communication network, such as, but not limited to, Gobal System for Mobile communications (GSM), Code Division Multiple Access (CDMA), Wideband CDMA Transmits and receives wireless signals with one. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. Wireless Internet technologies include WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), GSM, CDMA, WCDMA, LTE Evolution (but not limited to) may be used.

The wireless Internet module 113, which performs wireless Internet access through the mobile communication network, is connected to the mobile communication module 110 through the mobile communication network, for example, from the viewpoint that the wireless Internet access by Wibro, HSDPA, GSM, CDMA, WCDMA, LTE, (112). ≪ / RTI >

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for obtaining the position of the mobile terminal, and a representative example thereof is a Global Position System (GPS) module. According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information to obtain a three-dimensional string of latitude, longitude, The location information can be accurately calculated. At present, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another satellite is widely used. In addition, the GPS module 115 can calculate speed information by continuously calculating the current position in real time.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a button 136 located on the front, rear, or side of the mobile terminal 100, and a touch sensor (static / static) 137. Although not shown, ), A dome switch, a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141. (The proximity sensor will be described later).

The output unit 150 is for generating output related to the visual, auditory or tactile sense and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154 .

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, and a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another, or may be disposed integrally with one another, and may be disposed on different surfaces, respectively.

In the case where the display unit 151 and the touch sensor 137 have a mutual layer structure or are integrally formed (hereinafter referred to as a 'touch screen'), the display unit 151 may be used as an input device . The touch sensor 137 may be stacked on the display unit 151 to form a layer structure when the touch sensor 137 has a form of a touch film, a touch sheet, a touch pad, or the like. And may be integrally formed.

The touch sensor 137 may be configured to convert a change in a pressure applied to a specific part of the display part 151 or a capacitance generated in a specific part of the display part 151 into an electrical input signal. The touch sensor 137 can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor 137, the corresponding signal (s) is sent to the touch controller (not shown). The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

The proximity sensor 141 may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is enclosed by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch" The act of actually contacting the pointer on the touch screen may be referred to as "contact touch. &Quot; The location where the pointer is proximately touched on the touch screen may refer to a position where the pointer corresponds vertically to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. In this case, the display unit 151 and the audio output module 152 may be a type of the alarm unit 153. The display unit 151 and the audio output module 152 may be connected to the display unit 151 or the audio output module 152, .

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. At least two haptic modules 154 may be provided according to the configuration of the mobile terminal 100.

A program for processing and controlling the controller 180 may be stored in the memory 160 and temporary storage of data input / output (e.g., telephone directory, message, audio, still image, For example. The memory 160 may store the frequency of use of each of the data (for example, each telephone number, each message, and frequency of use for each multimedia). In addition, the memory 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user to the cradle may be transmitted It can be a passage to be transmitted to the terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components. The power supply unit 190 may include, for example, a battery, a connection port, a power supply control unit, and a charge monitoring unit.

The battery may be an internal battery configured to be chargeable, and may be detachably coupled to the terminal body for charging or the like. The connection port may be configured as an example of an interface 170 through which an external charger for supplying power for charging the battery is electrically connected.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The embodiments described may be implemented by the control unit 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

FIG. 2 is a perspective view of a mobile terminal or a portable terminal according to the present invention, as viewed from the front.

The disclosed mobile terminal 100 includes a bar-shaped terminal body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

The body of the mobile terminal 100 includes a casing 101, 102, In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102.

A component such as a USIM card and a memory card, such as an auxiliary storage medium 165, which may be detached, may include an opening in the case so as to be inserted into the case from the outside. Slots may be formed on the side of the case so that the auxiliary storage medium 165 may be inserted from the side of the mobile terminal 100 and card slots 166 and 167 may be formed on the surface of the rear case 102 It is possible.

The cases 101, 102, and 103 may be formed by injection molding synthetic resin or may be formed of a metal material such as stainless steel (STS) or titanium (Ti).

The display unit 151, the sound output unit 152, the camera 121, the user input units 130/131 and 132, the microphone 122, and the interface 170 may be disposed in the terminal cases 101 and 102.

The display unit 151 occupies most of the main surface of the front case 101. A sound output unit 152 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132 and the interface 170 may be disposed on the side surfaces of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100 and may include a plurality of operation units 131, 132, and 133. The operation units 131, 132, and 133 may be collectively referred to as a manipulating portion.

The contents inputted by the first or second operation unit 131 or 132 may be variously set. For example, the first operation unit 131 receives a command such as start, end, scroll, and the like, and the second operation unit 132 inputs a command such as adjustment of the sound output from the sound output unit 152 And the third operation unit 133 can receive commands such as activation / deactivation of the touch recognition mode of the display unit 151 and the like.

The operation units 131, 132 and 133 may have a button system recognized when a user applies pressure and a touch sensor 137 may be provided to the operation units 131, 132 and 133 in addition to the display unit 151 So that the user's command can be received only by the user's touch.

3 is a rear perspective view of the mobile terminal shown in FIG.

Referring to FIG. 3, a camera 121 'may be further mounted on the rear surface of the terminal body, that is, the rear case 102. The camera 121 'may have a photographing direction substantially opposite to the camera 121 (see FIG. 2), and may be a camera having the same or different pixels as the camera 121.

For example, the camera 121 may have a low pixel so that the face of the user can be photographed and transmitted to the other party in case of a video call or the like, and the camera 121 ' It is preferable to have a large number of pixels. The cameras 121 and 121 'may be installed in the terminal body such that they can be rotated or pop-up.

A flash 123 and a mirror 124 may be additionally disposed adjacent to the camera 121 '. The flash 123 illuminates the subject when the subject is photographed by the camera 121 '. The mirror 124 allows the user to illuminate the user's own face or the like when the user intends to shoot himself / herself (self-photographing) using the camera 121 '.

An acoustic output 152 'may be additionally disposed on the rear surface of the terminal body. The sound output 152 'on the rear side of the body may implement the stereo function together with the sound output 152 (see FIG. 2) of the front side of the body, and may be used for the implementation of the speakerphone mode during a call.

In addition to the antenna for talking and the like, a broadcast signal reception antenna 116 may be additionally disposed on the side of the terminal body. The antenna 116, which forms part of the broadcast receiving module 111 (see FIG. 1), can be installed to be able to be drawn out from the terminal body.

Hereinafter, an embodiment of a control method that can be implemented in the mobile terminal configured as above will be described with reference to FIG. 4 to FIG.

For convenience of explanation, it is assumed that the mobile terminal referred to below includes at least a part of the components shown in Fig. Specifically, the mobile terminal according to the present embodiment essentially includes a display unit 151 and a control unit 180 among the components shown in FIG. And may further include a camera 121 or a voice recognition unit 182 according to an embodiment. Since the mobile terminal according to the present invention can be more easily implemented when the display unit 151 is a touch screen, it is assumed that the display unit 151 is a 'touch screen' in the following description and drawings.

FIG. 4 shows a control flowchart of the mobile terminal according to the present embodiment, and FIG. 5 shows an example of a display method of the mobile terminal according to the above embodiment.

As shown in FIG. 4, first, the display unit 151 displays the dynamic image as a first screen (S401). The dynamic image may include a moving image and a preview image of the camera. That is, the first screen may be a moving picture playback screen, or may be a preview screen in which an external image input by the camera is output in real time. In the latter case, the mobile terminal of the present invention may further include a camera. In FIGS. 5 to 9 and FIGS. 14 to 16, it is assumed that a dynamic image is a previously stored moving image for convenience of explanation. Although not shown, all of the embodiments shown in the above drawings can be applied to a preview image of a camera.

The first screen may occupy a relatively large area in the display unit 151. [ Preferably, the first screen may occupy the entire display area on the display unit 151. [ Alternatively, the first screen may occupy only a part of the display area on the display unit 151. [ In the present embodiment, the first screen is composed of the dynamic images before being enlarged.

A dynamic image contains one or more objects. The objects included in the dynamic image can move within the first screen as the dynamic image is outputted. The objects included in the dynamic image become an object or a part of an object included in the moving image if the dynamic image is a previously stored moving image and a part of an external object or an object picked up by the camera when the dynamic image is a preview image of the camera .

Specifically, as shown in (1) of FIG. 5, the display unit 151 of the mobile terminal displays the playback screen of the moving image stored in the mobile terminal as the first screen 200. As shown in FIG. 5 (1), the first screen 200 may occupy the entire display area on the display unit 151. The dynamic image may include an object 2110 made of tigers, and the tiger object may be further composed of detailed objects such as eyes 2101, ears 2102, spots and the like. As the moving image is played back, the tiger object 2110 moves or changes its position in the first screen 200. [

In the state that the dynamic image is displayed as the first screen, the user selects the object in the dynamic image as the desired object (S402). A desired object refers to an object that the user wants to enlarge, and is an object necessarily included in a later enlarged partial image. The user can touch and select at least one of the objects included in the dynamic image in a state where the first screen is displayed, and the control unit 180 recognizes the object selected by the user as the desired object.

According to one embodiment, a user may select a desired object by specifying a desired area rather than selecting individual objects included in the dynamic image. The desired region refers to a predetermined region that the user wants to magnify and view in the dynamic image. In this case, the user can designate a certain area within the first screen. For example, the user can designate an area of a predetermined size by performing a touch drag input on the first screen, or when a user touches the first screen, a region of a predetermined size centered on the touched position is moved . ≪ / RTI > In the latter case, the predetermined size may be changed by the user.

In this embodiment, when a certain area is designated in the first screen as described above, the controller 180 can automatically recognize one or more objects included in the desired area as a desired object. That is, when a desired region is designated on the first screen, an object in the desired region can be automatically selected as a desired object according to the designation of the desired region.

The desired region may be displayed on the first screen or may not be displayed so that its shape and size are visible to the user. When the boundary of the desired area is displayed on the first screen, the user can easily confirm the state of the selected area. For convenience of explanation, only the case where the boundary of the desired area set in a rectangular shape is displayed on the first screen through the rectangular box displayed so as to be superimposed on the first screen is shown in the drawings attached hereto. However, the border of the desired area may not be displayed as described above.

As shown in (2) of FIG. 5, the user can designate the desired area 210 in a state in which the moving picture reproduction screen is displayed as the first screen 200 on the display unit 151. If the user wants to enlarge the tiger's eyes, the user can touch the area around the eye object 2101 to designate the area 210 including the eye object 2101 as a desired area.

5, the size of the desired area 210 is predetermined. As a result, the user touches one point on the first screen 200 as shown in (2) The user can specify the desired area 210 of the user. When the desired region 210 is designated as described above, the control unit 180 automatically recognizes the eye object 2101 included in the desired region 210 as a desired object.

Referring again to FIG. 4, after the desired object is selected on the first screen, the controller 180 enlarges the first partial image including the desired object and displays the enlarged first partial image on the second screen (S403). The first partial image refers to a portion of the dynamic image including the desired object selected by the user in the dynamic image. When the desired object is selected through designation of the desired region, the first partial image may be the same as the portion corresponding to the desired region in the dynamic image. The controller 180 determines a first partial image of the dynamic image and enlarges the first partial image. As the first partial image is enlarged, the desired object selected by the user is enlarged.

At this time, the controller 180 may enlarge the first partial image at a predetermined ratio. The enlargement ratio can be set or changed constantly by the user. The case where the enlargement ratio is changed will be described later in detail. In this case, the larger the size of the first partial image including the desired object, the larger the size of the second screen. In this case, when the size of the second screen reaches the maximum size, the size of the second screen is not increased any more, and a part of the enlarged first partial image is enlarged And can be displayed as the second screen.

Alternatively, the controller 180 may enlarge the first partial image so that the size of the first partial image is the same as the second image having the predetermined size, while the size of the second image is preset. That is, the controller 180 may enlarge the first partial image at a ratio of the size of the second partial image to the size of the first partial image. In this case, the larger the size of the first partial image including the desired object, the smaller the enlargement ratio. In this case, the size of the predetermined second screen is preferably set to be larger than the size of the first partial image.

The enlarged first partial image is displayed as the second screen. And the second screen may occupy a relatively small area on the display unit 151. [ Preferably, the second screen is displayed as a sub-screen smaller than the first screen, and may be displayed so as to overlap with the first screen occupying the entire display area. Alternatively, when the first screen occupies only a part of the display area, the second screen may occupy another part of the display area. In the present embodiment, the second screen is composed of a screen on which a part of the dynamic image is enlarged.

The second screen is displayed together with the first screen. At this time, the second screen is displayed together with the first partial image or the second partial image before enlargement in the first screen. That is, the before-enlarged view of the desired object in the dynamic image constituting the first screen is displayed simultaneously with the enlarged view of the desired object in the second screen. For this, when the second screen is displayed so as to overlap with the first screen, the controller 180 can adjust the position of the second screen so that the desired object displayed on the first screen is not covered by the second screen. The display of the desired object before and after the enlargement of the desired object are displayed together on the display unit 151 of the mobile terminal so that the user can observe the desired object at various ratios together.

Specifically, the second screen 300 may be displayed on a part of the edge of the display area as shown in (3) of FIG. The second screen 300 is a screen on which the first partial image 210a including the previously selected eye object 2101 is enlarged. 5, the desired region 210 is selected, and the first partial image 210a is a portion of a moving image that is reproduced in the mobile terminal and corresponds to the desired region 210 It can be a video.

Thereafter, the control unit 180 enlarges a portion included in the desired area 210 of the moving image and displays the enlarged portion as a second screen 300. In the second screen 300, a snow object 2101, which is a desired object, . As shown in (3) of FIG. 5, the second screen 300 is displayed together with the first partial image 210a before enlargement included in the first screen 200, that is, the image of the desired area.

Referring back to FIG. 4, in the state where the first partial image is enlarged and displayed as the second screen, the desired object can be moved within the first screen (S404). That is, as the dynamic image displayed on the first screen is continuously displayed, the position, shape, arrangement and the like of the desired object are changed in the first screen. For example, if the first screen is a playback screen of a moving image stored in the mobile terminal, the desired object in the moving image screen can be moved as the moving image is played back. Alternatively, if the first screen is a preview screen of the camera, the position of the desired object may be changed in the preview screen as the user moves the mobile terminal.

When the desired object is moved within the first screen, the controller 180 enlarges the second partial image including the moved desired object and displays the enlarged second partial image as the second screen (S405). That is, when the desired object moves in the first screen, the control unit 180 tracks the moving desired object so that the enlarged view of the desired object is continuously displayed on the second screen. Preferably, the controller 180 may enlarge the second partial image at the same rate as the enlargement ratio of the first partial image. When the desired area is selected in the first screen, the control unit 180 tracks the image in the desired area and controls the enlarged image to be continuously displayed on the second screen.

The second partial image refers to a part of the dynamic image including the desired object after the movement if the desired object selected by the user moves in the dynamic image. When the desired object is selected through designation of the desired region, the second partial image may be the same as the portion corresponding to the desired region after the movement of the dynamic image. The first partial image and the second partial image commonly include the desired objects selected by the user. In the case where the periphery of the desired object changes as the desired object moves, the second partial image may include an object not included in the first partial image.

Specifically, as shown in (4) of FIG. 5, the tiger included in the moving picture playback screen, which is the first screen 200, moves so that the eye object 2101, which is a desired object in the first screen 200, have. Compared with (3) in FIG. 5, in the first screen 200, the eye object 2101 has moved to the lower right. When the eye object 2101 moves as described above, the controller 180 tracks the eye object 2101 and sets a second partial image 210b including the moved eye object 2101 in real time. 5B, the second partial image 210b may also be an image of a portion corresponding to the desired region 210 designated by (2) in FIG. 5A among the moving images reproduced by the mobile terminal.

After setting the second partial image 210b, the controller 180 enlarges the second partial image 201b and displays the enlarged second partial image 201b as the second screen 300 in real time. As a result, the second screen 300 still includes an enlarged view of the tiger's eye object 2101.

According to the present embodiment, before and after the enlargement of the desired object can be displayed on the first screen and the second screen, respectively. In addition, even if the desired object in the dynamic image constituting the first screen moves, the enlarged view of the desired object can be continuously displayed on the second screen. As a result, the user can receive a display of various interfaces, thereby improving convenience for the user.

According to an embodiment, the controller 180 may enlarge the first partial image and display the second partial image after correcting the enlarged first partial image or the second partial image to improve the resolution. In general, when an image having a constant resolution is enlarged, the resolution of the enlarged image is reduced. In this embodiment, the user does not feel the resolution reduction of the enlarged image through the correction to improve the resolution of the enlarged image.

In particular, the controller 180 may use a super resolution technique for correcting the enlarged first partial image or the second partial image. To this end, the control unit 180 can first extract a plurality of frames before the current point in the frame constituting the dynamic image displayed as the first screen. The control unit 180 extracts a plurality of previous frames based on the current time point so that the control unit 180 can enlarge and correct the state of the desired object included in the first screen in real time and display it as a second screen.

Then, the controller 180 may analyze an edge of the desired object included in each of the plurality of extracted frames. Based on the analysis, the controller 180 can estimate and interpolate the detailed shape of the edge of the desired object included in the current-time frame. That is, when expanding the desired object, the controller 180 estimates and corrects a portion that does not appear as a desired object on the first screen based on an edge displayed in the previous frame.

According to the present embodiment, the edge of the enlarged desired object can be more clearly corrected, and the resolution of the second screen can be improved to a degree that the resolution of the second screen is not different from that of the first screen. As a result, the user can observe the enlarged screen of the object to be viewed in detail with improved image quality without deteriorating the image quality in the second screen on which the specific object is enlarged.

Hereinafter, various embodiments related to the case where the state of the desired area is changed in the first screen and the case where the enlargement ratio of the partial image is changed will be described with reference to FIG. 6 to FIG.

FIG. 6 shows an example of a case where another object is selected as a desired object in the mobile terminal according to the embodiment of FIG.

In a state where the second screen is displayed, if another object is selected on the first screen, the enlarged view of the newly selected object may be displayed on the second screen. That is, when the controller 180 detects a user command to select another object in a state where the second screen is displayed, the controller 180 can recognize the newly selected object as a desired object. Accordingly, the control unit 180 can enlarge the newly selected object and display it as the second screen. Until another object is selected, the controller 180 tracks the newly selected object and continuously displays the enlarged view on the second screen.

For example, as shown in (1) of FIG. 6, when the user desires to touch another portion of the first screen 200 in a state in which the desired area including the eye object 2101 is predefined in the first screen 200 can do. According to the touch input, the desired area 210 can be newly set around the touch point. When the desired area 210 is newly designated, the controller 180 can recognize the ear object 2102 included in the new desired area 210 as a new desired object.

If the control unit 180 recognizes the ear object 2102 as a new desired object, the partial image including the ear object 2102 is enlarged as shown in (2) of FIG. 6 to be displayed as the second screen 300 Can be displayed. As a result, in the enlarged image of the eye object 2101 as shown in FIG. 6 (1), the second screen 300 is enlarged (enlarged) of the ear object 2102 as shown in FIG. 6 (2) Video.

According to the present embodiment, the user can freely change the desired object while the second screen is being displayed. Accordingly, the enlarged image displayed on the second screen can be easily changed, and usability can be improved.

7 shows an example in which the size of the desired area designated on the first screen is changed by a user command.

According to one embodiment, the controller 180 may change the size of the desired area in response to a user command. The controller 180 can recognize the touch input as a command for changing the size of the desired area when a touch input of a specific pattern is detected. By the user command as described above, not only the size of the desired area but also the shape can be changed. When the first or second partial image including the desired object is set to be the same as the image included in the desired region, as the size or shape of the desired region is changed, the size or shape of the second screen, .

For example, the mobile terminal according to the present embodiment can operate as shown in FIG. As shown in (1) of FIG. 7, the user can touch-drag the boundary line of the desired area 210 in a state in which the desired area 210 of a predetermined size is designated. By the touch drag input of the user, the size of the desired area 210 can be increased.

As the size of the desired region 210 increases, the first partial image set to correspond to the desired region 210 can be changed, and as shown in FIG. 7 (2), the enlarged first partial image The image can be displayed as the second screen 300. [

In this figure, a case is shown in which the controller 180 enlarges the first partial image so that the size of the first partial image becomes equal to the size of the second screen 300 having a constant size. As the size of the first partial image is increased, the enlargement ratio of the first partial image is reduced in comparison with (1) in FIG. 7 (2). Although not shown, the same enlargement ratio as in (2) of FIG. 7 is maintained, and accordingly, when the size of the first partial image is increased, the size of the second screen may be increased.

By changing the size of the desired area as described above, the user can include more objects in the enlarged image displayed on the second screen.

FIGS. 8 and 9 show various examples in which the enlargement ratio of the enlarged image displayed on the second screen is changed by a user command.

According to the present embodiment, the controller 180 may change the enlargement ratio of the first partial image or the second partial image in response to the user command. The enlargement ratio changing operation may be performed after the second screen is displayed or before the second screen is displayed. When the touch input of a specific pattern is detected, the controller 180 recognizes the touch input as a command for changing the enlargement ratio of the enlarged image. In this case, the control unit 180 can reduce or enlarge the enlarged image displayed as the second screen in real time.

FIG. 8 shows an example in which the enlargement ratio of the first or second partial image is reduced in a state that the second screen is displayed.

As shown in (1) of FIG. 8, the user can perform a touch drag input to the right on the second screen 300. In this case, the control unit 180 can recognize the input as a command for decreasing the enlargement ratio of the first or second partial image. Accordingly, as shown in (2) of FIG. 8, Can be reduced.

In contrast, FIG. 9 shows an example in which the enlargement ratio of the first or second partial image is increased in a state that the second screen is displayed.

As shown in (1) of FIG. 9, the user can perform a left-pointing touch drag input on the second screen 300. The control unit 180 can recognize the touch drag input in the above-described direction as an instruction to increase the enlargement ratio of the first or second partial image. Accordingly, the controller 180 may enlarge the first or second partial image and display it on the second screen 300 as shown in (2) of FIG.

In FIGS. 8 and 9, the size of the second screen 300 is not constantly set but changed according to the enlargement ratio. As a result, in FIG. 8 (2), as the enlargement ratio of the first or second partial image is decreased, the size of the second screen 300 is decreased as compared with (1) in FIG. In FIG. 9 (2), as the magnification ratio of the first or second partial image is increased or decreased, the size of the second screen 300 is increased as compared with FIG. 9 (1).

Although not shown, the size of the second screen can be kept constant even when the enlargement ratio of the first or second partial image is changed, unlike in FIG. 8 (2) or FIG. 9 (2). In this case, if the enlargement ratio of the first or second partial image is reduced, the enlarged partial image may occupy only a part of the second screen. Or if the enlargement ratio of the first or second partial image is increased, the size of the enlarged partial image is larger than that of the second screen, so that a part of the enlarged partial image may not be displayed on the second screen. If a portion of the enlarged first or second partial image is larger than the size of the second screen, the user can scroll the enlarged partial image within the second screen.

According to the present embodiment, the user can change the enlargement ratio of the enlarged image with only a simple touch input while the second screen is displayed. As a result, it is possible to simply increase the enlargement ratio in the case of observing the desired object larger, and to simply reduce the enlargement ratio in the case of observing in a smaller size.

Hereinafter, referring to FIGS. 10 to 13, various embodiments that can be applied when the dynamic image forming the first screen is a preview image of a camera will be described.

FIG. 10 shows an example of the mobile terminal of the present invention when the dynamic image is a preview image of the camera.

As described above, according to one embodiment, the first screen may be a preview screen in which an external image input from the camera is output to the display unit 151 in real time. In this case, the dynamic image displayed as the first screen is a preview image of the camera. To this end, the mobile terminal of the present invention may further include a camera 121 (see FIG. 1).

A camera preview screen in which an external face object 2103 is imaged can be displayed as the first screen 200 on the display unit 151 of the mobile terminal, as shown in (1) of FIG. In this embodiment, the user can designate the desired area 210 in the vicinity of the face object 2103. When the desired area 210 is designated, the controller 180 recognizes the face object 2103 included in the desired area 210 as a desired object.

When the controller 180 recognizes the face object 2103 as a desired object, the control unit 180 enlarges the first partial image including the face object 2103 to display the second screen 300 as shown in FIG. 10 (2) As shown in FIG. The second screen 300 may be displayed so as to be superimposed on the first screen 200 at the corner of the display unit 151 and the second screen 300 may be displayed on the second screen 300 as shown in (2) The face object 2103 is included. The first partial image may be an image of a portion corresponding to the desired region 210 of the camera preview image. In this case, the second screen 300 is a screen on which the enlarged image of the desired region 210 is displayed.

When the face object 2103 moves or the user changes the position of the mobile terminal and the face object 2103 moves within the first screen 200, the controller 180 tracks the face object 2103 do. The control unit 180 enlarges and displays the second partial image including the moved face object 2103 as the second screen so that the enlarged image of the face object 2103 continues to be the second screen 300 Display.

According to the present embodiment, a user can enlarge and view a specific object desired to be viewed in detail in real time while capturing an external object with the camera of the mobile terminal. The mobile terminal of the present invention can track the specific object and display the enlarged image even if the external object moves or the user moves the camera. As a result, the user is able to shoot while viewing an enlarged view of the object when capturing an object far away. In addition, since the object and the user who are far away from the camera can be photographed and can be viewed in detail in real time, the camera preview image can be utilized as a kind of magnifying glass.

FIG. 11 shows an example in which the voice recognition function is applied to the mobile terminal according to the embodiment of FIG.

According to the present embodiment, the mobile terminal of the present invention may further include a voice recognition unit 182 (see FIG. 1). The voice recognition unit 182 recognizes and extracts a voice uttered by a human being among external acoustic signals. In this case, the mobile terminal may further include a microphone 122 (see FIG. 1) into which an external sound for voice recognition is input. Alternatively, the voice recognition unit 182 may be embedded in the microphone 122. [ The voice recognition unit 182 may transmit an electric signal to the controller 180 indicating that voice exists when the voice recognition unit 182 determines that there is voice in the acoustic signal inputted from the outside. The control unit 180 may receive the electric signal and start detecting a face of a person from an external image input from the camera.

That is, the control unit 180 can extract the face of the person from the preview screen, which is the first screen, when the speech recognition unit 182 recognizes the voice. When the face of the person is extracted, the control unit 180 automatically recognizes the extracted face as a desired object. When the desired object is determined, the controller 180 may enlarge the first partial image and the second partial image including the face, which is the desired object, and display the second partial image as the second screen. As described above, the second partial image is a partial image including the moved face when the face moves within the first screen.

Specifically, as shown in (1) of FIG. 11, when an audio signal is simultaneously input when a user uses the camera of the mobile terminal to pick up an external object or the like, the voice recognition unit 182 can operate automatically . Alternatively, although not shown in the figure, the voice recognition unit 182 may operate in response to a user command of a specific pattern while the camera preview image is displayed. The voice recognition unit 182 detects whether or not a voice is included in an audio signal input from the outside. When a voice is detected, the voice recognition unit 182 transmits an electric signal to the control unit 180. [

The control unit 180 receives the electric signal from the voice recognition unit 182 and operates to detect a face of the first screen 200 as a preview screen. When the face of the person is detected on the first screen 200, the controller 180 designates the area including the detected face 4101 as the desired area 210 as shown in (2) of FIG. 11, The detected face 4101 can be recognized as a desired object. The control unit 180 displays a rectangular figure 210 displaying the detected face 4101 on the first screen 200 and displays the rectangular figure 210 on the first screen 200 as shown in (2) Can be recognized as a desired area.

When the desired area 210 including the detected face 4101 is recognized, the controller 180 enlarges the partial image included in the desired area 210 as shown in (2) of FIG. And displays it as the third screen 300. The third screen 300 includes an enlarged view of the detected face 4101 on the preview screen.

On the other hand, FIG. 12 shows an example of a case where a plurality of faces of a person extracted through speech recognition in the embodiment where the speech recognition function is applied as shown in FIG.

According to the present embodiment, when there are a plurality of extracted faces through the voice recognition function, the controller 180 can control to display a screen for selecting one of the extracted faces. At this time, the controller 180 recognizes the selected face on the screen as a desired object.

Specifically, as shown in (1) of FIG. 12, when an audio signal is input to the mobile terminal together with a video signal, the voice recognition unit 182 can operate automatically. Alternatively, as described above, the voice recognition section 182 may operate in response to a user command of a specific pattern. When a voice is detected from the input audio signal, the voice recognition unit 182 transmits an electric signal to the control unit 180. [

Upon receipt of the electric signal from the speech recognition unit 182, the control unit 180 detects a face of the first screen 200 as a preview screen. At this time, if there are a plurality of detected faces of the person, the control unit 180 first detects the first face 4101 and the second face 4101 detected on the first screen 200 as shown in (2) 4102) are displayed on the display screen. As shown in (2) of FIG. 12, the first face 4101 and the second face 4102 may be respectively displayed by the rectangular figure 210 surrounding each face. The rectangular figure 210 indicates that the first face 4101 and the second face 4102 are detected, and can function as a desired area.

As shown in (2) of FIG. 12, the user can select one of the plurality of faces in a state where a plurality of faces detected by the controller 180 are displayed on the first screen 200 as described above . As an example, the second face 4102 can be selected.

When one of the plurality of faces is selected, the controller 180 can recognize the selected face (second face) 4102 and the rectangular figure 210 displaying the selected face as the desired object and the desired region 210, respectively have. As the desired area 210 is recognized, the controller 180 may enlarge the partial image included in the desired area 210 as shown in (3) of FIG. 12 and display it as the third screen 300 have. As a result, an enlarged view of the second face 4102 selected in (2) of FIG. 12 is displayed on the third screen 300.

According to the above-described embodiment, the face of the person can be automatically enlarged and previewed on the preview screen when the user picks up a person with the camera. When a plurality of persons are imaged at one time, the face of the person selected by the user can be automatically enlarged and displayed. As a result, the user does not need to perform additional operations such as enlarging the preview screen to view a person's face when capturing a person, thereby improving the convenience of using the camera.

FIG. 13 shows various examples of moving images or still images that can be stored through the mobile terminal according to the embodiment of FIG.

According to one embodiment, when the first screen is a camera preview screen, the controller 180 may control that the first screen and the second screen are stored as one moving picture or still image when a video storage command is detected. That is, when a moving image recording command or a still image capturing command is detected on the first screen, which is a camera preview screen, the control unit 180 can record a moving image as it is displayed on the display unit 151 of the mobile terminal, have. Accordingly, the moving picture or the still picture includes both the first picture and the second picture. For example, a recorded moving image or a captured still image may include both a first screen occupying the entire area of the display unit 151 and a second screen displayed in an overlapping manner with the first screen at one corner of the display unit 151 .

13 (a), the user can display the first screen 200, which is a preview screen of the camera, and the second screen 300, which is an enlarged portion of the preview image, together have. In this state, the user can press the shooting button of the camera to make a video recording command or a still image capturing command.

At this time, according to the present embodiment, the control unit 180 can store the video as it is displayed on the display unit 151 as a moving image or capture it as a still image, as shown in FIG. 13 (b). 13B, the screen of one frame of the recorded moving image or the captured still image screen 400 includes a first screen 200 occupying the entire area, a second screen 200 occupying a part of the screen, (300).

According to another embodiment, the controller 180 may control that only one of the first screen and the second screen is stored as a moving picture or a still image when a video storage command is detected. For this, either the first screen or the second screen may be selected, and the controller 180 may store only the selected image as a moving image or a still image. In the case where only the second screen is recorded, the second screen may be enlarged and stored so that the second screen occupies the one frame screen of the moving image or the entire still image screen 400.

12 (a), when a moving image recording or still image capturing command is input by the user, the moving image or the still image as shown in (c) or (d) of FIG. 12 is stored .

That is, as shown in (c) of FIG. 12, the controller 180 may allow only the first screen 200, which is a preview image before the enlargement, to be stored as a moving image or a still image. In this case, the first screen 200 may be selected by the user before or after the motion picture or still image storage command.

Alternatively, as shown in FIG. 12 (d), the controller 180 may cause only the second screen 300, which is an enlarged portion of the preview image, to be stored as a moving image or a still image. Likewise, the second screen 300 may be selected by the user before or after the motion picture or still image storage command. 12 (d), the second screen 300 may be further enlarged to occupy one frame of the moving image or the entire screen 400 of the still image, or may be configured to occupy the entire screen 400 of the second screen 300 May be stored in a size as shown in Fig. 12 (a).

According to the embodiment described above, a moving picture to be recorded or a still image to be captured on a preview screen where a first screen and a second screen are displayed together can be configured in various ways. As a result, moving pictures or still images captured using the camera of the mobile terminal can be configured variously according to the user's intention, and the usability and usability of the camera can be improved.

Hereinafter, with reference to FIG. 14 to FIG. 16, various embodiments in which the image displayed on the first screen and the image displayed on the second screen are exchanged will be described.

FIG. 14 shows an example in which the enlarged image displayed on the second screen in the embodiment of FIG. 5 is displayed as the first screen.

According to the present embodiment, the controller 180 can control the enlarged first partial image or the enlarged second partial image to be displayed on the first screen in response to a user command. In this case, the enlarged partial image is displayed as the first screen. That is, the enlarged partial image constitutes the first screen occupying a relatively large area in the display unit 151, thereby replacing the enlarged pre-dynamic image constituting the first screen. In this case, the enlarged pre-dynamic image constituting the first screen may not be displayed any more.

In this embodiment, the user command may be a touch input of a specific pattern. Alternatively, the user command may be a touch input performed on a specific area of the display unit 151. For example, when the long touch input is performed on the second screen, the controller 180 may display the enlarged first partial image or the enlarged second partial image as the first screen in response to the input.

Specifically, as shown in FIG. 14 (1), the first screen 200 and the second screen 300 may be displayed together on the display unit 151 of the mobile terminal. The first screen 200 may be a dynamic image before enlargement and the second screen 300 may be a partial image in which an image of a portion of the desired area 210 designated on the first screen 200 is enlarged. The tiger eye object 2101 is included in the desired area 210 and thus the second screen 300 includes an enlarged view of the eye object 2101. [

In this state, as shown in (1) of FIG. 14, the user can touch the second screen 300 for a long time. The control unit 180 may display the partial image in which the image of the desired area 210 is enlarged as the first screen 200 instead of the second screen in response to the touch input, . That is, the enlarged partial image can be displayed in the entire area of the display unit 151. For this, the control unit 180 can further enlarge and display the image of the portion of the desired region 210.

According to the present embodiment, the enlarged partial image can be displayed on the display unit 151 by the user command. In this embodiment, the user can enlarge a portion of the displayed dynamic image and display the enlarged dynamic image on the full screen.

On the other hand, Figs. 15 and 16 show various examples of the case where the dynamic image before enlargement in the mobile terminal according to the embodiment of Fig. 14 is displayed as the second screen.

According to one embodiment, as shown in FIG. 15, the control unit 180 may control that a part or all of the dynamic image is displayed on the second screen while the desired object is positioned within the second screen . That is, in this embodiment, when the controller 180 displays the enlarged partial image as the first screen as described above, it can display the dynamic image before the enlargement as the second screen.

At this time, the control unit 180 can display the dynamic image as the second screen as it is without reducing the dynamic image. As described above, when the size of the second screen is smaller than the size of the first screen, a part of the dynamic image may not be displayed in this case. The control unit 180 can position the dynamic image before enlargement so that the portion corresponding to the enlarged partial image of the dynamic image is located at the center of the second screen.

15 (1), a first screen 200 composed of a dynamic image before enlargement and a second screen 300 composed of an enlarged partial image are displayed on the display unit 151 , The user can perform touch input of a specific pattern. At this time, the partial image forming the second screen 300 can be selected by the desired area 210 designated on the first screen 200. [ That is, the image of the portion corresponding to the desired region 210 among the pre-enlarged dynamic images corresponds to the enlarged partial image of the second screen 300.

 In response to the touch input, the controller 180 may display the enlarged partial image constituting the second screen 300 as the first screen 200 as shown in (2) of FIG. Accordingly, the enlarged partial image can occupy the entire display unit 151.

At the same time, the controller 180 may display the enlarged pre-dynamic image of the first screen 200 as the second screen 300. As shown in (2) of FIG. 15, the controller 180 displays the second screen 300 while maintaining the ratio of the dynamic image before enlargement, the area corresponding to the enlarged partial image ) Portion is located at the center of the second screen 300. As a result, the outer portion of the dynamic image before enlargement can be hidden from the second screen 300.

According to another embodiment, as shown in FIG. 16, the controller 180 may reduce the dynamic image to a ratio of the size of the second screen to the size of the first screen, So that the second screen is displayed. That is, the pre-enlargement dynamic image can be reduced and displayed so that the entire pre-enlargement dynamic image can be displayed on a second screen having a size smaller than the first screen. For this, the controller 180 may reduce the entire dynamic image before enlargement to a ratio of the size of the second screen to the size of the first screen.

Specifically, as shown in FIG. 16 (1), a first screen 200 composed of a dynamic image before enlargement and a second screen 300 composed of an enlarged partial image are displayed on a display unit 151 The user can perform touch input of a specific pattern. In response to the touch input, the controller 180 may display the enlarged partial image constituting the second screen 300 as the first screen 200 as shown in (2) of FIG. Accordingly, the enlarged partial image can occupy the entire display unit 151.

At the same time, the control unit 180 can reduce the enlarged pre-dynamic image of the first screen 200 to fit the size of the second screen 300 and display the enlarged dynamic image as the second screen 300. The control unit 180 reduces the dynamic image before enlargement to a ratio of the size of the second screen 300 with respect to the size of the first screen 200 as shown in (2) of FIG. 16, 300). As a result, the entire image of the dynamic image before the enlargement can be viewed on the second screen 300.

According to the above-described embodiment, the contents of the first screen and the second screen constituting the display may be changed according to the user's intention. When the first screen occupies a main area of the display unit 151 and the second screen occupies a sub area, it is possible to realize the effect of main / sub conversion of the enlarged image and the enlarged partial image.

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

100: mobile terminal 180:
151: Display unit 200: First screen
210: Desired area 300: Second screen
2101, 2102, 2103:

Claims (17)

A display unit for displaying the dynamic image on the first screen; And
When a desired object is selected in the dynamic image, enlarging a first partial image including the selected desired object and displaying the enlarged first partial image together with the first screen as a second screen, The first partial image before enlargement in the screen is displayed together with the enlarged first partial image in the second screen,
When the desired object moves within the first screen after the selection of the desired object, enlarges the second partial image including the moved desired object and displays the enlarged second partial image as the second screen, And controls the second partial image before the enlargement in the first screen to be displayed together with the enlarged second partial image in the second screen. The method according to claim 1,
And an object in the desired region is automatically selected as the desired object when a desired region of a predetermined size is designated in the first screen. 3. The method of claim 2,
Wherein the control unit controls the border of the desired area to be displayed on the first screen when the desired area is selected. The method of claim 3,
Wherein the control unit changes the size of the desired area in response to a user command. The method according to claim 1,
Wherein the controller changes an enlargement ratio of the first partial image or the second partial image in response to a user command. The method according to claim 1,
The control unit
The enlarged first partial image or the enlarged second partial image is corrected to be displayed as the second screen so that the resolution of the enlarged first partial image or the enlarged second partial image is improved. The method according to claim 1,
The control unit
Extracting a plurality of frames before the current time point among frames constituting the dynamic image,
Wherein the resolution of the enlarged first partial image or the enlarged second partial image is enhanced by interpolating the edges of the desired object based on an edge of the desired object included in each of the plurality of frames. The method according to claim 1,
Further comprising a camera for receiving an image from outside,
Wherein the dynamic image is a preview image in which an external image input from the camera is output in real time to the display unit. 9. The method of claim 8,
Wherein the control unit controls the first screen and the second screen to be stored as one moving picture or still image when a video storage command is detected. 9. The method of claim 8,
Wherein the control unit controls only one of the first screen and the second screen to be stored as a moving image or a still image when an image storage command is detected. 9. The method of claim 8,
Further comprising a voice recognition section for recognizing a voice input from the outside,
Wherein the control unit extracts a face of a person from the preview image and recognizes the extracted face as the desired object when the voice is recognized by the voice recognition unit. 12. The method of claim 11,
If the extracted faces are plural,
Wherein the control unit controls the display unit to further display a screen for selecting one of the extracted faces and recognizes the face selected by the user as the desired object. The method according to claim 1,
Wherein the controller controls the enlarged first partial image or the enlarged second partial image to be displayed on the first screen in response to a user command. 14. The method of claim 13,
Wherein the control unit further controls that a part or the whole of the dynamic image is displayed on the second screen when the enlarged first partial image or the enlarged second partial image is displayed on the first screen. 14. The method of claim 13,
Wherein the control unit controls the controller to display the dynamic image at a ratio of the size of the second screen to the size of the first screen when the enlarged first partial image or the enlarged second partial image is displayed on the first screen, And further controls the reduced dynamic image to be displayed on the second screen. Displaying a dynamic image as a first screen;
Enlarging a first partial image including the selected desired object when the desired object is selected in the dynamic image;
Displaying the enlarged first partial image as a second screen, displaying a first partial image before enlargement in the first screen together with an enlarged first partial image in the second screen;
Enlarging a second partial image including the moved desired object when the desired object moves within the first screen after the selection of the desired object; And
Displaying the enlarged second partial image as a second screen and displaying a second partial image before enlargement in the first screen together with an enlarged second partial image in the second screen, Way. Displaying a dynamic image as a first screen;
Enlarging a first partial image including the selected desired object when the desired object is selected in the dynamic image;
Displaying the enlarged first partial image as a second screen and displaying a first partial image before enlargement in the first screen together with an enlarged first partial image in the second screen;
Enlarging a second partial image including the moved desired object when the desired object moves within the first screen after the selection of the desired object; And
And displaying the enlarged second partial image as a second screen and displaying a second partial image before enlargement in the first screen together with an enlarged second partial image in the second screen, Recording medium.

Images