KR102063768B1 - Mobile terminal and control method for the mobile terminal - Google Patents

Abstract

The present invention relates to a mobile terminal capable of taking an image and a control method thereof. The mobile terminal according to an exemplary embodiment of the present invention receives images through a display unit, a camera in which a plurality of lenses are arranged along a plurality of lines, and the plurality of lenses, and receives the received images on the display unit. And a control unit for outputting the control unit, wherein the control unit generates one video data by using an image received from a first lens among the plurality of lenses and an image received from at least one second lens different from the first lens. Characterized in that.

Description

MOBILE TERMINAL AND CONTROL METHOD FOR THE MOBILE TERMINAL}

The present invention relates to a mobile terminal capable of taking an image and a control method thereof.

The mobile terminal may be configured to perform various functions. Examples of such various functions include data and voice communication functions, taking pictures or videos through a camera, storing voices, playing music files through a speaker system, and displaying images or videos. Some mobile terminals include additional functionality to play games, while others are implemented as multimedia devices. Moreover, recent mobile terminals can receive broadcast or multicast signals to watch video or television programs.

In addition, efforts to support and increase the function of the mobile terminal continue. The foregoing efforts include not only changes and improvements in the structural components forming the mobile terminal, but also improvements in software or hardware.

In addition, thanks to this improvement, the mobile terminal may be provided with a camera including a plurality of lenses, and it is possible to receive and photograph an image through each of the plurality of cameras.

One object of the present invention relates to a mobile terminal capable of generating a desired composite moving image data using a plurality of images received through a camera having a plurality of lenses and a control method thereof.

A mobile terminal according to an exemplary embodiment of the present invention receives images through a display unit, a camera in which a plurality of lenses are arranged along a plurality of lines, and the plurality of lenses, and outputs the received images on the display unit. And a controller configured to generate one video data by using an image received from a first lens among the plurality of lenses and an image received from at least one second lens different from the first lens. It is characterized by.

According to an embodiment of the present disclosure, if any one of the received images is selected, the controller photographs an image received from a first lens corresponding to the selected image.

According to an embodiment of the present disclosure, if a second lens different from the first lens is selected while the image received from the first lens is being captured, the controller is further configured to follow the image captured by the first lens. Characterized in that the image received from the lens.

In one embodiment, the controller, in response to the selection of the second lens, terminates photographing of the image received through the first lens and starts capturing the image received through the second lens. Characterized in that.

According to an embodiment of the present disclosure, a progress bar indicating a photographing state of the video data is output to at least one region of the display unit, and the progress bar corresponds to the number of lenses used for capturing images constituting the video data. The display apparatus may be divided into a plurality of sections on the basis of the plurality of sections, and a preview image of any one of the photographed images for generating the video data is output around the plurality of sections.

According to an embodiment, the generated video data may be generated by arranging photographed images for generating the video data according to the arrangement positions of the preview images.

According to an embodiment, the preview image output on the progress bar may change an output position based on a user's selection, and the controller may change the position of the preview image to change the moving image data. Characterized in that the arrangement order of the images constituting the.

According to an embodiment of the present disclosure, when image photographing is started through one of the plurality of lenses, an image currently being photographed is output to at least one region of the display unit.

According to an embodiment of the present disclosure, when the image captured by the first lens is output to the one region, when the touch of the preset method is detected for the one region, the controller detects the touch. The imaging may be performed through a lens having a focus on a subject included in the image.

The control unit may extract an image of a difference portion between an image received from the first lens and an image received from the second lens, and extract the image of the extracted difference portion from the first lens. The video data may be synthesized by synthesizing the received video.

The second lens may be a plurality of lenses based on a user's selection among the plurality of lenses other than the first lens.

According to an embodiment, the controller may photograph images received from the plurality of lenses, and generate video data by using at least two of the plurality of photographed images after photographing is completed. It is done.

According to an embodiment of the present disclosure, a progress bar indicating a generation state of the video data is output to at least one region of the display unit, and the progress bar is configured to capture images of the video data. The image is divided into a plurality of sections based on the number of lenses used, and a thumbnail image of any one of the images photographed for generating the video data is output around the plurality of sections. It is done.

The control unit may divide the display unit into a plurality of regions, and display thumbnail images corresponding to each of the images photographed by the plurality of lenses in a first region of the plurality of regions. A plurality of thumbnail images selected from the preview images are displayed in a second area of the plurality of areas, and the display device is characterized by the order in which the thumbnail images are displayed in the second area.

According to an embodiment of the present disclosure, when any one of the thumbnail images displayed on the first area is selected, the controller may select a graphic object for selecting at least a portion of a captured image corresponding to the thumbnail image from a user. The image is displayed around the image, and a part of the captured image selected by the user through the graphic object is extracted from the captured image corresponding to the selected thumbnail image.

The control unit may generate one moving image data by arranging shot images including at least one of the at least one shot image in the order in which the thumbnail images are displayed in the second area. .

The control unit may output a first image photographed from a first lens of the plurality of lenses on the display unit, and display a display area of at least a portion of the first image based on a user's selection. And a display area of at least a portion of the second image photographed from at least one second lens different from the first lens among the plurality of lenses.

According to an embodiment, when a region of at least one image of the first image is selected, the controller extracts portions of at least one image from each of the second images photographed by the plurality of second lenses. And synthesizing the extracted portions from one of the extracted second images based on the user's selection and at least one image of the first image from which the selected one region is excluded. .

The control unit may display thumbnail images corresponding to the extracted portions, respectively, around the selected area.

The controller may be configured to output a first image photographed from a first lens of the plurality of lenses on the display unit, and to display the first image based on a user's selection. To be replaced with a portion of the display area of any one of the other stored video.

According to an embodiment of the present disclosure, when at least a portion of the display area of the first image is selected, the controller extracts a feature point from an image included in the display area and includes at least one image corresponding to the feature point. At least one moving picture is detected from the pre-stored moving pictures, and the display area of at least a portion of the selected first image is replaced with a display area of any one of the detected moving pictures.

The control unit may output a thumbnail image corresponding to each of the detected at least one moving images to at least a portion of the display unit.

A mobile terminal and a control method thereof according to an embodiment of the present invention allow a user to generate one moving picture data using at least two of a plurality of images input through a plurality of lenses.

In addition, the mobile terminal and its control method according to an embodiment of the present invention, the video data including a plurality of images taken from a variety of focus by editing a plurality of images input through a plurality of lenses as desired by the user To create a.

1 is a block diagram illustrating a mobile terminal according to an embodiment of the present invention.
2A is a front perspective view of an example of a mobile terminal according to one embodiment of the present invention;
2B is a perspective view of an example of a mobile terminal according to an embodiment of the present invention, seen from the rear side thereof.
Figure 2c is a perspective view of the mobile terminal according to another embodiment of the present invention as viewed from the rear.
2D illustrates an example of a camera provided with a plurality of lenses in a mobile terminal according to another embodiment of the present invention.
2E illustrates another example of a camera provided with a plurality of lenses in a mobile terminal according to another exemplary embodiment of the present disclosure.
3 is a flowchart illustrating a method of generating one moving picture data using a plurality of images received through a plurality of lenses in a mobile terminal according to one embodiment of the present invention.
FIG. 4 is a conceptual diagram illustrating an example of generating video data shown in FIG. 3.
FIG. 5 is a conceptual diagram illustrating an example of editing an image received through a plurality of lenses according to a user's selection in a mobile terminal according to an embodiment of the present invention.
6A is a conceptual diagram illustrating an example of generating moving image data using an image received from a lens selected according to a change of a position of a mobile terminal in a mobile terminal according to one embodiment of the present invention.
FIG. 6B is a conceptual diagram illustrating an example of generating video data from a lens that receives an image of a subject at different focal points in a mobile terminal according to one embodiment of the present invention.
FIG. 7 is a diagram for one example of generating one moving picture data by editing an image photographed from a plurality of lenses in a mobile terminal according to one embodiment of the present invention; FIG.
8A and 8B are diagrams illustrating an example of generating an image obtained by synthesizing a display area using images received through a plurality of lenses in a mobile terminal according to an embodiment of the present invention.
FIG. 9 is a diagram for an example of synthesizing a part of an image photographed by a specific lens into a part of an image photographed by another lens according to a user's selection in a mobile terminal according to an exemplary embodiment.
FIG. 10 illustrates an example of displaying another image data on a display unit by using a feature point of a subject image selected by a user in a mobile terminal according to an embodiment of the present disclosure.

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings, and the same or similar components will be given the same reference numerals regardless of the reference numerals, and redundant description thereof will be omitted. The suffixes "module" and "unit" for components used in the following description are given or used in consideration of ease of specification, and do not have distinct meanings or roles from each other. In addition, in describing the embodiments disclosed herein, when it is determined that the detailed description of the related known technology may obscure the gist of the embodiments disclosed herein, the detailed description thereof will be omitted. In addition, it should be noted that the accompanying drawings are only for easily understanding the embodiments disclosed in the present specification and are not to be construed as limiting the technical spirit disclosed in the present specification by the accompanying drawings.

The mobile terminal described herein includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), navigation, and a slate PC. , Tablet PC, Ultra Book, and so on. However, it will be readily apparent to those skilled in the art that the configuration according to the embodiments described herein may also be applied to fixed terminals such as digital TVs, desktop computers, etc., except when applicable only to mobile terminals.

1 is a block diagram illustrating a mobile terminal according to an exemplary embodiment disclosed herein.

The mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a detection unit 140, an output unit 150, a memory 160, and an interface. The unit 170, the controller 180, and the power supply unit 190 may be included. The components shown in FIG. 1 are not essential, so that a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and a network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short range communication module 114, a location information module 115, and the like. .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a previously generated broadcast signal and / or broadcast related information and transmits the same to a terminal. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 may include, for example, Digital Multimedia Broadcasting-Terrestrial (DMB-T), Digital Multimedia Broadcasting-Satellite (DMB-S), Media Forward Link Only (MediaFLO), and Digital Video Broadcast (DVB-H). Digital broadcast signals can be received using digital broadcasting systems such as Handheld and Integrated Services Digital Broadcast-Terrestrial (ISDB-T). Of course, the broadcast receiving module 111 may be configured to be suitable for not only the above-described digital broadcasting system but also other broadcasting systems.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives a wireless signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.

The mobile communication module 112 is configured to implement a video call mode and a voice call mode. The video call mode refers to a state of making a call while viewing the other party's video, and the voice call mode refers to a state of making a call without viewing the other party's image. In order to implement the video call mode and the voice call mode, the mobile communication module 112 is configured to transmit and receive at least one of audio and video.

The wireless internet module 113 refers to a module for wireless internet access and may be embedded or external to the mobile terminal 100. Wireless Internet technologies may include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and the like.

The short range communication module 114 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, etc. may be used.

The location information module 115 is a module for obtaining a location of the mobile terminal 100, and a representative example thereof is a GPS (Global Position System) module.

Referring to FIG. 1, the A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes an image frame such as a still image or a video obtained by an image sensor, that is, a lens, in a video call mode or a photographing mode. The camera 121 may be composed of a plurality of lenses. The camera 121 may receive an image received from each of the plurality of lenses and process an image frame of the received plurality of images. The image frames of the processed plurality of images may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras may be provided according to the use environment.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. The processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module 112 and output in the call mode. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (constant voltage / capacitance), a jog wheel, a jog switch, and the like.

The detector 140 detects a current state of the mobile terminal 100 such as an open / closed state of the mobile terminal 100, a position of the mobile terminal 100, presence or absence of a user contact, orientation of the mobile terminal, acceleration / deceleration of the mobile terminal, and the like. To generate a detection signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it may detect whether the slide phone is opened or closed. In addition, whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to the external device may be detected.

The sensing unit 140 may include at least one sensor. For example, the sensing unit 140 may include an acceleration sensor, an inertial sensor, and a gyro sensor. Through this, the sensing unit 140 is in a state of the current mobile terminal 100, that is, the degree or direction in which the mobile terminal 100 is moved or the direction in which the mobile terminal 100 is perpendicular to the ground surface (hereinafter, vertical direction) or horizontal to the ground surface. A state inclined in the in-direction (hereinafter, referred to as a lateral direction) can be detected.

In addition, the sensing unit 140 may include a pupil recognition sensor that can detect the eyes of the user. In this case, the detector 140 may recognize the eyes of the user and detect the direction of the user's eyes.

 The output unit 150 is used to generate an output related to visual, auditory, or tactile, and may include a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154. have.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, the mobile terminal displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the mobile terminal 100 is in a video call mode or a photographing mode, the mobile terminal 100 displays a photographed and / or received image, a UI, and a GUI.

The display unit 151 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display (flexible). display, a 3D display, or an e-ink display.

Some of these displays can be configured to be transparent or light transmissive so that they can be seen from the outside. This may be referred to as a transparent display. A representative example of the transparent display is TOLED (Transparant OLED). The rear structure of the display unit 151 may also be configured as a light transmissive structure. With this structure, the user can see the object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

According to an implementation form of the mobile terminal 100, two or more display units 151 may exist. For example, a plurality of display units may be spaced apart or integrally disposed on one surface of the mobile terminal 100, or may be disposed on different surfaces, respectively.

When the display unit 151 and a sensor for detecting a touch operation (hereinafter, referred to as a touch sensor) form a mutual layer structure (hereinafter referred to as a touch screen), the display unit 151 may be used in addition to an output device. Can also be used as an input device. The touch sensor may have, for example, a form of a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only the position and area of the touch but also the pressure at the touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can know which area of the display unit 151 is touched.

Referring to FIG. 1, a proximity sensor may be disposed in an inner region of the mobile terminal 100 surrounded by the touch screen or near the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without using a mechanical contact by using an electromagnetic force or infrared rays. Proximity sensors have a longer life and higher utilization than touch sensors.

Examples of the proximity sensor include a transmission photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high frequency oscillation proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, the touch screen is configured to detect the proximity of the pointer by the change of the electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of allowing the pointer to be recognized without being in contact with the touch screen so that the pointer is located on the touch screen is referred to as a "proximity touch", and the touch The act of actually touching the pointer on the screen is called "contact touch." The position where the proximity touch is performed by the pointer on the touch screen refers to a position where the pointer is perpendicular to the touch screen when the pointer is in proximity proximity.

The proximity sensor detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, and a proximity touch movement state). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The sound output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output module 152 may also output a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 100. The sound output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the mobile terminal 100. Examples of events occurring in the mobile terminal include call signal reception, message reception, key signal input, and touch input. The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than a video signal or an audio signal, for example, vibration. The video signal or the audio signal may also be output through the display unit 151 or the sound output module 152, so that they 151 and 152 may be classified as part of the alarm unit 153.

The haptic module 154 generates various haptic effects that a user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or may be sequentially output.

In addition to vibration, the haptic module 154 may be configured to provide a pin array that vertically moves with respect to the contact skin surface, a jetting force or suction force of air through the jetting or suction port, grazing to the skin surface, contact of the electrode, electrostatic force, and the like. Various tactile effects can be generated, such as effects by the endothermic and the reproduction of a sense of cold using the elements capable of endotherm or heat generation.

The haptic module 154 may not only deliver the haptic effect through direct contact, but also may implement the user to feel the haptic effect through a muscle sense such as a finger or an arm. Two or more haptic modules 154 may be provided according to configuration aspects of the mobile terminal 100.

The memory 160 may store a program for the operation of the controller 180 and may temporarily store input / output data (for example, a phone book, a message, a still image, a video, etc.). The memory 160 may store data regarding vibration and sound of various patterns output when a touch input on the touch screen is performed.

When the camera 121 includes a plurality of lenses, the memory 160 may store images photographed by the plurality of lenses. The memory 160 may store the captured images in the horizontal direction or the vertical direction according to a preset arrangement order.

For example, the photographed images may be determined in the horizontal direction or the vertical direction, respectively, based on the order in which the plurality of lenses are arranged. In this case, the captured images may be stored in the memory 160 in a predetermined direction order.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), RAM random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic It may include a storage medium of at least one type of disk, optical disk. The mobile terminal 100 may operate in connection with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device, receives power, transfers the power to each component inside the mobile terminal 100, or transmits data inside the mobile terminal 100 to an external device. For example, wired / wireless headset ports, external charger ports, wired / wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input / output (I / O) ports, The video input / output (I / O) port, the earphone port, and the like may be included in the interface unit 170.

The identification module is a chip that stores various types of information for authenticating the use authority of the mobile terminal 100. The identification module includes a user identify module (UIM), a subscriber identify module (SIM), and a universal user authentication module ( universal subscriber identity module (USIM), and the like. A device equipped with an identification module (hereinafter referred to as an 'identification device') may be manufactured in the form of a smart card. Therefore, the identification device may be connected to the terminal 100 through a port.

The interface unit 170 may be a passage for supplying power from the cradle to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, or various commands input from the cradle by a user. It may be a passage through which a signal is transmitted to the mobile terminal. Various command signals or power input from the cradle may be operated as signals for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal 100. For example, perform related control and processing for voice calls, data communications, video calls, and the like. The controller 180 may include a multimedia module 181 for playing multimedia. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

In addition, the controller 180 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on the touch screen as text and an image, respectively.

In addition, when the state of the mobile terminal 100 satisfies a set condition, the controller 180 may execute a lock state for restricting input of a user's control command to applications. The controller 180 may control the lock screen displayed in the locked state based on a touch input detected through the display unit (hereinafter, referred to as a “touch screen” 151) in the locked state.

In addition, when the camera 121 includes a plurality of lenses, the controller 180 may generate a synthesized image by using a plurality of images received or photographed from the plurality of lenses. For example, the controller 180 may generate one video data by using images received from at least two lenses according to a user's selection.

The controller 180 captures an image received from one particular lens until the user selects another lens, and when the user selects another lens, the controller 180 captures an image received from the lens selected by the user. One video data may be generated by capturing an image captured by the lens following the image.

In addition, the controller 180 may capture an image received from a lens having a different focal point following the captured image while the image is captured from one lens according to a user's selection.

In addition, the controller 180 may generate video data according to an arrangement order by arranging at least two or more images according to a user's selection among images already taken, that is, photographed images.

To this end, the controller 180 may include a video data generator 182, and the video data generator 182 may be implemented in the controller 180 or may be external to the controller 180 separately from the controller 180. It may be implemented in.

In addition, the controller 180 may generate a moving image data obtained by combining at least two images with each other by replacing a part of the display area of the image photographed by one lens with a part of the display area of the image photographed by another lens. For example, the controller 180 may replace some display areas of an image photographing a specific subject with some display areas of an image photographed from another focus. To this end, the controller 180 may include an image synthesizing unit 183, and the image synthesizing unit 183 may be implemented inside the controller 180 or outside the controller 180. It may be implemented separately from.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

Various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using, for example, software, hardware or a combination thereof.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), and field programmable gate arrays (FPGAs). It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions. In some cases, the embodiments described herein may be implemented by the controller 180 itself.

According to the software implementation, embodiments such as the procedures and functions described herein may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein.

The software code may be implemented as a software application written in a suitable programming language. The software code may be stored in the memory 160 and executed by the controller 180.

Hereinafter, a structure of a mobile terminal or a mobile terminal in which components of the mobile terminal or the mobile terminal according to an embodiment of the present invention described with reference to FIG. 1 are disposed will be described.

2A is a front perspective view of an example of a mobile terminal or a mobile terminal of the present invention, and FIG. 2B is a rear perspective view of the mobile terminal shown in FIG. 2A.

2A is a front perspective view of an example of a mobile terminal or a mobile terminal according to the present invention, and FIG. 2B is a rear perspective view of the mobile terminal shown in FIG. 2A.

The disclosed mobile terminal 100 has a terminal body in the form of a bar. However, the present invention is not limited thereto and may be applied to various structures such as a slide type, a folder type, a swing type, a swivel type, and two or more bodies are coupled to be relatively movable.

According to the illustration, the terminal body 100 (hereinafter referred to as 'body') has a front, side and back. The body also has both ends formed along the longitudinal direction.

The body 100 includes a case (casing, housing, cover, etc.) forming an appearance. In the present embodiment, the case may be divided into a front side (hereinafter referred to as 'front case' 101) and a rear side (hereinafter referred to as 'rear case' 102). Various electronic components are built in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be further disposed between the front case 101 and the rear case 102.

The cases may be formed by injecting synthetic resin or may be formed of a metal material, for example, a metal material such as stainless steel (STS) or titanium (Ti).

The terminal body 100 mainly includes a display unit 151, an audio output unit 152, a camera 121, a user input unit 130/131, 132, a microphone 122, an interface 170, and the like in the front case 101. Can be arranged.

The display unit 151 occupies most of the main surface of the front case 101. The sound output unit 152 and the camera 121 are disposed in regions adjacent to one end of both ends of the display unit 151, and the user input unit 131 and the microphone 122 are disposed in regions adjacent to the other end. The user input unit 131 and the interface 170 may be disposed on side surfaces of the front case 101 and the rear case 102. In contrast, the microphone 122 is disposed at the other end of the body 100.

The user input unit 130 is manipulated to receive a command for controlling the operation of the mobile terminal, and may include a plurality of manipulation units 131 and 132. The manipulation units 131 and 132 may also be collectively referred to as manipulating portions, and may be employed in any manner as long as the user operates the tactile manner with a tactile feeling.

Content input by the first or second manipulation units 131 and 132 may be variously set. For example, the first operation unit 131 receives a command such as start, end, scroll, and the like, and the second operation unit 132 adjusts the volume of the sound output from the sound output unit 152 or the display unit 151. Command), such as switching to the touch recognition mode.

Referring to FIG. 2B, a sound output unit 152 ′ may be additionally disposed on the rear of the terminal body, that is, the rear case 102. The sound output unit 152 ′ may implement a stereo function together with the sound output unit 152 (see FIG. 2A), and may be used to implement a speakerphone mode during a call.

The terminal body is equipped with a power supply unit 190 for supplying power to the mobile terminal 100. The power supply unit 190 may be embedded in the terminal body or may be directly detachable from the outside of the terminal body.

In addition, the rear case 102 may further be equipped with a touch pad 135 for sensing a touch. Like the display unit 151, the touch pad 135 may also be configured to have a light transmission type. In this case, if the display unit 151 is configured to output visual information from both sides, the visual information may be recognized through the touch pad 135. The information output on both surfaces may be controlled by the touch pad 135. Alternatively, a display may be additionally mounted on the touch pad 135, and a touch screen may also be disposed on the rear case 102.

In addition, a camera 121 'may be additionally mounted on the rear case 102 of the terminal body. The camera 121 ′ may be a camera having a photographing direction substantially opposite to that of the camera 121 mounted on the front case and having different pixels from the camera 121.

For example, the camera 121 has a low pixel so that the user's face is photographed and transmitted to the counterpart in case of a video call, and the camera 121 'photographs a general subject and does not transmit it immediately. Many can be made to have a high pixel. The camera 121 'may be installed in the terminal body 100 to be rotatable or pop-up.

A flash 123 and a mirror 124 are further disposed adjacent to the camera 121 '. The flash 123 shines light toward the subject when the subject is photographed by the camera 121 '. The mirror allows the user to see his / her face or the like when the user wants to photograph himself (self-photographing) using the camera 121 '.

The sound output unit 252 'may be further disposed on the rear surface of the terminal body. The sound output unit 252 ′ may implement a stereo function together with the sound output unit 252 (see FIG. 2A), and may be used to implement a speakerphone mode during a call.

The terminal body is equipped with a power supply unit 190 for supplying power to the mobile terminal 100. The power supply unit 190 may be embedded in the terminal body or may be directly detachable from the outside of the terminal body.

The rear case 102 may be further equipped with a touch pad 135 for sensing a touch. Like the display unit 151, the touch pad 135 may also be configured to have a light transmission type. In this case, if the display unit 151 is configured to output visual information from both sides, the visual information may be recognized through the touch pad 135. The information output on both surfaces may be controlled by the touch pad 135. Alternatively, a display may be additionally mounted on the touch pad 135, and a touch screen may also be disposed on the rear case 102.

The touch pad 135 operates in association with the display unit 151 of the front case 101. The touch pad 135 may be disposed in parallel to the rear of the display unit 151. The touch pad 135 may have the same or smaller size as the display unit 151.

In addition, in the mobile terminal according to an embodiment of the present invention, which may include at least one or more of the components as described above, as shown in FIG. 2C, a camera in which a plurality of lenses are arranged along a plurality of lines. And may include 121. As such, a camera in which a plurality of lenses is arranged may be referred to as an 'array camera'. As shown, in the array camera, a plurality of lenses may be arranged in a matrix form.

In the array camera, the plurality of lenses may be arranged on a plane, or may be arranged on a curved surface. In addition, the plurality of lenses may be arranged on a curved surface concave formed into the rear case 102 of the mobile terminal 100, or may be arranged on a curved surface formed convexly outside the rear case 102.

2D and 2E show an example of such an array camera 121.

First, referring to FIG. 2D, as shown in FIGS. 2D and 2B, the plurality of lenses may be arranged along a curved surface in which a plurality of lines in either the horizontal or the longitudinal direction are concave. have. Also, as shown in (c) of FIG. 2C, the plurality of lenses may be arranged along a curved surface, that is, a spherical surface, in which all of the plurality of lines in the transverse direction or the longitudinal direction are concave.

As described above, when a plurality of lenses are arranged in a curved surface, photographing angles of photographing a subject from each lens may be different. For example, in the case of (a) of FIG. 2D, the longitudinal photographing angles of the lens a 211 and the lens b 212 are the same, but the angles of the lens c 213, the lens a 211, and the lens b 212 are different. The photographing angle in the longitudinal direction may be different. In addition, in the case of (c) of FIG. 2C, the lens a 211 and the lens c 213 have the same photographing angles in the lateral direction, but the lens b 212 and the lens a 211 and the lens c 213 have the same angle. The photographing angle in the lateral direction may be different.

In addition, when a plurality of lenses are arranged along a plurality of lines concave in a spherical shape as shown in (c) of FIG. 2D, the lateral and vertical photographing angles of all the lenses may be different from each other. Therefore, the controller 180 can take a plurality of images taken from different angles, and the plurality of images can be used to synthesize a new image changed based on a user's selection.

Similar to that shown in FIG. 2D, the plurality of lenses may be arranged along a plurality of lines formed of convex curved or spherical surfaces. 2E illustrates this example.

As in FIG. 2D, even when a plurality of lines are formed on the convex curved surface or the spherical surface, the photographing angles of photographing the subject from each lens may be different from each other. However, in the case of FIG. 2D, the plurality of lenses are arranged in a concave shape, so that the shooting angles of the lenses converge toward a specific subject. In FIG. Abrasive angles of the lenses may be in a radiated form.

The arrangement of the plurality of lenses illustrated in FIG. 2D or 2E is merely an example of a lens array of an array camera that may be formed in a curved or spherical surface, but the present invention is not limited thereto. That is, a plurality of lenses may be arranged in the array camera in various manners not shown in FIGS. 2D and 2E, and of course, the present invention may be applied.

 3 is a flowchart illustrating a method of generating one moving picture data using a plurality of images received through a plurality of lenses in a mobile terminal according to one embodiment of the present invention.

Referring to FIG. 3, the controller 180 receives an image through a plurality of lenses according to a user's selection (S300). Herein, the image may be received when a function for capturing an image is executed or the camera 121 is activated. The function for capturing the image may be executed when the camera application is activated. The camera application may be activated when an icon (or graphic object) of a camera-related application output on the display unit 151 is selected.

In addition, when the function for capturing the image is executed (or the camera 121 is activated), the controller 180 may receive an image through all of the plurality of lenses when the camera 121 is activated according to the camera related setting information. The image may be received through at least one of the plurality of lenses. Hereinafter, an embodiment in which an image is received through all the lenses arranged in the camera will be described.

Meanwhile, as described in operation S300, when images are received through a plurality of lenses, at least one of the received images may be output on the display unit 151 in a predetermined arrangement (S302). For example, the controller 180 may display an image received from any one of the plurality of lenses selected by the user on the entire screen on the display unit 151.

Alternatively, the controller 180 may arrange the plurality of images to correspond to the position where the lens is disposed. For example, an image received through the 16th lens 211 may be output at a position corresponding to the 16th lens 211 among the plurality of lenses disposed on the camera 121. In this manner, the controller 180 may arrange images received from each lens and output the images on the display unit 151 so as to correspond to the positions where the lenses are disposed. That is, the images may be output on the display unit 151 according to a preset arrangement such that the plurality of lenses correspond to the order in which the plurality of lenses are arranged in the camera 121.

Accordingly, the controller 180 may divide the display unit 151 into a plurality of areas so as to correspond to the number of lenses, and output one of the images received through the plurality of lenses for each of the plurality of areas. have. For example, when the number of lenses is 16, the controller 180 may divide the display into 16 regions and output different images to the 16 divided regions. The different images may be images received through different lenses, respectively.

Meanwhile, in step S302, the images output on the display unit 151 may be preview images. Here, the 'preview image' may be simply images received through a plurality of lenses before a photographing request for capturing an image received through the camera 121 is received. In this case, the preview image may not be stored in the memory 160 until the photographing request is received. Accordingly, the preview image may be changed as the focus of the camera is changed, and thus the image output on the display unit 151 may be changed in real time.

As described above, when an image photographing request is received while the images input through the plurality of lenses are output on the display unit 151, the images received through the plurality of lenses may be photographed in response (S304). Here, "shooting" may mean storing images, which are input through a camera (or a lens), in the memory 160 at a point in time at which a photographing request is received or corresponding to the point in time.

When the plurality of images are stored in the memory 160, a step of generating one moving picture data using the images captured from at least two of the plurality of images based on a user's selection may be performed (S306). have.

In addition, the steps S304 and S306 may be a step in which any one video data is generated by sequentially photographing at least two of the plurality of lenses in the order selected by the user.

For example, in step S304 and S306, the controller 180 captures an image received from one lens until the user selects another lens, and when the user selects another lens, the controller 180 selects the selected lens. An image received from a lens may be photographed next to an image photographed through one of the lenses to generate one video data. Alternatively, the controller 180 may photograph an image received from a lens having a different focal point following the captured image while the image is captured from one lens according to a user's selection.

4A and 4B are conceptual views illustrating an example of generating video data in step S306. For convenience of explanation, the screens shown in FIGS. 4A and 4B are examples in which an image received from nine lenses among a plurality of lenses is output on the display unit 151. Here, the number of images output on the display unit 151 may be changed depending on the user's selection, the preset screen size of the display unit 151 or the number of the plurality of lenses. to be.

First, referring to FIG. 4A, an example of displaying images received from a plurality of lenses is displayed on the display unit 151. In this state, as shown in (b) of FIG. 4, the user selects an image received from at least two lenses (eg, 1 and 9), and selects one image from the selected lenses. Video data can be generated.

Herein, when the lens 1 is selected by the user, the controller 180 may photograph the image 400 received from the lens 1 until the lens 9 is selected. When the lens 9 is selected, the image 402 received by the lens 9 may be captured after the image captured by the lens 1. Therefore, in this case, one video data including an image taken from lens 1 until the time before lens 9 is selected and an image taken from lens 9 from the time after lens 9 is selected may be generated. have. That is, the images 410 and 412 constituting the moving image data may be images received from different lenses based on a time point at which another lens is selected, that is, a time point at which lens 9 is selected.

Alternatively, in step 306, the controller 180 may generate video data in an arrangement order by arranging at least two images from among images stored in the memory 160 according to a user's selection. In this case, as shown in FIG. 4A, the controller 180 may output a plurality of images captured by each of the plurality of lenses on the display unit 151.

In addition, among the images output on the display unit 151, at least two images according to a user's selection may be arranged to generate one moving image data. 4B illustrates this example.

Referring to FIG. 4B, when the user selects the image 400 photographed by the first lens, and then selects the image 402 photographed by the 9th lens, the controller 180 controls the first lens. One video data may be generated after the image 400 captured by and the image 402 taken by the lens 9. That is, the video data may be generated including an image 410 captured by lens 1 and an image 412 photographed by lens 9, and the order of images included in the video data may be selected by a user. Of course, it can be changed as much as possible.

In addition, in step 306, the controller 180 replaces a part of the display area of the image photographed by one lens with a part of the display area of the image photographed by the other lens, thereby generating moving image data in which at least two images are synthesized. You may.

4C and 4D are conceptual views illustrating an example of generating moving image data in step S306 in this case.

As described above, the plurality of lenses of the present invention may be formed along a plurality of lines formed of convex or concave curved surfaces. In this case, the plurality of lenses may photograph the same subject at different focal angles. In this case, the controller 180 may replace a part of the display area of the image photographed by one lens with a part of the corresponding display area of the image photographed by the same subject at different focal angles according to a user's selection.

For example, as shown in FIG. 4C, the controller 180 may output the graphic objects 450 and 452 on the screen in response to the user's selection. When any one of the graphic objects is selected, a portion of the image photographed by the focal angle corresponding to the graphic object may be replaced by a portion of the image photographed by the one lens.

4D illustrates this example.

For example, when the focal angle of one of the lenses is the front of the subject, an image of the front of the subject as shown in FIG. 4C may be output on the screen. When a portion of the display area of the output image is selected 454 according to a user's selection, graphic objects 450 and 452 may be output.

If one of the graphic objects 450 and 452, for example, the graphic object 452 is selected, the controller 180 displays the display of the portion 454 selected by the user in FIG. 4C. As shown in (d) of FIG. 4, the image of the region may be replaced with a portion 456 of the display area of the image photographed at the focal angle corresponding to the graphic object 452.

Hereinafter, in the mobile terminal according to an exemplary embodiment of the present invention, by using a plurality of images received or photographed through a plurality of lenses, video data that is arranged according to a user's selection or a portion thereof is synthesized with another image is generated. How to do this will be described in more detail with reference to the drawings.

FIG. 5 is a conceptual diagram illustrating an example in which images received through a plurality of lenses are edited and photographed according to a user's selection in a mobile terminal according to an embodiment of the present disclosure.

As described above, the mobile terminal 100 according to an embodiment of the present invention may output images received from each of the plurality of lenses on the display unit 151. The images output on the display unit 151 may be preview images. That is, the images output on the display unit 151 may be images that are not stored in the memory 160.

In addition, a portion of the display unit 151 of the mobile terminal 100 according to an embodiment of the present invention may be provided with a region for displaying a progress bar for notifying the shooting state of the currently generated video data. . Here, the progress bar may be formed in the form of a graphic object such as a bar graph or a similar type of graph. Alternatively, the progress bar may be configured to display images included to generate the video data. In this case, the progress bar may be divided into a plurality of sections based on the number of lenses used for capturing the images forming the moving image data, and the image forming the moving image data or the preview of the images are included in each section. An image may be output.

FIG. 5A illustrates an example of the display unit 151 including images received from each of the plurality of lenses and an area 550 for displaying the progress bar.

As shown in (a) of FIG. 5, in the state where the preview images are output, the controller 180 can detect a user's input to any one of the images. For example, as shown in FIG. 5A, the controller 180 may divide the display unit 151 into a plurality of areas, and output images received from different lenses for each area. When the user selects any one of the images displayed on the display unit 151, the controller 180 may determine that the photographing of the lens corresponding to the image is selected. In this case, the user's selection may be performed when a user's touch input is detected in an area in which one of the images displayed on the display unit 151 is displayed.

5B illustrates this example. Referring to FIG. 5B, when the user selects the image 500 captured by the first lens, the controller 180 may determine that the first lens is selected. In addition, the controller 180 may start capturing an image received from the selected first lens. In the area 550 for displaying the progress bar, as shown in FIG. 5B, an image 510 captured by a lens selected by a user may be displayed on the progress bar.

The controller 180 may continue capturing an image received from the first lens until the user selects another lens. If the user selects a lens that is different from the currently selected lens, that is, the first lens, the user may take an image received from another lens selected by the user following the image currently being photographed.

FIG. 5C illustrates this example. Referring to FIG. 5C, FIG. 5C illustrates a case in which a user selects an image 502 received by lens 5 after selecting an image 500 received by lens 1. It is assumed.

In this case, when the image 502 received by the lens 5 is selected, the controller 180 may determine that the user has requested to photograph the image received by the lens 5. If the lens for which the current image is requested by the current user is a different lens from the previously selected lens, the controller 180 ends the recording of the image received from the previously selected lens, and the newly requested lens is photographed. You can take a picture received from. Herein, the controller 180 may capture an image received from a lens that is newly requested to be photographed after an image photographed from a previously selected lens. Accordingly, the video data may be generated based on a time point when the lens 5 is selected, and the video data including the image photographed by the lens 1 before and the image photographed by the lens 5 after that.

In addition, the photographing state of the moving image data may be displayed through a progress bar. For example, in the above case, the image 512 captured by the lens 5 may be output after the image 510 photographed by the lens 1 in the area 550 where the progress bar is displayed. The image 510 captured by the lens 1 or the image 512 captured by the lens 5 may be output to an area 550 in which the progress bar is displayed in the form of a preview image.

Meanwhile, although the lens may be changed and photographed according to the order selected by the user in order to generate video data, an image captured by a specific lens may be inserted at a specific point in time of the already captured video data according to the user's selection. Of course you can.

For example, the controller 180 photographs an image received from a lens selected by the current user until another lens is selected or generation of video data is finished, and the controller 180 selects a user from among images forming the video data. The photographed image may be inserted between the two images. In this case, the controller 180 may arrange the inserted image between the two images according to the user's selection and generate the video data in the arrangement order.

FIG. 5D illustrates this example. Referring to FIG. 5D, when the image 504 received by the seventh lens is selected by the user, the controller 180 may determine that photographing of the image received from the seventh lens is requested. In addition, the controller 180 may touch and drag the image 504 received from the lens 7 from the user to be located between the images 510 and 512 output in the region 550 for displaying the progress bar. When the input is detected, it may be determined that the insertion of the image photographed by the lens 7 is selected between the images 510 and 512 of the video data.

In this case, the controller 180 captures an image received by the seventh lens, and receives the image received through the seventh lens following a time point when the image 510 captured by the first lens of the image forming the video data ends. Shoot the video. When the user selects a lens different from the currently selected lens or terminates the generation of the video data, the recording of the image received by the lens 7 is terminated and the image captured by the lens 7 is terminated. The image 512 captured by the 5th lens of the image data is connected.

Therefore, the video data may be followed by an image 514 captured by lens 1 followed by an image 514 photographed by lens 7 and a video captured by lens 5 subsequent to image 514 photographed by lens 7. The image 512 may be generated in a continuous form. Accordingly, in the region 550 where the progress bar is displayed, a generation state of the moving image data into which the image 514 captured by the lens 7 is inserted is output between the images 510 and 512 forming the moving image data. have.

In FIG. 5D, a case in which an image captured by a specific lens is inserted is described. However, at least one of images output in the region 550 where a progress bar is displayed according to a user's selection is deleted. Of course you can. In this case, the controller 180 may generate video data by connecting the images before and after the deleted image to each other. That is, the controller 180 may generate moving image data in the area 550 in which the progress bar is displayed, according to the arrangement of the captured images to form the moving image data, and the arrangement of the images may be performed by the user. It can be changed according to your choice.

As shown in (d) of FIG. 5, the controller 180 may insert an image captured by a specific lens between the arrays of the images or delete at least one of the arranged images. Insertion or deletion of such an image may be performed by a user directly selecting (for example, touching an image received or photographed by a specific lens) or by changing the position of the mobile terminal 100.

For example, when the user shakes the mobile terminal 100 at a predetermined number of times or at an intensity greater than or equal to a preset intensity, the arrangement order of the images may be changed. For example, when the user shakes the mobile terminal 100, the images arranged in the area 550 in which the progress bar is displayed may be arranged in ascending or descending lens order.

In addition, when the user moves or rotates the mobile terminal 100 in one of up, down, left, and right directions, one of the lenses is selected according to the moving direction, the rotating direction, and the degree of movement of the mobile terminal 100. Can be done.

For example, the controller 180 may detect a position change or rotation of the mobile terminal 100 using an acceleration sensor, an inertial sensor, a gyro sensor, or the like. In addition, the controller 180 may determine that any one lens is selected by the user according to the degree of change of the position or the degree of rotation of the direction in the direction corresponding to the changed direction or the rotated direction.

In addition, when one lens is selected according to the moving direction, the rotation direction, and the moving degree of the mobile terminal, the controller 180 may follow the image photographed from the previously selected lens, and then, from the lens selected according to the moving direction or the moving degree. Video data may be generated by photographing the received image.

For example, as described above, a lens different from the currently selected lens may be selected by using a position change or rotation of the mobile terminal 100, thereby generating moving image data including an image captured from at least two lenses. You may.

6A is a diagram illustrating this example.

When a specific lens is selected by the user, the controller 180 may determine that the photographing of the image received from the selected lens is requested. For example, when a lens for receiving a front image of the subject 600 is selected, an image as shown in FIG. 6A (a) may be output on the display unit 151.

In this state, when the user rotates the mobile terminal 100 to a right by a predetermined angle (for example, about 45 degrees, or when the user moves the mobile terminal 100 to the right by a predetermined distance or more, the controller 180 The sensor may detect a rotation or a change of position of the mobile terminal 100 through an inertial sensor, an acceleration sensor, etc. The controller 180 may be any one of a plurality of lenses based on the rotated state or the changed position. Here, the controller 180 selects a lens corresponding to the rotated angle or the rotated time in the rotated direction, or corresponds to the distance or the changed time of the location in the changed direction. You can choose the lens to be.

When a specific lens is selected according to the rotated state or the position change state, the controller 180 may end the image capturing state of the lens that was capturing the image before the selection. The camera may start capturing an image received from the selected lens according to the rotated state or position change. The captured image may be output on the display unit 151 as shown in (b) of FIG. 6A.

Referring to FIG. 6A (b), it can be seen that an image in which the subject 600 is rotated by a predetermined angle is output on the display unit 151. This is because it is assumed that the camera 121 of the mobile terminal 100 according to the embodiment of the present invention has a plurality of lenses arranged along a plurality of lines formed in a curved surface. Therefore, due to the characteristics of the lenses arranged in a curved surface, each lens has a different shooting angle, and accordingly, when different lenses are selected, moving image data including images captured at different focus angles may be generated.

For example, the video data generated in the case of FIG. 6A (b) is based on a point in time at which the user rotates or changes the position of the mobile terminal 100, and the image photographed from the front angle of the subject 600 before that. After the reference time point, the object 600 may include an image photographed at an angle rotated by a predetermined angle from the right side.

On the other hand, if (b) of Figure 6a is assumed to be selected when the lens corresponding to the left or right rotation or to move in the left and right direction, Figure 6a (c) is to rotate the mobile terminal 100 in the forward or backward direction In this case, it is assumed that a lens corresponding to the lens is selected when the lens is moved in the vertical direction. Accordingly, when the user rotates the mobile terminal 100 in the forward direction, that is, tilts the mobile terminal 100 more than a predetermined angle in the front direction, or moves the mobile terminal 100 more than a predetermined distance in the upward direction, as shown in (c) of FIG. 6A. As shown, the image photographed from the upper part of the subject 600 by a predetermined angle may be output on the display unit 151.

Meanwhile, the controller 180 of the mobile terminal 100 according to an exemplary embodiment of the present invention generates the video data by selecting a specific focus angle from a user and then photographing an image received from a lens corresponding to the selected focus angle. Of course you can.

For example, the controller 180 may photograph an image received from one of a plurality of lenses and output the captured image on the display unit 151. When the specific focus angle is selected by the user, the image capturing of the lens capturing the current image is terminated, and the image received from the lens corresponding to the focus angle selected by the user may be captured after the image photographed to date.

Herein, the controller 180 can receive a specific focus angle directly from the user through a keypad or jog key. Unlike this, however, when the user selects a specific subject included in the image output on the display unit 151, the controller 180 may determine that the lens focused on the subject is selected.

FIG. 6B is a conceptual diagram illustrating an example of generating moving image data from a lens for receiving an image of a subject at different focal points in a mobile terminal according to an embodiment of the present disclosure.

Referring to FIG. 6B, as shown in FIG. 6B, the controller 180 captures an image received from any one of a plurality of lenses and outputs the captured image to the display unit 151. Can be.

As shown in (b) of FIG. 6B, at least a portion of the area on the display unit 151 that outputs the image 650 of a specific subject may be selected by the user. For example, the controller 180 determines that the specific subject 650 is selected when a user's touch input or touch and drag input is detected in the area of the display unit 151 where the specific subject 650 is output. Can be.

If it is determined that a specific subject is selected by the user, the controller 180 may select a lens focused on the specific subject 650 of the plurality of lenses. In addition, the controller 180 finishes capturing an image of a lens capturing an image currently output on the display unit 151, and captures an image received from a lens focused on the specific subject 650. The current image is output on the display unit 151.

FIG. 6B (c) is a diagram illustrating such an example. Referring to (c) of FIG. 6B, it can be seen that the subject 650, which is offset to the right and is output from (a) and (b) of FIG. 6B, is output from the center portion of the display unit 151. This is because the user selects the subject 650 in FIG. 6B (b), and a lens focused on the subject 650 is selected, and an image received from the lens is output on the photographing and display unit 151. Because

As described above, the controller 180 of the mobile terminal 100 according to an exemplary embodiment of the present invention is based on a point in time at which a specific subject included in the image output to the display unit 151 is selected by the user, to the image photographed up to that point. Subsequently, one video data may be generated by photographing an image received from a lens focused on the selected subject. Accordingly, the video data may include images captured from at least two lenses having different focal angles based on a viewpoint selected by a user.

Meanwhile, in the above-described embodiments, at least one of the images received from each of the plurality of lenses is output on the display unit 151 and received from the selected lens when a photographing request is requested, that is, when one lens is selected. It has been described on the assumption that the image is taken. Unlike this, however, it is also possible to generate one moving picture data using the already taken images.

FIG. 7 is a diagram for one example of generating one moving picture data by editing an image photographed from a plurality of lenses in a mobile terminal according to one embodiment of the present invention.

The controller 180 may output a plurality of images photographed from the plurality of lenses according to a user's selection, to the plurality of regions partitioned on the display unit 151, respectively. Here, instead of the plurality of images, thumbnail images generated from each of the plurality of images may be output.

When the image (or thumbnail image) output to any one of the plurality of regions is selected by the user, the controller 180 may output the result to the region 550 in which a progress bar for indicating the generation state of the video data is displayed. have.

7A illustrates this example. Referring to FIG. 7A, when the image 700 photographed by the first lens is selected by the user, the controller 180 captures the image 700 captured by the first lens in an area 550 in which the progress bar is displayed. ) Can be printed.

Herein, the controller 180 replaces an image that can represent the image 700 photographed by the first lens, instead of the image 700 photographed by the lens 1, by the area 550 where the progress bar is displayed. You can also output The image that can represent the image 700 photographed by the first lens may be a thumbnail image generated from the image photographed by the first lens.

When the user selects an image photographed by another lens, the controller 180 may generate one video data by connecting the selected image to the image 700 photographed by the first lens. 7B illustrates this example.

Referring to FIG. 7B, when the user selects the image 702 photographed by the fifth lens while the image 700 photographed by the first lens is selected, the controller 180 may perform the process. In the area 550 where the bar is displayed, an image 700 (or a thumbnail image) photographed by the first lens may be output followed by an image 702 (or a thumbnail image) photographed by the fifth lens. The controller 180 may generate one video data by arranging images or thumbnail images in the progress bar region 550 in the order in which the images or thumbnail images are arranged. Therefore, as shown in (b) of FIG. 7D, the video data may be generated in a form in which an image 700 photographed by the lens 1 is followed by an image 702 photographed by the lens 5.

As shown in (a) and (b) of FIG. 7, the controller 180 may generate one video data by arranging and connecting images photographed from the plurality of lenses in an order according to a user's selection. By the way, in the case of the image already taken, it is also possible to generate video data by extracting only a part of the image of the image taken according to the user's selection.

For example, when the user selects any one of the images photographed from the plurality of lenses, the controller 180 may display a graphic object for selecting a portion of the selected photographed image from the user around the selected image. have. The controller 180 may extract a part of the image selected through the graphic object from the captured image. The extracted image may be included as one of the images forming the video data.

7 (c) and 7 (d) show this example.

Referring to FIG. 7C, when the user selects the image photographed by the 9th lens, the controller 180 selects the graphic object 710 for selecting at least a portion of the selected photographed image. (For example, an image taken by lens 9).

The controller 180 may select only a part of the currently selected captured image from the user using the graphic object 710, and extract the selected portion. According to at least one portion of the photographed image, the controller 180 may be configured according to a user's touch and drag input while the graphic object 710 is displayed or a user's touch with respect to any point of an area where the graphic object 710 is displayed. You can choose some. Alternatively, at least a portion of the captured image may be selected in response to the separate graphic object 720 being moved around the graphic object 710.

In addition, a portion of the image determined according to a user's touch and drag input or a touch on a specific point may be displayed on the graphic object 710 as shown in FIG. 7C.

In addition, the graphic object 710 may be for receiving a specific time interval. For example, the graphic object 710 may be related to a reproduction time of an image photographed by the lens 9. In this case, as shown in FIG. 7C, the controller 180 reproduces the image photographed by the 9th lens by touching and dragging an input or touching a point of an area where the graphic object 710 is displayed. You can select a time interval for some of the time. A portion of the image photographed by the lens 9 may be selected corresponding to the selected portion of time.

If a part of the captured image is selected through the graphic object 710, the controller 180 extracts the selected partial image from the captured image. The extracted image may be arranged together with other images output to the area 550 where the progress bar is displayed.

Meanwhile, the extracted part of the image may be displayed as a part of the image by displaying differently from other images output in the area 550 in which the progress bar is displayed. For example, as shown in FIG. 7D, the controller 180 displays a section of the region 550 in which the progress bar is displayed in which the extracted part of the image is displayed, shorter than a section in which other images are displayed. can do.

Here, the length of the shortly displayed section may be proportional to the reproduction time of the extracted partial image. For example, if the reproduction time of the other images constituting the moving picture data is 30 minutes, while the reproduction time of the extracted partial images is 20 minutes, the length of the shortly displayed section is as shown in (d) of FIG. It may also be 2/3 of the length of the section in which other images are displayed.

The controller 180 may change the arrangement order of other images constituting the moving image data, including the extracted partial image according to a user's selection. For example, the controller 180 may display an image of all or part of the image photographed by a specific lens as shown in FIG. 7D according to a user's selection, and the image displayed on the area 550 in which the progress bar is displayed. Can be inserted between them. Alternatively, the controller 180 may delete at least one of the images including the extracted partial image according to a user's selection.

In addition, as described above, even when the user shakes the mobile terminal 100 at a predetermined number of times, or at a strength greater than or equal to a predetermined intensity, the arrangement order of the images may be changed, due to a change in the position of the mobile terminal 100. In this case, the arrangement order may be changed as much as possible.

In the above description, at least two captured images are sequentially connected to each other in time, and thus generating one moving image data is described in detail with reference to the accompanying drawings. However, in addition to such time-series synthesis, the display area of at least two captured images may generate video data synthesized with each other.

 In this case, the display area is the moving image data synthesized with each other, and the plurality of images constituting the at least two images are moving image data including image images in which the display regions of the image are synthesized with each other.

In this case, the respective corresponding images may be determined according to, for example, a time at which the image is photographed. In general, in the case of an array camera having a plurality of lenses, photographing starts and ends simultaneously from the plurality of lenses under the control of a user, so that images captured by each of the plurality of lenses may be simultaneously captured at the same time point. have. Therefore, the images constituting the respective images may correspond to the images of the other images according to the shooting time.

 As an example, when there are two images, A and B, when the images A and B each consist of 10 images taken at 0.1 second intervals, the first image forming the image A is the first image forming the image B. The second image may correspond to the second image, and the second image constituting the image A may correspond to the second image constituting the image B. FIG.

In this case, the display area of the first image constituting the image A and the second image constituting the image B may be synthesized with each other, and thus the image composed of the images generated by synthesizing the display regions of the corresponding images, respectively. The display area is referred to as a synthesized image.

8A and 8B are diagrams illustrating an example of generating an image obtained by synthesizing a display area using images received through a plurality of lenses in a mobile terminal according to an embodiment of the present invention. Hereinafter, for the convenience of description, it will be assumed that the number of lenses provided in the camera 121 is four.

As described above, in the mobile terminal 100 according to the embodiment of the present invention, a plurality of lenses may be arranged in a plurality of lenses. In this case, as shown in FIG. 8A, since the plurality of lenses are arranged in different positions, the images captured by the lenses may be different from each other.

In this case, images taken from each of the plurality of lenses, that is, as shown in (a), (b), (c) and (d) of FIG. exist. In this case, the controller 180 may distinguish a portion that is different from a common portion from each of the images (for example, (a), (b), (c), and (d) of FIG. 8A).

In addition, the controller 180 may synthesize the difference parts based on a common part. For example, when the controller 180 synthesizes the display areas of the images photographed by each lens in the order of (a), (b), (c), and (d) of FIG. The remaining parts may be synthesized based on the areas 800a, 800b, 800c, and 800d on which the image is displayed.

That is, in the case of the image shown in (a) of FIG. 8A, the remaining portion 802 except for the common portion 800a may be used for synthesizing the display area. In the case of the image shown in FIG. 8A (b), the remaining portion 804 except for the common portion 800b and the portion 802a overlapping the portion (802) of FIG. 8A may be used for synthesizing the display area. In the case of the image shown in FIG. 8A (c), the remaining portion 806 except for the common portion 800c and the portion 804a overlapping the portion (804) of FIG. 8A may be used for synthesizing the display area. In the case of the image shown in (d) of FIG. 8a, the common portion 800d and the remaining portions 808 except for the portions 802a 'and 806a overlapping with (a) of FIG. 8a and (c) of FIG. 8a are displayed. It can be used for the synthesis of regions.

Thus, as shown in (e) of FIG. 8A, each of the plurality of lenses in which different portions 802, 804, 806, and 808 are synthesized around the common portions 800a, 800b, 800c, and 800d. Video data obtained by synthesizing the display area of the captured image may be generated.

Meanwhile, in FIG. 8A, the display area is synthesized by synthesizing the display areas of the images taken from all the plurality of lenses. Alternatively, the display area is synthesized using only images captured by some lenses selected by the user. Of course, video data can also be generated.

8B illustrates this example.

Referring to FIG. 8B (a), the controller 180 may receive at least two of the plurality of lenses output on the display unit 151 from the user. For example, as shown in FIG. 8B, when the image 850 captured by the first lens and the image 852 photographed by the second lens are selected, the controller 180 displays the images of the images captured by the two selected lenses. Only regions can be synthesized.

In addition, the image in which the display area is synthesized may be generated by other methods besides the above-described method. For example, the controller 180 determines a reference based on any one of a plurality of captured images, and the difference between the respective images forming the image determined based on the reference from the respective images forming the captured images not determined as the reference. May be extracted for each corresponding image. In addition, an image (image of a difference part) including the extracted difference part images may be generated. The synthesized image of the difference part may be synthesized around the captured image determined as the reference to generate the synthesized image of the display area.

8B (b) is a diagram illustrating an example of an image obtained by synthesizing the display area generated through this process.

(B) of FIG. 8B is determined according to the arrangement of the lens around the captured image (the image 850 captured by the first lens) determined as a reference, that is, the lens photographing the image determined as the reference, and the lens that is not the reference. An example in which an image obtained by synthesizing an image 860 of the difference portion under a location, that is, a captured image determined as a reference, is output on the display unit 151. As such, the mobile terminal 100 according to an embodiment of the present invention synthesizes a display area of an image photographed by at least two lenses determined by a user's selection of a plurality of lenses, thereby generating moving image data having an extended display area. To be possible.

The display area may be synthesized in various forms. For example, as shown in FIGS. 8A and 8B, the display area may be synthesized to expand the display area by synthesizing the entire display area of the captured image. Synthesis of the display area may be made to replace some of them.

FIG. 9 illustrates an example of synthesizing a part of an image photographed by a specific lens into a part of an image photographed by another lens according to a user's selection in the mobile terminal according to an embodiment of the present disclosure.

Referring to FIG. 9A, FIG. 9A illustrates an example in which the user selects a part of the subject 900, that is, the head 910. That is, as shown in (a) of FIG. 9, the user touches the head 910 of the subject 900 or the head 910 of the subject 900 on the screen on which the subject 900 is displayed. When the user's touch and drag input is detected in the displayed area, only the head portion 910 of the subject 900 may be selected as shown in FIG. 9A.

In this case, the controller 180 may display at least one graphic objects 902 and 904 for receiving a selection of another captured image to replace the selected partial display area around the selected partial display area. These graphic objects 902 and 904 may be implemented in various forms. For example, it may be implemented in the form of a simple bar, or as shown in FIG. 9B, may be displayed as arrow-shaped objects for selecting a rotation direction of a portion of the subject.

In this case, the graphic objects 902 and 904 are displayed in the form of an arrow image for selecting a rotation direction, as shown in FIG. 9B, the rotation angle of the mobile terminal 100 according to an embodiment of the present invention. This is because when the camera 121 is composed of a plurality of lenses arranged in a curved surface, even if the same subject is photographed, the photographing angles of the camera 121 are different, so that an image photographed by another lens may appear as if the subject is rotated. Therefore, when the selected area is replaced by a part of the captured image photographed by another lens, the screen may be output on the display unit 151 as if the selected area is rotated according to the rotation angle selected by the user.

Therefore, when any one of the graphic objects 902 and 904 shown in FIG. 9B is selected, the image of the selected part of the region, ie, the head 910, corresponds to the rotation direction selected by the user. It may be replaced with a portion of an image photographed from any one of the lenses. That is, when the graphic object 902 displaying the rotation direction in the horizontal direction is selected, the controller 180 has a lens positioned in the horizontal direction based on the lens that currently photographs the image output on the display unit 151. Select the photographed image taken from any of these. Herein, the controller 180 selects one lens positioned in the horizontal direction from the lens currently set as a reference according to the time when the user touches the graphic object 902 or the drag input length after touching the graphic object 902. Can be.

When any one of the lenses is selected through the graphic object 902, the controller 180 may display some of the display areas selected by the user, that is, the head portion 910 of the subject 900 among the display areas of the image photographed from the selected lens. ) Corresponding to the displayed area can be selected.

That is, the controller 180 may display a portion of the display area in which the user selects a portion of the display area from a plurality of images forming a captured image (hereinafter, referred to as a composite target captured image) captured by the lens selected through the graphic object 902. Each of the corresponding parts may be selected.

The controller 180 selects a display area selected by the user from a plurality of images forming a captured image (hereinafter, referred to as a reference captured image) photographed from a lens selected based on a current reference, and selects the selected display area. The selected part may be replaced from the synthesized target captured image.

Herein, the controller 180 is configured to form the corresponding synthesized target captured image in the selected display area of each of the plurality of images forming the reference captured image, that is, the area of the head portion 910 of the subject 900. Each of the plurality of images may be replaced with an area of the head portion of the subject 900. Here, each of the plurality of images forming the captured image of the reference and each of the plurality of images forming the synthesis target photographing image may correspond to each other based on the photographing time.

9 (c) shows such an example. Referring to FIG. 9C, a screen in which the display area of the head portion 910 of the subject 900 selected by the user in FIG. 9A is rotated by a predetermined angle is displayed on the display unit 151. Can be output to

That is, for example, when the user touches the left side of the graphic object 902 or touches a point of the graphic object 902 and drags it to the left direction, the head portion 910 of the subject 900 selected by the user is The image rotated to the left may be output. This is because the controller 180 selects any one of the lenses positioned in the horizontal direction to the right of the lens selected as a reference according to the user's input through the graphic object 902. In addition, the controller 180 uses the image photographed from the selected lens as the synthesis target photographed image, and displays the subject 900 head portion 910 of the reference photographed image as a partial display region of the synthesis target photographed image. Can be substituted for

Accordingly, the head portion 910 of the subject 900 output on the display unit 151 is an image photographed in the right direction by a predetermined angle, that is, selected by the user in response to the user selecting a direction in which the user rotates to the left. By using an image photographed by a lens positioned in a direction opposite to the rotation direction, an image rotated in a left direction as shown in FIG. 9C may be output on the display unit 151.

Similarly, when the user selects the graphic object 904 displaying the rotation direction in the vertical direction, the image of the head portion 910 of the subject 900 is rotated in the vertical direction on the display unit 151. Can be output to That is, when the user selects the graphic object 904 displaying the rotation direction in the vertical direction, the controller 180 selects any one of the lenses in the vertical direction of the lens selected as the current reference.

For example, the controller 180 may detect that a user's touch is detected at a portion above the center of the area where the graphic object 904 is displayed or when a drag input of the user is detected at a point of the area where the graphic object 904 is displayed. When detected in the upward direction, one of the lenses arranged in the downward direction of the lens selected as the current reference may be selected. In this case, the controller 180 may use the length of the point where the user's touch is detected or the length of the user's drag input in the area where the graphic object 904 is displayed to select the one lens.

If any one of the lenses arranged in the vertical direction of the lens selected based on the current reference is selected, the controller 180 synthesizes the captured image photographed from the selected lens, as described above with reference to FIG. 9C. The display area in which the head 900 of the subject 900 of the reference captured image is output may be replaced with a partial display area of the synthesis target captured image as a captured image. 9D illustrates this example.

As shown in (d) of FIG. 9, in response to the user selecting a direction of upward rotation, an image photographed in a downward direction by a predetermined angle, that is, photographed by a lens positioned in a direction opposite to the rotation direction selected by the user. By using the image, an image in which the head portion 910 of the subject 900 output on the display unit 151 is rotated upward may be output on the display unit 151.

Accordingly, as shown in FIGS. 9C and 9D, a part of an image currently output to the display unit 151 may be replaced with a part of an image photographed at different photographing angles through composition of the display areas. In addition, the controller 180 may generate an image including the synthesized display area as video data.

Meanwhile, in the above description, when the user selects any one of the graphic objects 902 and 904, the display area of a part of the image photographed by one lens corresponding to the selected rotation direction is replaced. In addition, information related to replaceable images may be displayed around a portion of the area selected by the user.

For example, the controller 180 may extract images of a display area corresponding to a portion of the display area selected by the user from images taken by the lenses corresponding to the selected rotation direction. The controller 180 may generate a thumbnail image from each of the extracted images and display the thumbnail images around a portion of the display area selected by the user, that is, around the head portion 910 of the subject 900. If any one of the displayed thumbnail images is selected by the user, the controller 180 may replace an area in which the head portion 910 of the subject 900 is displayed with the extracted image corresponding to the selected thumbnail image. Of course.

Meanwhile, in FIG. 9, the display areas of different captured images are synthesized. However, the display areas may be synthesized based on a viewpoint selected by the user.

For example, the controller 180 may allow the display region to be synthesized only for an image after a point in time in which some of the images output on the display unit 151 are selected by the user. That is, the controller 180 may synthesize the display area only for images corresponding to a time after the user selects a part of the plurality of images forming the image output on the display unit 151. Of course, it can be done.

In this case, the controller 180 selects only the corresponding images after the point in time at which the user selects a portion of the plurality of images constituting the image photographed from the lens selected in response to the user's input. It can be used for the synthesis of. Therefore, in this case, the generated video data may be synthesized with only a part of an image captured by another lens after a certain point in time.

In addition, in the above description, although the display area is synthesized with respect to the image after a certain point in time, the user may select a time point at which the synthesis of the display area is terminated as well as after a certain point in time. For example, the controller 180 may terminate the synthesis of the display area when a touch input for a graphic object for selecting the end of the synthesis of the display area is detected while the display area is being synthesized. Therefore, the moving image data generated in this case may be synthesized with only a part of the image photographed by another lens.

Meanwhile, in the above description, a method of generating one video data using a plurality of captured images photographed from a plurality of lenses has been described. Alternatively, other video data previously stored in the memory 160 may be used. Of course.

FIG. 10 illustrates an example of displaying another image data on a display unit by using a feature point of a subject image selected by a user in a mobile terminal according to an embodiment of the present disclosure.

First, referring to FIG. 10A, the controller 180 may output an image photographed by any one of a plurality of lenses on the display unit 151. The controller 180 may select a region of a part of the image output on the display unit 151 in response to a user's touch input.

For example, when a user's touch and drag input is detected in one region on the display unit 151, the controller 180 selects one region on the display unit 151 corresponding to the detected user's touch and drag input. It can be recognized as. Alternatively, as shown in FIG. 10A, when the user's touch input is detected in one region of the display unit 151, the controller 180 may display the touch unit on the display unit 151 where the user's touch input is detected. It can be recognized that one region is selected.

Here, one region on the display unit 151 selected by the user's touch and drag or touch input may be a specific subject of an image currently output on the display unit 151 as shown in FIG. The display area may correspond to a portion 1000 of a specific subject.

In this case, the controller 180 extracts a feature point for the part 1000 of the subject selected by the user. For example, as shown in FIG. 10A, when a part of the subject selected by the user is the “face” of the subject, the controller 180 uses face recognition or the like to detect the “face” of the subject. "We can extract this feature point.

When a feature point of a part 1000 of a user-selected subject is extracted, the controller 180 may search whether there is an image including an image having the same feature point as the feature point among images stored in the memory 160. . For example, as described above, if a part of the subject selected by the user is the "face" of the subject, an image having a feature point of the "face" of the subject, that is, a face image similar to the "face" of the subject is included. The retrieved image may be retrieved from the memory 160.

The controller 180 may output the search result to at least a portion of the display unit 151 (hereinafter, referred to as a child view region) 1010. Figure 10 (b) shows this example.

Referring to FIG. 10B, a plurality of images may be output to the child view area 1010. Here, the plurality of images are images including at least one image having the same feature point as that of the part 1000 of the subject selected by the user among images stored in the memory 160.

Here, the plurality of images output to the child view area 1010 may include another image photographed after or before the time point at which the image currently output on the display unit 151 is photographed. It may be.

In addition, in the child view area 1010, instead of directly outputting the plurality of images, a representative image (for example, a thumbnail image) generated from the plurality of images may represent each of the plurality of images. It may be output instead.

The controller 180 may select any one of a plurality of images output to the child view area 1010 in response to a user's selection. In addition, the controller 180 may reproduce only one selected image among the images included in the child view area 1010 and output the remaining images on the display unit 151 in a stopped state.

Herein, if any one of the images output on the child view area 1010 is selected by the user, the controller 180 receives a selection of a time interval at which the selected image is to be played, that is, a point at which playback starts and a point in which playback ends. The graphic object may be output around one of the images of the child view area 1010 selected by the user. FIG. 10C illustrates this example.

Referring to FIG. 10C, when any one 1020 of the images output to the child view area 1010 is selected, the controller 180 displays the graphic object 1030 as one of the images (see FIG. 10C). 1020) can be output around. The controller 180 may determine a time interval at which any one image 1020 is to be played based on a user's touch input or touch and drag input with respect to the graphic object 1030. The controller 180 may play the one image 1020 in the child view area 1010 based on the determined playback start time and playback end time.

Also, as described above, the plurality of images output from the child view area 1010 are images including at least one image having the same feature point as the portion 1000 of the subject selected by the user. Therefore, the controller 180 may extract a portion of the display area having the same feature point from the plurality of images output from the child view area 1010.

For example, the controller 180 detects images having the same feature point from the plurality of images output from the child view area 1010, and extracts only some areas having the same feature point from the detected images. It may be. And, of course, the image may be generated using only some of the extracted regions.

In addition, the controller 180 may replace the image generated by the extracted partial regions of the image instead of the portion 1000 of the subject selected by the user output on the display unit 151. to be. Accordingly, the controller 180 may generate video data by replacing a part of the display area of the image currently output on the display unit 151 as a part of the display area of other images having the same feature point through the synthesis of the display area. It may be.

Meanwhile, in the above description, although some of the images pre-stored in the memory 160 have been described as an example, alternatively, some of the images stored in an external server such as a cloud server may be selected.

On the other hand, those skilled in the art to which the present invention belongs will be able to various modifications and variations without departing from the essential characteristics of the present invention. Therefore, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited thereto. The protection scope of the present invention should be interpreted by the following claims, and all technical ideas within the equivalent scope should be interpreted as being included in the scope of the present invention.

In addition, according to one embodiment disclosed herein, the above-described method may be implemented as code that can be read by a processor in a medium in which a program is recorded. Examples of processor-readable media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and may be implemented in the form of a carrier wave (for example, transmission over the Internet). Of course, it may include.

Claims (22)

A display unit;
A camera in which a plurality of lenses are arranged at different positions along a plurality of lines and photographing a video of a subject having different focal angles; And
And a controller configured to receive images through the plurality of lenses, and control the plurality of lenses to capture a video by using the received images.
The controller may generate one moving image data by using an image received from a first lens among the plurality of lenses and an image received from at least one second lens different from the first lens, and from the first lens. Generating one video data by replacing a part of the subject of the display area of the first video photographed with a part of the display area of the second video of the subject photographed from the second lens,
And a focal angle of a portion of the subject of the display region of the photographed first video is different from a focal angle of a portion of the display region of the second video of the subject photographed from the second lens. The method of claim 1, wherein the control unit,
Outputting images received from the plurality of lenses to the display unit,
And when one of the received images is selected, photographing an image received by the first lens corresponding to the selected image. The method of claim 2, wherein the control unit,
If the second lens that is different from the first lens is selected while the image received from the first lens is being photographed, capturing an image received from the second lens following the image photographed from the first lens. Mobile terminal characterized in that. delete The method of claim 3,
In at least one area of the display unit,
A progress bar indicating the shooting state of the video data is output,
The progress bar,
It is divided into a plurality of sections based on the number of lenses used for capturing the images forming the video data,
In the vicinity of the plurality of sections,
And a preview image of any one of the photographed images for outputting the moving image data.
delete delete delete The method of claim 2, wherein the control unit,
When the image photographed through the first lens is output to one region of the display unit, when a touch of a preset method is detected for the one region,
And photographing the image through a lens having a focus on a subject included in the area where the touch is detected. delete delete delete delete delete delete delete delete The method of claim 1, wherein the control unit,
When a region of at least one image of the first video is selected, portions of at least one image captured by the plurality of lenses are respectively extracted,
Among the extracted portions, a portion extracted from the second video photographed from the second lens based on a user's selection and at least one image of the first video from which the selected one region is excluded are synthesized. Mobile terminal. delete The method of claim 1, wherein the control unit,
Outputting the first moving image photographed from the first lens on the display unit,
The mobile terminal of claim 1, wherein the at least one area in which the first video is displayed is replaced with a part of the display area of another previously stored video based on a user's selection. The method of claim 20, wherein the control unit,
When a display area of at least a portion of the first video is selected, a feature point is extracted by recognizing an image included in the display area, and at least one video including at least one image corresponding to the feature point is stored from previously stored videos. Detect,
And a display area of at least a portion of the selected first video is replaced with a display area of at least one of the detected moving pictures. The method of claim 21, wherein the control unit,
And a thumbnail image corresponding to each of the detected at least one moving pictures is output to at least a portion of the display unit.

Images