KR20140005634A - Mobile terminal and control method thereof - Google Patents

Abstract

The present invention relates to a mobile terminal capable of obtaining an external image from the outside and a control method thereof. The mobile terminal according to an embodiment of the present invention comprises: a main body; a camera unit for obtaining a video; a sensing unit for detecting at least one among a movement of the main body and a movement of a user; a user input unit for receiving a control command to obtain a video by the camera unit; a control unit for controlling the camera unit by directing the camera unit to obtain a first video if the detected movement is a predetermined movement, and directing the camera unit to obtain a second video if the control command which is received after the first video is obtained, is a control command to obtain a video by the camera unit; and a merge unit for producing a third video by combining second video frames included in the second video with at least a part of first video frames included in the first video. [Reference numerals] (AA) Start; (BB) End; (S110) Detect at least one among a movement of a main body and a movement of a user; (S120) Direct a camera unit to obtain a first video if the detected movement is a predetermined movement; (S130) After obtaining the first video, input a control command to obtain a video by the camera unit through a user input unit; (S140) Direct the camera to obtain a second video if the inputted control command is a control command to obtain a video by the camera unit; (S150) Produce a third video by combining second video frames included in the second video with at least a part of first video frames included in the first video

Description

[0001] MOBILE TERMINAL AND CONTROL METHOD THEREOF [0002]

The present invention relates to a mobile terminal, and more particularly, to a mobile terminal capable of acquiring an image from the outside and a control method thereof.

Terminal is movable And may be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

As the functions of the terminal are diversified, the terminal is implemented in the form of a multimedia device having a combination of functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, have. Further, in order to support and enhance the function of the terminal, it may be considered to improve the structural and software parts of the terminal.

Thanks to this improvement, the terminal can acquire an image from the outside using the camera unit. However, when the user intends to operate the camera unit in the sleep mode, the sleep mode of the terminal is released and a process of several steps may be performed and it may take several seconds. Accordingly, the user has an inconvenience in that it is difficult to acquire an image at a moment.

An object of the present invention is to provide a mobile terminal and a control method thereof capable of acquiring an image from the outside even before a user inputs a control command for operating the camera unit.

A mobile terminal according to an embodiment of the present invention, the main body; A camera unit obtaining a video image; A detector configured to detect at least one of a movement of the main body and a user's movement; A user input unit receiving a control command for acquiring a video image of the camera unit; If the detected motion is a preset motion, the camera unit is controlled to acquire a first video image, and the control command received after acquiring the first video image is a control command for acquiring a video image of the camera unit. The control unit controlling the camera unit to obtain a second video image; And a merger configured to merge at least some of the first video frames included in the first video image to second video frames included in the second video image to generate a third video image.

The mobile terminal may include a buffer memory configured to store the first video image; And a record memory for storing the second video image.

The mobile terminal may further include a display unit, and the controller may control the camera unit to acquire the first video image for a preset time when the detected movement is a preset movement. The display may be controlled to display a pop-up window for selecting whether to acquire the second video image after a preset time.

The camera unit may be configured to selectively acquire the second video image based on whether the control command selected through the pop-up window is a control command for acquiring the second video image. The control unit may delete the first video image from the buffer memory.

The merge unit may display the preview images corresponding to at least some of the first video frames included in the first video image when the camera unit ends capturing the second video image. The display unit may be controlled.

The merge unit may group the first video frames into a plurality of groups based on time information of each of the first video frames, and represent each of the plurality of groups. The display unit may be controlled to select key video frames and to display representative preview images corresponding to each of the representative video frames.

The merge unit may, when receiving at least one of the displayed representative preview images, detects a group of the selected representative preview image, and includes a first image included in the detected group among the first video frames. The third video image may be generated by merging one video frames and the second video frames.

In example embodiments, when the third video image is generated, the controller deletes the first video image from the buffer memory while storing the third video image in the record memory, and deletes the second video image. Can be deleted from the record memory.

The control unit may be further configured to, when the available memory capacity of the buffer memory is less than or equal to a threshold, the controller may select at least some of the first video frames from the buffer memory based on time information obtained from each of the first video frames. You can delete it.

In an embodiment, the sensing unit may include at least one of a geomagnetic sensor, a gyro sensor, and an acceleration sensor that detects a movement of the main body.

An embodiment of the present invention relates to a control method of a mobile terminal including a main body and a camera unit for acquiring a video image. The control method of the mobile terminal may include detecting at least one of a movement of the main body and a movement of a user; Controlling the camera unit to acquire a first video image when the detected motion is a preset motion; Receiving a control command for acquiring a video image of the camera unit through a user input unit after acquiring the first video image; Controlling the camera unit to acquire a second video image when the input control command is a control command for acquiring a video image of the camera unit; And merging at least some of the first video frames included in the first video image into second video frames included in the second video image to generate a third video image.

The control method of the mobile terminal may include: storing the first video image in a buffer memory; And storing the second video image in a record memory.

The controlling of the camera unit to acquire a first video image when the detected motion is a preset motion, when the detected motion is a preset motion, the first video for a preset time. And controlling the camera unit to acquire an image, and after receiving the first video image, receiving a control command for acquiring a video image of the camera unit through a user input unit, acquires the second video image. And controlling the display unit to display a pop-up window for receiving a selection.

The control method of the mobile terminal may include determining whether the control command selected through the pop-up window is a control command for acquiring the second video image; And selectively controlling the camera unit to acquire the second video image or deleting the first video image from the buffer memory based on the determination result.

According to the present invention, when the movement of the main body or the user sensed by the sensing unit is a predetermined movement, the terminal may acquire an image from the outside even before the user inputs a control command for operating the camera unit. That is, the terminal may acquire an image of the moment that the user may miss. Accordingly, the user can conveniently obtain an image corresponding to the shooting intention. Consequently, the convenience of the user can be improved.

1 is a block diagram illustrating a mobile terminal according to the present invention.
2A and 2B are perspective views showing an appearance of a mobile terminal according to the present invention.
3 is a flowchart for explaining an embodiment of a mobile terminal according to the present invention.
4 to 12 are conceptual views illustrating an operation example of the mobile terminal according to FIG. 3.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described with reference to the accompanying drawings so that those skilled in the art may easily implement the technical idea of the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

The mobile terminal described herein may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigator, have. However, it should be understood that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless it is applicable only to a mobile terminal. It will be easy to see.

1 is a block diagram illustrating a mobile terminal 100 according to the present invention.

1, a mobile terminal 100 includes a wireless communication unit 110, an audio / video (A / V) input unit 120 (hereinafter referred to as a user tracking unit), a user input unit 130, An input unit 140, an output unit 150, a memory 160, an interface unit 170, a control unit 180, and a power supply unit 190. The components shown in Fig. 1 are not essential, so that a mobile terminal having more or fewer components can be implemented.

Hereinafter, the components 110 to 190 of the mobile terminal 100 will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short distance communication module 114, and a location information module 115.

The broadcast receiving module 111 receives broadcast signals and broadcast related information from an external broadcast management server through a broadcast channel. Here, the broadcast-related information means information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information can also be provided through a mobile communication network. In this case, the broadcast-related information may be received by the mobile communication module 112. The broadcast signal and the broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. Such wireless signals may include various types of data depending on a voice call signal, a video call signal, a text message, or a multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be embedded in the mobile terminal 100 or externally. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used.

The position information module 115 is a module for acquiring the position of the mobile terminal 100, and a representative example thereof is a Global Position System (GPS) module.

1, the user tracking unit 120 receives an audio signal and a video signal and tracks a user using the received signal. The user tracking unit 120 includes a camera 121, a microphone 122, A sensor 123, and the like. The camera 121 processes image frames such as still images and moving images obtained by the image sensor in the video communication mode or the photographing mode. The image frame processed by the camera 121 can be displayed on the display unit 151. [ The image frame may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ More than two cameras 121 may be provided depending on the use environment.

The microphone 122 processes the sound signal input from the outside in the communication mode, the recording mode, the voice selection mode, and the like as electrical voice data. The voice data processed by the microphone 122 in the communication mode can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 and output. The microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated when an external sound signal is input.

The user input unit 130 generates input data for controlling the operation of the mobile terminal 100 by a user. The user input unit 130 may include a key pad, a dome switch, a touch pad (static pressure and static electricity), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as presence or absence of a user, the open / close state of the mobile terminal 100, position, orientation, acceleration, deceleration, And generates a sensing signal. For example, when the mobile terminal 100 is in the form of a slide phone, the sensing unit 140 may detect whether the slide phone is opened or closed. The sensing unit 140 may sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like.

The sensing unit 140 may include a proximity sensor 141. The sensing unit 140 may include a touch sensor (not shown) for sensing a touch operation with respect to the display unit 151.

The touch sensor may have the form of a touch film, a touch sheet, a touch pad, or the like. The touch sensor may be configured to convert a pressure applied to a specific portion of the display portion 151 or a change in capacitance generated at a specific portion of the display portion 151 into an electrical input signal. The touch sensor may be configured to detect a touch pressure as well as a touched position and area.

When the touch sensor and the display unit 151 have a mutual layer structure, the display unit 151 can be used as an input device in addition to the output device. The display unit 151 may be referred to as a 'touch screen'.

If there is a touch input via the touch screen, signals corresponding thereto are sent to a touch controller (not shown). The touch controller processes the signals transmitted from the touch sensor, and then transmits data corresponding to the processed signals to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched.

In the case where the touch screen is electrostatic, it can be configured to detect the proximity of the sensing object by a change of the electric field along the proximity of the sensing target. Such a touch screen may be classified as proximity sensor 141. [

The proximity sensor 141 refers to a sensor that detects the presence or absence of an object to be sensed without mechanical contact using an electromagnetic force or infrared rays. The proximity sensor 141 has a longer life than the contact type sensor and its utilization is also high. Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.

Hereinafter, for convenience of explanation, a proximity action is referred to as " proximity touch " while an object to be sensed does not touch the touch screen, and an action of touching the sensing object on the touch screen is called & touch ".

The proximity sensor 141 detects the presence or absence of a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, The information corresponding to the presence / absence of proximity touch and the proximity touch pattern can be output to the touch screen.

The output unit 150 generates an output related to visual, auditory, tactile, and the like. The output unit 150 may include a display unit 151, an audio output module 153, an alarm unit 154, and a haptic module 155.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal 100 operates in the call mode, the display unit 151 displays a UI (User Interface) or a GUI (Graphic User Interface) related to the call. When the mobile terminal 100 operates in the video communication mode or the photographing mode, the display unit 151 displays the photographed image, the received image, the UI, the GUI, and the like.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT-LCD), an organic light emitting diode (OLED), a flexible display display, a 3D display, and an e-ink display.

At least one display (or display element) included in the display unit 151 may be configured to be transparent or light transmissive so that the display can see the outside through it. This can be referred to as a transparent display. A typical example of such a transparent display is TOLED (Transparent OLED). The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 in the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. [ For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from each other or positioned integrally with one another, and may be located on different surfaces.

The sound output module 153 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice selection mode, a broadcast reception mode, The sound output module 153 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The sound output module 153 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 154 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events generated in the mobile terminal 100 include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 154 may output a signal for informing occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The display unit 151 and the audio output module 153 may be classified as a part of the alarm unit 154 because the video signal or the audio signal can be output through the display unit 151 or the audio output module 153. [

The haptic module 155 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 155 is vibration. The intensity, pattern, and the like of the vibration generated by the tactile module 155 are controllable. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 155 may be configured to perform various functions such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, Various effects can be generated such as the effect of heat generation and the effect of reproducing the cold sensation using the heat absorbing or heatable element.

The haptic module 155 can be configured to not only transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sense of the finger or arm. At least two haptic modules 155 may be provided according to the configuration of the mobile terminal 100.

The memory 160 may store a program for the operation of the controller 180 and temporarily store input and output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 160 may store data related to vibrations and sounds of various patterns that are output upon touch input on the touch screen.

The memory 160 may be a flash memory, a hard disk, a multimedia card micro type, a card type memory (e.g., SD or XD memory), a random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM) And may include at least one storage medium. The mobile terminal 100 may operate in association with a web storage that performs storage functions of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device, receives power, transfers the power to each component inside the mobile terminal 100, or transmits data inside the mobile terminal 100 to an external device. For example, the interface unit 170 may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, Input / output ports, video I / O ports, earphone ports, and the like.

The identification module is a chip for storing various information for authenticating the usage right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module Universal Subscriber Identity Module (USIM)). A device equipped with an identification module (hereinafter referred to as "identification device") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

The interface unit 170 may be a path through which the power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle or various command signals input from the cradle by the user, (Not shown). The various command signals or power supplied from the cradle may also act as a signal for recognizing that the mobile terminal 100 is correctly mounted in the cradle.

The controller 180 controls the overall operation of the mobile terminal 100. For example, control and processing related to voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [ The control unit 180 may perform pattern selection processing for selecting handwriting input and drawing input on the touch screen as characters and images, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

The various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be applied to various types of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays Microprocessors, microprocessors, and other electronic units for performing other functions, as will be appreciated by those skilled in the art. In some cases, the embodiments described herein may be implemented by the controller 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code may be implemented in a software application written in a suitable programming language. Such software code may be stored in the memory 160 and executed by the controller 180.

Hereinafter, a method of processing user input to the mobile terminal 100 will be described.

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100, and may include a plurality of operation units. The operating units may also be referred to as manipulating portions and may be employed in any manner as long as they are operated in a tactile manner by the user's tactile sense.

Various kinds of time information can be displayed on the display unit 151. [ Such visual information can be displayed in the form of letters, numbers, symbols, graphics, icons, and the like, and can be formed as a three-dimensional stereoscopic image. At least one of a character, a number, a symbol, a graphic, and an icon may be displayed in a predetermined arrangement for inputting time information, thereby being implemented as a keypad. Such a keypad may be referred to as a so-called " soft key ".

The display unit 151 may operate as an entire area or may be divided into a plurality of areas and operated. In the latter case, the plurality of areas can be configured to operate in association with one another. For example, an output window and an input window may be displayed on the upper and lower portions of the display unit 151, respectively. The output window and the input window are areas allocated for outputting or inputting information, respectively. In the input window, a soft key with a number for inputting a telephone number may be output. When the soft key is touched, the number corresponding to the touched soft key is displayed in the output window. When the operating unit is operated, a call connection to the telephone number displayed in the output window may be attempted, or the text displayed in the output window may be entered into the application.

The display unit 151 or the touch pad may be configured to detect touch scrolling. The user can move the cursor or the pointer positioned on the displayed object, for example, the icon, on the display unit 151 by scrolling the display unit 151 or the touch pad. Further, when the finger is moved on the display unit 151 or the touch pad, the path along which the finger moves may be visually displayed on the display unit 151. [ This will be useful for editing the image displayed on the display unit 151. [

One function of the mobile terminal 100 may be executed in response to a case where the display unit 151 and the touch pad are touched together within a predetermined time range. In the case of being touched together, there may be a case where the user clamps the main body of the mobile terminal 100 using the thumb and index finger. At this time, one function of the mobile terminal 100 to be executed may be activation or deactivation for the display unit 151 or the touch pad, for example.

2A and 2B are perspective views showing the appearance of the mobile terminal 100 related to the present invention.

FIG. 2A shows a front side and one side of the mobile terminal 100, and FIG. 2B shows a rear side and the other side of the mobile terminal 100. FIG.

Referring to FIG. 2A, the mobile terminal 100 includes a bar-shaped terminal body. However, the mobile terminal 100 is not limited thereto, and may be realized in various forms such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are movably coupled to each other.

The terminal body includes a case (a casing, a housing, a cover, and the like) that forms an appearance. In the embodiment, the case may be divided into a front case 101 and a rear case 102. A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injection molding of a synthetic resin or may be formed to have a metal material such as stainless steel (STS), titanium (Ti) or the like.

The display unit 151, the sound output unit 152, the camera 121, the user input unit 130 (see FIG. 1), the microphone 122, the interface 170, can do.

The display unit 151 occupies a main portion of the front case 101. [ The audio output unit 152 and the camera 121 are located in a region adjacent to one end of the display unit 151 and the first user input unit 131 and the microphone 122 are located in a region adjacent to the other end. The second user input unit 132 and the interface 170 may be located on the sides of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100. [ The user input unit 130 may include a plurality of operation units 131 and 132.

The first or second operating units 131 and 132 can receive various commands. For example, the first operation unit 131 can receive commands such as start, end, scroll, and the like. The second operation unit 132 can receive commands such as adjusting the size of the sound output from the sound output unit 152, switching to the touch selection mode of the display unit 151, and the like.

Referring to FIG. 2B, a rear camera 121 'may be additionally mounted on the rear surface of the terminal body, that is, the rear case 102. The rear camera 121 'has a photographing direction opposite to that of the front camera 121 (see FIG. 2A), and may be configured to have pixels different from those of the front camera 121.

For example, the front camera 121 may be configured to have a low pixel, and the rear camera 121 'may be configured to have a high pixel. Accordingly, when the front camera 121 is used during a video call, the size of the transmission data may be reduced when the user's face is photographed and transmitted to the counterpart in real time. On the other hand, the rear camera 121 'can be used for the purpose of storing a high-quality image.

Meanwhile, the cameras 121 and 121 'may be installed in the terminal body so as to be rotated or popped up.

The flash 123 and the mirror 124 may be further positioned adjacent to the rear camera 121 '. The flash 123 emits light toward the subject when the user photographs the subject with the rear camera 121 '. The mirror 124 illuminates the user's face when the user photographs himself (self-photographing) using the rear camera 121 '.

A rear sound output unit 152 'may be additionally disposed on the rear surface of the terminal body. The rear sound output unit 152 'may perform a stereo function together with the front sound output unit 152 (see FIG. 2A), and may perform a speakerphone function during a call.

In addition to the antenna for communication, an antenna 116 for receiving broadcast signals may be additionally provided on the side surface of the terminal body. The antenna 116 constituting a part of the broadcast receiving module 111 (see FIG. 1) can be installed to be able to be drawn out from the terminal body.

A power supply unit 190 for supplying power to the mobile terminal 100 is mounted on the terminal body. The power supply unit 190 may be built in the main body of the terminal or may be detachable from the outside of the main body of the terminal.

The rear case 102 may further include a touch pad 135 for sensing a touch. The touch pad 135 may be of a light transmission type like the display unit 151 (see FIG. 2A). Further, a back display unit for outputting time information can be additionally mounted on the touch pad 135. [ At this time, information output from both sides of the front display unit 151 and the rear display unit can be controlled by the touch pad 135. [

The touch pad 135 operates in correlation with the display unit 151. [ The touch pad 135 may be positioned parallel to the rear of the display unit 151. The touch pad 135 may have a size equal to or smaller than that of the display unit 151.

Meanwhile, the mobile terminal 100 may acquire an image from the outside using the camera unit 121. However, when the user wants to operate the camera unit 121 in the sleep mode, the sleep mode of the mobile terminal 100 is released and a process of several steps may take place and may take several seconds. Accordingly, the user has an inconvenience in that it is difficult to acquire an image at a moment.

Accordingly, hereinafter, the mobile terminal 100 capable of acquiring an image from the outside even before a user inputs a control command for operating the camera unit 121 will be described with reference to the accompanying drawings. do.

FIG. 3 is a flowchart for explaining an embodiment of the mobile terminal 100 (see FIG. 1) according to the present invention. The mobile terminal 100 may include a main body, a camera unit 121 (see FIG. 1), a detector 140 (see FIG. 1), a user input unit 130 (see FIG. 1), a controller 180 (see FIG. 1), and a merge unit ( 182, see FIG. 1).

Referring to FIG. 3, first, at least one of a movement of a main body and a user's movement is detected (S110).

In detail, the sensing unit 140 may include a motion recognition sensor (not shown) that detects the movement of the main body. The motion recognition sensor (not shown) may be mounted inside the mobile terminal 100 to recognize movement or position of the main body. The motion recognition sensor (not shown) may include at least one of a terrestrial magnetism sensor, a gyro sensor, and an acceleration sensor.

The motion recognition sensor (not shown) may detect whether the main body is rotated. That is, the motion recognition sensor (not shown) may detect the displacement according to the rotation of the main body, that is, the rotation direction and the rotation angle, and generate an electrical signal using the same.

Meanwhile, the sensing unit 140 may include a camera unit 121. The camera unit 121 may be mounted outside the mobile terminal 100 to recognize a user's movement. The camera unit 121 may detect at least one of a user's face and a user's motion, and generate an electrical signal using the same.

Next, when the detected motion is a predetermined motion, step S120 of controlling the camera unit 121 to acquire the first video image is performed.

In detail, the controller 180 may compare a pattern of a movement (for example, a body movement or a user's movement) detected by the sensing unit 140 with a preset pattern related to the acquisition of the first video image. As a result of the comparison, when the detected motion pattern corresponds to the preset pattern, the controller 180 may generate a control command related to acquisition of the first video image. Accordingly, the camera unit 121 may acquire the first video image from the outside. The obtained first video image may be stored in the buffer memory 161 (see FIG. 1).

Thereafter, after acquiring the first video image, a step of receiving a control command for acquiring a video image of the camera unit 121 through the user input unit 130 (S130) and the received control command is performed by the camera unit 121. In the case of a control command for acquiring a video image, step S140 of controlling the camera unit 121 to acquire a second video image is performed.

Specifically, the user input unit 130 generates input data for the user to control the operation of the mobile terminal 100. The user input unit 130 may include a key pad, a dome switch, a jog wheel, a jog switch, and the like. In addition, the user input unit 130 may be configured as a touch pad capable of touch input. The touch pad may be mounted on the front of the display unit 151.

The user may input a control command for acquiring the video image of the camera unit 121 through the user input unit 130. Accordingly, the camera unit 121 may acquire a second video image different from the first video image. The obtained second video image may be stored in the record memory 162 (see FIG. 1).

For example, the controller 180 acquires a first video image by using the camera unit 121 for a preset time, and then, after a preset time passes, a control unit 180 opens a pop-up window for selecting whether to acquire a second video image. I can display it. In this case, when the control command selected through the pop-up window is a control command for acquiring the second video image, the controller 180 may acquire the second video image by using the camera unit 121.

Next, in operation S150, a third video image is generated by merging at least some of the first video frames included in the first video image to second video frames included in the second video image.

In detail, the merge unit 182 may display preview images corresponding to at least some of the first video frames included in the first video image when the camera unit 121 finishes obtaining the second video image. The display unit 151 may be controlled.

In more detail, the merger 182 groups the first video frames into a plurality of groups based on time information of each of the first video frames, and represents a representative video for each of the plurality of groups. Key video frames can be selected. Thereafter, the display unit 151 may be controlled to display representative preview images corresponding to each of the selected representative video frames.

Subsequently, when the merger 182 receives at least one of the representative preview images displayed by the user, the merge unit 182 detects a group of the selected representative preview image, and includes a first video included in the detected group among the first video frames. The third video image may be generated by merging the frames and the second video frames.

Although not shown, when a third video image is generated, the controller 180 deletes the first video image from the buffer memory 161 while storing the third video image in the record memory 162 and the second video. An image can be deleted from the record memory 162.

As described above, according to the present invention, when the movement of the main body or the user detected by the sensing unit 140 is a preset movement, the mobile terminal 100 gives a control command for the user to operate the camera unit 121. Images can be obtained from the outside even before input. That is, the mobile terminal 100 may obtain an image of the moment that the user may miss. Accordingly, the user can conveniently obtain an image corresponding to the shooting intention. Consequently, the convenience of the user can be improved.

FIG. 4 is a conceptual diagram showing an operation example of the mobile terminal 200 according to FIG. The mobile terminal 200 may include a main body, a camera unit 121 (see FIG. 1), a detector 140 (see FIG. 1), a user input unit 130 (see FIG. 1), a controller 180 (see FIG. 1), and a merge unit ( 182, see FIG. 1). Here, the user input unit 130 may include a display unit 251 formed to enable a touch input.

Referring to FIG. 4, first, the sensing unit 140 may detect at least one of a movement of a main body and a movement of a user. The sensing unit 140 may detect the movement of the main body using a motion recognition sensor (not shown), or may detect the movement of the user using the camera unit 121.

Next, the controller 180 may compare the pattern of the movement detected by the sensor 140 with a preset pattern related to the acquisition of the first video image. Here, the pattern related to the acquisition of the first video image may include a preceding pattern before the user inputs a control command for acquiring the video image through the user input unit 130.

The pattern associated with the acquisition of the first video image may be a pattern related to movement of the main body, for example, a pattern in which the main body moves in a landscape position horizontal to the ground, and a portrait posture perpendicular to the ground. and a moving pattern to be a position).

Also, the pattern related to the acquisition of the first video image may include a pattern related to the movement of the user, for example, a pattern in which the user approaches the user input unit 130 to input a control command related to acquisition of the first video image. It may include.

In more detail, when the main body is in a landscape position horizontal to the ground as a pattern related to the acquisition of the first video image, as shown, the first video image when the main body is in the landscape position. A control command associated with the acquisition of may be generated.

 Thereafter, the camera unit 121 may acquire the first video image from the outside based on the control command. The obtained first video image may be stored in the buffer memory 161 (see FIG. 1). The buffer memory 161 is a first in first out (FIFO) memory and may temporarily store data.

Although not shown, when the available memory capacity of the buffer memory 161 is less than or equal to the threshold value, the controller 180 based on the obtained time information of each of the first video frames included in the first video image, the first video. At least some of the frames may be deleted from the buffer memory 161.

As illustrated, the display unit 251 may display the first video image. In addition, the display unit 251 may indicate that the first video image is a video image obtained before the user inputs a control command for acquiring the video image through the user input unit 130 (eg, the first video image). An indicator 253 indicating this preliminary video can be displayed.

5 and 6 are conceptual views illustrating an operation example of the mobile terminal 200 according to FIG. 3. The mobile terminal 200 may include a main body, a camera unit 121 (see FIG. 1), a detector 140 (see FIG. 1), a user input unit 130 (see FIG. 1), a controller 180 (see FIG. 1), and a merge unit ( 182, see FIG. 1). Here, the user input unit 130 may include a display unit 251 formed to enable a touch input.

Referring to FIGS. 5 and 6, subsequent to FIG. 4, the camera unit 121 may acquire a first video image from the outside based on a control command. The display unit 251 may indicate that the first video image is a video image obtained before the user inputs a control command for acquiring the video image through the user input unit 130 (eg, the first video image is reserved. An indicator 253 indicating that the image is displayed may be displayed.

Subsequently, when receiving a control command for acquiring a video image of the camera unit 121 through the user input unit 130, the camera unit 121 may acquire a second video image from the outside based on the control command.

As illustrated in FIG. 5, the user input unit 130 that receives a control command for acquiring a video image of the camera unit 121 may include a photographing button 252. The photographing button 252 may be displayed on the display unit 251 or may correspond to a separate hard key. As shown, while the first video image is acquired, the controller 180 acquires the second video image based on a touch input to the capture button 252 displayed on the display unit 251. Can be controlled.

In addition, as shown in FIG. 6, the controller 180 controls the camera unit 121 to acquire the first video image for a preset time, and determines whether to acquire the second video image after the preset time passes. The pop-up window 254 for receiving the selection may be displayed on the display unit 251. At this time, the controller 180 selectively controls the camera unit 121 to acquire the second video image based on whether the control command selected through the pop-up window 254 is a control command for acquiring the second video image. Can be controlled.

The second video image obtained as described above may be stored in the record memory 162 (see FIG. 1). The record memory 162 may store data semi-permanently, unlike the buffer memory 161 (see FIG. 1) which may temporarily store data.

The display unit 251 may display an indicator 253 indicating that the second video image is a video image obtained by the user inputting a control command for acquiring the video image through the user input unit 130.

FIG. 7 is a conceptual diagram showing an operation example of the mobile terminal 200 according to FIG. The mobile terminal 200 may include a main body, a camera unit 121 (see FIG. 1), a detector 140 (see FIG. 1), a user input unit 130 (see FIG. 1), a controller 180 (see FIG. 1), and a merge unit ( 182, see FIG. 1). Here, the user input unit 130 may include a display unit 251 formed to enable a touch input.

Referring to FIG. 7, subsequent to FIG. 6, the controller 180 controls the camera unit 121 to acquire the first video image for a preset time and, after the preset time passes, whether to acquire the second video image. The pop-up window 254 for receiving the selection may be displayed on the display unit 251.

In this case, as shown in the drawing, when the control command selected through the pop-up window 254 is not a control command for acquiring the second video image, the controller 180 stores the first stored in the buffer memory 161 (see FIG. 1). 1 You can delete a video image. In this case, as illustrated, the display unit 251 may display a pop-up window 255 indicating that the first video image is deleted. The user may transfer and store the first video image in the record memory 162 (see FIG. 1) through a touch input to the pop-up window 255.

Although not shown, regardless of whether the pop-up window 254 for selecting whether to acquire the second video image is displayed or not, the display unit 251 after a preset time elapses after the first video image is acquired. May display a pop-up window 255 indicating that the first video image is deleted.

FIG. 8 is a conceptual diagram showing an operation example of the mobile terminal 200 according to FIG. The mobile terminal 200 may include a main body, a camera unit 121 (see FIG. 1), a detector 140 (see FIG. 1), a user input unit 130 (see FIG. 1), a controller 180 (see FIG. 1), and a merge unit ( 182, see FIG. 1). Here, the user input unit 130 may include a display unit 251 formed to enable a touch input.

Referring to FIG. 8, subsequent to FIGS. 5 and 6, the camera unit 121 may acquire a second video image. Subsequently, when receiving a control command for acquiring a video image of the camera unit 121 through the user input unit 130, the camera unit 121 may acquire a second video image from the outside based on the control command.

As shown in the drawing, the display unit 251 may display an object (hereinafter, referred to as an end button) 252 corresponding to a function of terminating a video image acquisition. Although not shown, the end button 252 may correspond to a separate hard key.

The controller 180 may end the acquisition of the second video image based on the touch input to the end button 252 displayed on the display unit 251. Thereafter, the second video image is stored in the record memory 162 (see FIG. 1), and the display unit 251 may display a message 256 indicating that the second video image is stored in the record memory 162.

Figs. 9 and 10 are conceptual diagrams showing operational examples of the mobile terminal 200 according to Fig. The mobile terminal 200 may include a main body, a camera unit 121 (see FIG. 1), a detector 140 (see FIG. 1), a user input unit 130 (see FIG. 1), a controller 180 (see FIG. 1), and a merge unit ( 182, see FIG. 1). Here, the user input unit 130 may include a display unit 251 formed to enable a touch input.

Referring to FIG. 9, the first video image may include first video frames. The merger 182 may display preview images corresponding to at least some of the first video frames on the display 251.

In detail, the merger 182 may group the first video frame into a plurality of groups based on time information of each of the first video frames. As shown, the merger 182 may group the first video frames into five groups each containing 25 first video frames.

In addition, merge 182 may select representative video frames for each of the five groups. As shown, video frame 1, video frame 26, video frame 51, video frame 76, and video frame 101 may be selected as representative video frames.

Thereafter, the merger 182 may display the representative preview images 256a ˜ 256e corresponding to each of the selected representative video frames on the display 251.

Referring to FIG. 10, when at least one of the representative preview images 256a ˜ 256e is selected, the merge unit 182 detects a group of the selected representative preview image, and includes a first video frame included in the detected group. And second video frames may be merged to generate a third video image.

For example, when the first video frame group acquired four seconds before the second video image is acquired, the merge unit 182 may acquire the first acquired four seconds, three seconds, two seconds, and one second. The third video image may be generated by merging the video frames and the second video frames.

11 and 12 are conceptual views illustrating an operation example of the mobile terminal 200 according to FIG. 3. The mobile terminal 200 may include a main body, a camera unit 121 (see FIG. 1), a detector 140 (see FIG. 1), a user input unit 130 (see FIG. 1), a controller 180 (see FIG. 1), and a merge unit ( 182, see FIG. 1). Here, the user input unit 130 may include a display unit 251 formed to enable a touch input.

11 and 12, subsequent to FIGS. 5 and 6, the camera unit 121 may acquire a second video image. Thereafter, the controller 180 may terminate the acquisition of the second video image based on the touch input to the end button 252 displayed on the display unit 251.

When the acquisition of the second video image is completed, the merger 182 may group the first video frame into a plurality of groups. In addition, merge 182 may select representative video frames for each of the five groups. As shown, the display unit 251 may display the selected representative video frames.

As shown in FIG. 11, when a representative preview image 256e of the first video frame group acquired one second before the second video image is acquired is selected, and a touch input is detected by an object corresponding to the merge function The merge unit 182 may merge the first video frames and the second video frames obtained one second ago to generate a third video image. Meanwhile, the selected representative preview image 256e may have a thicker border than other preview images 256a ˜ 256d.

Then, as shown in the drawing, the preview image 257 for the third video image may be displayed on the display unit 251. The preview image 257 for the third video image may be displayed in a form in which the representative preview image 256e for the first video frame group and the preview image for the second video image are superimposed.

On the other hand, as shown in FIG. 12, when the representative preview image 256d for the first video frame group acquired 2 seconds before the second video image is acquired, the merge unit 182 immediately selects 2 seconds before. And merge the first video frames and the second video frames obtained one second ago to generate a third video image.

In this case, the selected representative preview image 256d and the preview image 256f for the second video image may be displayed together on the display unit 251. In addition, the preview image 257 for the third video image may be displayed on the display unit 251. The preview image 257 for the third video image may be displayed in a form in which the representative preview image 256d for the first video frame group and the preview image for the second video image are superimposed.

Further, according to the embodiment disclosed herein, the above-described method can be implemented as a code that can be read by a processor on a medium on which the program is recorded. Examples of the medium that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and may be implemented in the form of a carrier wave (e.g., transmission over the Internet) .

The mobile terminal described above can be applied to not only the configuration and method of the embodiments described above but also all or some of the embodiments may be selectively combined so that various modifications may be made to the embodiments It is possible.

Claims (14)

main body;
A camera unit obtaining a video image;
A detector configured to detect at least one of a movement of the main body and a user's movement;
A user input unit receiving a control command for acquiring a video image of the camera unit;
If the detected motion is a predetermined motion, the camera unit is controlled to obtain a first video image,
A controller configured to control the camera unit to acquire a second video image when the control command received after acquiring the first video image is a control command for acquiring a video image of the camera unit; And
And a merger configured to merge at least some of the first video frames included in the first video image to second video frames included in the second video image to generate a third video image. The method of claim 1,
A buffer memory for storing the first video image; And
And a record memory for storing the second video image. 3. The method of claim 2,
And a display unit,
The control unit,
If the detected motion is a predetermined motion, the camera unit is controlled to acquire the first video image for a preset time,
And controlling the display unit to display a pop-up window for selecting whether to acquire the second video image after the preset time elapses. The method of claim 3, wherein
The control unit,
Optionally, the camera unit is controlled to acquire the second video image or the first video image is based on whether the control command selected through the pop-up window is a control command for acquiring the second video image. And deleting from the buffer memory. 5. The method of claim 4,
The merge part,
When the camera unit is finished to acquire the second video image, the display unit is controlled to display preview images corresponding to at least some of the first video frames included in the first video image. Mobile terminal. The method of claim 5, wherein
The merge part,
Grouping the first video frames into a plurality of groups based on time information of each of the first video frames,
Selecting key video frames for each of the plurality of groups,
And control the display unit to display representative preview images corresponding to each of the representative video frames. The method according to claim 6,
The merge part,
If at least one of the displayed representative preview images is selected, a group for the selected representative preview image is detected,
And generating the third video image by merging the first video frames and the second video frames included in the detected group among the first video frames. The method of claim 7, wherein
The control unit,
When the third video image is generated, the first video image is deleted from the buffer memory while the third video image is stored in the record memory, and the second video image is deleted from the record memory. Mobile terminal. 3. The method of claim 2,
The control unit,
And when at least one of the available memory capacities of the buffer memory is less than a threshold value, at least some of the first video frames are deleted from the buffer memory based on time information of each of the first video frames. 3. The method of claim 2,
The sensing unit includes:
A mobile terminal comprising at least one of a geomagnetic sensor, a gyro sensor, and an acceleration sensor for detecting a movement of the main body. In the control method of a mobile terminal comprising a main body and a camera unit for obtaining a video image:
Detecting at least one of movement of the main body and movement of the user;
Controlling the camera unit to acquire a first video image when the detected motion is a preset motion;
Receiving a control command for acquiring a video image of the camera unit through a user input unit after acquiring the first video image;
Controlling the camera unit to acquire a second video image when the input control command is a control command for acquiring a video image of the camera unit; And
Generating a third video image by merging at least some of the first video frames included in the first video image to second video frames included in the second video image. The method of claim 11,
Storing the first video image in a buffer memory; And
And storing the second video image in a record memory. 13. The method of claim 12,
When the detected motion is a preset motion, controlling the camera unit to acquire a first video image,
Controlling the camera unit to acquire the first video image for a preset time when the detected motion is a preset motion;
After acquiring the first video image, receiving a control command for acquiring a video image of the camera unit through a user input unit may include:
And controlling a display unit to display a pop-up window for selecting whether to acquire the second video image. The method of claim 13,
Determining whether the control command selected through the pop-up window is a control command for acquiring the second video image; And
And selectively controlling the camera unit to acquire the second video image or deleting the first video image from the buffer memory based on the determination result. .

Images