KR101987462B1 - Mobile terminal and method for controlling of the same - Google Patents

Abstract

A control method for a mobile terminal and a mobile terminal is disclosed. A mobile terminal according to an exemplary embodiment of the present invention is connected to at least one external device through a wireless communication unit and transmits a control signal for recording a surrounding sound of an external device to at least one external device And when the moving image shooting is completed, the audio file recorded from at least one external device is received, and the moving image photographed by the camera and the audio file transmitted from at least one external device are combined.

Description

TECHNICAL FIELD [0001] The present invention relates to a mobile terminal and a control method of the mobile terminal,

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a mobile terminal for shooting a moving picture by driving a camera and a control method for the mobile terminal.

Along with the rapid development of the mobile communication terminal, the function of the camera has been widened to the utilization area of the existing digital camera as the resolution is improved.

As the mobile communication terminal with the built-in camera function is rapidly spreading, a mobile communication terminal capable of maximizing a moving picture shooting function by mounting a large-capacity multimedia memory device is being developed.

Currently, the moving picture mobile communication terminals being developed have a high performance enough to record a high-definition picture of several million pixels or more for a few minutes to a reception minute, and they have been rapidly improved so as to replace the functions of a camcorder.

However, there is a problem in that a voice corresponding to a moving picture to be photographed can not be recorded because a voice around the microphone located on the front face (keypad portion) of the mobile communication terminal is recorded when photographing a moving picture at a long distance.

The present invention relates to a mobile terminal and a control method of a mobile terminal, which are wirelessly connected to an external device and receive an audio file recorded from an external device when photographing a moving image at a long distance, and synthesize the captured moving image and the recorded audio file.

According to an aspect of the present invention, there is provided a mobile terminal connected to at least one external device through a camera, a touch screen, a wireless communication unit, and a wireless communication unit, A control unit for transmitting a control signal for recording a peripheral voice of the device to at least one external device, receiving a voice file recorded from at least one external device when the video recording is completed, And a control unit for synthesizing the voice file transmitted from the device.

The control unit may synthesize the moving picture photographed by the camera and the voice file transmitted from the external apparatus by referring to the current time information.

When the control unit is connected to two or more external devices through the wireless communication unit, the control unit may change the connection state of at least one of the two or more external devices during shooting of the moving image through the camera.

The control unit displays a preview acquired through the camera in the moving image shooting mode on the touch screen and displays a list including the preview and identification information of the external device when entering the mode of selecting the external device, Can be selected.

The control unit displays a preview obtained through the camera in the moving image shooting mode on the touch screen. When the specific object included in the preview is selected, the control unit searches the address book for identification information corresponding to the specific object, Lt; / RTI >

In the case where the control unit is connected to two or more external devices through the wireless communication unit, when the moving picture shooting is started through the camera, the control unit transmits a control signal for recording the peripheral sounds of the respective external devices to two or more external devices, It is possible to receive a recorded voice file from two or more external devices.

The control unit may synthesize the recorded voice file transmitted from two or more external devices by adjusting the volume of each recorded voice file when synthesizing the voice file with the captured moving image.

According to another aspect of the present invention, there is provided a mobile terminal including a camera, a touch screen, a wireless communication unit, and a control signal for requesting connection to at least one external device through a wireless communication unit in a moving image capture mode, A moving picture recording operation is started when at least one external device is connected to at least one external device, and when a moving picture photographing is completed, a voice file recorded from at least one external device And a controller for combining the photographed moving image and the transmitted voice file.

The control unit may synthesize the moving image photographed through the camera and the audio file transmitted from at least one external device by referring to the current time information.

The control unit may change the connection state of at least one external device until the moving image shooting starts and ends.

The control unit displays a preview acquired through the camera in the moving image shooting mode on the touch screen and displays a list including the preview and identification information of the external device when entering the mode of selecting the external device, Can be selected.

The control unit may adjust the volume of the voice file recorded from at least one external device to synthesize the photographed moving image and the transmitted voice file.

According to another aspect of the present invention, there is provided a method of controlling a mobile terminal, the method comprising: selecting at least one external device to set up a wireless link; Transmitting a control signal to at least one external device to end recording of a peripheral audio of the external device upon completion of moving picture shooting, transmitting the control signal to at least one external device, And synthesizing the photographed moving image and the transmitted voice file.

The step of selecting at least one external device and setting a wireless link may include displaying an icon to enter a screen for selecting an external device on the touch screen in the moving image shooting mode, Displaying at least one external device in the list or inputting identification information of the external device in the input window to select at least one external device And establishing a wireless link with the selected at least one external device.

The step of selecting at least one external device and setting up a wireless link may include displaying a preview obtained through a camera in a moving image shooting mode on a touch screen, selecting an object included in the preview, Retrieving identification information corresponding to an object from the address book, and selecting at least one external device corresponding to the identification information to set up a wireless link.

The details of other embodiments are included in the detailed description and drawings.

The control method of the mobile terminal and the mobile terminal according to the present invention has the following effects.

According to an embodiment of the present invention, at least one external device to provide a microphone function may be selected according to a moving image to be photographed.

According to an embodiment of the present invention, it is possible to provide a UI (User Interface) capable of intuitively selecting an external device by providing a list including at least one external device information or directly selecting an object of a preview .

In addition, according to an embodiment of the present invention, a variety of editing techniques may be applied, such as adjusting and synthesizing the volume of a voice file transmitted according to a moving picture scene to be photographed.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2A is a front perspective view of a mobile terminal according to an embodiment of the present invention.
2B is a rear perspective view of a mobile terminal according to an embodiment of the present invention.
3 is a flowchart of a method of controlling a mobile terminal according to an embodiment of the present invention.
4 to 10 are diagrams for explaining a control method of a mobile terminal according to an embodiment of the present invention.

The above objects, features and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. It is to be understood, however, that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and similarities. Like reference numerals designate like elements throughout the specification. In the following description, well-known functions or constructions are not described in detail since they would obscure the invention in unnecessary detail. In addition, numerals (e.g., first, second, etc.) used in the description of the present invention are merely an identifier for distinguishing one component from another.

Hereinafter, a mobile terminal according to the present invention will be described in detail with reference to the drawings. The suffix "module" and "part" for components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), navigation and the like.

However, it will be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to a mobile terminal.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory unit 160, An interface unit 170, a control unit 180, a power supply unit 190, and the like. The components shown in Fig. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of a DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of a DVBH (Digital Video BroadcastHandheld).

The broadcast receiving module 111 receives a broadcast signal using various broadcasting systems. In particular, the broadcast receiving module 111 may be a digital multimedia broadcasting broadcasting (DMBT), a digital multimedia broadcasting satellite (DMBS), a media forward link only (MediaFLO), a digital video broadcasting ), And ISDBT (Integrated Services Digital Broadcast Terrestrial). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems that provide broadcast signals as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory unit 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 refers to a module for wireless Internet access, and the wireless Internet module 113 can be embedded in the mobile terminal 100 or externally. WLAN (WiFi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and the like can be used as the short distance communication technology.

The location information module 115 is a module for confirming or obtaining the location of the mobile terminal. A typical example of the location information module is a GPS (Global Position System) module. According to the current technology, the GPS module 115 calculates information on a distance (distance) from three or more satellites to one point (entity), information on the time when the distance information is measured, , Three-dimensional position information according to latitude, longitude, and altitude of one point (individual) in one hour can be calculated. Further, a method of calculating position and time information using three satellites and correcting the error of the calculated position and time information using another satellite is also used. The GPS module 115 continues to calculate the current position in real time and uses it to calculate speed information.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory unit 160 or may be transmitted to the outside through the wireless communication unit 110. [ The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. In addition, it may be responsible for a sensing function related to whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include an orientation sensor 141 and / or a proximity sensor.

The output unit 150 is for generating output related to the visual, auditory or tactile sense and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154 .

The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display, a thin film transistor liquid crystal display, an organic light emitting diode, a flexible display, a 3D display And may include at least one.

Some of these displays may be transparent or light transmissive so that they can be seen through. This may be referred to as a transparent display. A typical example of the transparent display is a transparent LCD or the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

The display unit 151 is connected to a display unit 151 and a sensor for sensing a touch operation (hereinafter, referred to as 'touch sensor') having a mutual layer structure It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

Referring to FIG. 1, a proximity sensor may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is enclosed by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.

And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch & The act of actually touching the pointer on the screen is called "contact touch. &Quot; The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory unit 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 outputs an acoustic signal related to a function (e.g., a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 100. The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The video signal or the audio signal can also be output through the display unit 151 or the audio output module 152.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may be configured to perform various functions such as an effect of stimulation by a pin arrangement vertically moving with respect to a contact skin surface, an effect of stimulation by air spraying force or suction force through a jet opening or a suction opening, A variety of tactile effects such as an effect of stimulation through contact of an electrode, an effect of stimulation by an electrostatic force, and an effect of reproducing a cold sensation using a heat absorbing or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to feel the tactile effect through the muscles of the user's finger or arm. The haptic module 154 may include two or more haptic modules 154 according to the configuration of the portable terminal 100.

The memory unit 160 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory unit 160 may store data related to vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory unit 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) At least one of a random access memory (RAM), a static random access memory (SRAM), a read only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read- Lt; / RTI > type of storage medium. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory unit 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or receives power from the external device to transfer the data to each component in the mobile terminal 100 or to transmit data in the mobile terminal 100 to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input by the user to the cradle may be transmitted It can be a passage to be transmitted to the terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The control unit 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, microcontrollers, microprocessors, and electrical units for performing functions. In some cases such embodiments may be implemented using a controller 180 < / RTI >

According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. Also, the software codes may be stored in the memory unit 160 and executed by the control unit 180. [

2A is a perspective view of an example of a mobile terminal or a mobile terminal according to the present invention.

The disclosed mobile terminal 100 has a bar-shaped terminal body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

The body includes a case (a casing, a housing, a cover, and the like) which forms an appearance. In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injection molding a synthetic resin, or may be formed to have a metal material such as stainless steel (STS) or titanium (Ti) or the like.

The display unit 151, the sound output unit 152, the camera 121, the user input units 130/131 and 132, the microphone 122, the interface 170, and the like may be disposed in the front body 101 have.

The display unit 151 occupies most of the main surface of the front case 101. A sound output unit 152 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132, the interface 170, and the like are disposed on the side surfaces of the front case 101 and the rear case 102.

The user input unit 130 is operated to receive a command for controlling the operation of the portable terminal 100 and may include a plurality of operation units 131 and 132.

The operation units 131 and 132 may be collectively referred to as a manipulating portion and may be employed in any manner as long as the user operates in a tactile manner.

The contents input by the operation units 131 and 132 can be variously set. For example, the first operation unit 131 receives commands such as start, end, scroll, and the like, and the second operation unit 132 controls the size of the sound output from the sound output unit 152 or the size of the sound output from the display unit 151 To the touch recognition mode of the touch screen.

FIG. 2B is a rear perspective view of the portable terminal shown in FIG. 2A.

Referring to FIG. 2B, a camera 121 'may be further mounted on the rear surface of the terminal body, that is, the rear case 102. The camera 121 'may have a photographing direction substantially opposite to the camera 121 (see FIG. 2A), and may be a camera having different pixels from the camera 121.

For example, the camera 121 may have a low pixel so that the face of the user can be photographed and transmitted to the other party in case of a video call or the like, and the camera 121 ' It is preferable to have a large number of pixels. The cameras 121 and 121 'may be installed in the terminal body such that they can be rotated or popped up.

A flash 123 and a mirror 124 are additionally disposed adjacent to the camera 121 '. The flash 123 illuminates the subject when the subject is photographed by the camera 121 '. The mirror 124 allows the user to illuminate the user's own face or the like when the user intends to shoot himself / herself (self-photographing) using the camera 121 '.

An acoustic output 152 'may be additionally disposed on the rear surface of the terminal body. The sound output unit 152 'may implement the stereo function together with the sound output unit 152 (see FIG. 2A), and may be used for the implementation of the speakerphone mode during a call.

In addition to the antenna for a call or the like, a broadcast signal reception antenna 124 may be additionally disposed on the side of the terminal body. The antenna 124 constituting a part of the broadcast receiving module 111 (see FIG. 1) may be installed to be able to be drawn out from the terminal body.

A power supply unit 190 for supplying power to the portable terminal 100 is mounted on the terminal body. The power supply unit 190 may be built in the terminal body or may be detachable from the outside of the terminal body.

The rear case 102 may further include a touch pad 135 for sensing a touch. The touch pad 135 may also be of a light transmission type like the display unit 151. [ In this case, if the display unit 151 is configured to output time information on both sides, the time information can be recognized through the touch pad 135 as well. The information output on both sides may be all controlled by the touch pad 135. [ Alternatively, a display may be additionally mounted on the touch pad 135, and a touch screen may be disposed on the rear case 102.

The touch pad 135 operates in correlation with the display portion 151 of the front case 101. The touch pad 135 may be disposed parallel to the rear of the display unit 151. The touch pad 135 may have a size equal to or smaller than that of the display unit 151.

Hereinafter, embodiments of the present invention will be described.

FIG. 3 is a flowchart illustrating a method of controlling a mobile terminal according to an embodiment of the present invention, and FIGS. 4 to 10 illustrate a method of controlling a mobile terminal according to an exemplary embodiment of the present invention. The control method may be implemented under the control of the control unit 180 of the mobile terminal 100 illustrated in FIG. FIGS. 4 to 9 are views for explaining a method of connecting a mobile terminal and at least one external device according to an embodiment of the present invention. FIG. And synthesizing the received voice file.

3, the controller 180 of the mobile terminal 100 selects at least one external device to perform a microphone function, and transmits the selected at least one external device and the mobile terminal 100 to the wireless communication unit 100, (S110).

The control unit 180 displays a user interface including a preview input to the camera 121 and a soft function button for entering at least one external device in a moving picture shooting mode on a touch screen 151).

Here, the preview is an image that is previewed before the image input to the camera 121 is stored in the memory 160.

When the soft function button displayed on the touch screen 151 is touched in the moving picture shooting mode, the controller 180 enters a mode for selecting at least one external device, displays a list including identification information of the external device, An input window for inputting the identification information of the external device, or a selection screen for selecting an object from which external device identification information can be searched.

The controller 180 searches for at least one external device capable of wireless and network connection, selects at least one of the detected external devices, and transmits the selected wireless device to the wireless communication unit 110 You can connect through.

The control unit 180 may transmit a control signal to at least one external device to record the surround sound of the external device when the moving picture shooting is started through the camera 121 (S120).

The control unit 180 controls the at least one external device connected through the wireless communication unit 110 to start recording the surrounding audio of the external device when the camera 121 of the mobile terminal 100 is driven to start capturing moving images, Signal can be transmitted.

Here, the voice includes all the auditory elements such as the background music and the effect sound as well as the voice of the person.

In addition, the control unit 180 may transmit a control signal requesting the at least one external device to request the wireless link connection and request recording of the peripheral audio of the external device in the moving image shooting mode. In this case, when the mobile terminal 100 is connected to at least one external device, video recording and voice recording are started immediately. Therefore, it is necessary to transmit a control signal for requesting voice recording from the mobile terminal 100 to at least one external device .

In another embodiment, the control unit 180 can distinguish between a point of time when the mobile terminal 100 is connected to at least one external device and a point of time when a moving image is captured. That is, first, after the mobile terminal 100 is connected to at least one external device, the control unit 180 controls the mobile terminal 100 to start capturing moving images, and at the same time, A control signal requesting to record a voice can be transmitted.

Accordingly, the control unit 180 may set the time when the mobile terminal 100 is connected to at least one external device to the time when the moving picture shooting and the peripheral audio recording of the external device are requested to be the same or different.

The control unit 180 transmits a control signal requesting the at least one external device to terminate the voice recording at step S130 and transmits the recorded voice file at step S140.

At this time, the control unit 180 transmits a control signal to automatically transmit the recorded voice file when the voice recording is finished with at least one external device, or when a separate control signal requesting the recorded voice file is transmitted, To be transmitted.

In addition, the control unit 180 may synthesize a moving picture photographed by the camera 121 of the mobile terminal 100 and a voice file transmitted from at least one external device (S150).

Specifically, the control unit 180 photographs only the image to the camera 121 without recording the sound input to the microphone 122 of the mobile terminal 100 at the time of capturing a moving image, You can combine files to create a movie that combines sound and images.

The process of combining the photographed moving picture and the recorded voice file to generate a combined moving picture is performed by a synchronization process and an editing process.

First, the control unit 180 may synchronize the moving picture photographed by the camera 121 and the voice file transmitted from the external device by referring to the current time information. That is, the control unit 180 may perform a synchronization process with reference to the current time information in order to match the recording time of the moving image with the recording time of the synthesized audio file.

In general, since the mobile terminal 100 and the external device are physically separated, a delay time occurs due to the transmission of the control signal, and time synchronization between the video and the recorded voice file is required.

Accordingly, the control unit 180 must synchronize the moving picture photographed by the mobile terminal 100 and the voice file transmitted from at least one external device with reference to the current time information.

Next, the controller 180 may adjust the volume of the voice file to be synthesized and synthesize the voice file with the photographed moving image. When two or more voice files are combined with the photographed moving image, the volume of each voice file is synthesized .

4 to 9, a method of connecting a mobile terminal and at least one external device according to an embodiment of the present invention will be described in detail.

Referring to FIG. 4, an external device can be selected and connected according to the user's setting in the environment setting. Specifically, when a user selects an item (for example, Wi-Fi, Bluetooth, etc.) capable of setting wireless and network in the environment setting, a list of external devices capable of wireless and network connection of the selected item is displayed.

When at least one of the first external device, the second external device and the third external device capable of wireless and network connection with the mobile terminal 100 is selected, the controller 180 connects the wireless link to the selected first external device .

Referring to FIG. 5, the mobile terminal 100 may display a UI (User Interface) on the touch screen 151 to enter a mode for selecting an external device using a soft function button in a moving image shooting mode.

According to the present invention, by providing a soft function button for selecting at least one external device in the moving image shooting mode of the mobile terminal 100, An external device can be easily connected using the soft function button displayed on the screen 151. [

6, when the controller 180 enters at least a mode for selecting an external device displayed on the touch screen 151 in the moving image shooting mode, the controller 180 may display a list including identification information of at least one external device .

For example, identification information (ID) of an external device such as a first external device, a second external device, a third external device, and a fourth external device can be included in the list.

The control unit 180 may display the list including the identification information of the external device to overlap with the preview area. When the list is displayed on the upper part of the preview area, the control unit 180 deactivates the preview area and activates the list area so that external devices included in the list can be selected.

When the second external device of the at least one external device included in the list is selected (for example, by touching the external device selection box to be selected), the controller 180 controls the second external device selected through the wireless communication unit 110, Link the link.

7, when the control unit 180 enters a mode for selecting at least one external device in the moving picture shooting mode (see FIG. 5), the control unit 180 can display an input window and a keyboard capable of directly inputting the external device identification information have.

The control unit 180 may display the input window and the keyboard on the preview area or may display it transparently to overlap the preview area. Accordingly, the user can directly input the desired identification information (e.g., telephone number) of the external device through the keyboard or retrieve the identification information of the external device using the address book stored in the mobile terminal 100. [

Referring to FIG. 8, the controller 180 recognizes the objects included in the preview as A, B, and C, and when the specific object A is selected, the controller 180 searches for and displays the identification information corresponding to the selected object from the stored address book.

For example, when the identification information corresponding to the object A is "Kim XX, 010-1234-5678 ", the control unit 180 selects the object A included in the preview, Quot; can be connected to an external device having a "wireless link ".

According to the present embodiment, the controller 180 can select at least one external device to connect the wireless link in various ways, and change the connection state of at least one external device connected during the moving picture shooting.

9, the control unit 180 selects the first external device, the second external device, and the fourth external device in the moving image shooting mode, and after starting the moving image shooting after connecting the wireless link, The connection state to the external device can be canceled.

Specifically, the control unit 180 wirelessly connects the first external device, the second external device, and the fourth external device through the wireless communication unit 110 in the moving image capturing mode. When the moving image capturing is started, , The second external device and the fourth external device can transmit a control signal for recording the peripheral voice of the external device.

In addition, the control unit 180 may transmit a control signal for stopping the recording of the peripheral sound of the external device to the first external device and disconnecting the connection to the first external device during the moving picture shooting, The recorded voice file can be received until the interruption.

The control unit 180 receives the audio file recorded from the second external device and the fourth external device after the movie shooting is completed, and transmits the picked-up moving image to the first external device, the second external device, and the fourth external device The combined audio file can be generated.

That is, the control unit 180 synchronizes the partially recorded voice file transmitted from the first external device and the previously recorded voice file transmitted from the second external device and the fourth external device, based on the current time information .

In addition, the control unit 180 may adjust the volume of the voice file transmitted from each external device according to time.

Referring to FIG. 10, in an embodiment in which a moving picture of a viewer watching a stage is captured by the mobile terminal 100, a voice file recorded from three external devices A, B, and C included in the moving picture And composes the moving image captured by the mobile terminal 100 with a moving image.

First, the control unit 180 requests a wireless connection with three external devices A, B, and C outside the mobile terminal 100, and transmits a control signal to record the peripheral audio of each external device when the video shooting starts do.

The control unit 180 receives the recorded voice file from three external devices A, B, and C upon completion of capturing the moving image, and synthesizes the captured moving image and the transmitted voice file.

 In order to synthesize the photographed moving image and the transmitted voice file, the control unit 180 first synchronizes the voice file A, the voice file B, and the voice file C with the video file photographed using the current time information.

The synchronization process aligns the current time information, t, with the current time information t of the photographed moving image file, the audio file A, the audio file B, and the audio file C.

When the synchronization is completed, the control unit 180 adjusts the volumes of the audio file A, the audio file B, and the audio file C to be synthesized in accordance with the motion picture shooting direction of the mobile terminal 100 to Volume A, Volume B, and Volume C, can do.

For example, when the photographing position of the mobile terminal 100 is at the back of the stage (behind the external device B) and the photographing direction is at 2 o'clock, the volume of the recorded audio files A, B, Quot; 7: 8: 3 "in consideration of the positional relationship with the substrate 100. [

Accordingly, the control unit 180 can greatly synthesize the volume of the voice file recorded from the external device at the position closest to the position where the moving picture is photographed by the mobile terminal 100, and output the voice file recorded from the far- It is possible to generate a moving image file having a lively feeling by synthesizing the volume of the moving image.

In addition, the control unit 180 may adjust the volume of the voice file recorded from a plurality of external devices according to the direction in which the moving picture of the mobile terminal 100 is taken, respectively.

The above-described method of controlling a mobile terminal according to the present invention can be provided by being recorded in a computer-readable recording medium, which is a program for execution in a computer.

The control method of the mobile terminal according to the present invention can be executed through software. When executed in software, the constituent means of the present invention are code segments that perform the necessary tasks. The program or code segments may be stored in a processor readable medium or transmitted by a computer data signal coupled with a carrier wave in a transmission medium or a communication network.

A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored. Examples of the computer-readable recording device include a ROM, a RAM, a CD-ROM, a DVD-ROM, a DVD-RAM, a magnetic tape, a floppy disk, a hard disk and an optical data storage device. The computer-readable recording medium may also be distributed to networked computer devices so that computer readable code can be stored and executed in a distributed manner.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention. The present invention is not limited to the drawings. In addition, the embodiments described in this document are not limited to be applied, but all or some of the embodiments may be selectively combined so that various modifications can be made.

100: child terminal 151: touch screen
180:

Claims (15)

camera;
touch screen;
A wireless communication unit; And
Wherein the control unit is connected to at least one external device through the wireless communication unit and transmits to the at least one external device a control signal for recording a peripheral sound of the external device when the moving picture shooting is started through the camera, And a control unit for receiving the recorded voice file from the at least one external device and synthesizing a moving picture photographed by the camera and a voice file transmitted from the at least one external device,
Wherein,
When an input for canceling the connection state of the first external device among the plurality of external devices is received during shooting of the moving picture through the camera when the device is connected to the plurality of external devices through the wireless communication unit,
The first external device transmits a control signal requesting the discontinuation of the recording operation to the first external device, and transmits a control signal to the first external device from the first external device to the first audio file Lt; / RTI >
And synthesizes the audio file received from the external device other than the first external device and the first audio file after the movie shooting is completed.
The method according to claim 1,
Wherein the controller synchronizes the moving picture photographed by the camera and the voice file transmitted from the external device by referring to the current time information.
delete The method according to claim 1,
The control unit displays a preview acquired through the camera in the moving image shooting mode on the touch screen and displays a list including the preview and identification information of the external device when entering the mode for selecting the external device And selects the external device from the list.
The method according to claim 1,
Wherein the control unit displays a preview obtained through the camera in the moving picture shooting mode on the touch screen, and when the specific object included in the preview is selected, the control unit searches the address book for identification information corresponding to the specific object, And connects to an external device corresponding to the identification information.
The method according to claim 1,
When the moving picture shooting is started through the camera, when the control unit is connected to two or more external devices through the wireless communication unit, the control unit transmits a control signal to record the peripheral sounds of the external devices to the two or more external devices And when the moving picture shooting is completed, the audio file recorded from the two or more external devices is received.
The method according to claim 6,
Wherein the control unit adjusts the volume of each of the recorded voice files when synthesizing the recorded voice file transmitted from the two or more external devices with the captured moving image.
delete delete delete delete delete Selecting at least one external device to set up a wireless link;
Transmitting a control signal to the at least one external device to record a surrounding sound of the external device when the moving picture shooting is started through the camera;
Transmitting a control signal to the at least one external device to terminate the peripheral audio recording of the external device upon completion of the moving picture shooting and requesting transmission of the recorded audio file; And
And synthesizing the photographed moving image and the transmitted voice file,
When the wireless link is connected to a plurality of external devices,
And a control unit for controlling the first external device to stop the recording operation and request a connection to the first external device, when receiving an input for canceling the connection state of the first external device among the plurality of external devices, Transmitting,
Receiving a recorded first audio file from the time when the moving picture shooting is started to the time when the recording operation is stopped from the first external device, and
Further comprising the step of synthesizing the first audio file with a voice file received from an external device other than the first external device after the motion picture taking is completed.
14. The method of claim 13,
Wherein the step of selecting a wireless link by selecting the mobile terminal and the at least one external device comprises:
Displaying an icon to enter a screen for selecting an external device on a touch screen in a moving picture shooting mode;
Displaying the list including the identification information of at least one external device or the input window for inputting the identification information of the external device by selecting the icon;
Selecting at least one external device from the list or inputting identification information of the external device into the input window; And
And setting a radio link with the selected at least one external device.
14. The method of claim 13,
Wherein the step of selecting the at least one external device to establish a wireless link comprises:
Displaying a preview obtained through a camera in a moving image shooting mode on a touch screen;
Selecting an object included in the preview;
Retrieving identification information corresponding to an object included in the preview from an address book; And
And selecting at least one external device corresponding to the identification information to set up a wireless link.

Images