KR102135377B1 - Mobile terminal and method for controlling the same - Google Patents

Abstract

The present invention relates to a mobile terminal and its control method. In the mobile terminal according to an embodiment of the present invention, in a state in which a camera, a flash, a sensing unit that senses the state of the mobile terminal, and a camera application capable of taking an image through the camera are executed, the status of the mobile terminal is On the basis of satisfying a preset condition, and including a control unit for controlling the flash to output light, the control unit, the state of the mobile terminal in the state where the camera application is executed satisfies the preset condition, It is characterized in that it outputs light through the flash automatically before a photographing command is received.

Description

Mobile terminal and its control method{MOBILE TERMINAL AND METHOD FOR CONTROLLING THE SAME}

The present invention relates to a mobile terminal including a flash, and more particularly, to a mobile terminal capable of taking an image using a flash and a control method thereof.

Terminals can be divided into mobile terminals (mobile/portable terminals) and stationary terminals depending on whether they are mobile. Again, the mobile terminal may be divided into a handheld terminal and a vehicle mounted terminal according to whether the user can directly carry it.

The functions of mobile terminals are diversifying. For example, there are functions for data and voice communication, photo and video shooting through a camera, voice recording, music file playback through a speaker system, and output of an image or video to the display. In some terminals, an electronic game play function is added or a multimedia player function is performed. In particular, recent mobile terminals can receive multicast signals that provide visual content such as broadcast and video or television programs.

As the function is diversified, such a terminal is a multimedia player type having multiple functions such as taking a picture or a video, playing a music or video file, receiving a game, or broadcasting. Is being implemented.

Recently, as the performance of the camera has been developed, various functions using the camera have been developed. For example, development of functions for photographing a high-quality still image or a video, or generating a 3D image using depth information (depth value) of an image received through a camera has been actively conducted.

In addition, in recent years, there are many demands to take an image through a mobile terminal even in a dark place, and accordingly, various techniques have been developed to take a high quality image in a dark place.

One object of the present invention is to provide a mobile terminal and a control method for taking an image in a dark place in an optimized manner.

Another object of the present invention is to provide a mobile terminal capable of improving the image quality of a captured image in a dark place by controlling the flash in an optimized manner and a control method thereof.

Another object of the present invention is to provide a mobile terminal and a control method capable of reducing battery consumption by preventing the flash from outputting light in unnecessary situations.

In the mobile terminal according to an embodiment of the present invention, in a state in which a camera, a flash, a sensing unit that senses the state of the mobile terminal, and a camera application capable of taking an image through the camera are executed, the status of the mobile terminal is On the basis of satisfying a preset condition, and including a control unit for controlling the flash to output light, the control unit, the state of the mobile terminal in the state where the camera application is executed satisfies the preset condition, It is characterized in that it outputs light through the flash automatically before a photographing command is received.

In an embodiment, when the brightness of the preview image received through the camera is less than or equal to a predetermined brightness, the controller determines whether the state of the mobile terminal satisfies the preset condition.

In an embodiment, the preset condition is characterized in that it includes at least one of a case where the remaining battery power of the mobile terminal is equal to or greater than a certain amount and a movement of the mobile terminal is not detected.

In an embodiment, the controller sets the target brightness of the preview image differently based on whether a face region is detected in the preview image received through the camera while outputting light through the flash. It is characterized by.

In an embodiment, when the face region is detected in the preview image, the controller sets the target brightness so that the brightness of the face region included in the preview image becomes a preset first brightness, and the face in the preview image. When the area is not detected, the target brightness is set such that the average brightness of the preview image is a second brightness that is different from the first brightness.

In an embodiment, the controller is characterized in that the brightness of the light output from the flash is varied so that the brightness detected in the preview image becomes the target brightness.

In an embodiment, if the brightness of the preview image received through the camera is not changed even though light is output through the flash, the control unit controls the flash to stop outputting the light. do.

In an embodiment, when the brightness of the light output through the flash is the maximum, and the brightness of the preview image received through the camera does not reach the target brightness, the control unit changes the shooting property of the camera It is characterized by.

In an embodiment, when the controller detects that a specific object exists within a certain distance from the mobile terminal through the sensing unit, the control unit controls the flash to output no light even if the mobile terminal status satisfies a preset condition. It is characterized by.

The method of controlling a mobile terminal according to an embodiment of the present invention includes: executing a camera application capable of taking an image through a camera, sensing a state of the mobile terminal, and determining a condition in which the state of the mobile terminal is preset. On the basis of satisfaction, the step of outputting light through a flash, and the step of outputting, when the state of the mobile terminal satisfies the preset condition in the state where the camera application is executed, a shooting command is received. It is characterized in that it automatically outputs the light through the flash before it becomes.

In an embodiment, when the brightness of the preview image received through the camera is less than or equal to a predetermined brightness, the outputting is characterized in determining whether the state of the mobile terminal satisfies the preset condition.

In an embodiment, in the outputting step, in a state in which light is output through the flash, the brightness of the light outputted by the flash is mutually determined based on whether a face region is detected in a preview image received through the camera. It is characterized by controlling differently.

In an embodiment, if the brightness of the preview image received through the camera is not changed even though the light is output through the flash, the flash further includes stopping the flash from outputting light.

In an embodiment, when the brightness of the light output through the flash is at a maximum, when the brightness of the preview image received through the camera does not reach the target brightness, the method further includes changing a shooting property of the camera. .

According to the present invention, the present invention can provide a mobile terminal capable of taking a high-quality image without a delay time even in a dark situation by turning on the flash in advance before a photographing command is received.

In addition, according to the present invention, by varying the brightness of the light output from the flash before the shooting command is received, it is not necessary to change the shooting properties, and accordingly, the quality of the image can be prevented from changing as the shooting properties are changed.

In addition, the present invention is to adjust the brightness of the flash to match the target brightness of the preview image, and by shooting the image without changing the exposure time or ISO while the target brightness is set, blur caused by a long exposure time (blur ) And high ISO noise can be removed.

1A is a block diagram illustrating a mobile terminal related to the present invention.
1B and 1C are conceptual views of an example of a mobile terminal related to the present invention viewed from different directions.
2A and 2B are conceptual diagrams for explaining a method of controlling exposure by a mobile terminal related to the present invention.
3 is a flowchart illustrating a representative control method of the present invention.
4, 5, 6, and 7 are conceptual views for explaining the control method described in FIG. 3.

Hereinafter, exemplary embodiments disclosed herein will be described in detail with reference to the accompanying drawings, but the same reference numerals will be assigned to the same or similar elements regardless of reference numerals, and redundant descriptions thereof will be omitted. The suffixes "modules" and "parts" for components used in the following description are given or mixed only considering the ease of writing the specification, and do not have meanings or roles distinguished from each other in themselves. In addition, in the description of the embodiments disclosed herein, when it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed herein, detailed descriptions thereof are omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in the present specification, and the technical spirit disclosed in the specification is not limited by the accompanying drawings, and all modifications included in the spirit and technical scope of the present invention , It should be understood to include equivalents or substitutes.

Terms including ordinal numbers such as first and second may be used to describe various components, but the components are not limited by the terms. The terms are used only for the purpose of distinguishing one component from other components.

When an element is said to be "connected" or "connected" to another component, it is understood that other components may be directly connected to or connected to the other component, but there may be other components in between. It should be. On the other hand, when a component is said to be "directly connected" or "directly connected" to another component, it should be understood that no other component exists in the middle.

Singular expressions include plural expressions unless the context clearly indicates otherwise.

In this application, terms such as “comprises” or “have” are intended to indicate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, and that one or more other features are present. It should be understood that the existence or addition possibilities of fields or numbers, steps, operations, components, parts or combinations thereof are not excluded in advance.

Mobile terminals described herein include mobile phones, smart phones, laptop computers, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), navigation, and slate PCs. , Tablet PC (tablet PC), ultrabook (ultrabook), wearable device (wearable device, for example, a watch-type terminal (smartwatch), glass-type terminal (smart glass), HMD (head mounted display), etc. may be included have.

However, the configuration according to the embodiment described in the present specification can be easily recognized by those skilled in the art that the configuration may be applied to a fixed terminal such as a digital TV, a desktop computer, and a digital signage, except when applicable only to a mobile terminal. will be.

1A to 1C, FIG. 1A is a block diagram illustrating a mobile terminal related to the present invention, and FIGS. 1B and 1C are conceptual views of an example of a mobile terminal related to the present invention viewed from different directions.

The mobile terminal 100 includes a wireless communication unit 110, an input unit 120, a detection unit 140, an output unit 150, an interface unit 160, a memory 170, a control unit 180, and a power supply unit 190 ) And the like. The components shown in FIG. 1A are not essential for implementing a mobile terminal, so the mobile terminal described herein may have more or fewer components than those listed above.

More specifically, the wireless communication unit 110 among the components, between the mobile terminal 100 and the wireless communication system, between the mobile terminal 100 and another mobile terminal 100, or the mobile terminal 100 and an external server It may include one or more modules that enable wireless communication between. In addition, the wireless communication unit 110 may include one or more modules connecting the mobile terminal 100 to one or more networks.

The wireless communication unit 110 may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short-range communication module 114, and a location information module 115. .

The input unit 120 may include a camera 121 for inputting a video signal or a video input unit, a microphone for inputting an audio signal (microphone 122), or an audio input unit, a user input unit 123 for receiving information from a user, for example , A touch key, a mechanical key, and the like. The voice data or image data collected by the input unit 120 may be analyzed and processed by a user's control command.

The sensing unit 140 may include one or more sensors for sensing at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information. For example, the sensing unit 140 includes a proximity sensor 141, an illumination sensor 142, a touch sensor, an acceleration sensor, a magnetic sensor, and gravity G-sensor, gyroscope sensor, motion sensor, RGB sensor, infrared sensor (IR sensor), fingerprint scan sensor, ultrasonic sensor , Optical sensor (e.g., camera (see 121)), microphone (see 122, battery), battery gauge, environmental sensor (e.g. barometer, hygrometer, thermometer, radioactivity sensor, Thermal sensor, gas sensor, etc.), chemical sensors (for example, electronic nose, health care sensor, biometric sensor, etc.). Meanwhile, the mobile terminal disclosed in the present specification may combine and use information sensed by at least two or more of these sensors.

The output unit 150 is for generating output related to vision, hearing, or tactile sense, and includes at least one of a display unit 151, an audio output unit 152, a hap tip module 153, and an optical output unit 154 can do. The display unit 151 may form a mutual layer structure with the touch sensor or may be integrally formed, thereby realizing a touch screen. The touch screen may function as a user input unit 123 that provides an input interface between the mobile terminal 100 and a user, and at the same time, provide an output interface between the mobile terminal 100 and the user.

The interface unit 160 serves as a passage with various types of external devices connected to the mobile terminal 100. The interface unit 160 connects a device equipped with a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, and an identification module. It may include at least one of a port, an audio input/output (I/O) port, a video input/output (I/O) port, and an earphone port. In the mobile terminal 100, in response to an external device being connected to the interface unit 160, appropriate control related to the connected external device may be performed.

In addition, the memory 170 stores data supporting various functions of the mobile terminal 100. The memory 170 may store a number of application programs (application programs) driven in the mobile terminal 100, data for operating the mobile terminal 100, and instructions. At least some of these applications can be downloaded from external servers via wireless communication. In addition, at least some of these application programs may exist on the mobile terminal 100 from the time of shipment for basic functions of the mobile terminal 100 (for example, an incoming call, a calling function, a message reception, and a calling function). Meanwhile, the application program may be stored in the memory 170 and installed on the mobile terminal 100 to be driven by the controller 180 to perform an operation (or function) of the mobile terminal.

The controller 180 controls the overall operation of the mobile terminal 100 in addition to the operations related to the application program. The controller 180 may provide or process appropriate information or functions to the user by processing signals, data, information, etc. input or output through the above-described components or by driving an application program stored in the memory 170.

In addition, the controller 180 may control at least some of the components described with reference to FIG. 1A in order to drive the application program stored in the memory 170. Furthermore, the controller 180 may operate by combining at least two or more of the components included in the mobile terminal 100 to operate the application program.

Under the control of the controller 180, the power supply unit 190 receives external power and internal power to supply power to each component included in the mobile terminal 100. The power supply unit 190 includes a battery, and the battery may be a built-in battery or a replaceable battery.

At least some of the components may operate in cooperation with each other to implement an operation, control, or control method of a mobile terminal according to various embodiments described below. Also, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 170.

Hereinafter, before looking at various embodiments implemented through the mobile terminal 100 described above, the components listed above will be described in more detail with reference to FIG. 1A.

First, referring to the wireless communication unit 110, the broadcast reception module 111 of the wireless communication unit 110 receives a broadcast signal and/or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast reception modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or switching of broadcast channels for at least two broadcast channels.

The mobile communication module 112 includes technical standards or communication methods for mobile communication (eg, Global System for Mobile Communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (CDMA2000), EV -Enhanced Voice-Data Optimized or Enhanced Voice-Data Only (DO), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), LTE-A (Long Term Evolution-Advanced) transmits and receives wireless signals to and from at least one of a base station, an external terminal, and a server on a mobile communication network constructed according to (Long Term Evolution-Advanced).

The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, or a text/multimedia message.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built in or external to the mobile terminal 100. The wireless Internet module 113 is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World) Interoperability for Microwave Access (HSDPA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), and the wireless Internet module ( 113) transmits and receives data according to at least one wireless Internet technology in a range including the Internet technology not listed above.

In view of the wireless Internet access through WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE-A, etc., through the mobile communication network, the wireless Internet module 113 that performs wireless Internet access through the mobile communication network ) May be understood as a type of the mobile communication module 112.

The short-range communication module 114 is for short-range communication, Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, NFC (Near Field Communication), by using at least one of Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, Wireless USB (Wireless Universal Serial Bus) technology, it can support short-range communication. The short-range communication module 114 may be provided between the mobile terminal 100 and the wireless communication system, between the mobile terminal 100 and another mobile terminal 100, or through the mobile terminal 100 through wireless area networks. ) And other mobile terminals (100, or an external server) is located between the network can support wireless communication. The short-range wireless communication network may be wireless personal area networks (Wireless Personal Area Networks).

Here, the other mobile terminal 100 is a wearable device (for example, a smart watch), smart glasses capable of exchanging data (or interoperable) with the mobile terminal 100 according to the present invention. (smart glass), HMD (head mounted display). The short-range communication module 114 may detect (or recognize) a wearable device capable of communicating with the mobile terminal 100 around the mobile terminal 100. Furthermore, when the sensed wearable device is a device authenticated to communicate with the mobile terminal 100 according to the present invention, the controller 180 may include at least a portion of data processed by the mobile terminal 100, and the short-range communication module ( 114) to the wearable device. Accordingly, a user of the wearable device can use data processed by the mobile terminal 100 through the wearable device. For example, according to this, the user performs a phone call through the wearable device when a call is received by the mobile terminal 100 or, when a message is received by the mobile terminal 100, the received message through the wearable device It is possible to check the message.

The location information module 115 is a module for acquiring a location (or current location) of a mobile terminal, and typical examples thereof include a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, if the mobile terminal utilizes a GPS module, the location of the mobile terminal can be obtained using a signal sent from a GPS satellite. As another example, when the mobile terminal utilizes the Wi-Fi module, the location of the mobile terminal may be obtained based on information of a Wi-Fi module and a wireless access point (AP) that transmits or receives a wireless signal. If necessary, the location information module 115 may perform any function of other modules of the wireless communication unit 110 in order to obtain data regarding the location of the mobile terminal by substitution or additionally. The location information module 115 is a module used to acquire the location (or current location) of the mobile terminal, and is not limited to a module that directly calculates or acquires the location of the mobile terminal.

Next, the input unit 120 is for input of image information (or signals), audio information (or signals), data, or information input from a user. For input of image information, the mobile terminal 100 is one Alternatively, a plurality of cameras 121 may be provided. The camera 121 processes image frames such as still images or moving pictures obtained by an image sensor in a video call mode or a shooting mode. The processed image frame may be displayed on the display unit 151 or stored in the memory 170. Meanwhile, the plurality of cameras 121 provided in the mobile terminal 100 may be arranged to form a matrix structure, and through the camera 121 forming the matrix structure, various angles or focuses may be applied to the mobile terminal 100. A plurality of image information may be input. Also, the plurality of cameras 121 may be arranged in a stereo structure to acquire left and right images for realizing a stereoscopic image.

The microphone 122 processes external sound signals as electrical voice data. The processed voice data may be used in various ways according to a function (or a running application program) being performed by the mobile terminal 100. Meanwhile, various noise reduction algorithms for removing noise generated in the process of receiving an external sound signal may be implemented in the microphone 122.

The user input unit 123 is for receiving information from a user. When information is input through the user input unit 123, the controller 180 may control the operation of the mobile terminal 100 to correspond to the input information. . The user input unit 123 is a mechanical input means (or a mechanical key, for example, a button located on the front or rear or side of the mobile terminal 100, a dome switch, a jog wheel, Jog switch, etc.) and a touch input means. As an example, the touch-type input means is made of a virtual key, a soft key or a visual key displayed on the touch screen through software processing, or a part other than the touch screen It may be made of a touch key (touch key) disposed on. Meanwhile, the virtual key or the visual key may be displayed on the touch screen while having various forms, for example, a graphic, text, icon, video, or the like. It can be made of a combination of.

Meanwhile, the sensing unit 140 senses at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information, and generates a sensing signal corresponding thereto. The controller 180 may control driving or operation of the mobile terminal 100 based on the sensing signal, or perform data processing, function, or operation related to an application program installed in the mobile terminal 100. The representative sensors among various sensors that may be included in the sensing unit 140 will be described in more detail.

First, the proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object in the vicinity using mechanical force or infrared rays without mechanical contact. The proximity sensor 141 may be provided with a proximity sensor 141 in an inner region of the mobile terminal wrapped by the touch screen described above or near the touch screen.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, the proximity sensor 141 may be configured to detect the proximity of the object with a change in electric field according to the proximity of the conductive object. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of description, the act of allowing the object to be recognized as being located on the touch screen without being touched on the touch screen is called "proximity touch", and the touch The act of actually touching an object on the screen is called "contact touch". The location where an object is touched in proximity on the touch screen refers to a location where the object is perpendicular to the touch screen when the object is touched in close proximity. The proximity sensor 141 may detect a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.). have. Meanwhile, as described above, the controller 180 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern detected through the proximity sensor 141, and further, visual information corresponding to the processed data. It can be output on the touch screen. Furthermore, the controller 180 may control the mobile terminal 100 such that different operations or data (or information) are processed according to whether a touch on the same point on the touch screen is a proximity touch or a touch touch. .

The touch sensor detects a touch (or touch input) applied to the touch screen (or display unit 151) using at least one of various touch methods such as a resistive film method, a capacitive method, an infrared method, an ultrasonic method, and a magnetic field method. do.

As an example, the touch sensor may be configured to convert a change in pressure applied to a specific portion of the touch screen or capacitance generated in the specific portion into an electrical input signal. The touch sensor may be configured to detect a location, an area, a pressure when a touch is touched, a capacitance when a touch object is touched on the touch screen, and the like. Here, the touch object is an object that applies a touch to the touch sensor, and may be, for example, a finger, a touch pen or a stylus pen, a pointer, and the like.

As such, when there is a touch input to the touch sensor, the signal(s) corresponding to the touch is sent to the touch controller. The touch controller processes the signal(s) and then transmits corresponding data to the controller 180. Accordingly, the control unit 180 can know which area of the display unit 151 has been touched, and the like. Here, the touch controller may be a separate component from the controller 180, or may be the controller 180 itself.

Meanwhile, the controller 180 may perform different controls or perform the same control according to the type of the touch object that touches the touch screen (or a touch key provided in addition to the touch screen). Whether to perform different control or the same control according to the type of the touch object, it may be determined according to the current operating state of the mobile terminal 100 or the running application program.

On the other hand, the touch sensors and proximity sensors described above are independently or in combination, such as short (or tap) touch on the touch screen, long touch, multi touch, drag touch ), flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, etc. You can sense the touch.

The ultrasonic sensor may recognize location information of a sensing target using ultrasonic waves. Meanwhile, the control unit 180 may calculate the position of the wave generating source through information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave generator can be calculated by using a property in which light is much faster than ultrasonic waves, that is, a time when light reaches the optical sensor is much faster than a time when ultrasonic waves reach the ultrasonic sensor. More specifically, the position of the wave generator may be calculated by using a time difference from the time at which the ultrasound reaches the light as a reference signal.

Meanwhile, the camera 121, which has been described as the configuration of the input unit 120, includes at least one of a camera sensor (eg, CCD, CMOS, etc.), a photo sensor (or image sensor), and a laser sensor.

The camera 121 and the laser sensor are combined with each other to detect a touch of a sensing target for a 3D stereoscopic image. The photo sensor may be stacked on a display element, which is configured to scan the movement of the sensing object close to the touch screen. More specifically, the photo sensor mounts photo diodes and TRs (transistors) in rows/columns to scan the contents placed on the photo sensor using electrical signals that change according to the amount of light applied to the photo diode. That is, the photo sensor performs coordinate calculation of the sensing object according to the amount of change of light, and through this, location information of the sensing object may be obtained.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, the display unit 151 may display execution screen information of an application program driven by the mobile terminal 100, or user interface (UI) or graphical user interface (GUI) information according to the execution screen information. .

In addition, the display unit 151 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

A three-dimensional display method such as a stereoscopic method (glasses method), an auto stereoscopic method (glasses-free method), or a projection method (holographic method) may be applied to the stereoscopic display unit.

The audio output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception, call mode or recording mode, voice recognition mode, broadcast reception mode, or the like. The sound output unit 152 may also output sound signals related to functions (for example, call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. The sound output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 153 generates various tactile effects that the user can feel. A typical example of the tactile effect generated by the haptic module 153 may be vibration. The intensity and pattern of vibration generated in the haptic module 153 may be controlled by a user's selection or setting of a control unit. For example, the haptic module 153 may synthesize different vibrations and output them sequentially or sequentially.

In addition to vibration, the haptic module 153 is used for stimulation such as pin arrangement that vertically moves with respect to the contact skin surface, jet or suction power of the air through a spray or intake, grazing on the skin surface, contact with an electrode, and electrostatic force Various tactile effects can be generated, such as the effect caused by and the effect of reproducing the feeling of cold and warm using an element capable of absorbing heat or generating heat.

The haptic module 153 may not only deliver a tactile effect through direct contact, but may also be implemented so that the user can feel the tactile effect through muscle sensations such as fingers or arms. Two or more haptic modules 153 may be provided according to a configuration aspect of the mobile terminal 100.

The light output unit 154 outputs a signal for notifying the occurrence of an event using the light of the light source of the mobile terminal 100. Examples of events occurring in the mobile terminal 100 may include receiving messages, receiving call signals, missed calls, alarms, schedule notifications, receiving emails, and receiving information through applications.

The signal output by the light output unit 154 is implemented as the mobile terminal emits light of a single color or a plurality of colors to the front or rear. The signal output may be terminated by the mobile terminal detecting the user's event confirmation.

The interface unit 160 serves as a passage with all external devices connected to the mobile terminal 100. The interface unit 160 receives data from an external device, receives power, transfers it to each component inside the mobile terminal 100, or allows data inside the mobile terminal 100 to be transmitted to the external device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connecting a device equipped with an identification module An interface unit 160 may include a (port), an audio input/output (I/O) port, a video input/output (I/O) port, and an earphone port.

On the other hand, the identification module is a chip that stores various information for authenticating the usage rights of the mobile terminal 100, a user identification module (UIM), a subscriber identity module (SIM), universal user authentication It may include a module (universal subscriber identity module; USIM). The device provided with the identification module (hereinafter referred to as an'identification device') may be manufactured in a smart card format. Therefore, the identification device may be connected to the terminal 100 through the interface unit 160.

In addition, when the mobile terminal 100 is connected to an external cradle, the interface unit 160 becomes a passage through which power from the cradle is supplied to the mobile terminal 100 or is input by the user from the cradle. Various command signals may be passages to the mobile terminal 100. Various command signals or power inputted from the cradle may be operated as signals for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The memory 170 may store a program for the operation of the controller 180 and may temporarily store input/output data (eg, a phone book, a message, a still image, a video, etc.). The memory 170 may store data related to various patterns of vibration and sound output when a touch is input on the touch screen.

The memory 170 is a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), a multimedia card micro type ), card type memory (e.g. SD or XD memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read (EPMROM) It may include a storage medium of at least one type of -only memory (PROM), programmable read-only memory (PROM), magnetic memory, magnetic disk and optical disk. The mobile terminal 100 may be operated in connection with a web storage performing a storage function of the memory 170 on the Internet.

Meanwhile, as described above, the controller 180 controls the operation related to the application program and the overall operation of the mobile terminal 100 in general. For example, if the state of the mobile terminal satisfies a set condition, the controller 180 may execute or release a lock state that limits the input of a user's control command to applications.

In addition, the controller 180 performs control and processing related to voice calls, data communication, video calls, etc., or performs pattern recognition processing to recognize handwriting input or picture drawing inputs performed on a touch screen as text and images, respectively. Can. Furthermore, in order to implement various embodiments described below on the mobile terminal 100 according to the present invention, the controller 180 may control any one or a combination of the above-described components.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power required for the operation of each component. The power supply unit 190 includes a battery, and the battery can be a built-in battery made to be rechargeable, and can be detachably coupled to the terminal body for charging and the like.

In addition, the power supply unit 190 may include a connection port, and the connection port may be configured as an example of an interface 160 to which an external charger that supplies power for charging the battery is electrically connected.

As another example, the power supply unit 190 may be configured to charge the battery wirelessly without using the connection port. In this case, the power supply unit 190 uses at least one of an inductive coupling method based on a magnetic induction phenomenon from an external wireless power transmission device or a magnetic resonance coupling method based on an electromagnetic resonance phenomenon. Power can be delivered.

Meanwhile, various embodiments below may be implemented in a recording medium readable by a computer or a similar device using, for example, software, hardware, or a combination thereof.

1B and 1C, the disclosed mobile terminal 100 has a bar-shaped terminal body. However, the present invention is not limited to this, and may be applied to various structures such as a watch type, a clip type, a glass type, or a folder type, a flip type, a slide type, a swing type, a swivel type to which two or more bodies are movably coupled. . It will be related to a specific type of mobile terminal, but the description of a specific type of mobile terminal can be generally applied to other types of mobile terminals.

Here, the terminal body may be understood as a concept of referring to the mobile terminal 100 as at least one aggregate.

The mobile terminal 100 includes a case (for example, a frame, a housing, a cover, etc.) forming an exterior. As illustrated, the mobile terminal 100 may include a front case 101 and a rear case 102. Various electronic components are disposed in the inner space formed by the combination of the front case 101 and the rear case 102. At least one middle case may be additionally disposed between the front case 101 and the rear case 102.

A display unit 151 is disposed on the front of the terminal body to output information. As illustrated, the window 151a of the display unit 151 is mounted on the front case 101 to form the front surface of the terminal body together with the front case 101.

In some cases, electronic components may also be mounted on the rear case 102. Electronic components that can be mounted on the rear case 102 include a removable battery, an identification module, and a memory card. In this case, a rear cover 103 for covering the mounted electronic component may be detachably coupled to the rear case 102. Therefore, when the rear cover 103 is separated from the rear case 102, the electronic components mounted on the rear case 102 are exposed to the outside.

As shown, when the rear cover 103 is coupled to the rear case 102, a part of the side surface of the rear case 102 may be exposed. In some cases, the coupling rear case 102 may be completely covered by the rear cover 103. Meanwhile, an opening for exposing the camera 121b or the sound output unit 152b to the outside may be provided in the rear cover 103.

These cases (101, 102, 103) may be formed by injection of synthetic resin or may be formed of metal, for example, stainless steel (STS), aluminum (Al), titanium (Ti), or the like.

The mobile terminal 100 may be configured such that one case provides the inner space, unlike the above example in which a plurality of cases provide an inner space accommodating various electronic components. In this case, the mobile terminal 100 of a uni-body in which synthetic resin or metal extends from the side to the rear may be implemented.

On the other hand, the mobile terminal 100 may be provided with a waterproof portion (not shown) to prevent water from entering the terminal body. For example, the waterproof portion is provided between the window 151a and the front case 101, between the front case 101 and the rear case 102, or between the rear case 102 and the rear cover 103, the combination thereof It may include a waterproof member for sealing the interior space of the city.

The mobile terminal 100 includes a display unit 151, first and second sound output units 152a and 152b, a proximity sensor 141, an illuminance sensor 142, a light output unit 154, the first and second units Cameras 121a and 121b, first and second operation units 123a and 123b, a microphone 122, and an interface unit 160 may be provided.

Hereinafter, as illustrated in FIGS. 1B and 1C, a display unit 151, a first sound output unit 152a, a proximity sensor 141, an illuminance sensor 142, and an optical output unit are provided on the front surface of the terminal body. 154), the first camera (121a) and the first operation unit (123a) is disposed, the second operation unit (123b), the microphone 122 and the interface unit 160 are disposed on the side of the terminal body, the terminal body The mobile terminal 100 in which the second sound output unit 152b and the second camera 121b are disposed on the rear surface of the mobile terminal 100 will be described as an example.

However, these configurations are not limited to this arrangement. These configurations may be excluded or replaced as necessary, or may be disposed on different sides. For example, the first operation unit 123a may not be provided on the front of the terminal body, and the second sound output unit 152b may be provided on the side of the terminal body rather than the rear of the terminal body.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, the display unit 151 may display execution screen information of an application program driven by the mobile terminal 100, or user interface (UI) or graphical user interface (GUI) information according to the execution screen information. .

The display unit 151 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display (flexible). display), a three-dimensional display (3D display), an electronic ink display (e-ink display).

Also, two or more display units 151 may be present depending on the implementation form of the mobile terminal 100. In this case, a plurality of display units may be spaced apart from one surface or integrally disposed in the mobile terminal 100, or may be respectively disposed on different surfaces.

The display unit 151 may include a touch sensor that senses a touch on the display unit 151 so that a control command can be input by a touch method. Using this, when a touch is made to the display unit 151, the touch sensor detects the touch, and the controller 180 can be configured to generate a control command corresponding to the touch based on the touch. The content input by the touch method may be a letter or a number, or an instruction or designable menu item in various modes.

On the other hand, the touch sensor is composed of a film having a touch pattern, is disposed between the display (not shown) on the back surface of the window 151a and the window 151a, or a metal wire that is directly patterned on the back surface of the window 151a. It can be. Alternatively, the touch sensor may be integrally formed with the display. For example, the touch sensor may be disposed on the substrate of the display, or may be provided inside the display.

As such, the display unit 151 may form a touch screen together with a touch sensor, and in this case, the touch screen may function as a user input unit 123 (see FIG. 1A ). In some cases, the touch screen may replace at least some functions of the first operation unit 123a.

The first sound output unit 152a may be implemented as a receiver that delivers a call sound to the user's ear, and the second sound output unit 152b is a loud speaker that outputs various alarm sounds or multimedia playback sounds. ).

An acoustic hole for emitting sound generated from the first sound output unit 152a may be formed in the window 151a of the display unit 151. However, the present invention is not limited thereto, and the sound may be configured to be emitted along an assembly gap between structures (for example, a gap between the window 151a and the front case 101). In this case, the appearance of the mobile terminal 100 can be made simpler because the holes formed independently for the sound output are not visible or hidden.

The light output unit 154 is configured to output light to notify when an event occurs. Examples of the event include message reception, call signal reception, missed calls, alarm, schedule notification, email reception, information reception through an application, and the like. The control unit 180 may control the light output unit 154 so that the output of light is terminated when the user's event confirmation is detected.

The first camera 121a processes an image frame of a still image or video obtained by an image sensor in a shooting mode or a video call mode. The processed image frame may be displayed on the display unit 151, and may be stored in the memory 170.

The first and second operation units 123a and 123b are examples of the user input unit 123 operated to receive a command for controlling the operation of the mobile terminal 100, and may also be collectively referred to as a manipulating portion. have. The first and second manipulation units 123a and 123b may be employed in any manner as long as the user operates the device while receiving a tactile feeling, such as touch, push, scroll. Also, the first and second manipulation units 123a and 123b may be employed in such a way that the user operates without a tactile feeling through a proximity touch, a hovering touch, or the like.

In this figure, the first operation unit 123a is illustrated as a touch key, but the present invention is not limited thereto. For example, the first operation unit 123a may be a mechanical key or a combination of a touch key and a push key.

Contents input by the first and second operation units 123a and 123b may be variously set. For example, the first operation unit 123a receives commands such as a menu, home key, cancel, search, etc., and the second operation unit 123b is output from the first or second sound output units 152a, 152b. Commands such as adjusting the volume of the sound and switching to the touch recognition mode of the display unit 151 may be received.

Meanwhile, as another example of the user input unit 123 on the rear surface of the terminal body, a rear input unit (not shown) may be provided. The rear input unit is operated to receive a command for controlling the operation of the mobile terminal 100, and the input content may be variously set. For example, commands such as power on/off, start, end, scroll, and the like, and control the volume of sound output from the first and second sound output units 152a and 152b, to the touch recognition mode of the display unit 151 You can receive commands such as conversion of. The rear input unit may be implemented in a form capable of input by touch input, push input, or a combination thereof.

The rear input unit may be disposed to overlap the front display unit 151 in the thickness direction of the terminal body. For example, when the user holds the terminal body with one hand, the rear input unit may be disposed at the upper rear portion of the terminal body so that it can be easily operated using the index finger. However, the present invention is not necessarily limited to this, and the position of the rear input unit may be changed.

When the rear input unit is provided on the rear surface of the terminal body, a new type of user interface using the rear input unit may be implemented. In addition, when the touch screen or rear input unit described above replaces at least some functions of the first operation unit 123a provided on the front surface of the terminal body, when the first operation unit 123a is not disposed on the front surface of the terminal body, The display unit 151 may be configured as a larger screen.

Meanwhile, the mobile terminal 100 may be provided with a fingerprint recognition sensor for recognizing a user's fingerprint, and the controller 180 may use fingerprint information detected through the fingerprint recognition sensor as an authentication means. The fingerprint recognition sensor may be embedded in the display unit 151 or the user input unit 123.

The microphone 122 is configured to receive a user's voice, other sounds, and the like. The microphone 122 may be provided at a plurality of locations and configured to receive stereo sound.

The interface unit 160 is a path through which the mobile terminal 100 can be connected to an external device. For example, the interface unit 160 is a connection terminal for connection with other devices (eg, earphones, external speakers), a port for short-range communication (eg, an infrared port (IrDA Port), a Bluetooth port (Bluetooth) Port, Wireless LAN Port, etc.], or at least one of a power supply terminal for supplying power to the mobile terminal 100. The interface unit 160 may be implemented in the form of a socket that accommodates an external card such as a subscriber identification module (SIM) or a user identity module (UIM) or a memory card for storing information.

A second camera 121b may be disposed on the rear side of the terminal body. In this case, the second camera 121b has a shooting direction substantially opposite to the first camera 121a.

The second camera 121b may include a plurality of lenses arranged along at least one line. The plurality of lenses may be arranged in a matrix format. Such a camera may be referred to as an'array camera'. When the second camera 121b is configured as an array camera, images may be captured in a variety of ways using a plurality of lenses, and better quality images may be obtained.

The flash 124 may be disposed adjacent to the second camera 121b. When the flash 124 photographs the subject with the second camera 121b, light is directed toward the subject.

A second sound output unit 152b may be additionally disposed on the terminal body. The second sound output unit 152b may implement a stereo function together with the first sound output unit 152a, or may be used to implement a speakerphone mode during a call.

The terminal body may be provided with at least one antenna for wireless communication. The antenna may be built in the terminal body or may be formed in the case. For example, the antenna forming part of the broadcast receiving module 111 (see FIG. 1A) may be configured to be pulled out from the terminal body. Alternatively, the antenna may be formed of a film type and attached to the inner surface of the rear cover 103, or a case including a conductive material may be configured to function as an antenna.

The terminal body is provided with a power supply unit 190 (see FIG. 1A) for supplying power to the mobile terminal 100. The power supply unit 190 may include a battery 191 built in the terminal body or configured to be detachable from the outside of the terminal body.

The battery 191 may be configured to receive power through a power cable connected to the interface unit 160. Also, the battery 191 may be configured to be wirelessly charged through a wireless charger. The wireless charging may be implemented by a magnetic induction method or a resonance method (magnetic resonance method).

On the other hand, in this figure, the rear cover 103 is coupled to the rear case 102 so as to cover the battery 191 to limit the detachment of the battery 191, and configured to protect the battery 191 from external shocks and foreign matter. For example. When the battery 191 is configured to be detachably attached to the terminal body, the rear cover 103 may be detachably coupled to the rear case 102.

An accessory that protects the appearance or assists or expands the function of the mobile terminal 100 may be added to the mobile terminal 100. An example of such an accessory is a cover or pouch that covers or accommodates at least one surface of the mobile terminal 100. The cover or pouch may be configured to expand the function of the mobile terminal 100 in conjunction with the display unit 151. Another example of an accessory is a touch pen for assisting or expanding a touch input to a touch screen.

On the other hand, the mobile terminal related to the present invention can take an image to improve the image quality of the image taken in the dark.

Hereinafter, a mobile terminal for photographing a high-quality image in a dark place and a control method thereof will be described in detail with reference to the accompanying drawings.

2A and 2B are conceptual diagrams for explaining a method of adjusting exposure by a mobile terminal related to the present invention.

The mobile terminal of the present invention can adjust the image quality of the preview image received through the camera 121 using an Automatic Exposure Algorithm (AE Ego Algorithm).

The automatic exposure algorithm may include an algorithm for adjusting exposure time or ISO (sensitivity).

That is, the controller 180 of the mobile terminal of the present invention may perform a function of adjusting the exposure time and a function of adjusting the ISO.

As shown in FIG. 2A, the exposure time is a time for receiving light (or video) received through the camera when capturing an image, and may mean a time for light to be received through the camera while the shutter is open.

The exposure time may be related to the opening and closing time of the shutter.

When the exposure time is short (for example, 1/1000 second), since the time for receiving light is short, it may be less affected by the movement of the subject or the mobile terminal. In this case, the image photographed through the camera has less blurring due to movement of the subject/mobile terminal or less blur due to movement.

On the other hand, if the exposure time is long (for example, 1/2 second), since the time for receiving light is long, the movement of the subject or the mobile terminal is greatly affected. In this case, the image photographed through the camera has a lot of shaking due to the movement of the subject/mobile terminal, or a lot of blur due to the movement.

On the other hand, if the exposure time is short, the light reception time is short, so that when the space to be photographed is bright (above a preset brightness), sufficient light can be obtained even with a short exposure time. Accordingly, when the brightness of the space to be photographed is high, it is possible to shorten the exposure time and photograph a bright image with little blurring or blurring.

However, when the space to be photographed is dark (when the brightness is lower than the preset brightness), if the exposure time is shortened, sufficient light cannot be obtained during the short exposure time, and the image is darkened.

Accordingly, when the brightness of the space to be photographed is dark, an image is photographed so as to receive sufficient light by lengthening the exposure time. In this case, there is a problem that blurring or blurring occurs.

In addition, referring to FIG. 2A, in the case of ISO, it indicates the degree of reaction to light.

When the brightness of the space to be photographed is high, even when the ISO is low, it can sufficiently respond to light.

However, when the photographing space is dark, when the ISO is low, the sensitivity to light is low, so the photographed image becomes dark. Accordingly, when the photographing space is dark, an ISO representing the degree of response to light may be increased, and a small amount of light may be reacted (detected), thereby capturing an image capable of identifying the subject.

However, as shown in FIG. 2A, when the ISO is high, it reacts to a small amount of light, and thus there is a problem that noise is generated.

That is, the mobile terminal of the present invention when the shooting space is dark (when the brightness of the shooting space is less than or equal to the preset brightness), the AE algorithm is applied to increase the exposure time and increase the ISO to shoot an image that can identify the subject. Can.

However, as described above, blurring occurs when the exposure time is increased, and noise is generated when the ISO is increased, so the flash 124 may be used to increase the amount of light in a dark place.

The flash 124 may be formed to output light. The flash 124 may be driven by control of a camera or a controller.

When the flash 124 is turned on, it may mean that the flash outputs light. When the flash 124 is turned off, it may mean that the flash does not output light.

The flash 124 may also be referred to as a lighting device.

The flash 124 may include a plurality of light emitting elements. The plurality of light emitting elements are arranged to have a predetermined pattern, and may output structure light corresponding to the preset pattern.

In the foregoing description, the flash 124 has been described as being disposed adjacent to the second camera 121b, but is not limited thereto.

The flash 124 is disposed adjacent to the first camera 121a, so that when the subject is photographed with the first camera 121a, light may be directed toward the subject.

On the other hand, the mobile terminal of the present invention can receive and take an image through the camera 121.

The image received through the camera may be referred to as a preview image. Specifically, the preview image means an image received through the camera in real time. The preview image may be changed based on the mobile terminal equipped with the camera 121 moving by external force or moving the subject.

The image photographed through the camera may be, for example, an image in which a preview image is photographed. For example, in the image, a photographing button output on a display unit of a mobile terminal is touched, a user gesture associated to photograph a preview image is detected through the preview image, or a physical button provided on the mobile terminal is pressed. It can be photographed based on things.

The image described in this specification may mean at least one of a preview image or a captured image.

When a photographing command is received while the preview image is output, the controller 180 may photograph the preview image.

Here, the photographing command may be performed in various ways. For example, a touch is applied to a photographing button output on the display unit 151, a user input unit provided in the mobile terminal is pushed, and a mobile terminal. An object (for example, a finger) touches and falls on a proximity sensor provided in the user, and a user's specific gesture (for example, keeping a palm toward the camera for a certain period of time).

In this specification, for convenience of description, it will be described that a touch is applied to the photographing button on which the photographing command is output on the display unit 151.

Hereinafter, a method of using a flash to photograph an image in a dark place will be described in more detail with reference to FIG. 2B.

2B (a) is a timeline for explaining a conventional image capture method using a flash.

First, the controller 180 can execute a camera application based on a user request. For example, the camera application may be executed based on a touch applied (or selected) to the icon of the camera application or a user input received at a user input unit.

When the camera application is executed, the camera 121 provided in the mobile terminal 100 may be turned on or activated.

In the state in which the camera application is executed, the controller 180 may receive a shooting command from the user.

When the photographing command is received, the controller 180 may turn on the flash 124 when a specific condition is met. Turning on the flash may mean that light (light) is output through the flash.

Here, the specific condition may be a case where the flash is set to turn on when a shooting command is received, or a space in which an image is captured is darker than a preset brightness.

The controller 180 may first turn on the flash when a photographing command is received while the specific condition is satisfied after the camera application is executed. Here, the first step of turning on the flash may be referred to as pre-emission by pre-emission.

The controller 180 may apply the AE algorithm while the flash is first turned on. Specifically, the controller 180 may set the exposure time or ISO of the camera while the first flash is on.

At this time, when the flash is first turned on, the controller 180 always outputs light with a constant brightness of light.

The controller 180 may turn off the flash after the exposure time or ISO of the camera is set while the flash is first turned on.

Thereafter, the controller 180 may turn on the flash secondary after a predetermined time to have a delay.

The controller 180 may capture an image at a preset exposure time or ISO setting value when the flash is turned on while the flash is turned on.

At this time, the brightness of the light output while the first flash is on and the brightness of the light output while the second flash is on may be the same.

That is, as shown in Fig. 2B (a), conventionally, when shooting an image using a flash, the exposure time or ISO is first set while the flash is on. Subsequently, conventionally, the flash that is turned on primarily is turned off, the flash is turned on secondly after a predetermined time has elapsed, and the exposure time set while the flash is turned on firstly during the time when the flash is turned on is secondarily And ISO to shoot the image.

Accordingly, in the related art, since the flash has to be turned on/off multiple times, battery consumption due to peak current occurs, and there is a delay between the time the flash is first turned on and the time the second flash is turned on. So, there is a problem that the shooting time becomes longer.

The present invention can provide a control method using a flash that can solve this problem.

Referring to (b) of FIG. 2B, the present invention determines whether the state of the mobile terminal satisfies a preset condition when the camera application is executed.

Specifically, when the camera application is executed, the controller 180 may activate (or turn on) the camera and receive a preview image through the camera 121.

Thereafter, when the brightness of the preview image received through the camera 121 is equal to or less than a certain brightness, the controller 180 may determine whether the state of the mobile terminal satisfies a preset condition.

Here, when the brightness of the preview image is less than or equal to a certain brightness, it may mean that there is no area where the brightness is greater than or equal to a certain brightness in the preview image.

That is, when the brightness in a predetermined area or more in the preview image is greater than or equal to the predetermined brightness, it may be determined that the brightness of the preview image is greater than or equal to the predetermined brightness.

Also, when the brightness of the preview image is less than or equal to a certain brightness, it may also mean that the average brightness of pixels included in the preview video is less than or equal to a certain brightness.

On the other hand, if the brightness of the space where the mobile terminal is present (or a space for capturing an image or a space around the mobile terminal) is equal to or less than a predetermined brightness, the controller 180 satisfies the preset condition. Can judge.

The preset condition may include, for example, at least one of a case where the remaining battery power of the mobile terminal is equal to or greater than a certain amount and a movement of the mobile terminal is not detected.

When the brightness of the preview image received through the camera is less than or equal to a predetermined brightness, and the state of the mobile terminal satisfies the preset condition, the controller 180 may turn on the flash 124 before the photographing command is received.

That is, the control method illustrated in (a) and (b) of FIG. 2B may be whether or not the flash is turned on before a photographing command is received.

Conventionally, as shown in Fig. 2B (a), the flash may be turned on based on the reception of a photographing command. On the other hand, the present invention, as shown in Figure 2b (b), the flash may be turned on before the shooting command is received.

Then, the present invention can vary the brightness of the light output from the flash. Specifically, the controller 180 determines the brightness (or intensity of light) of the light output by the flash 124 so that the preview image received through the camera while the flash 124 is turned on satisfies a preset brightness/ It can be changed/changed.

In this state, when the photographing command is received, the controller 180 may photograph (capture) the preview image.

The controller 180 can maintain the execution of the camera application even if the preview image is taken (that is, the camera can be turned on).

When the photographing of the preview image is completed, the controller 180 may turn off the flash.

In addition, the controller 180 may maintain the on state of the flash so that the flash continues to output light even when photographing of the preview image is completed.

In addition, when photographing of the preview image is completed, the controller 180 determines the on state of the flash based on whether the brightness of the preview image is equal to or less than a predetermined brightness and whether the state of the mobile terminal satisfies a preset condition. You can decide whether to keep it or turn off the flash.

For example, when the brightness of the preview image is equal to or less than a predetermined brightness, and the state of the mobile terminal satisfies a preset condition, the controller 180 may maintain the on state of the flash.

As another example, the controller 180 may turn off the flash when the brightness of the preview image is greater than or equal to a certain brightness, or if the state of the mobile terminal does not satisfy a preset condition.

In addition, when a user request for terminating the camera application is received after shooting of the preview image is completed, the controller 180 ends the camera application (that is, turns the camera off (disables)) and turns off the flash. Can.

As described above, according to the present invention, the flash is turned on before a shooting command is received, so that the preview image can be taken while the flash is continuously turned on. Accordingly, the present invention can omit the AE algorithm to adjust the exposure time and ISO, so that it is possible to shoot quickly in the dark.

In addition, the present invention, by continuously turning on the flash before the shooting command is received, by varying the brightness of the light output from the flash itself, by taking a preview image while obtaining a sufficient amount of light, high-quality images in the dark It is possible to do.

Hereinafter, with reference to the accompanying drawings, it will be described in more detail with respect to the method for taking an image using the flash of the present invention.

3 is a flowchart illustrating a representative control method of the present invention, and FIGS. 4, 5, 6, and 7 are conceptual diagrams for explaining the control method discussed in FIG. 3.

First, the mobile terminal of the present invention may include a camera 121, a flash 124, a sensing unit 140 sensing a state of the mobile terminal, and a control unit 180 controlling them.

The controller 180 may execute a camera application capable of capturing an image (preview image) through the camera 121. The camera application may be executed based on the user's request (or user's manipulation) being received.

As an example, the camera application, as shown in (a) of FIG. 4, is based on a touch applied (or selected) to the icon 410 of the camera application or a user input received at a user input unit. Can be executed.

When the camera application is executed, the camera 121 may be turned on (or activated) (S302).

The controller 180 may output the preview image 430 to the display unit 151 based on the camera application being executed.

The controller 180, when the camera application capable of taking an image through the camera 121 is executed, the flash 124 to output light based on the condition of the mobile terminal that satisfies a preset condition. Can be controlled.

Specifically, if the state of the mobile terminal satisfies a preset condition in a state in which the camera application is executed, the controller 180 may automatically output light through the flash 124 before a photographing command is received.

That is, the present invention may turn on the flash 124 when the state of the mobile terminal satisfies a preset condition even when a photographing command is not received.

The preset condition may include, for example, at least one of a case where the remaining battery power of the mobile terminal is equal to or greater than a certain amount and a movement of the mobile terminal is not detected.

On the other hand, before determining whether the state of the mobile terminal satisfies the preset condition, the controller 180 determines whether the brightness of the preview image received through the camera is equal to or less than a predetermined brightness (or a space in which the mobile terminal exists, It is possible to determine whether the brightness of the space in which the image is to be captured or the surrounding space of the mobile terminal is less than a predetermined brightness (S304).

For example, when the brightness of the preview image received through the camera is less than or equal to a certain brightness (for example, 30Lux or less), as shown in FIG. 4B, the controller 180 has a state of the mobile terminal. It may be determined whether or not the predetermined condition is satisfied (S306).

When the brightness of the preview image received through the camera 121 is equal to or less than a certain brightness, the control unit 180 does not detect the movement of the mobile terminal when the remaining battery power is greater than a certain amount (ie, the status of the mobile terminal) If the preset condition is satisfied), the flash can be turned on before the shooting command is received.

Here, that the flash is on means that the flash is not turned on manually by a user request, but is automatically turned on by the control of the control unit based on satisfying a preset condition.

In this case, as illustrated in (c) of FIG. 4, the controller 180 may output the light 440 through the flash 124.

As illustrated in FIG. 4C, the controller 180 is based on the state of the mobile terminal that satisfies a preset condition in a state in which the brightness of the preview image received through the camera 121 is equal to or less than a certain brightness. By doing so, the flash 124 can be turned on. At this time, the control unit 180 may fix the AE setting value.

In other words, when the flash unit 124 is turned on, the controller 180 can fix the exposure time or the ISO value to a predetermined value without changing it (S308). However, the present invention is not limited thereto, and the controller 180 may use exposure time and ISO associated with each brightness of the preview image 430 based on the brightness of the preview image 430 received while the flash 124 is turned on. AE settings can be determined. In this case, the determined AE setting value may be fixed (maintained).

As illustrated in FIG. 4B, the preview image 430 (or the display unit 151) includes a first graphic object 420a (eg, a still image) associated with a function of photographing a still image. A shooting button) and a second graphic object 420b (eg, a video shooting button) associated with a function of shooting a video may be displayed.

The shooting command may include a still image shooting command and a video shooting command.

When a touch is applied to the first graphic object, a still image shooting command is received, and when a touch is applied to the second graphic object, a video shooting command may be received.

The controller 180 may capture a still image based on the first graphic object being touched and start recording a video based on the second graphic object being touched.

As shown in (d) of FIG. 4, when the flash 124 is turned on and a photographing command is received (for example, when a touch is applied to the first graphic object 420b), the controller 180 ), the preview image 430 can be taken.

Meanwhile, the controller 180 may determine whether a face region is detected in a preview image received through the camera 124 while outputting light through the flash 124 (Face Detected, FD) ( S310).

The controller 180 may set the target brightness of the preview image differently based on whether a face region is detected in the preview image received through the camera while the light is output through the flash 124.

For example, when the face region 510 is detected in the preview image 430, the controller 180, as shown in FIG. 5(a), displays the brightness of the face region included in the preview image. The target brightness T may be set to be a preset first brightness ROI_B (S312).

As another example, the controller 180, as shown in FIG. 5(b), when a face region is not detected in the preview image, a preset second brightness having an average brightness of the preview image different from the first brightness. The target brightness may be set to be (Global_B) (S314).

That is, the controller 180 may vary the brightness of the light output from the flash 124 so that the brightness detected in the preview image becomes the target brightness.

For example, when the face region is detected in the preview image, the controller 180 may change the brightness of the light output from the flash 124 so that the brightness of the face region detected in the preview image becomes the target brightness (ROI_B). .

As another example, if the face region is not detected in the preview image, the controller 180 may vary the brightness of the light output from the flash 124 so that the average brightness of the preview image is the target brightness (Global_B).

In addition, in the state in which the controller 180 outputs light through the flash 124, the brightness of the light output by the flash 124 based on whether a face area is detected in the preview image received through the camera 121 Can be controlled differently.

For example, when the face region 510 is detected in the preview image 430, the controller 180, as shown in FIG. The flash 124 may be controlled to have the brightness 520.

As another example, as illustrated in FIG. 5B, when the face region is not detected in the preview image, the controller 180 may have a second brightness different from the first brightness 520 when the brightness of the light is different. Flash 124 can be controlled to be 530.

Here, when the face region is detected in the preview image, the preset first brightness may mean the brightness of the light output from the flash such that the brightness of the face region becomes the target brightness (T=ROI_B).

In addition, the second brightness (or the preset second brightness) means the brightness of light output from the flash such that when the face area is not detected in the preview image, the average brightness of the preview image becomes the target brightness (T=Global_B). can do.

Returning again, based on whether the target brightness T of the preview image is detected in the face region of the preview image, the controller 180 changes the brightness of the light output from the flash 124 using the equation described in S316. You can (adjust, change, correct).

Here, F_N is the brightness of the changed light output from the flash 124, a (alpha) is a constant greater than 0 and less than 1, F_C is the brightness of the current (before the change) light output from the flash 124, T is the target brightness Can.

The controller 180 may vary the brightness of the light output from the flash 124 through the above equation so that the brightness of the preview image can reach the target brightness (S316).

The controller 180 may capture a preview image when a photographing command is received while varying (or after varying) the brightness of the light output from the flash 124.

Meanwhile, after outputting light through the flash 124 (or after changing the brightness of the light through the flash), the controller 180 may determine whether the brightness of the preview image received through the camera is changed ( S318).

Here, P_N may mean the brightness of the preview image after outputting the light through the flash, and P_C may refer to the brightness of the preview image before outputting the light through the flash.

As another example, P_N is the brightness of the preview image after the brightness of the light output from the flash is changed, and P_C may refer to the brightness of the preview image before the brightness of the light output from the flash is changed.

The same P_N and P_C may mean that the brightness of the preview image received through the camera does not change even when light is output through the flash.

For example, as illustrated in FIG. 6, when the subject is too far from the mobile terminal, the light output from the flash is reflected and is not received by the camera, so the preview received through the camera even when the light is output through the flash The brightness of the image may not change.

If the brightness of the preview image received through the camera is not changed even though the light is output through the flash, the controller 180 may turn off the flash (S326). That is, if the brightness of the preview image received through the camera is not changed even though the light is output through the flash, the controller 180 can control the flash 124 to stop the flash 124 from outputting light. .

Although not shown, the controller 180 may determine whether the brightness of the preview image has reached the target brightness as the flash 124 changes the brightness of the light. For example, the determination may be performed in step S318.

When the brightness of the preview image reaches the target brightness as the flash 124 changes the brightness of the light, the controller 180 maintains the brightness of the light in the reached state and notifies that the brightness of the preview image has reached the target brightness The indicator may be output to the display unit (or preview image).

In this state, when a photographing command is received, the controller 180 may photograph (capture) the preview image in which the brightness of the preview image reaches the target brightness.

On the other hand, when the brightness of the preview image changes as the light is output through the flash (for example, P_N and P_C are different) (or, if the brightness of the preview image does not reach the target brightness), the controller 180 ) May determine whether the brightness of the light output from the flash (eg, the brightness F_N of the changed light) is the maximum brightness (F_MAX) (S320 ).

When the brightness of the light output through the flash 124 is not the maximum brightness, the controller 180 can determine whether the state of the mobile terminal satisfies a preset condition (S322).

When the state of the mobile terminal determined in step S322 satisfies a preset condition, the brightness of the light output from the flash (light intensity) so that the brightness of the preview image reaches the target brightness using the equation in step S316. Can be adjusted again.

If the state of the mobile terminal does not satisfy a predetermined condition (S322), the controller 180 may turn off the flash that is turned on (S326).

Meanwhile, when the brightness of the light output through the flash 124 is the maximum brightness, the controller 180 may adjust at least one of the exposure time and ISO (S324).

Specifically, the controller 180, when the brightness of the light output through the flash 124 is the maximum, the brightness of the preview image received through the camera 121 does not reach the target brightness, the shooting properties of the camera (Exposure time, ISO, etc.) can be changed.

In other words, when the brightness of the preview image does not reach the target brightness, the controller 180 adjusts at least one of exposure time and ISO when the brightness of the light output from the flash 124 is the maximum brightness. You can do

On the other hand, if the brightness of the preview image is higher than a certain brightness after the camera application is executed (S304) (or the brightness of the space where the mobile terminal is present) is not higher than the predetermined brightness, the controller 180 does not turn on the flash, An AE algorithm for adjusting exposure time and ISO may be performed (S328). This is because there is no need to turn on the flash since the surroundings are bright enough to allow sufficient light received through the camera.

In addition, even if the brightness of the preview image is less than or equal to a predetermined brightness (S304), if the state of the mobile terminal does not satisfy a preset condition (for example, the remaining battery power is less than a predetermined amount, or the mobile terminal moves) If not, the AE algorithm for adjusting the exposure time and ISO can be performed instead of turning on the flash (S328). This is to prevent the additional consumption of the battery due to the flash when the remaining battery level is less than a certain amount, and the mobile terminal moves because it means that the image is not captured.

For example, if the mobile terminal continues to move for a predetermined time or longer, the controller 180 determines that the preset condition is not satisfied, and when the mobile terminal stops after moving for a predetermined time or less, it determines that the preset condition is satisfied. can do.

In addition, when a specific object is detected to exist within a certain distance from the mobile terminal through the sensing unit 140, the controller 180 flashes the light 124 so as not to output light even if the state of the mobile terminal satisfies a preset condition. Can be controlled.

The predetermined distance may be set/changed by the user or may be predetermined when the mobile terminal is produced.

For example, the specific object may include all kinds of objects.

For example, as illustrated in FIG. 7, the specific object may be a pocket 700 or a desk 710. This may mean that the camera application is executed due to a malfunction/error by the user putting the mobile terminal in his pocket or putting the mobile terminal on the desk.

As described above, the controller 180, even if the brightness of the preview image is equal to or less than a certain brightness, and the state of the mobile terminal satisfies a preset condition, a specific object exists within a certain distance from the mobile terminal through the sensing unit 140 Then, the flash 124 can be kept in an off state without being turned on.

In this case, in this case, by not turning on the flash 124, even if the camera application is executed due to malfunction/mistake, there is an effect that battery consumption through the flash can be prevented.

If, after performing the video shooting through the camera application, if the mobile terminal is placed on the desk 710 or the pocket 700 is not terminated, the brightness of the light output by the flash is changed in step S318. Even if the brightness of the preview image is the same, the flash 124 may be turned off by the control of the controller 180.

Through this configuration, the present invention enables the flash to be turned on in advance before a photographing command is received, and the intensity of the light output from the flash is varied to reduce delays caused by conventional primary and secondary light emission.

In addition, the present invention does not control the flash by the conventional primary light emission and secondary light emission, but keeps the flash on, thereby reducing the glare of the user corresponding to the subject.

In addition, according to the present invention, by turning on the flash and varying the brightness of the light output from the flash, the brightness of the preview image can be increased to the target brightness. Accordingly, according to the present invention, since the exposure time can be quickly set in a dark environment and the preview image can be taken while the sensitivity of the ISO is lowered, the delay of the shooting time can be reduced and noise generated due to the ISO can be reduced. There is.

In addition, according to the present invention, if the brightness of the preview image does not change when the preset condition is not satisfied and the brightness of the light output from the flash is changed, the on-state flash is automatically turned off to reduce battery consumption. You can provide a solution.

In addition, the present invention can adjust (adjust) the brightness by calculating the brightness (intensity) of the light output from the flash as a log (log) as in the equation of S316. This is because the human eye recognizes brightness in a log form according to the human visual system (HVS). Accordingly, the present invention has an effect that the brightness of the light output from the flash 124 is calculated as a log and the brightness can be easily adjusted.

For the control method of the mobile terminal related to the present invention, a function/operation/control method performed by the controller 180 described above may be applied.

Specifically, the control method of the mobile terminal is based on the step of executing a camera application capable of taking an image through a camera, sensing the status of the mobile terminal, and satisfying a preset condition of the mobile terminal. , Outputting light through a flash.

In the outputting step, if the state of the mobile terminal satisfies the preset condition in a state in which the camera application is executed, light may be automatically output through the flash before a photographing command is received.

Further, in the control method of the mobile terminal, the outputting step may determine whether the state of the mobile terminal satisfies the preset condition when the brightness of the preview image received through the camera is equal to or less than a predetermined brightness. .

Specifically, before determining whether the state of the mobile terminal satisfies a preset condition, the controller 180 may first determine whether the brightness of the preview image is equal to or less than a predetermined brightness.

When the brightness of the preview image is equal to or less than a certain brightness, the mobile terminal of the present invention may determine whether the state of the mobile terminal satisfies a preset condition.

The preset condition may include at least one of a case where the remaining battery power of the mobile terminal is equal to or greater than a certain amount and a movement of the mobile terminal is not detected.

Also, in the outputting step, in a state in which light is output through the flash, a target brightness of the preview image may be set differently based on whether a face region is detected in the preview image received through the camera.

Further, the control method of the mobile terminal may further include stopping the flash from outputting the light if the brightness of the preview image received through the camera is not changed even though the light is output through the flash.

In addition, the control method of the mobile terminal, when the brightness of the light output through the flash is the maximum, when the brightness of the preview image received through the camera does not reach the target brightness, the camera's shooting properties (AE algorithm, The method may further include changing the AE setting value, exposure time, ISO).

According to the present invention, the present invention can provide a mobile terminal capable of taking a high-quality image without a delay time even in a dark situation by turning on the flash in advance before a photographing command is received.

In addition, according to the present invention, by varying the brightness of the light output from the flash before the shooting command is received, it is not necessary to change the shooting properties, and accordingly, the quality of the image can be prevented from changing as the shooting properties are changed.

In addition, the present invention is to adjust the brightness of the flash to match the target brightness of the preview image, and by shooting the image without changing the exposure time or ISO while the target brightness is set, blur caused by a long exposure time (blur ) And high ISO noise can be removed.

The above-described present invention can be embodied as computer readable codes on a medium on which a program is recorded. The computer-readable medium includes all kinds of recording devices in which data that can be read by a computer system are stored. Examples of computer-readable media include a hard disk drive (HDD), solid state disk (SSD), silicon disk drive (SDD), ROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical data storage device. This includes, and is also implemented in the form of a carrier wave (eg, transmission over the Internet). In addition, the computer may include a control unit 180 of the terminal. Accordingly, the above detailed description should not be construed as limiting in all respects, but should be considered illustrative. The scope of the invention should be determined by rational interpretation of the appended claims, and all changes within the equivalent scope of the invention are included in the scope of the invention.

Claims (14)

camera;
flash;
A sensing unit sensing a state of the mobile terminal; And
And a controller that controls the flash to output light based on a condition in which the state of the mobile terminal satisfies a preset condition while a camera application capable of taking an image through the camera is executed,
The control unit,
When the state of the mobile terminal satisfies the preset condition while the camera application is executed, it is characterized in that it automatically outputs light through the flash before a photographing command is received.
The control unit,
If the brightness of the preview image received through the camera is not changed even though the light is output through the flash, the mobile terminal is controlled to stop the flash from outputting light. According to claim 1,
The control unit,
When the brightness of the preview image received through the camera is less than or equal to a certain brightness, the mobile terminal determines whether the state of the mobile terminal satisfies the preset condition. According to claim 1,
The preset condition includes at least one of a case where the remaining battery power of the mobile terminal is equal to or greater than a predetermined amount and a movement of the mobile terminal is not detected. According to claim 1,
The control unit,
In the state of outputting light through the flash, a mobile terminal characterized in that the target brightness of the preview image is set differently based on whether a face region is detected in the preview image received through the camera. The method of claim 4,
The control unit,
When a face region is detected in the preview image, the target brightness is set so that the brightness of the face region included in the preview image becomes a preset first brightness,
And when the face area is not detected in the preview image, the target brightness is set such that the average brightness of the preview image is a preset second brightness different from the first brightness. The method of claim 4,
The control unit,
And changing the brightness of the light output from the flash so that the brightness detected in the preview image becomes the target brightness. delete According to claim 1,
The control unit,
If the brightness of the light output through the flash is the maximum, and the brightness of the preview image received through the camera does not reach the target brightness, the mobile terminal characterized in that the shooting property of the camera is changed. According to claim 1,
The control unit,
When it is sensed that a specific object exists within a certain distance from the mobile terminal through the sensing unit, the mobile terminal characterized in that the flash is controlled to output no light even if the condition of the mobile terminal satisfies a preset condition. Executing a camera application capable of taking an image through a camera;
Sensing the state of the mobile terminal; And
And outputting light through a flash based on the condition of the mobile terminal satisfying a preset condition.
The step of outputting,
When the state of the mobile terminal satisfies the preset condition while the camera application is executed, it is characterized in that it automatically outputs light through the flash before a photographing command is received.
And if the brightness of the preview image received through the camera does not change even though the light is output through the flash, stopping the flash from outputting light. The method of claim 10,
The step of outputting,
If the brightness of the preview image received through the camera is less than a certain brightness, the control method of the mobile terminal characterized in that it determines whether the state of the mobile terminal satisfies the predetermined condition. The method of claim 10,
The step of outputting,
In a state in which light is output through the flash, a target terminal brightness of the preview image is set differently based on whether a face region is detected in the preview image received through the camera. delete The method of claim 10,
When the brightness of the light output through the flash is the maximum, and the brightness of the preview image received through the camera does not reach the target brightness, the method further comprising changing a shooting property of the camera. .

Images