KR20180047330A - Camera apparatus and mobile terminal having the same - Google Patents

Abstract

The present invention provides a camera device which includes a lighting unit composed of a plurality of segments capable of outputting light at different intensities of light, a camera unit which forms an image by receiving the light reflected by an object and includes an image sensor composed of a plurality of pixels corresponding to the plurality of segments, and a control unit for controlling the on and off of the camera unit and controlling the plurality of segments to output light with the specific intensity of light. Accordingly, the present invention can implement an image with high quality.

Description

[0001] CAMERA APPARATUS AND MOBILE TERMINAL HAVING THE SAME [0002]

The present invention relates to a camera apparatus for forming a stereoscopic image.

The mobile terminal includes a battery and a display unit, and outputs all information to a display unit using a power source supplied from a battery, and includes all the devices that the user can carry. The mobile terminal includes a device for recording and playing back moving pictures, a device for displaying a graphic user interface (GUI), and the like, and includes a notebook, a mobile phone, a glasses and a clock capable of displaying screen information, .

As the functions of electronic devices are diversified, they are implemented in the form of a multimedia player having multiple functions such as photographing and video shooting, music and video file playback, games, and broadcasting reception. In order to support and enhance the functionality of such a mobile terminal, it may be considered to improve the structural and / or software aspects of the mobile terminal.

Recently, a method of calculating a shift amount of reflected light by irradiating an object with a laser beam coded with a specific pattern and a time of flight (TOF) method have been studied as a method for acquiring a three-dimensional image. The TOF method is a method of measuring the depth by directly irradiating the object with light and calculating the time of the reflected light coming back.

The first method is disadvantageous in that it is difficult to use as a component of a mobile terminal because it is not suitable for a miniaturized camera due to the physical size of a device that receives coded reflected light while using a laser light source. In general, it is also difficult to optimize depth resolution in various environments by using a fixed focus lens and a passive coding device. In the second method, the TOF-dedicated sensor is expensive, and the light-emitting LED has a disadvantage of increasing the power consumption of the mobile terminal.

In addition, there is a method of measuring the distance by using the right and left cameras with the left and right parallax. However, there is a problem that the function is deteriorated at night, the cost of the camera module is doubled, and the quality is deteriorated due to the alignment error.

In the case of an image sensor having a global shutter, an image is formed using light incident on a camera in a short period of time, but a high-capacity memory is required and the unit price is high. In addition, the rolling shutter has a disadvantage in that it is difficult to realize a high-quality image due to the possibility of noise due to the driving state and the external environment because the recording time is different for each area of the image.

Accordingly, the present invention provides a camera device for forming a high-quality image through control of an image sensor and a lighting unit.

According to an aspect of the present invention, there is provided a camera apparatus comprising: an illumination unit including a plurality of segments capable of outputting light at different amounts of light; a light source for receiving the light reflected by the object, And a plurality of pixels corresponding to the plurality of segments,

A camera unit having an unknown sensor and a control unit for controlling ON / OFF of the camera unit and controlling the plurality of segments to output light of a specific amount of light.

As an example related to the present invention, the control unit may further include a sensing unit for controlling the illuminating unit or for sensing external light so that the light amount gradually decreases from an edge area to a center area of the illuminating unit, The unit can adjust the amount of light output from the segment according to the time, based on the light amount and position of the external light sensed by the sensing unit, thereby preventing the vignetting phenomenon.

As an example related to the present invention, the control unit controls the illumination unit such that light is output from each segment according to the passage of time during a plurality of frames,

The control unit can control the lighting unit to block the output of the light for a superimposed time period in which a plurality of frames overlap with each other, so that noise that may be generated by receiving light output from the lighting segment of the non- .

As an example related to the present invention, the control unit can output light only for a specific time except for the overlap time within each frame of the plurality of frames, so that the user can form an image with only a desired area.

According to the present invention, since light having an appropriate amount of light can be provided to each region of an image by the light source section divided into a plurality of segments, it is possible to prevent a vignetting phenomenon in which a peripheral region or an edge region of the image is darkened. In addition, a high-quality image can be realized by adjusting the light quantity of each of a plurality of segments according to the inflow of external light.

Also, by synchronizing the driving of the light source unit that outputs light with the rolling shutter that receives light in each pixel according to the passage of time, the output of light in a state in which the output of light is superposed and the activity of the image sensor are controlled, Thereby providing the minimized image.

1A is a block diagram illustrating a mobile terminal according to the present invention.
1B and 1C are conceptual diagrams illustrating an example of a mobile terminal according to the present invention in different directions.
2A is a conceptual diagram illustrating components of a camera device of a mobile terminal according to an exemplary embodiment of the present invention.
FIG. 2B is a conceptual diagram illustrating components of a camera device of a mobile terminal according to another embodiment of the present invention.
3A is a conceptual diagram for explaining a control method of an illumination unit and an image sensor according to an embodiment of the present invention.
3B is a conceptual diagram for explaining a feature of changing the light amount according to an embodiment of the present invention.
4A to 4C are conceptual diagrams for explaining a method of controlling a camera device according to an embodiment of the present invention.
5A and 5B are conceptual diagrams for explaining a control method of the lighting unit for supplementing the overlapping section.
6 to 8 are conceptual diagrams for explaining a control method of a lighting unit according to various embodiments of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like or similar components are denoted by the same reference numerals, and redundant explanations thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. , ≪ / RTI > equivalents, and alternatives.

The mobile terminal described in this specification includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, a slate PC A tablet PC, an ultrabook, a wearable device such as a smartwatch, a smart glass, and a head mounted display (HMD). have.

The mobile terminal described in this specification includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, a slate PC A tablet PC, an ultrabook, a wearable device such as a smartwatch, a smart glass, and a head mounted display (HMD). have.

However, it will be appreciated by those skilled in the art that the configuration according to the embodiments described herein may be applied to fixed terminals such as a digital TV, a desktop computer, a digital signage, and the like, will be.

1A to 1C are block diagrams for explaining a mobile terminal according to the present invention, and FIGS. 1B and 1C are conceptual diagrams showing an example of a mobile terminal according to the present invention in different directions.

The mobile terminal 100 includes a wireless communication unit 110, an input unit 120, a sensing unit 140, an output unit 150, an interface unit 160, a memory 170, a control unit 180, ), And the like. The components shown in FIG. 1A are not essential for implementing a mobile terminal, so that the mobile terminal described herein may have more or fewer components than the components listed above.

The wireless communication unit 110 may be connected between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and another mobile terminal 100 or between the mobile terminal 100 and the external server 100. [ Lt; RTI ID = 0.0 > wireless < / RTI > In addition, the wireless communication unit 110 may include one or more modules for connecting the mobile terminal 100 to one or more networks.

The wireless communication unit 110 may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short distance communication module 114, and a location information module 115 .

The input unit 120 includes a camera 121 or an image input unit for inputting a video signal, a microphone 122 for inputting an audio signal, an audio input unit, a user input unit 123 for receiving information from a user A touch key, a mechanical key, and the like). The voice data or image data collected by the input unit 120 may be analyzed and processed by a user's control command.

The sensing unit 140 may include at least one sensor for sensing at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information. For example, the sensing unit 140 may include a proximity sensor 141, an illumination sensor 142, a touch sensor, an acceleration sensor, a magnetic sensor, A G-sensor, a gyroscope sensor, a motion sensor, an RGB sensor, an infrared sensor, a finger scan sensor, an ultrasonic sensor, A microphone 226, a battery gauge, an environmental sensor (for example, a barometer, a hygrometer, a thermometer, a radiation detection sensor, A thermal sensor, a gas sensor, etc.), a chemical sensor (e.g., an electronic nose, a healthcare sensor, a biometric sensor, etc.). Meanwhile, the mobile terminal disclosed in the present specification can combine and utilize information sensed by at least two of the sensors.

The output unit 150 includes at least one of a display unit 151, an acoustic output unit 152, a haptic tip module 153, and a light output unit 154 to generate an output related to visual, auditory, can do. The display unit 151 may have a mutual layer structure with the touch sensor or may be integrally formed to realize a touch screen. The touch screen may function as a user input unit 123 that provides an input interface between the mobile terminal 100 and a user and may provide an output interface between the mobile terminal 100 and a user.

The interface unit 160 serves as a path to various types of external devices connected to the mobile terminal 100. The interface unit 160 is connected to a device having a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, And may include at least one of a port, an audio I / O port, a video I / O port, and an earphone port. In the mobile terminal 100, corresponding to the connection of the external device to the interface unit 160, it is possible to perform appropriate control related to the connected external device.

In addition, the memory 170 stores data supporting various functions of the mobile terminal 100. The memory 170 may store a plurality of application programs or applications running on the mobile terminal 100, data for operation of the mobile terminal 100, and commands. At least some of these applications may be downloaded from an external server via wireless communication. Also, at least a part of these application programs may exist on the mobile terminal 100 from the time of shipment for the basic functions (e.g., telephone call receiving function, message receiving function, and calling function) of the mobile terminal 100. Meanwhile, the application program may be stored in the memory 170, installed on the mobile terminal 100, and may be operated by the control unit 180 to perform the operation (or function) of the mobile terminal.

In addition to the operations related to the application program, the control unit 180 typically controls the overall operation of the mobile terminal 100. The control unit 180 may process or process signals, data, information, and the like input or output through the above-mentioned components, or may drive an application program stored in the memory 170 to provide or process appropriate information or functions to the user.

In addition, the controller 180 may control at least some of the components illustrated in FIG. 1A in order to drive an application program stored in the memory 170. FIG. In addition, the controller 180 may operate at least two of the components included in the mobile terminal 100 in combination with each other for driving the application program.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power to the components included in the mobile terminal 100. The power supply unit 190 includes a battery, which may be an internal battery or a replaceable battery.

At least some of the components may operate in cooperation with one another to implement a method of operation, control, or control of a mobile terminal according to various embodiments described below. In addition, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 170. [

Hereinafter, the various components of the mobile terminal 100 will be described in detail with reference to FIG. 1A.

First, referring to the wireless communication unit 110, the broadcast receiving module 111 of the wireless communication unit 110 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The mobile communication module 112 may be a mobile communication module or a mobile communication module such as a mobile communication module or a mobile communication module that uses technology standards or a communication method (e.g., Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution And an external terminal, or a server on a mobile communication network established according to a long term evolution (AR), a long term evolution (AR), or the like.

The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. The wireless Internet module 113 is configured to transmit and receive a wireless signal in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, wireless LAN (WLAN), wireless fidelity (Wi-Fi), wireless fidelity (Wi-Fi) Direct, DLNA (Digital Living Network Alliance), WiBro Interoperability for Microwave Access, High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE) and Long Term Evolution-Advanced (LTE-A) 113 transmit and receive data according to at least one wireless Internet technology, including Internet technologies not listed above.

The wireless Internet module 113 for performing a wireless Internet connection through the mobile communication network can be used for wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE or LTE- May be understood as a kind of the mobile communication module 112.

The short-range communication module 114 is for short-range communication, and includes Bluetooth ™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB) (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology. The short-range communication module 114 is connected to the mobile terminal 100 and the wireless communication system through the wireless area networks, between the mobile terminal 100 and another mobile terminal 100, or between the mobile terminal 100 ) And the other mobile terminal 100 (or the external server). The short-range wireless communication network may be a short-range wireless personal area network.

Here, the other mobile terminal 100 may be a wearable device (e.g., a smartwatch, a smart glass, etc.) capable of interchanging data with the mobile terminal 100 according to the present invention (smart glass), HMD (head mounted display)). The short range communication module 114 may detect (or recognize) a wearable device capable of communicating with the mobile terminal 100 around the mobile terminal 100. [ If the detected wearable device is a device authenticated to communicate with the mobile terminal 100 according to the present invention, the control unit 180 may transmit at least a part of the data processed by the mobile terminal 100 to the short- 114 to the wearable device. Therefore, the user of the wearable device can use the data processed by the mobile terminal 100 through the wearable device. For example, according to this, when a telephone is received in the mobile terminal 100, the user performs a telephone conversation via the wearable device, or when a message is received in the mobile terminal 100, It is possible to check the message.

The position information module 115 is a module for obtaining the position (or current position) of the mobile terminal, and a representative example thereof is a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, when the mobile terminal utilizes the GPS module, it can acquire the position of the mobile terminal by using a signal transmitted from the GPS satellite. As another example, when the mobile terminal utilizes the Wi-Fi module, it can acquire the position of the mobile terminal based on information of a wireless access point (AP) that transmits or receives the wireless signal with the Wi-Fi module. Optionally, the location information module 115 may perform any of the other functions of the wireless communication unit 110 to obtain data relating to the location of the mobile terminal, in addition or alternatively. The location information module 115 is a module used to obtain the location (or current location) of the mobile terminal, and is not limited to a module that directly calculates or obtains the location of the mobile terminal.

Next, the input unit 120 is for inputting image information (or signal), audio information (or signal), data, or information input from a user. For inputting image information, Or a plurality of cameras 121 may be provided. The camera 121 processes an image frame such as a still image or moving image obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame may be displayed on the display unit 151 or stored in the memory 170. [ A plurality of cameras 121 provided in the mobile terminal 100 may be arranged to have a matrix structure and various angles or foci may be provided to the mobile terminal 100 through the camera 121 having the matrix structure A plurality of pieces of image information can be input. In addition, the plurality of cameras 121 may be arranged in a stereo structure to acquire a left image and a right image for realizing a stereoscopic image.

The microphone 122 processes the external acoustic signal into electrical voice data. The processed voice data can be utilized variously according to a function (or a running application program) being executed in the mobile terminal 100. Meanwhile, the microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in receiving an external sound signal.

The user input unit 123 is for receiving information from a user and when the information is inputted through the user input unit 123, the control unit 180 can control the operation of the mobile terminal 100 to correspond to the input information . The user input unit 123 may include a mechanical input means (or a mechanical key such as a button located on the front, rear or side of the mobile terminal 100, a dome switch, a jog wheel, Jog switches, etc.) and touch-type input means. For example, the touch-type input means may comprise a virtual key, a soft key or a visual key displayed on the touch screen through software processing, And a touch key disposed on the touch panel. Meanwhile, the virtual key or the visual key can be displayed on a touch screen having various forms, for example, a graphic, a text, an icon, a video, As shown in FIG.

Meanwhile, the sensing unit 140 senses at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information, and generates a corresponding sensing signal. The control unit 180 may control the driving or operation of the mobile terminal 100 or may perform data processing, function or operation related to the application program installed in the mobile terminal 100 based on the sensing signal. Representative sensors among various sensors that may be included in the sensing unit 140 will be described in more detail.

First, the proximity sensor 141 refers to a sensor that detects the presence of an object approaching a predetermined detection surface, or the presence of an object in the vicinity of the detection surface, without mechanical contact by using electromagnetic force or infrared rays. The proximity sensor 141 may be disposed in the inner area of the mobile terminal or in proximity to the touch screen, which is covered by the touch screen.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. In the case where the touch screen is electrostatic, the proximity sensor 141 can be configured to detect the proximity of the object with a change of the electric field along the proximity of the object having conductivity. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of explanation, the act of recognizing that the object is located on the touch screen in proximity with no object touching the touch screen is referred to as "proximity touch & The act of actually touching an object on the screen is called a "contact touch. &Quot; The position at which the object is closely touched on the touch screen means a position where the object corresponds to the touch screen vertically when the object is touched. The proximity sensor 141 can detect a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, have. Meanwhile, the control unit 180 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern sensed through the proximity sensor 141 as described above, and further provides visual information corresponding to the processed data It can be output on the touch screen. Furthermore, the control unit 180 can control the mobile terminal 100 such that different operations or data (or information) are processed according to whether the touch to the same point on the touch screen is a proximity touch or a touch touch .

The touch sensor senses a touch (or touch input) applied to the touch screen (or the display unit 151) by using at least one of various touch methods such as a resistance film type, a capacitive type, an infrared type, an ultrasonic type, do.

For example, the touch sensor may be configured to convert a change in a pressure applied to a specific portion of the touch screen or a capacitance generated in a specific portion to an electrical input signal. The touch sensor may be configured to detect a position, an area, a pressure at the time of touch, a capacitance at the time of touch, and the like where a touch object touching the touch screen is touched on the touch sensor. Here, the touch object may be a finger, a touch pen, a stylus pen, a pointer, or the like as an object to which a touch is applied to the touch sensor.

Thus, when there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like. Here, the touch controller may be a separate component from the control unit 180, and may be the control unit 180 itself.

On the other hand, the control unit 180 may perform different controls or perform the same control according to the type of the touch object touching the touch screen (or a touch key provided on the touch screen). Whether to perform different controls or to perform the same control according to the type of the touch object may be determined according to the current state of the mobile terminal 100 or an application program being executed.

On the other hand, the touch sensors and the proximity sensors discussed above can be used independently or in combination to provide a short touch (touch), a long touch, a multi touch, a drag touch ), Flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, and the like. Touch can be sensed.

The ultrasonic sensor can recognize the position information of the object to be sensed by using ultrasonic waves. Meanwhile, the controller 180 can calculate the position of the wave generating source through the information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave source can be calculated using the fact that the light is much faster than the ultrasonic wave, that is, the time when the light reaches the optical sensor is much faster than the time the ultrasonic wave reaches the ultrasonic sensor. More specifically, the position of the wave generating source can be calculated using the time difference with the time when the ultrasonic wave reaches the reference signal.

The camera 121 includes at least one of a camera sensor (for example, a CCD, a CMOS, etc.), a photo sensor (or an image sensor), and a laser sensor.

The camera 121 and the laser sensor may be combined with each other to sense a touch of the sensing object with respect to the three-dimensional stereoscopic image. The photosensor can be laminated to the display element, which is adapted to scan the movement of the object to be detected proximate to the touch screen. More specifically, the photosensor mounts photo diodes and TRs (Transistors) in a row / column and scans the contents loaded on the photosensor using an electrical signal that varies according to the amount of light applied to the photo diode. That is, the photo sensor performs coordinate calculation of the object to be sensed according to the amount of change of light, and position information of the object to be sensed can be obtained through the calculation.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, the display unit 151 may display execution screen information of an application program driven by the mobile terminal 100 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information .

In addition, the display unit 151 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

In the stereoscopic display unit, a three-dimensional display system such as a stereoscopic system (glasses system), an autostereoscopic system (no-glasses system), and a projection system (holographic system) can be applied.

Referring to FIGS. 1B and 1C, the disclosed mobile terminal 100 includes a bar-shaped terminal body. However, the present invention is not limited thereto and can be applied to various structures such as a folder type, a flip type, a slide type, a swing type, and a swivel type in which a watch type, a clip type, a glass type or two or more bodies are relatively movably coupled . A description of a particular type of mobile terminal, although relevant to a particular type of mobile terminal, is generally applicable to other types of mobile terminals.

Here, the terminal body can be understood as a concept of referring to the mobile terminal 100 as at least one aggregate.

The mobile terminal 100 includes a case (for example, a frame, a housing, a cover, and the like) that forms an appearance. As shown, the mobile terminal 100 may include a front case 101 and a rear case 102. Various electronic components are disposed in the inner space formed by the combination of the front case 101 and the rear case 102. At least one rear case may be additionally disposed between the front case 101 and the rear case 102. [

A display unit 151 is disposed on a front surface of the terminal body to output information. The window 151a of the display unit 151 may be mounted on the front case 101 to form a front surface of the terminal body together with the front case 101. [

In some cases, electronic components may also be mounted on the rear case 102. Electronic parts that can be mounted on the rear case 102 include detachable batteries, an identification module, a memory card, and the like. In this case, a rear cover 103 for covering the mounted electronic components can be detachably coupled to the rear case 102. Therefore, when the rear cover 103 is separated from the rear case 102, the electronic parts mounted on the rear case 102 are exposed to the outside.

As shown, when the rear cover 103 is coupled to the rear case 102, a side portion of the rear case 102 can be exposed. In some cases, the rear case 102 may be completely covered by the rear cover 103 during the engagement. Meanwhile, the rear cover 103 may be provided with an opening for exposing the camera 121b and the sound output unit 152b to the outside.

These cases 101, 102, and 103 may be formed by injection molding of synthetic resin or may be formed of metal such as stainless steel (STS), aluminum (Al), titanium (Ti), or the like.

The mobile terminal 100 may be configured such that one case provides the internal space, unlike the above example in which a plurality of cases provide an internal space for accommodating various electronic components. In this case, a unibody mobile terminal 100 in which synthetic resin or metal is connected from the side to the rear side can be realized.

Meanwhile, the mobile terminal 100 may include a waterproof unit (not shown) for preventing water from penetrating into the terminal body. For example, the waterproof portion is provided between the window 151a and the front case 101, between the front case 101 and the rear case 102, or between the rear case 102 and the rear cover 103, And a waterproof member for sealing the inside space of the oven.

The mobile terminal 100 is provided with a display unit 151, first and second sound output units 152a and 152b, a proximity sensor 141, an illuminance sensor 142, a light output unit 154, Cameras 121a and 121b, first and second operation units 123a and 123b, a microphone 122, an interface unit 160, and the like.

1B and 1C, a display unit 151, a first sound output unit 152a, a proximity sensor 141, an illuminance sensor 142, an optical output unit (not shown) A second operation unit 123b, a microphone 122 and an interface unit 160 are disposed on a side surface of the terminal body, And a mobile terminal 100 having a second sound output unit 152b and a second camera 121b disposed on a rear surface thereof.

However, these configurations are not limited to this arrangement. These configurations may be excluded or replaced as needed, or placed on different planes. For example, the first operation unit 123a may not be provided on the front surface of the terminal body, and the second sound output unit 152b may be provided on the side surface of the terminal body rather than the rear surface of the terminal body.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, the display unit 151 may display execution screen information of an application program driven by the mobile terminal 100 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information .

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, a 3D display, and an e-ink display.

In addition, the display unit 151 may exist in two or more depending on the embodiment of the mobile terminal 100. In this case, the mobile terminal 100 may be provided with a plurality of display portions spaced apart from each other or disposed integrally with one another, or may be disposed on different surfaces, respectively.

The display unit 151 may include a touch sensor that senses a touch with respect to the display unit 151 so that a control command can be received by a touch method. When a touch is made to the display unit 151, the touch sensor senses the touch, and the control unit 180 generates a control command corresponding to the touch based on the touch. The content input by the touch method may be a letter or a number, an instruction in various modes, a menu item which can be designated, and the like.

The touch sensor may be a film having a touch pattern and disposed between the window 151a and a display (not shown) on the rear surface of the window 151a, or may be a metal wire . Alternatively, the touch sensor may be formed integrally with the display. For example, the touch sensor may be disposed on a substrate of the display or inside the display.

In this way, the display unit 151 can form a touch screen together with the touch sensor. In this case, the touch screen can function as a user input unit 123 (see FIG. 1A). In some cases, the touch screen may replace at least some functions of the first operation unit 123a.

The first sound output unit 152a may be implemented as a receiver for transmitting a call sound to a user's ear and the second sound output unit 152b may be implemented as a loud speaker for outputting various alarm sounds or multimedia playback sounds. ). ≪ / RTI >

The window 151a of the display unit 151 may be provided with an acoustic hole for emitting the sound generated from the first acoustic output unit 152a. However, the present invention is not limited to this, and the sound may be configured to be emitted along an assembly gap (for example, a gap between the window 151a and the front case 101) between the structures. In this case, the appearance of the mobile terminal 100 can be made more simple because the hole formed independently for the apparent acoustic output is hidden or hidden.

The optical output unit 154 is configured to output light for notifying the occurrence of an event. Examples of the event include a message reception, a call signal reception, a missed call, an alarm, a schedule notification, an email reception, and reception of information through an application. The control unit 180 may control the light output unit 154 to terminate the light output when the event confirmation of the user is detected.

The first camera 121a processes an image frame of a still image or a moving image obtained by the image sensor in the photographing mode or the video communication mode. The processed image frame can be displayed on the display unit 151 and can be stored in the memory 170. [

The first and second operation units 123a and 123b may be collectively referred to as a manipulating portion as an example of a user input unit 123 operated to receive a command for controlling the operation of the mobile terminal 100 have. The first and second operation units 123a and 123b can be employed in any manner as long as the user is in a tactile manner such as touch, push, scroll, or the like. In addition, the first and second operation units 123a and 123b may be employed in a manner that the user operates the apparatus without touching the user through a proximity touch, a hovering touch, or the like.

In this figure, the first operation unit 123a is a touch key, but the present invention is not limited thereto. For example, the first operation unit 123a may be a mechanical key, or a combination of a touch key and a touch key.

The contents input by the first and second operation units 123a and 123b can be variously set. For example, the first operation unit 123a receives a command such as a menu, a home key, a cancellation, a search, and the like, and the second operation unit 123b receives a command from the first or second sound output unit 152a or 152b The size of the sound, and the change of the display unit 151 to the touch recognition mode.

On the other hand, a rear input unit (not shown) may be provided on the rear surface of the terminal body as another example of the user input unit 123. The rear input unit is operated to receive a command for controlling the operation of the mobile terminal 100, and input contents may be variously set. For example, commands such as power on / off, start, end, scrolling, and the like, the size adjustment of the sound output from the first and second sound output units 152a and 152b, And the like can be inputted. The rear input unit may be implemented as a touch input, a push input, or a combination thereof.

The rear input unit may be disposed so as to overlap with the front display unit 151 in the thickness direction of the terminal body. For example, the rear input unit may be disposed at the rear upper end of the terminal body such that when the user holds the terminal body with one hand, the rear input unit can be easily operated using the index finger. However, the present invention is not limited thereto, and the position of the rear input unit may be changed.

When a rear input unit is provided on the rear surface of the terminal body, a new type of user interface using the rear input unit can be realized. When the first operation unit 123a is not disposed on the front surface of the terminal body in place of at least a part of the functions of the first operation unit 123a provided on the front surface of the terminal body, The display unit 151 may be configured as a larger screen.

Meanwhile, the mobile terminal 100 may be provided with a fingerprint recognition sensor for recognizing the fingerprint of the user, and the controller 180 may use the fingerprint information sensed through the fingerprint recognition sensor as authentication means. The fingerprint recognition sensor may be embedded in the display unit 151 or the user input unit 123.

The microphone 122 is configured to receive the user's voice, other sounds, and the like. The microphone 122 may be provided at a plurality of locations to receive stereophonic sound.

The interface unit 160 is a path through which the mobile terminal 100 can be connected to an external device. For example, the interface unit 160 may include a connection terminal for connection with another device (for example, an earphone or an external speaker), a port for short-range communication (for example, an infrared port (IrDA Port), a Bluetooth port A wireless LAN port, or the like), or a power supply terminal for supplying power to the mobile terminal 100. The interface unit 160 may be implemented as a socket for receiving an external card such as a SIM (Subscriber Identification Module) or a UIM (User Identity Module) or a memory card for storing information.

The second display unit 251 is disposed on the rear surface of the terminal body according to the present invention. Therefore, an additional rear camera and a flash may not be disposed on the rear surface of the terminal body.

And a second sound output unit 152b may be further disposed on the rear surface of the terminal body. The second sound output unit 152b may implement a stereo function together with the first sound output unit 152a and may be used for implementing a speakerphone mode in a call.

The terminal body may be provided with at least one antenna for wireless communication. The antenna may be embedded in the terminal body or formed in the case. For example, an antenna constituting a part of the broadcast receiving module 111 (see FIG. 1A) may be configured to be able to be drawn out from the terminal body. Alternatively, the antenna may be formed in a film type and attached to the inner surface of the rear cover 103, or a case including a conductive material may be configured to function as an antenna.

The terminal body is provided with a power supply unit 190 (see FIG. 1A) for supplying power to the mobile terminal 100. The power supply unit 190 may include a battery 191 built in the terminal body or detachable from the outside of the terminal body.

The battery 191 may be configured to receive power through a power cable connected to the interface unit 160. In addition, the battery 191 may be configured to be wirelessly chargeable through a wireless charger. The wireless charging may be implemented by a magnetic induction method or a resonance method (magnetic resonance method).

The rear cover 103 is configured to be coupled to the rear case 102 so as to cover the battery 191 to restrict the release of the battery 191 and to protect the battery 191 from external impact and foreign matter . When the battery 191 is detachably attached to the terminal body, the rear cover 103 may be detachably coupled to the rear case 102.

The mobile terminal 100 may be provided with an accessory that protects the appearance or supports or expands the function of the mobile terminal 100. [ One example of such an accessory is a cover or pouch that covers or accommodates at least one side of the mobile terminal 100. [ The cover or pouch may be configured to interlock with the display unit 151 to expand the function of the mobile terminal 100. Another example of an accessory is a touch pen for supplementing or extending a touch input to the touch screen.

Hereinafter, embodiments related to a control method that can be implemented in a mobile terminal configured as above will be described with reference to the accompanying drawings. It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

A mobile terminal according to the present invention includes a camera device for forming a three-dimensional image using distance information of an object. The camera device emits light in a specific manner and detects the distance of the object using light reflected by the object. Hereinafter, components of a camera apparatus for forming an image including distance information will be described.

2A is a conceptual diagram illustrating components of a camera device of a mobile terminal according to an exemplary embodiment of the present invention. FIG. 2B is a conceptual diagram illustrating components of a camera device of a mobile terminal according to another embodiment of the present invention.

Referring to FIG. 2A, the camera apparatus 300 includes a lighting unit 310 and a camera unit 320. The illumination unit 310 and the camera unit 320 are disposed adjacent to each other. The illumination unit 310 emits light, and the light emitted from the illumination unit 310 is reflected from an object in front and received by the camera unit 320.

The illumination unit 310 includes a light source unit 311 and an optical unit 312. The light source unit 311 may be a laser diode (LD) or a vertical-cavity surface-emitting laser (VCSEL). The optical unit 312 may include at least one of an illumination optical element (the illumination optical element includes a transmission optical element, a lens, a reflection optical element, a mirror, and a prism), and a diffusion lens.

The light emitted from the light source unit 311 is transmitted to the outside through the optical unit 312 and the light transmitted to the outside is reflected by the object O and enters the camera unit 320. The optical unit 312 is formed to diverge the light emitted from the light source unit 311 at a specific angle of view.

The camera unit 320 includes a light receiving unit 321, a filter unit 322, a modulator 323, a polarizing sheet 324, and an image sensor 325. The light receiving portion 321 may include a lens having an angle of view substantially similar to that of the lens forming the optical portion 312. In order to prevent loss of light due to an assembly error of the illumination unit 310 and the camera unit 320, the angle of view of the lens forming the light receiving portion 321 is set to be the same as that of the lens constituting the optical portion 312 It is preferable that it is formed larger than the angle of view.

The filter unit 322 may include a band pass filter (BFP) that allows only the wavelength of the light emitted from the light source unit 311 to pass therethrough and blocks the remaining light. For example, when the near-infrared ray having a wavelength of about 808 nm, about 850 nm, or about 940 nm is emitted from the light source unit 311 to emit light having a monochromatic wavelength, the near- Including visible light). In this case, the filter unit 322 passes only the light emitted from the light source unit 311 except the external light.

Meanwhile, the filter unit 322 may be formed so as to block visible light using pass filters and to pass only near infrared rays. Alternatively, the filter portion may be formed by band-pass coating or pass-coating on one surface of the light receiving portion 321 without a separate filter.

The filter unit 322 may be disposed at the front most of the incident light of the camera unit 320 or may be disposed between the light receiving unit 321 and the image sensor 325.

The modulator 323 is composed of an optoelectronic device that applies pockels cells to produce a pockels effect. The Foquel effect is an effect of changing the polarization of light with polarized light passing through the inside of the pockel cell by applying an electric field inside the Pockels cell. The phase delay of the incident polarized light is generated according to the intensity of the electric field applied to the pockels (optical switching).

The modulator 323 adjusts the intensity of light passing through the polarizing sheet 324 according to time, and adjusts the amount of light incident on the pixels of the image sensor 325 by position / time.

The image sensor 325 may be at least one of a monochrome sensor, a color sensor, and an RGB-monochrome sensor. In the case of a monochrome sensor, high-quality depth information can be obtained by combining a light source of a specific wavelength and a band-pass filter. When a color filter is used, the corresponding color filter is placed in each RGB pixel, and depth information can be obtained using an IR cut filter. When a color filter is used, depth information of an object corresponding to RGB colors can be obtained. The RGB-monocrome sensor is a sensor that combines a monochrome pixel with an RGB sensor and uses a dual band pass filter. remind

Accordingly, the control unit 330 can calculate the distance of the object O reflected by the light through the intensity ratio of the polarization. The light emitted from the light source unit 311 is reflected by the object O and reaches the modulator 323. The time to reach the modulator 323 changes in proportion to the distance between the illumination unit 310 and the object O, and the time difference causes a difference in the phase difference and the light amount of the polarization.

That is, since the ratio of the amount of light reaching the image sensor 325 is proportional to the distance between the illumination unit 310 and the camera unit 320 and the object O, the control unit 330 controls the light amount A depth map can be generated based on the calculated distance based on the ratio of the depth map. The control unit 330 may calculate the delay time based on the speed of light and the distance (the set distance) from the camera device 300 to the object.

Polarizing sheets in different directions (directions perpendicular to each other) corresponding to each pixel of the image sensor 325 can be alternately arranged. Accordingly, light of different polarized light is separately incident on each pixel of the image sensor 325. One image is formed by light of different polarized light incident on the image sensor 325.

The control unit 330 may form a depth map using two images of polarized light in different directions.

On the other hand, the polarized image can be standardized using a pair of images using light incident for two frames. The illumination unit 310 outputs the same pulse light according to the passage of time during the first and second frames. The control unit 330 activates the modulator 323 during the first frame and deactivates the modulator 323 during the second frame. The polarimetric image formed in a state in which the modulator 323 is activated can be standardized on the basis of the image formed while the modulator 323 is deactivated to calculate the ratio of the intensity of the incident light.

In this case, it is preferable that the illumination unit 310 outputs pulse light of the same characteristic in a pair of frames, and the camera unit 320 uses a high-speed frame.

Meanwhile, the control unit 330 may control the light source unit 311 to output multiple pulses at a predetermined light amount for the measurement of the distance. Hereinafter, the characteristics of the pulses output will be described with reference to Figs. 3A to 7.

FIG. 2B illustrates a camera device 300 'according to another embodiment of the present invention includes a lighting unit 310' and a camera unit 320. FIG. The illumination unit 310 'includes a first polarizing plate 313, the light source 311 and the optical unit 312. The light source 311 and the optical unit 312 are connected to the camera device 300, and therefore, the same reference numerals are assigned to the components, and redundant description is omitted.

The first polarizing plate 313 is disposed in front of the light source unit 311, but the position of the first polarizing plate 313 is not limited thereto. That is, between the optical unit 3121 and the light source unit 311.

The first polarizing plate 313 may be linearly polarized light (H, V-horizontal or resin linearly polarized light) or circularly polarized light (CW, CCW, clockwise or counterclockwise). The first polarizer 313 can prevent the light emitted from the light source unit 311 from being disturbed by the external light.

Meanwhile, the camera unit 320 'additionally includes a polarizing sheet 324' and a second polarizing plate 326 in the light receiving unit 321, the filter unit 322, the modulator 323, and the image sensor 325 do. The light receiving section 321, the filter section 322, the modulator 323 and the image sensor 325 are substantially the same as those included in the camera apparatus 300 of FIG. 2A, And the description thereof will be omitted.

The second polarizing plate 326 is disposed in front of the light receiving unit 321 and receives polarized light reflected by the object O emitted from the illumination unit 310 '. The second polarizing plate 326 passes only light emitted from the light source unit 311.

The first and second polarizing plates 313 and 326 and the light source 311 may be formed by using an active element for changing polarized light according to time or a rotating element for changing the polarizing plates fixed by using a switching motor Can be used to change the polarization state. For example, it is possible to prevent deterioration of image quality by applying a specific polarization to a specific object.

The camera device 300 'according to the present embodiment may selectively include the first and second polarizing plates 313 and 326.

The polarizing sheet 324 'according to the present embodiment is formed so that different polarized light can be incident on each pixel. That is, the neighboring pixels receive mutually perpendicular polarized signals and can combine them to form a three-dimensional image. The polarizing sheet 324 'may be integrally formed with the modulator 323.

However, the camera device according to the present invention may be mounted on an electronic device, such as an automobile or a VR device, which requires formation and output of images, in addition to the mobile terminal described with reference to FIGS. 1A to 1C.

The illumination unit 310 of the present invention is divided into a plurality of segments each of which is controlled in output and light amount, and the image sensor 325 is composed of a plurality of pixels individually controlled ON / OFF. Hereinafter, characteristics in which the control of the plurality of segments and the plurality of pixels are synchronized will be described.

3A is a conceptual diagram for explaining a control method of an illumination unit and an image sensor according to an embodiment of the present invention.

3A is a conceptual diagram showing a lighting unit 310 according to an embodiment of the present invention. The illumination unit 310 comprises a plurality of individually controlled segments. The plurality of segments are controlled to output different amounts of light. For example, the control unit 330 can output light of a high light amount (100%) from the segment located at the edge and output light of a low light amount (20%) toward the center. Accordingly, it is possible to prevent a vignetting phenomenon that darkens toward the periphery of the lens.

On the other hand, the control unit 330 can individually control ON / OFF of a plurality of segments of the illumination unit 310. That is, the segment to be turned on varies with the passage of time. 3A, the control unit 330 turns on the upper left segment for outputting the first light amount (100%) at the first time t1, and turns on the upper left segment for the second time t2 ), The other segment disposed at the lower right end and outputting the second light amount (70%) is turned on. The segment at the lower right end of the segment at the upper left corner is controlled to be turned on according to the flow of time, and each segment can output light of a predetermined light amount, but the present invention is not limited thereto, Can be changed.

That is, the control unit 330 can adjust the amount of light output from each segment to a predetermined value or the amount of light output through external light sensed in real time.

3A is a conceptual diagram for explaining the operation of the image sensor 325. As shown in FIG. Referring to (b) of FIG. 3A, the control unit 330 controls the pixels to be exposed according to the passage of time. The image sensor 325 is made up of a plurality of pixels, and some of the pixels are selectively exposed according to the passage of time. In addition, the time of exposure of the pixels and the position of the pixel may correspond to the position of the segment that outputs light according to the flow of time.

For example, the control unit 330 is exposed to receive the upper left pixel at the first time t1, and gradually exposes pixels located at the lower right as time passes. Thus, the position and time are synchronized and light is recorded in the image sensor.

Accordingly, since light can be received only at the exposed pixels, light of a predetermined light amount is received by each pixel of the image sensor, so that power consumption can be minimized.

Hereinafter, when an image is formed in successive frames, the image of each frame

3B is a conceptual diagram for explaining a feature of changing the light amount according to an embodiment of the present invention.

The control unit 330 may adjust the amount of light output by the segments when the external light is detected by the specific sensing unit. For example, when the control unit 330 detects that external light is introduced from the right side by the sensing unit, the left-side segment outputs light of a high light amount, and the right- It is possible to control to output light of a low light amount. The amount of light can be sequentially increased or decreased.

Thus, uniform light can be introduced into the image while minimizing the influence of the incoming external light. The present invention can be applied to a vehicle camera or the like. In this case, the amount of light can be individually controlled in a situation where an HDR is required, thereby improving the dynamic range of an image.

4A to 4C are conceptual diagrams for explaining a method of controlling a camera device according to an embodiment of the present invention.

4A and 4B, within each frame according to time, the control unit 330 controls the light output of each segment of the illumination unit 310 and controls the light output of each pixel of the image sensor 325 .

For example, the control unit 330 selectively turns on a plurality of segments of the illumination unit 310 according to the passage of time to output light. As time passes, the segments may be controlled such that the lower left segment gradually emits light in the upper right segment, as shown in FIG. 4B. The intensity of light output at the same time may be set differently for each segment. The amount of light output by each segment may correspond to a preset amount of light, but is not limited thereto. That is, the control unit 330 can adjust the amount of light output by each segment based on a change in the external environment (external light input) or other control command.

During the first to third frames of the illumination unit 310, an overlap area in which the light output times of the first and second frames, the second and third frames overlap each other is formed. In other words, since the segment for outputting the light is formed differently in one frame in accordance with the passage of time, the ending time of the first frame may be set later than the start time of the second frame, Can output light in a state where different frames are set to different frames. In this case, noise of an image may occur while light of different frames is received by an image sensor of one frame.

Therefore, the illumination unit 310 according to the present embodiment is turned off in the first and third frames. That is, no light is output from all the segments in the first and third frames.

Meanwhile, the control unit 330 controls the light from the lighting unit 310 to be output from the start time Ts of the second frame to the end time Te of the second frame. In the second frame, the plurality of segments included in the illumination unit 310 are controlled to sequentially output light.

When light is output from the start time Ts to the end time Te during the second frame, during the same time (second frame), the image sensor 325 outputs the light corresponding to the segment Sequentially activated and received.

Accordingly, light of predetermined light quantity output by each segment is received by pixels of the corresponding image sensor, so that a uniform image can be formed. On the other hand, since the illumination unit 310 is not activated in the first and third frames, specific pixels of the image sensor 325 of the first and third frames are not received.

However, the control unit 330 may turn off the image sensor 325 during the first and third frames, although the light output during the second frame in the overlapping area A may be received, . That is, the control unit 330 turns on / off the image sensor 325 alternately. Thus, the image formed by the image sensor 325 may be made up of the second frame (s). Therefore, the noise of the image formed on the image sensor 325 of the second frame can be minimized, and a clear image can be formed.

4C is a conceptual diagram for explaining a control method of an image sensor according to another embodiment. The control unit 330 can simultaneously activate a plurality of pixels constituting the image sensor 325 at the same time. That is, when a plurality of pixel groups among the pixel groups activated by the image sensor 325 from the upper left to the lower right are activated at one time, the light is received in the left-to-right direction as shown in FIG. 4C.

5A and 5B are conceptual diagrams for explaining a control method of the lighting unit for supplementing the overlapping section.

Referring to FIG. 5A, the control unit 330 turns on / off the image sensor 325 and the illumination unit 310 during the first to third frames in accordance with the passage of time.

Specifically, the control unit 330 controls the illumination unit 310 to block the light output from the start time Ts2 of the second frame of the illumination unit 310 to the end time Te1 of the first frame do. Further, the illumination unit 310 is controlled so as to block the light output during the end time (Te2) of the second frame from the end time (Te3) of the third frame. Accordingly, light does not reach one area of the image sensor 325 of the second frame, and an image is not formed in one area of the image sensor 325. Also, light does not reach one area of the image sensor 325 of the first and third frames, and no image is formed.

5A, since the output of the time close to the start time Ts2 and the end time Te2 between the start time Ts2 of the second frame and the end time Te2 of the second frame is limited, An image of an area adjacent to the upper left and lower right ends is not formed.

Referring to FIG. 5B, the control unit 330 may activate the illumination unit 310 alternately with a plurality of frames. For example, the control unit 330 deactivates the illumination unit 310 in the first and third frames, and activates the illumination unit 310 in the second frame. Accordingly, light does not reach the image sensor 325 in the first and third frames, and images are formed alternately.

In addition, the control unit 330 may control the illumination unit 310 so as not to output light for a part of the second frame according to the shape of the image to be formed.

According to the present embodiment, it is possible to prevent a region where the light output is superimposed by the illumination unit of each frame, so that it is possible to prevent the image from being deformed due to superposition of light.

6 to 8 are conceptual diagrams for explaining a control method of a lighting unit according to various embodiments of the present invention.

Referring to FIG. 6, the control unit 330 controls the illumination unit 310 to output light only for a specific time of the second frame. The control unit 330 may output light only during a specific time of the second frame (from T2 to T3) to control the image to be formed only in a specific area of the image sensor of the second frame. The formed image may have a shape corresponding to one area of the image sensor.

The control unit 330 may block the light output of the illumination unit 310 during the first and third frames before and after the second frame. Accordingly, no image is formed in the image sensor 325 during the first and third frames.

Or the control unit 330 can control to output the light for a specific time of the first and third frames, and the specific time of the first and third frames is different from the specific time of the second frame Can be set. 6, the illumination unit 310 outputs light from a first time T1, which is later than the start time Ts1 of the first frame, to a start time Ts2 of the second frame, And outputs light from the end time (Te2) of the second frame to the fourth time (T4) later than the start time (Ts3) of the third frame.

However, the illumination unit 310 does not output light during the overlapping region formed between the first and second frames and the overlapping region formed between the second and third frames. That is, since there is no light output from the start time (Ts2) of the second frame to the end time (Te2) of the second frame from the second time (T2) and the third time (T3) It is possible to block the generated light noise.

Therefore, since no light is output to the overlapping region, the light noise formed on the image can be prevented, and the user can form a desired size image by adjusting the time during one frame during which light is output.

Referring to FIG. 7, the control unit 330 controls the illumination unit 310 to output light during the second frame. That is, the illumination unit 310 outputs light according to the time from the start time Ts2 to the end time Te2 of the second frame.

On the other hand, the illumination unit outputs or blocks light only for a specific time of the first and third frames. The lighting unit 310 intercepts the light output from the start time Ts2 of the second frame to the end time Te1 of the first frame and outputs the light output from the start time Ts3 of the third frame The optical output is cut off until the end time Te2. Therefore, the light corresponding to the first and third frames is not output from the illumination unit while the light is output during the second frame.

Therefore, only the light of the second frame is output in the overlap region formed between the frames, and the output of the light of the remaining frames is blocked.

On the other hand, the control unit 330 may control the lighting unit 310 to output light for a specific time of the first and third frames, based on a specific setting. For example, the illumination unit can output light from the start time (Ts2) of the second frame at the first time (T1) and the end time (Te2) of the second frame to the second time (T2) . Further, in this case, the control unit 330 can control the first through third frames of the image sensor to activate the image through the light.

Referring to FIG. 8, the control unit 330 controls the illumination unit 310 to output light only for a specific time of each frame. The illumination unit 310 outputs light from a specific time T1 of the first frame to an end time Te1 of the first frame and outputs light from the end time Te1 of the first frame in the second frame Outputs light until the end time (Te2) of the second frame, and outputs light from the end time (Te2) of the second frame to the end time (Te3) of the third frame in the third frame.

In this case, the image sensor 325 is activated in all the frames to receive light. In particular, in the overlap area A, different frames of the image sensor 325 may receive light output from a previous frame to form an image.

The end time of the frame of the illumination unit 310 is set to coincide with the end time of the frame of the image sensor 325, but the start times may be set to coincide with each other.

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, , And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). Also, the computer may include a control unit 180 of the terminal. Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

Claims (11)

An illumination unit comprising a plurality of segments capable of outputting light at different amounts of light;
A camera unit having an image sensor configured to receive the light reflected by the object to form an image, the image sensor comprising a plurality of pixels corresponding to the plurality of segments; And
And a control unit for controlling on / off (ON / OFF) of the camera unit and controlling the plurality of segments so as to output light of a specific amount of light. The method according to claim 1,
Wherein the control unit controls the illumination unit such that the light amount gradually decreases from the edge area to the center area of the illumination unit. 3. The method of claim 2,
Further comprising a sensing unit for sensing external light,
Wherein the control unit adjusts the amount of light output from the segment according to a time, based on a light amount and a position of external light sensed by the sensing unit. The method according to claim 1,
Wherein the image sensor comprises a plurality of pixels for recording an image according to a plurality of times,
Wherein the control unit controls the illumination unit to output light from at least one segment corresponding to each of the plurality of pixels in accordance with a passage of time. 5. The method of claim 4,
The control unit controls the illumination unit such that light is output from each segment according to the passage of time during a plurality of frames,
Wherein the control unit controls the lighting unit to block the output of the light for a superimposed time period in which a plurality of frames overlap each other. 6. The method of claim 5,
Wherein the control unit controls the illumination unit such that a part of a plurality of frames is alternately activated to output light. 6. The method of claim 5,
Wherein the control unit controls the image sensor so that a part of the plurality of frames is alternately activated to receive light. 6. The method of claim 5,
Wherein the control unit controls the illumination unit to output light only for a specific time except for the overlap time within each frame of the plurality of frames. 6. The method of claim 5,
Wherein the plurality of frames include first to third frames,
Wherein the control unit controls the illumination unit to block the output of the light during the overlapping time of the first frame and the third frame and to output light during the entire time of the second frame.
And outputs the light during the second frame 6. The method of claim 5,
Wherein the plurality of frames include first to third frames,
Wherein the control unit controls the illumination unit such that a segment corresponding to the second frame outputs light at an end time of the second frame at an end time of the first frame. A terminal body;
And a camera device mounted on one surface of the main body and photographing an image,
The camera device includes:
A camera unit having an image sensor configured to receive the light reflected by the object to form an image, the image sensor comprising a plurality of pixels corresponding to the plurality of segments;
A camera unit having an image sensor for receiving the light reflected by the object and forming an image; And
And a control unit for controlling the plurality of segments so as to output on / off (ON / OFF) of the camera unit and light of a specific amount of light.

Images