KR20200050714A - Terminal - Google Patents

Abstract

The present invention relates to a terminal. According to an embodiment of the present invention, the terminal comprises: a front camera; a rear camera; and a processor receiving a first image from the rear camera, receiving a second image from the front camera, detecting a gaze area within the first image based on the second image, and controlling the detected area to be focused. Accordingly, focusing can be easily performed in accordance with a gaze.

Description

Terminal {Terminal}

The present invention relates to a terminal, and more particularly, to a slim terminal capable of easily setting a focusing or shooting mode according to the gaze.

The camera is a device for photographing images. Recently, various functions have been implemented as cameras are employed in mobile terminals and the like.

On the other hand, there is an increasing demand for automatic shooting with a desired image quality without any manipulation.

For example, a function of analyzing a scene captured through a camera using artificial intelligence has been developed.

However, when analyzing a scene based on artificial intelligence, scene recognition accuracy is deteriorated due to various subjects existing in the captured image, and there is a disadvantage that it is difficult to expect an improvement in image quality centered on a subject desired by a user.

An object of the present invention is to provide a terminal capable of easily setting a focusing or shooting mode according to the gaze.

Another object of the present invention is to provide a terminal capable of easily performing image quality setting.

A terminal according to an embodiment of the present invention for achieving the above object, receives a first image from the front camera, the rear camera, and the rear camera, receives a second image from the front camera, based on the second image Accordingly, a processor that detects a gaze area in the first image and controls the detected area to be focused may be included.

Meanwhile, the processor may output a third image in which the detected area is focused.

Meanwhile, the rear camera includes a lens device including a plurality of lenses, and the processor can control the position of at least one lens in the lens device to move in response to the detected area.

Meanwhile, when the gaze area is moved, the processor may control the position of at least one lens in the lens device to vary according to the moved gaze area.

On the other hand, when the rear camera is activated, and the eye tracking mode is in the eye tracking mode, the processor controls the front camera to be turned on and receives a second image from the front camera.

Meanwhile, the terminal according to an embodiment of the present invention further includes a sensor unit for sensing the position or movement of the front camera or the rear camera, and the processor is based on the location information or the movement information from the sensor unit, to the gaze area. Obtaining the subject information to be located, based on the acquired subject information, the shooting mode is automatically set, and according to the set shooting mode, a fourth image in which the detected area is focused can be output.

On the other hand, the processor, on the basis of the second image from the front camera, calculates the surrounding environment information, based on the calculated surrounding environment information, it is possible to control to perform automatic exposure, automatic white balance setting.

Meanwhile, the processor may calculate surrounding environment information based on brightness information and color information in the second image from the front camera.

Meanwhile, the processor may detect a user's emotion analysis and heart rate change based on the second image from the front camera, and set the image quality of the output image based on the user's emotion and heart rate change.

Meanwhile, the processor controls to output a plurality of mode images processed according to a plurality of modes based on the first image, and may perform image quality setting according to a selected image among the plurality of mode images.

Meanwhile, the plurality of mode images may include images in which at least one of brightness, color, and sharpness is different.

Meanwhile, the processor may control the user-defined image quality setting value to be updated using the image quality setting photographed using the expert mode or the image quality setting selected in the automatic mode.

Meanwhile, the processor may control the user-defined image quality setting value to be updated for each user based on the second image acquired from the front camera.

A terminal according to another embodiment of the present invention for achieving the above object, receives a first image from a front camera, a rear camera, and a rear camera, receives a second image from the front camera, and is based on the second image In this way, the gaze area in the first image is detected, subject information corresponding to the detected area is acquired, and a shooting mode is automatically set based on the acquired subject information. And a processor that outputs the focused third image.

A terminal according to another embodiment of the present invention for achieving the above object, receives a first image from the front camera, the rear camera, and the rear camera, receives a second image from the front camera, and the first image It may include a processor for controlling to output a plurality of mode images processed according to a plurality of modes based on the selected mode, and performing image quality setting according to a selected image among the plurality of mode images.

A terminal according to an embodiment of the present invention receives a first image from a front camera, a rear camera, and a rear camera, receives a second image from the front camera, and based on the second image, within the first image And a processor that detects the gaze area and controls the detected area to be focused. Accordingly, focusing can be easily performed according to the gaze.

Meanwhile, the processor may output a third image in which the detected area is focused. Accordingly, it is possible to easily provide a focused image according to the gaze.

Meanwhile, the rear camera includes a lens device including a plurality of lenses, and the processor can control the position of at least one lens in the lens device to move in response to the detected area. Accordingly, focusing can be easily performed according to the gaze.

Meanwhile, when the gaze area is moved, the processor may control the position of at least one lens in the lens device to vary according to the moved gaze area. Accordingly, it is possible to easily perform the focusing movement according to the gaze.

On the other hand, when the rear camera is activated, and the eye tracking mode is in the eye tracking mode, the processor controls the front camera to be turned on and receives a second image from the front camera. Accordingly, it is possible to easily perform focusing according to the gaze, based on the front camera.

Meanwhile, the terminal according to an embodiment of the present invention further includes a sensor unit for sensing the position or movement of the front camera or the rear camera, and the processor is based on the location information or the movement information from the sensor unit, to the gaze area. Obtaining the subject information to be located, based on the acquired subject information, the shooting mode is automatically set, and according to the set shooting mode, a fourth image in which the detected area is focused can be output. Accordingly, it is possible to easily perform focusing and automatic setting of the shooting mode according to the gaze.

On the other hand, the processor, on the basis of the second image from the front camera, calculates the surrounding environment information, based on the calculated surrounding environment information, it is possible to control to perform automatic exposure, automatic white balance setting. Accordingly, it is possible to easily and easily perform shooting settings based on the front camera.

Meanwhile, the processor may calculate surrounding environment information based on brightness information and color information in the second image from the front camera. Accordingly, it is possible to easily and conveniently calculate the environment information based on the front camera.

Meanwhile, the processor may detect a user's emotion analysis and heart rate change based on the second image from the front camera, and set the image quality of the output image based on the user's emotion and heart rate change. Accordingly, it is possible to easily and easily set the image quality based on the front camera.

Meanwhile, the processor controls to output a plurality of mode images processed according to a plurality of modes based on the first image, and may perform image quality setting according to a selected image among the plurality of mode images. Accordingly, it is possible to easily and easily set the image quality.

Meanwhile, the processor may control the user-defined image quality setting value to be updated using the image quality setting photographed using the expert mode or the image quality setting selected in the automatic mode. Accordingly, it is possible to conveniently update the user-defined image quality settings.

Meanwhile, the processor may control the user-defined image quality setting value to be updated for each user based on the second image acquired from the front camera. Accordingly, it is easy to update the quality setting value for each user.

A terminal according to another embodiment of the present invention receives a first image from a front camera, a rear camera, and a rear camera, receives a second image from the front camera, and based on the second image, within the first image The gaze area is detected, subject information corresponding to the detected area is acquired, and a shooting mode is automatically set based on the acquired subject information, and according to the set shooting mode, the detected area focuses the third image It may include a processor to output. Accordingly, it is possible to easily perform focusing and shooting mode setting according to the gaze.

According to another embodiment of the present invention, a terminal receives a first image from a front camera, a rear camera, and a rear camera, receives a second image from the front camera, and is in a plurality of modes based on the first image. It may be controlled to output a plurality of mode images processed according to, and may include a processor that performs image quality setting according to a selected image among the plurality of mode images. Accordingly, it is possible to easily set the image quality according to the gaze.

1A is a perspective view of a mobile terminal, which is one example of a terminal according to an embodiment of the present invention, viewed from the front.
1B is a rear perspective view of the mobile terminal shown in FIG. 1A.
FIG. 2 is a block diagram of the mobile terminal of FIG. 1.
3A is an internal cross-sectional view of the front and rear cameras of FIGS. 1A and 1B.
3B is an internal block diagram of a camera device having the front camera and the rear camera of FIGS. 1A and 1B.
4 is a flowchart illustrating a method of operating a terminal according to an embodiment of the present invention.
5A to 6D are diagrams referred to for explaining the operation method of FIG. 4.
7 is a flowchart illustrating a method of operating a terminal according to another embodiment of the present invention.
8A to 8D are views referred to for explaining the operation method of FIG. 7.
9 is a flowchart illustrating a method of operating a terminal according to another embodiment of the present invention.
10A to 10C are views referred to for explaining the operation method of FIG. 9.

Hereinafter, the present invention will be described in more detail with reference to the drawings.

The suffixes "modules" and "parts" for components used in the following description are given simply by considering the ease of writing this specification, and do not imply any special significance or role in itself. Therefore, the "module" and the "unit" may be used interchangeably.

1A is a perspective view of a mobile terminal, which is an example of a terminal according to an embodiment of the present invention, viewed from the front, and FIG. 1B is a rear perspective view of the mobile terminal shown in FIG. 1A.

Referring to Figure 1a, the case forming the appearance of the mobile terminal 100 is formed by a front case (100-1) and a rear case (100-2). Various electronic components may be embedded in the space formed by the front case 100-1 and the rear case 100-2.

Specifically, the display 180, the first audio output module 153a, the first camera 195a, and the first to third user input units 130a, 130b, and 130c may be disposed on the front case 100-1. have. In addition, a fourth user input unit 130d, a fifth user input unit 130e, and first to third microphones 123a, 123b, and 123c may be disposed on the side surfaces of the rear case 100-2.

The display 180 may overlap the touch pad in a layer structure, so that the display 180 may operate as a touch screen.

The first sound output module 153a may be implemented in the form of a receiver or speaker. The first camera 195a may be embodied in a form suitable for taking an image or video for a user. In addition, the microphone 123 may be implemented in a form suitable for receiving a user's voice, other sounds, and the like.

The first to fifth user input units 130a, 130b, 130c, 130d, and 130e, and the sixth and seventh user input units 130f and 130g, which will be described later, may be collectively referred to as a user input unit 130.

The first to second microphones 123a and 123b are arranged to collect audio signals on the upper side of the rear case 100-2, that is, on the upper side of the mobile terminal 100, and the third microphone 123c is The lower case 100-2, that is, the lower side of the mobile terminal 100, may be arranged for audio signal collection.

Referring to FIG. 1B, a second camera 195b, a third camera 195c, and a fourth microphone (not shown) may be additionally mounted on the rear surface of the rear case 100-2, and the rear case 100 On the side of -2), the sixth and seventh user input units 130f and 130g and the interface unit 175 may be disposed.

The second camera 195b has a photographing direction substantially opposite to the first camera 195a, and may have different pixels from the first camera 195a. A flash (not shown) and a mirror (not shown) may be additionally disposed adjacent to the second camera 195b.

Meanwhile, the second camera 195b may be an RGB camera, and the third camera 195c may be a depth camera for calculating a distance from a subject.

A second sound output module (not shown) may be additionally disposed in the rear case 100-2. The second audio output module may implement a stereo function together with the first audio output module 153a, or may be used for a call in speakerphone mode.

A power supply unit 190 for supplying power to the mobile terminal 100 may be mounted on the rear case 100-2 side. The power supply unit 190 may be detachably coupled to the rear case 100-2 for charging, for example, as a rechargeable battery.

The fourth microphone 123d may be disposed in front of the rear case 100-2, that is, on the back of the mobile terminal 100, for collecting audio signals.

FIG. 2 is a block diagram of the mobile terminal of FIG. 1.

Referring to FIG. 2, the mobile terminal 100 includes a wireless communication unit 110, an audio / video (A / V) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, and a memory 160, an interface unit 175, a control unit 170, and a power supply unit 190. These components may be configured when two or more components are combined into one component, or when one component is subdivided into two or more components, when implemented in an actual application.

The wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 113, a wireless Internet module 115, a short-range communication module 117, and a GPS module 119.

The broadcast receiving module 111 may receive at least one of a broadcast signal and broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast signal and / or broadcast-related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 113 may transmit and receive a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include a voice call signal, a video call signal, or various types of data according to transmission / reception of text / multimedia messages.

The wireless Internet module 115 refers to a module for wireless Internet access, and the wireless Internet module 115 may be built in or external to the mobile terminal 100.

The short-range communication module 117 refers to a module for short-range communication. As a short-range communication technology, Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, or near field communication (NFC) may be used.

The Global Position System (GPS) module 119 receives location information from a plurality of GPS satellites.

The A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, which may include a camera 195 and a microphone 123.

The camera 195 may process a video frame such as a still image or video obtained by an image sensor in a video call mode or a shooting mode. In addition, the processed image frame may be displayed on the display 180.

The image frames processed by the camera 195 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 195 may be provided according to a configuration aspect of the terminal.

The microphone 123 may receive an external audio signal by a microphone in a display off mode, for example, a call mode, a recording mode, or a voice recognition mode, and process it as electrical voice data.

Meanwhile, a plurality of microphones 123 may be disposed at different positions. The audio signal received from each microphone may be processed by the control unit 170 or the like.

The user input unit 130 generates key input data input by the user to control the operation of the terminal. The user input unit 130 may be configured with a key pad, a dome switch, a touch pad (static pressure / power outage), and the like, through which a user may receive commands or information by pressing or touching a user. In particular, when the touch pad forms a mutual layer structure with the display 180 to be described later, it may be referred to as a touch screen.

The sensing unit 140 detects the current state of the mobile terminal 100, such as an open / closed state of the mobile terminal 100, a location of the mobile terminal 100, or a user contact, to control the operation of the mobile terminal 100 It can generate a sensing signal.

The sensing unit 140 may include a proximity sensor 141, a pressure sensor 143, and a motion sensor 145, a touch sensor 146, and the like.

The proximity sensor 141 may detect the presence or absence of an object approaching the mobile terminal 100 or an object existing in the vicinity of the mobile terminal 100 without mechanical contact. In particular, the proximity sensor 141 may detect a proximity object using a change in an alternating magnetic field, a change in a static magnetic field, or a rate of change in capacitance.

The pressure sensor 143 may detect whether pressure is applied to the mobile terminal 100 and the size of the pressure.

The motion sensor 145 may detect the position or movement of the mobile terminal 100 using an acceleration sensor, a gyro sensor, or the like.

The touch sensor 146 may detect a touch input by a user's finger or a touch input by a specific pen. For example, when a touch screen panel is disposed on the display 180, the touch screen panel may include a touch sensor 146 for detecting location information, intensity information, and the like of the touch input. The sensing signal sensed by the touch sensor 146 may be transmitted to the controller 170.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display 180, an audio output module 153, an alarm unit 155, and a haptic module 157.

The display 180 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal 100 is in a call mode, it displays a user interface (UI) or a graphical user interface (GUI) related to the call. In addition, when the mobile terminal 100 is in a video call mode or a shooting mode, the captured or received video may be displayed respectively or simultaneously, and a UI and GUI are displayed.

On the other hand, as described above, when the display 180 and the touch pad are configured as a touch screen by forming a mutual layer structure, the display 180 may be used as an input device capable of inputting information by a user's touch in addition to the output device. Can be.

The audio output module 153 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, call mode or recording mode, voice recognition mode, broadcast reception mode, or the like. In addition, the audio output module 153 outputs an audio signal related to a function performed in the mobile terminal 100, for example, a call signal reception sound and a message reception sound. The sound output module 153 may include a speaker, a buzzer, and the like.

The alarm unit 155 outputs a signal for notifying the occurrence of an event in the mobile terminal 100. The alarm unit 155 outputs a signal for notifying the occurrence of an event in a form other than an audio signal or a video signal. For example, the signal can be output in the form of vibration.

The haptic module 157 generates various tactile effects that the user can feel. A typical example of the tactile effect generated by the haptic module 157 is a vibration effect. When the haptic module 157 generates vibration with a tactile effect, the intensity and pattern of vibration generated by the haptic module 157 are convertible, and different vibrations can be synthesized and output or sequentially output.

The memory 160 may store a program for processing and control of the control unit 170, and provide a function for temporarily storing input or output data (eg, a phone book, a message, a still image, a video, etc.). You can also do

The interface unit 175 serves as an interface with all external devices connected to the mobile terminal 100. The interface unit 175 may receive data from an external device or receive power, and transmit the data to each component inside the mobile terminal 100, and allow data inside the mobile terminal 100 to be transmitted to the external device.

The control unit 170 typically controls the operation of each part to control the overall operation of the mobile terminal 100. For example, it is possible to perform related control and processing for voice calls, data communication, video calls, and the like. Also, the control unit 170 may include a multimedia playback module 181 for multimedia playback. The multimedia playback module 181 may be configured with hardware in the control unit 170 or may be configured with software separately from the control unit 170. Meanwhile, the control unit 170 may include an application processor (not shown) for driving an application. Alternatively, the application processor (not shown) may be provided separately from the control unit 170.

In addition, the power supply unit 190 may receive external power or internal power under the control of the control unit 170 to supply power required for the operation of each component.

3A is an internal cross-sectional view of the front and rear cameras of FIGS. 1A and 1B.

Referring to the drawings, the rear camera 195b may include an aperture 194, a lens device 193, and an image sensor 820.

The aperture 194 can open and close the light incident to the lens device 193.

The lens device 193 may include a plurality of lenses adjusted for variable focus.

The image sensor 820 may include an RGb filter 915a and a sensor array 911b that converts an optical signal into an electrical signal to sense RGB color.

Accordingly, the image sensors 820 may sense and output RGB images, respectively.

The front camera 195a may include an aperture 194a, a lens device 193a, and an image sensor 820a.

The aperture 194a can open and close the light incident to the lens device 193a.

The lens device 193a may include a plurality of lenses adjusted for variable focus.

The image sensor 820a may include an RGb filter 915aa to sense RGB color, and a sensor array 911ba that converts an optical signal into an electrical signal.

Accordingly, the image sensors 820a may sense and output RGB images, respectively.

3B is an internal block diagram of a camera device having the front camera and the rear camera of FIGS. 1A and 1B.

Referring to the drawings, the camera device 195 includes a front camera 195a, a rear camera 195b, a processor 270, a sensor unit 230, a memory 240, an optical output unit 275, and an interface 250 ).

The rear camera 195b may include a lens device 193 and an image sensor 820.

The lens device 193 in the rear camera 195b may receive an incident incident light and may include a plurality of lenses adjusted for variable focus.

Meanwhile, the exposure time of the image sensor 820 may be adjusted based on an electrical signal.

The front camera 195a may include a lens device 193a and an image sensor 820a.

The lens device 193a in the front camera 195a may receive an incident incident light and may include a plurality of lenses adjusted for variable focus.

Meanwhile, the exposure time of the image sensor 820a may be adjusted based on an electrical signal.

Meanwhile, the processor 270 may generate an RGB image based on an electrical signal from the image sensor 820 in the rear camera 195b.

Meanwhile, the processor 270 may generate an RGB image based on an electrical signal from the image sensor 820a in the front camera 195a.

The sensor unit 230 may sense movement information or location information of the camera device 195. To this end, the sensor unit 230 may include a GPS receiver, an inertial sensor, and the like.

The interface 250 can be used for data transmission with other units in the mobile terminal 100.

The light output unit 275 may output infrared light or the like for the operation of the camera device.

Meanwhile, the RGB image from the processor 270 may be transferred to the control unit 170 of the mobile terminal 100.

Meanwhile, the processor 270 or the control unit 170 may output a control signal to the lens device 193 for the movement of the lens in the lens device 193 or the like. For example, a control signal for auto focusing may be output to the lens device 193.

Meanwhile, the processor 270 or the control unit 170 may output an aperture control signal for adjusting the light transmittance of the aperture 194 to the aperture 194.

For example, the processor 270 or the control unit 170 may control the aperture 194 to be opened in the first period and the aperture 194 to be closed in the second period.

4 is a flowchart illustrating an operation method of a terminal according to an embodiment of the present invention, and FIGS. 5A to 6D are diagrams referred to for describing the operation method of FIG. 4.

Referring to the drawings, the processor 270 or the control unit 170 in the terminal 100 determines whether the rear camera 195b is activated (S410), and, if applicable, the rear camera 195b is activated. Control (S415). To this end, the processor 270 or the control unit 170 may control power to be supplied to the rear camera 195b.

Next, the processor 270 or the control unit 170 in the terminal 100 determines whether or not it is in eye tracking mode (S420), and, if applicable, controls the front camera 195a to be turned on (S425) ). To this end, the processor 270 or the control unit 170 may control power to be supplied to the front camera 195a.

Next, the processor 270 or the control unit 170 receives the first image from the rear camera 195b (S430), and receives the second image from the front camera 195a (S435).

Next, the processor 270 or the controller 170 detects a gaze area in the first image based on the second image obtained from the front camera 195a (S440).

Then, the processor 270 or the control unit 170 controls to focus on the detected gaze area (S450).

5A illustrates that the rear camera 195b is activated and the first image 510 is displayed on the display 180 of the mobile terminal 100.

Meanwhile, in the eye tracking mode, the processor 270 or the controller 170 in the terminal 100 may activate the front camera 195a to receive the second image Img1 as shown in the drawing. have.

The second image Img1 in the drawing may include an eye of a user.

The processor 270 or the controller 170 in the terminal 100 calculates the position or direction of the eye, and based on the calculated position or direction of the eye, within the first image 510 It is possible to calculate where the user's gaze area is located.

In the drawing, it is illustrated that the user's gaze is located at the first position PT1 in the first image 510.

FIG. 5B illustrates that the first area Ara including the first position PT1 in the first image 510 is a gaze area.

On the other hand, if the processor 270 or the control unit 170 in the terminal 100 determines that the user's gaze is located in the first area Ara in the first image 510, as shown in FIG. 5C, the lens device ( The position of at least one lens in 193) may be controlled to be located at La. Accordingly, focusing is aligned to the first area Ara.

Accordingly, the processor 270 or the control unit 170 in the terminal 100 can easily acquire the third image 550 focused on the first area Ara, as shown in FIG. 5D. Therefore, it is possible to easily perform focusing according to the gaze.

Meanwhile, the processor 270 or the controller 170 may output a third image in which the detected area is focused. Accordingly, it is possible to easily provide a focused image according to the gaze.

On the other hand, the rear camera 195b includes a lens device 193 including a plurality of lenses, and the processor 270 or the control unit 170 corresponds to the detected area, at least one in the lens device 193 The position of the lens can be controlled to move. Accordingly, focusing can be easily performed according to the gaze.

Meanwhile, the processor 270 or the controller 170 may control the position of at least one lens in the lens device 193 to be varied according to the moved gaze area when the gaze area is moved. Accordingly, it is possible to easily perform the focusing movement according to the gaze.

6A illustrates that the rear camera 195b is activated and the first image 510 is displayed on the display 180 of the mobile terminal 100.

On the other hand, in the case of the eye tracking mode, the processor 270 or the control unit 170 in the terminal 100 may activate the front camera 195a to receive the second image Img2 as illustrated. have.

The second image Img2 in the drawing may include an eye of a user.

The processor 270 or the controller 170 in the terminal 100 calculates the position or direction of the eye, and based on the calculated position or direction of the eye, within the first image 510 It is possible to calculate where the user's gaze area is located.

In the drawing, it is illustrated that the user's gaze is located at the second position PT2 in the first image 510.

6B illustrates that the second area Arb including the second position PT2 in the first image 520 is the gaze area.

On the other hand, if the processor 270 or the control unit 170 in the terminal 100 determines that the user's gaze is located in the second area Arb in the first image 520, as shown in FIG. 6C, the lens device ( The position of at least one lens in 193) may be controlled to be located at Lb. Accordingly, focusing is aligned to the second region Arb.

Accordingly, the processor 270 or the control unit 170 in the terminal 100 can easily acquire the third image 560 focused on the second area Arb, as shown in FIG. 6D. Therefore, it is possible to easily perform focusing according to the gaze.

7 is a flowchart illustrating an operation method of a terminal according to another embodiment of the present invention, and FIGS. 8A to 8D are diagrams referred to for describing the operation method of FIG. 7.

Referring to the drawings, the processor 270 or the controller 170 in the terminal 100 determines whether the rear camera 195b is activated (S710), and, if applicable, the rear camera 195b is activated It is controlled (S715). To this end, the processor 270 or the control unit 170 may control power to be supplied to the rear camera 195b.

Next, the processor 270 or the control unit 170 in the terminal 100 determines whether it is an automatic shooting mode (S717), and, if applicable, controls the front camera 195a to be turned on (S725). To this end, the processor 270 or the control unit 170 may control power to be supplied to the front camera 195a.

Next, the processor 270 or the control unit 170 receives the first image from the rear camera 195b (S730), and receives the second image from the front camera 195a (S735).

Next, the processor 270 or the control unit 170 detects a gaze area in the first image based on the second image obtained from the front camera 195a (S740).

Then, the processor 270 or the control unit 170 controls to focus on the detected gaze area (S750).

Next, the processor 270 or the control unit 170 acquires object information corresponding to the detected gaze area (S746).

Next, the processor 270 or the controller 170 sets a shooting mode according to the acquired subject information (S748).

Next, the processor 270 or the controller 170 performs photographing in a set mode while the gaze area is focused (S750).

8A illustrates that the rear camera 195b is activated and the first image 810 is displayed on the display 180 of the mobile terminal 100.

Meanwhile, in the automatic shooting mode, the processor 270 or the control unit 170 in the terminal 100 may activate the front camera 195a to receive the second image Img2 as shown in FIG. 8B.

The second image Img2 in FIG. 8B may include an eye of a user.

The processor 270 or the controller 170 in the terminal 100 calculates the position or direction of the eye, and based on the calculated position or direction of the eye, within the first image 520 It is possible to calculate where the user's gaze area is located.

In the drawing, it is illustrated that the user's gaze is located at the second position PT2 in the first image 520.

8C illustrates that the second area Arb including the second position in the first image 520 is the gaze area.

On the other hand, if it is determined that the user's gaze is located in the second area Arb in the first image 520, the processor 270 or the control unit 170 in the terminal 100, at least one in the lens device 193 It can be controlled so that the lens is located at a specific position. Accordingly, focusing is aligned to the second region Arb.

Accordingly, the processor 270 or the control unit 170 in the terminal 100 can easily acquire the third image 560 focused on the second area Arb, as shown in FIG. 8D. Therefore, it is possible to easily perform focusing according to the gaze.

Meanwhile, the processor 270 or the controller 170 may output a third image in which the detected area is focused. Accordingly, it is possible to easily provide a focused image according to the gaze.

Meanwhile, the sensor unit 230 senses the position or movement of the front camera 195a or the rear camera 195b, and the processor 270 or the control unit 170 detects the position information or movement information from the sensor unit 230. Based on the, subject information located in the gaze area is acquired, based on the acquired subject information, a shooting mode is automatically set, and a fourth image in which the detected area is focused can be output according to the set shooting mode. have. Accordingly, it is possible to easily perform focusing and automatic setting of the shooting mode according to the gaze.

Meanwhile, the processor 270 or the control unit 170 calculates surrounding environment information based on the second image from the front camera 195a, and based on the calculated ambient environment information, automatic exposure and automatic white balance setting are performed. It can be controlled to be performed. Accordingly, it is possible to conveniently perform shooting settings based on the front camera 195a.

Meanwhile, the processor 270 or the control unit 170 may calculate surrounding environment information from the front camera 195a based on brightness information and color information in the second image. Accordingly, it is possible to easily calculate the surrounding environment information based on the front camera 195a.

On the other hand, the processor 270 or the controller 170, based on the second image from the front camera 195a, detects a user's emotion analysis and heart rate change, and based on the user's emotion and heart rate change, outputs the image You can set the image quality. Accordingly, it is possible to easily and easily set the image quality based on the front camera 195a.

Meanwhile, the processor 270 or the controller 170 controls to output a plurality of mode images processed according to a plurality of modes based on the first image, and performs image quality setting according to a selected image among the plurality of mode images can do. Accordingly, it is possible to easily and easily set the image quality.

Meanwhile, the processor 270 or the control unit 170 may control the user-defined image quality setting value to be updated using the image quality setting photographed using the expert mode or the image quality setting selected in the automatic mode. Accordingly, it is possible to conveniently update the user-defined image quality settings.

Meanwhile, the processor 270 or the control unit 170 may control the user set image quality setting value to be updated for each user based on the second image obtained from the front camera 195a. Accordingly, it is easy to update the quality setting value for each user.

9 is a flowchart illustrating an operation method of a terminal according to another embodiment of the present invention, and FIGS. 10A to 10C are diagrams referred to for describing the operation method of FIG. 9.

Referring to the drawings, the processor 270 or the controller 170 in the terminal 100 determines whether the rear camera 195b is activated (S910), and, if applicable, the rear camera 195b is activated. It is controlled (S915). To this end, the processor 270 or the control unit 170 may control power to be supplied to the rear camera 195b.

Next, the processor 270 or the control unit 170 receives the first image from the rear camera 195b (S930).

Next, the processor 270 or the controller 170 may output a plurality of mode images processed according to a plurality of modes based on the first image (S933).

Then, the processor 270 or the controller 170 may perform image quality setting according to the selected mode image (S936).

10A illustrates that the rear camera 195b is activated and the first image 810 is displayed on the display 180 of the mobile terminal 100.

On the other hand, the processor 270 or the control unit 170 in the terminal 100, after the first image 810, for the setting of any one of a plurality of modes, as shown in Figure 10b, a plurality of mode images (Imga, Imgb, Imgc) can be generated and output.

Here, the plurality of mode images (Imga, Imgb, Imgc) may be at least one of brightness, color, and sharpness different images.

Meanwhile, as illustrated in FIG. 10B, when a plurality of mode images Imga, Imgb, and Imgc are displayed on the display 180, a first mode image IMga is selected by a user's finger (FNG) touch input The processor 270 or the control unit 170 in the terminal 100 may control the image quality setting corresponding to the first mode image IMga to be performed.

Accordingly, the processor 270 or the control unit 170 in the terminal 100 controls to output the first mode image quality setting message 1020, as shown in FIG. 10C, and thereafter, signals according to the first mode image quality setting. The processed and generated image may be controlled to be displayed on the display 180. Accordingly, it is possible to conveniently set the image quality desired by the user.

Meanwhile, the processor 270 or the control unit 170 may control the user-defined image quality setting value to be updated using the image quality setting photographed using the expert mode or the image quality setting selected in the automatic mode. Accordingly, it is possible to conveniently update the user-defined image quality settings.

Meanwhile, the processor 270 or the control unit 170 may control the user set image quality setting value to be updated for each user based on the second image obtained from the front camera 195a. Accordingly, it is easy to update the quality setting value for each user.

Meanwhile, the camera device 195 illustrated in FIGS. 4 to 10C may be employed in various electronic devices such as the mobile terminal 100 of FIG. 2, a vehicle, a TV, a drone, a robot, a robot cleaner, and a door.

In addition, although the preferred embodiments of the present invention have been shown and described above, the present invention is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present invention claimed in the claims. In addition, various modifications can be implemented by those skilled in the art, and these modifications should not be individually understood from the technical idea or prospect of the present invention.

Claims (15)

Front camera;
Rear camera;
A first image is received from the rear camera, a second image is received from the front camera, and a gaze region in the first image is detected based on the second image, and the detected region is controlled to be focused. A terminal comprising a processor ;. According to claim 1,
The processor,
The terminal, characterized in that for outputting a third image in which the detected area is focused. According to claim 1,
The rear camera,
And a lens device including a plurality of lenses;
The processor,
In response to the detected area, the terminal characterized in that to control the position of at least one lens in the lens device to move. According to claim 3,
The processor,
When the gaze region is moved, the terminal characterized in that the position of the at least one lens in the lens device is controlled to vary according to the gaze region to be moved. According to claim 1,
The processor,
In the state in which the rear camera is activated, in the case of eye tracking mode, the terminal controls the front camera to be turned on, and receives the second image from the front camera. According to claim 1,
Further comprising; a sensor unit for sensing the position or movement of the front camera or the rear camera,
The processor,
Based on the location information or the movement information from the sensor unit, acquires the subject information located in the gaze area,
Based on the acquired subject information, the shooting mode is automatically set,
According to the set shooting mode, the terminal characterized in that the outputting the fourth image focused on the detected area. According to claim 1,
The processor,
A terminal characterized in that, based on the second image from the front camera, calculates surrounding environment information, and controls to perform automatic exposure and automatic white balance setting based on the calculated surrounding environment information. The method of claim 7,
The processor,
A terminal characterized by calculating the surrounding environment information based on brightness information and color information in a second image from the front camera. According to claim 1,
The processor,
A terminal based on a second image from the front camera, detecting a user's emotion analysis and heart rate change, and setting an image quality of the output image based on the user's emotion and heart rate change. According to claim 1,
The processor,
Control to output a plurality of mode images processed according to a plurality of modes based on the first image,
A terminal characterized in that image quality setting is performed according to a selected image among the plurality of mode images. The method of claim 10,
The plurality of mode images,
A terminal characterized in that at least one of brightness, color, and sharpness includes different images. According to claim 1,
The processor,
A terminal characterized in that the user-defined image quality setting value is controlled to be updated by using the image quality setting photographed using the expert mode or the image quality setting selected in the automatic mode. The method of claim 12,
The processor,
Based on the second image obtained from the front camera, a terminal characterized in that for each user, the user-defined image quality setting value is controlled to be updated. Front camera;
Rear camera;
A first image is received from the rear camera, a second image is received from the front camera, and a gaze region in the first image is detected based on the second image, and subject information corresponding to the detected region And a processor configured to automatically set a shooting mode based on the acquired subject information, and output a third image in which the detected area is focused according to the set shooting mode. terminal. Front camera;
Rear camera;
A first image is received from the rear camera, a second image is received from the front camera, and a plurality of mode images processed according to a plurality of modes are controlled based on the first image, and the plurality of modes are controlled. A terminal comprising: a processor for performing image quality setting according to a selected image among images.

Images