WO2019216682A1

WO2019216682A1 - Image display device

Info

Publication number: WO2019216682A1
Application number: PCT/KR2019/005613
Authority: WO
Inventors: 조주희; 정현숙
Original assignee: 엘지전자 주식회사
Priority date: 2018-05-11
Filing date: 2019-05-10
Publication date: 2019-11-14

Abstract

The present invention relates to an image display device. The image display device, according to one embodiment of the present invention, comprises: a camera; a display; and a control unit for controlling so that an image captured through the camera is displayed, and when an object corresponding to a first subject in the displayed image is selected, zoom-tracking is carried out for the object corresponding to the first subject. Accordingly, zoom-tracking for a subject may be carried out in a simple manner.

Description

Video display device

The present invention relates to an image display apparatus, and more particularly, to an image display apparatus capable of easily performing zoom tracking on a subject.

The image display device is a device for displaying an image. For example, a camera for capturing a subject may be employed as the image display device.

Recently, as a camera is adopted in a mobile terminal, research into miniaturization of a camera is in progress.

On the other hand, in addition to the trend of miniaturization of the camera, the auto focus function and the image stabilization function has been adopted.

Meanwhile, various methods for enlarging and displaying an image obtained through a camera with a zoom have been proposed.

SUMMARY OF THE INVENTION An object of the present invention is to provide a lens image display apparatus which can easily perform zoom tracking on a subject.

Another object of the present invention is to provide an image display apparatus capable of integrated management of an image obtained by using a plurality of cameras having different magnifications.

According to an embodiment of the present invention, an image display apparatus may display a camera, a display, and an image photographed through a camera, and when an object corresponding to a first subject in the displayed image is selected, And a control unit configured to perform zoom tracking on an object corresponding to the first subject.

Meanwhile, when an object corresponding to the first subject in the image displayed on the display is selected, the controller may control the object corresponding to the first subject to be highlighted.

On the other hand, when there is a magnification input for zooming, the controller may enlarge the object corresponding to the first subject and control to display the magnified object.

The controller may control the enlarged object to be displayed in the center area of the display when the enlarged object is displayed.

On the other hand, the controller may control to output a control signal to the lens device in the camera according to the set zoom ratio.

Meanwhile, when the first subject moves, the controller may control to output a control signal to the lens device in the camera.

On the other hand, as the first subject approaches, the controller may control some of the lenses in the lens structure away from the image sensor in the camera, or the distance between the first lens king and the second lens in the lens structure becomes farther away. have.

On the other hand, when the fixed zoom magnification is set for the first subject, the controller may control the size of the object corresponding to the first subject to be constantly displayed even when the first subject is moved.

The controller may control the zoom magnification to be lower as the first subject gets closer.

On the other hand, to compensate for the movement detected by the gyro sensor, the camera is provided with a prism device for varying the angle of the incident light with respect to the first rotation axis and the second rotation axis and output, a plurality of lenses, At least one lens may be moved to include a lens device that outputs light from the prism device using the moved lens, and an image sensor that converts light from the lens device into an electrical signal.

On the other hand, the prism device includes: a first prism on which light to be input is reflected, a first actuator that changes the angle of the first prism on the basis of the first rotation axis based on the input first control signal, and light from the first prism The second prism for reflecting the second prism, and the second actuator for changing the angle of the second prism with respect to the second axis of rotation based on the input second control signal.

The prism device may further include a first hall sensor that senses a magnetic field change according to the change of the angle of the first prism, and a second hall sensor that senses a magnetic field change according to the change in the angle of the second prism.

On the other hand, the camera controls the first actuator based on the first control signal and the first magnetic field change information from the first hall sensor, and the second control signal and the second magnetic field change information from the second hall sensor. On the basis of the, may further include a drive control unit for controlling the second actuator.

In addition, a 1st actuator can be equipped with a 1st drive magnet and a 1st drive coil.

On the other hand, the prism device includes a first prism holder for fixing the first prism to the first surface, a first yoke to which the first surface is attached to the second surface, which is the rear surface of the first surface of the first prism holder, The first coil holder may include a protrusion protruding in the first prism holder direction and an opening formed in the protrusion.

On the other hand, a 1st drive magnet is attached to the 2nd surface which is the back surface of the 1st surface of a 1st yoke, and a 1st drive coil is arrange | positioned between a 1st coil holder and a 1st yoke, and both ends of a 1st prism holder The boss may be coupled to an opening formed in the protrusion of the first coil holder.

In accordance with another aspect of the present invention, an image display device includes a first camera having a first magnification, a second camera having a second magnification, a display, a first camera, and a second camera. And a control unit for controlling the managed image as one file.

The controller may control the image acquired by the first camera having the first magnification and the image obtained by the second camera having the second magnification to be separately displayed.

If the enlarged display of the image acquired by the first camera at the first magnification is impossible, the controller may control to display only the image acquired by the second camera at the second magnification.

On the other hand, the first camera or the second camera, in order to compensate for the motion detected by the gyro sensor, the prism device for changing the angle of the incident light on the basis of the first rotation axis and the second rotation axis, and outputs a plurality of lenses And a lens device for outputting light from the prism device using the moved lens, and an image sensor for converting light from the lens device into an electrical signal. Can be.

According to an embodiment of the present invention, an image display apparatus displays a camera, a display, and an image photographed through the camera, and when an object corresponding to the first subject in the displayed image is selected, the image display apparatus corresponds to the first subject. And a control unit which controls to perform zoom tracking on the object. Accordingly, zoom tracking can be easily performed on the subject.

Meanwhile, when an object corresponding to the first subject in the image displayed on the display is selected, the controller may control the object corresponding to the first subject to be highlighted. Accordingly, the object corresponding to the first subject can be distinguished.

On the other hand, when there is a magnification input for zooming, the controller may enlarge the object corresponding to the first subject and control to display the magnified object. Accordingly, zoom tracking can be easily performed on the subject.

The controller may control the enlarged object to be displayed in the center area of the display when the enlarged object is displayed. Accordingly, the visibility of the enlarged object can be improved.

On the other hand, the controller may control to output a control signal to the lens device in the camera according to the set zoom ratio. Accordingly, an operation corresponding to the set zoom factor can be performed.

Meanwhile, when the first subject moves, the controller may control to output a control signal to the lens device in the camera. Accordingly, an operation corresponding to the movement of the first subject may be performed.

On the other hand, as the first subject approaches, the controller may control some of the lenses in the lens structure away from the image sensor in the camera, or the distance between the first lens king and the second lens in the lens structure becomes farther away. have. Accordingly, zoom tracking can be easily performed on the subject.

On the other hand, when the fixed zoom magnification is set for the first subject, the controller may control the size of the object corresponding to the first subject to be constantly displayed even when the first subject is moved. Accordingly, zoom tracking can be easily performed on the subject.

The controller may control the zoom magnification to be lower as the first subject gets closer. Accordingly, zoom tracking can be easily performed on the subject.

On the other hand, to compensate for the movement detected by the gyro sensor, the camera is provided with a prism device for varying the angle of the incident light with respect to the first rotation axis and the second rotation axis and output, a plurality of lenses, At least one lens may be moved to include a lens device that outputs light from the prism device using the moved lens, and an image sensor that converts light from the lens device into an electrical signal. Accordingly, image stabilization for the dual prism can be realized. In particular, by rotating the dual prism independently, it is possible to implement image stabilization on the basis of a plurality of rotation axis.

On the other hand, the prism device includes: a first prism on which light to be input is reflected, a first actuator that changes the angle of the first prism on the basis of the first rotation axis based on the input first control signal, and light from the first prism The second prism for reflecting the second prism, and the second actuator for changing the angle of the second prism with respect to the second axis of rotation based on the input second control signal. Accordingly, image stabilization for the dual prism can be realized. In particular, by rotating the dual prism independently, it is possible to implement image stabilization on the basis of a plurality of rotation axis.

The prism device may further include a first hall sensor that senses a magnetic field change according to the change of the angle of the first prism, and a second hall sensor that senses a magnetic field change according to the change in the angle of the second prism. Accordingly, image stabilization for the dual prism can be realized.

On the other hand, the camera controls the first actuator based on the first control signal and the first magnetic field change information from the first hall sensor, and the second control signal and the second magnetic field change information from the second hall sensor. On the basis of the, may further include a drive control unit for controlling the second actuator. Accordingly, image stabilization for the dual prism can be realized.

In addition, a 1st actuator can be equipped with a 1st drive magnet and a 1st drive coil. Accordingly, image stabilization for the dual prism can be realized.

On the other hand, the prism device includes a first prism holder for fixing the first prism to the first surface, a first yoke to which the first surface is attached to the second surface, which is the rear surface of the first surface of the first prism holder, The first coil holder may include a protrusion protruding in the first prism holder direction and an opening formed in the protrusion. Accordingly, image stabilization for the dual prism can be realized.

On the other hand, a 1st drive magnet is attached to the 2nd surface which is the back surface of the 1st surface of a 1st yoke, and a 1st drive coil is arrange | positioned between a 1st coil holder and a 1st yoke, and both ends of a 1st prism holder The boss may be coupled to an opening formed in the protrusion of the first coil holder. Accordingly, the first driving magnet, the first prism holder, and the first prism may be rotated based on the first rotation axis.

According to another exemplary embodiment of the present invention, an image display apparatus includes a first camera having a first magnification, a second camera having a second magnification, a display, and an image captured by the first camera and the second camera as one file. The control unit to control to manage. Accordingly, it is possible to integrate and manage the images obtained by using a plurality of cameras based on different magnifications.

The controller may control the image acquired by the first camera having the first magnification and the image obtained by the second camera having the second magnification to be separately displayed. Accordingly, it is possible to integrate and manage the images obtained by using a plurality of cameras based on different magnifications.

If the enlarged display of the image acquired by the first camera at the first magnification is impossible, the controller may control to display only the image acquired by the second camera at the second magnification. Accordingly, it is possible to integrate and manage the images obtained by using a plurality of cameras based on different magnifications.

On the other hand, the first camera or the second camera, in order to compensate for the motion detected by the gyro sensor, the prism device for changing the angle of the incident light on the basis of the first rotation axis and the second rotation axis, and outputs a plurality of lenses And a lens device for outputting light from the prism device using the moved lens, and an image sensor for converting light from the lens device into an electrical signal. Can be. Accordingly, image stabilization for the dual prism can be realized. In particular, by rotating the dual prism independently, it is possible to implement image stabilization on the basis of a plurality of rotation axis.

1A is a perspective view of a mobile terminal, which is an example of an image display apparatus, according to an exemplary embodiment.

FIG. 1B is a rear perspective view of the mobile terminal shown in FIG. 1A.

2 is a block diagram of the mobile terminal of FIG. 1.

3A is an internal cross-sectional view of the camera of FIG. 2.

3B is an internal block diagram of the camera of FIG. 2.

4 is a diagram illustrating a camera having a double prism structure.

5 is a diagram illustrating an example of a camera having a rotatable dual prism module according to an embodiment of the present invention.

6 to 8 are views referred to for description of the camera of FIG. 5.

9A to 11J are diagrams for describing an operation of an image display apparatus according to an embodiment of the present invention.

12A to 12F are views for explaining an operation of an image display apparatus according to another exemplary embodiment of the present invention.

Hereinafter, with reference to the drawings will be described the present invention in more detail.

The suffixes "module" and "unit" for components used in the following description are merely given in consideration of ease of preparation of the present specification, and do not impart any particular meaning or role by themselves. Therefore, the "module" and "unit" may be used interchangeably.

1A is a front perspective view of a mobile terminal as an example of an image display apparatus according to an embodiment of the present invention, and FIG. 1B is a rear perspective view of the mobile terminal shown in FIG. 1A.

Referring to FIG. 1A, the case forming the exterior of the mobile terminal 100 is formed by the front case 100-1 and the rear case 100-2. Various electronic components may be built in the space formed by the front case 100-1 and the rear case 100-2.

In detail, the front case 100-1 may include a display 180, a first sound output module 153a, a first camera 195a, and first to third

user input units

130a, 130b, and 130c. have. The fourth user input unit 130d, the fifth user input unit 130e, and the first to third microphones 123a, 123b, and 123c may be disposed on the side surface of the rear case 100-2.

As the display 180 overlaps the touch pad in a layer structure, the display 180 may operate as a touch screen.

The first sound output module 153a may be implemented in the form of a receiver or a speaker. The first camera 195a may be implemented in a form suitable for capturing an image or a video of a user or the like. The microphone 123 may be implemented in a form suitable for receiving a user's voice or other sound.

The first to fifth

user input units

130a, 130b, 130c, 130d, and 130e and the sixth and seventh

user input units

130f and 130g to be described below may be collectively referred to as the user input unit 130.

The first to second microphones 123a and 123b are disposed above the rear case 100-2, that is, above the mobile terminal 100 to collect audio signals, and the third microphone 123c may include The rear case 100-2, that is, the lower side of the mobile terminal 100, may be arranged to collect audio signals.

Referring to FIG. 1B, a second camera 195b, a third camera 195c, and a fourth microphone 123d may be additionally mounted on the rear of the rear case 100-2, and the rear case 100- The sixth and seventh

user input units

130f and 130g and the interface unit 175 may be disposed on side surfaces of 2).

The second camera 195b may have a photographing direction substantially opposite to that of the first camera 195a, and may have different pixels from the first camera 195a. A flash (not shown) and a mirror (not shown) may be further disposed adjacent to the second camera 195b. In addition, another camera may be further provided adjacent to the second camera 195b to be used for capturing 3D stereoscopic images.

A second sound output module (not shown) may be further disposed on the rear case 100-2. The second sound output module may implement a stereo function together with the first sound output module 153a and may be used for a call in the speakerphone mode.

The power supply unit 190 for supplying power to the mobile terminal 100 may be mounted on the rear case 100-2 side. The power supply unit 190 is, for example, a rechargeable battery, and may be detachably coupled to the rear case 100-2 for charging.

The fourth microphone 123d may be disposed at the front of the rear case 100-2, that is, at the rear of the mobile terminal 100 to collect audio signals.

2 is a block diagram of the mobile terminal of FIG. 1.

Referring to FIG. 2, the mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, and a memory. 160, an interface unit 175, a control unit 170, and a power supply unit 190 may be included. Such components may be configured by combining two or more components into one component, or by dividing one or more components into two or more components as necessary when implemented in an actual application.

The wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 113, a wireless internet module 115, a short range communication module 117, and a GPS module 119.

The broadcast receiving module 111 may receive at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 113 may transmit / receive a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to voice call signal, video call signal, or text / multimedia message transmission and reception.

The wireless internet module 115 refers to a module for wireless internet access. The wireless internet module 115 may be embedded or external to the mobile terminal 100.

The short range communication module 117 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), and the like may be used.

The GPS (Global Position System) module 119 receives position information from a plurality of GPS satellites.

The A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 195 and a microphone 123.

The camera 195 may process an image frame such as a still image or a video obtained by the image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display 180.

The image frame processed by the camera 195 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 195 may be provided depending on the configuration aspect of the terminal.

The microphone 123 may receive an external audio signal by a microphone in a display off mode, for example, a call mode, a recording mode, or a voice recognition mode, and process the external audio signal as electrical voice data.

On the other hand, the microphone 123 may be arranged as a plurality in different positions. The audio signal received by each microphone may be processed by the controller 170 or the like.

The user input unit 130 generates key input data input by the user for controlling the operation of the terminal. The user input unit 130 may be configured of a key pad, a dome switch, a touch pad (constant voltage / capacitance), etc. that may receive a command or information by a user's pressing or touch manipulation. In particular, when the touch pad has a mutual layer structure with the display 180 described later, this may be referred to as a touch screen.

The sensing unit 140 detects a current state of the mobile terminal 100 such as an open / closed state of the mobile terminal 100, a location of the mobile terminal 100, presence or absence of user contact, and the like to control the operation of the mobile terminal 100. The sensing signal may be generated.

The sensing unit 140 may include a proximity sensor 141, a pressure sensor 143, a motion sensor 145, a touch sensor 146, and the like.

The proximity sensor 141 may detect the presence or absence of an object approaching the mobile terminal 100 or an object present in the vicinity of the mobile terminal 100 without mechanical contact. In particular, the proximity sensor 141 may detect a proximity object by using a change in an alternating magnetic field or a change in a static magnetic field, or using a rate of change in capacitance.

The pressure sensor 143 may detect whether pressure is applied to the mobile terminal 100 and the magnitude of the pressure.

The motion sensor 145 may detect the position or movement of the mobile terminal 100 using an acceleration sensor, a gyro sensor, or the like.

The touch sensor 146 may detect a touch input by a user's finger or a touch input by a specific pen. For example, when the touch screen panel is disposed on the display 180, the touch screen panel may include a touch sensor 146 for sensing location information, intensity information, and the like of the touch input. The sensing signal detected by the touch sensor 146 may be transmitted to the controller 170.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display 180, a sound output module 153, an alarm unit 155, and a haptic module 157.

The display 180 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal 100 is in a call mode, the mobile terminal 100 displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the mobile terminal 100 is in a video call mode or a photographing mode, the mobile terminal 100 may display captured or received images respectively or simultaneously, and display a UI and a GUI.

Meanwhile, as described above, when the display 180 and the touch pad form a mutual layer structure and constitute a touch screen, the display 180 may also be used as an input device capable of inputting information by a user's touch in addition to the output device. Can be.

The sound output module 153 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. In addition, the sound output module 153 outputs an audio signal related to a function performed in the mobile terminal 100, for example, a call signal reception sound and a message reception sound. The sound output module 153 may include a speaker, a buzzer, and the like.

The alarm unit 155 outputs a signal for notifying occurrence of an event of the mobile terminal 100. The alarm unit 155 outputs a signal for notifying occurrence of an event in a form other than an audio signal or a video signal. For example, the signal may be output in the form of vibration.

The haptic module 157 generates various haptic effects that a user can feel. A representative example of the haptic effect generated by the haptic module 157 is a vibration effect. When the haptic module 157 generates vibration by the tactile effect, the intensity and pattern of the vibration generated by the haptic module 157 may be converted, and may be output by combining different vibrations or sequentially.

The memory 160 may store a program for processing and controlling the controller 170, and may provide a function for temporarily storing input or output data (eg, a phone book, a message, a still image, a video, etc.). It can also be done.

The interface unit 175 serves as an interface with all external devices connected to the mobile terminal 100. The interface unit 175 may receive data from an external device or receive power and transfer the data to each component inside the mobile terminal 100, and may transmit data within the mobile terminal 100 to an external device.

The controller 170 typically controls the operations of each unit to control the overall operation of the mobile terminal 100. For example, related control and processing for voice calls, data communications, video calls, and the like can be performed. In addition, the controller 170 may include a multimedia playback module 181 for multimedia playback. The multimedia playback module 181 may be configured in hardware in the controller 170 or may be configured in software separately from the controller 170. The controller 170 may include an application processor (not shown) for driving an application. Alternatively, the application processor (not shown) may be provided separately from the controller 170.

In addition, the power supply unit 190 may receive the external power and the internal power under the control of the controller 170 to supply power required for the operation of each component.

3A is an internal cross-sectional view of the camera of FIG. 2.

3A is an example of sectional drawing about the 2nd camera 195b in the camera 195. As shown in FIG.

The second camera 195b may include an aperture 194b, a prism module 192b, a lens device 193b, and an image sensor 820b.

The stop 194b may open and close the light incident on the lens device 193b.

The image sensor 820b may include an RGb filter 915b and a sensor array 911b for converting an optical signal into an electrical signal in order to sense an RGB color.

Accordingly, the image sensor 820b may sense and output RGB images, respectively.

3B is an internal block diagram of the camera of FIG. 2.

Referring to the drawings, FIG. 3B is an example of a block diagram for the second camera 195b in the camera 195.

The second camera 195b may include a prism module 192b, a lens device 193b, an image sensor 820b, and an image processor 830.

The image processor 830 may generate an RGB image based on the electrical signal from the image sensor 820b.

Meanwhile, the image sensor 820b may adjust the exposure time based on the electrical signal.

Meanwhile, the RGB image from the image processor 830 may be transferred to the controller 170 of the mobile terminal 100.

The controller 170 of the mobile terminal 100 may output a control signal to the lens device 193b for the movement of the lens in the lens device 193b or the like. For example, a control signal for auto focusing may be output to the lens device 193b.

The controller 170 of the mobile terminal 100 may output a control signal for the anti-shake function in the prism module 192b to the prism module 192b.

4 is a diagram illustrating a camera having a double prism structure.

Referring to the drawings, the camera 195x of FIG. 4 includes an image sensor 820x, a lens device 193x that transmits light to the image sensor, a dual device including a first prism 192ax and a second prism 192bx. An example of including the prism device 192x is illustrated.

The camera 195x of FIG. 4 performs the movement of the lens device 193x to prevent camera shake. In the drawing, the compensation is performed in the Dra direction.

In this manner, when the optical zoom of the lens device 193x is high magnification, hand shake compensation has to be performed more. Therefore, the accuracy of image stabilization is lowered.

In the present invention, to compensate for this, hand shake compensation is implemented inside the prism module, and in particular, angle compensation is performed by using a rotary actuator. According to this, by performing angle compensation, there is an advantage that only the angle within a predetermined range needs to be compensated regardless of the case where the optical zoom of the lens device 193x is low magnification or high magnification. For example, the plurality of prism modules may be used to compensate the first angle in the first and second rotation axis directions, respectively. As a result, angle compensation within a predetermined range can be performed irrespective of the optical zoom, thereby improving the accuracy of image stabilization. This will be described with reference to FIG. 5 or below.

5 is a view showing an example of a camera having a rotatable dual prism module according to an embodiment of the present invention, Figures 6 to 8 is a view referred to the description of the camera of FIG.

Referring to the drawings, the camera 500a of FIG. 5 includes an image sensor 520, a lens device 593 that transmits light to the image sensor 520, a first prism module 592a, and a second prism module 592b. Illustrates a dual prismatic device 592 having a).

The dual prism device 592, unlike FIG. 4, differs in rotating to implement the anti-shake function.

On the other hand, the lens device 593, unlike Figure 4, is not equipped with a hand shake function, it can be implemented more slim.

The lens device 593 includes at least one lens, and the lens may be moved for variable focus.

For example, the lens device 593 includes a plurality of lenses, such as a concave lens and a convex lens, and based on a control signal from the image processor 830 or the controller 170, the internal lens for variable focus. At least one of the can be moved. In particular, it may move to the image sensor 820b or move in the opposite direction of the image sensor 820b.

5 is arranged in the order of the image sensor 520, the lens device 593, and the dual prism device 592, and the light incident on the dual prism device 592 enters the lens device 593 and the image. Although illustrated as being transmitted to the sensor 520, other modifications are possible.

Specifically, light from the top is reflected at the reflecting surface of the first prism PSMa in the first prism module 592a, transmitted to the second prism module 592b and the second prism in the second prism module 592b. The light may be reflected by the reflective surface of the PSMb and transmitted to the lens device 593 and the image sensor 520.

That is, unlike FIG. 5, light arranged in the order of the image sensor 520, the dual prism device 592, and incident on the lens device 593 is the dual prism device 592 and the image sensor 520. May be delivered.

The dual prism device 592 includes a first prism module 692a having a first prism PSMa, a first rotational actuator for angularly shifting the first prism PSMa in a first direction to compensate for camera shake, A second prism module 692b may include a second prism PSMb and a second rotational actuator for angularly shifting the second prism PSMb in a second direction to compensate for image stabilization.

In this case, the first prism PSMa and the second prism PSMb may be disposed perpendicular to each other.

Accordingly, the image sensor 520, the lens device 593, and the first prism module 692a are arranged side by side in one direction, but the second prism module 692b crosses the first prism module 692a. Can be deployed.

Accordingly, the first prism module 692a and the second prism module 692b may be referred to as an L-shaped dual prism device 592. In addition, such a structure of the camera 500a may be referred to as an L-type camera.

According to this structure, the first prism module 692a and the second prism module 692b, respectively, the first direction CRa with respect to the first rotation axis, and the second direction CRb with respect to the second rotation axis, respectively. Angle compensation can be performed, thereby preventing a hand shake function.

In particular, by performing angle compensation using the rotary actuator, there is an advantage that only the angle within a predetermined range needs to be compensated regardless of the case where the optical zoom of the lens device 593 is low magnification or high magnification. As a result, regardless of the optical zoom, the accuracy of image stabilization is improved.

In addition, in a limited space, since the optimum space can be arranged, a slim camera 500a can be implemented. Therefore, it can be applied to the mobile terminal 100 or the like.

6 is a diagram showing another example of a camera having a rotatable dual prism module according to an embodiment of the present invention.

Referring to the drawings, the camera 600 of FIG. 6 includes an image sensor 620, a lens device 693 transmitting light to the image sensor 620, a first prism module 692a and a second prism module 692b. An example of a dual prism device 692 having

The camera 600 of FIG. 6 is similar to the camera 500a of FIG. 5, except that the arrangement of the first prism module 692a and the second prism module 692b in the dual prism device 692 is different. have. This description focuses on the difference.

In the drawing, light arranged in the order of the image sensor 620, the lens device 693, and the dual prism device 692, and the light incident on the dual prism device 692 is the lens device 693 and the image sensor 620. For example,

Specifically, light from the top is reflected at the reflecting surface of the first prism PSMa in the first prism module 692a, transmitted to the second prism module 692b, and the second prism in the second prism module 692b. The light may be reflected by the reflective surface of the PSMb and transmitted to the lens device 693 and the image sensor 620.

That is, unlike FIG. 5, there is a difference in that the first prism module 692a in the dual prism device 692 of FIG. 6 is disposed in the forward direction compared to the second prism module 692b. Accordingly, the light reflected by the prism module PSMa in the first prism module 692a travels in the paper direction or the right direction.

That is, unlike FIG. 6, the light is incident in the order of the image sensor 620, the dual prism device 692, and the lens device 693, and the light incident on the lens device 693 includes the dual prism device 692. It may also be transferred to the image sensor 620. In the following description, the structure of FIG. 6 is mainly described.

The dual prism device 692 includes a first prism module 692a having a first prism PSMa, a first rotational actuator for angularly shifting the first prism PSMa in a first direction for image stabilization; A second prism module 692b may include a second prism PSMb and a second rotational actuator for angularly shifting the second prism PSMb in a second direction to compensate for image stabilization.

Accordingly, the image sensor 620, the lens device 693, and the first prism module 692a are arranged side by side in one direction, but the second prism module 692b crosses the first prism module 692a. Can be arranged.

Accordingly, the first prism module 692a and the second prism module 692b may be referred to as an L-shaped dual prism device 692. The camera 600 may also be referred to as an L-type camera.

According to this structure, as shown in FIG. 7, the first direction CRa and the second rotation axis with respect to the first rotation axis Axa through the first prism module 692a and the second prism module 692b, respectively. Angle compensation in the second direction CRb can be performed based on Axb, so that a hand shake prevention function can be implemented, and also, in a limited space, an optimal space arrangement can be performed. The camera 600 may be implemented. Therefore, it can be applied to the mobile terminal 100 or the like.

7 and 8, the first prism module 692a includes a prism PSMa, a prism holder PSMHa for fixing the prism PSMa on the first surface, and a prism holder PSMHa. Is disposed between the yoke (Yka) and the driving magnet (DMa) seated on the yoke (Yka), the coil holder (CLHa), and the coil holder (CLHa) and the yoke (Yka). The driving coil DCLa, the coil holder CLHa holding the driving coil DCLa, and the hall sensor Hsa positioned between the driving coil DCLa and the driving magnet DMa may be provided.

The coil holder CLHa may include protrusions at both ends protruding in the prism holder PSMa direction and opening portions HSSa formed in the protrusions, respectively.

The prism holder PSMa may include bosses BSSa at both ends that protrude in the coil holder CLHa direction.

The bosses BSSa at both ends of the prism holder PSMa may be coupled to the openings HSSa formed at both ends in the coil holder CLHa.

On the other hand, the drive magnet DMa and the drive coil DCLa in the first prism module 692a can constitute the first rotary actuator ACTa.

For example, when a compensation signal based on a magnetic field sensed by the hall sensor HSa is applied to the driving coil DCLa, a Lorentz force is generated between the driving coil DCLa and the driving magnet DMa. The driving magnet DMa may rotate in the first direction.

Accordingly, the driving magnet DMa, the prism holder PSMHa, and the prism PSMa may be rotated according to the rotation of the first rotation axis Axa.

Meanwhile, the coil holder CLHa, the driving coil DCLa, and the hall sensor HSa may be fixed without being rotated despite the rotation of the first rotation axis Axa.

As such, some units in the first prism module 692a rotate and some units are fixed to detect hand shake based on the magnetic field signal sensed by the hall sensor HSa, and to compensate for hand shake. The driving magnet DMa is rotated to rotate the prism PSMa or the like. Thus, image stabilization in the first direction can be performed accurately.

Meanwhile, referring to FIG. 8, the second prism module 692b includes a prism PSMb, a prism holder PSMHb for fixing the prism PSMb to the first surface, and a prism holder PSMHb. The yoke Ykb coupled to the two surfaces, the drive magnet DMb seated on the yoke Ykb, the coil holder CLHb, and the drive coil disposed between the coil holder CLHb and the yoke Ykb The DCLb, the coil holder CLHb fixing the driving coil DCLb, and the hall sensor Hsb positioned between the driving coil DCLb and the driving magnet DMb may be provided.

The coil holder CLHb may include protrusions at both ends protruding in the prism holder PSMb direction, and openings HSSb respectively formed in the protrusions.

The prism holder PSMb may include bosses BSSb at both ends that protrude in the coil holder CLHb direction.

The bosses BSSb at both ends of the prism holder PSMb may be coupled to the openings HSSb formed at both ends in the coil holder CLHb.

On the other hand, the drive magnet DMb and the drive coil DCLb in the second prism module 692b can constitute the second rotary actuator ACTb.

For example, when a compensation signal based on the magnetic field sensed by the hall sensor HSb is applied to the driving coil DCLb, a Lorentz force is generated between the driving coil DCLb and the driving magnet DMb. The driving magnet DMb may rotate in the second direction.

Accordingly, the driving magnet DMb, the prism holder PSMHb, and the prism PSMb may be rotated according to the rotation of the second rotation axis Axb.

Meanwhile, the coil holder CLHb, the driving coil DCLb, and the hall sensor HSb may be fixed without being rotated despite the rotation of the second rotation shaft Axb.

As such, some units in the second prism module 692b are rotated and some units are fixed to detect hand shake based on the magnetic field signal sensed by the hall sensor HSb, and to compensate for hand shake. The driving magnet DMb rotates to rotate the prism PSMb or the like. Thus, image stabilization in the second direction can be performed accurately.

As illustrated in FIG. 9A, the camera 195b or 195c of the mobile terminal 100 may capture an image 910 including the subject DOG, spaced apart by the first distance D1 in the photographing mode.

Accordingly, the controller 170 of the mobile terminal 100 may control to display the image 910 including the object OBa corresponding to the subject DOG on the display 180 as shown in FIG. 9A. .

In FIG. 9A, a dog as a pet is illustrated as a subject DOG, but various subjects such as a moving vehicle, an animal, and a person are possible.

Meanwhile, as shown in FIG. 9B, when the object OBa corresponding to the subject DOG is selected, the controller 170 of the mobile terminal 100 zooms in on the object OBa corresponding to the subject DOG. control to perform (zoom tracking).

In FIG. 9B, the object OBa corresponding to the subject DOG is selected by the user's finger touch input FNG. However, the user's gaze through the image acquired by the front camera 195a may be different. By tracking, it is possible to select the object OBa corresponding to the subject DOG, or to select the object OBa corresponding to the subject DOG by the user's voice.

Meanwhile, as illustrated in FIG. 9B, when the object OBa corresponding to the subject DOG is selected, the controller 170 of the mobile terminal 100 highlights the object OBa corresponding to the selected subject DOG. Can be controlled.

Meanwhile, as illustrated in FIG. 9C, the controller 170 of the mobile terminal 100 may control the object OBa corresponding to the selected subject DOG to be activated and displayed.

When there is an enlargement input for zooming as shown in FIG. 9C, the controller 170 of the mobile terminal 100 enlarges the object OBa corresponding to the selected subject DOG as shown in FIG. 9D. It can be controlled to display the object (OBaa).

In this case, the controller 170 of the mobile terminal 100 may set a desired zoom ratio. The controller 170 of the mobile terminal 100 may transmit a control signal to the lens device 693 according to the set zoom factor.

Meanwhile, as illustrated in FIG. 9D, the controller 170 of the mobile terminal 100 may control the enlarged object OBaa to be displayed in correspondence with the position of the object OBa before the enlargement.

Alternatively, as shown in FIG. 9E, the controller 170 of the mobile terminal 100 may display the enlarged object OBaa in the center area of the display 180 regardless of the position of the object OBa before the enlargement. You can also control it.

In the drawing, an image 915 including an enlarged object OBaa is illustrated on the display 180.

On the other hand, when the subject DOG moves and approaches the second distance D2 closer than the first distance D1, the control unit 170 of the mobile terminal 100 moves the position of the lens in the lens device 693. Can be controlled to vary.

Accordingly, while the magnification of the zoom for the moving subject DOG is maintained, the auto focus AF function can be performed.

For example, the control unit 170 of the mobile terminal 100, the closer the subject (DOG), the part of the lens in the lens device 693, the farther away from the image sensor 620.

FIG. 10A shows the distance between the first lens Lsa and the second lens Lsb in the lens device 693 when the distance of the subject DOG is spaced apart by the first distance D1 as shown in FIG. 9A. This illustrates that it is DSb.

10B illustrates a first lens Lsa in the lens device 693 when the distance of the subject DOG is spaced apart by the second distance D2 closer than the first distance D1. The distance between the second lens Lsb and the second lens Lsb is far from DSa.

In FIG. 9F, when the distance of the subject DOG approaches the second distance D2 closer than the first distance D1, the image 915b including the object OBaa for the subject DOG having a constant size. Illustrates that is displayed on the display 180.

Meanwhile, in FIG. 9G, when the distance of the subject DOG approaches the third distance D3 closer than the second distance D2, the image including the object OBaa for the subject DOG having a constant size ( 915c is shown on the display 180.

The controller 170 of the mobile terminal 100 may control the size of the object with respect to the subject DOG to be constantly displayed while the zoom magnification decreases as the subject DOG approaches.

As described above, when the fixed zoom magnification of the subject is set, the controller 170 of the mobile terminal 100 may control the zoom tracking mode to be performed. The corresponding object can be displayed at a constant size regardless of the movement of the subject.

On the other hand, even if the subject DOG moves left and right, the control unit 170 of the mobile terminal 100 according to the zoom tracking mode, as illustrated in FIG. 9H, includes an image including the object OBaa for the subject DOG. 915d may be controlled to be displayed on the display 180.

Meanwhile, as illustrated in FIG. 11A, the camera 195b or 195c of the mobile terminal 100 may capture an image 1010 including the subject HUM spaced apart by the first distance Da in the photographing mode. have.

Accordingly, the controller 170 of the mobile terminal 100 may control to display the image 1010 including the object OBb corresponding to the subject HUM on the display 180 as shown in FIG. 11A. .

In FIG. 11A, a person is illustrated as the subject HUM, but various subjects such as a moving vehicle and an animal are possible.

Meanwhile, as shown in FIG. 11B, when the object OBb corresponding to the subject HUM is selected, the controller 170 of the mobile terminal 100 zooms in on the object OBb corresponding to the subject HUM. control to perform (zoom tracking).

In FIG. 11B, the object OBb corresponding to the subject HUM is selected by the user's finger touch input FNG. However, the user's gaze through the image acquired by the front camera 195a may be different. By tracking, it is possible to select the object OBb corresponding to the subject HUM, to select the object OBb corresponding to the subject HUM by the user's voice.

Meanwhile, when there is an enlargement input for zooming as shown in FIG. 11C, the controller 170 of the mobile terminal 100 enlarges the object OBb corresponding to the selected subject HUM as shown in FIG. 11D. It can be controlled to display the object (OBba).

Meanwhile, as illustrated in FIG. 11D, the controller 170 of the mobile terminal 100 may control to display the enlarged object OBba corresponding to the position of the object OBb before the enlargement.

Alternatively, as shown in FIG. 11E, the controller 170 of the mobile terminal 100 may display the enlarged object OBba in the center area of the display 180 regardless of the position of the object OBb before the enlargement. You can also control it.

In the drawing, an image 1015 including an enlarged object OBba is illustrated on the display 180.

On the other hand, when the subject HUM moves and approaches the second distance Db closer than the first distance Da, the controller 170 of the mobile terminal 100 moves the position of the lens in the lens device 693. Can be controlled to vary.

Accordingly, while the magnification of the zoom for the moving subject HUM is maintained, the auto focus AF function can be performed.

For example, the control unit 170 of the mobile terminal 100, as the subject (HUM) is closer, some of the lenses in the lens device 693 may be farther away from the image sensor 620.

FIG. 10A illustrates the distance between the first lens Lsa and the second lens Lsb in the lens device 693 when the distance of the subject HUM is spaced apart by the first distance Da, as shown in FIG. 11A. This illustrates that it is DSb.

On the other hand, FIG. 10B shows the first lens Lsa in the lens device 693 when the distance of the subject HUM is spaced apart by the second distance Db closer than the first distance Da, as shown in FIG. 11F. The distance between the second lens Lsb and the second lens Lsb is far from DSa.

In FIG. 11F, when the distance of the subject HUM approaches the second distance Db closer than the first distance Da, the image 1015b including the object OBba for the subject HUM having a constant size. Illustrates that is displayed on the display 180.

Meanwhile, in FIG. 11G, when the distance of the subject HUM approaches the third distance Dc closer than the second distance Db, the image including the object OBba for the subject HUM having a constant size ( 1015c is displayed on the display 180.

The controller 170 of the mobile terminal 100 may control the size of the object with respect to the subject HUM to be constantly displayed while the zoom magnification decreases as the subject HUM gets closer.

As described above, when the fixed zoom magnification of the subject is set, the controller 170 of the mobile terminal 100 may control the zoom tracking mode to be performed. Accordingly, the control unit 170 of the mobile terminal 100 may control the subject HUM. The corresponding object can be displayed at a constant size regardless of the movement of the subject.

On the other hand, even if the subject HUM is turned back and moves away, the controller 170 of the mobile terminal 100 includes the object OBbm for the subject HUM, as shown in FIG. 11H, according to the zoom tracking mode. The image 1015d may be controlled to be displayed on the display 180.

The controller 170 of the mobile terminal 100 determines whether the subject HUM is approaching the front or is turned away from the subject through object detection of the face of the subject HUM, and the subject HUM. Even if the user turns back and moves away, the image 1015d including the object OBbm for the subject HUM may be displayed on the display 180 according to the tracking mode.

FIG. 11H illustrates that the subject HUM is turned back and positioned at the third distance Dc. FIG. 11I illustrates that the subject HUM is turned back and is located at a first distance Da farther than the third distance Dc. Example of location.

In the case of FIG. 11I, the controller 170 of the mobile terminal 100 may control the display 180 to display an image 1015e including an object OBbm for a subject HUM having a predetermined size. .

11J, even when the subject HUM is turned back and the face faces the front, the controller 170 of the mobile terminal 100 includes the object OBbm for the subject HUM having a constant size. The image 1015f may be controlled to be displayed on the display 180. Accordingly, despite the movement of the subject of interest to the user, tracking is possible, and since the display can be displayed at a constant size, the user's convenience can be increased.

9A to 11J, the mobile terminal 100 includes the dual prism device 692 including the first prism module 692a and the second prism module 692b even if the user shakes the hand. Therefore, the camera shake correction function is applied.

Referring to FIG. 12A, an image display device according to another embodiment of the present invention, in particular, the mobile terminal 100 may include a high magnification camera 195b and a low magnification camera 195c.

In addition, in the photographing mode, the mobile terminal 100 may obtain an image using the high magnification camera 195b and the low magnification camera 195c, respectively.

In FIG. 12A, the area | region BSBa containing the pitcher of a baseball field is image | photographed using the high magnification camera 195b and the low magnification camera 195c.

In the photographing mode, the controller 170 of the mobile terminal 100 may control the image captured by the low magnification camera 195c to be displayed as a default rather than the high magnification camera 195b.

That is, as shown in FIG. 12B, the controller 170 of the mobile terminal 100 may control the image 1110 photographed by the low magnification camera 195c to be displayed on the display 180.

On the other hand, the control unit 170 of the mobile terminal 100, when the object (PTC) corresponding to the pitcher in the image 1110 is selected by the finger (FNG) touch, as shown in Fig. 12B, as shown in Fig. 12C The image 1010b captured by the low magnification camera 195c and the image 1020 captured by the high magnification camera 195b may be displayed together.

In this case, the selected object in the image 1010b may be highlighted and displayed as shown in the figure.

The controller 170 of the mobile terminal 100 may manage images captured by the high magnification camera 195b and the low magnification camera 195c as one file.

Accordingly, when the controller 170 of the mobile terminal 100 cannot display an image enlarged by the low magnification camera 195c as shown in FIG. 12B, the image 1020 captured by the high magnification camera 195b is displayed. It can be controlled to be displayed together.

Alternatively, in FIG. 12B, when an object (PTC) corresponding to the pitcher in the image 1110 is selected, the controller 170 of the mobile terminal 100 is photographed by the low magnification camera 195c as shown in FIG. 12D. The displayed image 1010b may be controlled so that only the image 1020b captured by the high magnification camera 195b is displayed. Accordingly, the optical zoom based image display for the object desired by the user is possible.

12E illustrates that the enlarged image 1215 is displayed superimposed on the base image 1210, and FIG. 12F illustrates that the enlarged image 1225 is displayed superimposed on the base image 1220.

Unlike FIG. 12E or FIG. 12F, as shown in FIG. 12C or FIG. 12D, in particular, the optical zoom-based

images

1020 and 1020b for the object desired by the user are different from the image 1010b captured by the low magnification camera 195c. By being separated and not overlapping and being displayed separately, viewing immersion of the object desired by the user can be improved.

12A to 12F, the mobile terminal 100 includes the dual prism device 692 including the first prism module 692a and the second prism module 692b even if the user shakes the hand. Therefore, the camera shake correction function is applied.

In addition, although the preferred embodiment of the present invention has been shown and described above, the present invention is not limited to the specific embodiments described above, but the technical field to which the invention belongs without departing from the spirit of the invention claimed in the claims. Of course, various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical spirit or the prospect of the present invention.

Claims

camera;

display;

A controller configured to display an image photographed through the camera and perform zoom tracking on the object corresponding to the first subject when an object corresponding to the first subject in the image displayed on the display is selected; Image display apparatus comprising a.
The method of claim 1,

The control unit,

And when an object corresponding to the first subject in the image displayed on the display is selected, the object corresponding to the first subject is displayed to be highlighted.
The method of claim 1,

The control unit,

And a magnification input for zooming, in which the object corresponding to the first subject is enlarged to control to display the enlarged object.
The method of claim 3,

The control unit,

And displaying the enlarged object on the center area of the display when the enlarged object is displayed.
The method of claim 1,

The control unit,

And a control signal is output to a lens device in the camera according to a set zoom factor.
The method of claim 1,

The control unit,

And outputting a control signal to a lens device in the camera when the first subject is moved.
The method of claim 6,

The control unit,

As the first subject gets closer, a part of the lenses in the lens structure is controlled to move away from the image sensor in the camera or the distance between the first lens king and the second lens in the lens structure is farther away. A video display device.
The method of claim 1,

The control unit,

And when the fixed zoom factor is set for the first subject, controlling the size of an object corresponding to the first subject to be constantly displayed even with the movement of the first subject.
The method of claim 8,

The control unit,

And the zoom magnification is lowered as the first subject gets closer.
The method of claim 1,

The camera,

In order to compensate for the motion detected by the gyro sensor, a prism device for changing the angle of the incident light with respect to the first axis and the second axis of rotation, and outputs;

A lens device having a plurality of lenses, at least one lens being moved for variable focus, and outputting light from the prism device using the moved lens;

And an image sensor for converting light from the lens device into an electrical signal.
The method of claim 10,

The prism device,

A first prism on which input light is reflected;

A first actuator configured to change the angle of the first prism with respect to the first axis of rotation based on the input first control signal;

A second prism that reflects light from the first prism;

And a second actuator configured to change an angle of the second prism with respect to the second axis of rotation based on the input second control signal.
The method of claim 11,

The prism device,

A first hall sensor sensing a change in magnetic field according to a change in angle of the first prism;

And a second hall sensor which senses a change in the magnetic field according to the change of the angle of the second prism.
The method of claim 12,

The camera,

The first actuator is controlled based on the first control signal and first magnetic field change information from the first hall sensor, and the second control signal and second magnetic field change information from the second hall sensor are controlled. And a driving controller configured to control the second actuator.
The method of claim 11,

The first actuator is,

And a first driving magnet and a first driving coil.
The method of claim 14,

The prism device,

A first prism holder fixing the first prism to a first surface;

A first yoke having a first surface attached to a second surface that is a rear surface of the first surface of the first prism holder;

And a first coil holder having a protrusion protruding in the direction of the first prism holder and an opening formed in the protrusion.

The first driving magnet,

Is attached to a second surface, which is a rear surface of the first surface of the first yoke,

The first drive coil,

Disposed between the first coil holder and the first yoke,

And bosses at both ends of the first prism holder are coupled to the openings formed at the protrusions of the first coil holder.
A first camera at a first magnification;

A second camera at a second magnification;

display;

And a controller configured to manage the images photographed by the first camera and the second camera to be managed as one file.
The method of claim 16,

The control unit,

And an image obtained by the first camera at the first magnification and an image obtained by the second camera at the second magnification are separated and displayed separately.
The method of claim 16,

The control unit,

And when the enlarged display of the image acquired by the first camera at the first magnification is impossible, only the image obtained by the second camera at the second magnification is displayed.
The method of claim 16,

The first camera or the second camera,

In order to compensate for the motion detected by the gyro sensor, a prism device for changing the angle of the incident light with respect to the first axis and the second axis of rotation, and outputs;

A lens device having a plurality of lenses, at least one lens being moved for variable focus, and outputting light from the prism device using the moved lens;

And an image sensor for converting light from the lens device into an electrical signal.