KR20130038658A - Mobile terminal - Google Patents

Abstract

PURPOSE: A mobile terminal is provided to control a frame rate of a camera based on delay time of the mobile terminal, thereby accurately sensing a position of a user without an error and delay. CONSTITUTION: A 3D image panel alternatively forms a penetration zone and a non-penetration zone in the front side of a display unit. A control unit(180) determines user position information based on an image photographed by a camera(121). The control unit controls movement of the non-penetration zone of a 3D image filter by controlling a 3D image filter driving unit(183) based on the user position information. The control unit controls a frame rate of the camera based on delay time. [Reference numerals] (121) Camera; (180) Control unit; (183) 3D image filter driving unit; (610) Position detection unit; (620) Movement amount calculation unit; (630) Communication control unit;

Description

[0001] MOBILE TERMINAL [0002]

The present invention relates to a mobile terminal, and more particularly, to a mobile terminal capable of displaying two-view and multi-view images in an autostereoscopic manner.

The terminal can move And may be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

Such a terminal has various functions, for example, in the form of a multimedia device having multiple functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, etc. .

In addition to the content for displaying two-dimensional (2D) video signal as a two-dimensional image as a content for broadcasting, content that displays a three-dimensional (3D) video signal as a three-dimensional image is produced and planned. have.

The technique of displaying a 3D image uses the principle of binocular parallax, in which an observer feels a stereoscopic feeling due to binocular disparity, and is classified into a shutter glass method, a glasses-free method, a full three-dimensional method, and the like.

In particular, in the case of the autostereoscopic method, the area where the stereoscopic image can be viewed without image reversal and cross chin is limited, so that the display of the stereoscopic image is controlled according to the position of the user.

An object of the present invention is to provide a mobile terminal capable of quickly and accurately detecting a user's position without errors and delays, and displaying a stereoscopic image such that the detected user's position becomes a sweet spot area.

In order to achieve the above technical problem, a mobile terminal according to the present invention includes a display unit for displaying at least two or two or more viewpoint images, disposed in front of the display unit, and alternately transmissive region and non-transmissive region. A stereoscopic image panel to be formed, a camera capturing an image of a user, and determining user location information related to the location of the user based on the captured image, and an opaque region of the stereoscopic image filter based on the determined user location information A control unit for generating a control signal for controlling the movement of the control unit; and a stereoscopic image filter driving unit for moving an opaque region of the stereoscopic image filter based on the control signal, wherein the control unit generates the control signal to generate the stereoscopic image. The camera based on a delay time to be transmitted to the image filter driver It is possible to control the frame rate.

The delay time may include a delay time for inputting an image frame captured by the camera to the controller, a delay time for generating the control signal using the input image frame, and the generated control signal. At least one of the delay time to start the transmission to the transmission signal and the control signal is transmitted to the three-dimensional image filter driver.

The frame rate may be set such that a time interval between image frames captured by the camera is greater than the delay time.

The controller determines user location prediction information related to a future location of the user when a preset time elapses based on the captured user image, and the stereoscopic image filter is based on the determined user location prediction information. A second control signal for controlling the movement of the opaque region of may be generated. Here, the controller may determine the moving speed of the user by using the determined user location information and previously determined user location information, and determine the user location prediction information by using the determined moving speed and the location of the user. have. The controller may control the frame rate of the camera based on the delay time and the number of times of determining the user position prediction information.

In order to achieve the above technical problem, a mobile terminal according to the present invention includes a display unit for displaying at least two or two or more viewpoint images, a lenticular lens disposed on the front of the display unit, and having a plurality of lenses. A control signal for determining user position information related to the position of the user based on a substrate, a camera for photographing an image of the user, and the photographed image, and controlling movement of the plurality of lenses based on the determined user position information. A control unit to generate and a stereoscopic image filter driving unit to move the plurality of lenses based on the control signal, wherein the control unit includes a delay time until the control signal is generated and transmitted to the stereoscopic image filter driving unit. Frame rate of the camera can be controlled.

According to another aspect of the present invention, a mobile terminal according to the present invention includes a display unit for displaying at least two or two or more viewpoint images, disposed in front of the display unit, and alternating a transmission region and an opacity region. And determine user location information related to the location of the user based on the stereoscopic image panel to be formed, the camera capturing an image of the user, and the captured image, and the viewpoint images based on the determined user location information. Determining the position to be displayed on the display unit, generating image data including the pixel value or the sub pixel value of the viewpoint image arranged according to the determined position, the delay time until the image data is generated and transmitted to the display unit To control the frame rate of the camera based on It may include a control unit.

The delay time may include a delay time for inputting an image frame captured by the camera to the controller, a delay time for generating the image data using the input image frame, and transmitting the generated image data to the display unit. It may include at least one of a delay time to start and a delay time to transmit the image data to the display unit.

The controller may calculate a stereoscopic image change amount based on the determined user position information, and determine a position at which the viewpoint images are displayed on the display unit based on the calculated stereoscopic image change amount.

The controller determines user location prediction information related to the future location of the user when a preset time elapses based on the image of the captured user, and the viewpoint images are based on the determined user location prediction information. The display apparatus may determine a position to be displayed on the display unit and generate second image data including a pixel value or a sub pixel value of a viewpoint image arranged according to the determined position.

The controller may control the frame rate of the camera based on the delay time and the number of times of determining the user position prediction information.

In order to achieve the above technical problem, a mobile terminal according to the present invention includes a display unit displaying at least two or two or more viewpoint images, and a lentincule disposed on the front of the display unit and including a plurality of lenses. Determine the user position information related to the position of the user based on a lens substrate, a camera that captures an image of the user, and the captured image, and display the viewpoint images on the display based on the determined user position information. Determine the position to be generated, and generate image data including pixel values or sub-pixel values of the viewpoint image arranged according to the determined position, and based on a delay time between the image data being generated and transmitted to the display unit. The control unit for controlling the frame rate of the There.

According to the mobile terminal according to the present invention, since the camera mounted on the mobile terminal photographs the user at a constant frame rate regardless of the illuminance of the external environment, the user's position is quickly detected, and the detected user's position is the sweet spot area. By allowing this movement, the user can feel a three-dimensional feeling without fatigue or awkwardness. In addition, since the frame rate of the camera mounted on the mobile terminal is adjusted based on the delay time of the mobile terminal, the present invention can accurately detect the position of the user without errors and delays.

1 is a block diagram showing the configuration of a preferred embodiment for a mobile terminal according to the present invention;
2 is a front perspective view of a preferred embodiment of a mobile terminal according to the present invention;
3 is a view showing an arrangement of an embodiment of a three-dimensional image filter;
4 is a diagram illustrating an arrangement of another embodiment of a stereoscopic image filter;
5 is a view showing the principle of the liquid crystal Lenticular,
6 is a block diagram showing a configuration of a preferred embodiment of the control unit;
7 is a view showing an amount of change in stereoscopic images calculated according to a change in the viewer's position;
8 is a view illustrating movement of a sweet spot according to a change in position of a stereoscopic image filter;
9 is a diagram illustrating a time interval of an image frame captured by a camera;
10 is a block diagram showing the configuration of another preferred embodiment of the control unit;
11 is a view illustrating movement of a sweet spot according to a change in display position of a viewpoint image;
12 is a block diagram showing the configuration of another preferred embodiment of the control unit;
13 to 16 are views illustrating an image frame in which a camera photographs a viewer, and
17 is a block diagram showing the configuration of another preferred embodiment of the control unit.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. At this time, the configuration and operation of the present invention shown in the drawings and described by it will be described as at least one embodiment, by which the technical spirit of the present invention and its core configuration and operation is not limited.

Although the terms used in the present invention have been selected in consideration of the functions of the present invention, it is possible to use general terms that are currently widely used, but this may vary depending on the intention or custom of a person skilled in the art or the emergence of new technology. Also, in certain cases, there may be a term selected arbitrarily by the applicant, in which case the meaning thereof will be described in detail in the description of the corresponding invention. Therefore, it is to be understood that the term used in the present invention should be defined based on the meaning of the term rather than the name of the term, and on the contents of the present invention throughout.

The mobile terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), and navigation. However, it will be readily apparent to those skilled in the art that the configuration according to the embodiments described herein may also be applied to fixed terminals such as digital TVs, desktop computers, etc., except when applicable only to mobile terminals.

1 is a block diagram showing the configuration of a preferred embodiment of a mobile terminal according to the present invention.

Referring to FIG. 1, the mobile terminal 100 according to the present invention includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, and an output unit ( 150, a memory 160, an interface unit 170, a controller 180, a stereoscopic image filter driver 183, a stereoscopic image filter 185, a power supply unit 190, and the like. The components shown in FIG. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal. The TV broadcast signal may include a 2D video broadcast signal and a 3D video broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 may be a digital multimedia broadcasting (DMB-T), a digital multimedia broadcasting (DMB-S), a media forward link only (DVF-H) (ISDB-T), and digital broadcasting systems such as ISDB-T (Integrated Services Digital Broadcast-Terrestrial). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. Wireless Internet technologies may include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), and the like.

The short range communication module 114 refers to a module for short range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for obtaining the position of the mobile terminal, and a representative example thereof is a Global Position System (GPS) module.

The A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame photographed by the camera 121 may be processed by the controller 180, and may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, And generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to the external device may be sensed. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 is for generating an output relating to visual, auditory or tactile sense and includes a display unit 151, an acoustic output module 152, an alarm unit 153, a haptic module 154, 155, and the like.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the mobile terminal 100 is in a video call mode or a photographing mode, the display 151 displays a photographed and / or received image, a UI, or a GUI. The display 151 displays a broadcast signal or stored video data when the mobile terminal 100 is in a broadcast signal display mode or an image display mode.

The display unit 151 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display (flexible). and at least one of a 3D display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another, or may be disposed integrally with one another, and may be disposed on different surfaces, respectively.

When the display unit 151 and a sensor for detecting a touch operation (hereinafter, referred to as a touch sensor) form a mutual layer structure (hereinafter referred to as a touch screen), the display unit 151 may be configured in addition to an output device. Can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. As a result, the controller 180 can know which area of the display unit 151 is touched.

The proximity sensor 141 may be disposed in the inner region of the mobile terminal wrapped by the touch screen or near the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of allowing the pointer to be recognized without being in contact with the touch screen so that the pointer is located on the touch screen is referred to as a "proximity touch", and the touch The act of actually touching the pointer on the screen is called "contact touch." The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor 141 detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, and a proximity touch movement state). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The sound output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events that occur in the mobile terminal include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The video signal or the audio signal may be output through the display unit 151 or the audio output module 152 so that they may be classified as a part of the alarm unit 153.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the haptic module 154 are controllable. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may be used for stimulation such as a pin array vertically moving with respect to the contact skin surface, a jetting force or suction force of air through an injection or inlet, grazing to the skin surface, contact of an electrode, and electrostatic force. Various tactile effects can be generated, such as effects by the endothermic and the reproduction of a sense of cold using the elements capable of endotherm or heat generation.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. The haptic module 154 may include two or more haptic modules 154 according to the configuration of the portable terminal 100.

The projector module 155 is a component for performing an image project function using the mobile terminal 100 and is similar to the image displayed on the display unit 151 in accordance with a control signal of the controller 180 Or at least partly display another image on an external screen or wall.

Specifically, the projector module 155 includes a light source (not shown) that generates light (for example, laser light) for outputting an image to the outside, a light source And a lens (not shown) for enlarging and outputting the image at a predetermined focal distance to the outside. Further, the projector module 155 may include a device (not shown) capable of mechanically moving the lens or the entire module to adjust the image projection direction.

The projector module 155 can be divided into a CRT (Cathode Ray Tube) module, an LCD (Liquid Crystal Display) module and a DLP (Digital Light Processing) module according to the type of the display means. In particular, the DLP module may be advantageous for miniaturization of the projector module 151 by enlarging and projecting an image generated by reflecting light generated from a light source on a DMD (Digital Micromirror Device) chip.

Preferably, the projector module 155 may be provided longitudinally on the side, front or back side of the mobile terminal 100. It goes without saying that the projector module 155 may be provided at any position of the mobile terminal 100 as occasion demands.

The memory unit 160 may store a program for processing and controlling the control unit 180 and temporarily store the input / output data (e.g., telephone directory, message, audio, For example. The memory unit 160 may also store the frequency of use of each of the data (for example, each telephone number, each message, and frequency of use for each multimedia). In addition, the memory unit 160 may store data on vibration and sound of various patterns output when the touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM A disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the mobile terminal 100 is connected to an external cradle, the interface unit 170 may be a path through which power from the cradle is supplied to the mobile terminal 100, or various command signals input from the cradle may be input by the user. It may be a passage that is delivered to the mobile terminal. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The control unit 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The controller 180 receives an image frame captured by the viewer from the camera 121 and detects the position of the viewer using the received image frame. In some embodiments, the controller 180 may calculate the stereoscopic image filter position based on the detected viewer's position. The position of the stereoscopic filter may be a barrier position and a lens position.

In some embodiments, the controller 180 may calculate a stereoscopic image change amount based on the detected viewer's position. The controller 180 may determine a position at which the viewpoint image included in the stereoscopic image is displayed based on the calculated stereoscopic image change amount. For example, as illustrated in FIG. 11, the controller 190 may control the display position of the left eye view image and the right eye view image to be changed according to the detected viewer's position.

In addition, the controller 180 may calculate the moving amount of the stereoscopic image filter by calculating a difference value between the calculated stereoscopic image filter position and the current stereoscopic image filter position. Here, the stereoscopic image filter shift amount may be a barrier shift amount and may be a lens shift amount.

The controller 180 may calculate the moving speed of the viewer using at least one of the detected viewer's position and the previously detected viewer's positions. The controller 180 estimates the viewer position when a preset time elapses using the detected viewer position and the calculated moving speed, and calculates the stereoscopic image filter position and the moving amount based on the estimated viewer position. Can be.

The controller 180 may generate a control signal for requesting the movement of the stereoscopic image filter based on one of the calculated stereoscopic image filter position and the stereoscopic image filter movement amount, and output the control signal to the stereoscopic image filter driver 183.

The stereoscopic image filter driver 183 may control the movement of the barrier or the lens of the stereoscopic image filter 185 based on the stereoscopic image filter position calculated by the controller 180. Here, the 3D image filter driver 183 calculates the 3D image filter shift amount by calculating the difference between the 3D image filter position and the current 3D image filter position calculated by the controller 180, and based on the 3D image filter shift amount calculated by the controller 180. Alternatively, the movement of the lens can be controlled.

In some embodiments, the 3D image filter driver 183 may control the movement of the transmission region and the non-transmission region of the 3D image filter 185 based on the position of the opacity region calculated by the controller 180. In some embodiments, the 3D image filter driver 183 may control the movement of the lens of the 3D image filter 185 based on the lens position calculated by the controller 180. Here, the transmission region refers to a region through which light is transmitted in the stereoscopic image filter, and the non-transmissive region refers to a region through which light is not transmitted through the stereoscopic image filter. In addition, the opaque region may be an area occupied by the barrier.

The stereoscopic image filter 185 is a filter for displaying two or more viewpoint images displayed on the display unit 151 as a stereoscopic image to the viewer. The three-dimensional image filter 185 may be one of a liquid crystal parallax barrier and a liquid crystalline filter.

In some embodiments, the stereoscopic image filter 185 may include transparent and opaque regions arranged at regular intervals. Light emitted from the display unit 151 is transmitted through the transmission area to reach the viewer's right eye or left eye. When the stereoscopic image filter 185 is a liquid crystal parallax barrier, the opaque region may be configured as a barrier, and the pair of transmissive and opaque regions may be referred to as pitch. The transmission region and the non-transmission region of the stereoscopic image filter 185 may be moved under the control of the stereoscopic image filter driver 183. In this case, the stereoscopic image filter 185 may be fixed to the mobile terminal 100.

In some embodiments, when the stereoscopic filter 185 is a liquid crystal reticular filter, the transmission region and the non-transmission region may be distinguished by a lens, and one lens may be referred to as a pitch. The lens of the stereoscopic image filter 185 may be moved under the control of the stereoscopic image filter driver 183. In this case, the stereoscopic image filter 185 may be fixed to the mobile terminal 100.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions. The described embodiments may be implemented by the controller 180 itself.

According to the software implementation, embodiments such as the procedures and functions described herein may be implemented as separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code may be implemented in software applications written in the appropriate programming languages. The software code is stored in the memory 160 and can be executed by the control unit 180. [

2 is a front perspective view of a preferred embodiment of a mobile terminal according to the present invention.

Referring to FIG. 2, the mobile terminal 100 includes a terminal body having a bar shape. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

The body includes a case (a casing, a housing, a cover, and the like) which forms an appearance. In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injecting synthetic resin or may be formed of a metal material, for example, a metal material such as stainless steel (STS) or titanium (Ti).

The display unit 151, the sound output unit 152, the camera 121, the user input units 130/131 and 132, the microphone 122, the interface 170, and the like may be disposed in the front body 101 have.

The display unit 151 occupies most of the main surface of the front case 101. The audio output unit 151 and the camera 121 may be disposed in an area adjacent to one end of both ends of the display unit 151, and a stereoscopic image filter 185 may be disposed at the one end. The stereoscopic filter 185 may be disposed to be bonded to one end of the display 151. The user input unit 131 and the microphone 122 are disposed in an area adjacent to the other end of the display unit 151.

The user input unit 132 and the interface 170 may be disposed on the side surfaces of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the portable terminal 100 and may include a plurality of operation units 131 and 132. The manipulation units 131 and 132 may also be collectively referred to as manipulating portions, and may be employed in any manner as long as the user operates the tactile manner with a tactile feeling.

The contents inputted by the first or second operation unit 131 or 132 may be variously set. For example, the first operation unit 131 receives commands such as start, end, scroll, and the like, and the second operation unit 132 controls the size of the sound output from the sound output unit 152 or the size of the sound output from the display unit 151 To the touch recognition mode of the touch screen.

3 is a diagram illustrating an arrangement of an embodiment of a stereoscopic image filter.

Referring to FIG. 3, the stereoscopic panel 300 includes a display panel 310, an opaque region 321, and a transmissive region that display a stereoscopic image in which a left eye view image L and a right eye view image R are mixed. 322 includes a stereoscopic image filter 320 arranged at a predetermined interval. Here, the 3D image filter 320 may be a liquid crystal parallax barrier. The display unit 151 of FIG. 1 may be a display panel 310, and the stereoscopic image filter 185 of FIG. 1 may be a stereoscopic image filter 320.

The stereoscopic filter 320 is disposed at a predetermined distance in front of the display panel 310, and the opaque region 321 and the transmission region 322 are alternately arranged in a direction parallel to the display panel 310.

When the display panel 310 displays viewpoint images corresponding to the left eye L and the right eye R, the viewer may display the displayed left eye L and right eye R through the stereoscopic filter 320. The left and right eyes of the viewer independently view the left eye view image L and the right eye view image R provided from the display panel 310, respectively, so that the viewer can feel a three-dimensional effect.

The spot where the viewer can see 3D images is called a sweet spot. That is, in the sweet spot, a cross-talk in which the left eye view image L and the right eye view image R overlap, and an image reversal phenomenon in which the left eye view image L and the right eye view image R are reversed are shown. It means the point where no flipping occurs. The sweet spot for viewing the left eye view image L may be points 332 and 334, and the sweet spot for viewing the right eye view image R may be points 331 and 333. If the viewer's right eye is located at points 332 and 334, and the viewer's left eye is located at points 331 and 333, image reversal may occur.

4 is a diagram illustrating an arrangement of another embodiment of a stereoscopic image filter.

Referring to FIG. 4, the stereoscopic image panel 400 includes a display panel 410 for displaying a stereoscopic image in which a left eye view image L and a right eye view image R are mixed, and a stereoscopic image filter including a plurality of lenses ( 420). The display unit 151 of FIG. 1 may be a display panel 410, and the stereoscopic image filter 185 of FIG. 1 may be a stereoscopic image filter 420.

The stereoscopic filter 420 may be disposed in front of the display panel 410. In this case, the stereoscopic image filter 420 may be disposed to be spaced apart from the display panel 410 by a predetermined distance ℓ so that the image lies on the focal plane of the lenticular lens.

The stereoscopic filter 420 may be a liquid crystal lenticular filter. In this case, the lens 421, the lens 422, the lens 423, the lens 424, and the lens 425 included in the stereoscopic image filter 420 may be liquid crystal lenses.

5 is a view showing the principle of the liquid crystal Lenticular.

Referring to FIG. 5, the liquid crystal lenticular filter 520 may be formed of a transparent electrode (ITO) 521 and 522 and a liquid crystal (LC) disposed between the transparent electrodes. The liquid crystal lenticular filter 520 adjusts the refraction of light emitted from the display panel 510 through liquid crystal (LC) so that the viewpoint zeros are positioned on an appropriate sweet spot. That is, liquid crystal (LC) forms lenses that refract light. The liquid crystal lenticular filter 520 may adjust the position, direction, and arrangement of the liquid crystal (LC) by adjusting the voltage applied to the transparent electrode ITO. The position of the lens to be formed may be changed according to the position, direction, and arrangement of the liquid crystal (LC), and thus the sweet spot may be changed.

6 is a block diagram showing the configuration of a preferred embodiment of the control unit.

Referring to FIG. 6, the controller 180 may include a location detector 610, a movement amount calculator 620, and a communication controller 630.

The position detector 610 receives an image frame captured by the viewer from the camera 121 and detects the position of the viewer using the received image frame. The location detector 610 may detect the location of the viewer by recognizing the face area. Here, the position detector 610 may recognize a face region using an algorithm using symmetry of the face, an algorithm using a hair color and a face color, and an algorithm using a contour of the face. In addition, the location detector 610 may recognize the face region by calculating skin color information in the image frame.

The movement amount calculator 620 calculates the stereoscopic image filter position and the stereoscopic image filter movement amount based on the detected viewer position and outputs the calculated stereoscopic image filter movement amount. In addition, the movement amount calculating unit 620 may generate a control signal for controlling the movement of the opaque region of the stereoscopic image filter according to the current stereoscopic image filter position and the calculated stereoscopic image filter movement amount, and the generated control signal is a communication control unit. And output to 630. The generated control signal may be a signal that allows the opaque region to be positioned at a point moved by the calculated stereoscopic image filter moving amount from the current point.

In some embodiments, the movement amount calculator 620 finds the positions of the transmission region and the opacity region of the stereoscopic image filter having a sweet spot corresponding to the detected viewer position, and transmits the transmission region of the current stereoscopic image filter. And the amount of movement of the stereoscopic image filter may be calculated by calculating the difference between the positions of the opaque regions.

In some embodiments, the movement amount calculator 620 may calculate the lens position and the lens movement amount based on the detected viewer position, and may output the calculated lens position and the lens movement amount. The calculated lens position and lens shift amount may be output to the stereoscopic image filter driver 183.

The movement amount calculator 620 may generate a control signal for controlling the movement of the lens according to the current lens position and the calculated lens movement amount, and may output the generated control signal to the communication controller 630. The generated control signal may be a signal that is positioned at a point moved by the lens shift amount calculated at the point where the lens is currently positioned.

The communication controller 630 may transmit the control signal generated by the movement calculator 620 to the 3D image filter driver 183. The communication controller 630 may output the control signal to the stereoscopic image filter driver 183 through an I ² C communication method.

FIG. 7 is a diagram illustrating an amount of change in stereoscopic images calculated according to a change in viewer position.

Referring to FIG. 7, when the viewer moves from the position 730 to the position 740, the movement amount h of the gaze position on the display panel 710 may be calculated from Equation 1 below.

Here, H is the amount of head movement of the viewer, D is the viewing distance which is the distance from the stereoscopic image filter 720 to the viewer's line of sight, and d is the distance between the display panel 710 and the stereoscopic image filter 720.

When the viewer moves from the position 730 to the position 740, the pixel shift amount P, which is an example of the stereoscopic image change amount, may be calculated from Equation 2 below.

Here, Q is a stereoscopic pixel period.

The movement amount calculating unit 620 may calculate a stereoscopic image change amount using Equation 1 and Equation 2, and calculate a stereoscopic image filter shift amount based on the calculated stereoscopic image change amount.

FIG. 8 is a diagram illustrating the movement of a sweet spot according to a change in position of a stereoscopic image filter.

Referring to FIG. 8, in the stereoscopic image filter 810 arranged in the opaque region 811 and the transparent region 812, a sweet spot 817 for viewing a left eye view image L displayed on the display panel 801. ) And the sweet spot 816 for viewing the right eye view image R is alternately arranged.

In the stereoscopic image filter 820 arranged in the opaque region 821 and the transparent region 822, the sweet spot 827 and the right eye viewpoint image (L) for viewing the left eye viewpoint image L displayed on the display panel 801 ( A sweet spot 826 for viewing R) has a sweet spot 825 alternately arranged.

In the stereoscopic image filter 830 arranged in the opaque region 831 and the transmissive region 832, the sweet spot 837 and the right eye viewpoint image (L) for viewing the left eye viewpoint image L displayed on the display panel 801 ( A sweet spot 836 for viewing R) has a sweet spot 835 alternately arranged.

In the stereoscopic image filter 840 arranged in the opaque region 841 and the transmissive region 842, the sweet spot 847 and the right eye viewpoint image (for viewing the left eye viewpoint image L displayed on the display panel 801) A sweet spot 846 for viewing R) has a sweet spot 845 alternately arranged.

In the stereoscopic image filter 850 arranged in the opaque region 851 and the transmissive region 852, the sweet spot 857 and the right eye viewpoint image for viewing the left eye viewpoint image L displayed on the display panel 801 ( A sweet spot 856 for viewing R) has a sweet spot 855 alternately arranged.

In the stereoscopic image filter 860 arranged in the opaque region 861 and the transmissive region 862, a sweet spot 867 and a right eye viewpoint image for viewing the left eye viewpoint image L displayed on the display panel 801 ( A sweet spot 866 for viewing R) has a sweet spot 865 arranged alternately.

In the stereoscopic image filter 870 arranged in the opaque region 871 and the transmissive region 872, the sweet spot 877 and the right eye viewpoint image (L) for viewing the left eye viewpoint image L displayed on the display panel 801 ( A sweet spot 876 for viewing R) has a sweet spot 875 alternately arranged.

The movement amount calculator 620 may determine that the barrier or lens arrangement of the stereoscopic image filter 185 is any one of the arrangements 810 to 860 in order to move the sweet spot according to the position where the user is located. For example, when the left eye of the user is located at the point 817 and the right eye is located at the point 818, the movement amount calculator 620 arranges the barrier so that the sweet spot becomes the sweet spot 815 ( 810, and when the user's left eye moves from point 817 to point 837, the controller 180 arranges the barrier so that the sweet spot becomes the sweet spot 835. The control signal for changing to the arrangement 830 in the control unit 630 may be calculated, and the calculated control signal may be output to the communication controller 630.

9 is a diagram illustrating a time interval of an image frame captured by a camera.

Referring to FIG. 9, the camera 121 may be driven at a constant frame rate regardless of external illumination or may be driven at a predetermined frame rate or more. The controller 180 may control the camera 121 to be driven at a constant frame rate regardless of external illumination, or may be controlled to be driven at a predetermined frame rate or more.

When the frame rate of the camera 121 is N fps (frame per second), the camera 121 captures N image frames 910 to 990 per second, and the time interval between the image frames is an interval 925. .

The probability of a user's position change is the same on all time axes between all image frames 910 to 990. Therefore, the delay time T _C by the camera 121 may be defined as in Equation 3 below.

Where FR is the frame rate of the camera 121. The delay time T _C may be referred to as a camera capture delay time.

After the user's position change, the maximum value T _m of the delay time before controlling the stereoscopic image filter according to the user's position change can be defined as in Equation 4 below.

In this case, the Tt receives an image frame in which the user's position change is captured, generates a control signal using the received image frame, and inputs the generated control signal to the stereoscopic image filter driver 183. The delay time until.

In the present invention, the camera 121 is driven at or below the frame rate at which the maximum value T _m of the delay time is maintained below the delay time at which the stereoscopic image filter can be moved before the user leaves the sweet spot. In addition, the controller 180 may control the camera 121 to be driven at the frame rate or higher.

Conventional cameras are driven in a manner that adjusts the exposure according to the external brightness to show a bright and clear image when the user views the image. However, since the camera and the mobile terminal according to the present invention maintain the frame rate of the camera irrespective of the external brightness, the user can always see a clear three-dimensional image without feeling a double image and a reverse image even when the user moves in a dark environment.

The time interval 925 between the image frames of the camera 121 generates a control signal using the image frame picked up by the camera 121, and the filter filter signal is generated until the generated filter control signal is input to the stereoscopic image filter 185. It may be set to be greater than the delay time T _t . That is, the time interval 925 may be set according to Equation 5 below.

The camera 121 may be driven at a frame rate satisfying Equation 5, and the controller 180 may control the camera 121 to be driven at a frame rate satisfying Equation 5. In addition, the camera 121 may be driven at a constant frame rate that satisfies Equation 5 regardless of the change in illuminance, and the controller 180 may control the camera 121 to be driven at a constant frame rate that satisfies Equation 5. Can be.

In some embodiments, the delay time T _t may be defined as in Equation 6 below.

Here, α denotes a delay time for inputting an image frame captured by the camera 121 to the controller 180, and β denotes a control signal using the image frame input from the position detector 610 and the movement amount calculator 620. Is a delay time for generating the signal, γ is a delay time until the communication control unit 630 starts transmitting the generated control signal to the stereoscopic image filter driver 183, and δ is a generated control signal in the communication control unit 630. The delay time taken to move to the stereoscopic image filter driver 183. The sum of the delay times α and β may be defined as the detection process delay time.

Equation 7 may be derived using Equation 5 and Equation 6.

The camera 121 may be driven at a frame rate satisfying Equation 7, and the controller 180 may control the camera 121 to be driven at a frame rate satisfying Equation 7. In addition, the camera 121 may be driven at a constant frame rate that satisfies Equation 7 regardless of the change in illuminance, and the controller 180 may control the camera 121 to be driven at a constant frame rate that satisfies Equation 7. Can be.

In some embodiments, T _t may be defined as the sum of at least one of α, β, γ, δ.

10 is a block diagram showing the configuration of another preferred embodiment of the control unit.

Referring to FIG. 10, the controller 180 may include a position detector 1010, a movement amount calculator 1020, and a graphic processor 1030.

The position detector 1010 receives an image frame captured by the viewer from the camera 121 and detects the position of the viewer using the received image frame. The location detector 1010 may detect the location of the viewer by recognizing the face area. Here, the position detector 1010 may recognize the face region by using an algorithm using symmetry of the face, an algorithm using a hair color and a face color, and an algorithm using a contour of the face. In addition, the position detector 1010 may calculate the skin color information in the image frame to recognize the face region.

The movement amount calculation unit 1020 calculates a stereoscopic image movement amount based on the detected viewer position and outputs the calculated stereoscopic image movement amount. Also, the movement amount calculator 1020 may calculate the stereoscopic image movement amount by using Equations 1 and 2 below. The movement amount calculator 1020 may output the calculated stereoscopic image movement amount to the graphic processor 1030. Herein, the calculated amount of moving images means a moving amount of a position at which a pixel value or a sub pixel value of the stereoscopic image is displayed so that the stereoscopic image is displayed according to the user position detected by the position detector 1010. In addition, the stereoscopic image shift amount may be one of a pixel shift amount and a subpixel shift amount.

The graphic processor 1030 determines a position where each pixel value of the stereoscopic image is to be displayed. In some embodiments, the graphic processor 1030 may determine a display position where each pixel value of the plurality of viewpoint images included in the stereoscopic image is to be displayed on the display 151 according to a predefined rule.

The graphic processor 1030 may determine the final display position by changing the determined display position based on the stereoscopic image movement amount output by the position detector 1010. In some embodiments, the graphic processor 1030 may display each pixel value of the plurality of viewpoint images included in the stereoscopic image by using a predefined rule and a stereoscopic image movement amount output by the position detector 1010. The display position, which is the position to be displayed on the image, can be determined.

In addition, the graphic processor 1030 may generate image data including the pixel value or the sub pixel value arranged according to the determined display position or the determined final display position, and may output the generated image data to the display 151.

In the embodiment of FIG. 10, the delay time T _t may be defined as in Equation 8 below.

Here, α denotes a delay time for inputting an image frame captured by the camera 121 to the controller 180, and β denotes a stereoscopic image using image frames inputted from the position detector 1010 and the movement amount calculator 1020. The delay time for calculating the movement amount, ε is the delay time for the graphic processing unit 1030 to generate the image data based on the calculated stereoscopic image movement amount, ζ is the delay time for inputting the generated image data to the display 151 to be. The sum of the delay time ε and ζ may be referred to as an image driver frame rate delay time.

Equation 9 may be derived using Equation 5 and Equation 8.

The camera 121 may be driven at a frame rate satisfying Equation 9, and the controller 180 may control the camera 121 to be driven at a frame rate satisfying Equation 9. In addition, the camera 121 may be driven at a constant frame rate that satisfies Equation 9 regardless of the change in illuminance, and the controller 180 may control the camera 121 to be driven at a constant frame rate that satisfies Equation 9. Can be.

In some embodiments, T _t may be defined as the sum of at least one of α, β, ε, ζ.

FIG. 11 is a diagram illustrating the movement of a sweet spot according to a change in the display position of a viewpoint image.

Referring to FIG. 11, when the stereoscopic image filter 1101 is fixed, the display 1110 displays a left eye view image at a point 1111 and a right eye view image at a point 1112, The spot is a sweet spot 1115 in which a sweet spot 1117 for viewing the left eye view image L displayed on the display 1110 and a sweet spot 1116 for viewing the right eye view image R are alternately arranged. Becomes

When the 3D image filter 1101 is fixed and the display unit 1120 displays the left eye view image at the point 1121 and the right eye view image at the point 1122, the sweet spot is displayed on the display unit 1120. A sweet spot 1127 for viewing the displayed left eye view image L and a sweet spot 1126 for viewing the right eye view image R become alternate sweet spots 1125.

When the stereoscopic image filter 1101 is fixed and the display unit 1130 displays a stereoscopic image with the left eye view image 1131 and the right eye view image 1132, the sweet spot is displayed on the display unit 1130. A sweet spot 1137 for viewing the left eye view image L and a sweet spot 1136 for viewing the right eye view image R are alternately arranged as a sweet spot 1135.

When the 3D image filter 1101 is fixed and the display unit 1140 displays a 3D image with the left eye view image 1141 and the right eye view image 1142, the sweet spot is displayed on the display unit 1140. A sweet spot 1147 for viewing the left eye view image L and a sweet spot 1146 for viewing the right eye view image R are alternately arranged as a sweet spot 1145.

When the stereoscopic image filter 1101 is fixed and the display unit 1150 displays the stereoscopic image with the left eye view image 1151 and the right eye view image 1152, the sweet spot is displayed on the display unit 1150. A sweet spot 1157 for viewing the left eye view image L and a sweet spot 1156 for viewing the right eye view image R are alternately arranged as a sweet spot 1155.

When the stereoscopic image filter 1101 is fixed and the display unit 1160 displays the stereoscopic image with the left eye view image 1161 and the right eye view image 1162, the sweet spot is displayed on the display unit 1160. The sweet spot 1167 for viewing the left eye view image L and the sweet spot 1166 for viewing the right eye view image R become alternate sweet spots 1165.

When the stereoscopic image filter 1101 is fixed and the display unit 1170 displays a stereoscopic image using the left eye view image 1171 and the right eye view image 1172, the sweet spot is displayed on the display unit 1170. A sweet spot 1177 for viewing the left eye view image L and a sweet spot 1176 for viewing the right eye view image R become alternate sweet spots 1175.

The movement amount calculation unit 1020 moves the display position of the left eye view image and the right eye view image to be the view image arrangement of any one of the view image arrangements 1110 to 1160 in order to move the sweet spot according to the point where the user is located. You can decide. That is, the movement amount calculation unit 1020 may calculate the stereoscopic image movement amount such that the movement of the viewpoint image is determined. For example, when the left eye of the user is located at the point 1117 and the right eye is located at the point 1118, the movement amount calculator 1020 may include the viewpoint image arrangement so that the sweet spot becomes the sweet spot 1115. If it is determined to be the arrangement 1110, and the left eye of the user is moved from the point 1117 to the point 1137, the movement amount calculating unit 1020 performs the arrangement of the viewpoint image such that the sweet spot becomes the sweet spot 1135. The view image arrangement 1110 may be changed to the view image arrangement 1130. That is, the movement amount calculation unit 1020 calculates the movement amount for moving the viewpoint image arrangement 1110 to the viewpoint image arrangement 1130 as a stereoscopic image movement amount.

12 is a block diagram showing the configuration of another preferred embodiment of the control unit.

Referring to FIG. 12, the controller 180 may include a position detector 1210, a speed calculator 1220, a position estimator 1230, a movement amount calculator 1240, and a communication controller 1250. .

The position detector 1210 receives an image frame captured by the viewer from the camera 121 and detects the position of the viewer using the received image frame. The location detector 1210 may detect the location of the viewer by recognizing the face area. Here, the position detector 1210 may recognize the face region by using an algorithm using symmetry of the face, an algorithm using a hair color and a face color, and an algorithm using a contour of the face. In addition, the location detector 1210 may calculate the skin color information in the image frame to recognize the face area.

The speed calculator 1220 calculates the moving speed of the viewer by using at least one of the position of the currently detected viewing hall and the previously detected positions of the viewing hall.

The position estimator 1230 estimates the viewer position when a preset time elapses using the detected viewer position and the calculated moving speed.

The movement amount calculator 1240 calculates the stereoscopic image filter position and the stereoscopic image filter movement amount based on the detected viewer position or the estimated viewer position, and outputs the calculated stereoscopic image filter movement amount. Each stereoscopic image filter shift amount may be calculated and output for each detected viewer position or estimated viewer position.

In addition, the movement amount calculating unit 1240 may generate a control signal for controlling the movement of the opaque region of the stereoscopic image filter according to the current stereoscopic image filter position and the calculated stereoscopic image filter movement amount, and transmits the generated control signal to the communication control unit. And output to 1250. Each control signal may be calculated and output for each detected viewer position or estimated viewer position. The generated control signal may be a signal for positioning the opaque area at a point moved by the calculated moving amount of the stereoscopic image filter at the current point, and the stereoscopic image filter calculated at the point of the opaque region indicated by the previous control signal. It may be a signal to be located at the point moved by the amount of movement.

In some embodiments, the movement amount calculator 1240 finds the positions of the transmission region and the non-transmission region of the stereoscopic image filter having a sweet spot corresponding to the detected viewer position or the estimated viewer position. The amount of movement of the stereoscopic image filter may be calculated by calculating a difference between the positions of the transmission region and the non-transmissive region of the filter and the positions of the transmission region and the non-transmissive region of the stereoscopic image filter indicated by the current or previous control signal.

In some embodiments, the movement amount calculator 1240 may calculate the lens position and the lens movement amount based on the detected viewer position or the estimated viewer position, and may output the calculated lens position and the lens movement amount. The calculated lens position and lens shift amount may be output to the stereoscopic image filter driver 183.

The movement amount calculating unit 1240 may generate a control signal for controlling the movement of the lens based on the lens position indicated by the current lens position or the previous control signal and the calculated lens movement amount, and the generated control signal may be transferred to the communication control unit ( 1250). The generated control signal may be a signal to be positioned at a point moved by the lens shift amount calculated at the point where the lens is currently positioned, and positioned at a point moved by the lens shift amount calculated at the point of the lens indicated by the previous control signal. It may be a signal.

The communication controller 1250 may transmit the control signal generated by the movement amount calculator 1240 to the 3D image filter driver 183. Here, the transmitted control signal may include a control signal generated based on the detected user location and a control signal generated based on the estimated user location, and the control signals may be transmitted in the order of generation. The communication controller 1250 may output the control signal to the stereoscopic image filter driver 183 through an I ² C communication method.

13 to 16 are diagrams illustrating image frames in which a camera photographs a viewer.

13 to 16, the location detector 1210 may detect a viewer's location 1311 using the image frame 1300. The location detector 1210 may detect a face region in the image frame 1400 and detect a viewer's location 1321.

The speed calculator 1220 may calculate the viewer's moving speed V from Equation 10 using the detected viewer's position 1321 and the previously detected viewer's position 1311.

Here, H is the distance between the detected viewer's position 1321 and the previously detected viewer's position 1311, and T is the time interval at which the image frame 1310 and the image frame 1320 were imaged.

The speed calculator 1220 may calculate the viewer position when a preset time elapses using the detected viewer position 1321 and the moving speed V according to the following algorithm.

[Algorithm 1]

for (k = 1, k <N + 1, k ++)

{Viewer's position at delay + kt}

Here, the delay time + kt is a predetermined time, and the delay time is at least one of a camera capture delay, a detecting process delay, and an image driver frame rate delay. May be delayed by.

t can be determined by the following equation (11).

Here, M is the maximum frame rate of the camera, N can be determined by the following equation (12).

Here, T is the threshold of the head position change in which the image change occurs.

The viewer's position P at the delay time + kt can be calculated by the following equation (13).

Where P ₀ is the detected viewer's position and T is the delay time + kt.

According to Algorithm 1, the position estimator 1230 can estimate the positions of the N viewers at the time interval t during the time interval at which the image frame is imaged, so that when using a camera captured at a frame rate of M Hz, M * The effect of using a camera photographed at a frame rate of N Hz can be achieved.

When the image frame 1500 is captured, the position detector 1210 detects the viewer's position 1331, and the speed calculator 1220 detects at least one of the viewer's positions 1311 and 1321 previously detected. The moving speed of the viewer can be calculated using.

In addition, when the image frame 1600 is photographed, the position detector 1210 detects the viewer position 1341, and the speed calculator 1220 detects the previously detected viewer positions 1311, 1321, and 1331. The moving speed of the viewer may be calculated using at least one of the following.

In the embodiment of Figure 12, the frame rate FR of the camera 121 can be determined by the following equation (14).

Here, α denotes a delay time for inputting an image frame captured by the camera 121 to the controller 180, and β denotes a control signal using the image frame input from the position detector 1210 and the movement amount calculator 1240. Is a delay time for generating the signal, γ is a delay time until the communication control unit 1250 starts transmitting the generated control signal to the 3D filter driver 183, and δ is a control signal generated by the communication control unit 630. The delay time taken to move to the stereoscopic image filter driver 183, and N is the number of times to estimate the user position. And η can be calculated by the following equation (15).

The camera 121 may be driven at a frame rate satisfying Equation 14, and the controller 180 may control the camera 121 to be driven at a frame rate satisfying Equation 14. In addition, the camera 121 may be driven at a constant frame rate that satisfies Equation 14 regardless of the change in illuminance, and the controller 180 may control the camera 121 to be driven at a constant frame rate that satisfies Equation 14. Can be.

17 is a block diagram showing the configuration of another preferred embodiment of the control unit.

Referring to FIG. 17, the controller 180 may include a position detector 1710, a speed calculator 1720, a position estimator 1730, a movement amount calculator 1740, and a graphic processor 1750. The position detector 1710, the speed calculator 1720, and the position estimator 1730 are components corresponding to the position detector 1210, the speed calculator 1220, and the position estimator 1730 of FIG. 12. Detailed description will be omitted below. Also, the graphic processor 1750 is a component corresponding to the graphic processor 1030 of FIG. 10.

The movement amount calculator 1740 may calculate the pixel movement amount at the corresponding point of time by using Equation 1 and Equation 2 based on the estimated viewer position at a specific point in time. Referring to FIG. 11, when the viewer's left eye is at position 1116 and the right eye is at position 1117, the viewpoint image arrangement becomes arrangement 1110. The position estimator 1230 estimates the position 1136 of the viewer's left eye and the position 1137 of the right eye, and calculates a pixel movement amount A according to the estimated moving positions 1136 and 1137. When the viewer moves from the positions 1116 and 1117 to the positions 1136 and 1137, the graphic processor 1750 processes the stereoscopic image to be moved according to the pixel movement amount A calculated according to the movement timing, so that the viewpoint image is arranged ( 1130 is displayed.

In the embodiment of FIG. 17, the frame rate FR of the camera 121 may be determined by the following equation (16).

Here, α denotes a delay time for inputting an image frame captured by the camera 121 to the controller 180, and β denotes a control signal using the image frame input from the position detector 1710 and the movement amount calculator 1740. Is the delay time for generating the signal, ε is the delay time for the graphic processor 1750 to generate the image data based on the calculated stereoscopic image movement amount, ζ is the delay time for inputting the generated image data to the display 151, and , N is the number of times to estimate the user position. And η can be calculated by the above equation (15).

The camera 121 may be driven at a frame rate satisfying Equation 16, and the controller 180 may control the camera 121 to be driven at a frame rate satisfying Equation 16. In addition, the camera 121 may be driven at a constant frame rate that satisfies Equation 16 regardless of the change in illuminance, and the controller 180 may control the camera 121 to be driven at a constant frame rate that satisfies Equation 16. Can be.

The present invention can also be embodied as computer-readable codes on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer apparatus is stored. Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may be implemented in the form of a carrier wave (for example, transmission via the Internet) . The computer-readable recording medium may also be distributed to networked computer devices so that computer readable code can be stored and executed in a distributed manner.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be taken by way of limitation in the embodiment in which said invention is directed. It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the scope of the appended claims.

Claims (13)

A display unit configured to display at least two or two or more viewpoint images;
A stereoscopic image panel disposed on the front surface of the display unit and alternately forming a transmission region and an opacity region;
A camera for photographing an image of a user;
A controller configured to determine user location information related to the location of the user based on the photographed image and to generate a control signal for controlling movement of an opaque region of the stereoscopic image filter based on the determined user location information; And
A stereoscopic image filter driver for moving an opaque region of the stereoscopic image filter based on the control signal,
The control unit,
And controlling the frame rate of the camera based on a delay time until the control signal is generated and transmitted to the stereoscopic image filter driver. The method of claim 1,
The delay time may include a delay time for inputting an image frame captured by the camera to the controller, a delay time for generating the control signal using the input image frame, and the generated control signal. And at least one of a delay time required to start the transmission and a delay time taken to transmit the control signal to the stereoscopic filter driver. The method of claim 1,
And the frame rate is set such that a time interval between image frames captured by the camera is greater than the delay time. The method of claim 1,
The control unit,
Determine user location prediction information related to the future location of the user when a preset time elapses based on the image of the captured user, and an opaque region of the stereoscopic image filter based on the determined user location prediction information Generating a second control signal for controlling movement of the mobile terminal. 5. The method of claim 4,
The control unit,
And determine the moving speed of the user by using the determined user location information and the previously determined user location information, and determine the user location prediction information by using the determined moving speed and the location of the user. . 5. The method of claim 4,
The control unit,
And controlling the frame rate of the camera based on the delay time and the number of times of determining the user position prediction information. A display unit configured to display at least two or two or more viewpoint images;
A lenticular lens substrate disposed on a front surface of the display unit and including a plurality of lenses;
A camera for photographing an image of a user;
A controller configured to determine user location information related to the location of the user based on the captured image, and generate a control signal for controlling movement of the plurality of lenses based on the determined user location information; And
And a stereoscopic image filter driver for moving the plurality of lenses based on the control signal.
The control unit,
And controlling the frame rate of the camera based on a delay time until the control signal is generated and transmitted to the stereoscopic image filter driver. A display unit configured to display at least two or two or more viewpoint images;
A stereoscopic image panel disposed on the front surface of the display unit and alternately forming a transmission region and an opacity region;
A camera for photographing an image of a user; And
Determine user location information related to the location of the user based on the captured image, determine a location to be displayed on the display unit based on the determined user location information, and arrange according to the determined location And a controller configured to generate image data including pixel values or sub-pixel values of the viewpoint image, and to control a frame rate of the camera based on a delay time between the image data is generated and transmitted to the display unit. Mobile terminal. The method of claim 8,
The delay time may include a delay time for inputting an image frame captured by the camera to the controller, a delay time for generating the image data using the input image frame, and transmitting the generated image data to the display unit. And at least one of a delay time for starting and a delay time for transmitting the image data to the display unit. The method of claim 8,
The control unit,
And calculating a stereoscopic image change amount based on the determined user position information, and determining a position at which the viewpoint images are to be displayed on the display unit based on the calculated stereoscopic image change amount. The method of claim 8,
The control unit,
Determine user location prediction information related to the future location of the user when a preset time elapses based on the captured user image, and the viewpoint images are displayed on the display unit based on the determined user location prediction information. Determining a position to be displayed in the second terminal, and generating second image data including pixel values or sub-pixel values of the viewpoint image arranged according to the determined position. 12. The method of claim 11,
The control unit,
And controlling the frame rate of the camera based on the delay time and the number of times of determining the user position prediction information. A display unit configured to display at least two or two or more viewpoint images;
A lenticular lens substrate disposed on a front surface of the display unit and including a plurality of lenses;
A camera for photographing an image of a user; And
Determine user location information related to the location of the user based on the captured image, determine a location to be displayed on the display unit based on the determined user location information, and arrange according to the determined location And a controller configured to generate image data including pixel values or sub-pixel values of the viewpoint image, and to control a frame rate of the camera based on a delay time between the image data is generated and transmitted to the display unit. Mobile terminal.

Images