KR101844225B1 - Mobile terminal and method for controlling the same - Google Patents

Abstract

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a portable terminal and a control method thereof, in which a user can manipulate the operation of 3D content displayed on a current screen using proximity depth of proximity touch.

Description

[0001] MOBILE TERMINAL AND METHOD FOR CONTROLLING THE SAME [0002]

The present invention relates to a portable terminal and a control method thereof, in which the use of the terminal can be realized by further considering the convenience of the user.

A terminal such as a personal computer, a notebook computer, a mobile phone, or the like can be configured to perform various functions. Examples of such various functions include a data and voice communication function, a function of photographing a video or a moving image through a camera, a voice storage function, a music file playback function through a speaker system, and an image or video display function. Some terminals include additional functions to execute games, and some other terminals are also implemented as multimedia devices. Moreover, recent terminals can receive a broadcast or multicast signal to view a video or television program.

In general, the terminal is movable The mobile terminal can be divided into a mobile terminal and a stationary terminal depending on whether the mobile terminal is portable or not, and the mobile terminal can be divided into a handheld terminal and a vehicle mount terminal.

Due to the development of display technology, many terminals equipped with a 3D function and a touch screen are being released.

That is, the user can operate the terminal by directly touching the touch screen provided on the terminal, while viewing the 3D image through the terminal.

However, when the user directly touches the touch screen for the operation of the terminal while viewing the 3D image, there may occur a case where the actual distance between the user and the touch screen is not recognized due to the spatial feeling caused by the 3D image.

It is an object of the present invention to provide a portable terminal and a control method thereof in which a user can operate an operation of 3D content displayed on a current screen by using the proximity depth of the proximity touch.

According to an aspect of the present invention, there is provided a portable terminal including: a touch screen for displaying 3D content; A proximity sensor for sensing a proximity depth of the proximity touch input on the 3D content; And a controller for controlling the operation of the 3D content according to the detected proximity depth.

According to another aspect of the present invention, there is provided a method of controlling a mobile terminal, including: displaying 3D content on a touch screen; Sensing a proximity depth of a proximity touch input on the 3D content through a proximity sensor provided on the touch screen; And controlling the operation of the 3D content according to the detected proximity depth.

The portable terminal and the control method thereof according to the present invention do not need to directly touch the touch screen screen by controlling the operation of the 3D content displayed on the current screen by using the proximity depth of the proximity touch of the user, And provides a new type of user interface for the operation of the apparatus.

1 is a block diagram illustrating a portable terminal according to an embodiment of the present invention.
2A is a perspective view of a portable terminal according to an embodiment of the present invention.
FIG. 2B is a rear perspective view of the portable terminal shown in FIG. 2A.
3 is a conceptual diagram for explaining the principle of binocular disparity.
4 is a conceptual diagram for explaining distance feeling and 3D depth due to binocular parallax.
FIG. 5 is a conceptual diagram illustrating a method of implementing a 3D stereoscopic image in a display unit of a view barrier system applicable to embodiments of the present invention.
6 is a flowchart illustrating a process of controlling the operation of 3D content through proximity touching of the portable terminal according to the present invention.
FIG. 7 is an explanatory diagram of a first embodiment of a process of controlling the operation of 3D content through proximity touching of a portable terminal according to the present invention.
FIG. 8 is a diagram illustrating a second embodiment of a process of controlling the operation of 3D content through proximity touching of a portable terminal according to the present invention.
FIG. 9 is an explanatory diagram of a third embodiment of a process of controlling the operation of 3D content through proximity touching of a portable terminal according to the present invention.
FIGS. 10 to 13 are explanatory diagrams of a fourth embodiment of a process of controlling the operation of 3D content through proximity touching of the portable terminal according to the present invention.
FIG. 14 is an explanatory diagram of a fifth embodiment of a process of controlling the operation of 3D content through proximity touching of a portable terminal according to the present invention.
FIG. 15 is an explanatory diagram of a sixth embodiment of a process of controlling the operation of 3D content through proximity touching of a portable terminal according to the present invention.
FIG. 16 is a diagram illustrating a seventh embodiment of a process of controlling the operation of 3D content through proximity touching of a portable terminal according to the present invention.
FIG. 17 is an explanatory diagram of an eighth embodiment of a process of controlling the operation of 3D content through proximity touching of a portable terminal according to the present invention.

Hereinafter, a portable terminal related to the present invention will be described in detail with reference to the drawings. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The portable terminal described in this specification may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), and navigation. However, it will be readily apparent to those skilled in the art that the configuration according to the embodiments described herein may be applied to fixed terminals such as a digital TV, a desktop computer, and the like, unless the configuration is applicable only to the portable terminal.

1 is a block diagram of a portable terminal according to an embodiment of the present invention.

The portable terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a battery 190, and the like. The components shown in Fig. 1 are not essential, and a portable terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the wireless terminal 100 and the wireless communication system or between the wireless terminal 100 and a network in which the wireless terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving broadcast signals and / or broadcast related information generated by the broadcast management server and transmitting the generated broadcast signals and / or broadcast related information. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only A digital broadcasting system such as DVB-CB, OMA-BCAST, or Integrated Services Digital Broadcast-Terrestrial (ISDB-T). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built in or externally mounted in the mobile terminal 100. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for acquiring the position of the portable terminal, and a representative example thereof is a GPS (Global Position System) module. According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites, and then applies trigonometry to the calculated information to obtain a three-dimensional string of latitude, longitude, The location information can be accurately calculated. At present, a method of calculating position and time information using three satellites and correcting an error of the calculated position and time information using another satellite is widely used. In addition, the GPS module 115 can calculate speed information by continuously calculating the current position in real time.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes an image frame such as a still image or moving image obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [

At this time, two or more cameras 121 may be provided depending on the use environment.

For example, the camera 121 may include first and second cameras 121a and 121b for capturing 3D images on the opposite side of the display unit 151 of the mobile terminal 100, A third camera 121c for self-photographing the user may be provided in a part of the surface of the display unit 151 of the terminal 100. [

In this case, the first camera 121a is for capturing the left eye image, which is the source image of the 3D image, and the second camera 121b, for the right eye image capturing.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the terminal.

The user input unit 130 may receive from the user a signal designating two or more contents among the displayed contents according to the present invention. A signal for designating two or more contents may be received via the touch input, or may be received via the hard key and soft key input.

The user input unit 130 may receive an input from the user for selecting the one or more contents. In addition, an input for generating an icon related to a function that the portable terminal 100 can perform can be received from the user.

The user input unit 130 may include a directional keypad, a keypad, a dome switch, a touchpad (static / static), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the portable terminal 100 such as the open / close state of the portable terminal 100, the position of the portable terminal 100, the presence of the user, the orientation of the portable terminal, And generates a sensing signal for controlling the operation of the portable terminal 100. For example, when the portable terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the battery 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141. The proximity sensor 141 will be described later in relation to the touch screen.

The output unit 150 is for generating an output relating to visual, auditory or tactile sense and includes a display unit 151, an acoustic output module 152, an alarm unit 153, a haptic module 154, 155), and the like.

The display unit 151 displays (outputs) the information processed in the portable terminal 100. For example, when the portable terminal is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the portable terminal 100 is in the video communication mode or the photographing mode, the photographed and / or received image, UI, or GUI is displayed.

In addition, the display unit 151 according to the present invention supports 2D and 3D display modes.

That is, the display unit 151 according to the present invention may have a configuration in which the switch liquid crystal 151b is combined with a general display device 151a as shown in FIG. 5 below. 5 (a), the optical parallax barrier 50 is operated by using the switch liquid crystal 151b to control the traveling direction of the light, so that different lights can be separated from the left and right eyes. Therefore, when a combined image of the right eye image and the left eye image is displayed on the display device 151a, the user can see the image corresponding to each eye and feel as if it is displayed in three-dimensional form.

That is, under the control of the control unit 180, the display unit 151 drives only the display device 151a without driving the switch liquid crystal 151b and the optical parallax barrier 50 in the 2D display mode Performs normal 2D display operation.

The display unit 151 drives the switch liquid crystal 151b and the optical parallax barrier 50 and the display device 151a under the control of the controller 180 to display the display liquid crystal 151b, 151a to perform the 3D display operation.

The 3D display process of the display unit 151 will be described later in detail with reference to FIGS. 3 to 5.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED) A flexible display, and a three-dimensional display (3D display).

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the portable terminal 100. [ For example, in the portable terminal 100, a plurality of display units may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

(Hereinafter, referred to as a 'touch screen') in which a display unit 151 and a sensor for sensing a touch operation (hereinafter, referred to as 'touch sensor') form a mutual layer structure, It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller (not shown). The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

The proximity sensor 141 may be disposed at one or more of the inner area of the portable terminal, which is enclosed by the touch screen, or the proximity of the touch screen. That is, the proximity sensor 141 of the present invention corresponds to the x-axis, the y-axis, and the z-axis of the touch screen so as to detect the positions of three axes of the x-axis, the y- A plurality of them can be installed. The proximity sensor 141 refers to a sensor that detects the presence of an object approaching a predetermined detection surface or an object existing in the vicinity of the detection surface without mechanical contact using an electromagnetic force or an infrared ray. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch & The act of actually touching the pointer on the screen is called "contact touch. &Quot; The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor detects proximity touch, proximity depth, proximity touch pattern (e.g., proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.) . Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception tones, message reception tones, etc.) performed in the portable terminal 100. The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the portable terminal 100. Examples of events occurring in the portable terminal include receiving a call signal, receiving a message, inputting a key signal, and touch input. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. In this case, the display unit 151 and the audio output module 152 may be a type of the alarm unit 153. The display unit 151 and the audio output module 152 may be connected to the display unit 151 or the audio output module 152, .

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. The haptic module 154 may include two or more haptic modules 154 according to the configuration of the portable terminal 100.

The projector module 155 is a component for performing an image project function using the portable terminal 100 and is similar to the image displayed on the display unit 151 in accordance with a control signal of the controller 180 Or at least partly display another image on an external screen or wall.

Specifically, the projector module 155 includes a light source (not shown) that generates light (for example, laser light) for outputting an image to the outside, a light source And a lens (not shown) for enlarging and outputting the image at a predetermined focal distance to the outside. Further, the projector module 155 may include a device (not shown) capable of mechanically moving the lens or the entire module to adjust the image projection direction.

The projector module 155 can be divided into a CRT (Cathode Ray Tube) module, an LCD (Liquid Crystal Display) module and a DLP (Digital Light Processing) module according to the type of the display means. In particular, the DLP module may be advantageous for miniaturization of the projector module 151 by enlarging and projecting an image generated by reflecting light generated from a light source on a DMD (Digital Micromirror Device) chip.

Preferably, the projector module 155 may be provided on the side surface, the front surface, or the back surface of the portable terminal 100 in the longitudinal direction. It goes without saying that the projector module 155 may be provided at any position of the portable terminal 100 as needed.

The memory 160 may store a program for processing and controlling the controller 180 and may store the input / output data (e.g., a telephone directory, a message, an audio, a still image, an electronic book, History, and the like). The memory 160 may also store the frequency of use of each of the data (for example, each telephone number, each message, and frequency of use for each multimedia). In addition, the memory unit 160 may store data on vibration and sound of various patterns output when the touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory, etc.) ), A random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read- A magnetic disk, an optical disk, a memory, a magnetic disk, or an optical disk. The portable terminal 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the portable terminal 100. The interface unit 170 receives data from an external device or receives power from the external device and transmits the data to each component in the portable terminal 100 or allows data in the portable terminal 100 to be transmitted to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the usage right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module A Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

When the portable terminal 100 is connected to an external cradle, the interface unit may be a path through which power from the cradle is supplied to the portable terminal 100, or various command signals input from the cradle by the user It can be a passage to be transmitted to the terminal. The various command signals input from the cradle or the power source may be operated as a signal for recognizing that the portable terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the portable terminal. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

The controller 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of a processor, controllers, micro-controllers, microprocessors, and other electronic units for performing other functions. In some cases, The embodiments described may be implemented by the control unit 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code can be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

2A is a perspective view of a portable terminal according to an embodiment of the present invention.

The disclosed mobile terminal 100 has a bar-shaped main body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

The body includes a case (a casing, a housing, a cover, and the like) which forms an appearance. In this embodiment, the case may be divided into a front case 101 and a rear case 102. [ A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injection molding a synthetic resin, or may be formed to have a metal material such as stainless steel (STS) or titanium (Ti) or the like.

The front body 101 mainly includes a display unit 151, an audio output unit 152, a third camera 121c, user inputs 130/131 and 132, a microphone 122, an interface 170, .

The display unit 151 occupies most of the main surface of the front case 101. A sound output unit 151 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 132 and the interface 170 may be disposed on the side surfaces of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the portable terminal 100 and may include a plurality of operation units 131 and 132. The operation units 131 and 132 may be collectively referred to as a manipulating portion.

The contents inputted by the first or second operation unit 131 or 132 may be variously set. For example, the first operation unit 131 receives commands such as start, end, scroll, and the like, and the second operation unit 132 controls the size of the sound output from the sound output unit 152 or the size of the sound output from the display unit 151 The touch recognition mode can be activated or deactivated.

FIG. 2B is a rear perspective view of the portable terminal shown in FIG. 2A.

Referring to FIG. 2B, a third camera 121c may be additionally mounted on the rear surface of the portable terminal body, that is, the rear case 102. The third camera 121c has a photographing direction substantially opposite to that of the first and second cameras 121a and 121b and may be a camera having the same or different pixels as the first and second cameras 121a and 121b have.

A flash 123 and a mirror 124 may be further disposed adjacent to the third camera 121c. The flash 123 illuminates the subject when the subject is photographed by the third camera 121c. The mirror 124 allows the user to illuminate the user's own face or the like when the user intends to take a picture of himself / herself (self-photographing) using the third camera 121c.

The sound output module 152 'may be further disposed on the rear surface of the portable terminal body. The sound output unit 152 'may implement the stereo function together with the sound output module 152 (see FIG. 2A), and may be used for the implementation of the speakerphone mode during a call.

In addition to the antenna for communication, a broadcast signal receiving antenna 116 may be additionally disposed on the side of the portable terminal body. The antenna 116, which forms part of the broadcast receiving unit 111 (see FIG. 1), may be installed to be able to be drawn out from the terminal body.

A power supply unit 190 for supplying power to the portable terminal 100 is mounted on the terminal body. The power supply unit 190 may be built in the terminal body or may be detachable from the outside of the terminal body.

The rear case 102 may further include a touch pad 135 for sensing a touch. The touch pad 135 may be of a light transmission type for the display unit 151. [ In this case, if the display unit 151 is configured to output the time information on both sides (i.e., in the directions of both the front and back sides of the mobile terminal), the time information can be recognized through the touch pad 135 do. The information output on both sides may be all controlled by the touch pad 135. [

Meanwhile, the display for exclusive use of the touch pad 135 may be separately installed, so that the touch screen may be disposed in the rear case 102 as well.

The touch pad 135 operates in correlation with the display portion 151 of the front case 101. The touch pad 135 may be disposed parallel to the rear of the display unit 151. The touch pad 135 may have a size equal to or smaller than that of the display unit 151.

Hereinafter, a 3D image control process of a mobile terminal that can be applied to embodiments of the present invention will be described.

The stereoscopic image that can be implemented on the display unit 151 of the portable terminal can be roughly divided into two categories. The criterion for this classification is whether or not different images are provided in both eyes.

First, we describe the first stereoscopic image category.

The first category is monoscopic in that the same image is provided in both eyes, which is advantageous in that it can be implemented as a general display unit. More specifically, the controller 180 arranges a polyhedron generated through one or more points, lines, faces, or a combination thereof on an imaginary three-dimensional space, and displays the image viewed at a specific time on the display unit 151 . Therefore, the substantial part of such a stereoscopic image can be referred to as a planar image.

The second category is a stereo scopic method in which different images are provided in both eyes. It is a method using a principle of feeling a three-dimensional feeling when a human is looking at an object with the naked eye. In other words, the two eyes of a person see different plane images when they see the same thing by the distance between them. These different planar images are transmitted to the brain through the retina, and the brain fuses them to feel the depth and reality of the stereoscopic image. Therefore, binocular disparity due to the distance between the two eyes makes a sense of stereoscopic effect, and this binocular disparity becomes the most important element of the second category. This binocular disparity will be described in more detail with reference to Fig.

3 is a conceptual diagram for explaining the principle of binocular disparity.

In Fig. 3, it is assumed that the hexahedron 31 is placed on the front face lower than the eye level and viewed with the naked eye. In this case, a left-eye plane image 32 in which only the top, front, and left sides of the hexahedron 31 are visible in the left eye. In addition, a right-eye plane image 33 in which only the top, front, and right sides of the hexahedron 31 are visible in the right eye.

If the left eye plane image 32 is left in the left eye and the right eye plane image 33 is in the right eye, the person can actually feel as if he is looking at the hexahedron 31, even if he or she is not in front of the actual eye.

As a result, in order for the stereoscopic image of the second category to be implemented in the portable terminal, the left eye image and the right eye image, which are viewed at the same time intervals, should be separated from each other through the display unit so as to reach both eyes. Next, 3D depth by binocular parallax will be described with reference to FIG.

4 is a conceptual diagram for explaining distance feeling and 3D depth due to binocular parallax.

Referring to FIG. 4, when the hexahedron 40 is viewed at a distance d1 through both eyes, the lateral specific gravity of the image input to each eye is relatively higher than when the hexahedron 40 is viewed at the d2 distance, The difference becomes large. Also, the degree of three-dimensional sensation experienced by a person when viewing the hexahedron 40 at a distance d1 is greater than when viewing the hexahedron 40 at a distance d2. In other words, when a person looks at an object through both eyes, the closer to the object, the greater the three-dimensional feeling, and the farther the object, the less the three-dimensional feeling.

This difference in 3D sensibility can be quantified in 3D depth or 3D level.

Next, an implementation method of the 3D stereoscopic image will be described.

As described above, in order to realize a 3D stereoscopic image, it is necessary that the right eye image and the left eye image are divided into two and reach the binocular. Various methods for this are described below.

1) Parallax barrier method

The parallax barrier method is a method of electronically driving a blocking device provided between a display unit and a binocular to control the traveling direction of light, thereby achieving different images in both eyes.

This will be described with reference to FIG.

FIG. 5 is a conceptual diagram illustrating a method of implementing a 3D stereoscopic image in a display unit of a view barrier system applicable to embodiments of the present invention.

The structure of the display unit 151 of the field barrier type for displaying the 3D stereoscopic image may have a structure in which the switch liquid crystal 151b is combined with the general display device 151a. The optical parallax barrier 50 can be operated by using the switch liquid crystal 151b as shown in FIG. 5A to control the traveling direction of the light so that different lights can be separated from the left and right eyes. When an image in which the right eye image and the left eye image are combined is displayed on the display device 151a, the user can see the image corresponding to each eye and feel as if the eye image is displayed as a three-dimensional object.

In addition, as shown in FIG. 5 (b), the parallax barrier 50 by the switch liquid crystal is electrically controlled so that light is totally transmitted, thereby eliminating the separation of light by the parallax barrier so that the same image can be seen on the left and right eyes It is possible. In this case, the same function as the general display unit can be achieved.

5 illustrates that the parallax barrier moves parallel to one axial direction. However, the present invention is not limited thereto, and a parallax barrier that can move in parallel in two or more axial directions may be used according to the control signal of the controller 180 have.

2) Lens refraction method

The lens refraction method (lenticular) is a method using a lenticular screen provided between a display part and a binocular eye, and a method of refracting a traveling direction of light through lenses on a lenticular screen so that different images are reached in both eyes.

3) polarized glasses system

Polarized light is polarized so that the directions of polarization are orthogonal to each other to provide different images in both directions or in the case of the circular polarized light so that the directions of rotation are different from each other.

4) Active shutter method

Eye image is alternately displayed at a predetermined cycle through the display unit and the user's eyeglasses are arranged such that when the image in the corresponding direction is displayed, the shutter in the opposite direction is closed, To reach the eye. That is, during the time when the left eye image is displayed, the shutter of the right eye is closed to allow the left eye image to be reached only in the left eye, and the shutter of the left eye is closed during the time when the right eye image is displayed.

It is assumed that the portable terminal according to an embodiment of the present invention described below can provide a 3D stereoscopic image to the user through the display unit 151 through any of the methods described above.

However, since the 3D image principle described above with reference to FIGS. 4 and 5 assumes a three-dimensional object, the shape of the object differs between the left-eye image and the right-eye image. However, in the case of a planar object other than a three-dimensional object, the shape of the object is the same in the left eye image and the right eye image. However, if the position of the object is different in each image, the user can feel the perspective of the object. In the present specification, for the sake of understanding, it is assumed that a stereoscopic image appearing below is a plane object. Obviously, the present invention can also be applied to a three-dimensional object.

Hereinafter, with reference to FIGS. 6 to 17, embodiments of a process of controlling the operation of 3D content through proximity touching of the portable terminal 100 according to the present invention will be described in detail.

Embodiments according to the present invention described below can be performed in combination with each other, but the embodiments will be described separately for clarifying the present invention.

6 is a flowchart illustrating a process of controlling the operation of 3D content through proximity touching of the portable terminal according to the present invention.

Referring to FIG. 6, the controller 180 displays the 3D content selected by the user through the touch screen 151 or the user input unit 130 (S110).

At this time, the 3D content may be stored in the memory 160 or received from the outside through the wireless communication unit 110.

In addition, the 3D content includes a 3D virtual keypad, a 3D video, a 3D document, a 3D image, a 3D preview image generated by the first and second cameras 121a and 121b, a 3D menu, a 3D list including 3D objects, A 3D home screen image, a 3D idle screen image, a 3D phone book, a 3D call history list, a 3D message transmission / reception history list, a 3D email, a 3D game, a 3D web page, a 3D application, etc. And includes all data that is executable in the portable terminal and is 3D.

Next, the controller 180 detects the proximity depth of the proximity touch input on the 3D content through the proximity sensor 141 while displaying the 3D content (S120).

Then, the controller 180 controls the operation of the 3D content according to the proximity depth of the detected proximity touch [S130].

Hereinafter, the 3D content operation control process in step S130 will be described in detail with reference to FIG. 7 through FIG.

First Embodiment

The first embodiment of the present invention relates to a process for controlling the operation of the 3D virtual keypad according to the proximity depth of the user's proximity touch when the 3D content is a 3D virtual keypad for inputting characters.

Hereinafter, the first embodiment of the present invention will be described in detail with reference to FIG.

FIG. 7 is an explanatory diagram of a first embodiment of a process of controlling the operation of 3D content through proximity touching of a portable terminal according to the present invention.

7A shows that the 3D virtual keypad 310 displayed on the touch screen 151 is displayed when the operation mode of the portable terminal 100 is the character input mode.

At this time, the 3D virtual keypad 310 includes a plurality of character keys for inputting characters (Korean, English, numbers, symbols, special characters, etc.) and function keys associated with character input.

At this time, a plurality of characters are allocated to each of the character keys, and the currently displayed character is switched to another assigned character according to a user operation.

For example, the "a" character key 311 is assigned to the "a" number, the "1" number, the "ㄲ" double consonant, the "ㅋ" character, the "a" .

When the character input mode of the portable terminal 100 is switched to the Hangul input mode, English input mode, numeric input mode, symbol input mode, special character input mode, or the like, the characters displayed on the character key 311 The letter corresponding to the mode is displayed.

The control unit 180 recognizes the proximity depth of the proximity touch when it is sensed that the proximity touch is input on the specific character key 311 of the 3D virtual keypad 310 through the proximity sensor 141. [

The control unit 180 gradually changes the character currently displayed on the character key 311 to other characters assigned to the character key 311 according to the detected proximity depth.

7A, when the proximity touch having the proximate depth of d1 is detected on the character key 311, the control unit 180 determines whether the character assigned to the character key 311 1 '(3111A) among the character keys (1, k, a) on the character key 311 in 3D form.

Next, when the proximity touch having the proximate depth of d2 is detected on the character key 311, the controller 180 determines whether the character key 311 is' 'Consonant 311B on the character key 311 in 3D form.

When a proximity touch having a proximate depth of d3 is detected on the character key 311, the control unit 180 determines whether the character key 311 is 'A' consonant among the characters (1, (311C) on the character key 311 in 3D form.

Although not shown in FIG. 7, the control unit 180 displays Hangul characters for the Hangul input mode on the character keys of the 3D virtual keypad 310, and displays the Hangul characters for the Hangul input mode on the 3D virtual keypad 310, When the proximity touch having the proximity depth is detected, the Hangul input mode is switched to the English input mode, and English characters for the English input mode are displayed on the character keys of the 3D virtual keypad 310, respectively.

In addition, the controller 180 displays the English characters for the English input mode on the character keys of the 3D virtual keypad 310, and displays a proximity touch having the proximate depth of d2 on the 3D virtual keypad 310 If it is detected, the English input mode is switched to the numeric input mode, and the numbers for the numeric input mode are displayed in the character keys of the 3D virtual keypad 310, respectively.

In addition, when the controller 180 displays the numbers for the numeric input mode in the character keys of the 3D virtual keypad 310, a proximity touch having a proximity depth of d3 is detected on the 3D virtual keypad 310 The symbols for the symbol input mode may be displayed on the character keys of the 3D virtual keypad 310, respectively.

That is, according to the first embodiment of the present invention, the character input mode of the 3D virtual keypad 310 is switched or the characters assigned to the character keys of the 3D virtual keypad 310 are switched As shown in FIG.

Second Embodiment

The second embodiment of the present invention relates to a process of enlarging or reducing the 3D image according to the proximity depth of the user's proximity touch when the 3D content is a 3D image.

Hereinafter, a second embodiment of the present invention will be described in detail with reference to FIG.

FIG. 8 is a diagram illustrating a second embodiment of a process of controlling the operation of 3D content through proximity touching of a portable terminal according to the present invention.

First, FIG. 8A shows that a 3D image 320 is displayed on the touch screen 151.

The control unit 180 recognizes the proximity depth of the proximity touch when it is detected that the user's proximity touch is input on the 3D image 320 through the proximity sensor 141. [

The control unit 180 enlarges or reduces the 3D image 320 according to the detected proximity depth.

At this time, the control unit 180 may gradually enlarge or reduce the area that is touched on the 3D image 320 according to the proximity depth.

8 (a), the controller 180 detects the proximity depth of the first d1 on the 3D image 320, and the proximity depth of d1 approaches the touch screen 151 , The 3D image 320 is enlarged and displayed according to the changed proximate depth as shown in FIG. 8 (b).

8 (b), the control unit 180 detects the proximity depth of the first d1 on the 3D image 320, and the proximity depth of d1 is in the opposite direction of the touch screen 151 , The 3D image 320 is displayed in a reduced size corresponding to the changed proximate depth, as shown in FIG. 8 (c).

In the second embodiment of the present invention, the process of enlarging or reducing the 3D image according to the proximity depth of the user's proximity touch has been described. However, in addition to the 3D image, The playback screen may be enlarged or reduced depending on the proximity depth.

Third Embodiment

A third embodiment of the present invention relates to a process for increasing or decreasing the 3D depth of objects included in the 3D image according to the proximity depth of the proximity touch of the user when the 3D content is 3D image.

Hereinafter, a third embodiment of the present invention will be described in detail with reference to FIG.

FIG. 9 is an explanatory diagram of a third embodiment of a process of controlling the operation of 3D content through proximity touching of a portable terminal according to the present invention.

9 (a), the controller 180 displays the 3D image 320 on the touch screen 151 through the proximity sensor 141 on the 3D image 320 When it is detected that the user's proximity touch is input, the proximity depth of the proximity touch is grasped.

The control unit 180 increases or decreases the 3D depth of the objects in the 3D image 320 according to the detected proximity depth.

9 (a), the controller 180 detects the proximity depth of the first d1 on the 3D image 320, and the proximity depth of d1 approaches the touch screen 151 The first and second building objects in the 3D image 320 correspond to the changed proximate depths, as shown in FIG. 9 (b) The 3D depth of the second building objects is increased and displayed.

9 (b), the controller 180 detects the proximity depth of the first d1 on the 3D image 320, and the proximity depth of d1 is in the opposite direction of the touch screen 151 The first and second building objects in the 3D image 320 corresponding to the changed proximate depth are displayed on the screen as shown in FIG. 9 (c) 2 Reduce the 3D depth of building objects and display them.

Although not shown in FIG. 9, when the proximity depth of the user's proximity touch is detected on any one of the first and second objects in the 3D image 320, The 3D depth of the object may be increased or decreased depending on the depth.

In the third embodiment of the present invention, the 3D depth of the objects included in the 3D image is increased or decreased according to the proximity depth of the user's proximity touch. However, in addition to the 3D image, The 3D depth of the objects contained within the object may also be increased or decreased.

Fourth Embodiment

A fourth embodiment of the present invention relates to a process for controlling an operation related to the reproduction of the 3D moving picture according to a close-up depth of a user's proximity touch when the 3D content is a 3D moving picture.

Hereinafter, a fourth embodiment of the present invention will be described in detail with reference to FIGS. 10 to 13. FIG.

FIGS. 10 to 13 are explanatory diagrams of a fourth embodiment of a process of controlling the operation of 3D content through proximity touching of the portable terminal according to the present invention.

First, as shown in FIG. 10A, the controller 180 reproduces the 3D movie 330 selected by the user and displays the reproduction screen of the 3D movie 330.

When the controller 180 detects that the user's proximity touch is input on the playback screen of the 3D movie 330 through the proximity sensor 141 while displaying the playback screen of the 3D movie 330, Identify the proximity depth of the touch.

Then, the controller 180 displays the brightness of the 3D video 330 in a bright or dark state according to the detected proximity depth.

10A, the control unit 180 detects the proximity depth of the first d1 on the reproduction screen of the 3D moving image 330, and the proximity depth of the first d1 is detected on the touch screen 151 , The brightness of the 3D moving image 330 is increased and displayed according to the changed proximate depth as shown in FIG. 10 (b).

10 (b), the control unit 180 detects the proximity depth of the first d1 on the playback screen of the 3D moving image 330, and the proximity depth of d1 is detected on the touch screen 151, The brightness of the 3D moving image 330 is reduced and displayed according to the changed proximity depth as shown in FIG. 10 (c).

11 (a), the control unit 180 controls the playback of the 3D movie 330 through the proximity sensor 141 while displaying the playback screen of the 3D movie 330. Then, When it is detected that the user's proximity touch is input on the screen, the proximity depth of the proximity touch is grasped.

Then, the control unit 180 enlarges or reduces the reproduction screen of the 3D moving image 330 according to the detected proximity depth.

11A, the control unit 180 detects the proximity depth of the first d1 on the reproduction screen of the 3D moving picture 330, and the proximity depth of the first d1 is detected on the touch screen 151 ), The reproduction screen of the 3D moving picture 330 is enlarged and displayed in accordance with the changed proximate depth, as shown in FIG. 11 (b).

11 (b), the control unit 180 detects the proximity depth of the first d1 on the reproduction screen of the 3D moving image 330, , The reproduction screen of the 3D moving picture 330 is displayed in a reduced size corresponding to the changed proximate depth, as shown in FIG. 11 (c).

12 (a), the controller 180 controls the playback of the 3D movie 330 through the proximity sensor 141 in a state in which the playback screen of the 3D movie 330 is displayed, When it is detected that the user's proximity touch is input on the screen, the proximity depth of the proximity touch is grasped.

The control unit 180 increases or decreases the size of the sound volume of the 3D moving image 330 according to the detected proximity depth.

12 (a), the control unit 180 detects the proximity depth of the first d1 on the reproduction screen of the 3D moving picture 330, and the proximity depth of the first d1 is detected on the touch screen 151 , The size of the sound volume of the 3D moving image 330 is increased corresponding to the changed proximate depth, as shown in FIG. 12 (b).

12 (b), the control unit 180 detects the proximity depth of the first d1 on the reproduction screen of the 3D moving image 330, and the proximity depth of the first d1 is detected on the touch screen 151, The size of the sound volume of the 3D moving picture 330 is reduced corresponding to the changed proximate depth, as shown in FIG. 12 (c).

13 (a), the control unit 180 controls the playback of the 3D movie 330 through the proximity sensor 141 while displaying the playback screen of the 3D movie 330, When it is detected that the user's proximity touch is input on the screen, the proximity depth of the proximity touch is grasped.

The control unit 180 moves the current playback point of the 3D moving image 330 forward or backward according to the detected proximity depth.

13A, the control unit 180 detects the proximity depth of the first d1 on the reproduction screen of the 3D moving image 330, and the proximity depth of the d1 is detected on the touch screen 151 , The current playback point of the 3D moving image 330 is moved forward in accordance with the changed proximate depth as shown in FIG. 13 (b).

13 (b), the control unit 180 detects the proximity depth of the first d1 on the reproduction screen of the 3D moving image 330, and the proximity depth of the first d1 is detected on the touch screen 151, The current playback point of the 3D moving image 330 is moved backward in accordance with the changed proximate depth, as shown in FIG. 13 (c).

Fifth Embodiment

In the fifth embodiment of the present invention, when the 3D content is a 3D preview image generated using the left and right eye images inputted through the first and second cameras 121a and 121b, And changing a shooting condition value of the 3D preview image.

Hereinafter, a fifth embodiment of the present invention will be described in detail with reference to FIG.

FIG. 14 is an explanatory diagram of a fifth embodiment of a process of controlling the operation of 3D content through proximity touching of a portable terminal according to the present invention.

As shown in FIG. 14 (a), when the 3D photographing menu is selected from the user, the controller 180 drives the first and second cameras 121a and 121b for generating the 3D preview image, And a 3D preview image 340 using the left and right eye images input through the first and second cameras 121a and 121b.

If it is detected that the user's proximity touch is input on the 3D preview image 340 through the proximity sensor 141 while the 3D preview image 340 is being displayed, Obtain proximity depth.

Then, the control unit 180 changes the shooting condition value of the 3D preview image 340 according to the detected proximity depth.

At this time, the photographing condition value includes a zoom-in or zoom-out value, an exposure value, a resolution value, a white balance value, an ISO (International Organization for Standardization) sensitivity value,

For example, as shown in FIG. 14A, the control unit 180 detects the proximity depth of the first d1 on the 3D preview image 340, , The ISO sensitivity value of the 3D preview image 340 is increased and displayed according to the changed proximity depth as shown in FIG. 14 (b).

14 (b), the control unit 180 detects the proximity depth of the first d1 on the 3D preview image 340, and if the proximity depth of the first d1 is greater than the proximity of the touch screen 151 , The ISO sensitivity value of the 3D preview image 340 is reduced and displayed according to the changed proximate depth as shown in FIG. 14 (c).

Although not shown in FIG. 14, the control unit 180 detects the proximity depth of the first d1 on the 3D preview image 340, and the proximity depth of d1 changes to d2 in the direction toward the touch screen 151 The 3D preview image 340 can be zoomed in and displayed according to the changed proximate depth. Although not shown in FIG. 14, the control unit 180 detects the proximity depth of the first d1 on the 3D preview image 340, and the proximity depth of d1 changes to d2 in the direction opposite to the touch screen 151 The 3D preview image 340 can be zoomed out and displayed according to the changed proximity depth.

Although not shown in FIG. 14, the control unit 180 detects the proximity depth of the first d1 on the 3D preview image 340, and the proximity depth of d1 changes to d2 in the direction toward the touch screen 151 The exposure value of the 3D preview image 340 may be increased and displayed according to the changed proximity depth. Although not shown in FIG. 14, the control unit 180 detects the proximity depth of the first d1 on the 3D preview image 340, and the proximity depth of d1 changes to d2 in the direction opposite to the touch screen 151 The exposure value of the 3D preview image 340 may be reduced and displayed according to the changed proximity depth.

Although not shown in FIG. 14, the control unit 180 detects the proximity depth of the first d1 on the 3D preview image 340, and the proximity depth of d1 changes to d2 in the direction toward the touch screen 151 The resolution value of the 3D preview image 340 may be increased and displayed according to the changed proximity depth. Although not shown in FIG. 14, the control unit 180 detects the proximity depth of the first d1 on the 3D preview image 340, and the proximity depth of d1 changes to d2 in the direction opposite to the touch screen 151 The resolution value of the 3D preview image 340 may be reduced and displayed according to the changed proximity depth.

Although not shown in FIG. 14, the control unit 180 detects the proximity depth of the first d1 on the 3D preview image 340, and the proximity depth of d1 changes to d2 in the direction toward the touch screen 151 The white balance value of the 3D preview image 340 may be increased and displayed in accordance with the changed proximity depth. Although not shown in FIG. 14, the control unit 180 detects the proximity depth of the first d1 on the 3D preview image 340, and the proximity depth of d1 changes to d2 in the direction opposite to the touch screen 151 The white balance value of the 3D preview image 340 may be reduced and displayed according to the changed proximity depth.

Although not shown in FIG. 14, the control unit 180 detects the proximity depth of the first d1 on the 3D preview image 340, and the proximity depth of d1 changes to d2 in the direction toward the touch screen 151 The image quality value of the 3D preview image 340 may be increased and displayed according to the changed proximity depth. Although not shown in FIG. 14, the control unit 180 detects the proximity depth of the first d1 on the 3D preview image 340, and the proximity depth of d1 changes to d2 in the direction opposite to the touch screen 151 The image quality value of the 3D preview image 340 may be reduced and displayed according to the changed proximity depth.

Sixth Embodiment

The sixth embodiment of the present invention relates to a process of entering an upper or lower menu of the 3D menu in accordance with the proximity depth of the user's proximity touch when the 3D content is a 3D menu including an upper or lower menu.

Hereinafter, a sixth embodiment of the present invention will be described in detail with reference to FIG.

FIG. 15 is an explanatory diagram of a sixth embodiment of a process of controlling the operation of 3D content through proximity touching of a portable terminal according to the present invention.

As shown in FIG. 15A, when the control unit 180 detects that the user's proximity touch is input on the 3D menu screen 350A while displaying the 3D menu screen 350A, Identify the proximity depth of the touch.

The control unit 180 enters the lower menu 350B or the upper menu 350C of the 3D menu screen 350A according to the detected proximity depth.

15A, the control unit 180 detects the proximity depth of the first d1 on the 3D menu screen 350A, and when the proximity depth of the first d1 is greater than the proximity depth of the touch screen 151 The user enters the submenu 350B of the 3D menu screen 350A corresponding to the changed proximate depth as shown in FIG. 15 (b).

15 (b), the control unit 180 detects the proximity depth of the first d1 on the 3D menu screen 350A, and the proximity depth of d1 is the opposite of the touch screen 151 Direction d2, the upper menu 350C of the 3D menu screen 350A is entered corresponding to the changed proximate depth as shown in FIG. 15 (c).

Seventh Embodiment

The seventh embodiment of the present invention relates to a process of multiple selection of objects in the 3D list or scrolling of a 3D list according to the proximity depth of the user's proximity touch when the 3D content is a 3D list including a plurality of objects .

Hereinafter, a seventh embodiment of the present invention will be described in detail with reference to FIG.

FIG. 16 is a diagram illustrating a seventh embodiment of a process of controlling the operation of 3D content through proximity touching of a portable terminal according to the present invention.

16A, the controller 180 displays a 3D list 360 including a plurality of objects, such as a file, on the 3D list 360, When it is detected that a touch is input, the proximity depth of the proximity touch is grasped.

The controller 180 sequentially selects the objects in the 3D list 360 or scrolls the 3D list 360 according to the detected proximity depth.

16 (a), the controller 180 detects the proximity depth of the first d1 on the 3D list 360, and when the proximity depth of d1 reaches the touch screen 151 Direction d2, as shown in FIG. 16 (b), objects of the 3D list 360 are sequentially selected in a multiple order corresponding to the changed proximate depth.

15B, the control unit 180 detects the proximity depth of the first d1 on the 3D list 360, and determines that the proximity depth of the d1 is in a direction toward the touch screen 151 , The 3D list 360 is sequentially scrolled upward or downward in accordance with the changed proximate depth, as shown in FIG. 16 (c).

Eighth Embodiment

In the eighth embodiment of the present invention, when the 3D content is a 3D image indicating a screen lock state of the touch screen 151, the process of releasing the screen lock of the touch screen 151 according to the proximity depth of the user's proximity touch .

Hereinafter, an eighth embodiment of the present invention will be described in detail with reference to FIG.

FIG. 17 is an explanatory diagram of an eighth embodiment of a process of controlling the operation of 3D content through proximity touching of a portable terminal according to the present invention.

As shown in FIG. 17A, when the touch screen 151 is locked, the control unit 180 displays a 3D image 370A indicating the screen lock state on the screen of the touch screen 151 .

When the controller 360 detects that the user's proximity touch is input on the 3D image 370A while displaying the 3D image 370A, the controller 180 grasps the proximity depth of the proximity touch.

If the detected proximity depth is a predetermined depth for unlocking the screen of the touch screen 151, the controller 180 cancels the screen lock of the touch screen 151, As shown, a 3D idle screen 370B is displayed.

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer-readable medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and also implemented in the form of a carrier wave (for example, transmission over the Internet) . Also, the computer may include a control unit 180 of the terminal.

Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

The above-described mobile terminal and its control method are not limited to the configuration and method of the above-described embodiments, but the embodiments may be modified such that all or some of the embodiments are selectively And may be configured in combination.

100: mobile terminal 110: wireless communication unit
111: broadcast receiver 112: mobile communication module
113 wireless Internet module 114 short-range communication module
115: Position information module 120: A / V input section
121: camera 122: microphone
130: user input unit 140: sensing unit
141: proximity sensor 150: output section
151: Display unit 152: Acoustic output module
153: Alarm module 154: Haptic module
155: projector module 160: memory
170: interface unit 180: control unit
181: Multimedia module 190: Power supply

Claims (12)

A touch screen for displaying 3D content on the screen;
A proximity sensor for sensing a proximity depth of the proximity touch input on the 3D content; And
And a control unit for controlling the operation of the 3D content according to the detected proximity depth,
Wherein the 3D content includes a 3D image including at least one 3D object displayed on the screen,
Wherein,
When the proximity depth of the proximity touch input on the 3D image is changed in the first direction toward the screen, the 3D object is displayed on the screen so that the 3D object is close to the screen, The 3D depth is increased and displayed,
When the proximity depth is changed in a second direction opposite to the first direction, the 3D depth of the 3D object is reduced and displayed so that the 3D object is far away on the screen corresponding to the proximity depth changed in the second direction , A portable terminal. The method according to claim 1,
Wherein the 3D content further comprises a 3D virtual keypad including keys each assigned a plurality of characters,
Wherein the control unit gradually changes the characters assigned to the specific key according to the proximity depth of the proximity touch input on the specific key of the 3D virtual keypad. delete The method according to claim 1,
Wherein the 3D content further comprises a playback screen of the 3D movie being played back,
The control unit may control the brightness of the 3D video to be played back, the magnification or reduction of the playback screen of the 3D movie, the size of the sound volume, the forward or backward playback And controls one of the operations during the viewpoint movement. The method according to claim 1,
At least two first and second cameras for left eye and right eye image input for 3D,
Wherein the 3D content further includes a 3D preview image generated based on the 3D left eye and right eye images input by the first and second cameras,
Wherein the controller changes the shooting condition value of the 3D preview image according to the proximity depth of the proximity touch input on the 3D preview image. The method according to claim 1,
The 3D content further includes a 3D menu including an upper or lower menu,
Wherein the control unit enters the upper or lower menu of the 3D menu according to the proximity depth of the proximity touch input on the 3D menu. The method according to claim 1,
The 3D content further includes a 3D list including a plurality of 3D objects,
Wherein the controller sequentially selects the 3D objects or scrolls the 3D list according to the proximity depth of the proximity touch input on the 3D list. The method according to claim 1,
Wherein the 3D content further comprises a 3D image indicating a screen lock state of the touch screen,
Wherein the controller releases the screen lock of the touch screen if the proximity depth of the proximity touch input on the 3D image is a predetermined depth for unlocking the screen. delete delete delete delete

Images