KR101847917B1 - Mobile terminal and control method thereof - Google Patents

Abstract

A mobile terminal according to an exemplary embodiment of the present invention includes a display unit configured to display a 2D image including a plurality of objects and capable of touch input, Changing a characteristic of each of the objects based on a 3D depth value of each of the objects included in the 3D image, converting the 3D image including the changed objects into 3D images, And a control unit for displaying on the display unit.

Description

[0001] MOBILE TERMINAL AND CONTROL METHOD THEREOF [0002]

The present invention relates to a mobile terminal, and more particularly, to a mobile terminal capable of displaying an image and a control method thereof.

The terminal is movable And may be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

As the functions are diversified, such a terminal is implemented in the form of a multimedia player having a complex function of, for example, shooting a picture or a moving picture, reproducing a music or a moving picture file, receiving a game, or receiving a broadcast have. Further, in order to support and enhance the function of the terminal, it may be considered to improve the structural and software parts of the terminal.

With this improvement, the terminal has evolved to be able to display 3D images that enable depth perception or stereovision beyond the level of 2D image display. Thereby, the user can enjoy a more realistic user interface or contents through the 3D image. However, since the depth value of each object in the 3D image is fixed to the default value, there is a limitation in expressing the three-dimensional effect for each of the objects.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a mobile terminal and a control method thereof that can impart a sense of depth to an object separately in a 3D image.

A mobile terminal according to an exemplary embodiment of the present invention includes a display unit configured to display a 2D image including a plurality of objects and capable of touch input, Changing a characteristic of each of the objects based on a 3D depth value of each of the objects included in the 3D image, converting the 3D image including the changed objects into 3D images, And a control unit for displaying on the display unit.

The controller may calculate an average 3D depth value of the objects using the 3D depth value of each of the objects and calculate a difference between the 3D depth value of each of the objects and the average 3D depth value , The property of each of the objects can be changed.

In an embodiment, a property of each of the objects may include at least one of a shape, a size, and a color of each of the objects.

In an embodiment, the controller may change an attribute of color information of each of the objects based on the 3D depth value of each of the objects included in the 3D image, The color of each of the objects can be changed.

In an embodiment, the attribute information of the color may include at least one of a hue value, a brightness value, and a saturation value.

In an exemplary embodiment, the controller may convert the 3D image to the 2D image when the touch input to the 3D image is sensed, and display the modified 2D objects on the display unit have.

In one embodiment of the present invention, when the touch input of at least one of the objects is sensed, the control unit may control the touch input unit to display the touch input of each of the plurality of areas The 3D depth value of the object can be controlled.

The control unit may divide the object into a plurality of regions based on attribute information of colors displayed on the object, and based on attribute information of each of the plurality of regions, You can change each 3D depth value.

The controller may change the 3D depth value of the detected object when the touch input of at least one of the objects included in the 3D image is sensed, And display the object on the display unit.

In an exemplary embodiment, the controller may detect a degree of touching the object when the touch input is sensed, and may change the 3D depth value of the object according to the amount of the touch.

In an exemplary embodiment, the controller may detect at least one of a change in a touch operation from the start of the touch input to a release of the touch input to the object, and a duration of the touch input.

One embodiment of the present invention relates to a control method of a mobile terminal including a display unit configured to display a 2D image including a plurality of objects, the touch input being enabled. A method of controlling a mobile terminal, the method comprising: converting a 2D image to a 3D image when a touch input to the 2D image is sensed; determining, based on a 3D depth value of each of the objects included in the 3D image, Changing the respective characteristics, and displaying the 3D image including the objects whose characteristics have been changed on the display unit.

In one embodiment, modifying the properties of each of the objects comprises calculating an average 3D depth value of the objects using the 3D depth value of each of the objects, And modifying the property of each of the objects based on a difference between the depth value and the average 3D depth value.

In an exemplary embodiment, the control method of the mobile terminal may further include, when a touch input to at least one of the objects is sensed, based on attribute information of colors displayed on the sensed object, Changing a 3D depth value of each of the plurality of areas based on color property information of each of the plurality of areas, and displaying the object including the 3D depth value changed areas on the display And a step of displaying the information on the part.

In one embodiment of the present invention, the control method of the mobile terminal further comprises the steps of: detecting a degree of touching the object when at least one of the objects included in the 3D image is sensed; And changing the 3D depth value of the object according to the degree of the 3D depth.

According to the present invention, as the characteristics of the objects included in the 3D image are changed, a stereoscopic effect is separately given to each of the objects, so that the user can enjoy more realistic contents.

In addition, according to the present invention, a 3D depth value of an object included in a 3D image is changed based on a touch input, so that a user can enjoy a 3D image more stereoscopically by adjusting a stereoscopic effect according to a viewing angle and a viewing environment.

1 is a block diagram illustrating a mobile terminal according to the present invention.
2A and 2B are perspective views showing the appearance of a mobile terminal according to the present invention.
3 is a flowchart illustrating a method of controlling a mobile terminal according to an exemplary embodiment of the present invention.
4A, 4B, 4C, 5A and 5B are conceptual diagrams showing an example of the operation of the mobile terminal according to FIG.
6 is a flowchart illustrating a method of controlling a mobile terminal according to another embodiment of the present invention.
7A and 7B are conceptual diagrams showing an operation example of the mobile terminal according to FIG.
8 is a flowchart illustrating a method of controlling a mobile terminal according to another embodiment of the present invention.
FIGS. 9A, 9B, 10A and 10B are conceptual diagrams showing an operation example of the mobile terminal according to FIG.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings so that those skilled in the art can easily carry out the technical idea of the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly explain the present invention, parts not related to the description are omitted, and like parts are denoted by similar reference numerals throughout the specification.

The mobile terminal described herein may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigator, have. However, it should be understood that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless it is applicable only to a mobile terminal. It will be easy to see.

1 is a block diagram illustrating a mobile terminal 100 according to the present invention.

1, a mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, A controller 160, an interface unit 170, a controller 180, and a power supply unit 190. The components shown in Fig. 1 are not essential, so that a mobile terminal having more or fewer components can be implemented.

Hereinafter, the components 110 to 190 of the mobile terminal 100 will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication unit 114, and a location information module 115.

The broadcast receiving module 111 receives broadcast signals and broadcast related information from an external broadcast management server through a broadcast channel. Here, the broadcast-related information means information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information can also be provided through a mobile communication network. In this case, the broadcast-related information may be received by the mobile communication module 112. The broadcast signal and the broadcast-related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. Such wireless signals may include various types of data depending on a voice call signal, a video call signal, a text message, or a multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be embedded in the mobile terminal 100 or externally. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication unit 114 is a module for short-range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used.

The position information module 115 is a module for acquiring the position of the mobile terminal 100, and a representative example thereof is a Global Position System (GPS) module.

1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal and a video signal, and may include a camera 121, a microphone 122, and the like. The camera 121 processes image frames such as still images and moving images obtained by the image sensor in the video communication mode or the photographing mode. The image frame processed by the camera 121 can be displayed on the display unit 151. [ The image frame may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ More than two cameras 121 may be provided depending on the use environment.

The microphone 122 processes the sound signal input from the outside in the communication mode, the recording mode, the voice selection mode, and the like as electrical voice data. The voice data processed by the microphone 122 in the communication mode can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 and output. The microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated when an external sound signal is input.

The user input unit 130 generates input data for controlling the operation of the mobile terminal 100 by a user. The user input unit 130 may include a key pad, a dome switch, a touch pad (static pressure and static electricity), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as presence or absence of a user, the open / close state of the mobile terminal 100, position, orientation, acceleration, deceleration, And generates a sensing signal. For example, when the mobile terminal 100 is in the form of a slide phone, the sensing unit 140 may detect whether the slide phone is opened or closed. The sensing unit 140 may sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like.

The sensing unit 140 may include a proximity sensor 141. The sensing unit 140 may include a touch sensor (not shown) for sensing a touch operation with respect to the display unit 151.

The touch sensor may have the form of a touch film, a touch sheet, a touch pad, or the like. The touch sensor may be configured to convert a pressure applied to a specific portion of the display portion 151 or a change in capacitance generated at a specific portion of the display portion 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the touch pressure.

When the touch sensor and the display unit 151 have a mutual layer structure, the display unit 151 can be used as an input device in addition to the output device. The display unit 151 may be referred to as a 'touch screen'.

If there is a touch input via the touch screen, corresponding signals are sent to a touch controller (not shown). The touch controller processes the signals transmitted from the touch sensor, and then transmits data corresponding to the processed signals to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched.

In the case where the touch screen is electrostatic, it can be configured to detect the proximity of the sensing object by a change of the electric field along the proximity of the sensing target. Such a touch screen may be classified as proximity sensor 141. [

The proximity sensor 141 refers to a sensor that detects the presence or absence of an object to be sensed without mechanical contact using an electromagnetic force or infrared rays. The proximity sensor 141 has a longer life than the contact type sensor and its utilization is also high. Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.

Hereinafter, for convenience of explanation, a proximity action is referred to as " proximity touch " while an object to be sensed does not touch the touch screen, and an action of touching the sensing object on the touch screen is called & touch ".

The proximity sensor 141 detects the presence or absence of a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, The information corresponding to the presence / absence of proximity touch and the proximity touch pattern can be output to the touch screen.

The output unit 150 generates an output related to visual, auditory, tactile, and the like. The output unit 150 may include a display unit 151, an audio output module 153, an alarm unit 154, and a haptic module 155.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal 100 operates in the call mode, the display unit 151 displays a UI (User Interface) or a GUI (Graphic User Interface) related to the call. When the mobile terminal 100 operates in the video communication mode or the photographing mode, the display unit 151 displays the photographed image, the received image, the UI, the GUI, and the like.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT-LCD), an organic light emitting diode (OLED), a flexible display display, a 3D display, and an e-ink display.

At least one display (or display element) included in the display unit 151 may be configured to be transparent or light transmissive so that the display can see the outside through it. This can be referred to as a transparent display. A typical example of such a transparent display is TOLED (Transparent OLED). The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 in the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. [ For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from each other or positioned integrally with one another, and may be located on different surfaces.

The sound output module 153 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice selection mode, a broadcast reception mode, The sound output module 153 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The sound output module 153 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 154 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events generated in the mobile terminal 100 include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 154 may output a signal for informing occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The display unit 151 and the audio output module 153 may be classified as a part of the alarm unit 154 because the video signal or the audio signal can be output through the display unit 151 or the audio output module 153. [

The haptic module 155 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 155 is vibration. The intensity, pattern, and the like of the vibration generated by the tactile module 155 are controllable. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 155 may be configured to perform various functions such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, Various effects can be generated such as the effect of heat generation and the effect of reproducing the cold sensation using the heat absorbing or heatable element.

The haptic module 155 can be configured to not only transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sense of the finger or arm. At least two haptic modules 155 may be provided according to the configuration of the mobile terminal 100.

The memory 160 may store a program for the operation of the controller 180 and temporarily store input and output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 160 may store data related to vibrations and sounds of various patterns that are output upon touch input on the touch screen.

The memory 160 may be a flash memory, a hard disk, a multimedia card micro type, a card type memory (e.g., SD or XD memory), a random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM) And may include at least one storage medium. The mobile terminal 100 may operate in association with a web storage that performs storage functions of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, the interface unit 170 may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, Input / output ports, video I / O ports, earphone ports, and the like.

The identification module is a chip for storing various information for authenticating the usage right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module Universal Subscriber Identity Module (USIM)). A device equipped with an identification module (hereinafter referred to as "identification device") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

The interface unit 170 may be a path through which the power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle or various command signals input from the cradle by the user, (Not shown). The various command signals or power supplied from the cradle may also act as a signal for recognizing that the mobile terminal 100 is correctly mounted in the cradle.

The controller 180 controls the overall operation of the mobile terminal 100. For example, control and processing related to voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [ The control unit 180 may perform pattern selection processing for selecting handwriting input and drawing input on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be applied to various types of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays Microprocessors, microprocessors, and other electronic units for performing other functions, as will be appreciated by those skilled in the art. In some cases, the embodiments described herein may be implemented by the controller 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code may be implemented in a software application written in a suitable programming language. Such software codes may be stored in the memory 160 and executed by the control unit 180. [

Hereinafter, a method of processing user input to the mobile terminal 100 will be described.

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100, and may include a plurality of operation units. The operating units may also be referred to as manipulating portions and may be employed in any manner as long as they are operated in a tactile manner by the user's tactile sense.

Various kinds of time information can be displayed on the display unit 151. [ Such visual information can be displayed in the form of letters, numbers, symbols, graphics, icons, and the like, and can be formed as a three-dimensional stereoscopic image. At least one of a character, a number, a symbol, a graphic, and an icon may be displayed in a predetermined arrangement for inputting time information, thereby being implemented as a keypad. Such a keypad may be referred to as a so-called " soft key ".

The display unit 151 may operate as an entire area or may be divided into a plurality of areas and operated. In the latter case, the plurality of areas can be configured to operate in association with one another. For example, an output window and an input window may be displayed on the upper and lower portions of the display unit 151, respectively. The output window and the input window are areas allocated for outputting or inputting information, respectively. In the input window, a soft key with a number for inputting a telephone number may be output. When the soft key is touched, the number corresponding to the touched soft key is displayed in the output window. When the operating unit is operated, a call connection to the telephone number displayed in the output window may be attempted, or the text displayed in the output window may be entered into the application.

The display unit 151 or the touch pad may be configured to detect touch scrolling. The user can move the cursor or the pointer positioned on the displayed object, for example, the icon, on the display unit 151 by scrolling the display unit 151 or the touch pad. Further, when the finger is moved on the display unit 151 or the touch pad, the path along which the finger moves may be visually displayed on the display unit 151. [ This will be useful for editing the image displayed on the display unit 151. [

One function of the mobile terminal 100 may be executed in response to a case where the display unit 151 and the touch pad are touched together within a predetermined time range. In the case of being touched together, there may be a case where the user clamps the main body of the mobile terminal 100 using the thumb and index finger. At this time, one function of the mobile terminal 100 to be executed may be activation or deactivation for the display unit 151 or the touch pad, for example.

2A and 2B are perspective views showing the appearance of the mobile terminal 100 related to the present invention.

FIG. 2A shows a front side and one side of the mobile terminal 100, and FIG. 2B shows a rear side and the other side of the mobile terminal 100. FIG.

Referring to FIG. 2A, the mobile terminal 100 includes a bar-shaped terminal body. However, the mobile terminal 100 is not limited thereto, and may be realized in various forms such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are movably coupled to each other.

The terminal body includes a case (a casing, a housing, a cover, and the like) that forms an appearance. In the embodiment, the case may be divided into a front case 101 and a rear case 102. A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injection molding of a synthetic resin or may be formed to have a metal material such as stainless steel (STS), titanium (Ti) or the like.

The display unit 151, the sound output unit 152, the camera 121, the user input unit 130 (see FIG. 1), the microphone 122, the interface 170, can do.

The display unit 151 occupies a main portion of the front case 101. [ The audio output unit 152 and the camera 121 are located in a region adjacent to one end of the display unit 151 and the first user input unit 131 and the microphone 122 are located in a region adjacent to the other end. The second user input unit 132 and the interface 170 may be located on the sides of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100. [ The user input unit 130 may include a plurality of operation units 131 and 132.

The first or second operating units 131 and 132 can receive various commands. For example, the first operation unit 131 can receive commands such as start, end, scroll, and the like. The second operation unit 132 can receive commands such as adjusting the size of the sound output from the sound output unit 152, switching to the touch selection mode of the display unit 151, and the like.

Referring to FIG. 2B, a rear camera 121 'may be additionally mounted on the rear surface of the terminal body, that is, the rear case 102. The rear camera 121 'has a photographing direction opposite to that of the front camera 121 (see FIG. 2A), and may be configured to have pixels different from those of the front camera 121.

For example, the front camera 121 may be configured to have a low pixel, and the rear camera 121 'may be configured to have a high pixel. Accordingly, when the front camera 121 is used during a video call, when the user's face is photographed and the photographed image is transmitted to the other party in real time, the size of the transmitted data can be reduced. On the other hand, the rear camera 121 'can be used for the purpose of storing a high-quality image.

Meanwhile, the cameras 121 and 121 'may be installed in the terminal body so as to be rotated or popped up.

The flash 123 and the mirror 124 may be further positioned adjacent to the rear camera 121 '. The flash 123 emits light toward the subject when the user photographs the subject with the rear camera 121 '. The mirror 124 illuminates the user's face when the user photographs himself (self-photographing) using the rear camera 121 '.

A rear sound output unit 152 'may be additionally disposed on the rear surface of the terminal body. The rear sound output unit 152 'may perform a stereo function together with the front sound output unit 152 (see FIG. 2A), and may perform a speakerphone function during a call.

In addition to the antenna for communication, an antenna 116 for receiving broadcast signals may be additionally provided on the side surface of the terminal body. The antenna 116 constituting a part of the broadcast receiving module 111 (see FIG. 1) can be installed to be able to be drawn out from the terminal body.

A power supply unit 190 for supplying power to the mobile terminal 100 is mounted on the terminal body. The power supply unit 190 may be built in the main body of the terminal or may be detachable from the outside of the main body of the terminal.

The rear case 102 may further include a touch pad 135 for sensing a touch. The touch pad 135 may be of a light transmission type like the display unit 151 (see FIG. 2A). Further, a back display unit for outputting time information can be additionally mounted on the touch pad 135. [ At this time, information output from both sides of the front display unit 151 and the rear display unit can be controlled by the touch pad 135. [

The touch pad 135 operates in correlation with the display unit 151. [ The touch pad 135 may be positioned parallel to the rear of the display unit 151. The touch pad 135 may have a size equal to or smaller than that of the display unit 151.

Meanwhile, the mobile terminal 100 can display a 3D image (3-dimensional stereoscopic image) enabling a depth perception or stereovision beyond the level of a 2D image display It is evolving. The 3D image is an image in which the depth and the reality where the object is located on the display unit 151 can be felt to be the same as the real space.

Thereby, the user can enjoy a more realistic user interface or contents through the 3D image. However, since the depth value of each object in the 3D image is fixed to the default value, there is a limitation in expressing the three-dimensional effect for each of the objects. Hereinafter, a mobile terminal 100 and a control method thereof capable of separately imparting a stereoscopic effect to each of objects in a 3D image will be described with reference to the accompanying drawings.

In the present specification, the term "3D depth value" means an index representing a distance difference between objects included in the 3D image. Specifically, when the user views the object through the display unit 151, if the object appears in 2D, the 3D depth value of the object becomes "0 ". However, when the object is displayed in a 3D form, for example, when the object appears as protruding from the mobile terminal 100 with respect to the display unit 151, the 3D depth value of the object becomes negative, The 3D depth value of the object becomes a positive number.

That is, when the user views the objects included in the 3D image projected to the outside of the mobile terminal 100 with respect to the display unit 151, the absolute value of the 3D depth value expressed as a negative value Big.

Hereinafter, for convenience of explanation, when a user views objects included in a 3D image projected to the outside of the mobile terminal 100 on the basis of the display unit 151, the '3D depth value' Large ', and' object with distance 'is' 3D depth'. This is obvious to those skilled in the art to which the present invention belongs.

FIG. 3 is a flowchart illustrating a method of controlling the mobile terminal 100 (see FIG. 1) according to an embodiment of the present invention. The mobile terminal 100 may include a display unit 151 (see FIG. 1) and a control unit 180 (see FIG. 1). The display unit 151 may be configured to allow touch input.

Referring to FIG. 3, when a touch input is sensed on a 2D image displayed on a display unit (S110) and a touch input to a 2D image is sensed, a step of switching a 2D image to a 3D image (S120 ).

Specifically, when a touch input is sensed on the display unit 151, the controller 180 displays a plurality of objects based on the size, brightness, and saturation of each of a plurality of objects included in the 2D image, Can be distinguished. Accordingly, the 2D image can be converted to the 3D image.

The 3D image may be output in the form of a left eye image and a right eye image so that the 3D image can be recognized as a 3D image by a user. For example, the left eye image and the right eye image may be superimposed, or the left eye image and the right eye image may be alternately outputted. The 3D image may protrude to the outside of the mobile terminal 100 or enter the inside of the mobile terminal 100 based on the display unit 151.

Meanwhile, although not shown, the controller 180 may convert the 2D image into the 3D image based on the relationship between the background color included in the 2D image and the color of each object. For example, when the background color and the color of the specific object are complementary color, the controller 180 may change the 3D depth value of the object so that the object is more emphasized when switching to the 3D image. In addition, when the colors of the background included in the 2D image are varied, the controller 180 may change the 3D depth value of the object to be smaller in order to improve the visibility of the user when switching to the 3D image.

In addition, although not shown, when a plurality of objects overlap in a 2D image, the controller 180 may recognize a plurality of objects as one object and convert them into a 3D image. In addition, when the 2D image includes more than a certain number of objects, the controller 180 can convert only a certain number of objects into a 3D form based on the order of sizes, brightness, or sharpness order of the objects.

Next, in step S130, the characteristic of each of the objects is changed based on the 3D depth value of each of the objects included in the 3D image. The characteristics of each of the objects may include at least one of the shape, size, and color of each of the objects.

Specifically, the control unit 180 may change the attribute information of each color of the objects based on the 3D depth values of the objects included in the 3D image. The attribute information of the color may include at least one of a color value, a brightness value, and a saturation value. The brightness value represents the degree of brightness of the color of the object, and the saturation value represents the degree of sharpness of the color of the object. The control unit 180 may change the color of each of the objects according to the changed information.

More specifically, the controller 180 may calculate an average 3D depth value of the objects using the 3D depth values of the objects included in the 3D image. Thereafter, the controller 180 may change the color of each of the objects based on the difference between the 3D depth value of each of the objects and the average 3D depth value.

For example, in a 3D image projected to the outside of the mobile terminal 100 on the basis of the display unit 151, the control unit 180 determines that the 3D depth value is an object larger than the average 3D depth value, The attribute information of the color of the object can be changed so that the brightness value and the saturation value of the object become larger. Likewise, the controller 180 may change the attribute information of the object color so that the 3D depth value is smaller than the average 3D depth value, i.e., the brightness value and the saturation value of the object at a distance.

Thereafter, the 3D image including the objects whose characteristics have been changed is displayed on the display unit 151 (S140). Accordingly, objects whose shape, size, and / or color is changed based on the 3D depth value can be displayed on the display unit 151. [

As described above, according to the present invention, as the characteristics of the objects included in the 3D image are changed, a stereoscopic effect is separately provided for each of the objects, so that the user can enjoy more realistic contents.

4A to 4C are conceptual diagrams showing an operation example of the mobile terminal 200 according to FIG. The mobile terminal 200 may include a display unit 251 and a control unit 180 (see FIG. 1).

Referring to FIG. 4A, a 2D image displayed on the display unit 251 may include a plurality of objects (hereinafter, referred to as 'first to third objects') 252 to 254.

4B, when the touch input to the 2D image is sensed, the control unit 180 converts the 2D image into the 3D image using the characteristic information of the first through third objects 252 through 254 You can switch. As described above, the controller 180 distinguishes the perspective of the first through third objects 252 through 254 based on the size, brightness, and saturation of each of the first through third objects 252 through 254, 2D images can be converted to 3D images.

The control unit 180 can change the characteristics of each of the first to third objects 252 to 254 based on the 3D depth values of the first to third objects 252 to 254 included in the 3D image .

As shown in the figure, in the 3D image projected to the outside of the mobile terminal 200 on the basis of the display unit 251, the controller 180 controls the brightness value or the saturation value of the first object 252, The attribute information of the color of the first object 252 can be changed so as to be larger. In addition, the controller 180 may change the color property information of the third object 254 so that the brightness value or the saturation value of the third object 254 displayed at a long distance becomes smaller.

Accordingly, the first object 252 may be changed to a brighter color or a brighter color and displayed on the display unit 251. In addition, the third object 254 may be changed to a darker or darker color and displayed on the display unit 251. [ Although not shown, when the control unit 180 changes color property information of the second object 253, the color of the second object 253 may be changed and displayed on the display unit 251. [

At this time, if the touch input to the 3D image is sensed, the controller 180 can switch the 3D image to the 2D image as shown in FIG. 4C.

The control unit 180 may display the first to third objects 252 to 254 in which the color attribute information is changed in the 2D image on the display unit 151. [ Accordingly, unlike the 2D image shown in FIG. 4A, the first through third objects 252 through 254 included in the 2D image shown in FIG. 4C can clearly reveal differences in brightness or sharpness of colors.

5A and 5B are conceptual diagrams showing an operation example of the mobile terminal 200 according to FIG. The mobile terminal 200 may include a display unit 251 and a control unit 180 (see FIG. 1).

Referring to FIG. 5A, a 2D image displayed on the display unit 251 may include a plurality of objects (hereinafter referred to as 'first to third objects') 252 to 254.

5B, when the touch input to the 2D image is sensed, the control unit 180 converts the 2D image into the 3D image using the characteristic information of the first through third objects 252 through 254 And change the characteristics of each of the first to third objects 252 to 254 based on the 3D depth values of the first to third objects 252 to 254 included in the 3D image.

As shown in the figure, in the 3D image projected to the outside of the mobile terminal 200 on the basis of the display unit 251, the controller 180 controls the size of the first object 252 1 object 252 can be changed. In addition, the controller 180 may change the property information of the third object 254 so that the size of the third object 254 displayed at a long distance becomes smaller.

Accordingly, the first object 252 can be displayed on the display unit 251 in a larger size. Also, the third object 254 may be displayed on the display unit 251 in a smaller size. Although not shown, when the control unit 180 changes the property information of the second object 253, the size of the second object 253 may be changed and displayed on the display unit 251. [

On the other hand, although not shown, the control unit 180 determines the shape of each of the first to third objects 252 to 254 based on the 3D depth values of the first to third objects 252 to 254 It can also be changed.

FIG. 6 is a flow chart for explaining a control method of the mobile terminal 100 (see FIG. 1) according to another embodiment of the present invention. The mobile terminal 100 may include a display unit 151 (see FIG. 1) and a control unit 180 (see FIG. 1). The display unit 151 may be configured to allow touch input.

Referring to FIG. 6, a touch input is sensed for at least one of objects displayed on the display unit 151 (S210), and when an object touch input is detected, the object is divided into a plurality of regions (S220).

Specifically, various colors may be displayed on the object. The control unit 180 may divide the object into a plurality of regions based on attribute information of colors displayed on the object. Here, the attribute information of the colors may include at least one of a hue value, a brightness value, and a saturation value.

Next, in step S230, the 3D depth value of each of the plurality of areas is changed based on the color attribute information of each of the plurality of areas.

Specifically, the control unit 180 divides the perspective of each of a plurality of regions included in one object based on the hue, brightness, and saturation of each of the plurality of regions, thereby changing the 3D depth value of each of the plurality of regions .

Thereafter, a step S240 is performed in which the object including the areas in which the 3D depth value is changed is displayed on the display unit 151.

Meanwhile, although not shown, the control unit 180 may adjust the 3D depth value of the objects based on the number of objects displayed on the display unit 151. That is, when the number of objects is large, the 3D image of the 3D image projected to the outside of the mobile terminal 100 on the basis of the display unit 151, Can be changed to be smaller. In addition, if the number of objects is small, the controller 180 may change the 3D depth value of the objects to be larger so that the objects are closer to each other.

Also, although not shown, when the controller 180 converts only 3D objects of some of the objects included in the 2D image, all the objects are converted to 3D, You can change it bigger.

As described above, according to the present invention, the 3D depth value of each of a plurality of areas included in one object is changed and displayed on the display unit 151, so that the user can feel a 3D stereoscopic effect on one object .

FIGS. 7A and 7B are conceptual diagrams showing an operation example of the mobile terminal 200 according to FIG. The mobile terminal 200 may include a display unit 251 and a control unit 180 (see FIG. 1).

Referring to FIG. 7A, a 2D image displayed on the display unit 251 may include a plurality of objects (hereinafter, referred to as 'first and second objects') 255 and 256.

7B, when the touch input to the first object 255 is sensed, the control unit 180 generates 2D images using characteristic information of the first and second objects 255 and 256, You can switch to 3D video.

On the other hand, the controller 180 determines whether the first object 255 is divided into a plurality of regions (hereinafter, referred to as 'first and second regions') based on the color attribute information of the first object 255 included in the 3D image (255a, 255b). The controller 180 may change the 3D depth values of the first and second areas 255a and 255b based on the color attribute information of the first and second areas 255a and 255b .

For example, as shown, the controller 180 may change the 3D depth value of the first area 255a such that the first area 255a with a higher brightness and saturation is closer to the second area 255b have. In addition, the controller 180 may change the 3D depth value of the second area 255b such that the second area 255b having a lower brightness and saturation is distant from the first area 255a.

FIG. 8 is a flowchart illustrating a method of controlling the mobile terminal 100 (see FIG. 1) according to another embodiment of the present invention. The mobile terminal 100 may include a display unit 151 (see FIG. 1) and a control unit 180 (see FIG. 1). The display unit 151 may be configured to allow touch input.

Referring to FIG. 8, at step S310, a touch input is sensed for at least one of the objects included in the 3D image, and a step S320 is performed for detecting a touch degree.

Specifically, the controller 180 may detect a degree of touching the object when sensing a touch input to at least one of the objects included in the 3D image. The control unit 180 may detect at least one of the change in the touch operation and the duration of the touch operation from the start of the touch input to the release of the object to determine the degree of touching.

Here, the extent to which the touch is applied may be the time the touch was held, the number of times it was touched, and the length of the drag, and may be a distance value between the first and second touch points upon detection of the multi-touch input.

Thereafter, in step S330, the 3D depth value of the object is changed according to the extent to which the touch is applied.

Specifically, the control unit 180 can calculate the 3D depth value to be changed based on the degree of touching. Then, the control unit 180 can change the 3D depth value of the object based on the calculation result.

Next, in step S340, the object whose 3D depth value has been changed is displayed on the display unit 151 is proceeded.

As described above, according to the present invention, a 3D depth value of an object included in a 3D image is changed based on a touch input, so that a user can enjoy a 3D image more stereoscopically by adjusting a stereoscopic effect according to a viewing angle and a viewing environment .

FIGS. 9A, 9B, 10A and 10B are conceptual diagrams showing operational examples of the mobile terminal 200 according to FIG. The mobile terminal 200 may include a display unit 251, a sensing unit 140 (see FIG. 1), and a control unit 180 (see FIG. 1).

Referring to FIG. 9A, a plurality of objects (hereinafter referred to as 'first and second objects') 257 and 258 may be included in the 3D image displayed on the display unit 251.

The sensing unit 140 may sense a two-dimensional position of the sensing object, for example, a position on a plane parallel to the mobile terminal 200. In addition, the sensing unit 140 may sense a position including a three-dimensional position of the sensing object, for example, a vertical distance of the mobile terminal 200. Accordingly, the sensing unit 140 may sense a touch input to the first object 257. [

The control unit 180 may perform a work on the control command corresponding to the touch input. As shown, when a user drags the first object 257 in a first direction (from down to down), a control command to change the 3D depth value of the first object 257 is sensed .

Although the drawing shows the case where a drag gesture is detected by a touch input to the first object 257, the kind of touch input to the first object 257 is not limited thereto. For example, when a single tap gesture, a double tap gesture, a flick gesture, a pinch-in or a pinch-out gesture is detected A control command for changing the 3D depth value of the first object 257 can also be sensed.

9B, the control unit 180 may change the 3D depth value of the first object 257 in response to the control command. That is, the controller 180 controls the first object 257 so that the first object 257 can be seen more closely in the 3D image projected to the outside of the mobile terminal 200 on the basis of the display unit 251, The 3D depth value of the image can be changed to a larger value.

Referring to FIG. 10A, when a user drags a first object 257 in a second direction (downward to upward direction), a control command for changing the 3D depth value of the first object 257 is detected .

10B, the controller 180 may change the 3D depth value of the first object 257 in response to the control command. That is, in the 3D image projected to the outside of the mobile terminal 200 on the basis of the display unit 251, the controller 180 controls the first object 257 so that the first object 257 is seen more distantly, Can be changed to a smaller value.

Further, according to the embodiment disclosed herein, the above-described method can be implemented as a code that can be read by a processor on a medium on which the program is recorded. Examples of the medium that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and may be implemented in the form of a carrier wave (e.g., transmission over the Internet) .

The mobile terminal described above can be applied to not only the configuration and method of the embodiments described above but also all or some of the embodiments may be selectively combined so that various modifications may be made to the embodiments It is possible.

Claims (15)

A display unit configured to perform a touch input and configured to display a 2D image including a plurality of objects; And
When the touch input to the 2D image is sensed, the 2D image is converted into a 3D image, and the characteristics of each of the objects are changed based on the 3D depth value of each of the objects included in the 3D image And a controller for displaying the 3D image including the objects whose characteristics have been changed on the display unit,
Wherein,
Wherein when a touch input applied to a first object among the objects whose characteristics have been changed is dragged in a first direction, a 3D depth value of the first object is increased, and a touch input applied to a second object of the plurality of objects Direction of the second object, the 3D depth value of the second object is reduced and displayed. The method according to claim 1,
Wherein,
Calculating an average 3D depth value of the objects using the 3D depth values of each of the objects,
And changes the characteristic of each of the objects based on a difference between the 3D depth value and the average 3D depth value of each of the objects. [Claim 3 is abandoned upon payment of the registration fee.] 3. The method of claim 2,
Wherein characteristics of each of the objects include at least one of a shape, a size, and a color of each of the objects. [Claim 4 is abandoned upon payment of the registration fee.] The method of claim 3,
Wherein,
Changing an attribute of color information of each of the objects based on the 3D depth value of each of the objects included in the 3D image and changing the color of each of the objects according to the changed information And the mobile terminal. [Claim 5 is abandoned upon payment of registration fee.] 5. The method of claim 4,
Wherein the attribute information of the color includes at least one of a color value, a brightness value, and a saturation value. [Claim 6 is abandoned due to the registration fee.] 6. The method of claim 5,
Wherein,
And a controller for switching the 3D image to the 2D image when the touch input to the 3D image is sensed and displaying the changed objects in the 2D image on the display unit. The method according to claim 1,
Wherein,
Wherein when the touch input is detected for at least one of the objects, the 3D depth value of each of the plurality of areas is changed based on the characteristics of the plurality of areas included in the detected object, To the mobile terminal. [8] has been abandoned due to the registration fee. 8. The method of claim 7,
Wherein,
Dividing the object into a plurality of regions based on attribute information of colors displayed in the object and changing the 3D depth value of each of the plurality of regions based on color attribute information of each of the plurality of regions The mobile terminal comprising: The method according to claim 1,
Wherein,
When a touch input for at least one of the objects included in the 3D image is sensed, the 3D depth value of the object sensed by the touch input is changed and the object having the 3D depth value changed is displayed on the display unit The mobile terminal comprising: 10. The method of claim 9,
Wherein,
And detects a degree of touching the object when the touch input is sensed, and changes the 3D depth value of the object according to the degree of the touch. [Claim 11 is abandoned upon payment of the registration fee.] 11. The method of claim 10,
Wherein,
Wherein the controller determines at least one of a change in the touch operation and a duration of the touch input to the object from the start of the touch input to the release of the touch input. A method of controlling a mobile terminal including a display unit configured to display a 2D image including a plurality of objects, the method comprising:
Converting the 2D image into a 3D image when a touch input to the 2D image is sensed;
Changing properties of each of the objects based on a 3D depth value of each of the objects included in the 3D image; And
Displaying the 3D image including the objects whose characteristics have been changed on the display unit; And
When a touch input applied to a first object among the objects whose characteristics have been changed is dragged in a first direction, a 3D depth value of the first object is increased, and a touch input applied to a second object of the plurality of objects And decreasing a 3D depth value of the second object when the second object is dragged in a second direction different from the first direction. 13. The method of claim 12,
Wherein changing properties of each of the objects comprises:
Calculating an average 3D depth value of the objects using the 3D depth values of each of the objects; And
And changing the characteristic of each of the objects based on a difference between the 3D depth value and the average 3D depth value of each of the objects. 13. The method of claim 12,
Dividing the object into a plurality of regions based on the attribute information of the colors displayed on the object where the touch input is sensed when a touch input to at least one of the objects is sensed;
Changing a 3D depth value of each of the plurality of areas based on color property information of each of the plurality of areas; And
And displaying the object including the changed 3D depth values on the display unit. 13. The method of claim 12,
Detecting a degree of touching the object when at least one of the objects included in the 3D image is sensed; And
Further comprising changing a 3D depth value of the object according to a degree of the touch applied to the object.

Images