KR20170086947A - Mobile terminal and method for controlling the same - Google Patents

Abstract

A control method for a mobile terminal and a mobile terminal is disclosed. The present invention relates to a transparent display and an application execution screen displayed on a front surface of the transparent display, and when a first touch input applied to a first area on the rear surface of the transparent display is sensed, And a control unit for confirming a second area on the front surface of the display and displaying an object on the front of the transparent display for executing a function set to correspond to the confirmed second area. According to the present invention, when an application is executed in a mobile terminal having a transparent display, different functions can be performed depending on whether the same area of the application execution screen is touched at the front or back.

Description

[0001] MOBILE TERMINAL AND METHOD FOR CONTROLLING THE SAME [0002]

The present invention relates to a mobile terminal having a transparent display and a control method thereof.

With the evolution of display technology, there is a continuing discussion of next generation display devices such as electronic devices having transparent displays.

Transparent displays have a transparent nature so that the background of the display is reflected directly on the display. Conventionally, a display panel is fabricated using an opaque semiconductor compound such as silicon (Si), gallium arsenide (GaAs), or the like. However, various application fields that can not be covered by conventional display panels have been developed. Is accelerating.

An apparatus having a transparent display is realized in a form including a transparent oxide semiconductor film, and has a transparent property. When a device having a transparent display is used, the user can view necessary information on the transparent display device screen while viewing the object located on the rear side of the device through the transparent display device. Therefore, it is possible to extend the utilization beyond the spatial and temporal limitations of the conventional display device.

Apparatus with Transparent Display Because it can be used in various environments for various purposes, development of a user interface that can more effectively utilize a transparent display is required. As a part of this, when a web browser or the like is used through a transparent display, it is necessary to develop a user interface that can facilitate the user's convenience.

The present invention is directed to solving the above-mentioned problems and other problems. Another object of the present invention is to provide a mobile terminal and a control method thereof that enable different functions to be performed depending on whether the same area of an application execution screen is touched on the front or rear side when an application is executed in a mobile terminal having a transparent display The purpose of that is to do.

According to an aspect of the present invention, there is provided a display device including a transparent display and an execution screen of an application on a front surface of the transparent display and displaying a first touch input applied to a first area on a rear surface of the transparent display, A control unit for confirming a second area on the front surface of the transparent display corresponding to the first area and displaying an object for performing functions set to correspond to the second area identified on the front of the transparent display The present invention provides a mobile terminal including the mobile terminal.

The object may include a pop-up window displaying a thumbnail corresponding to a page displayed on the execution screen and a thumbnail corresponding to a page displayed on the execution screen, and the control unit may include an input for selecting a first thumbnail among the thumbnails displayed on the pop- A page corresponding to the first thumbnail may be displayed on the execution screen.

The control unit may remove the second thumbnail from the pop-up window upon receiving an input for moving a second thumbnail of the thumbnails displayed in the pop-up window out of the pop-up window.

Wherein the control unit displays thumbnails corresponding to the pages displayed on the execution screen among the thumbnails displayed on the pop-up window so as to be distinguished from other thumbnails, and when receiving touch input on the back surface of the transparent display, The thumbnail corresponding to the next page of the thumbnail displayed to be distinguished from other thumbnails may be displayed when the touch input to the front of the transparent display is received.

The object may include an item for setting an area to be enlarged and displayed on the execution screen, and the control unit may display a pop-up window enlarged on the area of the page corresponding to the item on the execution screen, When the size of the item is adjusted, the enlarged area of the pop-up window may be adjusted to correspond to the size of the item.

The controller may change the position of the item according to the movement of the first touch input and change the enlarged area to correspond to the position of the item in the pop-up window.

The control unit may change the position of the item according to the movement of the second touch input in the pop-up window, and may change the enlarged display area to correspond to the position of the item.

The object may include a thumbnail of a page corresponding to a link included in the second area, and the controller may move the thumbnail to one of the indicators displayed on the execution screen according to the movement of the first touch input, The user can display the page on the execution screen or display the page on a new execution screen of the application or register the page as a bookmark according to the indicator on which the thumbnail is moved.

The control unit may display a menu for sharing a page corresponding to the link upon receiving a predetermined input for the thumbnail.

According to another aspect of the present invention, there is provided a method of displaying an application, the method comprising the steps of: displaying an application execution screen on a front surface of a transparent display; sensing a first touch input applied to a first area on a rear surface of the transparent display; And displaying an object for performing a function set to correspond to the identified second area on the front side of the transparent display, the method comprising the steps of: .

Effects of the mobile terminal and the control method according to the present invention will be described as follows.

According to at least one of the embodiments of the present invention, when the application is executed in the mobile terminal having the transparent display, different functions are performed depending on whether the same area of the application execution screen is touched at the front or back, The advantage is that various functions can be performed by a simple touch input on the display.

In addition, according to at least one embodiment of the present invention, when a touch input is applied to the rear of a page movement area, a pop-up window displaying a thumbnail of a displayed page is displayed, thereby making it possible to conveniently move to a desired page.

In addition, according to at least one of the embodiments of the present invention, the thumbnail list of the displayed page can be easily edited by deleting the thumbnail moved out of the pop-up window displaying the thumbnail of the displayed page.

In addition, according to at least one embodiment of the present invention, a thumbnail corresponding to a page can be easily selected by displaying a thumbnail corresponding to the page according to a touch input to the front or rear surface of the transparent display .

In addition, according to at least one embodiment of the present invention, when an area set for enlargement display is touched at the rear side, an item for setting an area to be enlarged is displayed so that one area of the displayed page is enlarged There is an advantage that it can be confirmed.

In addition, according to at least one of the embodiments of the present invention, by moving an item for setting an area to be enlarged according to the movement of the touch input on the rear surface of the transparent display, it is possible to easily select an area to be enlarged .

According to at least one embodiment of the present invention, an area to be enlarged is easily selected by changing the position of an area to be enlarged according to a touch input in a pop-up window where an area of a page is enlarged.

According to at least one embodiment of the present invention, when a rear touch is applied to an area including link information, a thumbnail of a page corresponding to link information is displayed, and a function set in an indicator in which a thumbnail is moved is performed, It is advantageous that the function according to the link information can be performed only by inputting.

In addition, according to at least one embodiment of the present invention, a menu for sharing a page corresponding to a link is displayed according to an input for a thumbnail, so that it is possible to easily share a page corresponding to a link with a simple touch input have.

Further scope of applicability of the present invention will become apparent from the following detailed description. It should be understood, however, that the detailed description and specific examples, such as the preferred embodiments of the invention, are given by way of illustration only, since various changes and modifications within the spirit and scope of the invention will become apparent to those skilled in the art.

1 is a block diagram illustrating a mobile terminal according to the present invention.
2A to 2C are conceptual diagrams showing an example of a mobile terminal related to the present invention, from different directions.
3 is a flowchart illustrating a method of controlling a mobile terminal according to an exemplary embodiment of the present invention.
4 is a view for explaining a first area and a second area in a transparent display according to an embodiment of the present invention.
5 is a flowchart illustrating a method of moving a page using a pop-up window displaying a thumbnail corresponding to a page according to an exemplary embodiment of the present invention.
FIGS. 6 to 11 are diagrams for explaining a function of moving a page using a pop-up window in which a thumbnail corresponding to a page is displayed according to an embodiment of the present invention.
FIG. 12 is a flowchart of a method of enlarging and displaying an area on a pop-up window using an item for setting an area to be enlarged among pages according to an embodiment of the present invention.
FIGS. 13 to 16 are views for explaining enlargement and display of an area on a pop-up window by using an item for setting an area to be enlarged among pages according to an embodiment of the present invention.
17 is a flowchart of a method of executing a function set in an indicator using a thumbnail of a page corresponding to a link according to an embodiment of the present invention.
18 to 22 illustrate execution of a function set in an indicator by using a thumbnail of a page corresponding to a link according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. , ≪ / RTI > equivalents, and alternatives.

Terms including ordinals, such as first, second, etc., may be used to describe various elements, but the elements are not limited to these terms. The terms are used only for the purpose of distinguishing one component from another.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The singular expressions include plural expressions unless the context clearly dictates otherwise.

In the present application, the terms "comprises", "having", and the like are used to specify that a feature, a number, a step, an operation, an element, a component, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

The mobile terminal described in this specification includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, a slate PC A tablet PC, an ultrabook, a wearable device such as a smartwatch, a smart glass, and a head mounted display (HMD). have.

However, it will be appreciated by those skilled in the art that the configuration according to the embodiments described herein may be applied to fixed terminals such as a digital TV, a desktop computer, a digital signage, and the like, will be.

Referring to FIG. 1, FIG. 1 is a block diagram illustrating a mobile terminal according to the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an input unit 120, a sensing unit 140, an output unit 150, an interface unit 160, a memory 170, a control unit 180, and a power supply unit 190 ), And the like. The components shown in FIG. 1 are not essential for implementing a mobile terminal, so that the mobile terminal described herein may have more or fewer components than the components listed above.

The wireless communication unit 110 may be connected between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and another mobile terminal 100 or between the mobile terminal 100 and the external server 100. [ Lt; RTI ID = 0.0 > wireless < / RTI > In addition, the wireless communication unit 110 may include one or more modules for connecting the mobile terminal 100 to one or more networks.

The wireless communication unit 110 may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short distance communication module 114, and a location information module 115 .

The input unit 120 includes a camera 121 or an image input unit for inputting a video signal, a microphone 122 for inputting an audio signal, an audio input unit, a user input unit 123 for receiving information from a user A touch key, a mechanical key, and the like). The voice data or image data collected by the input unit 120 may be analyzed and processed by a user's control command.

The sensing unit 140 may include at least one sensor for sensing at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information. For example, the sensing unit 140 may include a proximity sensor 141, an illumination sensor 142, a touch sensor, an acceleration sensor, a magnetic sensor, A G-sensor, a gyroscope sensor, a motion sensor, an RGB sensor, an infrared sensor, a finger scan sensor, an ultrasonic sensor, A microphone 226, a battery gauge, an environmental sensor (for example, a barometer, a hygrometer, a thermometer, a radiation detection sensor, A thermal sensor, a gas sensor, etc.), a chemical sensor (e.g., an electronic nose, a healthcare sensor, a biometric sensor, etc.). Meanwhile, the mobile terminal disclosed in the present specification can combine and utilize information sensed by at least two of the sensors.

The output unit 150 includes at least one of a display unit 151, an acoustic output unit 152, a haptic tip module 153, and a light output unit 154 to generate an output related to visual, auditory, can do. The display unit 151 may have a mutual layer structure with the touch sensor or may be integrally formed to realize a touch screen. The touch screen may function as a user input unit 123 that provides an input interface between the mobile terminal 100 and a user and may provide an output interface between the mobile terminal 100 and a user.

The interface unit 160 serves as a path to various types of external devices connected to the mobile terminal 100. The interface unit 160 is connected to a device having a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, And may include at least one of a port, an audio I / O port, a video I / O port, and an earphone port. In the mobile terminal 100, corresponding to the connection of the external device to the interface unit 160, it is possible to perform appropriate control related to the connected external device.

In addition, the memory 170 stores data supporting various functions of the mobile terminal 100. The memory 170 may store a plurality of application programs or applications running on the mobile terminal 100, data for operation of the mobile terminal 100, and commands. At least some of these applications may be downloaded from an external server via wireless communication. Also, at least a part of these application programs may exist on the mobile terminal 100 from the time of shipment for the basic functions (e.g., telephone call receiving function, message receiving function, and calling function) of the mobile terminal 100. Meanwhile, the application program may be stored in the memory 170, installed on the mobile terminal 100, and may be operated by the control unit 180 to perform the operation (or function) of the mobile terminal.

In addition to the operations related to the application program, the control unit 180 typically controls the overall operation of the mobile terminal 100. The control unit 180 may process or process signals, data, information, and the like input or output through the above-mentioned components, or may drive an application program stored in the memory 170 to provide or process appropriate information or functions to the user.

In addition, the controller 180 may control at least some of the components illustrated in FIG. 1 in order to drive an application program stored in the memory 170. In addition, the controller 180 may operate at least two of the components included in the mobile terminal 100 in combination with each other for driving the application program.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power to the components included in the mobile terminal 100. The power supply unit 190 includes a battery, which may be an internal battery or a replaceable battery.

At least some of the components may operate in cooperation with one another to implement a method of operation, control, or control of a mobile terminal according to various embodiments described below. In addition, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 170. [

Hereinafter, the components listed above will be described in more detail with reference to FIG. 1 before explaining various embodiments implemented through the mobile terminal 100 as described above.

First, referring to the wireless communication unit 110, the broadcast receiving module 111 of the wireless communication unit 110 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The mobile communication module 112 may be a mobile communication module or a mobile communication module such as a mobile communication module or a mobile communication module that uses technology standards or a communication method (e.g., Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution And an external terminal, or a server on a mobile communication network established according to a long term evolution (AR), a long term evolution (AR), or the like.

The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. The wireless Internet module 113 is configured to transmit and receive a wireless signal in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, wireless LAN (WLAN), wireless fidelity (Wi-Fi), wireless fidelity (Wi-Fi) Direct, DLNA (Digital Living Network Alliance), WiBro Interoperability for Microwave Access, High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE) and Long Term Evolution-Advanced (LTE-A) 113 transmit and receive data according to at least one wireless Internet technology, including Internet technologies not listed above.

The wireless Internet module 113 for performing a wireless Internet connection through the mobile communication network can be used for wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE or LTE- May be understood as a kind of the mobile communication module 112.

The short-range communication module 114 is for short-range communication, and includes Bluetooth ™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB) (Near field communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, Wireless USB (Universal Serial Bus) and MST (Magnetic Secure Transmission) The short-range communication module 114 is connected to the mobile terminal 100 and the wireless communication system through the wireless area networks, between the mobile terminal 100 and another mobile terminal 100, or between the mobile terminal 100 ) And the other mobile terminal 100 (or the external server). The short-range wireless communication network may be a short-range wireless personal area network.

Here, the other mobile terminal 100 may be a wearable device (e.g., a smartwatch, a smart glass, etc.) capable of interchanging data with the mobile terminal 100 according to the present invention (smart glass), HMD (head mounted display)). The short range communication module 114 may detect (or recognize) a wearable device capable of communicating with the mobile terminal 100 around the mobile terminal 100. [ If the detected wearable device is a device authenticated to communicate with the mobile terminal 100 according to the present invention, the control unit 180 may transmit at least a part of the data processed by the mobile terminal 100 to the short- 114 to the wearable device. Therefore, the user of the wearable device can use the data processed by the mobile terminal 100 through the wearable device. For example, according to this, when a telephone is received in the mobile terminal 100, the user performs a telephone conversation via the wearable device, or when a message is received in the mobile terminal 100, It is possible to check the message.

The position information module 115 is a module for obtaining the position (or current position) of the mobile terminal, and a representative example thereof is a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, when the mobile terminal utilizes the GPS module, it can acquire the position of the mobile terminal by using a signal transmitted from the GPS satellite. As another example, when the mobile terminal utilizes the Wi-Fi module, it can acquire the position of the mobile terminal based on information of a wireless access point (AP) that transmits or receives the wireless signal with the Wi-Fi module. Optionally, the location information module 115 may perform any of the other functions of the wireless communication unit 110 to obtain data relating to the location of the mobile terminal, in addition or alternatively. The location information module 115 is a module used to obtain the location (or current location) of the mobile terminal, and is not limited to a module that directly calculates or obtains the location of the mobile terminal.

Next, the input unit 120 is for inputting image information (or signal), audio information (or signal), data, or information input from a user. For inputting image information, Or a plurality of cameras 121 may be provided. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame may be displayed on the display unit 151 or stored in the memory 170. [ A plurality of cameras 121 provided in the mobile terminal 100 may be arranged to have a matrix structure and various angles or foci may be provided to the mobile terminal 100 through the camera 121 having the matrix structure A plurality of pieces of image information can be input. In addition, the plurality of cameras 121 may be arranged in a stereo structure to acquire a left image and a right image for realizing a stereoscopic image.

The microphone 122 processes the external acoustic signal into electrical voice data. The processed voice data can be utilized variously according to a function (or a running application program) being executed in the mobile terminal 100. Meanwhile, the microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in receiving an external sound signal.

The user input unit 123 is for receiving information from a user and when the information is inputted through the user input unit 123, the control unit 180 can control the operation of the mobile terminal 100 to correspond to the input information . The user input unit 123 may include a mechanical input means (or a mechanical key such as a button located on the front, rear or side of the mobile terminal 100, a dome switch, a jog wheel, Jog switches, etc.) and touch-type input means. For example, the touch-type input means may comprise a virtual key, a soft key or a visual key displayed on the touch screen through software processing, And a touch key disposed on the touch panel. Meanwhile, the virtual key or the visual key can be displayed on a touch screen having various forms, for example, a graphic, a text, an icon, a video, As shown in FIG.

Meanwhile, the sensing unit 140 senses at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information, and generates a corresponding sensing signal. The control unit 180 may control the driving or operation of the mobile terminal 100 or may perform data processing, function or operation related to the application program installed in the mobile terminal 100 based on the sensing signal. Representative sensors among various sensors that may be included in the sensing unit 140 will be described in more detail.

First, the proximity sensor 141 refers to a sensor that detects the presence of an object approaching a predetermined detection surface, or the presence of an object in the vicinity of the detection surface, without mechanical contact by using electromagnetic force or infrared rays. The proximity sensor 141 may be disposed in the inner area of the mobile terminal or in proximity to the touch screen, which is covered by the touch screen.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. In the case where the touch screen is electrostatic, the proximity sensor 141 can be configured to detect the proximity of the object with a change of the electric field along the proximity of the object having conductivity. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of explanation, the act of recognizing that the object is located on the touch screen in proximity with no object touching the touch screen is referred to as "proximity touch & The act of actually touching an object on the screen is called a "contact touch. &Quot; The position at which the object is closely touched on the touch screen means a position where the object corresponds to the touch screen vertically when the object is touched. The proximity sensor 141 can detect a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, have. Meanwhile, the control unit 180 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern sensed through the proximity sensor 141 as described above, and further provides visual information corresponding to the processed data It can be output on the touch screen. Furthermore, the control unit 180 can control the mobile terminal 100 such that different operations or data (or information) are processed according to whether the touch to the same point on the touch screen is a proximity touch or a touch touch .

The touch sensor uses a touch (or touch input) applied to the touch screen (or the display unit 151) by using at least one of various touch methods such as a resistance film type, a capacitive type, an infrared type, an ultrasonic type, Detection.

For example, the touch sensor may be configured to convert a change in a pressure applied to a specific portion of the touch screen or a capacitance generated in a specific portion to an electrical input signal. The touch sensor may be configured to detect a position, an area, a pressure at the time of touch, a capacitance at the time of touch, and the like where a touch object touching the touch screen is touched on the touch sensor. Here, the touch object may be a finger, a touch pen, a stylus pen, a pointer, or the like as an object to which a touch is applied to the touch sensor.

Thus, when there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like. Here, the touch controller may be a separate component from the control unit 180, and may be the control unit 180 itself.

On the other hand, the control unit 180 may perform different controls or perform the same control according to the type of the touch object touching the touch screen (or a touch key provided on the touch screen). Whether to perform different controls or to perform the same control according to the type of the touch object may be determined according to the current state of the mobile terminal 100 or an application program being executed.

On the other hand, the touch sensors and the proximity sensors discussed above can be used independently or in combination to provide a short touch (touch), a long touch, a multi touch, a drag touch ), Flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, and the like. Touch can be sensed.

The ultrasonic sensor can recognize the position information of the object to be sensed by using ultrasonic waves. Meanwhile, the controller 180 can calculate the position of the wave generating source through the information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave source can be calculated using the fact that the light is much faster than the ultrasonic wave, that is, the time when the light reaches the optical sensor is much faster than the time the ultrasonic wave reaches the ultrasonic sensor. More specifically, the position of the wave generating source can be calculated using the time difference with the time when the ultrasonic wave reaches the reference signal.

The camera 121 includes at least one of a camera sensor (for example, a CCD, a CMOS, etc.), a photo sensor (or an image sensor), and a laser sensor.

The camera 121 and the laser sensor may be combined with each other to sense a touch of the sensing object with respect to the three-dimensional stereoscopic image. The photosensor can be laminated to the display element, which is adapted to scan the movement of the object to be detected proximate to the touch screen. More specifically, the photosensor mounts photo diodes and TRs (Transistors) in a row / column and scans the contents loaded on the photosensor using an electrical signal that varies according to the amount of light applied to the photo diode. That is, the photo sensor performs coordinate calculation of the object to be sensed according to the amount of change of light, and position information of the object to be sensed can be obtained through the calculation.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, the display unit 151 may display execution screen information of an application program driven by the mobile terminal 100 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information .

Also, the display unit 151 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

In the stereoscopic display unit, a three-dimensional display system such as a stereoscopic system (glasses system), an autostereoscopic system (no-glasses system), and a projection system (holographic system) can be applied.

The sound output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output unit 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 153 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 153 may be vibration. The intensity and pattern of the vibration generated in the haptic module 153 can be controlled by the user's selection or the setting of the control unit. For example, the haptic module 153 may synthesize and output different vibrations or sequentially output the vibrations.

In addition to vibration, the haptic module 153 may be configured to perform various functions such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 153 can transmit the tactile effect through the direct contact, and the tactile effect can be felt by the user through the muscles of the finger or arm. The haptic module 153 may include two or more haptic modules 153 according to the configuration of the mobile terminal 100.

The light output unit 154 outputs a signal for notifying the occurrence of an event using the light of the light source of the mobile terminal 100. Examples of events that occur in the mobile terminal 100 may include message reception, call signal reception, missed call, alarm, schedule notification, email reception, information reception through an application, and the like.

The signal output from the light output unit 154 is implemented as the mobile terminal emits light of a single color or a plurality of colors to the front or rear surface. The signal output may be terminated by the mobile terminal detecting the event confirmation of the user.

The interface unit 160 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 160 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data in the mobile terminal 100 to an external device. For example, a port for connecting a device equipped with a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, an audio I / O port, a video I / O port, an earphone port, and the like may be included in the interface unit 160.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM) A universal subscriber identity module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the interface unit 160. [

The interface unit 160 may be a path through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, And various command signals may be transmitted to the mobile terminal 100. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The memory 170 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 170 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 170 may be a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), a multimedia card micro type ), Card type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read memory, a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs the storage function of the memory 170 on the Internet.

Meanwhile, as described above, the control unit 180 controls the operations related to the application program and the general operation of the mobile terminal 100. [ For example, when the state of the mobile terminal meets a set condition, the control unit 180 can execute or release a lock state for restricting input of a user's control command to applications.

In addition, the control unit 180 performs control and processing related to voice communication, data communication, video call, or the like, or performs pattern recognition processing to recognize handwriting input or drawing input performed on the touch screen as characters and images, respectively . Further, the controller 180 may control any one or a plurality of the above-described components in order to implement various embodiments described below on the mobile terminal 100 according to the present invention.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components. The power supply unit 190 includes a battery, the battery may be an internal battery configured to be chargeable, and may be detachably coupled to the terminal body for charging or the like.

In addition, the power supply unit 190 may include a connection port, and the connection port may be configured as an example of an interface 160 through which an external charger for supplying power for charging the battery is electrically connected.

As another example, the power supply unit 190 may be configured to charge the battery in a wireless manner without using the connection port. In this case, the power supply unit 190 may use at least one of an inductive coupling method based on a magnetic induction phenomenon from an external wireless power transmission apparatus and a magnetic resonance coupling method based on an electromagnetic resonance phenomenon Power can be delivered.

In the following, various embodiments may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

Referring to FIGS. 2A to 2C, the mobile terminal 100 includes a bar-shaped terminal body. However, the present invention is not limited thereto and can be applied to various structures such as a folder type, a flip type, a slide type, a swing type, and a swivel type in which a watch type, a clip type, a glass type or two or more bodies are relatively movably coupled . A description of a particular type of mobile terminal, although relevant to a particular type of mobile terminal, is generally applicable to other types of mobile terminals.

Here, the terminal body can be understood as a concept of referring to the mobile terminal 100 as at least one aggregate.

The mobile terminal 100 according to an embodiment of the present invention includes a transparent display 151, a first housing 101 that supports the transparent display 151 at the upper and lower ends of the transparent display 151, And may include a housing 103.

Since the transparent display 151 is to be projected on the rear side, the rear case may not be provided. Therefore, the transparent display 151 itself can form the appearance of the mobile terminal 100 together with the first housing 101 and the second housing 103. [

The transparent display 151 displays (outputs) information processed in the mobile terminal 100. For example, the transparent display 151 can display UI (User Interface) and GUI (Graphic User Interface) information according to execution screen information of an application program driven by the mobile terminal 100 or the execution screen information .

The transparent display 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED) display, a 3D display, and an e-ink display.

A representative example of the transparent display 151 is TOLED (Transparent OLED) or the like. The rear structure of the transparent display 151 may also be of a light transmissive structure. With this structure, the user can see the object located behind the terminal body through the area occupied by the transparent display unit 151. [

In addition, the transparent display 151 may exist in two or more depending on the embodiment of the mobile terminal 100. [ In this case, the mobile terminal 100 may be provided with a plurality of display portions spaced apart from each other, disposed integrally with each other, or disposed on different surfaces.

Touch panels 151c and 151d may be provided on the front surface 151a and the rear surface 151b of the transparent display 151, respectively. A first touch panel 151c provided on the front surface of the transparent display 151 and a second touch panel 151d provided on the rear surface of the transparent display 151 may be used. That is, the user can view images both on the front and back sides of the transparent display 151, and the user touch input can also be done on both the front and back sides of the transparent display 151. [

Meanwhile, the transparent display 151 may include a touch sensor that senses a touch to the transparent display 151 so that a control command can be received by a touch method. When a touch is made to the transparent display 151, the touch sensor senses the touch, and the control unit 180 generates a control command corresponding to the touch based on the touch. The content input by the touch method may be a letter or a number, an instruction in various modes, a menu item which can be designated, and the like.

The touch sensor may be a metal wire formed in a film form having a touch pattern and disposed between the window and the display 151 on the back surface of the window or directly patterned on the back surface of the window. Alternatively, the touch sensor may be formed integrally with the transparent display. For example, the touch sensor may be disposed on a substrate of the display or inside the display.

As such, the transparent display 151 may form a touch screen with the touch sensor, in which case the touch screen may function as a user input 123 (see FIG. 1). In some cases, the touch screen may replace at least some of the functions of the operating unit.

Various electronic components may be disposed in the inner space formed in the first housing 101 and the second housing 103. The housings may be formed by injection molding a synthetic resin or may be formed of a metal such as stainless steel (STS), aluminum (Al), titanium (Ti), or the like.

The first housing 101 is provided with a second camera 121a, a proximity sensor 141, an illuminance sensor 142, an acoustic output unit 152, an optical output unit 142, an interface unit 160, . The second housing 103 may include a microphone 122, a power supply unit 191, and the like.

However, these configurations are not limited to this arrangement. These configurations may be excluded or replaced as needed, or placed on different planes. In addition, elements other than the above-described elements may be added to the first housing and the second housing to be disposed at appropriate positions.

The second camera 121a processes the still image or moving image frame obtained by the image sensor in the photographing mode or the video communication mode. The processed image frame can be displayed on the transparent display unit 151 and can be stored in the memory 170. [

The interface unit 160 is a path through which the mobile terminal 100 can be connected to an external device. For example, the interface unit 160 may include a connection terminal for connection with another device (for example, an earphone or an external speaker), a port for short-range communication (for example, an infrared port (IrDA Port), a Bluetooth port A wireless LAN port, or the like), or a power supply terminal for supplying power to the mobile terminal 100. The interface unit 160 may be implemented as a socket for receiving an external card such as a SIM (Subscriber Identification Module) or a UIM (User Identity Module) or a memory card for storing information.

On the other hand, in FIG. 2B, the first camera 121b may be disposed on the rear surface of the first housing 101. FIG. In this case, the first camera 121b has a photographing direction which is substantially opposite to that of the second camera 121a. The second camera 121a has low pixels so that it is easy to capture a face of a user in the case of a video call or the like and transmit the face to the other party. The first camera 121b does not directly transmit an image of a general object It is preferable to have a high pixel. The first camera 121b may include a plurality of lenses arranged along at least one line. The plurality of lenses may be arranged in a matrix form. Such a camera can be named an 'array camera'. When the first camera 121b is configured as an array camera, images can be taken in various ways using a plurality of lenses, and a better quality image can be obtained. Although not shown, a flash may be disposed adjacent to the first camera 121b, and the flash illuminates the subject when the first camera 121a photographs the subject.

The second housing 103 is provided with a power supply unit 190 (see FIG. 1A) for supplying power to the mobile terminal 100. The power supply unit 190 may include a battery 191 built in the terminal body or detachable from the outside of the terminal body.

The microphone 122 is configured to receive the user's voice, other sounds, and the like. The microphone 122 may be provided at a plurality of locations to receive stereophonic sound.

Meanwhile, although not shown, at least one antenna for wireless communication may be provided in either the first housing 101 or the second housing 103. The antenna may be embedded in the terminal housing. For example, the antenna constituting a part of the broadcast receiving module 111 (see FIG. 1A) may be configured to be able to be drawn out from the terminal housing. Alternatively, the antenna may be formed in a film type and attached to the inner surface of the second housing 103.

2C, when the first housing 101 and the second housing 103 are integrally formed with the side frames 105a and 105b, the side frames 105a and 105b including a conductive material And may be configured to function as an antenna.

The structure of the mobile terminal 100 having the appearance that the transparent display 151 is supported through the first housing 101 and the second housing 103 has been described with reference to FIGS. 2A and 2B . 2A and 2B, the upper surface of the transparent display 151 is supported by the first housing 101, the lower surface is supported by the second housing 103, and the transparent display 151 ) Have no support structure.

However, the present invention is not limited thereto. 2C, the first housing 101 and the second housing 103 are connected to each other by the side supports 105a and 105b to support one structure Can be achieved. The structure may serve as a side frame, and the transparent display 151 may be inserted into the side frame to form an appearance of the mobile terminal 100.

Although not shown, various operation units may be provided in the side frames 105a and 105b in FIG. 2C. The operation unit may include, for example, a unit for receiving a command such as a menu, a home key, a cancel, and a search. In addition, for example, the operation unit may adjust the size of sound output through the sound output unit, or a command to switch the touch display mode of the transparent display 151 to the image shooting mode.

2A to 2C, the transparent display 151 may have an external appearance that is supported only by the housing of either the first housing 101 or the second housing 103. [

In addition, the first housing 101 and the second housing 103 shown in FIGS. 2A and 2B can be implemented with a structure that can be attached to and detached from the transparent display 151. Accordingly, the use of the mobile terminal 100 can be simplified so that only a desired function is realized through the transparent display 151 according to the type of the electronic part included in the first housing 101 or the second housing 103 .

2A, a first camera 121a is provided on the front surface of the first housing 101 and a second camera 121b is provided on the rear surface of the first housing 101. Thus, The user can use the mobile terminal 100 in a state where only the first housing 101 is detached by detaching the second housing 103 from the transparent display 151. [ In a case where various mobile communication modules are provided in the second housing 103 and the first housing 101 is detached from the transparent display 151 and the mobile terminal 100 ) May be used.

Hereinafter, embodiments related to a control method that can be implemented in a mobile terminal configured as above will be described with reference to the accompanying drawings. It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

3 is a flowchart illustrating a method of controlling a mobile terminal according to an exemplary embodiment of the present invention. 4 is a view for explaining a first area and a second area in a transparent display according to an embodiment of the present invention.

The method of controlling a mobile terminal according to an embodiment of the present invention can be implemented in the mobile terminal 100 described with reference to FIGS. 1 to 2C. Hereinafter, a method of controlling a mobile terminal according to an exemplary embodiment of the present invention and an operation of the mobile terminal 100 for implementing the method will be described in detail with reference to the accompanying drawings.

Referring to FIG. 3, the controller 180 may display an application execution screen on the front of the transparent display (S100).

FIG. 4 (a) shows a user holding a mobile terminal 100 provided with a transparent display 151. 4 (a), the user's hand is shown in dotted lines in the transparent display 151 area. This means that the user's hands are visible through the transparent display 151, and the same applies to the following drawings.

When the user executes a specific application, the control unit 180 can display an execution screen of the application on the transparent display 151. [ According to one example, the application may include, but is not limited to, a web browser. The application may be an application that can be executed in the mobile terminal 100, regardless of the type or name, as long as the following contents can be applied.

Referring again to FIG. 3, the controller 180 may sense the first touch input applied to the first area on the rear side of the transparent display [S110].

FIG. 4B is a perspective view of the transparent display 151. FIG. As described above with reference to FIGS. 2A to 2C, the user can see a hand, which is an object behind the transparent display 151, as the execution screen. The user can apply the touch input to the rear surface 151b of the transparent display while viewing the execution screen displayed on the front surface 151a of the transparent display. In this case, the user may apply the touch input within any first region 10 of the rear surface 151b of the transparent display.

Referring back to FIG. 3, the controller 180 can identify a second area on the front surface of the transparent display corresponding to the first area [S120].

Referring to FIG. 4 (b), the second region 20 may be a region of the transparent display front surface 151a corresponding to the first region 10. Accordingly, the user can touch the back surface of the second area 20 while viewing the second area 20 displayed on the front surface 151a of the transparent display to apply the touch input to the first area 10. [

The controller 180 can recognize the corresponding second area 20 when the first area 10 is touched. According to one example, identifying the second area 20 may mean determining whether a particular function is set in relation to an execution view of the application displayed on the front surface 151a of the transparent display.

For example, it is assumed that the second area 20 is a region in which a function related to page movement of the execution screen is set. A backward indicator and a foreward indicator for displaying previous or subsequent pages of the page currently displayed on the execution screen may be displayed in the second region 20. [ If the user touches the backward indicator or the forward indicator of the second area 20, the controller 180 may display the previous or subsequent page of the page currently displayed on the execution screen.

In this case, the function of the second region 20 performed in accordance with the touch of the first region 10 may be set to another function related to page movement. When the user touches the back surface of the second area 20 displayed with the backward indicator and the forward indicator, the control unit 180 may display a pop-up window including a thumbnail corresponding to the page displayed on the execution screen. When the user selects one of the thumbnails included in the pop-up window, the controller 180 can move to a page corresponding to the selected thumbnail.

According to an example, information on the functions corresponding to the front touch and the rear touch on the second area 20 may be stored in the memory 170. FIG. In FIG. 4 (b), one second region 20 is shown, but the present invention is not limited thereto. A plurality of second areas may be set on the execution screen of the application. According to an example, the information about the functions corresponding to the front touch and the rear touch for each second area can be stored in the memory 170 in the form of a data table.

Referring back to FIG. 3, the controller 180 may display an object for performing a function set corresponding to the identified second area on the front of the transparent display (S130).

The control unit 180 can confirm the function of the second region 20 performed according to the touch of the first region 10 and display an object for executing the confirmed function as the execution screen. The object for executing the verified function may include a pop-up window, a thumbnail, etc., which will be described in detail with reference to FIG.

According to the present invention, when an application is executed in a mobile terminal having a transparent display, the user performs different functions depending on whether the same area of the application execution screen is touched at the front or back, Various functions can be performed.

5 is a flowchart illustrating a method of moving a page using a pop-up window displaying a thumbnail corresponding to a page according to an exemplary embodiment of the present invention. FIGS. 6 to 11 are diagrams for explaining a function of moving a page using a pop-up window in which a thumbnail corresponding to a page is displayed according to an embodiment of the present invention.

Referring to FIG. 5, the control unit 180 may display an application execution screen on the front side of the transparent display (S200).

6A, an application execution screen 30 is displayed on the front surface 151a of the transparent display 151 of the mobile terminal 100. In FIG. The application may be a web browser application, according to one example. However, the present invention is not limited thereto. Any application can be applied as long as the history of the page displayed on the execution screen 30 can be stored and the following description can be applied substantially equally.

The execution screen 30 may include an address window indicator 31 and a new execution window open indicator 32. Link information for the currently displayed page may be displayed in the address window indicator 31. [ When the new execution screen open indicator 32 is selected, the controller 180 may display another execution screen of the application different from the execution screen 30. [

In addition, the execution screen 30 may include a backward indicator 33 and a forward indicator 34 for displaying previous or subsequent pages of the page currently displayed on the execution screen. The execution screen 30 may include a bookmark indicator 35 for bookmarking a currently displayed page.

The indicators 31 to 35 included in the execution screen 30 described above are examples, but are not limited thereto. The execution screen 30 may further include indicators for performing other functions. The above-described contents can be applied to substantially the same or analogous range, except for the case where the above-mentioned indicators can not be applied in their nature.

Referring again to FIG. 5, the controller 180 may sense the first touch input applied to the first area on the rear side of the transparent display (S210).

6B shows that the user touches the rear surface 151b of the transparent display 151 in a state where the execution screen 30 is displayed. The user can touch the first area 11 which is the rear of the area in which the backward indicator 33 and the forward indicator 34 are displayed while viewing the execution screen 30. [ The control unit 180 may sense the touch input applied to the first area 11 through the second touch panel 151d (see FIG. 2A) provided on the rear surface of the transparent display 151. FIG.

Referring again to FIG. 5, the controller 180 can confirm that the second area corresponding to the first area is an area in which an indicator for page movement is displayed (S220).

Referring to FIG. 7 (a), the controller 180 can identify the second area 21 corresponding to the first area 11. In this case, the second area 21 may be an area including a backward indicator 33 and a forward indicator 34. [ The control unit 180 can read information on the user interface for page movement, which is a function set to correspond to the second area 21, from the memory 170. [

5, the control unit 180 may display a pop-up window displaying a thumbnail corresponding to the page displayed on the execution screen and a thumbnail corresponding to the page displayed on the execution screen on the transparent display 151 [S230].

7A, the control unit 180 displays a pop-up window 40 including a thumbnail t1 to t4 corresponding to a page displayed on the execution screen 30 as a user interface for page movement can do. According to an example, the thumbnails t1 and t2 corresponding to the previous pages may be displayed to the left of the thumbnail t3 corresponding to the currently displayed page in the displayed order. In addition, a thumbnail t4 corresponding to the subsequent pages may be displayed on the right side of the thumbnail t3 corresponding to the currently displayed page.

In FIG. 7 (a), four thumbnails are displayed, but this is not limitative. The number of thumbnails displayed on the pop-up window 40 may be set differently as needed. In addition, the pop-up window 40 may further include other thumbnails depending on the number of pages displayed after the application is executed. In this case, according to one example, the pop-up window 40 may be displayed with an indicator indicating that other thumbnails can be identified.

Referring to FIG. 8A, a user may apply a drag-touch input to identify another thumbnail not displayed in the pop-up window 40. When the user applies a drag input to the left, the thumbnail t1 to t4 displayed in the pop-up window 40 can be shifted to the left. In this case, the thumbnails t4, t5, and t6 corresponding to the pages displayed after the currently displayed page may be sequentially displayed in the pop-up window 40 as shown in FIG. 8B.

Similarly, when the user applies a drag input to the right, a thumbnail corresponding to the page displayed before the currently displayed page can be sequentially displayed in the pop-up window 40. [

Referring again to FIG. 7A, the thumbnail t3 corresponding to the currently displayed page among the thumbnails t1 to t4 displayed on the pop-up window 40 is displayed to be distinguished from the other thumbnails t1, t2, and t4 . According to an example, the control unit 180 may display the identification indicator 41 on the border of the thumbnail t3 corresponding to the currently displayed page. However, the present invention is not limited thereto. If it can be distinguished from other thumbnails, effects such as specific colors, characters, symbols, and highlight processing can be given to the thumbnail t3 corresponding to the currently displayed page.

Referring to FIG. 5 again, when the controller 180 receives an input for selecting a first thumbnail among the thumbnails displayed on the pop-up window, the controller 180 may display a page corresponding to the first thumbnail on the execution screen (S240).

In FIG. 7A, the user selects one of the thumbnails t1 to t4 included in the pop-up window 40. In the example of FIG. In this case, the control unit 180 may display the page corresponding to the selected thumbnail t1 on the execution screen 30 ', using the link information of the page corresponding to the selected thumbnail t1. According to an example, the controller 180 may display the identification indicator 41 on a thumbnail t1 corresponding to a page currently displayed on the execution screen 30 '.

In FIG. 7, the case where one thumbnail t1 is selected has been described on the premise, but the present invention is not limited thereto. The user can select two or more thumbnails simultaneously or sequentially. In this case, the control unit 180 may divide the execution screen 30 and display pages corresponding to the selected thumbnails.

According to an example, the controller 180 may receive a long touch input for a specific thumbnail in the pop-up window 40. [ In this case, the control unit 180 can enlarge and display the specific thumbnail. When the user releases the long touch input, the control unit 180 can display the enlarged thumbnail as it is.

Accordingly, when a touch input is applied to the back of the page movement area, a pop-up window displaying a thumbnail of the displayed page is displayed so that the user can conveniently use the backward indicator or the forward indicator Can be moved.

9A, the user can drag a specific thumbnail t1 among the thumbnails t1 to t4 displayed in the pop-up window 40 out of the area in which the pop-up window 40 is displayed. The control unit 180 can remove the specific thumbnail t1 from the pop-up window 40 as shown in (b) of FIG. 9 upon receiving the input for moving the specific thumbnail t1 out of the pop-up window 40 have.

In this case, the controller 180 may display a thumbnail t7 corresponding to the page displayed earlier than the page corresponding to the specific thumbnail t1 on the pop-up window 40. [ However, the present invention is not limited thereto. The control unit 180 may move the thumbnails t2, t3, and t4 on the right side of the deleted thumbnail t1 to the left and display thumbnails corresponding to the pages displayed thereafter to the right.

In the example shown in FIG. 9, a specific thumbnail is selected and deleted. However, the present invention is not limited thereto. The user can change the order in which thumbnails are displayed by moving specific thumbnails. According to this, when the user moves the page using the backward indicator 33 or the forward indicator 34 of the execution screen 30, the page can be moved according to the changed order.

According to this, the user can easily edit the thumbnail list of the displayed page by deleting the thumbnail moved out of the pop-up window displaying the thumbnail of the displayed page.

Referring to FIG. 10 (a), according to an example, the thumbnails t1 to t5 may be displayed on the pop-up window 42 in a stacking manner in the order in which they were displayed. The control unit 180 may display the thumbnail t3 corresponding to the page displayed on the execution screen among the thumbnails displayed on the pop-up window so as to be distinguished from other thumbnails t1, t2, t4, and t5.

For example, the control unit 180 may display the thumbnail t3 corresponding to the currently displayed page larger than the other thumbnails t1, t2, t4, and t5. Alternatively, as described above, the identification indicator 41 may be displayed on the thumbnail t3 corresponding to the currently displayed page. However, the present invention is not limited to this example, and any effect can be applied if it can be distinguished from other thumbnails.

When the user touches the rear side of the area in which the pop-up window 42 is displayed, the controller 180 displays thumbnails corresponding to the previous pages of the page corresponding to the thumbnail t3 displayed to be distinguished as shown in FIG. 10 (b) (t2) can be displayed so as to be distinguished from other thumbnails. 11, when the user touches the front of the area in which the pop-up window 42 is displayed, the controller 180 displays a thumbnail t3 corresponding to a subsequent page of the page corresponding to the displayed thumbnail t2 ) Can be displayed so as to be distinguished from other thumbnails.

According to this, the thumbnail corresponding to the page is displayed to be distinguished according to the touch input to the front or rear surface of the transparent display, so that the user can easily select the thumbnail corresponding to the desired page.

FIG. 12 is a flowchart of a method of enlarging and displaying an area on a pop-up window using an item for setting an area to be enlarged among pages according to an embodiment of the present invention. FIGS. 13 to 16 are views for explaining enlargement and display of an area on a pop-up window by using an item for setting an area to be enlarged among pages according to an embodiment of the present invention.

Referring to FIG. 12, the control unit 180 may display an application execution screen on the front of the transparent display (S300).

13A, an execution screen 30 of an application is displayed on the front surface 151a of the transparent display 151 of the mobile terminal 100. As shown in FIG. The description related to the execution screen 30 is substantially the same as that described above with reference to FIG. 6 (a), and a detailed description thereof will be omitted.

Referring again to FIG. 12, the controller 180 may sense the first touch input applied to the first area on the rear side of the transparent display [S310].

13A shows that the user touches the rear surface 151b of the transparent display 151 in a state where the execution screen 30 is displayed. The user can touch the specific first region 12 while viewing the execution screen 30. [ According to an example, the first area 12 may be set as the leftmost area of the portion where the content of the execution screen 30 starts.

12, the controller 180 confirms that the second area 22 corresponding to the first area 12 is an area set to enlarge and display one area of the page displayed on the execution screen 30 [S320].

Referring to FIG. 13 (b), the controller 180 can identify the second area 22 corresponding to the first area 12. In this case, the second area 22 may be an area set to enlarge and display one area of the page. The control unit 180 may read information on the user interface for enlarged display of the page, which is a function set to correspond to the second area 22, from the memory 170.

12, the controller 180 displays an item 50 for setting an area to be enlarged and displayed on the execution screen 30 and a pop-up window for enlarging the area of the page corresponding to the item 50, (51) on the execution screen 30 (S330).

Referring to FIG. 13B, the controller 180 may display an item 50 in the second area 22 for setting an area to be enlarged and displayed among the pages displayed on the execution screen 30 . The control unit 180 can enlarge and display the area of the page included in the area where the item 50 is displayed in the pop-up window 51. [ 13 (b), the pop-up window 51 is displayed on the lower left portion of the execution screen 30, but the present invention is not limited thereto.

According to an example, the pop-up window 51 may be displayed at a predetermined ratio larger than the area in which the item 50 is displayed. However, the present invention is not limited thereto. The pop-up window 51 may be displayed in a predetermined size. Also in this case, it is natural that, for enlarged display, the pop-up window 51 must be larger than the area in which the item 50 is displayed.

Referring again to FIG. 12, when the size of the item is adjusted, the controller 180 may adjust the enlarged area of the pop-up window to correspond to the size of the item (S340).

Referring to FIG. 14 (a), the user can touch and drag the item 50 to set an area to be enlarged and displayed. The control unit 180 can enlarge and display the contents of the page on which the item 50 is displayed in the pop-up window 51. [ The control unit 180 may expand the pop-up window 51 as the area in which the item 50 is displayed is expanded. Referring to FIG. 14 (b), the controller 180 may extend the height of the pop-up window 51 as well.

Accordingly, when an area set for enlargement display is touched at the rear side, an item for setting an area to be enlarged is displayed, so that the user can enlarge and confirm one area of the displayed page according to a simple touch input.

Referring to FIG. 15 (a), the user can move the first touch input applied to the rear surface of the transparent display 151, while the item 50 is displayed. For example, as shown in (a) of FIG. 15, it is possible to drag downward while maintaining the first touch input. The control unit 180 may move the item 50 according to the first touch input.

Referring to FIG. 15 (b), it is shown that the item 50 is moved down and displayed according to the drag input. The control unit 180 can enlarge and display the page of the area in which the item 50 is displayed in the pop-up window 51 at the changed position.

According to this, by moving the item for setting the area to be enlarged in accordance with the movement of the touch input on the rear surface of the transparent display, the user can easily select an area to be enlarged among the displayed pages.

Referring to FIG. 16A, the user can apply a second touch input for touching and dragging one area of the pop-up window 51 while the item 50 is displayed. The control unit 180 may change the contents displayed in the pop-up window 51 according to the second touch input. For example, as shown in FIG. 16 (a), when dragging from the bottom up, the control unit 180 can move the contents displayed in the pop-up window 51 up. The control unit 180 can display continuous contents based on the page displayed on the execution screen 30 from below the pop-up window 51. [

According to an example, the controller 180 may move the item 50 to display an area displayed in the pop-up window 51 according to the touched input. Referring to FIG. 16B, it is shown that the item 50 has moved down. In this case, the changed contents may be enlarged in the pop-up window 51 as well.

According to this, by changing the position of the area to be enlarged according to the touch input in the pop-up window in which the area of the page is enlarged, the user can easily select an area to be enlarged of the displayed pages.

17 is a flowchart of a method of executing a function set in an indicator using a thumbnail of a page corresponding to a link according to an embodiment of the present invention. 18 to 22 illustrate execution of a function set in an indicator by using a thumbnail of a page corresponding to a link according to an embodiment of the present invention.

Referring to FIG. 17, the control unit 180 may display an application execution screen on the front of the transparent display (S400).

Referring to FIG. 18A, an application execution screen 30 is displayed on the front surface 151a of the transparent display 151 of the mobile terminal 100. FIG. The description related to the execution screen 30 is substantially the same as that described above with reference to FIG. 6 (a), and a detailed description thereof will be omitted.

Referring again to FIG. 17, the controller 180 may sense the first touch input applied to the first area on the rear side of the transparent display (step S410).

18A shows that the user touches the rear surface 151b of the transparent display 151 in a state where the execution screen 30 is displayed. The user can touch the first area 13, which is the rear side of the area where the link information is displayed, while viewing the execution screen 30. The controller 180 may sense the touch input applied to the first area 13 through the second touch panel 151d (see FIG. 2A) provided on the rear surface of the transparent display 151. FIG.

Referring again to FIG. 17, the controller 180 can confirm that the second area 23 corresponding to the first area 13 includes the link information (step S420).

Referring to FIG. 18 (b), the controller 180 can identify the second area 23 corresponding to the first area 13. In this case, the second area 23 may be an area set to display a thumbnail corresponding to a page corresponding to the link information. The control unit 180 can read information on the user interface for displaying the thumbnail, which is a function set to correspond to the second area 23, from the memory 170. [

Referring again to FIG. 17, the controller 180 may display a thumbnail of a page corresponding to a link included in the second area on the transparent display [S430].

Referring to FIG. 18 (a), the controller 180 may display a thumbnail 60 of a page corresponding to a link included in the second area 23 on the execution screen 30. According to an example, the thumbnail 60 may be displayed at a position where the first touch input is applied. Through this, the user can confirm the page corresponding to the link information in advance as a thumbnail.

According to an example, in order to display the thumbnail 60, the controller 180 uses the link information included in the second area 23 to transmit information on a corresponding page to the wireless communication unit 110 . If the corresponding page is a page that has already been displayed, a thumbnail for the page can be read from the memory 170.

Referring again to FIG. 17, the controller 180 can perform a function set to correspond to the indicator to which the thumbnail is moved (S440).

Referring to FIG. 19 (a), the user can move the thumbnail 60 to the address window indicator 31. In this case, the control unit 180 can display a page corresponding to the thumbnail 60 on the execution screen 30 '', as shown in FIG. 19 (b).

Referring to FIG. 20 (a), the user can move the thumbnail 60 to a new execution screen open indicator 32. In this case, the controller 180 may display a page corresponding to the thumbnail 60 on another execution screen 70 of the application different from the execution screen 30, as shown in FIG. 20 (b) . The other execution screen 70 may also include an address window indicator 71, a new execution window open indicator 72, a bookmark indicator 75, and the like. However, the new execution screen open indicator 72 may be displayed with the number 2 to indicate that it is the second execution screen of the application.

 Referring to FIG. 21 (a), the user can move the thumbnail 60 to the bookmark indicator 35. In this case, the control unit 180 can display a pop-up window 80 for displaying a bookmark, as shown in Fig. 21 (b). The pop-up window 80 may display thumbnails 81 to 84 previously set as bookmarks.

According to an example, when the user releases the first touch input in the area where the pop-up window 80 is displayed, the controller 180 may set the thumbnail 60 as a bookmark. Thereafter, the user can select the bookmark indicator 35 and select the thumbnail 60 to display the currently displayed page on the execution screen 30 again.

According to the present invention, when the rear touch is applied to the area including the link information, the thumbnail of the page corresponding to the link information is displayed and the function set in the indicator in which the thumbnail is shifted is performed, Can be performed.

Referring to FIG. 22 (a), the user can apply a predetermined input to the thumbnail 60. In FIG. 22 (a), an input to the right of the thumbnail 60 is shown, but this is not limiting. The predetermined input may be set in a variety of touches such as a short touch, a long touch, a multi-touch, a drag touch, a flick touch, a pinch-in touch, a pinch-out touch, a swipe touch, .

Upon receipt of the predetermined input, the control unit 180 may display the menu 90 including the list of applications 91 to 95 that can share the page corresponding to the link. According to an example, the menu 90 may include a list of various applications, such as an SNS application, a messaging application, an email application, etc., that may share a page.

When the user selects a specific application among the applications included in the menu 90, the controller 180 may execute the selected application and share information about the page corresponding to the thumbnail 60. [

According to this, by displaying a menu for sharing a page corresponding to a link in accordance with an input to a thumbnail, a user can easily share a page corresponding to the link with a simple touch input.

Although the transparent display has been described above, it is not limited thereto. In the case of the mobile terminal 100 having a non-transparent touch screen, the above description can be substantially applied to the same if the mobile terminal 100 has a sensor capable of sensing touch input on the front and back sides thereof . In this case, the controller 180 may detect the position of the touch input applied to the rear surface of the mobile terminal 100 and display the corresponding position of the touch screen 151 provided on the front surface of the mobile terminal 100 .

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, , And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). Also, the computer may include a control unit 180 of the terminal. Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

100: mobile terminal 110: wireless communication unit
120: input unit 140: sensing unit
150: output unit 160: interface unit
170: memory 180:
190: Power supply

Claims (10)

Transparent display; And
The method of claim 1, further comprising: displaying an application execution screen on a front surface of the transparent display; sensing a first touch input applied to a first area on a rear surface of the transparent display, And displaying an object on the front of the transparent display for executing a function set to correspond to the confirmed second area;
. The method according to claim 1,
Wherein the object includes a pop-up window displaying a thumbnail corresponding to a page displayed on the execution screen and a thumbnail corresponding to a page displayed on the execution screen,
Wherein the controller displays a page corresponding to the first thumbnail on the execution screen when receiving an input for selecting a first thumbnail among the thumbnails displayed on the pop-up window. 3. The method of claim 2,
Wherein the control unit removes the second thumbnail from the pop-up window upon receiving an input for moving a second thumbnail of the thumbnails displayed in the pop-up window out of the pop-up window. 3. The method of claim 2,
Wherein the control unit displays thumbnails corresponding to the pages displayed on the execution screen among the thumbnails displayed on the pop-up window so as to be distinguished from other thumbnails, and when receiving touch input on the back surface of the transparent display, And displays a thumbnail corresponding to a subsequent page of the thumbnail displayed to be distinguished from other thumbnails when the touch input to the front of the transparent display is received. The method according to claim 1,
Wherein the object includes an item for setting an area to be enlarged and displayed among the pages displayed on the execution screen,
Wherein the control unit displays a pop-up window displaying an enlarged area of the page corresponding to the item on the execution screen, and adjusts the enlarged display area of the pop-up window to correspond to the size of the item when the size of the item is adjusted . 6. The method of claim 5,
Wherein the controller changes the position of the item according to the movement of the first touch input and changes the enlarged area to correspond to the position of the item in the pop-up window. 6. The method of claim 5,
Wherein the control unit changes the position of the item according to the movement of the second touch input in the pop-up window, and changes the enlarged display area to correspond to the position of the item in the pop-up window. The method according to claim 1,
Wherein the object includes a thumbnail of a page corresponding to a link included in the second region,
The controller moves the thumbnail to one of the indicators displayed on the execution screen according to the movement of the first touch input and displays the page on the execution screen according to the indicator on which the thumbnail is moved, And displays it on a new execution screen or registers the page as a bookmark. 9. The method of claim 8,
Wherein the control unit displays a menu for sharing a page corresponding to the link when receiving a predetermined input for the thumbnail. Displaying an execution screen of the application on a front surface of the transparent display;
Sensing a first touch input applied to a first region of the rear side of the transparent display;
Identifying a second region of the front of the transparent display corresponding to the first region; And
Displaying an object on the front of the transparent display for executing a function set to correspond to the identified second area;
And transmitting the control information to the mobile terminal.

Images