KR101578731B1 - Mobile terminal and control method thereof - Google Patents

Abstract

The present invention displays a keypad or a virtual keyboard on a user interface / graphic user interface screen through a plurality of eyepieces provided in a mobile terminal and interlocks with an external terminal (including a stylus pen, a touch pen, and a wireless mouse) Or performing input to a virtual keyboard (performing a corresponding function), and a control method thereof. To this end, a method of controlling a mobile terminal according to the present invention includes: generating display information when an event occurs; Displaying a screen generated based on the display information on a display unit; And executing a function to be displayed on the display unit based on data transmitted from an external terminal.

Mobile terminal, micro display panel, eyepiece

Description

[0001] MOBILE TERMINAL AND CONTROL METHOD THEREOF [0002]

The present invention relates to a mobile terminal and a control method thereof.

2. Description of the Related Art Generally, a mobile terminal is a device that performs a Global Positioning System (GPS) function and a call function (or a call function) and provides a result of the operation to a user.

It is an object of the present invention to provide a mobile terminal and a control method thereof that provide a user interface and / or a graphical user interface screen to a user through a plurality of eyepieces provided in a mobile terminal.

It is another object of the present invention to provide a portable terminal which displays a keypad or a virtual keyboard on a user interface and / or a graphical user interface screen displayed through an eyepiece, And performing input to the keypad or the virtual keyboard by interlocking with the mobile terminal, and a control method thereof.

It is another object of the present invention to provide a mobile terminal providing a screen larger than a screen of a display unit provided in the mobile terminal and a control method thereof.

According to an aspect of the present invention, there is provided a mobile terminal including a controller for generating display information when an event occurs; And a lens unit for displaying a screen generated based on the display information.

According to another aspect of the present invention, there is provided a method of controlling a mobile terminal, the method comprising: generating display information when an event occurs; Displaying a screen generated based on the display information on a display unit; And executing a function to be displayed on the display unit based on data transmitted from an external terminal.

A mobile terminal and a control method thereof according to an embodiment of the present invention provide a user interface and / or a graphical user interface screen to a user through a plurality of eyepieces provided in the mobile terminal, thereby maintaining portability of the mobile terminal A large screen can be provided to the user.

Also, a mobile terminal and a control method thereof according to an embodiment of the present invention may be configured to display a keypad or a virtual keyboard on a user interface and / or a graphical user interface screen displayed through an eyepiece lens, (For example, a screen configuration of 15 inches or more) by performing input to the keypad or the virtual keyboard by interlocking with the keyboard There is an effect that a user element (UE) can be provided.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like or corresponding elements are denoted by the same reference numerals, and a duplicate description thereof will be omitted.

1 is a block diagram illustrating a configuration of a mobile terminal 100 for explaining a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 may be implemented in various forms. For example, the mobile terminal 100 may be a cellular phone, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigation , And so on.

1, the mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, A memory 160, an interface unit 170, a control unit 180, a power supply unit 190, and the like. Not all of the components of the mobile terminal 100 shown in Fig. 1 are essential components, and the mobile terminal 100 may be implemented by more components than the components shown in Fig. 1, The mobile terminal 100 may be implemented.

The wireless communication unit 110 may include at least one component for performing wireless communication between the mobile terminal 100 and the wireless communication system or wireless communication between the mobile terminal 100 and the network on which the mobile terminal 100 is located have. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114 and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel, a terrestrial channel, and the like. The broadcast management server may be a server for generating and transmitting broadcast signals and / or broadcast related information, or a server for receiving previously generated broadcast signals and / or broadcast related information and transmitting the broadcast signals and / or broadcast related information to the mobile terminal 100. The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, it may be received by the mobile communication module 112. The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcasting signals using various broadcasting systems. In particular, the broadcasting receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) Only Digital Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcasting systems that provide broadcasting signals as well as the digital broadcasting system described above. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data related to transmission and reception of a voice call signal, a video call signal, and / or a text / multimedia message.

The wireless Internet module 113 refers to a module for wireless Internet access, and the wireless Internet module 113 can be embedded in the mobile terminal 100 or externally. Here, the wireless Internet technology includes a wireless LAN (WLAN), a Wi-Fi, a wireless broadband (Wibro), a WiMAX, and a High Speed Downlink Packet Access (HSDPA) Can be used.

The short-range communication module 114 means a module for short-range communication. Here, as a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, etc. may be used .

The location information module 115 is a module for confirming or obtaining the location of the mobile terminal. As an example, there is a GPS module. The GPS module receives position information from a plurality of satellites. Here, the location information may include coordinate information indicated by latitude and longitude. For example, the GPS module can accurately calculate the current position according to the triangulation method by measuring the correct time and distance from three or more satellites and measuring three different distances. A method of obtaining distance and time information from three satellites and correcting the error by one satellite may be used. In particular, the GPS module can acquire latitude, longitude and altitude as well as three-dimensional velocity information and accurate time from the position information received from the satellite. As the position information module 115, a Wi-Fi Positioning System and / or a Hybrid Positioning System may be applied.

The A / V input unit 120 is for inputting an audio signal or a video signal. The A / V input unit 120 includes a camera 121 and a microphone 122, . The camera 121 processes an image frame such as a still image or a moving image obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ The camera 121 may be composed of two or more according to the configuration of the mobile terminal and / or the usage environment.

The microphone 122 receives an external sound signal by a microphone in a communication mode, a recording mode, a voice recognition mode, and the like, and processes it as electrical voice data. In the call mode, the processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 and output. The microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for a user to control the operation of the mobile terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the position of the mobile terminal 100 such as the open / close state of the mobile terminal 100, the position of the mobile terminal 100, the presence of the user, the orientation of the mobile terminal 100, 100, and generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. The sensing unit 140 senses whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor 141.

The output unit 150 is for outputting an audio signal (or a signal related to auditory sense) or a video signal (or a signal related to time) or an alarm signal or a signal related to a tactile sense. The display unit 151, the sound output module 152, the alarm unit 153, the haptic module 154, and the like.

The display unit 151 displays (or outputs) the information processed by the mobile terminal 100. For example, when the mobile terminal 100 is in the call mode, a UI (User Interface) or GUI (Graphic User Interface) associated with a call is displayed. If the mobile terminal 100 is in the video communication mode or the photographing mode, the captured image and / or the received image or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED) (Flexible Display), and a 3D display (3D Display).

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. For example, the plurality of display units may be spaced apart from one another (on the same surface) or arranged integrally with the mobile terminal 100, and may be disposed on different surfaces, respectively.

Meanwhile, the display unit 151 is connected to a touch screen (hereinafter, referred to as 'touch screen') in which a sensor (hereinafter, referred to as 'touch sensor' May be used as an input device in addition to the output device. The touch sensor may take the form of, for example, a touch film, a touch sheet, a touch pad, a touch panel, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated at a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch. If there is a touch input to the touch sensor, the corresponding signal (s) is sent to a touch controller (not shown). The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

The proximity sensor 141 may be disposed in an inner region of the mobile terminal 100 or in the vicinity of the touch screen, which is surrounded by the touch screen. The proximity sensor 141 refers to a sensor that detects the presence of an object approaching a predetermined detection surface or an object existing in the vicinity thereof without mechanical contact by using electromagnetic force or infrared rays. The proximity sensor 141 has a longer lifetime and higher utilization than the contact-type sensor.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch" The act of actually touching the pointer on the screen is called "Contact Touch ". A position where the pointer is proximally touched on the touch screen means a position where the pointer corresponds to the touch screen vertically when the pointer is touched.

Further, the proximity sensor 141 detects a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, do. Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The sound output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, and a broadcast reception mode. The sound output module 152 outputs an acoustic signal related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events generated in the mobile terminal 100 include a call signal reception, a message reception, a key signal input, a touch input, and the like. The alarm unit 153 may output a signal for informing occurrence of an event in a form other than an audio signal or a video signal, for example, vibration. When the call signal is received or the message is received, the alarm unit 153 may vibrate the mobile terminal 100 via the vibration means. Alternatively, when the key signal is input, the alarm unit 153 may vibrate the mobile terminal 100 through the vibration means with the feedback of the key signal input. Through the above-described vibration, the user can recognize the occurrence of the event. Of course, a signal for notifying the occurrence of an event may also be output through the display unit 151 or the audio output module 152 so that they 151 and 152 may be classified as a part of the alarm unit 153.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the haptic module 154 are controllable. For example, different vibrations may be synthesized and output or sequentially output.

In addition to vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of air through the injection port or the suction port, a spit on the skin surface, contact with an electrode, And various effects of tactile effect such as effect of reproducing the cold sensation using the heat absorbing or heatable element can be generated.

The haptic module 154 can transmit a tactile effect through direct contact, and the tactile effect can be felt by a user through a muscular sense such as a finger or an arm. The haptic module 154 may include two or more haptic modules 154 according to the configuration of the mobile terminal 100. [

The memory 160 may store a program for processing and control of the controller 180 and may have a function for temporarily storing input / output data (e.g., a phone book, a message, a still image, . ≪ / RTI > The memory 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) A random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM) A disk, and / or an optical disk. In addition, the mobile terminal 100 may operate in association with the web storage or operate web storage that performs a storage function of the memory 150 on the Internet.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, the interface unit 170 may include a headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, An audio input / output (I / O) port, a video I / O (input / output) port, and an earphone port. Here, the identification module is a chip that stores various information for authenticating the use right of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identity module (SIM) A Universal Subscriber Identity Module (USIM), and the like. In addition, the device having the identification module (hereinafter, referred to as 'identification device') can be manufactured in a smart card format. Accordingly, the identification module can be connected to the mobile terminal 100 through the port. The interface unit 170 receives data from an external device or receives power from the external device and transmits the received data to each component in the mobile terminal 100 or transmits data in the mobile terminal 100 to an external device.

When the mobile terminal 100 is connected to an external cradle, the interface unit 170 may be a path through which power from the cradle is supplied to the mobile terminal 100, or various commands A signal may be transmitted to the mobile terminal 100. The various command signals or the power source inputted from the cradle may be operated as a signal for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal 100. For example, the control unit 180 performs related control and processing for voice call, data communication, video call, and the like. In addition, the controller 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180.

The control unit 180 can perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 and supplies power required for operation of the respective components.

The functions of the components applied to the mobile terminal 100 may be implemented in a computer-readable recording medium using software, hardware, or a combination thereof. According to a hardware implementation, a plurality of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs) A control unit, a micro-controller, a microprocessor, and an electric unit for performing a function. In some cases, such embodiments may be implemented by the controller 180. According to a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that perform at least one function or operation. The software code may be implemented by a software application written in a suitable programming language. The software codes may also be stored in the memory 160 and executed by the control unit 180. [ In addition, the navigation session 300 applied to the mobile terminal 100 provides a general navigation function.

Meanwhile, the control unit 180 applied to the mobile terminal 100 according to an embodiment of the present invention displays a keypad or a virtual keyboard on a user interface / graphic user interface screen through a plurality of eyepieces provided in the mobile terminal, And can perform input (perform a corresponding function) on the keypad or virtual keyboard by interlocking with a terminal (including a stylus pen, a touch pen, and a wireless mouse).

FIG. 2 is a block diagram illustrating a configuration of a telematics terminal 200 for explaining a function execution device according to an embodiment of the present invention. As shown in FIG. 2, a central processing unit (Central Processing unit (CPU) 222, a key control unit 221 for controlling various key signals, an LCD control unit 223 for controlling the LCD, and a main board having a memory 224 for storing various kinds of information 220).

The memory 224 stores map information (map data) for displaying vehicle guidance information (road guidance information for guiding the user while driving or not driving) on the map of the display unit (or LCD)

The memory 224 stores various information for controlling the traffic information collection control algorithm and a traffic information collection control algorithm that allows the vehicle to input traffic information according to the current road conditions.

The main board 220 includes a communication module 201 for performing voice communication and data transmission / reception through a mobile communication terminal provided with a unique device number, A GPS module 202 for receiving a GPS signal for route tracking and generating current position data of the vehicle based on the received GPS signal or transmitting traffic information collected by a user as a GPS signal, A gyro sensor 203 for detecting a traveling direction, a CD deck 204 for reproducing a signal recorded on a compact disc (CD), and the like.

The communication module 201 and the GPS module 202 transmit / receive signals through the first antenna 205 and the second antenna 206, respectively.

The main board 220 is connected to a TV module 230 that receives a broadcast signal through a broadcast signal antenna (or TV antenna) 231.

The main board 220 is connected to a liquid crystal display (LCD) 211 under the control of the LCD controller 223 through an interface board 213.

After the LCD 211 receives the broadcast signal received through the TV module 230, the LCD controller 223 controls the signal processing of the broadcast signal, 213 and outputs the video signal to the LCD 211 through the amplifier 254 under the control of the audio board 240 to be described later. In addition, the LCD 211 displays various video signals and character signals based on the control signal of the LCD control unit 223.

Also, the LCD 211 may be configured to receive input from a user using a touch screen method.

The main board 220 is connected to the front board 212 under the control of the key controller 221 through the interface board 213. The front board 212 constitutes a button and a menu for inputting various key signals and provides a key signal corresponding to a key (or a button) selected by the user to the main board 220. In addition, the front board 212 may include a menu key for directly inputting traffic information, and the menu key may be controlled by the key controller 221.

The audio board 240 is connected to the main board 220 and processes various audio signals. The audio board 240 includes a microcomputer 244 for controlling the audio board 240, a tuner 243 for receiving a radio signal through an antenna (or a radio antenna) 245, A power supply unit 242 for supplying power to the microcomputer 244 and a signal processing unit 241 for performing signal processing for outputting various audio signals.

The audio board 240 is connected to a radio antenna 245 for receiving radio signals and a tape deck 246 for reproducing audio tapes.

The audio board 240 is connected to an amplifier 254 for outputting a signal processed by the audio board 240.

The amplifier 254 is also connected to the vehicle interface 250. That is, the main board 220 and the audio board 240 are connected to the vehicle interface 250, respectively. The vehicle interface 250 includes a handsfree 251 for inputting a voice signal without using the hands of the vehicle operator, an airbag 252 for providing safety for the occupant, a speed sensor 251 for detecting the speed of the vehicle, (253), and the like.

The speed sensor 253 calculates the vehicle speed and provides the calculated vehicle speed information to the central processing unit 222. [

In addition, the navigation session 300 applied to the telematics terminal 200 provides a general navigation function.

Meanwhile, the central processing unit 222 applied to the telematics terminal 200 according to an embodiment of the present invention displays a keypad or a virtual keyboard on a user interface / graphic user interface screen through a plurality of eyepieces provided in the telematics terminal (Including a stylus pen, a touch pen, a wireless mouse, and the like) to perform input (perform a corresponding function) on the keypad or the virtual keyboard.

Hereinafter, a configuration of a mobile terminal according to an embodiment of the present invention will be described with reference to FIG. 3 may include not only the mobile terminal 100 and the telematics terminal 200 but also a smart phone, a portable terminal, a mobile terminal, a personal digital assistant (PDA), a notebook computer, a Wibro terminal, an IPTV terminal, a telematics terminal, a navigation terminal, an AVN (Audio Video Navigation) terminal, and the like.

3, the mobile terminal 400 includes an input unit 410, a storage unit 420, a lens unit 430, and a display unit 430. The input unit 410, the storage unit 420, A control unit 440, a display unit 450, and an audio output unit 460.

The input unit 410 receives input of a button operation by the user, or receives an instruction or a control signal by an operation such as touching / scrolling the displayed screen.

The input unit 410 may be a variety of devices such as a keypad, a touch screen, a jog shuttle, and a microphone.

The input unit 410 may include a microphone (not shown) and / or a camera (not shown), and receive voice and / or image information of the user through the microphone and / or the camera.

The storage unit 420 stores various user interface (UI) and / or graphical user interface (GUI).

The storage unit 420 stores data and programs necessary for the mobile terminal 400 to operate.

Also, the storage unit 420 stores data (information or control signal) transmitted from an external terminal connected by wire / wireless communication.

The lens unit 430 includes a microdisplay panel 431, an eyepiece 432, and a support unit 433. 4A, the microdisplay panel 431 is aligned with the eyepiece 432 (in the same direction as the "A direction"). At this time, the micro display panel 431 may be a reflection type or a light emission type display panel.

The support portion 433 is configured to support (maintain) the microdisplay panel 431 and the eyepiece 432.

4B, the lens unit 430 is provided on the same side of the mobile terminal 400 as shown in FIG. At this time, the plurality of lens units 430 are spaced apart from each other (by a distance of "d").

The lens unit 430 may be mounted on one side of the mobile terminal 400 or may be detachably mounted on one side of the mobile terminal 400.

4C, the lens unit 430 may include a light source 434, a microdisplay panel 431, an eyepiece 432, a polarized light transmitting unit 435, and a supporting unit 433 It is possible. At this time, the light source 434, the microdisplay panel 431, the eyepiece 432, and the polarized light transmitting portion 435 are arranged on the same line (in the direction of "A").

The light source 434 functions as a backlight of the micro display panel 431 and the light generated from the light source 434 is incident on the micro display panel 431.

The micro display panel 431 modulates the light emitted from the light source 434 into polarized light based on the display information generated by the control unit 440 and outputs the modulated light to the eyepiece lens 432 do. Herein, the modulation is performed by using the light from the light source 434 and outputting the polarized light having the image signal in which R, G, and B are mixed according to the display information input to the microdisplay panel 431 it means. In this case, the micro display panel 431 may be a transmissive display panel to utilize the light of the light source 434.

The eyepiece 432 enlarges or reduces the polarized light emitted from the microdisplay panel 431 to produce a virtual image, and then outputs the virtual image to the polarized light transmitting portion 435.

The polarized-light transmitting portion 435 is configured so that only polarized light in the same direction as the polarized light of the virtual image produced by the eyepiece 432 is transmitted.

As described above, by transmitting only the polarized light in the same direction as the polarized light of the virtual image produced by the eyepiece lens, an excellent optical efficiency can be obtained.

The supporting portion 433 is configured to support the light source 434, the microdisplay panel 431, the eyepiece 432, and the polarized-light transmitting portion 435.

5 to 8 are views showing a structure in which the lens unit 430 is formed in the mobile terminal 400. [

5A to 5C, the lens unit 430 includes a front surface (FIG. 5A), a rear surface (FIG. 5B), or a side surface (Or may be mounted).

In this case, as shown in FIGS. 5A to 5C, the plurality of lens units 430 may include one lens unit 430 mounted on each of the two slidable portions, and may be adjusted to a distance between two pupils of the user Can be configured.

5C, when the plurality of lens units 430 are provided on the side surface of the mobile terminal 400, the lens unit 430 provided on the side surface of the front surface unit and the side surface of the rear surface member Each of the lens units 430 may be configured so as to be adjustable in an arbitrary direction (501 direction) so as to be aligned with the distance between two pupils of the user.

6A to 6C, the lens unit 430 includes a folder inside the folder (FIG. 6A), a folder outside (FIG. 6B), or a side surface 6C).

6B and 6C, when the plurality of lens units 430 are provided on the rear surface or the side surface of the mobile terminal 400, the lens unit 430 provided on a part of the upper member, And the lens unit 430 included in a part of the lower member may be configured to be adjustable in an arbitrary direction (direction 502) so as to be aligned with the distance between two pupils of the user.

7A and 7B, the lens unit 430 may be connected to the mobile terminal 400 through a connection member.

7A, the plurality of lens units 430 are moved left / right (or up / down) in a predetermined direction (direction 504) by the connecting member 503, 400 to the inside / outside. At this time, each of the plurality of lens units 430 may be configured to be rotatable (direction 505).

7B, the plurality of lens units 430 may be mounted on a hinge 506 provided on the mobile terminal 400 by a connecting member 507, , Left / right) direction (508 direction). That is, the plurality of lens units 430 may be configured to be foldable with respect to the mobile terminal 400. At this time, each of the plurality of lens units 430 can be configured to be capable of rotating (direction 509).

7C, when the connection member 507 and the lens unit 430 are folded to the mobile terminal 400, the connection member 507 and the lens unit 430 are connected to each other, (Or built-in) the mobile terminal 400.

8A and 8B, the lens unit 430 may be embedded in a side surface of the mobile terminal 400 through a hinge provided on the mobile terminal 400. [0053] FIG.

As shown in FIG. 8A, the lens unit 430 may be embedded in the mobile terminal 400 at a normal time.

8B, the plurality of lens units 430 can move the lens unit 430 (in the 511 direction) about the hinge 510 provided in the mobile terminal 400 . That is, the plurality of lens units 430 may be configured to be foldable with respect to the mobile terminal 400.

In addition to the slide type mobile terminal, the folder type mobile terminal and the connecting member, the lens unit 430 may be a bar type mobile terminal, a slide type qwerty terminal, a mobile terminal in the form of a rotation, and the like. However, the present invention is not limited thereto.

Also, the lens unit 430 may be detachably attached to the mobile terminal using a connecting member, a coupling member, or the like.

The control unit 440 executes the overall control function of the mobile terminal 400. [

The control unit 440 controls the lens unit 430 to transmit data to the lens unit 430 when a button included in the mobile unit 400 is clicked (or input) And generates display information for operating the micro display panel 431 included therein. Here, the external terminal may include a stylus pen, a touch pen, and a wireless mouse.

The control unit 440 processes the data (including coordinate information, function information, and the like) transmitted from the external terminal by a predetermined signal and transmits the signal-processed data to a user interface Screen / graphical user interface screen.

Also, the controller 440 executes a function matched to the user interface screen / graphic user interface screen based on the matched result, and outputs the execution result to the micro display panel 431 and / And outputs it to the display unit 450 or the audio output unit 460.

The display unit 450 may display various contents such as various menu screens by using the user interface and / or graphical user interface included in the storage unit 420 under the control of the controller 440. Here, the content displayed on the display unit 450 includes various text or image data (including map data and various information data), a menu screen including data such as an icon, a list menu, and a combo box. Also, the display unit 450 may be a touch screen.

The audio output unit 460 outputs audio information included in the signal processed by the control unit 440. Here, the audio output unit 460 may be a speaker.

The mobile terminal 400 may further include a universal antenna for performing communication with an external terminal through a wired / wireless communication network and transmitting / receiving signals in various frequency bands.

Hereinafter, a method of controlling a mobile terminal according to the present invention will be described in detail with reference to FIGS. 1 to 10. FIG.

9 is a flowchart illustrating a method of controlling a mobile terminal according to an exemplary embodiment of the present invention.

First, the control unit 440 generates display information for operating the micro display panel 431 when an event occurs.

At this time, the event may be a moment when a predetermined button included in the mobile terminal 400 is clicked.

In addition, the event may be a moment when the control unit 440 receives a control signal transmitted from an external terminal for driving the micro display panel 431.

7B or 8B, the control unit 440 may control the moment when the connecting member connected to the lens unit 430 including the microdisplay panel 431 is horizontally extended It may be the moment that is sensed. That is, the event may be the moment when the lens unit 430 configured as a folding type is unfolded.

In this way, when an event for operating the micro display panel 431 is generated, the controller 440 can generate display information corresponding to the event.

In addition, when the event occurs, the controller 440 can maintain a standby state in which data (information or a control signal) can be transmitted / received to / from the external terminal by wire / wireless communication with the external terminal . Here, the external terminal may be any one of a stylus pen, a touch pen, and a wireless mouse (S110).

Thereafter, the lens unit 430 displays an arbitrary screen (a virtual reality user interface / graphical user interface, augmented reality) on the micro display panel 431 based on the generated display information, User interface / graphical user interface, etc.).

In addition, a keypad or a virtual keyboard may be displayed together with a part of the screen displayed on the microdisplay panel 431. [

10, an execution result of an arbitrary application program executed by the control unit 440 is displayed (601) on the micro display panel 431, and the control of the control unit 440 A virtual keyboard screen 602 according to a user interface / graphic user interface previously stored in the storage unit 420 is displayed together with the virtual keyboard screen 602. [

The user of the mobile terminal 400 may be provided with a screen displayed on the microdisplay panel 431 through an eyepiece 432 included in the lens unit 430. As described above, the user of the mobile terminal can display a screen (for example, a screen configuration of at least 15 inches or more) larger than the screen displayed on the display unit 430 of the mobile terminal 400 through the lens unit 430 Can be provided.

In addition, a pointer (or a mouse pointer) 603 can be displayed on a part of the micro display panel 431 for interlocking with the external terminal.

For example, when an arbitrary screen is displayed on the micro display panel 431 based on the display information, the controller 440 displays a pointer 603 at the center of the screen (the first arbitrary reference position of the pointer) (S120).

The control unit 440 may change the position of the pointer displayed on the micro display panel 431 based on the data transmitted from the external terminal or change the position of the pointer displayed on the micro display panel 431 To perform the function of < / RTI >

Here, the data transmitted from the external terminal includes a pointer movement signal (including coordinate information), a first click signal (including a signal corresponding to a left-click function of a general mouse), a second click signal (Including a signal corresponding to a button click function), a third click signal (including a signal corresponding to a double click function of a general mouse left button), a drag signal (including a signal corresponding to a drag function of a general mouse) . When the external terminal is a stylus pen and the sensor is provided on one side of the stylus pen (tip end portion of the pen tip), the external terminal senses movement of the one side or touches an arbitrary object (bottom) And generates a control signal (including coordinate movement information) according to the sensed movement of one side or a control signal (including a signal corresponding to a left / right button click function of the mouse) according to the sensed touch, And transmit the generated control signal to the mobile terminal 400.

For example, when the coordinate information on the pointer is included in the data transmitted from the external terminal, the control unit 440 performs predetermined signal processing on the data, and then transmits the coordinate information included in the signal- With the coordinate information of the pointer displayed on the display panel 431.

In a case where the data transmitted from the external terminal includes the function information, the control unit 440 processes the data according to predetermined signal processing, and then transmits the function information included in the signal- To the function information corresponding to the user interface screen / graphic user interface screen displayed on the display unit 431.

Also, the controller 440 executes a function matched to the user interface screen / graphic user interface screen based on the matched result, and outputs the execution result to the micro display panel 431 and / And outputs it to the display unit 450 or the audio output unit 460.

For example, the controller 440 determines whether or not the result of the matching (the result of matching the coordinate information included in the signal processed data with the coordinate information of the pointer displayed on the microdisplay panel 431) The coordinates of the pointer displayed on the user interface screen / graphic user interface screen are shifted, and the result of shifting the coordinates of the pointer is displayed on the micro display panel 431 and / And output it to the voice output unit 460.

The control unit 440 may receive the function information included in the signal processed data as function information corresponding to the user interface screen / graphic user interface screen displayed on the micro display panel 431, (A function of an "OK" button, for example) among the contents displayed on the user interface screen / graphic user interface screen based on the result (S130).

It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the embodiments disclosed in the present invention are intended to illustrate rather than limit the scope of the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments. The scope of protection of the present invention should be construed according to the following claims, and all technical ideas within the scope of equivalents should be construed as falling within the scope of the present invention.

1 is a block diagram illustrating a configuration of a mobile terminal for explaining a mobile terminal according to an embodiment of the present invention.

2 is a block diagram illustrating a configuration of a telematics terminal for explaining a function execution device according to an embodiment of the present invention.

3 is a block diagram illustrating a configuration of a mobile terminal according to an embodiment of the present invention.

4A to 4C are views showing the configuration of a lens unit according to an embodiment of the present invention.

5A to 5C are views illustrating a structure of a lens unit formed in a mobile terminal according to an embodiment of the present invention.

6A to 6C are views illustrating a structure of a lens unit formed in a mobile terminal according to an embodiment of the present invention.

7A to 7C are views illustrating the structure of a lens unit formed in a mobile terminal according to an embodiment of the present invention.

8A and 8B are views illustrating a structure of a lens unit formed in a mobile terminal according to an embodiment of the present invention.

9 is a flowchart illustrating a method of controlling a mobile terminal according to an exemplary embodiment of the present invention.

10 is a view illustrating a screen displayed on a lens unit according to an embodiment of the present invention.

Claims (15)

When the event occurs, generating display information; Displaying a screen generated based on the display information on a display unit included in the lens unit; And Executing a function displayed on the display unit based on data transmitted from an external terminal, The lens unit includes: A display unit for displaying the screen; An eyepiece disposed corresponding to the display unit; And And a support part for supporting the display part and the eyepiece lens. The method of claim 1, When a predetermined button included in the mobile terminal is clicked or when a control signal for driving the display unit transmitted from the external terminal is received. The display device according to claim 1, Wherein the mobile terminal is a micro display panel. The method according to claim 1, A user interface / graphical user interface screen, a virtual keyboard screen, and a pointer. The method according to claim 1, wherein the step of performing the function displayed on the display unit comprises: Processing the data transmitted from the external terminal with a predetermined signal; Changing a position of a pointer displayed on the display unit based on coordinate information included in the signal processed data; And And executing a predetermined function corresponding to the function information based on the function information included in the signal processed data. 6. The method according to claim 5, A left button function of the mouse, a right button function of the mouse, a double click function of the mouse, and a drag function. A control unit for generating display information when an event occurs; And And a lens unit for displaying a screen generated based on the display information, The lens unit includes: A micro display panel displaying the screen; An eyepiece disposed corresponding to the microdisplay panel; And And a support for supporting the micro-display panel and the eyepiece lens. 8. The method of claim 7, When a predetermined button provided on the mobile terminal is clicked or when a control signal for driving the micro display panel transmitted from an external terminal is received. delete 8. The display device according to claim 7, Reflection type or light-emitting type display panel. 8. The method according to claim 7, A user interface / graphical user interface screen, a virtual keyboard screen, and a pointer. 8. The apparatus of claim 7, Processing the data transmitted from the external terminal with a predetermined signal, and changing the position of the pointer displayed on the microdisplay panel based on the coordinate information included in the signal-processed data. 8. The apparatus of claim 7, Wherein the mobile terminal performs predetermined signal processing on data transmitted from an external terminal and executes a predetermined function corresponding to the function information based on function information included in the signal processed data. 8. The lens barrel according to claim 7, Light source; A micro display panel for displaying the light generated from the light source and the screen generated based on the display information; An eyepiece disposed corresponding to the microdisplay panel for enlarging or reducing the polarized light emitted from the microdisplay panel; A polarized-light transmitting portion that transmits only polarized light in the same direction as the polarized light emitted by the eyepiece lens; And And a support for supporting the light source, the microdisplay panel, the eyepiece lens, and the polarized-light transmitting portion. 8. The lens barrel according to claim 7, Wherein the mobile terminal is mounted on one side of the inside or the outside of the mobile terminal or is configured to be detachable or mountable on one side of the mobile terminal.

Images