KR20110122003A - Mobile terminal - Google Patents

Abstract

PURPOSE: A mobile terminal is provided to use the gesture input of a user about an image examined from a projector by photographing the gesture input. CONSTITUTION: A touch screen(20) is prepared along the outer circumference of a stick type body. A projector is prepared into one end of the stick type body. A camera is prepared by facing the direction in which an image is researched from the projector. The camera photographs the gesture input about an image.

Description

Mobile terminal {MOBILE TERMINAL}

The present invention relates to a mobile terminal, and more particularly, to a mobile terminal that can capture and use a user's gesture input for an image irradiated from a projector.

A terminal such as a personal computer, a notebook computer, or a mobile phone has various functions, for example, a multimedia device having a complex function such as photographing or photographing of a moving picture, reproduction of music or a moving picture file, (Multimedia player).

The terminal can move It may be divided into a mobile terminal and a stationary terminal, depending on whether it is present. The mobile terminal may be further classified into a handheld terminal and a vehicle mount terminal according to whether a user can directly carry it.

In order to support and enhance the functionality of the terminal, it is contemplated to improve the structural and / or software portion of the terminal.

Recently, a variety of terminals including mobile terminals provide a complex and various functions, and the menu structure is also becoming complicated. In addition, a function of displaying various digital documents including a web page is added to a mobile terminal.

The present invention relates to a mobile terminal that can capture and use a user's gesture input for an image irradiated from a projector.

Mobile terminal according to an embodiment of the present invention for realizing the above object, the stick-shaped body; A touch screen provided along an outer circumferential surface of the stick-shaped body; A projector provided at one end of the stick-shaped body; And a camera provided in a direction in which the image is irradiated from the projector and photographing a gesture input to the image.

In addition, the mobile terminal according to an embodiment of the present invention for realizing the above object, a stick-shaped body; A touch screen provided along an outer circumferential surface of the stick-shaped body; A projector provided at one end of the stick-shaped body to irradiate an image; And a camera configured to detect a gesture input for the image irradiated from the projector.

In addition, the mobile terminal according to an embodiment of the present invention for realizing the above object, the first and second stick-type body is coupled to be substantially parallel to the axial direction, which one is rotatably coupled to the other ; A touch screen provided along an outer circumferential surface of at least one of the first and second stick-type bodies; A projector provided at one end of the first and second stick-type bodies to irradiate an image; And a camera provided at one end of the camera and photographing a gesture input.

In addition, the mobile terminal according to an embodiment of the present invention for realizing the above object, the first and second stick-type body is coupled to be substantially parallel to the axial direction, which one is rotatably coupled to the other ; A touch screen provided along an outer circumferential surface of at least one of the first and second stick-type bodies; A projector provided at one end of the first and second stick-type bodies to irradiate an image; A camera provided at one end to capture a gesture input; And a motion sensor module provided on at least one of the first and second stick-type bodies to sense a gesture input to the first and second stick-type bodies.

In addition, the mobile terminal according to an embodiment of the present invention for realizing the above object, a stick-shaped body; A touch screen provided along an outer circumferential surface of at least one of the stick-shaped bodies; A projector provided at one end of the stick-shaped body to irradiate an image; And a motion sensor module provided on the stick body to sense a change in posture of the stick body.

In addition, the mobile terminal according to an embodiment of the present invention for realizing the above object, a stick-shaped body; A touch screen provided along an outer circumferential surface of at least one of the stick-shaped bodies; A projector provided at one end of the stick-shaped body to irradiate an image; And a gesture detecting sensor provided at one end of the projector and sensing a gesture input.

The mobile terminal according to the present invention has an effect of photographing and using a user's gesture input for an image irradiated from a projector.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2 is a perspective view of the mobile terminal of FIG. 1.
3 is a diagram illustrating an operation of the mobile terminal of FIG. 2.
4 is a diagram illustrating a touch screen screen according to the operation of FIG. 3.
5 is a partial cutaway view of the mobile terminal of FIG. 2.
6 and 7 illustrate an operation of the mobile terminal of FIG. 1.
8 is a diagram illustrating another operation of the mobile terminal of FIG. 2.
FIG. 9 is a diagram illustrating still another operation of the mobile terminal of FIG. 2.
FIG. 10 is a partially enlarged view of the mobile terminal of FIG. 2.
FIG. 11 is a block diagram of a projector module of the mobile terminal of FIG. 1.
12 and 13 are views illustrating operations of the projector module and the camera of FIG. 11.
14 to 17 illustrate an operation of the mobile terminal of FIG. 2.
18 illustrates a mobile terminal according to another embodiment of the present invention.
19 illustrates a mobile terminal according to another embodiment of the present invention.
20 is a diagram illustrating a mobile terminal according to another embodiment of the present invention.

The above objects, features and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings. It is to be understood, however, that the invention is not limited to the disclosed embodiments, but, on the contrary, is intended to cover various modifications and similarities. Like reference numerals designate like elements throughout the specification. In addition, when it is determined that the detailed description of the known function or configuration related to the present invention may unnecessarily obscure the subject matter of the present invention, the detailed description thereof will be omitted. In addition, the numbers (eg, first, second, etc.) used in the description process of the present specification are merely identification symbols for distinguishing one component from another component.

Hereinafter, a mobile terminal according to the present invention will be described in more detail with reference to the accompanying drawings. The suffixes "module" and "unit" for components used in the following description are given or used in consideration of ease of specification, and do not have distinct meanings or roles from each other.

The mobile terminal described herein may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), navigation, and the like. However, it will be readily apparent to those skilled in the art that the configuration according to the embodiments described herein may also be applied to fixed terminals such as digital TVs, desktop computers, etc., except when applicable only to mobile terminals.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an audio / video input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory unit 160, An interface unit 170, a control unit 180, a power supply unit 190, and the like. The components shown in Fig. 1 are not essential, and a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and a network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a previously generated broadcast signal and / or broadcast related information and transmits the same to a terminal. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video BroadcastHandheld (DVBH).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems. In particular, the broadcast receiving module 111 may be a digital multimedia broadcasting broadcasting (DMBT), a digital multimedia broadcasting satellite (DMBS), a media forward link only (MediaFLO), a digital video broadcasting ), And ISDBT (Integrated Services Digital Broadcast Terrestrial). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems that provide broadcast signals as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory unit 160.

The mobile communication module 112 transmits and receives a wireless signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.

The wireless Internet module 113 refers to a module for wireless Internet access, and the wireless Internet module 113 can be embedded in the mobile terminal 100 or externally. WLAN (WiFi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short range communication module 114 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The location information module 115 is a module for confirming or obtaining the location of the mobile terminal. A representative example of the location information module is a GPS (Global Position System) module. According to the current technology, the GPS module 115 calculates information on a distance (distance) from three or more satellites to one point (entity), information on the time when the distance information is measured, , Three-dimensional position information according to latitude, longitude, and altitude of one point (individual) in one hour can be calculated. Furthermore, a method of calculating position and time information using three satellites and correcting the error of the calculated position and time information using another satellite is also used. The GPS module 115 may continuously calculate the current position in real time and use the same to calculate speed information.

Referring to FIG. 1, the A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory unit 160 or transmitted to the outside through the wireless communication unit 110. The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like.

The sensing unit 140 detects a current state of the mobile terminal 100 such as an open / closed state of the mobile terminal 100, a location of the mobile terminal 100, presence or absence of a user contact, orientation of the mobile terminal, acceleration / deceleration of the mobile terminal, and the like. To generate a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, it may be responsible for sensing functions related to whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to an external device, and the like. Meanwhile, the sensing unit 140 may include a proximity sensor.

The output unit 150 is used to generate an output related to sight, hearing, or tactile sense, and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154. Can be.

The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, the mobile terminal displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the mobile terminal 100 is in a video call mode or a photographing mode, the mobile terminal 100 displays photographed and / or received images, a UI, and a GUI.

The display unit 151 may be a liquid crystal display, a thin film transistor liquid crystal display, an organic light emitting diode, a flexible display, a 3D display And may include at least one.

Some of these displays can be configured to be transparent or light transmissive so that they can be seen from the outside. This may be referred to as a transparent display. A representative example of the transparent display is a transparent LCD. The rear structure of the display unit 151 may also be configured as a light transmissive structure. With this structure, the user can see the object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the implementation form of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from one another, or may be disposed integrally with one another, and may be disposed on different surfaces, respectively.

When the display unit 151 and a sensor for detecting a touch operation (hereinafter, referred to as a touch sensor) form a mutual layer structure (hereinafter, abbreviated as “touch screen”), the display unit 151 is an output device. It can also be used as an input device. The touch sensor may have, for example, a form of a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only the position and area of the touch but also the pressure at the touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can know which area of the display unit 151 is touched.

Referring to FIG. 1, a proximity sensor may be disposed in an inner region of the mobile terminal or in the vicinity of the touch screen, which is enclosed by the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.

When the touch screen is capacitive, the touch screen is configured to detect the proximity of the pointer by the change of the electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of allowing the pointer to be recognized without being in contact with the touch screen so that the pointer is located on the touch screen is referred to as a "proximity touch", and the touch The act of actually touching the pointer on the screen is called "contact touch." The position where the proximity touch is performed by the pointer on the touch screen refers to a position where the pointer is perpendicular to the touch screen when the pointer is in proximity proximity.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The sound output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory unit 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output module 152 outputs an acoustic signal related to a function (e.g., a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 100. The sound output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the mobile terminal 100. Examples of events occurring in the mobile terminal include call signal reception, message reception, key signal input, and touch input. The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than a video signal or an audio signal, for example, vibration. The video signal or the audio signal can also be output through the display unit 151 or the audio output module 152.

The haptic module 154 generates various tactile effects that the user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or may be sequentially output.

In addition to the vibration, the haptic module 154 may be used for the effects of stimulation by the arrangement of pins vertically moving with respect to the contact skin surface, the effect of the injection force of the air through the injection or inlet or the stimulation through the suction force, and the stimulation that rubs the skin surface. Various tactile effects may be generated, such as effects by stimulation through contact of electrodes, effects by stimulation using electrostatic force, and effects of reproducing a sense of warmth and heat using an endothermic or heat generating element.

The haptic module 154 may not only deliver the haptic effect through direct contact, but also implement the haptic effect through the muscle sense of the user's finger or arm. Two or more haptic modules 154 may be provided according to a configuration aspect of the mobile terminal 100.

The memory unit 160 may store a program for the operation of the controller 180 and may temporarily store input / output data (for example, a phone book, a message, a still image, a video, etc.). The memory unit 160 may store data regarding vibration and sound of various patterns output when a touch input on the touch screen is performed.

The memory unit 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory) At least one of a random access memory (RAM), a static random access memory (SRAM), a read only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read- Lt; / RTI > type of storage medium. The mobile terminal 100 may operate in association with a web storage that performs a storage function of the memory unit 160 on the Internet.

The interface unit 170 serves as a path with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or receives power from the external device to transfer the data to each component in the mobile terminal 100 or to transmit data in the mobile terminal 100 to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip that stores various types of information for authenticating the usage rights of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identify module (SIM), and a universal user authentication module ( Universal Subscriber Identity Module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

The interface unit may be a passage through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, or various command signals input from the cradle by a user may be moved. It may be a passage that is delivered to the terminal. Various command signals or power input from the cradle may be operated as signals for recognizing that the mobile terminal is correctly mounted on the cradle.

The control unit 180 typically controls the overall operation of the mobile terminal. For example, perform related control and processing for voice calls, data communications, video calls, and the like. The controller 180 may include a multimedia module 181 for playing multimedia. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The controller 180 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on the touch screen as text and an image, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

Various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using, for example, software, hardware or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays May be implemented using at least one of processors, controllers, microcontrollers, microprocessors, and electrical units for performing functions. In some cases such embodiments may be implemented using a controller 180 < / RTI >

In a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that allow at least one function or operation to be performed. The software code may be implemented by a software application written in a suitable programming language. Also, the software codes may be stored in the memory unit 160 and executed by the control unit 180. [

The sensing unit 140 may include a motion sensor module 142.

The motion sensor module 142 may detect a change in posture of the mobile terminal 100. The posture change may include a change in the angle that the mobile terminal 100 makes with the ground at a specific point, a movement from the first point to the second point, and the like. Detecting a change in angle, movement, or the like means detecting at least one of a moving direction, a moving speed, and a moving acceleration in a specific reference posture. As will be described in more detail in the corresponding part, the motion sensor module 142 may be provided at any one side of the mobile terminal 100 or at a plurality of positions inside the mobile terminal 100. The motion sensor module 142 may include an acceleration sensor, a GPS sensor, and the like.

The acceleration sensor may detect an acceleration change in the process of moving from the first point to the second point. By integrating the acceleration detected by the acceleration sensor, the speed can be known, and by integrating the speed, the distance can be known. In the case of differentiating a specific value, an abnormal value may be calculated due to the influence of noise, and thus, a desired value may be calculated by integrating after detecting the acceleration.

The GPS sensor may detect a signal received from the satellite. If the received signal is processed through a preset method, absolute coordinates on the surface of the earth can be calculated. By substituting the time, the speed and the like can be known.

The output unit 150 may further include a projector module 155. The projector module 155 may be a device that projects an image using a light and lens system. The projector module 155 may express an image by irradiating light onto a plane such as a screen. The mobile terminal 100 according to an embodiment of the present invention may irradiate an image to a flat surface around a desk, a wall, etc., as well as a specific position such as a screen. As a result, the location of the image may be less restricted. In addition, due to the small size of the body (10 of FIG. 2), even if the area of the display (30 of FIG. 2) is small, information display may not be restricted. The configuration of the projector module 155 will be described in more detail in the corresponding part.

2 is a perspective view of the mobile terminal of FIG. 1.

As shown in the drawing, the mobile terminal 100 according to the embodiment of the present invention includes a stick type body 10, a touch screen 20 provided along an outer circumferential surface of the stick type body 10, and It may include an input button 30 provided at one end of the stick-shaped body (30).

Stick-shaped body 10 may be cylindrical. That is, it means that it may have a cylindrical shape. The stick-shaped body 10 may be long in the axial direction (X direction). That is, compared with the length of the cylinder in the radial direction (Z direction), it means that the length of the cylinder in the axial direction (X direction) can be provided longer. Due to the long cylindrical shape in the axial direction (X direction), it is easy for the user to store the mobile terminal 100. For example, it may be more convenient to store in a shirt pocket or the like. In addition, the user may be easier to grip the mobile terminal 100 than the rectangular shape. Furthermore, unique manipulation may be possible using the shape of the stick-shaped body 10. For example, it means that the operation such as rotating the stick-shaped body 10 can be possible. Rotational manipulation for the stick-shaped body 10 may be possible by being divided into first and second stick-type bodies 12 and 14 in which the stick-shaped body 10 is rotatable.

The first and second stick type bodies 12 and 14 may be provided side by side in the axial direction (X direction). In addition, the first and second stick type bodies 12 and 14 may be rotated when the other is based on one of them. For example, after the user grips the first and second stick-shaped bodies 12 and 14 with different hands, it means that the first stick-shaped body 12 can be rotated clockwise or counterclockwise. . When the first stick-shaped body 12 receives a signal that is rotated in a clockwise or counterclockwise direction, the controller (180 of FIG. 1) may perform a specific operation such as selecting a specific item or switching a screen. . Between the first and second stick type bodies 12 and 14, a circular annular spacer 16 may be positioned to smoothly rotate the first and second stick types 12 and 14. Can be.

The touch screen 20 may be located on the outer circumferential surface of the stick-shaped body 10. The touch screen 20 located on the outer circumferential surface of the stick-shaped body 10 may be provided in a cylindrical shape. That is, the touch screen 20 may be a curved surface rather than a plane. The touch screen 20 may be provided in one area or the entire area of the outer circumferential surface of the stick-shaped body 10. The touch screen 20 may be viewed as an output unit (150 of FIG. 1) in terms of displaying an image, and may be viewed as a user input unit (130 in FIG. 1) in terms of receiving a user's touch input through the touch screen 20. can see.

The input button 30 may be provided at one end of the stick-shaped body 10. Through the input button 30 provided at one end of the stick-shaped body 10 may receive a physical key input from the user. That is, when the user presses the input button 30 in the axial direction (X direction), the input button 30 may move in the axial direction (X direction) and generate a key signal. When the controller (180 of FIG. 1) receives the generated key signal, the controller (180 of FIG. 1) may perform a specific operation corresponding thereto such as changing the display of the touch screen 20.

3 is a diagram illustrating an operation on the mobile terminal of FIG. 2, and FIG. 4 is a diagram illustrating a touch screen screen according to the operation of FIG. 3.

As shown in these figures, the mobile terminal 100 according to an embodiment of the present invention can be performed to perform a specific operation through the operation of pressing the input button (30).

As shown in FIG. 3, the standby screen may be displayed on the touch screen 20 until the user performs a specific operation. Various screens may be displayed as the standby screen, and FIG. 3 illustrates a case in which the current time is displayed. The user may take an action of pressing the input button 30 at the end of the second stick-shaped body 14 while holding the first stick-shaped body 12 with one hand.

As illustrated in FIG. 4, when the input button 30 is pressed, the controller (180 of FIG. 1) may display the icon I on the touch screen 20. The displayed icons I may be those corresponding to each function of the mobile terminal 100. In FIG. 4, the standby screen is switched to the icon I display screen by pressing the input button 30, but the function due to the pressing on the input button 30 is not limited thereto.

5 is a partial cutaway view of the mobile terminal of FIG. 2.

As shown in the drawing, the stick type body 10 of the mobile terminal 100 according to an embodiment of the present invention may be divided into a first stick type body 12 and a second stick type body 14. The first and second stick type bodies 12 and 14 may be rotatably coupled to the other side with respect to one side.

First and second coupling structures 13 and 15 may be provided in the first stick-shaped body 12 and the second stick-shaped body 14, respectively. That is, the first coupling structure 13 extending from the first stick-shaped body 12 and the second coupling structure 15 extending from the second stick-shaped body 14 may be provided. The first coupling structure 13 and the second coupling structure 15 may be uneven structures corresponding to each other. When the first and second coupling structures 13 and 15 are combined in a concave-convex structure, the first and second stick-shaped bodies 12 and 14 are not easily disassembled by external force, but in the axial direction (X direction in FIG. 2). It can be a structure rotatable with respect to each other. Spacers 16 may be provided between the first and second stick-shaped bodies 12 and 14.

The spacer 16 may have an annular shape surrounding the outside of the stick-shaped body 10. The spacer 16 located between the first and second stick-type bodies 12 and 14 may prevent the coupling of the first and second stick-type bodies 12 and 14 to be excessively strong or too loose. That is, the spacer 16 may play a role in which the first and second stick-shaped bodies 12 and 14 are coupled to each other at an appropriate coupling tolerance.

6 and 7 illustrate an operation of the mobile terminal of FIG. 1.

As shown in these figures, the mobile terminal 100 according to an embodiment of the present invention may be coupled so that any one of the first and second stick-shaped bodies 12 and 14 can be rotated with respect to the other.

As shown in FIG. 6, a specific screen may be displayed on the touch screen 20 of the second stick-shaped body 14. The specific screen may display a list L which should be selected by the user. For example, as shown in the drawing, a list L listing the names of the parties to whom the message is to be sent or the call may be displayed. The user can rotate the first stick-shaped body 12 lying in the axial direction (X direction) by applying an external force. The wrist L is indicated in the orthogonal direction (Y direction) with respect to the axial direction (X direction), and the first stick-shaped body 12 rotates in the orthogonal direction (Y direction). Selection of the list L through the rotation of 12 may be intuitive. That is, when the first stick-shaped body 12 is rotated in the direction shown in FIG. 6, the indicator also moves in the direction, and the items displayed in the list L can be selected.

As shown in FIG. 7, as a result of the rotation of the first stick-shaped body 12, Paul Smith, located below Kerstin, was selected and the image IM corresponding to the person was displayed.

8 is a diagram illustrating another operation of the mobile terminal of FIG. 2, and FIG. 9 is a diagram illustrating another operation of the mobile terminal of FIG. 2.

As shown in the drawing, the mobile terminal 100 according to an embodiment of the present invention may receive an input through the touch screen 20 or provide information to a user.

As illustrated in FIG. 8, an image reflecting the operation of the mobile terminal 100 may be displayed on the touch screen 20. For example, as illustrated in FIG. 8, a numeric input keyboard N for inputting a phone number of a counterpart to be called may be displayed. The user may select by touching the numeric input keyboard N with the finger F or the like.

The touch screen 20 may be installed on one or both of the first and second stick type bodies 12 and 14. For example, the touch screen 20 is provided on the outer circumferential surface of the first stick-shaped body 12, or is provided on the outer circumferential surface of the second stick-shaped body 14, or the first and second stick-type bodies 12 and 14. Each may be provided in.

As shown in FIG. 9, the information M to inform the user may be displayed on the touch screen 20 of the mobile terminal 100 according to an exemplary embodiment of the present invention. For example, as shown in FIG. 9, the touch screen 20 may display information M indicating that a message has been received.

FIG. 10 is a partially enlarged view of the mobile terminal of FIG. 2.

As shown in the drawing, the projector 155 and the camera 121 may be provided in the mobile terminal 100 according to the exemplary embodiment of the present invention.

The projector 155 may display an image by irradiating light toward an external object. Since the image may be displayed on the surface of the external object instead of the display 20, necessary information may be displayed without being limited to the size of the area of the display 20. The image displayed through the projector 155 and the image displayed on the touch screen 20 may be different from each other (M). For example, when a text message is received, simple information such as a sender and a reception time may be displayed on the touch screen 20, and actual text message contents may be displayed through the projector 155. In such a case, the user may selectively activate the projector 155 only when the user wants to check the contents of the brief information displayed on the touch screen 20.

The projector 155 may be provided at one end of the stick-shaped body 10. For example, as shown, it may be located at the end of the first stick-shaped body 12. By being located at the end of the first stick-shaped body 12, the user can naturally grip and use the stick-shaped body 10 to face the surface of the object to be displayed. How the projector 155 displays an image will be described in more detail in the corresponding part.

The camera 121 may photograph an external image. More specifically, the camera 121 may photograph a user's gesture (including a gesture) input. Although sensing is performed in a manner of capturing a visual image, the camera 121 may be a kind of a gesture detection sensor in that it senses a gesture taken by a user.

The gesture image photographed through the camera 121 may be transmitted to the controller 180 of FIG. 1. The controller (180 of FIG. 1) receiving the gesture image may analyze the information and activate or deactivate the corresponding function if the gesture is related to the specific function of the mobile terminal 100.

The camera 121 may be provided on the same plane as the projector 155. As described above, since the projector 155 according to an embodiment of the present invention is provided at one end of the stick-shaped body 10, the camera 121 may also be provided at the same end of the stick-shaped body 10. have. The gesture captured by the camera 121 may be a user's gesture with respect to an image displayed through the projector 155. Therefore, when the camera 121 is displayed in the direction in which the image is irradiated from the projector 155, the user's gesture action on the irradiated image may be smoothly captured. For example, the image irradiated through the projector 155 may be a virtual key. When the virtual key is displayed on the surface of the external object through the projector 155, the user may perform a key input operation by moving a finger on the displayed virtual key. Since the camera 121 is provided in the same direction as the projector 155, the camera 121 may capture a user's finger movement with respect to the irradiated image.

FIG. 11 is a block diagram of a projector module of the mobile terminal of FIG. 1.

As shown in the drawing, the projector module 155 of the mobile terminal 100 according to an embodiment of the present invention may include a light source 156, an optical processor 157, and a modulator 158.

The light source 156 may generate light of each of RGB or RGB. The light source 156 may be a LED or laser that can efficiently emit light. Light generated by the light source 156 may be transmitted to the optical processor 157.

The optical processor 157 may be a combination of singular or plural lenses. For example, the optical processor 157 may be a color synthesis system including a condenser lens and a dichroic mirror for passing only light of a specific wavelength. Light emitted from the light source 156 may pass through the lenses and be shaped into light of a predetermined shape. That is, the light generated from the light source 156 may be in the form of being radiated in a fan shape by using the light source 156 as a viewpoint, but it may be processed into light having the same optical axis through the optical processor 157. The optical processor 157 may be located before and after the modulator 158.

The modulator 158 may form an image according to a control signal of the controller 180. The modulator 158 may adjust the intensity of light by adjusting the degree of light transmission and the degree of light reflection. That is, it means that the light in the form of RGB passes through the modulator 158 and has a constant shape. Therefore, when the light is reflected on the projection surface PL after passing through the modulator 158 and further through the optical processing unit 157, a shape that can be visually recognized by the user may be seen.

12 and 13 are views illustrating operations of the projector module and the camera of FIG. 11.

As shown in these figures, the mobile terminal 100 according to an embodiment of the present invention may project an image by a projection method, recognize a gesture operation on the projected image, and execute a specific function.

As illustrated in FIG. 12, the user may examine the received message DM on the projection surface PL. Irradiation of the image onto the projection surface PL may be performed through the projector 155 of FIG. 10. The controller (180 of FIG. 1) may cause the image displayed on the display 20 and the image displayed on the projection surface PL to be different from each other when the image is irradiated on the projection surface PL. That is, a brief description of the projected content is displayed on the display 20, and the content itself may be displayed on the projection surface PL. For example, as shown, the display 20 indicates that a message from James Brown has arrived at 12:59 am, and means that the received message DM itself may be displayed on the projection surface PL. .

As shown in FIG. 13, the user may make a gesture of selecting the menu ME with the finger F or the like. When the user makes a gesture, the controller (180 of FIG. 1) may analyze the recognized image captured by the camera (121 of FIG. 10) and recognize the same. That is, the controller 180 of FIG. 1 may analyze the image photographed by the camera 121 of FIG. 10 to determine whether there is a gesture in the menu area (ME), and if so, what gesture it is. For example, as illustrated, the user is taking a gesture of touching the 'Reply' part of the menu ME with the finger F. As shown in FIG. When the gesture motion is photographed by the camera 121 (see FIG. 10) and transmitted to the controller 180 (FIG. 1), the controller 180 (FIG. 1) analyzes the gesture motion and touches a specific area of the menu ME. Can be determined. If it is determined that the touch operation is applied to a specific area of the menu ME, the controller 180 of FIG. 1 may display an indicator for visually displaying the touched point and execute a function corresponding to the touch operation.

14 to 17 illustrate an operation of the mobile terminal of FIG. 2.

As shown in these figures, the mobile terminal 100 according to an embodiment of the present invention can detect a change in posture of the mobile terminal 100 itself and recognize the detected change in posture corresponding to a text. In addition, the recognized character RM may be displayed on the display 20.

As shown in FIG. 14, the user may take a gesture of holding and writing the mobile terminal 100. For example, the user may grasp the mobile terminal 100 and perform a writing operation WM that writes 'How's it go' toward the virtual projection surface PL. The writing operation WM taken by the user may be sensed through the motion sensor module 142 of FIG. 1 embedded in the mobile terminal 100. The motion sensor module 142 of FIG. 1 may be a kind of gesture detection sensor in that it detects a gesture that the mobile terminal 100 takes in a two-dimensional or three-dimensional space.

When the writing operation WM taken by the user is detected, the controller 180 of FIG. 1 may determine which character the writing operation WM corresponds to. When the controller 180 of FIG. 1 recognizes a character corresponding to the writing operation WM taken by the user, an input value for a specific application may be used as the recognized character. For example, if the SMS application is running, the SMS may be sent with the recognized text. In addition, the controller 180 of FIG. 1 may display the character corresponding to the writing operation WM on the display 20. The user may look at the text display RM and determine whether the input is as intended. In addition to the character display RM of the recognized character, the display unit 20 may also display an icon I indicating that the current writing gesture input mode is present.

As shown in FIG. 15, the user may move the three-dimensional space by holding the mobile terminal 100. That is, it may start from the first position P1 and move to the third position P3 via the second position P2. When moving each position, the angle and acceleration may be different. The motion sensor module 142 of FIG. 1 may detect a user's gesture input by detecting such a change in angle and acceleration.

As shown in FIG. 16, the movement of the mobile terminal 100 may be represented by a trajectory TR. The trajectory TR represents a path in which the mobile terminal 100 moves in space to represent a specific character. By considering the slopes TL1 and TL2 of the trajectory TR and the time before and after the specific slopes TL1 and TL2, the controller TR may determine the change of the trajectory TR of the mobile terminal 100. Therefore, if the change of the trajectory TR is continuously tracked, the user may recognize the character to be displayed through the mobile terminal 100.

As shown in FIG. 17, the motion sensor module 142 may be located inside the end of the mobile terminal. The first position P1 corresponds to the first mobile terminal 100a, the second position P2 corresponds to the second mobile terminal 100b, and the third position P3 corresponds to the third mobile terminal 100c. May correspond to. Since the user can be expected to move the mobile terminal 100 by holding the upper side of the mobile terminal 100, it is possible that the motion sensor module 142 is positioned at the end side opposite to the position where the user grips. The user's gesture applied to 100 may be effectively detected. However, the position and number of the mossen sensor module 142 is not limited thereto.

18 illustrates a mobile terminal according to another embodiment of the present invention.

As shown in the drawing, the mobile terminal 100 according to another embodiment of the present invention may be provided with a display 20 on each of the first and second stick-type bodies 12 and 14. That is, the first display 20a may be located on the first stick-shaped body 12, and the second display 20b may be positioned on the second stick-shaped body 14. Therefore, more information can be expressed through the display 20.

19 illustrates a mobile terminal according to another embodiment of the present invention.

As shown in the drawing, in the mobile terminal 100 according to another embodiment of the present invention, the light emitting part 25 may be provided in the first stick-shaped body 12. The light emitter 25 may emit light when the first stick-shaped body 12 is rotated to display an operating state. For example, in the center of the light emitting unit 25, there is an arrow-type light emitting body pointing to the currently selected item, and on the left and right sides thereof, there may be a light emitting body indicating the direction of rotation.

20 is a diagram illustrating a mobile terminal according to another embodiment of the present invention.

As shown in the drawing, the mobile terminal 100 according to another embodiment of the present invention can transmit content to other electronic devices 200, 300, and 400. For example, this means that the received message may be displayed on the display 251 of the TV 200. At this time, the other electronic devices 200, 300, 400 to be transmitted are automatically adjusted according to the location where the mobile terminal 100 is located, the distance to the mobile terminal 100, or the like. ) Can be selected.

As described above, the present invention is not limited to the described embodiments, and various modifications and changes can be made without departing from the spirit and scope of the present invention. Accordingly, such modifications or variations are intended to fall within the scope of the appended claims.

100: mobile terminal 110: wireless communication unit
140: sensing unit 151: display unit
180:

Claims (27)

Stick-shaped body;
A touch screen provided along an outer circumferential surface of the stick-shaped body;
A projector provided at one end of the stick-shaped body; And
And a camera provided in a direction in which the image is irradiated from the projector and photographing a gesture input to the image. The method of claim 1,
The touch screen,
Mobile terminal characterized in that the curved surface along the outer peripheral surface. The method of claim 1,
The mobile terminal further comprises at least one input button provided on at least one end of the stick-shaped body. The method of claim 1,
The stick-shaped body,
A mobile terminal, characterized in that it comprises a first and second stick-type body coupled to be substantially parallel to the axial direction, one of which is rotatably coupled to the other. The method of claim 4, wherein
Mobile terminal, characterized in that the coupling portion of the first and second stick-type body, further provided with an annular spacer so that the coupling tolerance of the first and second stick-type body is within the set range. The method of claim 1,
And a control unit for allowing the first image displayed through the projector to be different from the second image displayed on the touch screen. The method of claim 1,
And a controller configured to cause the second image displayed on the touch screen to be different from the first image from the time when the first image is displayed through the projector. The method of claim 1,
The mobile terminal further comprises a motion sensor module provided in the stick-like body, the gesture sensor for detecting the gesture input to the stick-shaped body. The method of claim 8,
And a controller configured to display a character corresponding to the gesture input on the display. Stick-shaped body;
A touch screen provided along an outer circumferential surface of the stick-shaped body;
A projector provided at one end of the stick-shaped body to irradiate an image; And
A mobile terminal comprising a camera for detecting a gesture input for the image irradiated from the projector. The method of claim 10,
The mobile terminal further comprises at least one input button provided on at least one end of the stick-shaped body. The method of claim 10,
The stick-shaped body,
A mobile terminal, characterized in that it comprises a first and second stick-type body coupled to be substantially parallel to the axial direction, one of which is rotatably coupled to the other. The method of claim 10,
And a control unit for allowing the first image displayed through the projector to be different from the second image displayed on the touch screen. The method of claim 10,
The mobile terminal further comprises a motion sensor module provided in the stick-like body, the gesture sensor for detecting the gesture input to the stick-shaped body. The method of claim 14,
And a controller configured to display a character corresponding to the gesture input on the display. First and second stick-type bodies coupled substantially parallel to the axial direction, one of which is rotatably coupled to the other;
A touch screen provided along an outer circumferential surface of at least one of the first and second stick-type bodies;
A projector provided at one end of the first and second stick-type bodies to irradiate an image; And
A mobile terminal provided at one end of the mobile terminal, comprising a camera for capturing a gesture input. 17. The method of claim 16,
And a control unit for allowing the first image displayed through the projector to be different from the second image displayed on the touch screen. 17. The method of claim 16,
The mobile terminal further comprises a motion sensor module provided on at least one side of the first and second stick type bodies to sense a gesture input to the first and second stick types. 19. The method of claim 18,
And a controller configured to display a character corresponding to the gesture input on the display. First and second stick-type bodies coupled substantially parallel to the axial direction, one of which is rotatably coupled to the other;
A touch screen provided along an outer circumferential surface of at least one of the first and second stick-type bodies;
A projector provided at one end of the first and second stick-type bodies to irradiate an image;
A camera provided at one end to capture a gesture input; And
And a motion sensor module provided in at least one of the first and second stick-type bodies to sense a gesture input to the first and second stick-type bodies. The method of claim 20,
And a control unit for allowing the first image displayed through the projector to be different from the second image displayed on the touch screen. The method of claim 20,
And a controller configured to display a character corresponding to the gesture input on the display. Stick-shaped body;
A touch screen provided along an outer circumferential surface of at least one of the stick-shaped bodies;
A projector provided at one end of the stick-shaped body to irradiate an image; And
A mobile terminal provided on the stick-shaped body, the motion sensor module for detecting a change in posture of the stick-shaped body. 24. The method of claim 23,
And a control unit for allowing the first image displayed through the projector to be different from the second image displayed on the touch screen. 25. The method of claim 24,
And a controller configured to display a character corresponding to the gesture input on the display. Stick-shaped body;
A touch screen provided along an outer circumferential surface of at least one of the stick-shaped bodies;
A projector provided at one end of the stick-shaped body to irradiate an image; And
And a gesture detecting sensor provided at one end of the projector and detecting a gesture input. The method of claim 26,
The gesture sensor,
At least one of a camera for photographing the gesture input and a motion sensor module for detecting a gesture input to move the position of the stick-shaped body.

Images