Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. , ≪ / RTI > equivalents, and alternatives.
The mobile terminal described in this specification includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, a slate PC A tablet PC, an ultrabook, a wearable device such as a smartwatch, a smart glass, and a head mounted display (HMD). have.
However, it should be understood by those skilled in the art that the configuration according to the embodiments described herein may be applied to fixed terminals such as a digital TV, a desktop computer, a digital signage, and the like, It will be easy to see.
1 is a block diagram illustrating a mobile terminal according to the present invention.
1, the mobile terminal 100 includes a wireless communication unit 110, an input unit 120, a sensing unit 140, an output unit 150, an interface unit 160, a memory 170, a controller 180, And a power supply unit 190 and the like. The components shown in FIG. 1 are not essential for implementing a mobile terminal, so that the mobile terminal described herein may have more or fewer components than the components listed above.
The wireless communication unit 110 may be connected between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and another mobile terminal 100 or between the mobile terminal 100 and the external server 100. [ Lt; RTI ID = 0.0 > wireless < / RTI > In addition, the wireless communication unit 110 may include one or more modules for connecting the mobile terminal 100 to one or more networks.
The wireless communication unit 110 may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short distance communication module 114, and a location information module 115 .
The input unit 120 includes a camera 121 or an image input unit for inputting a video signal, a microphone 122 for inputting an audio signal, an audio input unit, a user input unit 123 for receiving information from a user A touch key, a mechanical key, and the like), and a finger scan sensor 124. The voice data or image data collected by the input unit 120 may be analyzed and processed by a user's control command.
The sensing unit 140 may include at least one sensor for sensing at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information. For example, the sensing unit 140 may include a proximity sensor 141, an illumination sensor 142, a touch sensor, an acceleration sensor, a magnetic sensor, A G-sensor, a gyroscope sensor, a motion sensor, an RGB sensor, an infrared sensor, an ultrasonic sensor, an optical sensor, A microphone 226, a battery gauge, an environmental sensor (for example, a barometer, a hygrometer, a thermometer, a radiation sensor, a heat sensor, a gas sensor, or the like) , A chemical sensor (e. G., An electronic nose, a healthcare sensor, a biometric sensor, etc.). Meanwhile, the mobile terminal disclosed in the present specification can combine and utilize information sensed by at least two of the sensors.
The output unit 150 includes at least one of a display unit 151, an acoustic output unit 152, a haptic tip module 153, and a light output unit 154 to generate an output related to visual, auditory, can do. The display unit 151 may have a mutual layer structure with the touch sensor or may be integrally formed to realize a touch screen. The touch screen may function as a user input unit 123 that provides an input interface between the mobile terminal 100 and a user and may provide an output interface between the mobile terminal 100 and a user.
The interface unit 160 serves as a path to various types of external devices connected to the mobile terminal 100. The interface unit 160 is connected to a device having a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, And may include at least one of a port, an audio I / O port, a video I / O port, and an earphone port. In the mobile terminal 100, corresponding to an external device being connected to the interface unit 160, it is possible to perform appropriate control related to the connected (paired) external device.
In addition, the memory 170 stores data supporting various functions of the mobile terminal 100. The memory 170 may store a plurality of application programs or applications driven by the mobile terminal 100, data for operation of the mobile terminal 100, and commands. At least some of these applications may be downloaded from an external server via wireless communication. Also, at least a part of these application programs may exist on the mobile terminal 100 from the time of shipment for the basic functions (e.g., telephone call receiving function, message receiving function, and calling function) of the mobile terminal 100. Meanwhile, the application program may be stored in the memory 170, installed on the mobile terminal 100, and operated by the control unit 180 to perform the operation (or function) of the mobile terminal.
In addition to the operations related to the application program, the control unit 180 typically controls the overall operation of the mobile terminal 100. The control unit 180 may process or process signals, data, information, and the like input or output through the above-mentioned components, or may drive an application program stored in the memory 170 to provide or process appropriate information or functions to the user.
In addition, the controller 180 may control at least some of the components illustrated in FIG. 1 in order to drive an application program stored in the memory 170. FIG. In addition, the controller 180 may operate at least two of the components included in the mobile terminal 100 in combination with each other for driving the application program.
The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power to the components included in the mobile terminal 100. The power supply unit 190 may include a battery, and the battery may be an internal battery or a replaceable battery.
At least some of the components may operate in cooperation with one another to implement a method of operation, control, or control of a mobile terminal according to various embodiments described below. The method of operation, control, or control of the mobile terminal may also be implemented on the mobile terminal by driving at least one application program stored in the memory 170. [
Hereinafter, the components listed above will be described in more detail with reference to FIG. 1 before explaining various embodiments implemented through the mobile terminal 100 as described above.
First, referring to the wireless communication unit 110, the broadcast receiving module 111 of the wireless communication unit 110 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.
The mobile communication module 112 may be a mobile communication module or a mobile communication module such as a mobile communication module or a mobile communication module that uses technology standards or a communication method (e.g., Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE) And an external terminal, or a server on a mobile communication network established according to a long term evolution (e. G., Long Term Evolution-Advanced).
The wireless signal may include various types of data in response to a voice signal, a video call signal, or a text / multimedia message transmission / reception.
The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. The wireless Internet module 113 is configured to transmit and receive a wireless signal in a communication network according to wireless Internet technologies.
Wireless Internet technologies include, for example, wireless LAN (WLAN), wireless fidelity (Wi-Fi), wireless fidelity (Wi-Fi) Direct, DLNA (Digital Living Network Alliance), WiBro Interoperability for Microwave Access, High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE) and Long Term Evolution-Advanced (LTE-A) Transmits and receives data according to at least one wireless Internet technology, including Internet technologies not listed above.
The wireless Internet module 113 for performing a wireless Internet connection through the mobile communication network in view of wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE, LTE- May be understood as a kind of mobile communication module 112.
The short-range communication module 114 is for short-range communication, and includes a Bluetooth, a Radio Frequency Identification (RFID), an Infrared Data Association (IrDA), an Ultra Wideband (UWB), a ZigBee, Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology. The short-range communication module 114 is connected to the mobile terminal 100 and the wireless communication system through the wireless area networks, between the mobile terminal 100 and another mobile terminal 100, or between the mobile terminal 100 ) And the other mobile terminal 100 (or the external server). The short-range wireless communication network may be a short-range wireless personal area network.
Here, the other mobile terminal 100 may be a wearable device (e.g., a smartwatch, a smart glass, etc.) capable of interchanging data with the mobile terminal 100 according to the present invention (smart glass), HMD (head mounted display)). The short range communication module 114 can detect (or recognize) a wearable device capable of communicating with the mobile terminal 100 around the mobile terminal 100. [ If the detected wearable device is a device authenticated to communicate with the mobile terminal 100 according to the present invention, the control unit 180 may transmit at least part of the data processed by the mobile terminal 100 to the local communication module 114 ) To the wearable device. Therefore, the user of the wearable device can use the data processed by the mobile terminal 100 through the wearable device. For example, according to this, when a telephone is received in the mobile terminal 100, the user performs a telephone conversation via the wearable device, or when a message is received in the mobile terminal 100, It is possible to check the message.
The position information module 115 is a module for obtaining the position (or current position) of the mobile terminal, and a representative example thereof is a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, when the mobile terminal utilizes the GPS module, it can acquire the position of the mobile terminal by using a signal transmitted from the GPS satellite. As another example, when the mobile terminal utilizes the Wi-Fi module, it can acquire the position of the mobile terminal based on information of a wireless access point (AP) that transmits or receives the wireless signal with the Wi-Fi module. Optionally, the location information module 115 may perform any of the other functions of the wireless communication unit 110 to obtain data relating to the location of the mobile terminal, in addition or alternatively. The location information module 115 is a module used to obtain the location (or current location) of the mobile terminal, and is not limited to a module that directly calculates or obtains the location of the mobile terminal.
Next, the input unit 120 is for inputting image information (or signal), audio information (or signal), data, or information input from a user. For inputting image information, Or a plurality of cameras 121 may be provided. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame may be displayed on the display unit 151 or stored in the memory 170. [ A plurality of cameras 121 provided in the mobile terminal 100 may be arranged to have a matrix structure and various angles or foci may be provided to the mobile terminal 100 through the camera 121 having the matrix structure A plurality of pieces of image information can be input. In addition, the plurality of cameras 121 may be arranged in a stereo structure to acquire a left image and a right image for realizing a stereoscopic image.
The microphone 122 processes the external acoustic signal into electrical voice data. The processed voice data can be utilized variously according to a function (or a running application program) being executed in the mobile terminal 100. Meanwhile, the microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in receiving an external sound signal.
The user input unit 123 is for receiving information from a user and when the information is inputted through the user input unit 123, the control unit 180 can control the operation of the mobile terminal 100 to correspond to the input information . The user input unit 123 may include a mechanical input means (or a mechanical key such as a button located on the front or side of the mobile terminal 100, a dome switch, a jog wheel, Etc.) and touch-type input means. For example, the touch-type input means may comprise a virtual key, a soft key or a visual key displayed on the touch screen through software processing, And a touch key disposed on the touch panel. Meanwhile, the virtual key or the visual key can be displayed on a touch screen having various forms, for example, a graphic, a text, an icon, a video, As shown in FIG.
Meanwhile, the sensing unit 140 senses at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information, and generates a corresponding sensing signal. The control unit 180 may control the driving or operation of the mobile terminal 100 or may perform data processing, function or operation related to the application program installed in the mobile terminal 100 based on the sensing signal.
The ultrasonic sensor can recognize the position information of the object to be sensed by using ultrasonic waves. Meanwhile, the controller 180 can calculate the position of the wave generating source through the information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave source can be calculated using the fact that the light is much faster than the ultrasonic wave, that is, the time when the light reaches the optical sensor is much faster than the time the ultrasonic wave reaches the ultrasonic sensor. More specifically, the position of the wave generating source can be calculated using the time difference with the time when the ultrasonic wave reaches the reference signal.
The camera 121 includes at least one of a camera sensor (for example, a CCD, a CMOS, etc.), a photo sensor (or an image sensor), and a laser sensor.
The camera 121 and the laser sensor may be combined with each other to sense a touch of the sensing object with respect to the three-dimensional stereoscopic image. The photosensor can be laminated to the display element, which is adapted to scan the movement of the object to be detected proximate to the touch screen. More specifically, the photosensor mounts photo diodes and TRs (Transistors) in a row / column and scans the contents loaded on the photosensor using an electrical signal that varies according to the amount of light applied to the photo diode. That is, the photo sensor performs coordinate calculation of the object to be sensed according to the amount of change of light, and position information of the object to be sensed can be obtained through the calculation.
The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, the display unit 151 may display execution screen information of an application program driven by the mobile terminal 100 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information .
Also, the display unit 151 may be configured as a stereoscopic display unit for displaying a stereoscopic image.
In the stereoscopic display unit, a three-dimensional display system such as a stereoscopic system (glasses system), an autostereoscopic system (no-glasses system), a projection system (holographic system) can be applied.
The sound output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output unit 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output unit 152 may include a receiver, a speaker, a buzzer, and the like.
The haptic module 153 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 153 may be vibration. The intensity and pattern of the vibration generated in the haptic module 153 can be controlled by the user's selection or the setting of the control unit. For example, the haptic module 153 may combine and output different vibrations or sequentially output the vibrations.
In addition to vibration, the haptic module 153 may be configured to perform various functions such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.
The haptic module 153 can transmit the tactile effect through the direct contact, and the tactile effect can be felt by the user through the muscles of the finger or arm. The haptic module 153 may include two or more haptic modules 153 according to the configuration of the mobile terminal 100.
The light output unit 154 outputs a signal for notifying the occurrence of an event using the light of the light source of the mobile terminal 100. Examples of events that occur in the mobile terminal 100 may include message reception, call signal reception, missed call, alarm, schedule notification, email reception, information reception through an application, and the like.
The signal output from the light output unit 154 is implemented as the mobile terminal emits light of a single color or a plurality of colors to the front or rear surface. The signal output may be terminated by the mobile terminal detecting the event confirmation of the user.
The interface unit 160 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 160 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data in the mobile terminal 100 to an external device. For example, a port for connecting a device equipped with a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, an audio I / O port, a video I / O port, an earphone port, and the like may be included in the interface unit 160.
The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM) A universal subscriber identity module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the interface unit 160. [
The interface unit 160 may be a path through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, May be a path through which the mobile terminal 100 is transmitted. The various command signals or the power source input from the cradle can be operated as a signal for recognizing that the mobile terminal 100 is correctly mounted on the cradle.
The memory 170 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 170 may store data related to vibrations and sounds of various patterns output upon touch input on the touch screen.
The memory 170 may be a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), a multimedia card micro type ), Card type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read memory, a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs storage functions of the memory 170 on the Internet.
Meanwhile, as described above, the control unit 180 controls the operations related to the application program and the general operation of the mobile terminal 100. [ For example, when the state of the mobile terminal meets a set condition, the controller 180 can execute or release a lock state for restricting input of a user's control command to applications.
In addition, the control unit 180 performs control and processing related to voice communication, data communication, video call, or the like, or performs pattern recognition processing to recognize handwriting input or drawing input performed on the touch screen as characters and images, respectively . Further, the controller 180 may control any one or a plurality of the above-described components in order to implement various embodiments described below on the mobile terminal 100 according to the present invention.
The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components. The power supply unit 190 includes a battery, the battery may be an internal battery configured to be chargeable, and may be detachably coupled to the terminal body for charging or the like.
In addition, the power supply unit 190 may include a connection port, and the connection port may be configured as an example of an interface 160 through which an external charger for supplying power for charging the battery is electrically connected.
As another example, the power supply unit 190 may be configured to charge the battery in a wireless manner without using a connection port. In this case, the power supply unit 190 may use at least one of an inductive coupling method based on a magnetic induction phenomenon from an external wireless power transmission apparatus and a magnetic resonance coupling method based on an electromagnetic resonance phenomenon Power can be delivered.
In the following, various embodiments may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.
2 is a view for explaining a front part of a mobile terminal according to the present invention. 3 is a view for explaining a rear portion of a mobile terminal according to the present invention.
2 and 3, the mobile terminal 100 includes a bar-shaped terminal body. However, the present invention is not limited thereto and can be applied to various structures such as a folder type, a flip type, a slide type, a swing type, and a swivel type in which a watch type, a clip type, a glass type or two or more bodies are relatively movably coupled . A description of a particular type of mobile terminal, although relevant to a particular type of mobile terminal, is generally applicable to other types of mobile terminals.
Here, the terminal body can be understood as a concept of referring to the mobile terminal 100 as at least one aggregate.
The mobile terminal 100 includes a case (for example, a frame, a housing, a cover, and the like) that forms an appearance.
A display unit 151 is disposed on a front surface of the terminal body to output information. The mobile terminal 100 having the display unit 151, the proximity sensor 141, and the illuminance sensor 142 disposed on the front surface of the terminal body will be described as an example.
However, these configurations are not limited to this arrangement. These configurations may be excluded or replaced as needed, or placed on different planes.
The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, the display unit 151 may display execution screen information of an application program driven by the mobile terminal 100 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information .
The display unit 151 may be a thin film transistor liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display, a 3D display, , And an electronic ink display (e-ink display).
Also, two or more display units 151 may be disposed according to the embodiment of the mobile terminal 100. [ In this case, a plurality of display portions may be disposed on one surface or may be disposed integrally with each other, or each of the plurality of display portions may be disposed on a different surface.
The display unit 151 may include a touch sensor that senses a touch with respect to the display unit 151 so that a control command can be received by a touch method. When a touch is made to the display unit 151, the touch sensor senses the touch, and the control unit 180 generates a control command corresponding to the touch based on the touch. The content input by the touch method may be a letter or a number, an instruction in various modes, a menu item which can be designated, and the like.
The proximity sensor 141 refers to a sensor that detects the presence of an object approaching a predetermined detection surface or an object existing in the vicinity thereof without mechanical contact using an electromagnetic force or an infrared ray. The proximity sensor 141 may be disposed in the inner area of the mobile terminal or in proximity to the touch screen, which is covered by the touch screen.
Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. In the case where the touch screen is electrostatic, the proximity sensor 141 can be configured to detect the proximity of the object with a change of the electric field along the proximity of the object having conductivity. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.
On the other hand, for convenience of explanation, the act of recognizing that the object is located on the touch screen in proximity with no object touching the touch screen is referred to as "proximity touch & The act of actually touching an object on the screen is called a "contact touch. &Quot; The position at which the object is closely touched on the touch screen means a position where the object corresponds to the touch screen vertically when the object is touched. The proximity sensor 141 can detect a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, have. Meanwhile, the control unit 180 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern sensed through the proximity sensor 141 as described above, and further provides visual information corresponding to the processed data It can be output on the touch screen. Furthermore, the control unit 180 can control the mobile terminal 100 such that different operations or data (or information) are processed according to whether the touch to the same point on the touch screen is a proximity touch or a touch touch .
The illuminance sensor 142 may be located on the front side of the mobile terminal 100 and may be located on the rear side as the case may be. The illuminance sensor 142 is not limited to a specific type, and any type of sensor capable of measuring the brightness of the attention of the mobile terminal 100 is possible.
The illuminance sensor 142 measures the brightness of the attention of the mobile terminal 100. The brightness information of the attention of the mobile terminal 100 input from the brightness sensor 142 is transmitted to the controller 180. The control unit 180 may adjust the brightness of the display unit 151 using the brightness information of the mobile terminal 100 input from the brightness sensor 142. [ The control unit 180 processes data (or information) corresponding to brightness information of the attention of the mobile terminal 100 input from the brightness sensor 142 and further displays visual information corresponding to the processed data on the display unit 151 ).
The angle sensor 143 refers to a sensor that measures the angle between the mobile terminal 100 and the ground. The proximity sensor 143 is located inside the mobile terminal 100 and can be disposed without being limited in position.
When the mobile terminal 100 is placed on a horizontal table, the angle sensor 143 can recognize 90 degrees when it is erected vertically, such as when the user makes a call to the mobile terminal 100 at 0 degree. The control unit 180 processes data (or information) corresponding to the angle information of the mobile terminal 100 input from the angle sensor 143 and further displays visual information corresponding to the processed data on the display unit 151 .
Meanwhile, a rear input unit may be provided on a rear surface of the terminal body. The rear input unit is operated to receive a command for controlling the operation of the mobile terminal 100, and input contents may be variously set. For example, commands such as power on / off, start, end, scrolling and the like, adjustment of the size of sound outputted from the sound output unit, switching to the touch recognition mode of the display unit 151, . The rear input unit may be implemented as a touch input, a push input, or a combination thereof.
The rear input unit may be disposed so as to overlap with the front display unit 151 in the thickness direction of the terminal body. For example, the rear input unit may be disposed at the rear upper end of the terminal body such that when the user holds the terminal body with one hand, the rear input unit can be easily operated using the index finger. However, the present invention is not limited thereto, and the position of the rear input unit may be changed.
When a rear input unit is provided on the rear surface of the terminal body, a new type of user interface using the rear input unit can be realized.
Meanwhile, the mobile terminal 100 may be provided with a fingerprint recognition sensor 124 for recognizing the fingerprint of the user, and the controller 180 may use the fingerprint information sensed through the fingerprint recognition sensor 124 as the authentication means . The fingerprint recognition sensor may be embedded in the display unit 151 or the user input unit 123.
The interface unit 160 is a path through which the mobile terminal 100 can be connected to (or paired with) an external device. For example, the interface unit 160 may include a connection terminal for connection with another device (for example, an earphone or an external speaker), a port for short-range communication (for example, an infrared port (IrDA Port), a Bluetooth port A wireless LAN port, or the like), or a power supply terminal for supplying power to the mobile terminal 100. The interface unit 160 may be implemented as a socket for receiving an external card such as a SIM (Subscriber Identification Module) or a UIM (User Identity Module) or a memory card for storing information.
A camera 121 may be disposed on the rear surface of the terminal body. The camera 121 may comprise a plurality of lenses arranged along at least one line. The plurality of lenses may be arranged in a matrix form. Such a camera can be named an array camera. When the camera 121 is an array camera, images can be taken in various ways using a plurality of lenses, and a better quality image can be obtained.
Hereinafter, embodiments related to a control method that can be implemented in a mobile terminal configured as above will be described with reference to the accompanying drawings. It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.
According to an embodiment of the present invention, the fingerprint recognition sensor 123 and the back button 125 may be disposed on the rear surface of the mobile terminal 100. [ However, the fingerprint recognition sensor 123 and the rear button 125 are disposed at positions that can be immediately input when the mobile terminal is turned upside down, It may be disposed at another position.
4 is a flowchart illustrating an operation method of the mobile terminal 100 according to an embodiment of the present invention.
The control unit 180 of the mobile terminal 100 recognizes the state of the mobile terminal 100 through the sensing unit 140 (S110). In one embodiment, the sensing unit 140 includes a proximity sensor 141, an illumination sensor 142, and an angle sensor 143. [ However, it is also possible to recognize the state of the mobile terminal 100 using another sensor except for the proximity sensor 141, the illuminance sensor 142 and the angle sensor 143. [ The controller 180 recognizes that the proximity sensor 141 recognizes an object on the front side of the mobile terminal 100 and the illuminance sensor 142 detects that the front side of the mobile terminal 100 is dark, When the angle sensor 143 recognizes that the angle between the mobile terminal 100 and the ground is less than 60 degrees, the controller 180 may determine that the mobile terminal 100 is turned upside down. The state in which the mobile terminal 100 is turned up refers to a state in which the display unit 151 of the mobile terminal 100 faces the bottom so that the user can not check the display unit 151 of the mobile terminal 100.
If the controller 180 determines that the mobile terminal 100 is turned upside down, the control unit 180 waits for a user's request for information output through the input unit 120 (S120).
In one embodiment, the control unit 180 may periodically recognize the state of the mobile terminal 100. [ Accordingly, the control unit 180 may perform other functions on the same input inputted through the input unit 120 according to the state of the mobile terminal 100. [ For example, when the display unit 151 of the mobile terminal 100 is positioned toward the opposite side of the floor and the fingerprint recognition sensor 124 of the mobile terminal 100 recognizes the fingerprint information of the user of the mobile terminal 100 , The control unit 180 can switch the mobile terminal 100 from the locked state to the unlocked state. If the fingerprint recognition sensor 124 of the mobile terminal 100 recognizes the fingerprint information of the user of the mobile terminal 100 while the mobile terminal 100 is turned upside down, It is possible to perform another predetermined operation other than the release of the lock state of the memory card.
The control unit 180 receives the information output request of the user input through the input unit 120 (S130). In one embodiment, when the user inputs fingerprint information of the user through the fingerprint recognition sensor 124 of the mobile terminal 100, the controller 180 may determine that there is a request to output the information of the inputted user. In another embodiment, the information output request may be received through a physical button on the rear side of the mobile terminal 100. That is, in the present invention, the information output request can request information output by the user in a state in which the mobile terminal 100 is turned upside down. The method is not limited to the above-described method.
The control unit 180 may output the notification information through the sound output unit 152 when the user requests the information output (S140). The notification information refers to information such as a notification message, a text message, an SNS message, and the like, by an application running on the mobile terminal 100. That is, information displayed on the display unit 151 of the mobile terminal 100 may be referred to as notification information. However, when the mobile terminal 100 is turned upside down, the user can not directly confirm the notification information. Therefore, when the mobile terminal 100 is turned upside down and the information output request is received, And outputs the notification information. It is a TTS (Text to Speech) technology that outputs such notification information by voice, and it is a technology for automatically converting characters to speech. Unlike the case of outputting a voice using the prerecorded training, the TTS can transmit all the notification information to the mobile terminal 100 by voice by directly converting the characters into a sound. However, the TTS technique is not limited to a specific technology, and a TTS technique generally used in an electronic terminal may be used.
5 is a view for explaining the operation of the sound output unit 152 when the fingerprint of the owner of the mobile terminal 100 is recognized according to an embodiment of the present invention.
5, the control unit 180 according to an embodiment of the present invention outputs announcement information through the sound output unit 152. FIG. When the control unit 180 recognizes that the mobile terminal 100 is turned upside down and the fingerprint information 511 of the user is input to the fingerprint recognition sensor 124 in operation 501, And output through the sound output unit 152 (502).
As described above, the present invention is advantageous in that the notification information can be confirmed by voice without needing to recognize the notification information through the display unit 151 of the mobile terminal 100.
Fig. 2 will be described again.
The control unit 180 can output the notification information through the sound output unit 152 or receive the control signal through the input unit 120 after the notification information is output at step S150. In one embodiment, the control unit 180 may receive a control signal using a gyro sensor, a fingerprint sensor 124, a camera, and a back button.
The control unit 180 also performs control corresponding to the control signal (S160).
According to another embodiment of the present invention, the state of the mobile terminal 100 can be recognized and the corresponding operation can be performed. This will be described with reference to FIG.
6 illustrates an operation of executing an application when the mobile terminal 100 is changed to the use state while the announcement information is output to the sound output unit 152 of the mobile terminal 100 according to an embodiment of the present invention Fig.
When the mobile terminal 100 is manually operated (602) while the announcement information is being outputted from the sound output unit 152 of the mobile terminal 100 (602), the control unit 180 transmits the notification information And executes the corresponding application so that the user of the mobile terminal 100 can immediately check the message. For example, when three pieces of notification information are stored in the memory 170 of the mobile terminal 100, and the first notification information and the second notification information are output as a voice in the sound output unit 152, When the user of the mobile terminal 100 picks up the mobile terminal 100 while being output to the output unit 152 and the mobile terminal 100 is turned off and becomes in the use state, The application is executed. If the third notification information is a text message, the control unit 180 displays a message application on the display unit 151 of the mobile terminal 100 so as to confirm the text message, so that the user can visually confirm the message.
As described above, according to the present invention, when the user confirms the mobile terminal 100 in which the notification information is outputted, the application corresponding to the notification information immediately So that the user of the mobile terminal 100 can more easily confirm detailed notification information.
According to another embodiment of the present invention, additional fingerprint information may be recognized and the notification information may be obtained in stages. This will be described with reference to FIG.
FIG. 7 is a flowchart illustrating a method of transmitting a fingerprint to a fingerprint recognition sensor 124 according to an exemplary embodiment of the present invention. Referring to FIG. 7, And outputting detailed notification information when information is input.
When the controller 180 recognizes the first fingerprint information through the fingerprint recognition sensor 124, the control unit 180 outputs the notification information through the sound output unit 152. Such notification information may include only simple information for reporting the personal information of the user of the mobile terminal 100. [ For example, in the case of a message, a person nearby the user of the mobile terminal 100, such as the sender, the time of the transmission,
If the control unit 180 recognizes the second fingerprint information through the fingerprint recognition sensor 124 while the notification information is being output, the control unit 180 outputs the traffic detail notification information to the sound output unit 152. [ The second fingerprint information may be fingerprint information of the same finger as the first fingerprint information and may be fingerprint information of a finger different from the finger corresponding to the first fingerprint information to enhance security. For example, when three pieces of notification information are stored in the memory 170 of the mobile terminal 100, and the first and second notification information are outputted as sound by the sound output unit 152 and the third notification information is outputted When the control unit 180 receives the second fingerprint information of the user of the mobile terminal 100, the control unit 180 outputs the detailed notification information of the third notification information through the sound output unit 152. [ The detailed notification information includes specific contents of the notification information, and may be the contents of the text message when the notification information is a text message.
While the controller 180 outputs the notification information through the sound output unit 152, the controller 180 receives the second fingerprint information and outputs the detailed notification information corresponding to the notification information, The user can more easily obtain detailed notification information. In addition, personal information of the user of the mobile terminal 100 can be protected more efficiently through the multiple input.
8) of the watchdog mobile terminal 812 when the watchdog mobile terminal 812 is paired with the mobile terminal 100 according to another embodiment of the present invention, And can transmit notification information to the mobile terminal 812. This will be described with reference to FIG.
8 is a view for explaining the operation when the mobile terminal 100 and the watchdog mobile terminal 812 are connected (paired) according to an embodiment of the present invention.
The mobile terminal 100 can be extended to a wearable device that can be worn on the body beyond the dimension that the user mainly grasps and uses. These wearable devices include smart watch, smart glass, and head mounted display (HMD). The watch-type mobile terminal 812 includes a main body having a display unit 151 and a band connected to the main body and configured to be worn on the wrist. The watch-type mobile terminal 812 is configured to be capable of wireless communication, and the main body may be provided with an antenna for the wireless communication. A display unit 151 may be disposed on the front surface of the main body to output information, and a touch sensor may be provided on the display unit 151 to implement a touch screen. In addition, the watch-type mobile terminal 812 may incorporate a sensor for recognizing the operation of the user and may be worn on the user's wrist to recognize the operation of the user's arm.
The control unit 180 receives a predetermined gesture such as a touch on the screen of the watchdog mobile terminal 812 at the time of outputting the notification information at the sound output unit 152 of the mobile terminal 100, And transmits the notification information to the watch-type mobile terminal 812.
That is, when the confirmation information is input to the watch-type mobile terminal 812 after the notification information is being outputted or output through the sound output unit 152, the controller 180 transmits the notification information to the watchdog mobile terminal 812 ). However, the confirmation signal may be in various forms. For example, when a button of a watch-type terminal is pressed, a signal is input to a touch screen of the watch-type terminal, The acknowledgment signal may be in various forms.
When the confirmation signal is input to the watchdog mobile terminal 812 after the announcement information is being outputted or outputted through the sound output unit 152, the controller 180 controls the paired watchdog type The mobile terminal 812 can execute the application corresponding to the notification information. In this case, the notification information can be confirmed by the watchdog mobile terminal 812 through the executed application.
When the confirmation signal is inputted to the watch-type mobile terminal 812 after the notification information is outputted or output through the sound output unit 152, the watch-type terminal can confirm the notification information And the user of the mobile terminal 100 can receive the notification information more easily.
9 to 12 are views for explaining a method of controlling the mobile terminal 100 according to an embodiment of the present invention.
Referring to FIG. 9, when the swipe fingerprint sensor 124 is used, the mobile terminal 100 may perform another operation according to the fingerprint recognition direction of the finger 901.
The swipe method, which is one of the fingerprint recognition methods, is a method of recognizing fingerprint information by sweeping down the fingerprint recognition sensor 124 with a finger. Such a fingerprint recognition method can change the direction in which the finger is swept away. For example, you can swipe your finger from top to bottom and swipe your finger from bottom to top. Or you could swipe your finger from left to right, right to left.
The mobile terminal 100 may control the fingerprint recognition sensor 124 in the direction of sweeping the finger when the fingerprint recognition sensor 124 is in the swipe mode. For example, if the user recognizes the fingerprint while moving the finger upward in step S130 of FIG. 4 (911), even if the controller 180 recognizes that the mobile terminal 100 is turned upside down, The controller 180 can change the state of the mobile terminal 100 from the locked state to the unlocked state. If the user recognizes the fingerprint while moving the finger downward (912), the controller 180 recognizes that the mobile terminal 100 is in an inverted state It is possible to output the notification information to the sound output unit 152.
Also, in the case where the second fingerprint information is input after the first fingerprint information is inputted and the mobile terminal 100 is controlled while the notification information is output, the controller 180 performs another control according to the direction in which the fingerprint is recognized with the finger can do. For example, the control unit 180 can perform various controls such as replaying the notification information, listening to the next notification information, deleting the notification information, and executing an application corresponding to the release notification information.
Referring to FIG. 10, when the area-based fingerprint recognition sensor 124 is used, the mobile terminal 100 may perform another operation according to the fingerprint recognition direction of the finger 901. FIG.
The area method, which is one of the fingerprint recognition methods, is a method of recognizing a fingerprint by connecting a finger to the fingerprint recognition sensor 124. [ Such a fingerprint recognition method may change the direction in which the finger is connected to the fingerprint recognition sensor 124. [ For example, the finger can be connected in the upward direction 1001, and the finger can be connected in the downward direction. Or in the leftward direction.
The mobile terminal 100 can perform different controls according to the direction in which the finger is connected when the fingerprint recognition sensor 124 is in the area type in the step of recognizing the fingerprint of the user. For example, if the user recognizes the fingerprint in a direction in which the finger is pointed up (S110), the controller 180 may display the fingerprint on the display unit 151 even if the user recognizes the fingerprint as being in an inverted state The controller 180 can change the state of the mobile terminal 100 from the locked state to the unlocked state. If the user connects the fingerprint in the downward direction (1002), if the controller 180 recognizes that the mobile terminal 100 is turned upside down, ) To output the notification information.
Also, in the case where the second fingerprint information is input after the first fingerprint information is inputted and the mobile terminal 100 is controlled while the notification information is output, the controller 180 performs another control according to the direction in which the fingerprint is recognized with the finger can do. For example, the control unit 180 can perform various controls such as replaying the notification information, listening to the next notification information, deleting the notification information, and executing an application corresponding to the release notification information.
11, it is possible to control the mobile terminal 100 using the back button 125 after the announcement information is being outputted through the sound output unit 152 or after the announcement information is output.
When there are one or more rear buttons 125, different controls are possible depending on the respective rear buttons. In addition, different control signals can be assigned to various click methods such as one-click, long-click, double-click, and triple-click on one rear button. For example, according to this control method, the control unit 180 can perform various controls such as replaying the notification information, listening to the next notification information, deleting the notification information, and executing the application corresponding to the release notification information.
Referring to FIG. 12, it is possible to control the mobile terminal 100 by using the camera 121 after the announcement information is outputted through the sound output unit 152 or after the announcement information is output.
The control unit 180 can recognize the motion of the user through the camera. For example, the user may recognize the motion of moving the hand of the user from left to right or right to left, top to bottom, and bottom to top of the camera 121. In addition, the camera 121 can recognize various operations of the user, such as a fist opening and closing motion, a fist clenching motion, and the like. Various control signals can be given to each operation of the user. For example, according to this control method, the control unit 180 can perform various controls such as replaying the notification information, listening to the next notification information, deleting the notification information, and executing the application corresponding to the release notification information.
The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, , And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). In addition, the computer may include a control unit 180 of the mobile terminal 100. Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.
