KR102056192B1 - Mobile terminal and controlling method thereof - Google Patents

Abstract

The mobile terminal of the present invention includes a first sensing unit for detecting a face down mode of the mobile terminal, a second sensing unit for detecting a user-specified direction around the mobile terminal, a touch screen, and the face down ( And a controller configured to control a portion of the touch screen corresponding to the detected user-specified direction to emit light according to a preset event generated in a face down) mode.

Description

MOBILE TERMINAL AND CONTROLLING METHOD THEREOF}

The present invention relates to a mobile terminal supporting a face down mode and a control method thereof.

Terminals may be divided into mobile / portable terminals and stationary terminals according to their mobility. The mobile terminal may be further classified into a handheld terminal and a vehicle mount terminal according to whether a user can directly carry it.

As the functions are diversified, for example, the terminal is implemented in the form of a multimedia player having complex functions such as taking a picture or video, playing a music or video file, playing a game or receiving a broadcast. have. Further, in order to support and increase the function of the terminal, it may be considered to improve the structural part and / or the software part of the terminal.

Such a terminal has a problem that most functions cannot be used when the terminal is turned upside down, that is, when the display unit of the terminal faces the floor, even though various functions can be implemented.

The present invention has been made to solve the above problems, an object of the present invention is a mobile terminal that can provide a notification related to the event occurrence to the user through the display unit when a specific event occurs while the user turned the mobile terminal upside down It is to provide.

In detail, the present invention provides a mobile terminal in which the display unit emits light by changing brightness, color, and pattern according to a preset event in the face down mode.

Furthermore, the present invention is to provide a mobile terminal that the display unit emits light so that the mobile terminal recognizes the user's direction and the user knows the occurrence of a preset event in the direction.

The technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned above will be clearly understood by those skilled in the art from the following description. Could be.

A mobile terminal according to an embodiment of the present invention includes a first sensing unit for sensing a face down mode of the mobile terminal and a second sensing unit for sensing a user specified direction around the mobile terminal. And a control unit configured to control light emission of a portion of the touch screen corresponding to the detected user-specified direction according to a preset event occurring in a screen and the face down mode.

In addition, according to an embodiment of the present invention, the second sensing unit of the mobile terminal is characterized in that it detects the user-designated direction by recognizing the sound around the mobile terminal.

In addition, according to an embodiment of the present invention, the two sensing units of the mobile terminal is characterized in that it detects the user-designated direction by recognizing the sound generated from the outer surface of the mobile terminal.

The technical solutions obtained in the present invention are not limited to the above-mentioned solutions, and other solutions not mentioned above will be apparent to those skilled in the art from the following description. It can be understood.

A mobile terminal according to an embodiment of the present invention can provide a notification regarding an event occurrence to a user through a display unit when a specific event occurs even when the mobile terminal is turned upside down. In detail, the user may know whether a specific event occurs in the mobile terminal even when the mobile terminal is upside down, and may also know information on the type and the number of occurrences of the event. The mobile terminal according to an exemplary embodiment of the present invention may distinguish various types of information such as the type and the number of occurrences of the event by emitting light by the display unit by changing brightness or color.

The effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned above may be clearly understood by those skilled in the art from the following description. will be.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
2 and 3 are each a front view and a rear view of an example of a mobile terminal or a mobile terminal according to the present invention.
4 is a front perspective view of another example of a mobile terminal according to one embodiment of the present invention;
5 is an exemplary view for explaining a face down mode of a mobile terminal according to an embodiment of the present invention.
6 is an exemplary view for explaining a position at which the display emits light in a face down mode of a mobile terminal according to one embodiment of the present invention;
7 is an operation flowchart of a mobile terminal according to an embodiment of the present invention.
8 is a flowchart illustrating an operation of a mobile terminal according to another embodiment of the present invention.
FIG. 9 is an exemplary view for explaining a process of detecting a user designated direction by recognizing sound by a mobile terminal according to one embodiment of the present invention; FIG.
10 and 11 are exemplary diagrams for explaining a method for setting a user-specified direction through sound by a mobile terminal according to an embodiment of the present invention.
12 is an exemplary view for explaining a process of setting a user-specified direction by recognizing sound generated from an outer surface of a mobile terminal according to an embodiment of the present invention.
13A is an exemplary view for explaining a process of setting a user-specified direction by generating sound on an outer surface of a mobile terminal according to an embodiment of the present invention.
13B is an exemplary view for explaining a process of setting a user-specified direction by using a physical key on the outer surface of a mobile terminal according to an embodiment of the present invention.
FIG. 14 is an exemplary diagram for describing various light emission forms of a display unit according to a movement or drag area of a sound sensed by a mobile terminal according to one embodiment of the present invention; FIG.
15 is an exemplary diagram for describing a light emission form of a display unit in a face down mode of a mobile terminal according to one embodiment of the present invention;
FIG. 16 is an exemplary view for explaining that a display unit of a mobile terminal emits light in a user specified direction according to a preset event according to an embodiment of the present invention; FIG.
17A is an exemplary view for explaining that a display unit of a mobile terminal emits light differently according to the importance of an event according to an embodiment of the present invention.
17B is an exemplary view for explaining a display pattern of a display unit when a mobile terminal receives a call according to an embodiment of the present invention.
18 is an exemplary view for explaining that the display unit of the mobile terminal emits light differently according to the number of events when the event is a signal reception according to an embodiment of the present invention.
19 is an exemplary view for explaining that the display unit of the mobile terminal emits light differently according to the type or number of occurrences of events when the user-specified direction is set to the right in one embodiment of the present invention.
20 is an exemplary view for explaining that the display unit of the mobile terminal emits light differently according to the amount of data transmission and reception when the event according to an embodiment of the present invention is data transmission and reception.
FIG. 21 is an exemplary diagram for explaining that a display unit of a mobile terminal emits light differently according to a music genre or playing time when an event is music playback according to an embodiment of the present invention.
FIG. 22 is an exemplary view for explaining that when an event is music playback according to an embodiment of the present invention, the display of the mobile terminal emits light in different regions according to the music genre on the playlist.
FIG. 23 illustrates an example in which the display unit of the mobile terminal emits light by varying the light emitting area according to the duration of the face down mode when the event is performed in the face down mode of the mobile terminal according to an embodiment of the present invention. Degree.
FIG. 24 is an exemplary view for explaining that an event outputs a current time according to an embodiment of the present invention, and that the display unit of the mobile terminal inverts and outputs time information when the mobile terminal is placed on a specific floor.
FIG. 25 illustrates an example in which a snooze function is activated by a touch gesture and the display unit of the mobile terminal emits light differently according to snooze time when an event is an alarm output.
FIG. 26 is an exemplary view for explaining that when an event according to an embodiment of the present invention executes a voice recording operation, the display of the mobile terminal emits light differently according to a recording progress state; FIG.
FIG. 27 is an exemplary view for explaining a method of outputting a notification about a display unit of a mobile terminal when an event is a specific task incomplete detection according to an embodiment of the present invention; FIG.
FIG. 28A is an exemplary diagram for describing a method of recognizing a color of a bottom surface by a mobile terminal according to one embodiment of the present invention; FIG.
FIG. 28B is an exemplary diagram for describing a feature in which a display unit of a mobile terminal according to an embodiment of the present invention adjusts the color, brightness, and the like emitted according to ambient light; FIG.
FIG. 29 is an exemplary diagram for describing a process of outputting the notification by a display unit of a mobile terminal when an event relates to detecting a charging state of a mobile terminal according to one embodiment of the present invention; FIG.
30 is an exemplary diagram for describing an operation of controlling an amount of light emitted from a display of a mobile terminal according to an embodiment of the present invention.

Hereinafter, a mobile terminal according to the present invention will be described in more detail with reference to the accompanying drawings. The suffixes "module" and "unit" for components used in the following description are given or mixed in consideration of ease of specification, and do not have distinct meanings or roles from each other.

The mobile terminal described herein may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), navigation, and the like. However, it will be readily apparent to those skilled in the art that the configuration according to the embodiments described herein may also be applied to fixed terminals such as digital TVs, desktop computers, etc., except when applicable only to mobile terminals.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, and an interface. The unit 170, the controller 180, and the power supply unit 190 may be included. The components shown in FIG. 1 are not essential, so that a mobile terminal having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and a network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short range communication module 114, a location information module 115, and the like. .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast reception modules 1100 may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a previously generated broadcast signal and / or broadcast related information and transmits the same to a terminal. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

The broadcast associated information refers to information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 may include, for example, Digital Multimedia Broadcasting-Terrestrial (DMB-T), Digital Multimedia Broadcasting-Satellite (DMB-S), Media Forward Link Only (MediaFLO), and Digital Video Broadcast (DVB-H). -Handheld), DVB-CBMS (Convergence of Broadcasting and Mobile Service), OMA-BCAST (Open Mobile Alliance-BroadCAST), CMMB (China Multimedia Mobile Broadcasting), MBBMS (Mobile Broadcasting Business Management System), ISDB-T (Integrated Services) Digital broadcast signals may be received using a digital broadcast system such as Digital Broadcast-Terrestrial. Of course, the broadcast receiving module 111 may be configured to be suitable for not only the above-described digital broadcasting system but also other broadcasting systems.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 may include at least one of a base station, an external terminal, and a server on a mobile communication network such as, but not limited to, Global System for Mobile communications (GSM), Code Division Multiple Access (CDMA), and Wideband CDMA (WCDMA). Send and receive wireless signals with one. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.

The wireless internet module 113 refers to a module for wireless internet access and may be embedded or external to the mobile terminal 100. Wireless Internet technologies include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), GSM, CDMA, WCDMA, Long Term Evolution), but is not limited to such.

In view of the fact that the wireless Internet access by Wibro, HSDPA, GSM, CDMA, WCDMA, LTE, etc. is made through a mobile communication network, the wireless Internet module 113 for performing a wireless Internet access through the mobile communication network is the mobile communication module. It can be understood as a kind of (112).

The short range communication module 114 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

The location information module 115 is a module for obtaining a location of a mobile terminal, and a representative example thereof is a GPS (Global Position System) module. According to the current technology, the GPS module 115 calculates distance information and accurate time information away from three or more satellites, and then applies trigonometric methods to the calculated information, thereby providing three-dimensional chords according to latitude, longitude, and altitude. The location information can be calculated accurately. Currently, a method of calculating position and time information using three satellites and correcting the error of the calculated position and time information using another satellite is widely used. In addition, the GPS module 115 may calculate speed information by continuously calculating the current position in real time.

Referring to FIG. 1, the A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be provided according to the use environment.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. The processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module 112 and output in the call mode. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, a touch pad (constant voltage / capacitance), a jog wheel, a jog switch, and the like. In addition, according to an embodiment of the present invention, the rear of the terminal may further include a key for determining a user-specified direction to be described later.

The sensing unit 140 detects a current state of the mobile terminal 100 such as an open / closed state of the mobile terminal 100, a location of the mobile terminal 100, presence or absence of a user contact, orientation of the mobile terminal, acceleration / deceleration of the mobile terminal, and the like. To generate a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, whether the power supply unit 190 is supplied with power, whether the interface unit 170 is coupled to the external device may be sensed. On the other hand, the sensing unit 140 may include a proximity sensor 141, and includes a gyro sensor or an acceleration sensor for sensing the horizontal state of the terminal and an optical sensor for sensing the color, brightness, etc. of the ambient light of the terminal. can do. The sensor for sensing the color of the light among the light sensors may be, for example, an RGB sensor, and the sensor for sensing the brightness of the light may be, for example, an illuminance sensor. In addition, the sensing unit 140 may detect sound generated in the vicinity or the outer surface of the mobile terminal 100, and in particular, may sense the direction in which the corresponding sound occurs. The sensing unit 140 may be located inside or behind the sides of each side constituting the mobile terminal 100 in order to detect sound generated from the surroundings or the outer surface of the mobile terminal 100. Such sound sensing may be performed by the microphone 122 in some cases.

The output unit 150 is used to generate an output related to sight, hearing, or tactile sense, and includes a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154. Can be.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, the mobile terminal displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the mobile terminal 100 is in a video call mode or a shooting mode, the mobile terminal 100 displays a photographed and / or received image, a UI, or a GUI.

The display unit 151 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display (flexible). and at least one of a 3D display.

Some of these displays can be configured to be transparent or light transmissive so that they can be seen from the outside. This may be referred to as a transparent display. A representative example of the transparent display is TOLED (Transparant OLED). The rear structure of the display unit 151 may also be configured as a light transmissive structure. With this structure, the user can see the object located behind the terminal body through the area occupied by the display unit 151 of the terminal body.

There may be two or more display units 151 according to the implementation form of the mobile terminal 100. For example, a plurality of display units may be spaced apart or integrally disposed on one surface of the mobile terminal 100, or may be disposed on different surfaces, respectively.

When the display unit 151 and a sensor for detecting a touch operation (hereinafter, referred to as a touch sensor) form a mutual layer structure (hereinafter referred to as a touch screen), the display unit 151 may be configured in addition to an output device. Can also be used as an input device. The touch sensor may have, for example, a form of a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only the position and area of the touch but also the pressure at the touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to a touch controller (not shown). The touch controller processes the signal (s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can know which area of the display unit 151 is touched.

The proximity sensor 141 may be disposed in an inner region of the mobile terminal surrounded by the touch screen or near the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without using a mechanical contact by using an electromagnetic force or infrared rays. Proximity sensors have a longer life and higher utilization than touch sensors.

Examples of the proximity sensor include a transmission photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high frequency oscillation proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, the touch screen is configured to detect the proximity of the pointer by the change of the electric field according to the proximity of the pointer. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, an act of allowing the pointer to be recognized without being in contact with the touch screen so that the pointer is located on the touch screen is referred to as a "proximity touch". The act of actually touching the pointer on the touch screen may be referred to as "contact touch". The position where the proximity touch is performed by the pointer on the touch screen may mean a position where the pointer is perpendicular to the touch screen when the pointer is in proximity touch.

The proximity sensor detects a proximity touch and a proximity touch pattern (eg, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, and a proximity touch movement state). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

The sound output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output module 152 may also output a sound signal related to a function (for example, a call signal reception sound or a message reception sound) performed in the mobile terminal 100. The sound output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the mobile terminal 100. Examples of events occurring in the mobile terminal include call signal reception, message reception, key signal input, and touch input. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than a video signal or an audio signal, for example, vibration. The video signal or the audio signal may also be output through the display unit 151 or the audio output module 152. In this case, the display unit 151 and the audio output module 152 may be a kind of alarm unit 153. May be classified.

The haptic module 154 generates various haptic effects that a user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154. The intensity and pattern of vibration generated by the haptic module 154 can be controlled. For example, different vibrations may be synthesized and output or may be sequentially output.

In addition to the vibration, the haptic module 154 may be used for stimulation such as a pin array vertically moving with respect to the contact skin surface, a jetting force or suction force of air through an injection or inlet, grazing to the skin surface, contact of an electrode, and electrostatic force Various tactile effects can be generated, such as effects by the endothermic and the reproduction of a sense of cold using the elements capable of endotherm or heat generation.

The haptic module 154 may not only deliver the haptic effect through direct contact, but may also be implemented to allow the user to feel the haptic effect through a muscle sense such as a finger or an arm. Two or more haptic modules 154 may be provided according to configuration aspects of the mobile terminal 100.

The memory unit 160 may store a program for processing and controlling the controller 180, and temporarily stores input / output data (for example, a phone book, a message, an audio, a still image, a video, etc.). It can also perform a function for. The memory unit 160 may store a frequency of use of each of the data (eg, a phone number, a message, and a frequency of use of each multimedia).

In addition, the memory unit 160 may store data regarding vibration and sound of various patterns output when a touch input on the touch screen is performed.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), RAM (Random Access Memory, RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), Magnetic Memory, Magnetic It may include a storage medium of at least one type of disk, optical disk. The mobile terminal 100 may operate in connection with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device, receives power, transfers the power to each component inside the mobile terminal 100, or transmits data inside the mobile terminal 100 to an external device. For example, wired / wireless headset ports, external charger ports, wired / wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input / output (I / O) ports, The video input / output (I / O) port, the earphone port, and the like may be included in the interface unit 170.

The identification module is a chip that stores various types of information for authenticating the usage rights of the mobile terminal 100, and includes a user identification module (UIM), a subscriber identify module (SIM), and a universal user authentication module ( Universal Subscriber Identity Module (USIM), and the like. A device equipped with an identification module (hereinafter referred to as an 'identification device') may be manufactured in the form of a smart card. Therefore, the identification device may be connected to the terminal 100 through a port.

The interface unit may be a passage through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, or various command signals input from the cradle by a user may be transferred. It may be a passage that is delivered to the terminal. Various command signals or power input from the cradle may be operated as signals for recognizing that the mobile terminal is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the mobile terminal. For example, perform related control and processing for voice calls, data communications, video calls, and the like. The controller 180 may include a multimedia module 181 for playing multimedia. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The controller 180 may perform a pattern recognition process for recognizing a writing input or a drawing input performed on the touch screen as text and an image, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

Various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using, for example, software, hardware or a combination thereof.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing other functions. The described embodiments may be implemented by the controller 180 itself.

According to the software implementation, embodiments such as the procedures and functions described herein may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein. Software code may be implemented in software applications written in a suitable programming language. The software code may be stored in the memory 160 and executed by the controller 180.

2 is a front perspective view of an example of a mobile terminal or a mobile terminal according to the present invention;

The disclosed mobile terminal 100 has a terminal body in the form of a bar. However, the present invention is not limited thereto and may be applied to various structures such as a slide type, a folder type, a swing type, a swivel type, and two or more bodies are coupled to be relatively movable.

The body includes a casing (casing, housing, cover, etc.) that forms an exterior. In this embodiment, the case may be divided into a front case 101 and a rear case 102. Various electronic components are built in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be further disposed between the front case 101 and the rear case 102.

The cases may be formed by injecting synthetic resin or may be formed of a metal material, for example, a metal material such as stainless steel (STS) or titanium (Ti).

The display unit 151, the audio output unit 152, the camera 121, the user input units 130/131 and 132, the microphone 122, and the interface 170 may be disposed in the terminal body, mainly the front case 101. have.

The display unit 151 occupies most of the main surface of the front case 101. The sound output unit 152 and the camera 121 are disposed in regions adjacent to one end of both ends of the display unit 151, and the user input unit 131 and the microphone 122 are disposed in regions adjacent to the other end. The user input unit 132 and the interface 170 may be disposed on side surfaces of the front case 101 and the rear case 102.

The user input unit 130 is manipulated to receive a command for controlling the operation of the mobile terminal 100, and may include a plurality of manipulation units 131 and 132. The manipulation units 131 and 132 may also be collectively referred to as a manipulating portion.

Content input by the first or second manipulation units 131 and 132 may be variously set. For example, the first manipulation unit 131 receives a command such as start, end, scroll, and the like, and the second manipulation unit 132 adjusts the volume of the sound output from the sound output unit 152 or displays 151. Command, such as activating / deactivating the touch recognition mode.

3 is a rear perspective view of the mobile terminal shown in FIG. 2.

Referring to FIG. 3, a camera 121 ′ may be additionally mounted on the rear of the terminal body, that is, the rear case 102. The camera 121 ′ has a photographing direction substantially opposite to that of the camera 121 (see FIG. 2), and may be a camera having the same or different pixels as the camera 121.

For example, the camera 121 has a low pixel so that the user's face is photographed and transmitted to the counterpart in case of a video call, and the camera 121 'photographs a general subject and does not transmit it immediately. It is desirable to have a high pixel because there are many. The cameras 121 and 121 'may be installed on the terminal body to be rotatable or pop-up.

The flash 123 and the mirror 124 may be further disposed adjacent to the camera 121 ′. The flash 123 shines light toward the subject when the subject is photographed by the camera 121 '. The mirror 124 allows the user to see his / her own face or the like when photographing (self-photographing) the user using the camera 121 '.

The sound output unit 152 'may be further disposed on the rear surface of the terminal body. The sound output unit 152 ′ may implement a stereo function together with the sound output unit 152 (see FIG. 2), and may be used to implement a speakerphone mode during a call.

In addition to the antenna for a call or the like, an antenna 116 for receiving a broadcast signal may be additionally disposed on the side of the terminal body. The antenna 116 constituting a part of the broadcast receiving module 111 (refer to FIG. 1) may be installed to be pulled out of the terminal body.

The terminal body is equipped with a power supply unit 190 for supplying power to the mobile terminal 100. The power supply unit 190 may be embedded in the terminal body or may be directly detachable from the outside of the terminal body.

The rear case 102 may be further equipped with a touch pad 135 for sensing a touch. The touch pad 135 may be configured to be light transmissive for the display unit 151. In this case, if the display unit 151 is configured to output visual information on both sides (i.e., in the direction of both the front and rear surfaces of the mobile terminal), the visual information may be recognized through the touch pad 135. do. The information output on both surfaces may be controlled by the touch pad 135.

Meanwhile, since a display dedicated to the touch pad 135 is separately installed, the touch screen may be disposed on the rear case 102.

The touch pad 135 operates in association with the display unit 151 of the front case 101. The touch pad 135 may be disposed in parallel to the rear of the display unit 151. The touch pad 135 may have the same or smaller size as the display unit 151.

Meanwhile, as illustrated in FIG. 4, the mobile terminal 100 according to an exemplary embodiment of the present disclosure may include a display unit 151 having a curved shape (with a curved surface). Furthermore, the terminal body in which the display unit 151 is disposed may be formed to have a bent appearance. For example, the front surface of the terminal body on which the display unit 151 is disposed may be bent concave, and the rear surface of the terminal body on which the display unit 151 is not disposed may be bent convexly.

That is, the front case of the terminal body may be bent so that the front surface is concave, and the display unit 151 may also be bent concave to correspond thereto. That is, in this case, the front of the terminal has a curvature.

If the front surface of the terminal is flat, when the user puts it down on a specific floor without directly manipulating the mobile terminal 100, the user generally displays the display unit 151 in order to check an event occurring in the mobile terminal 100. The mobile terminal 100 can be put down in the direction of pointing upwards. On the other hand, when the user inverts the mobile terminal 100, that is, when the display unit 151 faces the floor, information about an event occurring in the mobile terminal 100 provided through the display unit 151. It is difficult to check.

However, when the user puts down the mobile terminal 100 having the curvature of the front surface on a specific floor as described above, the user is an event that occurs in the mobile terminal 100 in whatever direction the mobile terminal 100 is placed You can check. That is, when the display unit 151 is in the upward direction, the mobile terminal 100 has a curvature, and thus, vibrates for a while and becomes horizontal, and the touch screen ( Information about an event occurring in the mobile terminal 100 may be checked through 151. In addition, when the direction in which the mobile terminal 100 is placed is the direction in which the display unit 151 faces the floor, both ends of the upper and lower parts of the mobile terminal 100 come into contact with the floor, and are immediately horizontal. In the horizontal state, since the display unit 151 has a curvature, the display unit 151 disposed on the front surface of the mobile terminal 100 may have a predetermined space between the floor and the floor.

In this case, the sensing unit 140 may detect the horizontal state of the mobile terminal 100 as described above using a gyro sensor or an acceleration sensor. In particular, according to an embodiment of the present invention, the sensing unit 140 may recognize the face down mode. In addition, since the sensing unit 140 may further include an optical sensor, when the direction in which the mobile terminal 100 is placed is the direction in which the display unit 151 faces the floor, the mobile terminal 100 may display the display unit 151. It can detect the ambient light entering the space between the floor and the floor. Specifically, the light sensor can determine the brightness, color, etc. of the ambient light. In addition, as the display unit 151 emits light, light may be emitted through the space to provide the user with information about an event occurring in the mobile terminal 100. In particular, the display unit 151 may partially output light only to a portion of the entire displayable area. In addition, the position of the partial region may be changed, and thus the user-designated direction may be changed in the face down mode to be described later. In addition, when the display unit 151 partially outputs the light, the display unit 151 may output the light by varying the brightness, color, wavelength, and the like of the light.

In addition, according to an embodiment of the present invention, a touch sensor and a proximity sensor for detecting a user's touch gesture may be provided on the rear of the terminal body of the mobile terminal 100.

In addition, the mobile terminal 100 according to an embodiment of the present invention is provided with a visual key displayed on the display unit 151 without a separate key button on the front of the display unit 151. The control command can be received.

Hereinafter, embodiments related to a control method that can be implemented in the mobile terminal 100 configured as described above will be described with reference to the accompanying drawings.

For convenience of description, it is assumed that the mobile terminal 100 mentioned below includes at least one of the components shown in FIG. 1. In detail, the mobile terminal 100 according to the present invention may include a display unit 151, a sensing unit 140, and a controller 180. In some cases, the mobile terminal 100 according to the present invention may further include a proximity sensor 141. When the display unit 151 is implemented as the touch screen 151, the present invention can be implemented more easily. Hereinafter, the present invention will be described on the assumption that the display unit 151 is the touch screen 151. do.

In the present specification, the face down mode refers to a state in which the mobile terminal 100 is placed upside down on a specific floor. That is, when the touch screen 151 of the mobile terminal 100 is placed on the plane to face the bottom, the mobile terminal 100 is said to be in the face down mode. The controller 180 may determine whether the mobile terminal 100 is in the face down mode through the sensing unit 140.

In particular, when the horizontal state of the mobile terminal 100 is detected through the sensing unit 140 for a predetermined time, the controller 180 is in a state in which the mobile terminal 100 is inverted, that is, the mobile terminal is in a face down mode. I can detect it. To this end, the sensing unit 140 may include a gyro sensor or an acceleration sensor.

However, even when the touch screen 151 of the mobile terminal 100 faces upward, when the horizontal state is detected, the mobile terminal 100 may be mistaken for the face down mode. When the additional condition is satisfied according to the user setting or the manufacturer's intention, the mobile terminal ( The controller 180 may determine that the 100 is in the face down mode. As an example of an additional condition for determining a face down mode, the controller 180 may detect the horizontal state of the mobile terminal 100 in addition to sensing the horizontal state of the mobile terminal 100 on both sides of the upper and lower ends of the mobile terminal 100 through a sensing unit 140. When further contact is detected, it may be determined that the mobile terminal 100 is in a face down mode.

As another example of the additional condition for determining the face down mode, the controller 180 may detect a horizontal state of the mobile terminal 100, and may sense a space between the touch screen 151 and the floor of the mobile terminal 100 through the sensing unit 140. When the brightness of the detected light is detected and the brightness of the light falls within a predetermined range, the mobile terminal 100 may determine that the face down mode.

According to the user's setting or the manufacturer's intention, the controller 180 may detect the face down mode of the mobile terminal 100 when the plurality of additional conditions presented in the above example are satisfied at the same time, and various conditions may be added in addition to the above examples. Can be.

The controller 180 may control to output information on the specific event through the touch screen 151 when a specific event occurs in the mobile terminal 100 while the mobile terminal 100 is in the face down mode. When the touch screen 151 has a concave curvature, a predetermined space exists between the touch screen 151 and the floor. When the touch screen 151 emits light with various wavelengths, brightness, colors, and patterns according to an event, the user checks the wavelength, brightness, color, and pattern of light leaking through the predetermined space, thereby obtaining information about the event. I can recognize it.

In the present specification, an event may mean an interrupt associated with various functions of the mobile terminal 100. That is, when a signal is received through the wireless communication unit 110 or when an application scheduled to be executed within a predetermined time is executed, when a content of the running application is changed, a notification operation for a specific state of the mobile terminal 100 is performed. In this case, an event may occur in the mobile terminal 100.

For example, a call, a message, other data, a signal reception, an alarm operation, and the like correspond to an event of the mobile terminal 100. In addition, when a song is terminated or changed in a running music player, a missed call notification window is displayed on the touch screen 151 may correspond to an event in the mobile terminal 100.

In particular, the preset event refers to an event that the user presets such that the touch screen 151 emits light in the face down mode of the mobile terminal 100 among the various events that may occur in the mobile terminal 100. . In the face-down mode of the mobile terminal 100, that is, the touch screen 151 of the mobile terminal 100 is placed facing the floor, the user emits light of the touch screen 151 among the events occurring in the mobile terminal 100. Speak the event you want to check through.

In the present specification, the touch gesture refers to an input operation for the user to operate the mobile terminal 100 through the touch screen 151 or using the sensing unit 140. The controller 180 may recognize a user's touch gesture input through the touch screen 151 or using the sensing unit 140 as an operation command of the mobile terminal 100. The touch gesture may include a user's tab operation, a flick operation, a touch drag operation for drawing a specific trajectory, and the like for a specific point. In addition, the touch gesture may include a proximity touch when the mobile terminal 100 includes the proximity sensor 141 as described above. In particular, the touch gesture using the sensing unit 140 includes a touch gesture that generates sound in the vicinity of the mobile terminal 100 and a touch gesture that is performed to generate sound on the outer surface of the mobile terminal 100.

5 is an exemplary view for explaining a face down mode of a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 5, in FIG. 5A, the mobile terminal 100 is inclined without being completely turned upside down. At this time, only one side of the mobile terminal 100 is in contact with the floor, both ends are not in contact with the floor. In this case, the controller 180 does not detect the state of the mobile terminal 100 in the face down mode. On the other hand, in FIG. 5B, the mobile terminal 100 is completely turned upside down so that the touch screen 151 faces the bottom. When the front surface of the mobile terminal 100 is bent concave, both ends 501 and 503 of the upper and lower portions of the mobile terminal are in contact with the bottom, respectively. In this case, the sensing unit 140 may detect a horizontal state of the mobile terminal 100 for a preset time, and accordingly, the controller 180 detects that the mobile terminal 100 is in a face down mode. As described above, when there is additional sensing of the sensing unit 140 according to a user setting or a manufacturer's intention, the controller 180 may sense that the mobile terminal is in a face down mode. Herein, the sensing unit 140 used to detect the face down mode of the mobile terminal 100 is referred to as a first sensing unit. The first sensing unit is a concept distinguished from the second sensing unit for sensing a user-designated direction, which will be described later.

The second sensing unit may include a sound sensor capable of sensing the ambient sound of the mobile terminal 100 and a sound generated through a touch gesture on the outer surface of the mobile terminal 100 in order to detect a user specified direction. . In addition, the second sensing unit may include a gyro sensor or an acceleration sensor capable of detecting vibration generated through a touch gesture performed on the periphery or the outer surface of the mobile terminal 100. On the other hand, when the mobile terminal 100 has a key for detecting a user-specified direction on the outer surface, the second sensing unit may detect the user-specified direction by sensing the key input.

6 is an exemplary view for explaining a position at which the display emits light in a face down mode of a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 6A, the touch screen 151 has a concave curvature. When both ends 501 and 503 of the mobile terminal 100 are in contact with the floor, the touch screen 151 faces the bottom surface. Light emitting toward is shown (601). Since the light has a scattering characteristic, the touch screen 151 may emit light to the surroundings instead of emitting light only in the space between the touch screen 151 and the bottom surface. In this case, the touch screen 151 may emit light in an entire area or a partial area. The user may recognize an event occurring in the mobile terminal 100 by checking the light emitted around the touch screen 151.

6B illustrates an example for further including a light emitting unit 603 that emits light according to an event on a side of the mobile terminal 100 so that a user may check an event occurring in the mobile terminal 100. It is also. The light emitting unit 603 may emit light in at least a partial region of at least one side surface of the mobile terminal 100 (605). On the other hand, the light emitting unit 603 may be provided in the mobile terminal 100 in the form of a touch screen according to the manufacturer's intention, it may be provided as a device for light emission only. When the user is on a specific side of the mobile terminal 100, the controller 180 may determine the location of the user and control the light emitting unit 603 to emit light toward the user. For example, in FIG. 6B, a direction 605 of the light emitter 603 may be a direction recognized by the controller 180 as the user's location.

7 is a flowchart illustrating an operation of a mobile terminal according to an embodiment of the present invention, and FIG. 9 is an exemplary diagram for describing a process of detecting a user-specified direction by recognizing a sound according to an embodiment of the present invention. .

7 and 9, both ends 501 and 503 are in contact with the floor with the mobile terminal 100 upside down in FIG. 9A. As described above with reference to FIG. 5, the controller 180 may detect a face down mode of the mobile terminal 100 through the first sensing unit (S701). FIG. 9B is an exemplary diagram for describing an operation of setting a user designation direction by generating a specific sound 903 around the mobile terminal 100 through the touch gesture 901. Referring to FIG. 9B, the user generates a sound 903 to the touch gesture 901 around the right side of the mobile terminal 100. In this case, a method of generating sound through the touch gesture 901 is merely an example, and may make a sound using a tool such as a pen or use a user's voice or an external sound device. As described above, the second sensing unit may recognize the sound generated around the mobile terminal 100 and may also sense the direction in which the sound is recognized. In this case, the controller 180 sets the direction in which the sound is sensed through the second sensing unit as a user-specified direction (S703). For example, in FIG. 9B, the second sensing unit recognizes sound on the right side of the mobile terminal 100, and the controller 180 sets the right direction of the mobile terminal 100 as a user-specified direction. In addition, in FIG. 9B, the touch gesture 901 may generate vibrations around the mobile terminal 100. That is, the sensing unit 140 may sense the vibration of the right side of the mobile terminal 100 by the touch gesture 901, and the control unit 180 may set the right side of the mobile terminal 100 in a user specified direction through the touch gesture 901. Can be. In this case, the second sensing unit may include a gyro sensor or an acceleration sensor.

FIG. 9C is an exemplary diagram for describing an operation of outputting a notification by the mobile terminal 100 so that the user can confirm the set direction when the user designated direction is set. Referring to FIG. 9C, the touch screen 151 emits light to emit light toward the right side of the mobile terminal 100 (910). In the above example, since the user-specified direction is set to the right side of the mobile terminal 100, the controller 180 controls the touch screen 151 to emit light corresponding to the user-specified direction. Thus, the user may know that the user-specified direction is set to the right when the touch screen 151 emits light.

That is, the touch screen 151 emits light and scatters light between the touch screen 151 and the floor to the surroundings. In this case, the direction in which light is scattered and spreads should correspond to a user-specified direction. In order to satisfy such a condition, the controller 180 can control a specific area related to the user-specified direction to be emitted from the entire area of the touchscreen 151 so that the touch screen 151 can emit light in the user-specified direction. Can be. In addition, the controller 180 may control the light not to be emitted in a direction other than the user-specified direction.

8 is a flowchart illustrating an operation of a mobile terminal according to another embodiment of the present invention. 7 and 9, the controller 180 has described a process of setting a user-specified direction. However, when there is no setting for the user-specified direction, the controller 180 uses the touch screen 151 as a mobile terminal ( 100 may be controlled to emit light in both right and left directions. The controller 180 detects a face down mode of the mobile terminal through the first sensing unit (S701), and controls the touch screen 151 to emit light according to a preset event (S801). In this case, the controller 180 may emit light in both the right and left directions of the mobile terminal 100, so that the entire area of the touch screen 151 may emit light, or the entire area of the touch screen 151. In the meantime, the mobile terminal 100 may control to emit light in a region near the right and the left of the mobile terminal 100.

Meanwhile, a specific example of a method in which the second sensing unit recognizes sound and sets the user-specified direction will be described with reference to FIGS. 10 and 11.

In FIG. 10A, in order to distinguish the direction in which the second sensing unit senses sound in the mobile terminal 100 in the face mode, the upper 1005 and the lower 1007 surrounding the terminal body of the mobile terminal 100 are illustrated. The regions are shown divided in the left 1001 and right 1003 directions. Each of the areas indicates an area in which the second sensing unit can sense sound in each direction of the mobile terminal 100. In order to detect the direction in which the sound is generated, the second sensing unit may be provided in the mobile terminal 100 in the form of a plurality of sensors in an inner region adjacent to each side surrounding the mobile terminal 100. The area indicates an area in which sensors located in an inner area adjacent to each side can sense sound. When sound is generated at a boundary between two areas, the sound may be sensed through at least one of each sensor sensing the two areas. In some cases, when there is no need to sense sound in the upper and lower regions 1005 and 1007 of the mobile terminal 100, the mobile terminal 100 includes sensors for sensing the upper and lower regions 1005 and 1007. You may not. Hereinafter, in the present specification, it is assumed that the area 1005 is an upward direction of the mobile terminal 100, the area 1007 is a downward direction, the area 1003 is a right direction, and the area 1001 is a left direction.

A case in which sound occurs in a specific direction of the mobile terminal 100 will be described with reference to FIG. 10B. When the user generates the sound 903 with the touch gesture 901 in a specific direction of the mobile terminal 100, the second sensing unit may detect the generated sound in each direction of the mobile terminal 100, and the controller ( 180 may set a user-specified direction in response to the sound detected by the second sensing unit. When the sound 903 generated by the user's touch gesture 901 is detected on the right side of the mobile terminal 100, the controller 180 sets the user designation direction to the right direction. On the contrary, when the sound 907 generated by the user's touch gesture 901 is detected on the left side of the mobile terminal 100, the controller 180 sets the user designation direction to the left direction.

On the other hand, when the sound 905 generated by the user's touch gesture 901 is detected from the upper side of the mobile terminal 100, the controller 180 may set the user-specified direction to the upward direction, but FIG. When the mobile terminal 100 has a curvature in the up and down direction as shown in FIG. 2, the controller 180 may control the up and down directions not to be set in the user designation direction according to a user setting or a manufacturer's intention. Since the upper and lower ends of the mobile terminal 100 are in contact with the floor, if a user-specified direction is set in one of the up and down directions, light scatters in the corresponding direction even if the touch screen 151 emits light. Because this may be impossible. In this case, when the sound is sensed through the second sensing unit in one of the up and down directions, the controller 180 can designate the user to the direction in which the sound is detected among the right and left directions of the mobile terminal 100 close to each other. The direction can be controlled to be set. Even when sensors for sensing the upper and lower regions 1005 and 1007 of the mobile terminal 100 of the controller 180 are not provided, the same operation as described above may be performed.

For example, referring to FIG. 10A, when the position where sound is sensed through the second sensing unit in the upper region 1005 of the mobile terminal 100 is close to the right region 1003, the controller 180 You can set the custom direction to the right. On the contrary, when the position where the sound is detected is close to the left side 1001, the controller 180 may set the user designation direction to the left side. In addition, as described in (b) of FIG. 9, the embodiment may be applied not only to an acoustic sensor that senses sound but also to a gyro sensor or an acceleration sensor that senses vibration.

Meanwhile, when the user generates sounds 903 and 907 with the touch gesture 901 at the right and the left of the mobile terminal 100, the controller 180 can know when the second sensing unit senses the sound. So you can set custom directions in the order in which they are detected. For example, when the sound 903 is detected through the second sensing unit, the right side is set in the user-specified direction, and when the sound 907 is detected through the second sensing unit, the user-specified direction is changed from right to left. Is set. At this time, the controller 180 controls the touch screen 151 to emit light corresponding to the right direction when the right side is first set in the user-specified direction, and emits light corresponding to the changed direction again when the user-specified direction is changed to the left side. To control.

In the above example, if a user-intentional sound occurs in a direction opposite to the user-specified direction after the user-specified direction is set in a specific direction, the user-specified direction may be changed regardless of the user's intention. To prevent this, the controller 180 may control the user-specific direction lock function to be executed when a specific key input of the user input unit 130 is detected.

Alternatively, the controller 180 may control the user-specified direction not to be changed by detecting a preset user-specified direction lock input. For example, when the controller 180 controls the touch screen 151 to emit light in response to a user specified direction, the user may check the user specified direction through the light emission. After checking the user-specified direction, if the user generates sound in the same user-specified direction again, the second sensing unit detects this and the controller 180 can control the user-specific direction lock function to be executed.

If both sounds 903 and 907 are simultaneously detected by the second sensing unit, the controller 180 may control to output a notification indicating that the user-specified direction setting has failed. The notification may be output in various ways. For example, the touch screen 151 may emit light with a specific color, the mobile terminal 100 may vibrate, or a method of outputting an audio file such as a specific warning sound. have.

FIG. 11A is an exemplary diagram for describing a case where a sound sensed by the second sensing unit is a human voice. Even when the sound is a human voice, the method of setting the user-specified direction by the controller 180 is the same as that described with reference to FIG. 10. That is, when the user-specified direction is set to the right side of the mobile terminal 100 using the voice 1101, the controller 180 controls the touch screen to emit light corresponding thereto (910). In this case, when the voice 1103 is detected through the second sensing unit, the controller 180 may change the user designation direction to the left. The above-described user-specified direction locking function may also be applied in the present embodiment. In addition, the controller 180 may control the user-specified direction to be set only by the voice of the user of the mobile terminal 100. To this end, the user may input the user's voice through the microphone 122 of the input unit 120, and may preset it as a sound for setting a user-specified direction.

For example, when the user presets the user's voice 1101 as a sound for setting a user-specified direction, if the second sensing unit detects the user's voice 1101 after the preset, the controller 180 pre-sets the user's voice 1101. It is determined whether the voiceprint of the set voice matches the voiceprint of the voice detected by the second sensing unit. As a result of the determination, when it is determined that the voiceprints of the two voices match within a predetermined range, the controller 180 sets the right direction of the mobile terminal 100 as a user-specified direction. At this time, even if the voice 1103 of the person other than the user is detected through the second sensing unit in the other direction, the controller 180 does not change the user-specified direction because the voice 1103 is different from the preset voice 1101. To control. When the user moves the seat to the left side of the mobile terminal 100, when the second sensing unit detects the user's voice, the controller 180 may control the user designation direction to be changed to the left side.

FIG. 11B is an exemplary diagram for explaining setting of a user-designated direction according to an attribute of a sound sensed by the second sensing unit. A method of setting a user-specified direction when a sound is generated in a plurality of directions around the mobile terminal 100 will be described with reference to FIG. 11B. When the decibel of the sound 1105 detected by the second sensing unit of the mobile terminal 100 is greater than the decibel of the sound 1107 detected by the left, the controller 180 may set the user-specified direction to the right. have. The controller 180 may recognize the sound for setting a user-specified direction only when the sound detected by the second sensing unit is equal to or greater than a predetermined decibel.

In addition, when the sound sensed by the second sensing unit corresponds to a specific frequency band, the controller 180 may recognize it as a sound for setting a user-specified direction. For example, when the second sensing unit detects a sound 1105 belonging to a preset frequency band, and detects a sound 1107 that is out of a preset frequency band, the controller 180 controls the direction in which the sound 1105 is detected. Can be set to a custom orientation.

In addition, the second sensing unit may detect a sense of distance of the sound. For example, it is possible to detect a sound approaching a sound that is far away and the sound provided at a fixed position. The controller 180 may use a sound that is approached by using a sense of distance of the sensed sound or a sound provided at a fixed position as a sound for setting a user-specified direction.

12 is an exemplary diagram for describing a process of setting a user-specified direction when a sound occurs on an outer surface of a mobile terminal according to an embodiment of the present invention. Referring to FIG. 12, the same as described with reference to FIGS. 7 and 9, the controller 180 may set a user-specified direction. In particular, descriptions of FIGS. 9A and 9C will be described with reference to FIG. The same applies in the case of) and (c). However, unlike the user-specified direction of FIG. 9, the user-specified direction of FIG. 12 is not set based on the sound generated around the mobile terminal 100, but based on the sound generated on the outer surface of the mobile terminal 100. Is set.

FIG. 12B illustrates an operation in which the controller 180 sets a user-specified direction when the touch gesture 901 input from the user is performed in a specific area 1201 of the outer surface of the mobile terminal 100. It is an illustration. Although the touch gesture may be performed on the outer surface of the mobile terminal 100, a case in which the touch gesture is performed on the rear surface of the mobile terminal 100 will be described by way of example.

In the present exemplary embodiment, the second sensing unit may include a sensor capable of detecting sound generated from an outer surface of the mobile terminal 100. In particular, FIG. 12B illustrates a form 1210 in which the second sensing unit is widely positioned on the rear surface of the mobile terminal 100 in order to detect sound generated in an area of the rear surface of the mobile terminal 100. 12 is illustrated as being disposed on the rear surface of the mobile terminal, but the present invention is not limited thereto and may be disposed on the side surface. The sensor 1210 may further include a touch sensor according to an outer material of the mobile terminal 100, and may include a proximity sensor when the mobile terminal 100 includes a proximity sensor. In addition, if the sound generated on the outer surface of the mobile terminal 100 can be detected regardless of the type or name of the sensor, it can be viewed as a sensor 1210 of the second sensing unit.

Referring to FIG. 12A, the controller 180 may detect a face down mode of the mobile terminal 100 through the first sensing unit (S701), and a rear surface of the mobile terminal 100 through the second sensing unit. The user may set a user-specified direction by detecting a sound generated in operation S703. When the region 1201 in which the sound is generated by the touch gesture 901 is the right side of the mobile terminal 100, the controller 180 may set the user designation direction to the right.

Hereinafter, referring to FIG. 13A, a method of setting a user-specified direction by generating sound on an outer surface of the mobile terminal 100 will be described.

FIG. 13A illustrates a rear surface of the mobile terminal 100 in which the right region 1303 and the left region 1303 are divided. A case where the mobile terminal 100 is in the face down mode will be described as an example. When the user inputs the touch gesture 901 to the rear of the mobile terminal 100, the second sensing unit detects sound generation in the area 1305 as the touch gesture 901 is performed. The controller 180 determines whether the area 1305 belongs to a right area 1303 or a left area 1301 of the mobile terminal 100. As a result of the determination, when the area 1305 belongs to an area on the right side 1303 of the mobile terminal 100, the controller 180 sets a user-specified direction to the right. Referring to FIG. 12C, the controller 180 may control the touch screen 151 to emit light in a direction corresponding to a user specified direction. That is, when the area 1305 belongs to the right area 1303 of the mobile terminal 100, the touch screen 151 emits light in the right direction (1220).

FIG. 13A (b) is an exemplary diagram for describing a method of setting a user-designated direction according to a sound generated when a drag input is made to a touch gesture on a rear surface of the mobile terminal 100. When the region 1310 where sound is generated by the drag input is the right side of the mobile terminal 100, the controller 180 may set the user designation direction to the right. In particular, when the touch gesture is a drag input, when it is sensed that the sound continues for the dragged distance 1310, the controller 180 may control the touch screen 151 to emit light in response to the area. Can be.

12 and 13A, a case in which a user makes a touch gesture on the rear surface of the mobile terminal 100 and a sound generated through the touch gesture is sensed through the second sensing unit has been described. However, in addition to the case where the second sensing unit senses the sound, the vibration is generated through the touch gesture, and even when the second sensing unit detects the vibration, the controller 180 is configured to control the external surface of the mobile terminal 100 where the vibration occurs. For example, a user-specified direction may be set according to an area, for example, as the user rubs the rear surface of the mobile terminal 100 with a touch gesture as shown in FIG. 12 (b), or the user moves as shown in (a) of FIG. When tapping the rear surface of the terminal 100, the second sensing unit detects the vibration, and the controller 180 may set a user-designated direction in consideration of the area where the vibration is sensed. The sensing sensor may be a gyro sensor or an acceleration sensor.

FIG. 13B is an exemplary diagram for describing a process of setting a user designation direction by using a physical key on an outer surface of a mobile terminal according to an embodiment of the present invention.

Referring to (a) of FIG. 13B, the mobile terminal 100 may include a physical key 3100 at a rear surface thereof. FIG. 13B (b) illustrates a physical key 3100 located on the rear surface of the mobile terminal 100 in a front view as seen from the direction 501. The scene in which the user presses the physical key 3100 (3110) is shown. Has been shown. In FIG. 13B (c), when the user presses the physical key 3100 in the right direction (3110), the physical key 3100 is tilted to the right in the form of a seesaw. Accordingly, in FIG. 13B (d), the controller 180 can set a user-specified direction in the right direction of the mobile terminal 100. In addition, in FIG. 13B (e), when the user presses the physical key 3100 in the left direction (3110), the physical key 3100 is tilted to the left in the form of a seesaw. Accordingly, in (f) of FIG. 13B, the controller 180 may set a user-specified direction in the left direction of the mobile terminal 100. FIG. 14 illustrates movement of sound detected by the mobile terminal according to an embodiment of the present invention. Or, it is an exemplary view for explaining various light emission forms of the display unit according to the drag area. In FIG. 14, the mobile terminal 100 is in a face down mode and the user designation direction is set to the right. Referring to (a) and (b) of FIG. 14, a case in which the lengths of sounds sensed by the second sensing unit are different will be described. In FIG. 14A, the user may generate a sound on the right side of the mobile terminal 100 using the touch gesture 901. In this case, when the touch gesture 901 is in a drag form, the sound ends from the drag start position. Will be moved to the position. The second sensing unit may detect the length of the sound movement, and through this, the controller 180 may determine the lengths of the drags 1401 and 1403. Here, the user generating the length of the sound with the touch gesture 901 is a display area setting operation of the touch screen 151. In addition, as described in (b) of FIG. 9, the embodiment may be applied not only to an acoustic sensor that senses sound but also to a gyro sensor or an acceleration sensor that senses vibration.

FIG. 14B is an exemplary diagram for describing that the emission area of the touch screen 151 is changed according to the display area setting in FIG. 14A. Referring to FIG. 14B, for example, the second sensing unit may detect movement of sound generated from the drag 1401 and the drag 1403, and the controller 180 may control the respective drags 1401 and 1403. ) Can be determined so that the touch screen emits light according to the drag length. That is, when the second sensing unit detects sound from the drag 1401, the controller 180 may determine the length of the drag 1401 and control the touch screen 151 to emit light 1405 accordingly. In addition, when sound is detected from the drag 1403, the controller 180 may determine the length of the drag 1403, and control the touch screen 151 to emit light in response thereto (1407). In this case, the controller 180 may control the touch screen 151 to emit light in a portion corresponding to the drag length in an area corresponding to a user specified direction.

FIG. 14C illustrates a touch screen 151 according to a length of sound generated through a user's touch gesture 901 around the mobile terminal 100 or a drag input made by the user on the outer surface of the mobile terminal 100. It is a figure for demonstrating that the light emission form of is changed. Referring to FIG. 14C, when the second sensing unit senses the length of the sound generated by the drag 1401, the controller 180 causes the touch screen 151 to emit light with corresponding brightness, wavelength, or color. 1409). In addition, when the second sensing unit senses the length of the sound generated by the drag 1403, which is relatively longer than the drag 1401, the controller 180 corresponds to the touch screen 151 by the drag 1401. The touch screen 151 may be controlled to emit light 1411 at a brighter, larger wavelength, or darker color than the light emission 1409.

Meanwhile, in the description of FIG. 14, the touch screen 151 emits light by varying an area according to the length of sound generated by the touch gesture 901. However, the touch gesture is formed on the outer surface of the mobile terminal 100. Even if a sound is generated through this, the above description is equally applicable. That is, when a drag input is made to the touch gesture on the outer surface of the mobile terminal 100, the second sensing unit may detect the length of the sound generated by the drag input, and the controller 180 makes the touch screen 151 sound It can be controlled to emit light corresponding to this generated length.

As described above with reference to FIGS. 9C and 12C, when a user-specified direction is set, the controller 180 controls the touch screen 151 to emit light so that a user can check it. In this case, referring to FIG. 7, if a preset event occurs in the mobile terminal 100 while the face down mode of the mobile terminal 100 is maintained, the controller 180 may correspond to a user-specified direction. 151 may be controlled to emit light (S705).

15 is an exemplary diagram for describing a light emitting form of a display unit in a face down mode of a mobile terminal according to an embodiment of the present invention.

(A), (b), (c) and (d) of FIG. 15 are displayed on the touch screen 151 facing the bottom when the controller 180 detects a preset event in the face down mode. Example of the screen. That is, when not in the face down mode, the controller 180 may control an event occurring in the mobile terminal 100 to be displayed through the touch screen 151. However, in the face down mode, even when the mobile terminal 100 is placed so that the touch screen 151 faces the bottom surface, even if the controller 180 detects a preset event, the touch screen 151 is informed about the event. There is no need to control the output. Therefore, in the face down mode, the controller 180 may control the touch screen 151 to minimize the information on the event and output only the partial region so as to provide limited information to the user.

In particular, FIG. 15A illustrates an area 1501 in which the touch screen 151 emits light when the user-specified direction is set to one direction as illustrated in FIGS. 9C and 12C. 15B is an exemplary diagram illustrating regions 1501 and 1503 that the touch screen 151 emits light when there is no setting of a user-specified direction. The controller 180 may adjust the brightness or pattern of the light emitted through the touch screen 151 according to the type or number of preset events to be detected. Accordingly, the areas of the regions 1501 and 1503 where the touch screen 151 emits light may be enlarged or reduced.

FIG. 15C is an exemplary diagram for describing a case in which the area of the light emitting area of the touch screen 151 is controlled to be adjusted according to the number of preset events detected by the controller 180. The controller 180 may control a portion of the touch screen 151 to emit light when the first preset event is detected. In this case, when the second preset event is detected, the controller 180 may adjust the light emitting area of the touch screen 151 according to the first preset event, and control to display the count information as the number of occurrences of the event increases. . That is, when the second preset event is detected, the controller 180 may control to display the emission area 1505 accordingly. In addition, the controller 180 may control the light emitting area of the touch screen 151 to increase the area and emit light as the number of event occurrences increases.

15D is an exemplary diagram for describing a case in which the controller 180 emits light by dividing the light emitting area of the touch screen 151 into an area having a different color according to the type of a preset event. Referring to FIG. 15D, when the first preset event occurs, the controller 180 controls the touch screen 151 to emit light in the first color in the region 1507, and the second preset event occurs. The touch screen 151 may be controlled to emit light in the region 1509 in the second color. The controller 180 may control the two regions 1507 and 1509 to emit light at the same time, or may control to emit light alternately at a predetermined time interval. The regions 1507 and 1509 may be further subdivided and partitioned according to the type or number of events, and the area may vary.

The controller 180 may control the touch screen 151 to emit light in a partial region 1505 of the side region of the touch screen 151 according to the type of preset event.

FIG. 16 is an exemplary diagram for describing that a display unit of a mobile terminal emits light in a user specified direction according to a preset event according to an embodiment of the present invention.

FIG. 16A illustrates an example of a screen on which reception information and a reception selection window are displayed through the touch screen 151 when a preset event is a telephone reception of the mobile terminal 100. When the call reception 1520 from a specific contact is a preset event, the controller 180 determines whether the event is a preset event when the call reception event occurs. When the event corresponds to a preset event 1520, the touch screen 151 emits light 1530 as shown in FIG. 16B. 16B illustrates a case in which the touch screen 151 emits light when a user-specified direction is not set as shown in FIG. 15B. If the user-specified direction is set to the right side of the mobile terminal 100, when the preset event occurs, the controller 180 moves the touch screen (right) to the right direction set in the user-specified direction as shown in FIG. 151 may be controlled to emit light. This allows the user to know that a preset event has occurred.

17A is an exemplary view for explaining that a display unit of a mobile terminal emits light differently according to the importance of an event according to an embodiment of the present invention. In particular, (a), (b) and (c) of FIG. 17A are exemplary views for explaining a case in which there is no setting for a user-specified direction as described above in the description of FIG. 8. Referring to FIG. 17A, in the face down mode of the mobile terminal 100, the controller 180 detects a preset event and controls the touch screen 100 to emit light in both directions (right and left) of the mobile terminal 100. do. In this case, the touch screen 151 may be displayed as shown in FIG. 15B.

Referring to (a), (b) and (c) of FIG. 17A, the controller 180 may control the touch screen 151 to emit light with different brightness according to a preset event. A case where the preset event is reception of a message from a specific sender will be described as an example. When the user is in the state of doing other work while the mobile terminal 100 is turned upside down, the user may want to confirm a specific message and may not want to confirm the other message. Thus, the user can set the reception of a message from a specific sender who wants to confirm as a preset event. At this time, if a message is received once, the controller 180 determines whether the message reception corresponds to a preset event. As a result of the determination, when the message corresponds to the preset event, the controller may control the touch screen 151 to emit light at a light brightness as shown in FIG. 17A.

Thereafter, when the user does not confirm the received message, if the message is received twice from the same sender, the control unit emits light on the touch screen 151 at a darker brightness than that of (a) of FIG. 17A as shown in FIG. 17A. Can be controlled. If the user does not confirm all the received messages twice, if the message is received three times from the same sender, the control unit touch screen 151 with a darker brightness than (b) of FIG. 17A as shown in (c) of FIG. 17A. It can be controlled to emit light. The brightness of the light emitted from the touch screen 151 may be adjusted according to the number of unacknowledged reception messages according to a user setting or a manufacturer's intention. In addition, the controller 180 may control the brightness not to change every time the number of unacknowledged reception messages increases once, as described above, and to change the brightness to the number of times according to a user setting. In addition, even if the number of occurrences of the event is repeated as described above, if the user does not confirm the above, the mobile terminal 100 according to the present invention emits through the touch screen 151 on the bottom surface in contact with the touch screen 151. It is possible to produce the color of light. That is, the controller 180 can detect the color of the floor on which the mobile terminal 100 is placed and control the light to be emitted in a color complementary to the color of the floor surface through the touch screen 151. If the user does not check the event that occurred multiple times, the controller 180 outputs the color of the light emitted by the touch screen 151 in a darker manner, so that the light emitted by the touch screen 151 on the bottom surface is dyed; Can produce the same visual effect. A method of determining the color of the bottom surface by the controller 180 will be described later with reference to FIG. 28A.

Meanwhile, in addition to receiving a message, when the user sets a signal reception from a specific source as a preset event, the signal may include all signals received from the same source such as a telephone, a message, a messenger, and the like. For example, when receiving a message once from a specific sender corresponding to a preset event, the controller 180 can control the touch screen to emit light as shown in FIG. 17A (a). Thereafter, when the user receives the call once from the same originator in the unacknowledged state, the controller 180 can control the touch screen to emit light with a darker brightness than that of FIG. 17A as shown in FIG. 17A. .

In addition, a case in which the user sets the reception of a signal from a specific contact list other than a specific originator as a preset event will be described as an example. If contacts of three persons A, B, and C exist in the contact list, each time a signal is received from each contact, the controller 180 displays the brightness of (a), (b), and (c) of FIG. 17A, respectively. The touch screen 151 may be controlled to emit light. That is, the controller 180 may control the touch screen 151 to emit light with different brightness for each person present in the contact list.

In addition, the controller 180 may control the touch screen 151 to emit light by varying the brightness every time a signal is received from a contact in the contact list. For example, when a message is received once from a contact of A present in the contact list, the controller 180 may control the touch screen to emit light as shown in FIG. 17A. When the message is received twice from the contact A, the controller 180 controls the touch screen 151 to emit light as shown in FIG. 17A, and when receiving a message from the contact B of the same contact list, the controller ( 180 may control the touch screen 151 to emit light as shown in (c) of FIG. 17A. That is, the controller 180 may control the touch screen 151 to emit light by varying the brightness every time a signal is received from a contact belonging to a specific contact list.

Only the case where the touch screen 151 emits light with different brightness according to an event has been described above. However, the touch screen 151 may emit light by changing at least one of color, pattern, and wavelength according to an event.

For example, when a call is received from contacts of A, B, and C respectively present in the contact list of the mobile terminal 100, the controller 180 determines that the touch screen 151 of FIG. ), And may be controlled to emit light in different colors as shown in (b) of FIG. 17A and (c) of FIG. 17A. The user may preset the color output through the touch screen 151 when receiving a call for each contact existing in the contact list. The controller 180 checks the contact when receiving a call and controls the touch screen 151 to emit light in a color corresponding to the corresponding contact preset by the user. Accordingly, when the user receives a call, the user may predict the contact point by checking the color emitted from the touch screen 151.

In addition, in FIG. 17A, only the case where the user-specified direction is not set is illustrated, but when there is a user-specified direction setting, the controller 180 may control the touch screen 151 to emit light only in the user-specified direction.

17B is an exemplary diagram for describing a display pattern of a display unit when a mobile terminal according to an embodiment of the present invention receives a call.

When the preset event is a call reception to the mobile terminal 100, the controller 180 may express a feeling of receiving a call through the touch screen 151. That is, referring to FIGS. 17B, 17B, 17B, and 17C, when the controller 180 detects a call reception, the wavelength of light gradually spreads through the touch screen 151. You can control that the shrinking pattern is displayed again. That is, when the call is received, the controller 180 spreads the light emitted from the touch screen 151 to the outside direction 3200 of the mobile terminal 100 in FIG. As shown in (c) of 17b, the spreading may be further enlarged (3210) and may be controlled to be reduced in the direction (3220) of the mobile terminal 100. In addition, the controller 180 may control such a pattern to be repeated.

18 is an exemplary view for explaining that the display unit of the mobile terminal emits light differently according to the number of events when the event is a signal reception according to an embodiment of the present invention. In FIG. 18A, as an example of a preset event, a notification window for notifying occurrence of a missed call from the VIP is illustrated. Hereinafter, the case where the user designation direction is the right side will be described as an example. If the user misses the call, the controller 180 controls the notification window for notifying the missed call to be displayed through the touch screen 151. However, when the mobile terminal 100 is in the facedown mode, since the user does not directly look at the touch screen 151, it may be difficult to check the notification window. The controller 180 determines whether the missed call occurrence corresponds to a preset event.

For example, the user may create a VIP list in advance and set an event to be generated when a signal is received from a corresponding contact. When a missed call occurs because the user does not receive a call from the VIP, the controller 180 may control the touch screen 151 to emit light. Referring to FIGS. 18B and 18C, when the missed call from the VIP, which is the preset event, occurs once, the touch screen 151 emits light as shown in FIG. 18B. Can be controlled. The controller 180 may control the user's right direction to emit light in the entire area of the touch screen 151, but control the light to be emitted in some areas to correspond to the number of event occurrences. Accordingly, when the touch screen 151 emits light into a light emitting area corresponding to one event, light is emitted to an area 1710 (hereinafter, referred to as a first area) on the bottom surface where the mobile terminal 100 is placed. Can be. When the same event occurs again, the controller 180 may control to enlarge the area where the touch screen 151 emits the light as many times as the occurrence of the same event. For example, when two missed calls are generated from the VIP, the controller 180 may control the touch screen 151 to emit light as shown in FIG. 18C. FIG. 18C illustrates an area 1720 corresponding to twice the first area 1710 corresponding to the light emitting area of the touch screen when the one-time missed call is shown in FIG. 18B. It is shown that the light emitted by the light is emitted.

Although the case where the preset event is the occurrence of the missed call from the VIP has been described, the controller 180 is not the case of the missed call from the VIP, or even if the missed call occurs because the user does not receive a call received from a contact other than the VIP. ) May be treated the same as the VIP contact. The controller 180 may check the transmission / reception pattern of the user even if the contact other than the VIP is used and treats the contact other than the VIP as the contact of the VIP when the missed call occurs continuously for a predetermined number of times or more. Alternatively, if the user's transmission / reception pattern analysis shows that a missed call has been made from the contact in the past, and the time taken to call the contact is very short, less than a predetermined time, the number of times the user calls the contact is If a predetermined number of times or the like is detected, the controller 180 can apply the above embodiment by treating the contact as a VIP contact even if the contact is not a VIP contact. When the missed call is generated from the VIP contact or the contact that can be treated as the VIP contact as described above, when the user lifts the mobile terminal 100 and faces the user's ear, the controller 180 controls the mobile terminal 100 to make a call to the contact. Can be controlled. To detect this, the controller 180 may control the wireless communication unit 110 to make a call to a corresponding contact when a predetermined condition is satisfied using at least one of a gyro sensor, an acceleration sensor, an altitude sensor, and a proximity sensor. have.

In addition, the present embodiment may be applied to various cases in which the light emitting area may be changed according to the number of times other than the missed call occurrence event.

FIG. 19 is an exemplary view for explaining that the display unit of the mobile terminal emits light differently according to the type or number of occurrences of events when the user designation direction is set to the right in one embodiment of the present invention. Particularly, referring to FIGS. 19A, 19B, 19C, and 19D, when a plurality of events occur in the mobile terminal 100 in the face down mode, the touch screen 151 may display color, wavelength, It will be described that the light emission is made by different patterns and light emitting regions.

Referring to FIGS. 19A and 19B, when the controller 180 detects the first preset event and the second preset event at separate times, the controller 180 may detect the event according to the type of the detected event. As illustrated in (a) and (b) of FIG. 19, the touch screen 151 may be controlled to emit light at different wavelengths. In addition, when the controller 180 detects the first preset event and the controller 180 detects the second preset event while the touch screen 151 emits light in the first form as shown in FIG. 19A. As illustrated in FIG. 19B, the touch screen 151 may be controlled to emit light in a second form in which the first form is modified. Alternatively, the controller 180 may control the touch screen 151 to emit light in a pattern in which the first and second shapes are repeated.

According to an embodiment of the present invention, the first preset event and the second preset event may have the same shape according to a user setting or a manufacturer's intention. May be applied in the case. That is, the deformation of the light emitting form or the repetition of the pattern may provide the user with information about the number of occurrences of the same event.

On the other hand, the above embodiment may be applied when the first preset event and the second preset event differ according to a user setting or a manufacturer's intention. That is, the deformation of the light emitting form or the repetition of the pattern may provide the user with information that a different event has occurred.

Referring to FIG. 19C, as in the description of FIG. 18, the controller 180 may control the touch screen 151 to emit light corresponding to the number of occurrences of a preset event. The controller 180 detects the first preset event and controls the area where the touch screen 151 emits light to be displayed on the first area 1830 of the floor where the mobile terminal 100 is placed. If the controller 180 detects a second pre-event while the touch screen 151 emits light in the first area, the touch screen 151 controls to emit light in the second area 1833. Can be. Here, the first preset event and the second preset event may be different from each other, but may have a common content in the event. For example, when the user sets the preset event to signal detection from a VIP belonging to a specific contact list, the first preset event may be a message reception, and the second ejaculation setting event may be a telephone reception. In other words, the types of events are different, but the contacts of the other party are the same. In this case, the controller 180 detects the first preset event and while the touch screen 151 emits light in the first area 1830, the second area 1833 has the same color as that displayed in the first area. ), The touch screen 151 may be controlled to emit light. The second area may be an area adjacent to the first area. The user may know from the emitted light 1830, 1833 that a number of contacts have come from the same contact in the contact list.

In addition, the above example may be applied to a case where a message is received from different contacts belonging to the same contact list. For example, when a message is received from different contacts A and B belonging to the specific contact list, the controller 190 may control the touch screen to emit light as shown in FIG. 19C. The controller 180 controls the touch screen 151 to emit light in the first area 1830 when a message is received from the contact A. FIG. As such, when a message is received from the contact B while the light is emitted in the first area 1830, the controller 180 detects the message and the color displayed on the first area 1830 in the second area 1835. The touch screen 151 may be controlled to emit light with the same color.

Referring to FIG. 19D, when the controller 180 detects a second pre-event different from the first pre-event while the touch screen emits light in the first area 1835, the controller ( 180 may control the touch screen 151 to emit light as shown in FIG. That is, when the controller 180 detects the second preset event, the touch screen 151 may control the other area to emit light while maintaining the emission state of the area to emit light when the first preset event occurs. have. Accordingly, the touch screen 151 emits light to the second area 1840 in a state of emitting light to the first area 1835. In this case, the controller 180 may control the touch screen 151 to emit different light to the first area 1835 and the second area 1840.

Herein, the case in which the first preset event and the second preset event are different types has been described as an example. That is, when the controller 180 detects the first preset event while detecting the first preset event, the touch screen 151 may emit light as shown in FIG. 19D. It can be explained. However, FIG. 19D may be applied even when the same preset event occurs. For example, when the preset event is a missed call occurrence from the VIP, when the first missed call occurs, the controller 180 may control the touch screen 151 to emit light in the first area 1835. . Then, when the cumulative three missed calls are detected from the VIP, the controller 180 lights the second area 1840 with a color darker than the color of the light emitted by the touch screen 151 to the first area 1835. It can be controlled to be released.

20 is an exemplary view for explaining that the display of the mobile terminal emits light differently according to the amount of data transmission and reception when the event according to an embodiment of the present invention is data transmission and reception. 20 (a) and 20 (b) are for explaining the transmitting side mobile terminal 100, and FIGS. 20 (c) and 20 (d) show the receiving side mobile terminal 100. To illustrate.

Referring to FIG. 20A, when the user designation direction is right, when the mobile terminal 100 is transmitting mail or uploading data, the controller 180 transmits data through the touch screen 151. Alternatively, the number of data to be transmitted may be displayed. The controller 180 may control the touch screen 151 to emit light in the areas 1910 and 1920 in response to the amount of data or the number of data to be transmitted in the transmission start step. Referring to FIG. 20B, the controller 180 is configured to store the data waiting to be transmitted except for the amount (or number) of data transmitted among the entire areas 1910 and 1920 where the touch screen 151 may emit light. The touch screen 151 may be controlled to emit light to an area 1910 corresponding to a quantity (or number). In this case, the controller 180 may control the touch screen 151 not to emit light in the region 1920 corresponding to the amount of data already transmitted.

Referring to FIG. 20C, when the mobile terminal 100 is receiving mail or downloading data, the controller 180 can control the data reception state to be displayed through the touch screen 151. That is, when the user designation direction is right, the controller 180 may control the touch screen 151 not to emit light when there is no data amount or data number received in the data reception start step. Referring to FIG. 20D, the controller 180 corresponds to the amount of received data except for the amount of data waiting to be received, among the entire areas 1910 and 1920 where the touch screen 151 can emit light. The region 1920 may control the touch screen 151 to emit light. In this case, the controller 180 may control the touch screen 151 not to emit light in the area 1910 corresponding to the amount of data waiting to be received.

Meanwhile, the descriptions of FIGS. 20B and 20D may be applied to data transmission / reception between the mobile terminals 100. For example, FIG. 20B illustrates an example of a mobile terminal transmitting data between mobile terminals in mobile short-range wireless communication, and FIG. 20D illustrates an example of a mobile terminal receiving data. As data is transmitted, the area 1910 corresponding to the amount of data waiting to be transmitted in FIG. 20B decreases, and the area corresponding to the amount of received data in FIG. 20D increases.

FIG. 21 is an exemplary diagram for explaining that the display unit of the mobile terminal emits light differently according to a music genre or playing time when the event is music playback according to an embodiment of the present invention.

Referring to FIG. 21A, the controller 180 may control to display a play state information of music and a player capable of playing music through the touch screen 151 by receiving a user input. In this case, the controller 180 may control to display an area for visualizing the play state of the music currently being played (2010), such as the genre of the music or the sound intensity, in order to provide the play state information of the music. have. In addition, the controller 180 may control to display a player 2020 for manipulating a music playback operation through the touch screen 151. In (a) of FIG. 21, not only can a player operate a play operation through a play operation button, but a player that can additionally provide information such as a song title and a play time is shown as an example.

Referring to FIGS. 21B and 21C, when the mobile terminal 100 is playing music through the player, the controller 180 detects this as a preset event and sounds the music being played. The touch screen 151 may be controlled to emit light differently according to the intensity of music, the genre of music, or the playing time.

According to an embodiment of the present invention, for example, when a particular music is being played through the music player, when the sound intensity is being played back, the controller 180 makes the touch screen 151 of FIG. Can be controlled to emit light with strong brightness or dark color. When the specific music plays a portion where sound intensity is weak during playback, the controller 180 makes the touch screen 151 weaker in brightness or lighter color than in the case of FIG. 21B as shown in FIG. 21C. Can be controlled to emit light.

In addition, according to an embodiment of the present invention, when a specific music is being played through the music player, the controller 180 controls the light emitted from the touch screen 151 during the end of the playing time of the music from the start of playing the specific music. It can be controlled to emit light by changing the brightness or color of. For example, when the playback of a particular music is started, the controller 180 can control the touch screen 151 to emit light in dark colors as shown in FIG. 21 (b), and as the play time elapses, the touch screen 151 ) Can be controlled to gradually lighten the color emitted. In this case, the controller 180 can control the touch screen 151 to emit light in a light color as shown in FIG. 21C when the play time ends.

In addition, according to an embodiment of the present invention, when the specific music being played through the music player is a strong beat of rock music or dance music, the controller 180 makes the touch screen 151 strong as shown in FIG. It can be controlled to emit light with brightness or dark color. When the specific music is played and the music played by the player is changed, when the genre of the changed music is a bit of music that is weaker than the previously played specific music such as a ballad or a performance song, the controller 180 controls the touch screen 151. As shown in (c) of FIG. 21, light emission may be performed at lighter brightness or lighter color than in the case of FIG.

On the other hand, in the above embodiment, the control unit 180 controls the touch screen 151 to emit light by changing the color or brightness may be a method using the visualization area 2010 displayed on the touch screen 151. Unlike the case of FIG. 15, even when the mobile terminal 100 is in the face down mode, the controller 180 may control to display the music visualization area 2010 and the player 2020 through the touch screen 151 during music playback. Can be. In this case, the controller 180 may control various visual effects to be displayed on the touch screen 151 according to at least one of the genre of music, sound intensity, or playing time through the visualization area 2010. Therefore, the user can see the light emitted by the visual effect between the touch screen 151 and the floor on which the mobile terminal 100 is placed. Through this, the user may experience the visual effect of the music player even in the face down mode of the mobile terminal 100 without looking at the screen on which the music player is displayed through the front of the touch screen 151.

21 may be more effective when the speaker is located at the rear of the mobile terminal 100 in the face down mode of the mobile terminal 100. In addition, when the speaker is located at the rear of the mobile terminal 100, when the preset event is a phone call through the speaker phone, the controller 180 may notify the user that the user is busy using the speaker phone. ) Can be controlled to emit light. In addition, the controller 180 may control the touch screen 151 to emit light by changing brightness or color as the call time through the speaker phone elapses. For example, the controller 180 may control the touch screen 151 to emit light gradually every 10 minutes of communication time. FIG. 21 illustrates the touch screen 151 when a user-specified direction is not set. Although the light emission has been described as an example, when the user designation direction is set, the controller 180 may control the light emission of the touch screen 151 to correspond to the set user designation direction.

FIG. 22 is an exemplary diagram for describing that when an event is music playback according to an embodiment of the present invention, the display of the mobile terminal emits light in different regions according to the music genre on the playlist.

Referring to FIG. 22A, the controller 180 may control to display a playlist 2030 and a player 2020 capable of playing music through the touch screen 151 by receiving a user input. In particular, the controller 180 may control the next play scheduled song of the song being played by the player to be displayed in a list form 2030.

Referring to FIG. 22B, the controller 180 may control light of a specific color 2031 to be emitted from a portion of the touch screen 151 in response to the song “Hotel California” being played. The user can know the genre of music currently playing. In addition, the controller 180 may control the touch screen 151 to emit light in response to the genre of the song to be played through the player. That is, adjacent to the area where the touch screen 151 emits light in response to the current playback song, the controller 180 may move a portion of the touch screen 151 according to the genre of music present in the playlist 2030. Different colors may be used to control the light emission 2033 and 2035. This allows the user to grasp the genre of music present in the playlist in order, in addition to the music currently being listened to.

  FIG. 23 illustrates that when an event is a timer operation performed in a face down mode of a mobile terminal 100, the display of the mobile terminal emits light by varying a light emitting area according to a duration of a face down mode. It is an exemplary figure for following. When the user turns the mobile terminal 100 over, the mobile terminal 100 may enter the face down mode. According to the present embodiment, when the user is in a meeting or taking a class, the user may obtain time information while maintaining the face down mode of the mobile terminal 100. Referring to FIGS. 23A and 23B, when the mobile terminal 100 enters the face down mode, the controller 180 may respond to the touch screen 151 corresponding to the duration of the face down mode. It can be controlled to emit light.

For example, the controller 180 may control the touch screen 151 to emit light as shown in (a) of FIG. 23 after 10 minutes after the mobile terminal 100 enters the face down mode. In FIG. 23A, the controller 180 may control a portion of the touch screen 151 to emit light as the face down mode elapses, so that the touch screen 151 emits light to the area 2101. Can be released. Thereafter, when another 10 minutes have elapsed, the controller 180 can control the touch screen 151 to emit light as shown in FIG. In FIG. 23B, the controller 180 may control the touch screen 151 to emit light in a wider area 2103 than in FIG. 23A. As described above, the time for increasing the area of the touch screen 151 to emit light may be determined according to a user setting.

23 (c) illustrates that the touch screen 151 emits light according to a continuous flow of time, unlike when the light emitting area of the touch screen 151 increases for each time unit set by the timer. It is an illustration for. Referring to FIG. 23C, the controller 180 may control the touch screen 151 to emit light in the continuous area 2015 in response to the time duration of the face down mode. As a result, the user may check the continuous flow of time in which the face down mode of the mobile terminal 100 continues. If the controller 180 detects the elapse of the preliminary time, the controller 180 may control the area where the touch screen 151 emits light to gradually widen in response to the detected time. When a preset time elapses, the controller 180 may adjust an area in which the touch screen 151 emits light so that light is emitted in the entire continuous area 2015. The timer function may be automatically executed by an execution command by a user input or when the controller 180 detects a face down mode.

On the other hand, the embodiment can be applied to all embodiments that can adjust the light emitting area of the touch screen 151 by measuring a specific amount that can be measured by the controller 180.

For example, FIG. 23 illustrates that when the preset event according to the present invention is checking the remaining power level of the mobile terminal, the controller 180 controls the touch screen 151 to emit light by varying the light emitting area according to the measured remaining power amount. can do. Alternatively, the preset event may be applied when the charging amount of the mobile terminal 100 is checked while the mobile terminal 100 is charging. That is, the controller 180 may adjust the light emitting area of the touch screen 151 according to the charging amount of the mobile terminal 100. Accordingly, the area 2101 in which the touch screen 151 emits light in FIG. 23A becomes wider to the area 2103 shown in FIG. 23B as the amount of charge of the mobile terminal 100 increases. Can lose. In addition, as shown in FIG. 23C, the controller 180 may control the touch screen 151 to continuously display the increase in the amount of charge of the mobile terminal 100.

Alternatively, when the preset event is multimedia playback, the controller 180 may control the touch screen 151 to emit light by varying the light emitting area according to the playback time of the multimedia being measured. The controller 180 corresponds to the entire play time of the multimedia to the light emitting area of the touch screen 151, and the touch screen 151 emits light as shown in FIG. 23A whenever a predetermined time elapses during the play time. As shown in (b), the light emitting area may be controlled to increase. The flow of reproduction time may be represented by a continuous flow of time as shown in FIG.

FIG. 24 is an exemplary view for explaining that an event is outputted at a current time according to an embodiment of the present invention, and the display unit of the mobile terminal reverses and outputs time information when the mobile terminal is placed on a specific floor surface. In the face down mode of the mobile terminal 100, when the controller 180 controls the touch screen 151 to emit light, the emitted light may be reflected according to the material of the bottom surface. That is, when the bottom surface on which the mobile terminal 100 is placed is made of glass, when the touch screen 151 emits light, the emitted light may be reflected at a certain amount and at a certain angle through the bottom surface of the glass material. Referring to FIG. 24A, when the controller 180 detects a preset event, the controller 180 may control the touch screen 151 to emit light. In this case, the light emitted from the touch screen 151 may be a bottom surface ( 2200 may be reflected. The user may check the event of the mobile terminal 100 through the light leaking into the space between the touch screen 151 and the bottom surface 2200, but the mobile terminal 100 through the reflected light 2201 as in the present embodiment. If you check the events of the more specific information can be obtained. The controller 180 may determine the material of the bottom surface 2200 on which the mobile terminal 100 is placed through the sensing unit 140. In particular, the sensing unit 140 may include an optical sensor and determine the material of the bottom surface 2200 by measuring a reflectance of light emitted toward the bottom surface. When a reflectance of a predetermined range or more is measured, the controller 180 may control the display screen of the touch screen 151 to be inverted and output when the touch screen 151 emits light in response to a preset event.

FIG. 24B is an exemplary diagram for describing a display screen inverted and output from the touch screen 151. When the user wants to check the current time information, if a specific input is made through the user input unit 130, the controller 180 may control the current time information to be output through the touch screen 151. However, when the face down mode is continued, time information cannot be checked through the front of the touch screen 151. However, when the light 2201 emitted by the touch screen 151 is reflected through the bottom surface 2200 as shown in FIG. 24A, the user may check current time information through the reflected light 2201. have. Referring to FIG. 24B, in the face down mode, the controller 180 may control the current time to be inverted 2203 and output through the touch screen 151. Even when the touch screen 151 is placed on the bottom surface in the face down mode, the controller 180 may control the touch screen 151 to emit light when it detects a preset event. If the preset event detects a user input for confirming the current time value, the controller 180 may control the current time information to be output to a portion of the touch screen 151. In particular, when the controller 180 detects the material of the bottom surface 2200 through the sensing unit 140 and determines that the material reflects the light emitted through the touch screen 151, the current time information is displayed. It can be controlled to be inverted and output. In this case, the controller 180 may determine the reflectance of the bottom surface 2200 and the like to control the current time information to be inverted and displayed on a portion of the touch screen 151. In particular, the controller 180 may control the current time information emitted by the touch screen 151 to be inverted and distorted according to the determined reflectance of the bottom surface 2200. That is, the controller 180 may control the display to change the appearance, color, brightness, size, etc. of the current time information to be displayed (2203), so that the bottom surface 2200 takes the role of the touch screen 151 instead. You can do it. Referring to FIG. 24C, when the touch screen 151 displays the current time information 2203 in an inverted form, the current time information 2205 is non-inverted on the bottom surface 2200. do. At this time, the concluded image is reflected so that the user can check the current time information of the non-inverted form.

Although the above embodiment has been described using the case where the preset event is the current time check as an example, if the material of the bottom surface can reflect the light emitted through the touch screen 151, the type of the preset event is not limited. Can be applied without

FIG. 25 illustrates an example in which a snooze function is activated by a sound generated by a touch gesture and the display unit of the mobile terminal emits light differently according to a snooze time when an event is an alarm output according to an embodiment of the present invention. It is also.

Referring to FIG. 25A, when the alarm time preset by the user arrives, the controller 180 may output an alarm and display the alarm screen on the touch screen 151. At this time, the alarm output is made in the form of an alarm output through the sound output module 152, at least one of the vibration output through the alarm unit 153 and the touch screen 151. The user may detect an alarm through the alarm output, terminate the alarm output through the operation of the function key 2310 displayed on the alarm output screen displayed on the touch screen 151, or activate the alarm snooze function. The alarm snooze function refers to a function for generating an alarm output again after a predetermined time based on a preset alarm time. However, when the mobile terminal 100 is in the face-on mode, the user may not operate the alarm output screen through the touch screen 151 even though an alarm output event is output through the touch screen 151. FIG. 25B is an exemplary diagram for describing a method of activating a snooze function when the mobile terminal 100 is outputting an alarm in a face down mode. Referring to FIG. 25B, during an alarm output, the controller 180 may control the touch screen 151 to emit light in response to an alarm output event. In this case, the controller 180 may control the light to be emitted to both the right and left sides of the mobile terminal 100 as shown in FIG. 25B, but when a user-specified direction is set, the touch screen 151 Only a part of the region may be controlled to emit light 2320. As such, when the user generates a sound through the touch gesture on the outer surface of the mobile terminal 100 during the alarm output, the controller 180 detects this through the second sensing unit and controls the snooze function to be activated. Specifically, when the user generates a sound through the touch gesture on the rear of the mobile terminal 100, the controller 180 activates the snooze function, the area where the sound generated by the touch gesture is detected, and the time duration of the sound. The snooze time of the snooze function may be controlled to correspond to at least one of the above. Also, as illustrated in FIG. 17A, the controller 180 may control the touch screen 151 to emit light by changing at least one of color and brightness according to the adjusted snooze time so that the user can check the adjusted snooze time. have. In addition, as illustrated in FIG. 21, the controller 180 may control the touch screen 151 to emit light by varying an area in which light is emitted according to the adjusted snooze time. For example, when the snooze time is set to 5 minutes, the controller 180 may control the touch screen 151 to emit light as shown in FIG. In addition, when the snooze time is set to 10 minutes, the controller 180 may control the touch screen 151 to emit light as shown in FIG. 23B.

FIG. 25C illustrates an alarm output screen displayed on the touch screen 151 when a sound through a touch gesture occurs on the rear surface of the mobile terminal 100 as described above. During the alarm output, the controller 180 may activate a snooze function by detecting a sound generated through a touch gesture on the rear surface of the mobile terminal 100 and adjust the snooze time. In this case, the snooze setting 2330 may be displayed on the touch screen 151.

FIG. 26 is an exemplary diagram for describing that when an event according to an embodiment of the present invention executes a voice recording operation, the display of the mobile terminal emits light differently according to a recording progress state.

Referring to FIGS. 26A and 26B, in FIG. 26A, when the preset event is execution of a recording program, the controller 180 executes a recording program execution screen through the touch screen 151. Control to display (2400). When the user executes the recording program and turns the mobile terminal 100 upside down, the controller 180 detects the face down mode and causes the touch screen 151 to emit light 2410 and 2415 as shown in FIG. Can be controlled. Through this, the user may know that the mobile terminal 100 is executing recording. The controller 180 may control the touch screen 151 to emit light with a specific color during the recording time so that the user can be notified that recording is in progress. Alternatively, since the user can confirm that the mobile terminal 100 is continuously recording, the user may preset the mobile terminal 100 not to continuously emit light through the touch screen 151. In this case, the controller 180 may control the touch screen 151 to emit light every predetermined time so that the user can recognize that recording is continued. For example, the controller 180 may control the touch screen 151 to emit light whenever the recording progress time elapses for 5 minutes. In addition, the controller 180 may control to emit light by changing a color for each specific time unit during recording. FIG. 26B illustrates an example in which the controller 180 controls the touch screen 151 to emit light 2410 and 2415 in both directions of the mobile terminal 100 without setting a user-specified direction. If there is a user-specified direction setting in the right direction of the mobile terminal 100, the controller 180 may control the touch screen 151 to emit light 2410 in the right direction of the mobile terminal 100.

If the method of setting the user-specified direction is a method in which the controller 180 recognizes the sound through the second sensing unit, if the direction of the recorded sound is different from the user-specified direction, the controller 180 records the user-specified direction. The direction of the sound can be changed. In order to prevent such a change in the user-specified direction, the user-specified direction locking function described above with reference to FIG. 10 may be used. Therefore, when a user-specified direction is set in a specific direction from the user and the user-specified direction locking function is set, the controller 180 can fix the user-specified direction in the corresponding direction. In this case, even if the direction of the recorded sound is different from the user-specified direction, the user can check the recording progress state in the user-specified direction as the touch screen 151 emits light. In addition, the user voice may be preset as a sound for setting a user-specified direction as described above with reference to FIG. 11 in addition to the user-defined direction lock. When the controller 180 detects a voice that matches the preset user voice in a specific direction, the controller 180 sets a user-specified direction to the specific direction, and the user-specified direction is not changed even when a sound recorded in the other direction is detected.

FIG. 26C is an exemplary diagram for describing a method of controlling a voice recording state using a sound through a touch gesture on the rear surface of the mobile terminal 100. Referring to FIG. 26C, when the touch gesture 901 is input to the rear surface of the mobile terminal 100, the controller 180 generates a sound, and detects the sound to control a running recording program. can do. For example, when a user makes a tap input 901 of a touch gesture on the rear of the mobile terminal 100, the controller 180 detects a sound generated through the touch gesture and recognizes the detected sound as a recording pause command. You can pause the recording in progress. In addition, if the tap 901 is input twice within a predetermined time, the controller 180 detects the sound generated through the tap 901 and recognizes the detected sound as a recording end command, thereby terminating the ongoing recording and storing the recorded file. Can be controlled. On the other hand, after the touch gesture is input once and the sound is generated, if the touch gesture is input again after the predetermined time is exceeded and the sound is generated, the controller 180 can control the recording to be resumed. have.

In this case, as shown in (c) of FIG. 26, the controller 180 differently emits at least one of color, brightness, and pattern according to an event such as recording pause and recording termination (2420). Can be controlled. In addition, the controller 180 may control the touch screen 151 to emit light as shown in FIG. That is, the controller 180 may control the touch screen 151 to emit light differently according to the type of recording event, thereby allowing the user to check the progress of recording.

FIG. 26D is an exemplary diagram of a recording pause screen. FIG. Referring to (d) of FIG. 26, when the recording in progress as shown in FIG. 26 (a) is paused according to the control of the recording program using the sound through the touch gesture, the controller 180 controls the touch screen 151. You can control the recording pause screen.

FIG. 27 is an exemplary diagram for describing a method of outputting a notification of a display unit of a mobile terminal when an event is a specific task incomplete detection according to an embodiment of the present invention. When a user performs a specific task using the mobile terminal 100, the controller 180 may control a task window for performing the specific task to be displayed on the touch screen 151. In FIG. 27A, an edit window 2500 used to perform a text editing task is illustrated as an example of a work window for performing a specific task. The edit window 2500 is divided into different areas for each function such as text editing, cutting, and copying. The controller 180 may control the editing window 2500 to be displayed through the touch screen 151. In this case, when a touch gesture is input from a user in an area divided by functions of the edit window, the controller 180 performs a corresponding editing operation. However, the editing work through the editing window 2500 may require subsequent work. For example, the text correction function may require post-modification save operation, the cut function, and the copy function may cut or copy text and paste the text to another area. If the user has not performed subsequent work, the work is incomplete. When the mobile terminal 100 is in the face down mode, when the controller 180 detects incomplete work, the controller 180 may control the touch screen 151 to emit light 2510 in some areas as shown in FIG. 27B. The controller 180 may control the touch screen 151 to emit light by changing at least one of color, brightness, wavelength, and pattern according to the type of incomplete work. In addition, the embodiment may be applied to the case in which the controller 180 detects incomplete completion of a specific task in addition to the editing task. For example, when the user inverts the mobile terminal 100 while the mobile terminal 100 is downloading or uploading data, the controller 180 detects a face down mode. When the controller 180 detects incomplete work due to a data download or upload failure while performing the data download or upload operation, the touch screen 151 may be controlled to emit light. The user can recognize that there is an incomplete work through the light of the touch screen 151. However, even when the user does not want to proceed with the subsequent work during the incomplete work, when the touch screen 151 continuously emits light, user inconvenience may be caused. In order to solve this problem, as shown in FIG. 27B, when a touch gesture is performed on a part of the area 2510 where the touch screen 151 emits light in response to an incomplete operation, the controller 180 performs an incomplete completion of the touch screen 151. Control to cancel job notifications. That is, the controller 180 may control the touch screen 151 not to emit light as shown in FIG. 27D when sound is sensed by the user's touch gesture through the second sensing unit or vibration is detected in the corresponding area. have. In addition to the user's touch gesture, even when the incomplete work is completed by the user as shown in FIG. 27C, the controller 180 may control the touch screen 151 not to emit light as shown in (d) of FIG.

28A is an exemplary diagram for describing a method of recognizing a color of a bottom surface by a mobile terminal according to an embodiment of the present invention.

FIG. 28A illustrates an example of a scene in which the user places the mobile terminal 100 on the bottom surface 2550. That is, the user may allow the top 503 to move to the bottom surface while holding the mobile terminal 100. In this case, the controller 180 may detect the movement of the upper end 503 of the mobile terminal 100 through the gyro sensor or the acceleration sensor. In addition, if the movement trajectory 2560 of the upper end 503 is equal to or greater than a preset speed or distance, the controller 180 may detect that the mobile terminal 100 is in the face down mode. Referring to FIG. 28A (b), the mobile terminal (! 00) is more constricted than (a) of FIG. 28A through the movement of the upper end 503. FIG. In this case, the controller 180 may detect that the mobile terminal 100 is in the face down mode. Accordingly, the controller 180 may detect the color 2553 of the bottom surface 2550 by using an optical sensor located in front of the mobile terminal 100. In this case, the optical sensor may include an RGB sensor and an illuminance sensor. For this embodiment, the mobile terminal 100 may be provided with a separate optical sensor on the front, it is also possible to use a camera 121 located on the front without having a separate optical sensor.

FIG. 28B is an exemplary diagram for describing a feature in which a display unit of a mobile terminal according to an embodiment of the present invention adjusts and outputs color, brightness, and the like emitted according to ambient light. Referring to FIGS. 28B and 28B, when the mobile terminal 100 is placed on the bottom surface of the specific colors 2601 and 2605, the controller 180 may bottom through the sensing unit 140. The color of the face can be detected. The sensing unit 140 may include an optical sensor, and the controller 180 may detect colors 2601 and 2605 of the bottom surface through the optical sensor. As the method of the controller 180 detecting the color of the bottom surface, the method described with reference to FIG. 28A may be used. In this case, when the controller 180 detects a preset event of the mobile terminal 100, the touch screen 151 emits light with colors 2603 and 2607 corresponding to the detected colors 2601 and 2605 of the bottom surface. Can be controlled. The controller 180 may control the touch screen 151 to emit light in the corresponding colors 2603 and 2607 so as to be contrasted with the colors 2601 and 2605 of the bottom surface. For example, the colors 2601 and 2605 of each bottom surface and the colors 2603 and 2607 emitted by the touch screen 151 may be complementary colors. For example, when the mobile terminal 100 is placed on a yellow floor, the controller 180 may control the touch screen 151 to emit light in indigo blue, which is a yellow complementary color, when a call is received from a VIP, which is a preset event. have.

Referring to FIGS. 28B (c) and 28D (d), in the face down mode of the mobile terminal 100, the controller 180 controls the brightness of the touch screen 151 according to the brightness 2609 and 2613 of ambient light. Can be controlled to emit light by differently. The controller 180 may detect the brightness of the ambient light through the sensing unit 140, in particular, an optical sensor. In this case, when the controller 180 detects a preset event, the touch screen 151 may control the touch screen 151 to emit light 2611 and 2615 in response to the detected brightness of the ambient light. When the ambient light is bright, when the controller 180 detects a preset event and controls the touch screen 151 to emit light, if the touch screen 151 emits light, it may be difficult for the user to confirm the occurrence of the event. On the contrary, when the ambient light is dark, when the control unit 180 detects a preset event and controls the touch screen 151 to emit light, if the touch screen 151 emits dark light, the controller 180 may not save power in terms of power saving. It is economical. Therefore, when the ambient light is bright (2609), the controller 180 may control the touch screen 151 to emit light 2611 brightly so that the user can confirm the occurrence of the preset event. The controller 180 may control the brightness of the touch screen 151 to be brighter than the brightness of the ambient light measured by the sensing unit 140.

In addition, the controller 180 may control the touch screen 151 to emit light 2615 lightly to the extent that the user can confirm the occurrence of a preset event when the ambient light is dark (2613). The controller 180 may control the brightness emitted by the touch screen 151 to be at least brighter than the brightness of the ambient light measured by the sensing unit 140.

For example, when the preset event is power charging of the mobile terminal 100, the controller 180 detects that the mobile terminal 100 is charging power, and controls a portion of the touch screen 151 to emit light. Can be. In this case, the controller 180 may control the sensing unit 140 to detect brightness, color, etc. of ambient light. The controller 180 may control the brightness of the light output by the touch screen 151 to be adjusted according to the brightness of the ambient light sensed by the sensing unit 140. In an environment where the ambient light is bright, the controller 180 may detect that the ambient light is bright through the sensing unit 180 and control the touch screen 151 to emit light as shown in (c) of FIG. 28B. That is, the controller 180 controls the brightness of the light output from the touch screen 151 to be brighter than the brightness of the ambient light, thereby allowing the user to confirm that the mobile terminal 1000 is being charged. When charging the power, the controller 180 detects that the brightness of the ambient light is dark through the sensing unit 140 and controls the touch screen 151 to emit light as shown in Fig. 28B (d). May be less disturbed from the light output from the touch screen 151. As described above, when the mobile terminal 100 is charging, the control unit 180 may charge while the touch screen 151 emits light. Upon detecting the completion, the touch screen 151 may be controlled to not emit light, and the user may confirm that the touch screen 151 does not emit light and know that the mobile terminal 100 is fully charged.

29 is an exemplary diagram for describing a process of outputting the notification by a display unit of a mobile terminal when an event is related to detecting a charging state of a mobile terminal according to one embodiment of the present invention.

Referring to FIG. 29A, when the remaining power of the mobile terminal 100 is detected to be lower than or equal to a predetermined level, the controller 180 displays a notification window 2700 indicating that charging is necessary through the touch screen 151. You can control the display. In addition, the controller 180 may control the emoticon 2705 of the empty battery to be displayed through the touch screen 151. When the mobile terminal 100 is in the face down mode, when the face down mode is maintained for a long time, it is difficult for the user to grasp the remaining power shortage of the mobile terminal 100. Therefore, when the user wants to operate the mobile terminal 100 by releasing the face down mode of the mobile terminal 100, the mobile terminal 100 may not be used due to lack of power. Referring to FIG. 29B, when the remaining power of the mobile terminal 100 is detected to be lower than or equal to a predetermined level, the controller 180 controls the touch screen 151 to indicate that the mobile terminal 100 needs to be charged. It may be controlled to emit light 2710. The controller 180 may control the touch screen 151 to emit light according to the level of the remaining power according to a user setting or a manufacturer's intention. For example, when the remaining power of the mobile terminal 100 is 30% or less or 10% or less, the controller 180 may control the touch screen 151 to emit light by changing the color and brightness emitted.

Referring to FIG. 29C, when the remaining power of the mobile terminal 100 is detected to be higher than or equal to a predetermined level, it is determined that the charging is completed and the controller 180 completes charging through the touch screen 151. The notification window 2720 notifying that the operation has been displayed may be controlled. In addition, the controller 180 may control to display the emoticon 2725 of the battery that is filled up through the touch screen 151. When the mobile terminal 100 is in the face down mode, it is difficult for the user to grasp the completion of the charging of the mobile terminal 100. Accordingly, the user may not know the completion of charging of the mobile terminal 100 and may continue to maintain the charging state of the mobile terminal 100 unnecessarily. Referring to FIG. 29D, when the remaining power of the mobile terminal 100 is detected to be higher than or equal to a predetermined level, the controller 180 may notify the touch screen 151 that the charging of the mobile terminal 100 is completed. It may be controlled to emit light 2730. The controller 180 may control the touch screen 151 to emit light according to the level of the remaining power according to a user setting or a manufacturer's intention. For example, when the remaining power of the mobile terminal 100 is 80% or more or 90% or more, the controller 180 may control the touch screen 151 to emit light by changing the color and brightness emitted. Meanwhile, in the descriptions of FIGS. 28B (c) and (d), the controller 180 may control the touch screen 151 not to emit light when detecting the state of completion of charging. 29 (d) illustrates an embodiment in which the control unit 180 controls the touch screen 151 to emit light when charging is completed when the charging is completed. Any one of the embodiments may be employed. Alternatively, the controller 180 controls the touch screen 151 to continue to emit light while charging, and when the touch screen 151 is being charged for a predetermined time to notify the completion of charging as shown in FIG. For example, the touch screen 151 may emit light with a different color or brightness than that shown in FIG. 28B (b). When the predetermined time elapses, the controller 180 may control the touch screen 151 not to emit light.

30 is an exemplary diagram for describing an operation of controlling an amount of light emitted from a display of a mobile terminal according to an embodiment of the present invention.

Referring to FIGS. 30A and 30B, in the face down mode, the user may simply shake the mobile terminal 100 left and right to release and set the face down mode. Referring to FIG. 30A, when the controller 180 detects a preset event when the mobile terminal 100 is in the face down mode, the touch screen 151 emits light. At this time, when the user shakes the mobile terminal 100 left and right to release the face down mode, the controller 180 detects the face down mode release, so that the touch screen 151 does not emit light as shown in FIG. Can be controlled. In addition, when the mobile terminal 100 is shaken from side to side as shown in FIG. 30A while the face down mode is released, the controller 180 may set the face down mode by detecting it as a reset command of the face down mode. .

Referring to FIGS. 30C and 30D, in the face down mode, the user may easily release and set the face down mode by adjusting the amount of ambient light of the mobile terminal 100. Referring to FIG. 30C, when the controller 180 detects a preset event when the mobile terminal 100 is in the face down mode, the touch screen 151 emits light. In this case, when the user performs a gesture of covering the surroundings of the mobile terminal 100 with the palm of the hand to release the face down mode, the controller 180 detects the release of the face down mode and the touch screen 151 as shown in FIG. ) Can be controlled so as not to emit light. The controller 180 may measure the brightness of the ambient light using the sensing unit 140, in particular, an optical sensor. When the user covers the surroundings of the mobile terminal 100 with the palm of the hand, the controller 180 may sense that the amount of ambient light has decreased. The controller 180 may control the face down mode of the mobile terminal 100 to be released when the amount of ambient light is detected to be less than or equal to a predetermined brightness level. In addition, when the mobile terminal 100 detects a decrease in the amount of ambient light as shown in FIG. 30C while the face down mode is released, the controller 180 detects this as a reset command of the face down mode, and the face down mode. You can also set When the sensing unit 140 includes a proximity sensor, the present embodiment may also be applied when the controller 180 detects a proximity input on the outer surface of the mobile terminal 100 through the proximity sensor.

In the above, a case in which the operations illustrated in FIGS. 30A and 30C are recognized as a release and setting command of the face down mode of the controller 180 has been described. However, according to another embodiment of the present invention, the controller 180 may recognize the operation as a command for adjusting at least one of the color and the brightness of the light emitted from the touch screen 151. For example, when a preset event occurs in the mobile terminal 100 and the touch screen 151 emits light with a specific color and brightness under the control of the controller 180, the controller 180 is the FIG. 30 (a). Alternatively, when the operation illustrated in FIG. 30C is detected, the touch screen 151 may control to emit light by adjusting at least one of the color and the brightness of the light emitted from the touch screen 151. That is, when the operation illustrated in FIG. 30A or 30C is detected while the touch screen 151 emits light, the controller 180 may recognize the brightness of light emitted from the touch screen 151. It may be darker than before motion detection, and may be darker depending on the duration of the motion.

In addition, the user may check a preset event when the touch screen 151 emits light. In this case, when the controller 180 detects the operation illustrated in FIG. 30 (a) or FIG. 30 (c), the touch screen is displayed. 151 may be controlled to stop light emission.

The user may desire that the touch screen 151 no longer emits light in relation to the event by causing the touch screen 151 to emit light according to a preset event occurrence. Nevertheless, when the touch screen 151 emits light for a long time or repeatedly emits light at predetermined time intervals, when the user performs the operation illustrated in FIG. 30 (a) or FIG. 30 (c), the controller 180 The touch screen 151 may be controlled to stop emitting light. For example, when the preset event is detected so that the controller 180 emits the touch screen 151 for 3 seconds, while the touch screen 151 emits the light for 1 second, the user is shown in FIG. ) Or in operation (c) of FIG. 30, the controller 180 may stop light emission of the touch screen 151 regardless of a preset time.

According to one embodiment of the present invention, the above-described method (operation flowchart) can be embodied as processor readable code on a medium in which a program is recorded. Examples of processor-readable media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and may be implemented in the form of a carrier wave (for example, transmission over the Internet). Include.

The mobile terminal 100 described above is not limited to the configuration and method of the embodiments described above, the embodiments are a combination of all or part of each embodiment selectively so that various modifications can be made It may be configured.

On the other hand, it has been described with respect to the preferred embodiments of the present invention through the specification and drawings, although specific terms are used, this is only used in a general sense to easily explain the technical details of the present invention and to help the understanding of the invention. It is not intended to limit the scope of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical spirit of the present invention can be carried out even in the embodiments disclosed herein.

100: mobile terminal
140: sensing unit
151: touch screen
180: control unit

Claims (17)

A first sensing unit for sensing a face down mode of the mobile terminal;
A second sensing unit for sensing a user specified direction around the mobile terminal;
A touch screen provided on the front of the mobile terminal;
At least one touch screen light emitting device provided on at least one side of the mobile terminal; And
And a controller configured to control a portion of the at least one touch screen device corresponding to the detected user specified direction to emit light in response to at least one preset event generated in the face down mode. and,
The at least one event comprises a missed call occurrence event from a particular contact;
The control unit,
The mobile terminal expands a light emitting area of the at least one touch screen light emitting device in proportion to the number of missed calls from the specific contact during the face down mode,
Detect the color of the front surface of the mobile terminal,
And the mobile terminal controls the at least one touch screen light emitting device to emit other colors complementary to the color of the sensed surface in response to the at least one event during the face down mode. . The method of claim 1, wherein the control unit
And detecting a horizontal state of the mobile terminal for a preset time through the first sensing unit, and controlling the mobile terminal to operate in the face down mode. The method of claim 1, wherein the control unit
Each time the direction is changed, the mobile terminal, characterized in that for controlling a portion of the touch screen corresponding to the changed direction to emit light. The mobile terminal of claim 1, wherein the second sensing unit senses the user-specified direction by recognizing a sound around the mobile terminal. delete The method of claim 4, wherein the control unit
And controlling at least one of a light emission color, a light emitting area, and a light emitting area of a portion of the at least one touch screen light emitting device according to at least one of a generated position, a generated distance, a duration, and a size of the recognized sound. Mobile terminal. The mobile terminal of claim 1, wherein the second sensing unit senses the user-specified direction by recognizing sound on the outer surface of the mobile terminal. The method of claim 7, wherein the control unit
And controlling at least one of a light emission color, a light emitting area, and a light emitting area of a portion of the at least one touch screen light emitting device to be adjusted according to at least one of the touch generation detection area and the duration of the sound. delete delete delete According to claim 1,
The event includes an event in which at least one task is incomplete,
And the control unit controls a portion of the at least one touch screen light emitting device to emit light in a preset manner according to the type of the task. According to claim 1,
The event includes an execution event of a program playing content;
And the control unit controls a portion of the at least one touch screen light emitting device to emit light by changing at least one of a light emission color, a light emitting area, and a light emitting area in response to a reproduction time of the content. The method of claim 1, wherein the control unit
When the second event setting event is detected while controlling the at least one touchscreen light emitting device to emit light with a specific color, brightness, light emitting area, and light emitting area according to a first preset event, the specific color, brightness, light emitting area, And at least one light emitting area to control the at least one touch screen light emitting device to emit light. According to claim 1,
The event includes an execution event of a recording program,
The control unit controls to emit light by changing at least one of a color brightness and a pattern emitted by a portion of the at least one touch screen light emitting device according to whether the recording program is in a recording progress state or a recording completion state. terminal. The method of claim 7, wherein
The event includes an alarm operation performance event of the mobile terminal by an alarm program,
When the sound is detected on the outer surface of the mobile terminal, the control unit detects the area where the sound is detected and the duration of time and controls the snooze function to be executed by varying the snooze time of the alarm program according to the area or time. And controlling a portion of the at least one touch screen light emitting device to emit light at different brightness levels or light emitting areas according to the snooze time. delete

Images