KR102127389B1 - Mobile terminal and controlling method thereof - Google Patents

Abstract

According to the present invention, when a touch screen for displaying information in a first area and a second area in a first direction and a user input for changing a display direction for information on the second area are received, information on the first area The display direction for the first direction may be maintained, but information on the second area may include a mobile terminal including a control unit for controlling to be displayed in a second direction different from the first direction.

Description

Mobile terminal and its control method {MOBILE TERMINAL AND CONTROLLING METHOD THEREOF}

The present invention relates to a mobile terminal capable of changing the direction of information displayed on a partial area of the display unit and a control method thereof.

Terminals can be divided into mobile terminals (mobile/portable terminals) and stationary terminals according to their mobility. Again, the mobile terminal may be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry it.

As the functions of the terminal are diversified, for example, in the form of a multimedia player equipped with multiple functions such as taking a picture or a video, playing a music or video file, receiving a game, or broadcasting, etc. Is being implemented.

In order to support and increase the function of such a terminal, it may be considered to improve the structural part and/or software part of the terminal.

In particular, as described above, in performing a complex function, the display unit of the terminal is designed to be enlarged for user convenience. Through the enlarged display unit, the terminal can provide a more effective multi-tasking environment to the user. More specifically, the terminal may simultaneously display a plurality of pieces of information being multi-tasked in each of different areas of the display unit.

However, even if a plurality of pieces of information are displayed simultaneously, the display direction of the information is fixed, which may cause inconvenience for a user to operate the terminal. Particularly, when a plurality of users perform operations using a single terminal, it is difficult for a plurality of users to independently perform operations in different directions.

The present invention is proposed to meet the above-mentioned needs, and an object thereof is to provide a mobile terminal and a control method for changing the direction of information displayed on a partial area of the display unit.

More specifically, according to the present invention, when each information displayed on the first and second areas of the display unit is displayed in the first direction, the display direction for the information on the first area is maintained in the first direction. , It is to provide a mobile terminal that can change the display direction for information on the second area in the second direction.

In addition, the present invention displays a list in some areas of the display area, displays content corresponding to the objects on the list in other areas, and content corresponding to other objects on the list while the content is displayed. Is to provide a mobile terminal capable of being sequentially displayed or changing the display direction.

The technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems that are not mentioned will be clearly understood by those having ordinary knowledge in the technical field to which the present invention belongs from the following description. Will be able to.

In order to achieve the above object, the present invention provides a touch screen for displaying information in a first direction through a first area and a second area and a user input for rotating information displayed through the second area. The information displayed through the first area maintains the first direction, but the information displayed through the second area provides a mobile terminal including a control unit that controls to be displayed in a second direction different from the first direction.

In addition, the present invention is a holding input through a pointer to any one of the at least one object on the first area, while a scroll input is received on the first area, the holding on the first area It provides a mobile terminal characterized in that it comprises a control unit for controlling the other objects to be scrolled in response to the scroll input, while the object selected by the input is fixed.

In addition, the present invention, in response to the scroll input, the mobile terminal characterized in that it comprises a control unit for controlling to display the content corresponding to the other object to be scrolled sequentially in the third area separated from the second area to provide.

The technical solutions that can be obtained in the present invention are not limited to the above-mentioned solutions, and other solutions that are not mentioned are clearly understood by those skilled in the art from the following description. Will be understandable.

The effects of the mobile terminal and its control method according to the present invention are as follows.

According to at least one of the embodiments of the present invention, when a plurality of users respectively perform a task using a single terminal, a plurality of users operate the terminal by displaying information in a direction in which the plurality of users are respectively located. Convenience can be maximized.

In addition, according to at least one of the embodiments of the present invention, a list is displayed in some areas of the display area of the mobile terminal, and content corresponding to the object on the list is displayed in other areas, and the content is displayed. In the state, since content corresponding to another object on the list is sequentially displayed or the display direction can be changed, the displayed contents can be compared at a glance, and there is an advantage that information can be easily recognized in the direction in which the other party is located.

The effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned may be clearly understood by those skilled in the art from the following description. will be.

1 is a block diagram illustrating a mobile terminal related to the present invention.
2 and 3 are conceptual views of an example of a mobile terminal related to the present invention viewed from different directions.
4 is an operation flowchart of a mobile terminal according to an embodiment of the present invention.
5 is an exemplary view for explaining a screen division of a display unit according to an embodiment of the present invention according to an embodiment of the present invention.
6 is an exemplary view for explaining a change in display direction of information according to an embodiment of the present invention.
7 is another exemplary view for explaining a display direction change of information according to an embodiment of the present invention.
8 is an exemplary view for explaining a relationship between information displayed in different areas according to an embodiment of the present invention.
9 is an exemplary view for explaining user input when there is additional screen division according to an embodiment of the present invention.
10 is another exemplary view for explaining user input when there is additional screen division according to an embodiment of the present invention.
11 is an exemplary view for explaining a sequential display of content according to scrolling of a list according to an embodiment of the present invention.
12 is an exemplary view for explaining the addition of fixed content when content is sequentially displayed according to scrolling of a list according to an embodiment of the present invention.
13 is an exemplary view for explaining a display direction change of a list or content according to an embodiment of the present invention.
14 is an exemplary view for explaining a search function for an object included in a list according to an embodiment of the present invention.
15 is an exemplary view for explaining a call function for display direction information according to an embodiment of the present invention.

Hereinafter, exemplary embodiments disclosed herein will be described in detail with reference to the accompanying drawings, but the same or similar elements are assigned the same reference numbers regardless of the reference numerals, and overlapping descriptions thereof will be omitted. The suffixes "modules" and "parts" for the components used in the following description are given or mixed only considering the ease of writing the specification, and do not have meanings or roles distinguished from each other in themselves. In addition, in describing the embodiments disclosed in this specification, detailed descriptions of related well-known technologies are omitted when it is determined that they may obscure the gist of the embodiments disclosed herein. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed herein, and the technical spirit disclosed in the specification is not limited by the accompanying drawings, and all modifications included in the spirit and technical scope of the present invention , It should be understood to include equivalents or substitutes.

Terms including ordinal numbers such as first and second may be used to describe various components, but the components are not limited by the terms. The terms are used only for the purpose of distinguishing one component from other components.

Singular expressions include plural expressions unless the context clearly indicates otherwise.

Mobile terminals described herein include mobile phones, smart phones, laptop computers, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), navigation, and slate PCs. , Tablet PC (tablet PC), ultrabook (ultrabook), wearable device (wearable device, for example, a watch-type terminal (smartwatch), glass-type terminal (smart glass), HMD (head mounted display), etc. may be included have.

However, the configuration according to the embodiment described in the present specification can be easily recognized by those skilled in the art that it may be applied to a fixed terminal such as a digital TV, a desktop computer, and a digital signage, except when applicable only to a mobile terminal. will be.

1 is a block diagram illustrating a mobile terminal related to the present invention, and FIGS. 2 and 3 are conceptual views of an example of a mobile terminal related to the present invention viewed from different directions.

The mobile terminal 100 includes a wireless communication unit 110, an input unit 120, a sensing unit 140, an output unit 150, an interface unit 160, a memory 170, a control unit 180, and a power supply unit 190 ) And the like. The components shown in FIG. 1 are not essential for implementing a mobile terminal, so the mobile terminal described herein may have more or fewer components than those listed above.

More specifically, among the above components, the wireless communication unit 110 may move between the mobile terminal 100 and the wireless communication system, between the mobile terminal 100 and another mobile terminal 100, or different from the mobile terminal 100. The terminal 100 or an external server may include one or more modules that enable wireless communication between networks.

The wireless communication unit 110 may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short-range communication module 114, and a location information module 115. .

The input unit 120 may include a camera 121 for inputting a video signal or a video input unit, a microphone for inputting an audio signal (microphone 122), or an audio input unit, a user input unit 123 for receiving information from a user, for example , A touch key, a mechanical key, and the like. The voice data or image data collected by the input unit 120 may be analyzed and processed by a user's control command.

The sensing unit 140 may include one or more sensors for sensing at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information. For example, the sensing unit 140 includes a proximity sensor 141, an illumination sensor 142, a touch sensor, an acceleration sensor, a magnetic sensor, and gravity G-sensor, gyroscope sensor, motion sensor, RGB sensor, infrared sensor (IR sensor), fingerprint scan sensor, ultrasonic sensor , Optical sensor (e.g., camera (see 121)), microphone (see 122, battery), battery gage, environmental sensor (e.g. barometer, hygrometer, thermometer, radioactivity sensor, heat Sensing sensors, gas sensing sensors, etc.), chemical sensors (eg, electronic nose, healthcare sensors, biometric sensors, etc.) On the other hand, the mobile terminal disclosed herein, such sensors, Among them, information sensed by at least two or more sensors may be used in combination.

The output unit 150 is for generating output related to vision, hearing, or tactile sense, and includes at least one of a display unit 151, an audio output unit 152, a hap tip module 153, and an optical output unit 154 can do. The display unit 151 may form a mutual layer structure with the touch sensor or may be integrally formed, thereby realizing a touch screen. The touch screen may function as a user input unit 123 that provides an input interface between the mobile terminal 100 and a user, and at the same time, provide an output interface between the mobile terminal 100 and the user.

The interface unit 160 serves as a passage with various types of external devices connected to the mobile terminal 100. The interface unit 160 connects a device equipped with a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, and an identification module. It may include at least one of a port, an audio input/output (I/O) port, a video input/output (I/O) port, and an earphone port. In the mobile terminal 100, in response to an external device being connected to the interface unit 160, appropriate control related to the connected external device may be performed.

The memory 170 may store a number of application programs or applications that are driven in the mobile terminal 100 and data and instructions for the operation of the mobile terminal 100. At least some of these applications can be downloaded from external servers via wireless communication. In addition, at least some other of these application programs may exist on the mobile terminal 100 from the time of shipment for basic functions of the mobile terminal 100 (for example, an incoming call, a calling function, a message reception, and a calling function). . Meanwhile, the application program may be stored in the memory 170 and installed on the mobile terminal 100 to be driven by the controller 180 to perform an operation (or function) of the mobile terminal.

The controller 180 controls the overall operation of the mobile terminal 100 in addition to the operations related to the application program. The controller 180 may provide or process appropriate information or functions to the user by processing signals, data, information, etc. input or output through the above-described components or by driving an application program stored in the memory 170.

In addition, the controller 180 may control at least some of the components discussed with reference to FIG. 1 in order to drive the application program stored in the memory 170. Furthermore, the controller 180 may operate by combining at least two or more of the components included in the mobile terminal 100 for driving the application program.

Under the control of the controller 180, the power supply unit 190 receives external power and internal power to supply power to each component included in the mobile terminal 100. The power supply unit 190 includes a battery, and the battery may be a built-in battery or a replaceable battery.

At least some of the components may operate in cooperation with each other to implement an operation, control, or control method of a mobile terminal according to various embodiments described below. Also, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 170.

Hereinafter, prior to examining various embodiments implemented through the mobile terminal 100 described above, the components listed above will be described in more detail with reference to FIG. 1.

First, referring to the wireless communication unit 110, the broadcast reception module 111 of the wireless communication unit 110 receives a broadcast signal and/or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or switching of broadcast channels for at least two broadcast channels.

The mobile communication module 112 includes technical standards or communication methods for mobile communication (eg, Global System for Mobile Communication (GSM), Code Division Multi Access (CDMA), Wideband CDMA (WCDMA), High Speed HSDPA) Downlink Packet Access (LTE, Long Term Evolution (LTE), etc.) transmits and receives wireless signals to and from at least one of a base station, an external terminal, and a server on a mobile communication network.

The radio signal may include various types of data according to transmission and reception of a voice call signal, a video call signal, or a text/multimedia message.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built in or external to the mobile terminal 100. The wireless Internet module 113 is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, WLAN (Wireless LAN), WiFi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink) Packet Access), LTE (Long Term Evolution), and the like, and the wireless Internet module 113 transmits and receives data according to at least one wireless Internet technology in a range including Internet technologies not listed above.

In view of the wireless Internet access by Wibro, HSDPA, GSM, CDMA, WCDMA, LTE, etc., through the mobile communication network, the wireless Internet module 113 performing wireless Internet access through the mobile communication network is the mobile communication module It may be understood as a kind of (112).

The short-range communication module 114 is for short-range communication, Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, NFC (Near Field Communication), by using at least one of Wi-Fi (Wireless-Fidelity), Wi-Fi Direct technology, it can support short-range communication. The short-range communication module 114 is between the mobile terminal 100 and the wireless communication system, between the mobile terminal 100 and another mobile terminal 100, or a mobile terminal through short-range wireless personal area networks. It is possible to support wireless communication between the (100) and the network where the other mobile terminal (100, or an external server) is located.

Here, the other mobile terminal 100 is a wearable device (for example, a smart watch), smart glasses capable of exchanging data (or interoperable) with the mobile terminal 100 according to the present invention. (smart glass), HMD (head mounted display). The short-range communication module 114 may detect (or recognize) a wearable device capable of communicating with the mobile terminal 100 around the mobile terminal 100. Furthermore, when the detected wearable device is a device authenticated to communicate with the mobile terminal 100 according to the present invention, the controller 180 may include at least a portion of data processed by the mobile terminal 100, and the short-range communication module ( 114) to the wearable device. Therefore, the user of the wearable device can use data processed by the mobile terminal 100 through the wearable device. For example, according to this, the user performs a phone call through the wearable device when a call is received by the mobile terminal 100, or when a message is received by the mobile terminal 100, the user receives the call through the wearable device. It is possible to check the message.

The location information module 115 is a module for acquiring a location (or current location) of a mobile terminal, and representative examples thereof include a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, if the mobile terminal utilizes a GPS module, the location of the mobile terminal can be obtained using a signal sent from a GPS satellite. As another example, if the mobile terminal utilizes a Wi-Fi module, the location of the mobile terminal may be obtained based on information of a Wi-Fi module and a wireless access point (AP) that transmits or receives a wireless signal.

Next, looking at the input unit 120 in more detail, the input unit 120 is for input of image information (or signals), audio information (or signals), or information input from a user, and inputs image information. To this end, the mobile terminal 100 may include one or a plurality of cameras 121. The camera 121 processes image frames such as still images or moving pictures obtained by an image sensor in a video call mode or a shooting mode. The processed image frame may be displayed on the display unit 151. Meanwhile, the plurality of cameras 121 provided in the mobile terminal 100 may be arranged to form a matrix structure, and through the camera 121 forming the matrix structure, various angles or focuses may be applied to the mobile terminal 100. A plurality of image information may be input. In addition, the plurality of cameras 121 may be arranged in a stereo structure to acquire left and right images for realizing a stereoscopic image.

The microphone 122 processes external sound signals as electrical voice data. The processed voice data may be used in various ways according to a function (or a running application program) being performed by the mobile terminal 100. Meanwhile, various noise cancellation algorithms for removing noise generated in the process of receiving an external sound signal may be implemented in the microphone 122.

The user input unit 123 is for receiving information from a user. When information is input through the user input unit 123, the controller 180 may control the operation of the mobile terminal 100 to correspond to the input information. . The user input unit 123 is a mechanical input means (or a mechanical key, for example, a button located on the front, rear or side of the mobile terminal 100, a dome switch, a jog wheel, And a jog switch) and a touch-type input means. As an example, the touch-type input means is made of a virtual key, a soft key or a visual key displayed on the touch screen through software processing, or a part other than the touch screen It may be made of a touch key (touch key) disposed on. Meanwhile, the virtual key or the visual key may be displayed on the touch screen while having various forms, for example, a graphic, text, icon, video, or the like. It can be made of a combination of.

Meanwhile, the sensing unit 140 senses at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information, and generates a sensing signal corresponding thereto. The controller 180 may control driving or operation of the mobile terminal 100 based on the sensing signal, or perform data processing, function, or operation related to an application program installed in the mobile terminal 100. The representative sensors among various sensors that may be included in the sensing unit 140 will be described in more detail.

First, the proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object in the vicinity using mechanical force or infrared light without mechanical contact. The proximity sensor 141 may be provided with the proximity sensor 141 in the inner region of the mobile terminal or the touch screen, which is covered by the touch screen described above. The proximity sensor 141 has a longer lifespan and a higher utilization than the contact sensor.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, and an infrared proximity sensor. When the touch screen is capacitive, the proximity sensor 141 may be configured to detect the proximity of the object with a change in electric field according to the proximity of the conductive object. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of description, the act of allowing the object to be recognized as being located on the touch screen without being touched on the touch screen is called a "proximity touch", and the touch The act of actually touching an object on the screen is called "contact touch". The location where an object is touched close on the touch screen refers to a location where the object is perpendicular to the touch screen when the object is touched close. The proximity sensor 141 may detect a proximity touch and a proximity touch pattern (eg, proximity touch distance, proximity touch direction, proximity touch speed, proximity touch time, proximity touch position, proximity touch movement state, etc.). have. Meanwhile, as described above, the controller 180 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern detected through the proximity sensor 141, and further, visual information corresponding to the processed data. It can be output on the touch screen. Furthermore, the controller 180 may control the mobile terminal 100 such that different operations or data (or information) are processed according to whether a touch on the same point on the touch screen is a proximity touch or a touch touch. .

The touch sensor detects a touch (or touch input) applied to the touch screen (or display unit 151) using at least one of various touch methods such as a resistive film method, a capacitive method, an infrared method, an ultrasonic method, and a magnetic field method. do.

As an example, the touch sensor may be configured to convert a change in pressure applied to a specific part of the touch screen or capacitance generated in the specific part into an electrical input signal. The touch sensor may be configured to detect a location, an area, a pressure when a touch is touched on a touch sensor, and a touch object applying a touch on the touch screen. Here, the touch object is an object that applies a touch to the touch sensor, and may be, for example, a finger, a touch pen or a stylus pen, a pointer, and the like.

As such, when there is a touch input to the touch sensor, the signal(s) corresponding thereto is sent to the touch controller. The touch controller processes the signal(s) and then transmits corresponding data to the controller 180. Accordingly, the control unit 180 can know which area of the display unit 151 has been touched, and the like. Here, the touch controller may be a separate component from the controller 180, or may be the controller 180 itself.

Meanwhile, the controller 180 may perform different controls or perform the same control according to the type of the touch object that touches the touch screen (or a touch key provided in addition to the touch screen). Whether to perform different control or the same control according to the type of the touch object, it may be determined according to the current operating state of the mobile terminal 100 or the running application program.

On the other hand, the touch sensors and proximity sensors described above can be independently or in combination, such as short (or tap) touch on the touch screen, long touch, multi touch, drag touch ), flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, etc. Touch can be sensed.

The ultrasonic sensor may recognize location information of a sensing target using ultrasonic waves. Meanwhile, the control unit 180 may calculate the position of the wave generating source through information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave generator can be calculated by using a property in which light is much faster than ultrasonic waves, that is, a time when light reaches the optical sensor is much faster than a time when ultrasonic waves reach the ultrasonic sensor. More specifically, the position of the wave generating source may be calculated by using a time difference from the time at which ultrasonic waves reach the light as a reference signal.

On the other hand, the camera 121, which is considered as the configuration of the input unit 120, is a type of camera sensor, and the camera sensor includes at least one of a camera 121, a photo sensor, and a laser sensor.

The camera 121 and the laser sensor may be combined with each other to detect a touch of a sensing target for a 3D stereoscopic image. The photo sensor may be stacked on a display element, which is configured to scan the movement of the sensing object close to the touch screen. More specifically, the photo sensor mounts photo diodes and TRs (transistors) in rows/columns to scan the contents loaded on the photo sensor using electrical signals that change according to the amount of light applied to the photo diode. That is, the photo sensor performs coordinate calculation of the sensing target according to the amount of change of light, and through this, location information of the sensing target may be obtained.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, the display unit 151 may display execution screen information of an application program driven by the mobile terminal 100, or user interface (UI) or graphical user interface (GUI) information according to the execution screen information. .

In addition, the display unit 151 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

A three-dimensional display method such as a stereoscopic method (glasses method), an auto stereoscopic method (glasses-free method), or a projection method (holographic method) may be applied to the stereoscopic display unit.

The audio output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception, call mode or recording mode, voice recognition mode, broadcast reception mode, or the like. The sound output unit 152 may also output sound signals related to functions (for example, call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. The sound output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 153 generates various tactile effects that the user can feel. A typical example of the tactile effect generated by the haptic module 153 may be vibration. The intensity and pattern of vibration generated in the haptic module 153 may be controlled by a user's selection or setting of a control unit. For example, the haptic module 153 may synthesize different vibrations and output them sequentially or sequentially.

In addition to vibration, the haptic module 153 is suitable for stimulation of pin arrangements that vertically move to the contact skin surface, spray or suction power of air through a spray or intake, grazing on the skin surface, contact of an electrode, and electrostatic force. Various tactile effects can be generated, such as an effect caused by an effect and an effect of reproducing a feeling of cold and warm using an element capable of absorbing heat or generating heat.

The haptic module 153 may not only deliver a tactile effect through direct contact, but may also be implemented so that the user can feel the tactile effect through muscle sensations such as fingers or arms. Two or more haptic modules 153 may be provided according to a configuration aspect of the mobile terminal 100.

The light output unit 154 outputs a signal for notifying the occurrence of an event using the light of the light source of the mobile terminal 100. Examples of events occurring in the mobile terminal 100 may include receiving messages, receiving call signals, missed calls, alarms, schedule notifications, receiving emails, and receiving information through applications.

The signal output by the light output unit 154 is implemented as the mobile terminal emits light of a single color or a plurality of colors to the front or rear. The signal output may be terminated by the mobile terminal detecting the user's event confirmation.

The interface unit 160 serves as a passage with all external devices connected to the mobile terminal 100. The interface unit 160 receives data from an external device, receives power, transfers it to each component inside the mobile terminal 100, or allows data inside the mobile terminal 100 to be transmitted to the external device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connecting a device equipped with an identification module (port), an audio input/output (I/O) port, a video input/output (I/O) port, an earphone port, and the like may be included in the interface unit 160.

On the other hand, the identification module is a chip that stores various information for authenticating the usage rights of the mobile terminal 100, a user identification module (UIM), a subscriber identity module (SIM), universal user authentication It may include a module (universal subscriber identity module; USIM). The device equipped with the identification module (hereinafter referred to as'identification device') may be manufactured in a smart card format. Accordingly, the identification device may be connected to the terminal 100 through the interface unit 160.

In addition, when the mobile terminal 100 is connected to an external cradle, the interface unit 160 becomes a passage through which power from the cradle is supplied to the mobile terminal 100 or is input from the cradle by a user. Various command signals may be passages to the mobile terminal 100. Various command signals or power inputted from the cradle may be operated as signals for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The memory 170 may store a program for the operation of the controller 180 and temporarily store input/output data (eg, a phone book, a message, a still image, a video, etc.). The memory 170 may store data related to various patterns of vibration and sound output when a touch is input on the touch screen.

The memory 170 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory, etc.), RAM. (random access memory; RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic It may include a storage medium of at least one type of a disc and an optical disc. The mobile terminal 100 may be operated in connection with a web storage that performs a storage function of the memory 170 on the Internet.

Meanwhile, as described above, the controller 180 controls the operation related to the application program and the overall operation of the mobile terminal 100 in general. For example, when the state of the mobile terminal satisfies a set condition, the controller 180 may execute or release a lock state that restricts input of a user's control command to applications.

In addition, the controller 180 performs control and processing related to voice calls, data communication, video calls, etc., or performs pattern recognition processing capable of recognizing handwriting input or drawing input on the touch screen as text and images, respectively. Can. Furthermore, in order to implement various embodiments described below on the mobile terminal 100 according to the present invention, the controller 180 may control any one or a combination of the above-described components.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power required for the operation of each component. The power supply unit 190 includes a battery, and the battery may be a built-in battery made to be rechargeable, and may be detachably coupled to a terminal body for charging and the like.

In addition, the power supply unit 190 may include a connection port, and the connection port may be configured as an example of an interface 160 to which an external charger that supplies power for charging the battery is electrically connected.

As another example, the power supply unit 190 may be configured to charge the battery wirelessly without using the connection port. In this case, the power supply unit 190 uses one or more of an inductive coupling method based on a magnetic induction phenomenon from an external wireless power transmission device or a magnetic resonance coupling method based on an electromagnetic resonance phenomenon. Power can be delivered.

Meanwhile, various embodiments below may be implemented in a recording medium readable by a computer or a similar device using, for example, software, hardware, or a combination thereof.

2 and 3, the disclosed mobile terminal 100 has a bar-shaped terminal body. However, the present invention is not limited to this, and may be applied to various structures such as a watch type, a clip type, a glass type, or a folder type, a flip type, a slide type, a swing type, a swivel type to which two or more bodies are movably coupled. .

In the present specification, the information is stored in at least one of the memory 160 and the controller 180 of the mobile terminal 100, or various texts, images, videos, voice data received through the wireless communication unit 110, and multimedia combining them. It may be at least one of data. In addition, even when a plurality of the same type of information is included in one file format, it can be viewed as information of the present invention. Further, even when a plurality of different types of the above information are included in one file format, it can be viewed as information of the present invention. That is, a document including one piece of information or information of the same kind or different kinds may also correspond to the information of the present invention.

In addition, the information of the present invention may also include execution screens and interfaces of various apps or programs displayed on the display unit 150 according to execution of software necessary to operate various functions of the mobile terminal 100.

In addition, the information of the present invention includes a web document including an object to which a URL address is linked, and all objects displayed on the touch screen 151 may be referred to as information of the present invention. The information may be a list including at least one object, and content corresponding to at least one object on the list may also be included in the information of the present invention.

The controller 180 may control the content to be output through the output unit 150, and in particular, may be displayed through the touch screen 151 or may be played through the sound output module 152.

In the present specification, the user input refers to input for the various information displayed on the touch screen, and may be input through the user input unit 130. The user input may be a pointer input input to the touch screen 151 when the user input unit 130 is operated by the touch screen 151. In addition, when the mobile terminal 100 is provided with a physical key, it may also be input through this.

In particular, the pointer input refers to an input operation for a user to operate the mobile terminal 100 through the touch screen 151. The controller 180 may recognize the pointer input input through the touch screen 151 as an operation command of the mobile terminal 100. Types of the pointer input include a tap operation for a specific point of the touch screen 151, a flick operation, and a drag operation for drawing a specific trajectory. In addition, the pointer input may include a proximity pointer input when the mobile terminal 100 has a proximity sensor 141 as described above.

Hereinafter, embodiments related to a control method that can be implemented in the mobile terminal configured as described above will be described with reference to the accompanying drawings.

4 is an operation flowchart of a mobile terminal according to an embodiment of the present invention.

In addition, FIG. 5 is an exemplary view for explaining a screen division of a display unit according to an embodiment of the present invention, and FIG. 6 is an exemplary view for explaining a display direction change of information according to an embodiment of the present invention. In particular, in FIG. 5 and FIG. 6, the case where the information is an execution screen of a specific app is illustrated as an example.

4 and 5, the controller 180 may divide the display area of the touch screen 151. For example, the controller 180 may control the screen division mode as shown in FIG. 5A to be displayed according to the user input. When a user input is detected on the object 511 for entering a specific menu in the screen division mode, the controller 180 displays the specific menu tab 520 as shown in FIG. 5(b). The display area of the touch screen 151 may be controlled to be divided. The specific menu tab may include an app icon frequently used by the user, and the controller 180 may control the icon of the selected app to be included in the menu tab according to user settings.

Referring to FIG. 4, the controller 180 can control information to be displayed in the first direction on the separated first area and the second area on the touch screen 151 (401). The first area refers to a part of the display area on the touch screen 151, and the second area refers to a different area from the first area. In particular, the first area and the second area refer to areas that display information among the display areas on the touch screen 151. The display area may include another area in addition to the first area and the second area.

5(b) and 5(c), the controller 180 may control the specific app to be executed in the dragged and dropped area 523. Specifically, when a drag input 525 for a specific app icon is detected from a user, the controller 180 causes the execution screen 533 of the app to be displayed in the first area 523 where the specific app is dragged and dropped. Can be controlled. In addition, when a drag input 527 for a specific app is detected from another user to another area as shown in FIG. 5C, the controller 180 drags the specific app as shown in FIG. 5D. It is possible to control the execution screen 535 of the app to be displayed in the dropped second area 521.

4 and 6, when a user input 600 for changing a display direction for information 535 on the second area is received (403), the control unit 180 displays information on the first area. The display direction for the first direction may be maintained, but information on the second area may be controlled to be displayed in a second direction different from the first direction (405).

In (a) of FIG. 6, a user's touch gesture input is illustrated as an example of the user input, and particularly, a drag input having a rotation trajectory is illustrated. However, the user input is not limited to a touch gesture, and input through a pointer, flick input with directionality, and tap input for a specific direction may also be used.

Furthermore, an input for a specific object displayed to receive a rotation command for the information on the touch screen 151 may also be included in the user input. Also, physical key manipulation may be included in the user input.

In particular, while receiving a user input for changing the display direction of the information on the second area in FIG. 6A, the controller 180 displays the display direction of the information 533 displayed in the first area. It can be controlled to remain in one direction. Here, the first direction means a direction in which the information is displayed when the information is first displayed in the first area as shown in FIG. 5C.

In addition, as illustrated in FIG. 6A, the controller 180 may control a scene in which information is rotated from a first direction to a second direction according to a user input on the second area.

Referring to (b) of FIG. 6, the controller 180 may control the information 540 rotated according to the user input 600 to be displayed in the second area.

The second direction means a direction in which the display direction of information displayed in the first direction in the second area is changed, and refers to a direction different from the first direction.

The controller 180 may determine the second direction according to the degree of rotation of the user input 600. That is, when a plurality of users manipulate information displayed on the first area and the second area, the controller 180 may control information to be displayed in various directions according to a user input.

7 is another exemplary view for explaining a change in display direction of information according to an embodiment of the present invention. Referring to (a) of FIG. 7, when the user uses the mobile terminal 100 horizontally, the control unit 180 displays information 710 and 720 in the first area 711 and the second area 721. Each can be controlled to be displayed.

At this time, when the user input 725 is input from the user, the controller 180 controls the information 730 whose display direction is changed to be displayed on the second area 721 as shown in FIG. 7B. can do.

8 is an exemplary diagram for describing a relationship between information displayed in different areas according to an embodiment of the present invention.

Referring to (a) of FIG. 8, the controller 180 may control information 810 to be displayed in the first area 811 and information 820 to be displayed in the second area 821. In FIG. 8(a), in particular, the case where the information on the first area 811 is a list including at least one object is illustrated as an example. The control unit 180, while the holding input through the pointer to any one of the at least one object 813 is maintained, the content corresponding to the any one object 813 in the second area 821 The 820 may be controlled to be displayed.

Here, the holding input through the pointer refers to an input that selects at least one of the objects on the first area 811 and simultaneously displays information related to the object on the second area. The holding input may be applied to the mobile terminal 100 in various ways according to a user's or manufacturer's setting. It was shown as.

In addition, the relationship between any one object and content can be described by a wide variety of examples. For example, when any one object is for selecting a specific channel, the content may be a broadcast screen provided by the specific channel. Also, when any one object is an incoming mail, the content may correspond to the content of the incoming mail. The objects and contents of the present invention are not limited to the above examples. That is, when an input to a specific object is sensed through a conventional pointer, unlike the object being executed and displayed on the entire screen of the touch screen 151, the controller 180 displays a list including the object in the first area In the second area, content corresponding to an object may be displayed.

Referring to (b) of FIG. 8, when a user input is detected in the manner described above with reference to FIGS. 6 and 7, the controller 180 displays content 830 with a changed display direction on the second area 821. Can be controlled. At this time, the display direction of the information 810 on the first area 811 is maintained as shown in FIG. 8B.

9 and 10 are exemplary views for explaining user input when there is additional screen division according to an embodiment of the present invention.

In (a) of FIG. 9, the controller 180 may control to generate another area 931 in addition to the first area 911 and the second area 921 according to a user input. That is, the controller 180 may control information to be displayed on the first area 911 and the second area 921 as well as the third area 931 through the touch screen 151. The third region means a region different from the first region and the second region. In particular, the controller 180 may generate the third region by dividing the second region. However, the controller 180 does not necessarily divide the third area from the second area, and does not generate the third area after the second area is generated. That is, the order of domain names and the order of domain creation is irrelevant.

When a holding input is detected in the information 910 on the first area 911 through the pointer, the controller 180 includes information 920 related to the information 910 on the first area in the second area 921. It can be controlled to be displayed. In addition, when the holding input is detected in the information 920 displayed on the second area 921 while the holding input on the first area 911 is maintained, the control unit 180 controls the third area ( 931), the information 920 on the second area 921 may be controlled to be displayed on the third area 931.

At this time, as the controller 180 detects the user input 935 in the third area 931, the information 940 on the third area 931 is shown in FIG. 9(a) as shown in FIG. 9(b). It can be controlled to be displayed in a direction different from the displayed direction.

Referring to (a) of FIG. 10, the control unit 180 detects holding inputs 926 and 927 through a pointer to the first area 911 and the third area 931, and the second area 921. When the user input 937 is detected, it is possible to control the display direction of the information 920 to be changed. As illustrated in (b) of FIG. 10, the controller 180 may control the information 1020 to be displayed in a different direction from the information 910 and 930.

11 is an exemplary view for describing sequential display of content according to scrolling of a list according to an embodiment of the present invention, and FIG. 12 is when content is sequentially displayed according to scrolling of a list according to an embodiment of the present invention, It is an exemplary diagram for explaining the addition of fixed content.

Referring to (a) of FIG. 11, the controller 180 may control the list 1110 to be displayed in the first area 1111, at which time, the holding input through the pointer from the user is included in the list. When it is sensed by one object 1115, the controller may control the content 1120 to be displayed in the second area 1121.

Referring to (b) of FIG. 11, when the scroll input 1125 for the list 1110 is received, the controller 180 maintains the display of the content 1120 in the second area 1121. In addition, the list 1110 may be controlled to be scrolled. In particular, the controller 180 may include a third area in which content 1130 corresponding to the scrolled list 1110 is separated from the second area 1121 ( In operation 1131, the display 1140 may be controlled to be sequentially displayed. The controller 180 may control the third area 1131 to be divided in the second area 1121 as it detects that other objects on the list 1110 are scrolled in the first area 1111. The controller 180 may control that any one object 1115 holding the input is not scrolled even though other objects on the list 1110 are scrolled. That is, the controller 180 may control the one object 1115 to be fixed at a position where the holding input continues even when a scroll input is detected.

Here, the scroll input is an input for scrolling information displayed on the touch screen 151, and may include a drag input for information through a user's pointer. In addition, a touch input performed on an object for performing a scroll function as displayed on the touch screen 151 may also be included in the scroll input. Also, a physical key input may be included in the scroll input.

As illustrated in FIG. 11B, the controller 180 can control information to be sequentially displayed in the same direction 1140 as the direction of the scroll input 1125. The controller 180 may control the content 1120 corresponding to the scrolled other object to be sequentially displayed in response to the scroll input 1125 for other objects on the list 1110.

Referring to (a) of FIG. 12, the controller 180 detects the scroll input 1125 while the holding input is maintained in the one object 1115, and the second region 1121 has the one The content 1120 corresponding to the object 1115 may be controlled to be displayed, and the content corresponding to other objects on the scrolled list 1120 may be sequentially displayed in the third area 1131.

Referring to (b) of FIG. 12, when the holding input for one of the objects 1115 is maintained, the controller 180 additionally detects a holding input for the object 1116, and the controller 180 May control the fourth area 1151 to be divided in the second area 1120. In addition, the controller 180 may control the content 1150 corresponding to the holding input object 1116 to be displayed in the fourth area 1151. That is, the controller 180 displays the content 1120 in the second area, the content 1150 is displayed in the fourth area, and the content 1130 sequentially in the direction 1140 in the third area 1131. It can be controlled to be displayed.

13 is an example for explaining a display direction change of a list or content according to an embodiment of the present invention.

Referring to (a) of FIG. 13, the controller 180 displays a list 1110 in a first area 1111, content 1120 in a second area 1121, and a third area 1131. ) Can be controlled to display the information 1130. 13A, after the third area is generated in the second area as shown in FIG. 11B, the user's holding input and scroll input may be released.

At this time, when the user input 1310 is detected in the information 1130 on the third area 1131, the controller 180 may control the display direction of the information 1130 to be changed.

Referring to (b) of FIG. 13, the controller 180 may control the information 1320 whose direction has been changed to be displayed on the third area 1131. Since the display direction change method is the same as the method described above in the description of FIG. 6, it will be omitted here. When the scroll input 1125 is detected by the user, the controller 180 may control the information 1320 to be sequentially displayed in the third area. In particular, the controller 180 may control the information 1320 to be sequentially displayed in the direction 1330. That is, in this case, the display direction of the scroll input 1125 and the information 1320 are sequentially different from each other.

14 is an exemplary diagram for explaining a search function for an object included in a list according to an embodiment of the present invention.

Referring to (a) of FIG. 14, when the search command 1403 according to a preset condition is received with respect to the list 1110 displayed in the first area 1111, the controller 180 is included in the list 1110 Among the at least one object, an identification mark may be displayed on an object that satisfies the preset condition. In particular, the controller 180 may receive the search command from the user while the holding input through the pointer is maintained on any one object 1401 among at least one object included in the list 1110. The controller 180 may control the content corresponding to the one object 1401 to be displayed in the second area according to the holding input.

Here, the search command refers to a command to search for another object related to the one object to which a holding input is input in the list 1110. As an input method of the search command, a two-point touch input 1403 is illustrated as an example in FIG. 14A. In this case, the controller 180 detects one pointer input for any one object as a holding input, and when two pointer inputs are simultaneously input to any one of the objects, recognizes it as a search command simultaneously with the holding input can do. The input method of the search command is only an example, and a search command input method of various types may be applied to the mobile terminal 100.

When the search command is detected, the controller 180 may control the identification marks 1410 and 1420 to be displayed on the object related to the one object 1401.

The preset condition may be variously changed according to the type of object included in the list 1110. For example, when any one object is a thumbnail for an image, another object related to the one object may be determined by various factors such as the date, time, and the person included in the image. That is, when a user sets a person included in an image in advance as a search condition, the controller 180 identifies the person in the image indicated by any one object 1401 and another object indicating an image containing the same person. The displays 1410 and 1420 may be controlled to be displayed. According to the user setting, the controller 180 may perform a search according to a plurality of preset conditions. When a search is performed according to a plurality of conditions, the controller 180 may stir the searched objects to display different identification marks for each condition. Also, the controller 180 may control to display a plurality of identification marks for objects corresponding to a plurality of conditions.

Referring to (b) of FIG. 14, the controller 180 detects a search command 1403, as in 14(a), and then points the pointer to any one of the at least one object 1401. While the holding input through is maintained, when the scroll input 1125 for the list is received, the list 1110 may be controlled to scroll. In particular, the controller 180 maintains the display of the content in the second area 1121, and the content corresponding to the objects 1410 and 1420 on which the identification mark is displayed is separated from the second area 1121. It can be controlled to be displayed sequentially in the third area (1131). That is, unlike in (a) of FIG. 12, the controller 180 displays all content corresponding to other objects on the scrolled list 1110, referring to FIG. 14(b), the controller 180 is a list Among the other objects scrolled on 1110, the identification marks 1410 and 1402 may be controlled to sequentially display only content for the displayed object. In FIG. 14(b), whether the search command input should be maintained as in the holding input may be determined according to a user's or manufacturer's setting.

15 is an exemplary view for explaining a calling function for display direction information according to an embodiment of the present invention.

The controller 180 may control a display direction for information on a plurality of areas frequently used by a user to be stored in the memory 160. The plurality of regions may include a first region and a second region. When a call command for the stored direction information is received, the controller 180 can control the information on the plurality of areas to be displayed according to the stored display direction information.

Here, the call command may be an input for selecting a pre-stored split screen in the split screen mode. The controller 180 may control to store information displayed according to the direction when the direction information is stored. That is, when a user selects a specific pre-stored divided screen, the controller 180 can display information stored in each of a plurality of areas in a stored direction. Also, the direction information may include the number of divided regions, the size of each region, the type of information displayed in each region, and setting information regarding the display direction of the information.

15(a) and 15(b), the controller 180 can control each of App A to App D 1501, 1502, 1503, and 1504 to be displayed according to pre-stored direction information. have. Referring to (a) of FIG. 15, the controller 180 may display different display directions of each of App A, App B, App C, and App D according to the previously stored direction information. In addition, referring to (b) of FIG. 15, the controller 180 may control the display directions of the app A and the app B to be differently displayed according to the previously stored direction information.

It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit and essential features of the present invention.

The above-described present invention can be embodied as computer readable codes on a medium on which a program is recorded. The computer-readable medium includes all types of recording devices in which data that can be read by a computer system are stored. Examples of computer-readable media include ROM, RAM, CD-ROM, magnetic tapes, floppy disks, optical data storage devices, etc., which are also implemented in the form of carrier waves (eg, transmission over the Internet). It also includes. In addition, the computer may include a control unit 180 of the terminal.

Accordingly, the above detailed description should not be construed as limiting in all respects, but should be considered illustrative. The scope of the invention should be determined by rational interpretation of the appended claims, and all changes within the equivalent scope of the invention are included in the scope of the invention.

100: mobile terminal
130: user input
150: output unit
160: memory
180: control unit

Claims (10)

A touch screen for displaying information in the first direction on the first area and the second area; And
When a user input for changing the display direction of the information on the second area is received, while the display direction of the information on the first area is maintained in the first direction, the information on the second area is the first It includes a control unit for controlling to be displayed in a second direction different from the direction,
The information on the first area includes a list including at least one object,
The information on the second area includes content corresponding to the at least one object,
The control unit,
When a search command according to a preset condition is received for the list while a holding input through a pointer is maintained on any one of the at least one object, an object selected by the holding input among the at least one object Control related objects to be identified,
When a scroll input to the list is received while a holding input through a pointer is maintained on any one of the at least one object, the list is scrolled while the display of the content is maintained in the second area. Control,
And controlling the content corresponding to the identified and displayed object to be sequentially displayed in a third area separated from the second area. According to claim 1,
The user input includes a rotation input of a pointer made to the second area,
The control unit determines the second direction according to the degree of rotation of the pointer. delete delete The method of claim 1, wherein the control unit,
When a scroll input is received on the first area while a holding input through a pointer is maintained on any one of the at least one object on the first area, selected by the holding input on the first area While the object is fixed, other objects are controlled to be scrolled in response to the scroll input,
And in response to the scroll input, controlling a content to be displayed sequentially corresponding to another scrolled object in a third area separated from the second area. delete delete delete According to claim 1,
Further comprising a memory for storing direction information on which information is displayed on a plurality of areas including the first area and the second area,
The control unit,
When receiving a call command for the stored direction information, the mobile terminal characterized in that the control to display information on the plurality of areas according to the stored direction information. delete

Images