KR101507813B1 - Mobile terminal having touch sensor and Operation method thereof - Google Patents

Abstract

And a method of operating the portable terminal. The present invention provides a touch screen display device including a touch sensor disposed on a predetermined area of a user input unit, a pointer displayed on a display unit, a pointer corresponding to a touch signal when only a touch signal is inputted through the touch sensor, And displaying an operation menu corresponding to an area where the pointer is displayed when a touch signal and a key input signal are inputted through a predetermined area. According to the present invention, the user input unit and the touch sensor can be conveniently used.

Touch sensor, key input, keypad

Description

Technical Field [0001] The present invention relates to a mobile terminal having a touch sensor and a method of operating the same,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a mobile terminal having a touch sensor and a method of operating the same, and more particularly, to a mobile terminal having a touch sensor at a user input unit.

A portable terminal is a portable device having at least one function that can carry out voice and video communication, a function to input and output information, and a function to store data while being portable.

In order to realize a complicated function, a mobile terminal implemented in the form of a multimedia device is being applied variously in terms of hardware and software.

Generally, a user input unit uses a key pad or a dome switch system to input a key input signal. Therefore, in order to input a touch signal, a touch pad must be separately provided. In the case of using the touch screen of the display unit instead of the touch pad, the size or form of the user input unit is limited due to the limitation of the physical size of the display unit.

Accordingly, it is required to implement a user input unit with a keypad to enable various user inputs, and to sense a touch signal without a separate touch pad.

It is an object of the present invention to provide a touch sensor which can detect a touch signal without a separate touch pad by disposing a touch sensor in a predetermined area of a user input unit, And a method of operating the portable terminal.

According to another aspect of the present invention, there is provided a method of operating a portable terminal, the method comprising the steps of: providing a touch sensor disposed over a predetermined area of a user input unit; displaying a pointer on a display unit; When a touch signal and a key input signal are input through the predetermined area, the operation menu corresponding to the area in which the pointer is displayed .

According to another aspect of the present invention, there is provided a portable terminal including a touch sensor disposed in a predetermined area of a user input unit, a display unit displaying a pointer, A controller for moving and displaying the pointer corresponding to the touch signal and displaying an operation menu corresponding to an area in which the pointer is displayed when the touch signal and the key input signal are input through the predetermined area, .

According to the present invention, the user input unit and the touch sensor can be conveniently used without physical extension of the size of the portable terminal.

The portable terminal described in this specification includes a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), and navigation.

FIG. 1 is a block diagram of a portable terminal according to an exemplary embodiment of the present invention. Referring to FIG. Referring to FIG. 1, a mobile terminal according to an exemplary embodiment of the present invention will be described in terms of its functional components.

1, the portable terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, A memory 160, an interface unit 170, a control unit 180, and a power supply unit 190. When such components are implemented in practical applications, two or more components may be combined into one component, or one component may be divided into two or more components as necessary.

The wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 113, a wireless Internet module 115, a short distance communication module 117, and a GPS module 119.

The broadcast receiving module 111 receives at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel. At this time, the broadcast channel may include a satellite channel, a terrestrial channel, and the like. The broadcast management server may refer to a server for generating and transmitting at least one of a broadcast signal and broadcast related information and a server for receiving at least one of the generated broadcast signal and broadcast related information and transmitting the broadcast signal to the terminal.

The broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal. The broadcast-related information can also be provided through a mobile communication network, in which case it can be received by the mobile communication module 113. Broadcast-related information can exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems. In particular, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) ), Digital Video Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. In addition, the broadcast receiving module 111 may be configured to be suitable for all broadcasting systems that provide broadcasting signals, as well as the digital broadcasting system. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 113 transmits and receives a radio signal to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module 115 refers to a module for wireless Internet access, and the wireless Internet module 115 can be embedded in the mobile terminal 100 or externally. The short-range communication module 117 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and the like can be used as the short distance communication technology. A GPS (Global Position System) module 119 receives position information from a plurality of GPS satellites.

The A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 123. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. Then, the processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 123 receives an external sound signal by a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 113 and output when the voice data is in the call mode. The microphone 123 may be a variety of noise reduction algorithms for eliminating noise generated in receiving an external sound signal.

A key input signal input by the user for controlling the operation of the terminal is input through the user input unit 130. [ The user input unit 130 may include a key pad, a dome switch, a touch pad, a jog wheel, a jog switch, and the like. The user input unit 130 may include one or more key input units for inputting one key input signal.

The sensing unit 140 senses the current state of the portable terminal 100 such as the open / close state of the portable terminal 100, the position of the portable terminal 100, Thereby generating a sensing signal. For example, when the portable terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. In addition, a sensing function related to whether or not the power supply unit 190 is powered on, whether the interface unit 170 is coupled to an external device, and the like can be handled.

The sensing unit 140 may include a touch sensor 141. The touch sensor 141 is disposed in a predetermined area of the user input unit 130 in a superimposed manner with the user input unit 130. [ When a touch signal is input through the touch sensor 141, the control unit 180 can perform a specific operation according to the input touch signal. A directional touch signal can be input through the touch sensor 141. [ The touch sensor 141 may be implemented as an electrostatic type or a static pressure type. The touch sensor 141 may be implemented using an optical sensor system. That is, the light is output to the outside, and the touch signal is sensed by sensing the light that changes according to the touch input. Accordingly, when an optical sensor is used, an optical output module 157 capable of outputting light to the outside is required.

The output unit 150 is for outputting an audio signal, a video signal or an alarm signal and includes a display unit 151 and an audio output module 153, an alarm unit 155, an optical output module 157, And the like.

The display unit 151 displays and outputs the information processed by the portable terminal 100. For example, when the portable terminal 100 is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the portable terminal 100 is in the video communication mode or the photographing mode, the photographed or received images can be displayed individually or simultaneously, and the UI and the GUI are displayed.

Meanwhile, when the display unit 151 and the touch pad have a mutual layer structure to constitute a touch screen, the display unit 151 may be used as an input device in addition to the output device. If the display unit 151 is configured as a touch screen, it may include a touch screen panel, a touch screen panel controller, and the like. In this case, the touch screen panel is a transparent panel attached to the outside, and can be connected to the internal bus of the portable terminal 100. The touch screen panel keeps a watch on the contact result, and if there is a touch input, sends the corresponding signals to the touch screen panel controller. The touch screen panel controller processes the signals, and then transmits corresponding data to the controller 180 so that the controller 180 can determine whether the touch input has been made and which area of the touch screen has been touched.

The display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, And a display (3D display). There may be two or more display units 151 according to the implementation mode of the portable terminal 100. [ For example, the portable terminal 100 may include an external display unit (not shown) and an internal display unit (not shown) at the same time.

The audio output module 153 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 153 outputs sound signals related to functions performed in the portable terminal 100, for example, a call signal reception tone, a message reception tone, and the like. The sound output module 153 may include a speaker, a buzzer, and the like.

The alarm unit 155 outputs a signal for notifying the occurrence of an event of the portable terminal 100. Examples of events occurring in the portable terminal 100 include call signal reception, message reception, key signal input, and the like. The alarm unit 155 outputs a signal for notifying the occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode. The alarm unit 155 may output a signal for notifying a call signal when a call signal is received or a message is received. Also, when the key signal is inputted, the alarm unit 155 can output the signal as the feedback to the key signal input. The user can recognize the occurrence of an event through the signal output by the alarm unit 155. Of course, a signal for notifying the occurrence of an event may also be output through the display unit 151 or the sound output module 153. [

The optical output module 157 is provided at the center of the touch sensor 141 when the touch sensor 141 detects the touch input using the optical sensor system. The touch signal can be sensed through the light output through the optical output module 157.

The memory 160 may store a program for processing and controlling the control unit 180 and may store a function for temporarily storing input or output data (e.g., a phone book, a message, a still image, .

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM , And a ROM. ≪ / RTI > In addition, the portable terminal 100 may operate a web storage for storing the memory 150 on the Internet.

The interface unit 170 serves as an interface with all external devices connected to the portable terminal 100. Examples of the external device connected to the portable terminal 100 include a card socket such as a wired / wireless headset, an external charger, a wired / wireless data port, a memory card, a SIM / UIM card, / Output, Video I / O, and Earphone. The interface unit 170 receives data from the external device or receives power from the external device and transmits the data to each component in the portable terminal 100 so that data in the portable terminal 100 can be transmitted to the external device .

The controller 180 typically controls the operation of the respective units to control the overall operation of the mobile terminal 100. For example, voice communication, data communication, video communication, and the like. In addition, the control unit 180 may include a multimedia playback module 181 for multimedia playback. The multimedia playback module 181 may be configured in hardware in the controller 180 or separately from software in the controller 180. [

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The portable terminal according to the present invention has been described in terms of components according to functions. Hereinafter, the portable terminal related to the present invention will be described in more detail with reference to FIG. Hereinafter, for convenience of explanation, a folder type portable terminal having a keypad such as a keyboard as a user input unit among various types of portable terminals such as a folder type, a bar type, a swing type, a slider type and the like will be described as an example. However, the present invention is not limited to a folder type portable terminal, but can be applied to all types of portable terminals including the above-described type.

2 is a perspective view of a portable terminal according to an embodiment of the present invention.

2, the portable terminal 100 includes a first main body 100A having a display unit 151 and a second main body having a first user input unit 130a of a keypad type. The first main body 100A is formed by the first front case 100A-1 and the first rear case 100A-2 and the second main body 100B is formed by the second front case 100B-1 and the second main case 100B. And is formed by the rear case 100B-2. Various electronic components are embedded in the space formed by the front cases 100A-1 and 100B-1 and the rear cases 100A-2 and 100B-2. At least one intermediate case may be additionally disposed between the front cases 100A-1 and 100B-1 and the rear cases 100A-2 and 100B-2. Such cases may be formed by injection molding of a synthetic resin, or may be formed of a metal material, for example, a metal material such as stainless steel (STS) or titanium (Ti).

The display unit 151, the first sound output module 153a, and the first camera 121a may be disposed in the first main body 100A, specifically, the first front case 100A-1.

The display unit 151 includes a liquid crystal display (LCD), an OLED (Organic Light Emitting Diodes), and the like that visually express information. The display unit 151 may be configured to operate as a touch screen by inputting information by a user's touch by superimposing the touch pad on the display unit 151 in a layer structure.

The first acoustic output module 153a may be implemented in the form of a receiver or a speaker. The first camera 121a may be adapted to photograph an image or a moving image of a user or the like.

The second main body 100B includes a microphone 123, first to third user inputs 130a, 130b and 130c, a touch sensor 141, an optical output module 157, an interface unit 170, a power supply unit 190 . More specifically, a first user input unit 130a and an optical output module 157 of a keypad type are disposed in the second front case 100B-1, and a touch sensor 141 And an optical output module 157 are disposed. The second and third user input units 130b and 130c, the interface unit 170, and the power supply unit 190 are disposed in the second rear case 100B-2.

A second sound output module (not shown) may be additionally disposed in the rear case 100A-2. The second sound output module may implement the stereo function together with the first sound output module 153a, and may be used for talking in the speakerphone mode.

An antenna (not shown) for receiving broadcasting signals may be disposed on one side of the second rear case 100A-2 in addition to the antenna for communication. The antenna may be installed to be capable of being drawn out from the rear case 100A-2.

The microphone 123 may be implemented in a form suitable for receiving voice, sound, etc. of the user.

The first to third user input units 130a, 130b, and 130c may be collectively referred to as a user input unit 130 and may be employed in any manner as long as the user operates in a tactile manner with a tactile impression.

For example, the user input unit 130 may be embodied as a dome switch or a touch pad capable of receiving a command or information by a push or touch operation of a user, or may be a wheel, a jog type, a joystick, Or the like. In terms of functions, the first user input unit 130a is for inputting a command such as start, end, and call, and the second user input unit 130b is for inputting an operation mode selection or the like. Also, the third user input unit 130c may operate as a hot-key for activating a special function in the portable terminal 100. [

The first user input unit 130a overlaps the touch sensor 141 in a predetermined area of the first user input unit 130a and when the touch sensor 141 uses the optical sensor scheme, And an optical output module 157 for outputting light at the center of the optical fiber 141 is disposed.

The interface unit 170 enables the portable terminal according to the present invention to exchange data with an external device. For example, the interface unit 170 may be at least one of a connection terminal for connecting to an earphone, a port for short-range communication, or power supply terminals for supplying power to the portable terminal 100, have. The interface unit 170 may be a card socket that accommodates an external card such as a user authentication module such as a subscriber identification module (SIM) or a user identity module (UIM), or a memory card for information storage.

A power supply unit 190 for supplying power to the portable terminal is mounted on the second rear case 100B-2. The power supply unit 190 may be a rechargeable battery, for example, and may be detachably coupled to the second rear case 100B-2 for charging or the like.

3 and 4 are block diagrams illustrating in detail a user input unit included in a mobile terminal according to an exemplary embodiment of the present invention.

3 (a), the user input unit 130 includes a plurality of key input units 130-1, 130-2, and 130-3. The key input unit may be implemented as a key pad, a dome switch, a jog wheel, or a jog switch. The key input units 130-1, 130-2, and 130-3 transmit the input key input signals to the controller 180 when the key input signals are input. A touch sensor 141 is provided to overlap with a partial area of the key input units 130-1, 130-2, and 130-3. The touch sensor 141 may be implemented as an electrostatic or a static pressure type. When the touch sensor 141 is implemented as a static pressure type, the touch sensor 141 is set to be distinguished from the key input signal and the touch signal inputted in a static pressure manner. Accordingly, the touch signal input through the touch sensor 141 and the key input signal input through the key input units 130-1, 130-2, and 130-3 are distinguished.

3 (b) shows a case where the touch sensor is implemented using an optical sensor system. When an optical sensor system is used, an optical output module 157 for outputting light is provided, and light output from the optical output module 157 is input to the key input units 130-1 and 130-3 It is possible to sense a touch signal input in a certain area 141A.

4, the user input unit 130 includes key input units 130-1, 130-2, and 130-3, and a touch sensor 141 is provided in a predetermined area of the user input unit 130 do. The touch sensor 141 can transmit the inputted touch signal to the control unit 180 and the key input units 130-1, 130-2 and 130-3 can transmit the inputted key input signal to the control unit 180 .

When a touch signal is input, the control unit 180 moves and displays the pointer displayed on the display unit 151 according to the input touch signal. When the key input signal is input, And executes an operation corresponding to the key input unit.

Meanwhile, since the touch sensor 141 is arranged to be overlapped with the user input unit 130, not only the touch signal is input through the touch sensor 141, but also the key input signal can be input at the same time.

When the touch signal and the key input signal are inputted at the same time, the control unit 180 displays the operation menu corresponding to the area in which the pointer is displayed or executes the operation menu. The operation menu may vary depending on the area where the touch signal and the key input signal are simultaneously input. For example, when the touch signal and the key input signal are input simultaneously in the area A, a menu for editing the area in which the pointer is displayed can be displayed. When the touch signal and the key input signal are simultaneously input in the area E, cursor) can be moved to the area indicated by the pointer and displayed.

5 is a flowchart illustrating an operation method of a portable terminal according to an exemplary embodiment of the present invention.

5, the control unit 180 displays an image on the display unit 151 and displays a pointer POINTER (S300). Here, the image may be an idle screen, a menu execution screen, or a web page transmitted from a web server. The image is a concept that includes all the moving images, images, and text that can be displayed on the display unit. Here, the pointer is an indicator that can indicate a specific area of the image displayed on the display unit 151. [ It can be displayed in the form of arrows or fingers in general. If the image includes a text input window, the control unit 180 may display a cursor on the display unit 151. [

Next, the control unit 180 determines whether only the touch signal is input through the touch sensor 141 provided in the predetermined range of the user input unit 130 (S305). The touch sensor 141 may be an electrostatic type, a static pressure type touch sensor, or a touch sensor using an optical sensor type.

 As a result of the determination in step S305, when only the touch signal is input, the controller 180 moves the pointer according to the touch signal and displays the pointer on the display unit 151 (S310). For example, when a directional touch signal is input, the pointer is moved according to the direction of the directional touch signal, that is, according to the direction and movement distance of the touch signal. Since the touch sensor 141 is smaller than the display area of the display unit 151, not only the pointer moves in the same direction and the same moving distance as the input touch signal but also the display unit 151 The pointer can be moved and displayed in the direction in which the trajectory of the input touch signal is enlarged and the movement distance.

If it is determined in step S305 that the touch signal is not input, or if the pointer is moved in step S310, the control unit 180 determines whether a key input signal is inputted simultaneously with the touch signal (S315). The touch sensor 141 and the user input unit 130 are overlapped with each other so that when an input signal is generated through the area where the touch sensor 141 and the user input unit 130 are disposed in a mutually overlapping manner, The touch input signal is input through the user input unit 130, and the touch input signal is input through the user input unit 130. [

As a result of the determination in step S315, if the touch signal and the key input signal are input at the same time, the controller 180 displays an operation menu corresponding to the area in which the pointer is displayed or executes the operation menu (S320). Here, the operation menu includes an edit menu capable of editing, printing, saving, and so on an image displayed on the display unit, a selection menu selecting an area in which the pointer is displayed, a movement menu capable of moving to a sub- And a cursor movement menu for moving the cursor to the area where the pointer is displayed. The operation menu may be displayed differently according to the key input unit in which the key input signal is input, and the operation menu displayed differently according to the key input unit may be set differently by the user.

If it is determined in step S315 that the touch signal and the key input signal are not simultaneously input or if the information is displayed on the display unit 151 in step S320, the controller 180 determines whether only the key input signal is input (step S325). For example, in a case where the touch sensors 141 are superimposed on only a part of the key input unit for generating one key input signal, only the key input signal is inputted through the area where the touch sensor 141 does not overlap .

If it is determined in step S325 that only the key input signal is input, the controller 180 performs an operation corresponding to the key input unit that generated the key input signal (S330). For example, when only the key input signal is input through the 'ENTER' key input unit, the 'ENTER' operation is performed. When only the key input signal is inputted through the '1' key input unit, '1' ). The operation corresponding to the key input unit can be executed at a position where the cursor is displayed on the display unit 151. [

Accordingly, by disposing the touch sensor in a predetermined area of the user input unit 130 redundantly, it is possible to use the keypad and the touch pad at the same time without having a separate touch pad. Also, when a touch signal and a key input signal are simultaneously input through an area where the touch sensor and the user input unit are superimposed, an effect of using the key of the mouse can be obtained.

In addition, the portable terminal according to the present invention and its operation method are not limited to the configuration and method of the embodiments described above, but the embodiments can be applied to all or a part of each embodiment Some of which may be selectively combined.

Meanwhile, the present invention can be embodied as a processor-readable code on a processor-readable recording medium such as a mobile station modem (MSM). The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium readable by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and also a carrier wave such as transmission over the Internet. In addition, the processor readable recording medium may be distributed over networked computer systems so that code readable by the processor in a distributed manner can be stored and executed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

1 is a block diagram of a portable terminal according to an embodiment of the present invention;

FIG. 2 is a perspective view of a mobile terminal according to an exemplary embodiment of the present invention,

FIGS. 3 and 4 are views illustrating a detailed configuration of a user input unit included in a mobile terminal according to an exemplary embodiment of the present invention;

5 is a flowchart illustrating an operation method of a portable terminal according to an exemplary embodiment of the present invention.

Claims (7)

Comprising: a touch sensor disposed in a superimposed manner with a predetermined area of a user input unit; Displaying a pointer on a display unit; Moving and displaying the pointer corresponding to the touch signal when only the touch signal is inputted through the touch sensor; Displaying an operation menu corresponding to a region in which the pointer is displayed when a touch signal and a key input signal are simultaneously input through an area where the user input unit and the touch sensor are overlapped with each other; And And performing an operation corresponding to a position at which the key input signal is input when only a key input signal is input through an area of a user input unit that does not overlap the touch sensor. The method according to claim 1, Wherein the user input unit includes a plurality of key input units, Wherein the touch sensor is disposed to overlap with one or more key input units of the plurality of key input units. The method according to claim 1, And executing an operation menu corresponding to an area in which the pointer is displayed when a touch signal and a key input signal are simultaneously input through the predetermined area. The method according to claim 1, Wherein the touch sensor senses a touch signal using an optical sensor method. 5. The method of claim 4, Wherein the touch sensor comprises an optical output module. The method according to claim 1, The operation menu includes an edit menu for editing an image, a selection menu for selecting an area where the pointer is displayed, a movement menu for moving to a menu linked downward in the area where the pointer is displayed, And a cursor moving menu for moving the cursor. A touch sensor disposed to overlap with a predetermined region of a user input unit; A display unit for displaying a pointer; And Wherein when the touch signal is input through the touch sensor, the pointer is moved and displayed corresponding to the touch signal, and the touch signal and the key input signal are input simultaneously through the area where the user input unit and the touch sensor overlap each other And a control unit for displaying an operation menu corresponding to an area where the pointer is displayed on the display unit, Wherein the control unit executes an operation corresponding to a position at which the key input signal is input when only a key input signal is input through a region of a user input unit that does not overlap with the touch sensor.

Images