EP2040146A2 - Mobile terminal and method of controlling operation of the same - Google Patents

Mobile terminal and method of controlling operation of the same Download PDF

Info

Publication number
EP2040146A2
EP2040146A2 EP08016452A EP08016452A EP2040146A2 EP 2040146 A2 EP2040146 A2 EP 2040146A2 EP 08016452 A EP08016452 A EP 08016452A EP 08016452 A EP08016452 A EP 08016452A EP 2040146 A2 EP2040146 A2 EP 2040146A2
Authority
EP
European Patent Office
Prior art keywords
mobile terminal
scroll
list
displayed
touch screen
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP08016452A
Other languages
German (de)
French (fr)
Other versions
EP2040146A3 (en
EP2040146B1 (en
Inventor
Min Joo Kim
Hang Jun Cho
Jeong Hyuk Yoon
Yun Hwan Kang
Sung Eun Bang
Sang Hyun Lee
Min Soo Park
Hyo Jin Suh
Hye Youn Cho
Hye Eun Shin
Se Il Hwang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
LG Electronics Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020070094836A external-priority patent/KR101414766B1/en
Priority claimed from KR1020070097896A external-priority patent/KR101418510B1/en
Application filed by LG Electronics Inc filed Critical LG Electronics Inc
Publication of EP2040146A2 publication Critical patent/EP2040146A2/en
Publication of EP2040146A3 publication Critical patent/EP2040146A3/en
Application granted granted Critical
Publication of EP2040146B1 publication Critical patent/EP2040146B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016Input arrangements with force or tactile feedback as computer generated output to the user
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction with lists of selectable items, e.g. menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842Selection of displayed objects or displayed text elements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485Scrolling or panning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485Scrolling or panning
    • G06F3/04855Interaction with scrollbars
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/02Constructional features of telephone sets
    • H04M1/0202Portable telephone sets, e.g. cordless phones, mobile phones or bar type handsets
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/26Devices for calling a subscriber
    • H04M1/27Devices whereby a plurality of signals may be stored simultaneously
    • H04M1/274Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc
    • H04M1/2745Devices whereby a plurality of signals may be stored simultaneously with provision for storing more than one subscriber number at a time, e.g. using toothed disc using static electronic memories, e.g. chips
    • H04M1/27467Methods of retrieving data
    • H04M1/2747Scrolling on a display
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72469User interfaces specially adapted for cordless or mobile telephones for operating the device by selecting functions from two or more displayed items, e.g. menus or icons

Definitions

  • the present invention relates to a mobile terminal in which a signal can be output or an identifying character can be displayed such that characters, a screen scroll speed, a current scrolling position and so on can be identified, and a method of controlling an operation of the mobile terminal.
  • a mobile terminal is a portable device equipped with one or more of functions for performing voice and video communications while being carried with, inputting and outputting information, storing data and so on.
  • the mobile terminal has become equipped with complicated functions, such as capturing of photos or motion images, the play of music files or motion image files, gaming, reception of broadcasting, and wireless Internet, and therefore has been implemented in the form of a comprehensive multimedia player.
  • one of the attempts can include a user interface environment in which a user can search or select functions easily and conveniently.
  • the mobile terminal has been considered as one of personal belongings for expressing a user's personality, there is a need for a change in the designs of various forms.
  • a mobile terminal provides the function of outputting a key tone, etc. according to a pressed key when characters are input, but does not provide a function of distinguishing characters input by a tactile sense.
  • a typical mobile terminal does provide the function of outputting a key tone or a vibration signal having a specific pattern according to a specific key pressed, but does not provide a function of distinguishing characters, such as input Korean consonants and vowels, the English alphabet, and numerals.
  • the mobile terminal does provide the function of varying high-speed scrolling, the scroll speed, etc. when a file list and so on is scrolled, but does not provide a function of knowing a change in the scroll speed, a current scrolling position or the like.
  • an object of the present invention to provide a mobile terminal in which a vibration signal, enabling input characters, a change in a screen scroll speed or a current scrolling position to be identified through a tactile sense, is output, and a method of controlling an operation of the same.
  • Another object of the present invention is to provide a mobile terminal in which an identifying character to easily identify a current scrolling position when a search list, etc. are scrolled is displayed, and a method of controlling an operation of the same.
  • a method of controlling an operation of a mobile terminal including the steps of displaying a character input window in which characters can be entered by touch input on a touch screen, and when characters are entered by touch input through the character input window, outputting different vibration signals according to the entered characters.
  • a method of controlling an operation of a mobile terminal including the steps of displaying a file list and scroll arrows for scrolling the file list on a touch screen, when the scroll arrow is touched and entered, scrolling the file list at a scroll speed previously set in response to a time when the scroll arrow is touched and entered, and outputting a vibration signal to identify at least one of a scroll speed and a current scrolling position of the file list.
  • a method of controlling an operation of a mobile terminal including the steps of displaying a search list and a scroll bar for scrolling the search list, and scrolling the search list in response to a moving direction of the scroll bar and displaying an identifying character for enabling a current scrolling position to be identified in the search list.
  • a mobile terminal including a touch screen displaying a character input window in which characters can be entered through touch input, an alarm unit outputting vibration signals, and a controller for, when characters are entered by touch input through the character input window, controlling the alarm unit to output different vibration signals according to the entered characters.
  • a mobile terminal including a touch screen on which a file list and scroll arrows for scrolling the file list are displayed, an alarm unit outputting vibration signals, and a controller for, when the scroll arrow is touched and entered, controlling the file list to be scrolled at a scroll speed previously set in response to a time when the scroll arrow is touched and entered and controlling the alarm unit to output a vibration signal to identify at least one of a scroll speed and a current scrolling position of the file list.
  • a mobile terminal including a display unit on which a search list and a scroll bar for scrolling the search list are displayed, and a controller for scrolling the search list in response to a moving direction of the scroll bar and controlling an identifying character to be displayed such that a current scrolling position can be identified in the search list.
  • the present invention provides a computer-readable recording medium in which a program for executing the above method in a computer is recorded.
  • a mobile terminal described in this specification can include mobile phones, smart phones, notebook computers, terminals for digital broadcasting, personal digital assistants (PDAs), portable multimedia players (PMPs), navigation devices for GPS and so on.
  • PDAs personal digital assistants
  • PMPs portable multimedia players
  • FIG. 1 is a block diagram of a mobile terminal in accordance with an embodiment of the present invention.
  • the mobile terminal in accordance with an embodiment of the present invention is described below with reference to FIG. 1 from a standpoint of constituent elements according to their functions.
  • the suffix of constituent elements used in the following description, such as “module” and “unit” is simply assigned by considering the easiness of writing this specification, but is not specifically assigned by considering the importance and roles. Accordingly, the “module” and “unit” can be mixed in use.
  • a mobile terminal 100 can include a wireless communication unit 110, an audio/video (A/V) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, memory 160, an interface unit 170, a controller 180, and a power supply unit 190.
  • A/V audio/video
  • a user input unit 130 a user input unit 130
  • a sensing unit 140 a sensing unit 140
  • an output unit 150 memory 160
  • an interface unit 170 a controller 180
  • a power supply unit 190 a power supply unit 190.
  • the wireless communication unit 110 can include a broadcasting receiving module 111, a mobile communication module 113, a wireless Internet module 115, a short-range communication module 117, a global positioning system (GPS) module 119 and so on.
  • a broadcasting receiving module 111 can include a broadcasting receiving module 111, a mobile communication module 113, a wireless Internet module 115, a short-range communication module 117, a global positioning system (GPS) module 119 and so on.
  • GPS global positioning system
  • the broadcasting receiving module 111 receives at least one of broadcasting signals and broadcasting-related information from an external broadcasting management server through broadcasting channels.
  • the broadcasting channels can include a satellite channel, a terrestrial wave channel and the like.
  • the broadcasting management server can refer to a server for creating and transmitting at least one of broadcasting signals and broadcasting-related information or a sever for receiving at least one of previously generated broadcasting signals and previously generated broadcasting-related information and transmitting it to a terminal.
  • the broadcasting-related information can refer to information pertinent to a broadcasting channel, a broadcasting program and/or a broadcasting service provider.
  • the broadcasting signal can include not only TV broadcasting signals, radio broadcasting signals, and data broadcasting signals, but also broadcasting signals in which TV broadcasting signals or radio broadcasting signals are combined with data broadcasting signals.
  • the broadcasting-related information can be provided over a mobile communication network. In this case, the broadcasting-related information can be received by the mobile communication module 113.
  • the broadcasting-related information can exist in various forms.
  • the broadcasting-related information can exist in the form of the electronic program guide (EPG) of the digital multimedia broadcasting (DMB), the electronic service guide (ESG) of the digital video broadcast-handheld (DVB-H) or the like.
  • EPG electronic program guide
  • DMB digital multimedia broadcasting
  • ESG electronic service guide
  • DVD-H digital video broadcast-handheld
  • the broadcasting receiving module 111 receives broadcasting signals using various broadcasting systems.
  • the broadcasting receiving module 111 can receive broadcasting signals using a digital broadcasting system, such as the digital multimedia broadcasting-terrestrial (DMB-T), the digital multimedia broadcasting-satellite (DMB-S), the media forward link only (MediaFLO), the digital video broadcast-handheld (DVB-H), and the integrated services digital broadcast-terrestrial (ISDB-T).
  • the broadcasting receiving module 111 can be constructed to be suitable for not only the digital broadcasting systems, but also all broadcasting systems providing broadcasting signals. At least one of broadcasting signals and/or broadcasting-related information, received through the broadcasting receiving module 111, can be stored in the memory 160.
  • the mobile communication module 113 transmits and receives radio signals to and from at least one of a base station, an external terminal, and a server over a mobile communication network.
  • the radio signals can include voice call signals, video call signals, or various forms of data according to transmission/reception of text/multimedia messages.
  • the wireless Internet module 115 refers to a module for wireless Internet access.
  • the wireless Internet module 115 can be built in the mobile terminal 100 or external to the mobile terminal 100.
  • the short-range communication module 117 refers to a module for local area communication. Local area communication technology can employ Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee or the like.
  • the GPS module 119 receives position information from a plurality of GPS satellites.
  • the A/V input unit 120 is adapted to input audio signals or video signals and can include a camera 121, a microphone 123, and so on.
  • the camera 121 processes image frames, such as still images or motion images, which are captured by an image sensor in the video call mode or the capturing mode.
  • the processed image frames can be displayed on a display unit 151.
  • the image frames processed by the camera 121 can be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110.
  • the camera 121 can be provided in plural numbers according to the configuration of a terminal.
  • the microphone 123 receives external sound signals in the call mode, the recording mode, the voice recognition mode, etc. and converts the received sound signals into electrical voice data.
  • the processed voice data can be converted into a format, which can be transmitted to a mobile communication base station through the mobile communication module 113, and then output.
  • the microphone 123 can employ a variety of noise removal algorithms for removing noise occurring in the process of receiving external sound signals.
  • the user input unit 130 generates key entry data, which is input by a user in order to control the operation of the terminal.
  • the user input unit 130 can include the keypad, the dome switch, the touch pad (static pressure/constant electricity), the jog wheel, the jog switch, the finger mouse or the like.
  • a mutually layered structure of the touch pad and the display unit 151 which will be described later on, can be referred to as a touch screen.
  • the sensing unit 140 senses a current status of the mobile terminal 100, such as a closed state of the mobile terminal 100, the position of the mobile terminal 100, whether a user touches the mobile terminal 100 or not, and so on and generates a sensing signal for controlling the operation of the mobile terminal 100.
  • a current status of the mobile terminal 100 such as a closed state of the mobile terminal 100, the position of the mobile terminal 100, whether a user touches the mobile terminal 100 or not, and so on and generates a sensing signal for controlling the operation of the mobile terminal 100.
  • the sensing unit 140 can sense whether the slide phone is opened or not.
  • the sensing unit 140 can also have the functions of sensing whether the power supply unit 190 supplies power or not, whether the interface unit 170 is connected to an external device, and so on.
  • the output unit 150 is constructed to output audio signals, video signals or alarm signals and can include the display unit 151, a sound output module 153, an alarm unit 155, and so on.
  • the display unit 151 displays information processed in the mobile terminal 100. For example, when the mobile terminal is in the call mode, the display unit 151 displays a user interface (UI) or a graphic user interface (GUI), which is pertinent to a call. When the mobile terminal 100 is in the video call mode or the capturing mode, the display unit 151 displays captured or received images individually or simultaneously and also displays a UI or a GUI.
  • UI user interface
  • GUI graphic user interface
  • the display unit 151 can also be used as an input device as well as the output device.
  • the display unit 151 can include a touch screen panel, a touch screen panel controller, and so on.
  • the touch screen panel is a transparent panel attached to the outside and can be connected to an internal bus within the mobile terminal 100.
  • the touch screen panel continues to monitor whether there is a touch input and, when there is a touch input, sends corresponding signals to the touch screen panel controller.
  • the touch screen panel controller processes the corresponding signals received from the touch screen panel and transmits the corresponding data to the controller 180, so that the controller 180 can understand whether there has been a touch input or which area of the touch screen has been touched.
  • the display unit 151 can include at least one of a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, and a 3D display. Two or more display units 151 may exist according to the implementation type of the mobile terminal 100.
  • the mobile terminal 100 may be equipped with both an external display unit (not shown) and an internal display unit (not shown).
  • the sound output module 153 outputs audio data, which is received from the wireless communication unit 110 in the incoming call mode, the call mode, the record mode, the voice recognition mode, the incoming broadcasting mode or the like or stored in the memory 160.
  • the sound output module 153 also outputs sound signals pertinent to the functions performed in the mobile terminal 100, for example, sound of a received call signal and sound of a received message.
  • the sound output module 153 can include a speaker, a buzzer or the like.
  • the alarm unit 155 outputs signals to inform the occurrence of events in the mobile terminal 100.
  • events occurring in the mobile terminal 100 can include an incoming call signal, a received message, an entered key signal input and so on.
  • the alarm unit 155 can also output signals to inform the occurrence of events in different ways other than the audio or video signals.
  • the alarm unit 155 can output the signals in vibration form.
  • the alarm unit 155 can generate a vibration signal in order to inform the reception of the call signal or message.
  • the alarm unit 155 can generate a vibration signal as a feedback to the input key signal.
  • a user can notice the occurrence of an event through the output of the vibration signal.
  • the signals to inform the occurrence of events can also be output through the display unit 151 or the sound output module 153.
  • the memory 160 can store programs necessary to process and control the controller 180 and also function to temporarily store input or output data (for example, a phonebook, messages, still images, motion images and the like).
  • input or output data for example, a phonebook, messages, still images, motion images and the like.
  • the memory 160 can include at least one type of storage media, including a flash memory type, a hard disk type, a multimedia card micro type, card type memory (for example, SD memory, XD memory, and so on), RAM, and ROM.
  • the mobile terminal 100 can also manage a web storage serving as the storage function of the memory 160 on an Internet.
  • the interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100.
  • the external devices connected to the mobile terminal 100 can include a wired/wireless headset, an external charger, wired/wireless data ports, a memory card, a card socket such as subscriber identification module (SIM) /user identity module (UIM) cards, an audio input/output (I/O) terminal, a video I/O terminal, an earphone, and so on.
  • SIM subscriber identification module
  • UIM user identity module
  • I/O audio input/output
  • video I/O terminal a video I/O terminal
  • earphone an earphone
  • the controller 180 typically controls an operation of each of the elements and controls an overall operation of the mobile terminal 100.
  • the controller 180 can perform pertinent controls and processes for voice call, data communication, video telephony, and so on.
  • the controller 180 can include a multimedia play module 181 for playing multimedia.
  • the multimedia play module 181 can be constructed in hardware within the controller 180 or constructed in software separately from the controller 180.
  • the power supply unit 190 is supplied with external power source or internal power source and supplies power source necessary for the operation of the each constituent element under the control of the controller 180.
  • the mobile terminal pertinent to the present invention has been described so far from a viewpoint of the constituent elements according to its functions.
  • the mobile terminal related to the present invention is further described from a viewpoint of the constituent elements according to its external shape with reference to FIGS. 2 and 3 .
  • the bar type mobile terminal equipped with a full touch screen is described below as an example, for convenience of description.
  • the present invention is not limited to the bar type mobile terminal, but instead may be applied to all types of mobile terminals, including the above types.
  • FIG. 2 is a front perspective view of the mobile terminal in accordance with an embodiment of the present invention.
  • a casing constituting an external shape of the mobile terminal 100 is comprised of a front casing 100A-1 and a rear casing 100A-2.
  • a variety of electronic components are built in the space formed by the front casing 100A-1 and the rear casing 100A-2.
  • At least one middle casing can be further disposed between the front casing 100A-1 and the rear casing 100A-2.
  • the casings can be formed by injecting synthetic resin or can be formed from metal such as stainless steel (STS) or titanium (Ti).
  • the display module 151 In a main body, more particularly, in the front casing 100A-1 are disposed the display module 151, a first sound output module 153a, a first camera 121a, and a first user input unit 130a. Further, a second user input unit 130b, a third user input unit 130c, and a microphone 123 can be disposed on the sides of the rear casing 100A-2.
  • the display unit 151 includes a LCD, an OLED or the like for visually displaying information.
  • a touch pad can be overlapped with the display unit 151 in the layered structure, so the display unit 151 can operate as a touch screen in order to enable the input of information by the touch of a user.
  • the first sound output module 153a can be implemented in the form of a receiver or speaker.
  • the first camera 121 a can be implemented to capture images or motion images of a user, and so on. Further, the microphone 123 can be implemented properly in such a way as to receive a user's voice, other sound and so on.
  • the first to third user input units 130a, 130b, and 130c can be collectively called the user input unit 130.
  • the user input unit 130 can adopt any kind of a method as long as it supports a tactile manner.
  • the user input unit 130 can be implemented using a dome switch or a touch pad, which is able to receive commands or information by push or touch manipulation of a user, or can be implemented using a wheel or jog method for rotating the key, or a method employing Joystick.
  • the first user input unit 130a is adapted to input commands such as the start, the end, and call.
  • the second user input unit 130b can be used as a mode setting key for entering an operating mode, etc.
  • the third user input unit 130c can operate as a hot key for activating special functions within the mobile terminal 100.
  • FIG. 3 is a rear perspective view of the mobile terminal shown in FIG. 2 .
  • a fourth user input unit 130d, a fifth user input unit 130e, and the interface unit 170 can be disposed on the side of the rear casing 100A-2.
  • a second camera 121b can be further mounted on the rear side of the rear casing 100A-2.
  • the second camera 121b has a photographing direction substantially opposite to that of the first camera 121a and can have different pixels from that of the first camera 121a.
  • the first camera 121a can have low pixels sufficiently enough to capture an image of a user face and transmit the captured image to a counterpart in the video call or the like.
  • the second camera 121b captures general subjects and can have high pixels because a photographed subject is not transmitted immediately.
  • a sixth user input unit 130f can be installed around the second camera 121b.
  • the sixth user input unit 130f can employ a jog wheel enabling the rotation input or the like.
  • a flash 125 and a mirror 126 can be further disposed adjacent to the second camera 121b.
  • the flash 125 illuminates light to a subject when the subject is photographed by the second camera 121b.
  • the mirror 126 reflects a user's face, etc. when the user wants to have his picture taken (self-photographing) using the second camera 121b.
  • a second sound output module (not shown) can be further disposed in the second rear casing 100A-2.
  • the second sound output module can implement a stereo function together with the first sound output module 153a and can also be used for a call in a speakerphone mode.
  • An antenna (not shown) for receiving broadcasting signals, other than an antenna for a call, etc., can be disposed on one side of the second rear casing 100A-2.
  • the antenna can be drawn out from the second rear casing 100A-2.
  • the interface unit 170 becomes a passage, enabling the mobile terminal 100 to exchange data, etc. with external devices.
  • the interface unit 170 can be at least one of a connector for connecting to an earphone, a port for near area communication, and power supply terminals for supplying power to the mobile terminal 100 in a wired or wireless manner.
  • the interface unit 170 can be a card socket for receiving external cards, such as a SIM, a UIM and a memory card for storing information.
  • the power supply unit 190 for supplying power to the mobile terminal is mounted on the part of the rear casing 100A-2.
  • the power supply unit 190 can be, for example, a rechargeable battery and can be detachably coupled to the rear casing 100A-2 for charging purpose, and so on.
  • the second camera 121 b and the like are disposed in the rear casing 100A-2, but the present invention is not limited to the above arrangement.
  • the second camera 121 b is not separately included, the first camera 121 a can be rotatably formed so as to cover even the photographing direction of the second camera 121b.
  • FIG. 4 is a flowchart illustrating a method of controlling an operation of the mobile terminal in accordance with a first embodiment of the present invention.
  • the controller 180 controls a character input window in which characters, such as the Korean alphabet, the alphabet, Chinese characters, numerals, and a punctuation mark, can be input through touch input to be displayed on the display unit 151 consisting of a touch screen in response to a menu selected by a user, such as message transmission and search for a telephone number or a file, (S200).
  • the controller 180 determines whether specific characters have been input by the touch input through the character input window (S205).
  • the controller 180 controls different default vibration signals to be output in response to the input characters (S210). That is, the controller 180 controls the alarm unit 155 to output different vibration signals according to the input characters through the character input window.
  • a user can identify the input characters based on the output vibration signals.
  • a user can set the vibration signals, which are output according to the input characters, according to desired output patterns.
  • the controller 180 may control a character input through the character input window to be displayed in a specific area of the display unit 151 along with the output of a vibration signal.
  • the output of a vibration signal according to an input character is repeatedly performed until another operation menu displayed on the display unit 151 is selected. If it is determined that another operation menu item displayed on the display unit 151 has been selected (S215), the controller 180 controls an operation, corresponding to a selected operation menu, to be executed (S220).
  • FIG. 5 is a flowchart illustrating a method of controlling an operation of the mobile terminal in accordance with a second embodiment of the present invention.
  • the controller 180 controls a file list in which file names, etc. are listed, and a scroll arrow for scrolling a file list to be displayed on the display unit 151 consisting of a touch screen (S250).
  • the scroll arrow is displayed when all pieces of information within a screen displayed on the display unit 151 cannot be displayed or the like.
  • the controller 180 controls a list, etc., which is displayed on the screen, to be scrolled upwardly.
  • a down scroll arrow is touched, the controller 180 controls a list, etc., which is displayed on the screen, to be scrolled downwardly.
  • the controller 180 may control a list, etc., which is displayed on the screen, to be scrolled to the left or right according to the shape of a file list, etc., which is displayed on the display unit 151 or the touch of the scroll arrow.
  • the above configuration can be applied identically when a scroll bar is used instead of the scroll arrow.
  • the controller 180 determines whether the scroll arrow displayed on the display unit 150 has been touched and entered (S255). If, as a result of the determination, there is touch through the scroll arrow, the controller 180 controls the file list to be scrolled at a default scroll speed according to the time when the scroll arrow is touched and entered (S260). In other words, when there is a first touch through the scroll arrow, the controller 180 controls the file list to be scrolled at a basic speed. When the touch of the scroll arrow continues, the controller 180 controls the file list to be scrolled at a faster scroll speed step by step.
  • a file list may be scrolled in response to a direction where the scroll bar is dragged.
  • the file list may be scrolled at a faster scroll speed step by step.
  • the controller 180 controls a vibration signal to be output along with the scrolling of the file list (S265). That is, whenever the scroll speed changes, the controller 180 can control vibration signals of different patterns to be output. Alternatively, the controller 180 may control a vibration signal to be output such that a current scrolling position can be identified as well as the scroll speed according to use environment. For example, in the case in which scrolling of one page or a certain range is performed, the controller 180 may control a vibration signal to be output or in the case in which an initial letter of a file name in a file list, etc. changes, the controller 180 may control a vibration signal to be output. The scrolling of the file list and the output of the vibration signal are displayed repeatedly until the touch through the scroll arrow is finished (S270).
  • the controller 180 controls an operation, corresponding to the selected operation menu, to be executed (S280).
  • the operation corresponding to the selected operation menu can include an operation for selecting and playing any one item in a file list, an operation for switching a menu for voice call, mail transmission, etc. and so on.
  • vibration signals can be output such that a change in the scroll speed, a current scrolling position, the degree of a scrolling progress and so on can be identified.
  • a scroll arrow may be selected according to the entry of a key, which is defined to execute a scroll function, such that the same operation as that of the above embodiment is executed.
  • a file list has been described as an example, the present invention is not necessarily limited to the case where the file list is scrolled, but can be applied to cases where other screen scrolling is necessary.
  • FIGS. 6A and 6B are flowcharts illustrating a method of controlling an operation of the mobile terminal in accordance with a third embodiment of the present invention.
  • the controller 180 controls a search list in which a telephone number list, file names and so on are listed and a scroll bar for scrolling the search list to be displayed on the display unit 151 (S305).
  • the scroll bar indicates where is the information of a current screen located in the entire screen when all pieces of information cannot be displayed within a screen displayed on the display unit 151.
  • the controller 180 also controls the contents of information, which is displayed on a screen, to be scrolled upward/downward or left/right as the scroll bar moves.
  • the controller 180 determines whether the scroll bar displayed on the display unit 150 has moved (S310).
  • the scroll bar can be moved in such a manner that the scroll bar is touched and dragged.
  • the scroll bar may be moved using a Jog wheel key or a key defined to execute other scroll function.
  • the controller 180 controls the search list to be scrolled in response to a moving direction of the scroll bar (S315).
  • a moving direction of the scroll bar In other words, when a moving direction of the scroll bar is downward, the controller 180 controls the search list to be scrolled downwardly and, when a moving direction of the scroll bar is upward, the controller 180 controls the search list to be scrolled upwardly.
  • the controller 180 may control the search list to be scrolled to the left or right according to the form of a search list displayed on the display unit 151.
  • the controller 180 controls an identifying character for identifying a current scrolling position to be displayed in the form of speech balloon along with the scrolling of the search list (S320).
  • the speech balloon is meant that speaking of persons in a cartoon, etc. is surrounded by a balloon shape and expressed.
  • the speech balloon is used as a meaning to include the tooltip, which pops up when the mouse cursor in a web page, etc. is taken.
  • the identifying character which is able to indicate a current scrolling position
  • the identifying character can be indicated by the first letter in the name of an item corresponding to the current scrolling position.
  • the first letter refers to the first letter in a word or sentence.
  • an adequate character can be used according to use environment.
  • This scrolling of the search list and the identifying character of the speech balloon shape are executed repeatedly until the movement of the scroll bar is finished (S325).
  • the controller 180 controls a detailed menu for the selected item to be displayed (S345).
  • the controller 180 controls an operation, which is selected in the detailed menu, to be executed (S350).
  • the controller 180 may control a default operation, which corresponds to a selected item, to be immediately executed without displaying a detailed menu according to use environment.
  • the controller 180 controls an operation, corresponding to the selected operation menu, to be executed (S340).
  • a current scrolling position can be displayed in such a way as to be easily identified, and an operation necessary for an item selected in the search list may be executed.
  • a search list has been described as an example, the present invention is not necessarily limited to the case where the search list is scrolled, but can be applied to cases where other screen scrolling is necessary.
  • FIGS. 7 to 9 are diagrams to which reference is made in order to describe the method of controlling the operation of the mobile terminal in accordance with a first embodiment of the present invention along with screens displayed on the display unit.
  • FIGS. 7 to 9 show examples of a search screen 400, which can be used to search files, telephone numbers and so on by inputting characters by touch.
  • Indicator icons are displayed at the top of the search screen 400.
  • a display window 440 and a character input window 430 are displayed under the indicator icons.
  • a letter entered through the character input window 430 is displayed on the display window 440.
  • a window 420 for selecting and entering the Korean alphabet, the English capital and small letters, numerals and so on is displayed under the character input window 430.
  • Menu items such as icons 410 for selecting other menus, Search 415 for executing search, and Mode 420 for selecting a mode, are displayed under the window 420.
  • FIG. 7 shows a state where a ' ⁇ ' key 431 displayed on the character input window 430 is touched and a letter ' ⁇ ' is entered
  • FIG. 8 shows a state where a ' ⁇ ' key 433 displayed on the character input window 430 is touched and a letter ' ⁇ ' is entered
  • FIG. 9 shows a state where a ' ⁇ ' key 435 and a 'Add dot' key 437 are consecutively selected and ' ' is consequently entered.
  • different vibration signals are output according to the entered Korean alphabet consonants ' ⁇ ', ' ⁇ ', and ' '. That is, when the respective keys displayed on the character input window 430 are touched and entered, different vibration signals are output. When a stroke is added or even when dual consonants, etc. are entered, different vibration signals are output. Accordingly, a user can notice which letter has been entered by a sense of vibration even with a tactile sense.
  • FIG. 10 is a diagram to which reference is made in order to describe the method of controlling the operation of the mobile terminal in accordance with a second embodiment of the present invention along with a screen displayed on the display unit.
  • FIG. 10 shows an example of a play screen 500 of a multimedia file.
  • a first window 510 on which a play state or pertinent information of a multimedia file, which is being played, is displayed is displayed on an upper portion of the play screen 500.
  • a second window 520 on which a file list and scroll arrows 530 and 540 are displayed is displayed on a lower portion of the play screen 500.
  • a user can notice a change in the scroll speed, the degree of scrolling progress, a current scrolling position and so on through a tactile sense.
  • FIGS. 11 to 15 are diagrams to which reference is made in order to describe the method of controlling the operation of the mobile terminal in accordance with a third embodiment of the present invention along with screens displayed on the display unit.
  • FIG. 11 shows a search screen 600 on which a search list and a scroll bar are displayed.
  • Indicator icons are displayed at the top of the search screen 600.
  • An icon 625, indicating the search screen, is displayed under the indicator icons.
  • Menu items such as an icon 610 for selecting other menus, a menu 615 showing the contents of a selected file, and an icon 620 for moving to a previous menu, are displayed at the bottom of the search screen 600.
  • a search list 640 such as a telephone directory list and files, is displayed on the search screen 600.
  • FIG. 11 shows that a telephone directory list is displayed.
  • a vertical scroll bar 630 for scrolling items, which are displayed as a search list, downwardly is displayed on the left side of the search list 640. Scroll arrows may be displayed on upper or lower sides of the scroll bar according to use environment.
  • an identifying character to identify a current scrolling position is displayed in the form of speech balloon.
  • the displayed character can be represented by the first letter in the name of an item corresponding to a current scrolling position.
  • reference numeral 650a indicates that an identifying character, indicating that a current scrolling position is placed at an item that begins with the first letter 'A', is represented by the speech balloon shape.
  • FIG. 12 shows a state where the search list is scrolled downward when the scroll bar 630 moves downward.
  • Reference numeral 650b indicates that an identifying character, indicating that a current scrolling position is placed at an item that begins with the first letter 'C', is represented by the speech balloon shape.
  • FIG. 13 shows a screen in which any one item is selected in the search list.
  • any one item 660 can be selected in the search list through touch input. If a detailed menu for the selected item exists, the corresponding detailed menu can be displayed. However, in the case where a default operation corresponding to a selected item has been set, the default operation may be executed immediately. Alternatively, when the touch input is short, a detailed menu may be displayed and, when the touch input is long, a default operation may be executed immediately.
  • FIG. 14 shows a screen 700 on which, when any one item is selected in a search list displaying a telephone directory list is selected, a corresponding detailed menu is displayed.
  • FIG. 14 shows items such as the name of a selected telephone directory list, a mobile phone number, a home telephone number, an e-mail address, and a group. If a telephone number is selected in this detailed menu and 'Call' 450 is then pressed, a call can be made to a corresponding person. In order to select other option items, 'Options' 440 can be selected.
  • FIG. 15 shows a state screen 800 in which a call to the telephone number selected in the detailed menu of FIG. 14 is being requested. If there is a stored image corresponding to the telephone number of a person who has requested the call, the stored image can be displayed along with the person's telephone number. Alternatively, a keypad for entering numerals, texts, etc., may be displayed by selecting a menu item 'keypad' 810.
  • the present invention can be implemented as a code readable by a processor in a recording medium readable by a processor included in a mobile terminal such as a mobile station modem (MSM).
  • the processor-readable recording medium can include all kinds of recording devices in which data readable by the processor is stored.
  • the processor-readable recording medium can include ROM, RAM, CD-ROM, magnetic tapes, floppy disks, optical data storages, and so on, and can also be implemented in the form of carrier waves, such as transmission over the Internet.
  • the processor-readable recording medium can be distributed into computer systems connected over a network, so codes readable by a processor can be stored and executed in a distributed manner.
  • the mobile terminal and the method of controlling the operation of the same in accordance with the present invention are not limited to the constructions and methods described in connection with the above embodiments, but the embodiments may be selectively combined and configured partially or entirely so that they can be modified in various manners.
  • vibration signals in the event of message transmission, search for a telephone number or a file and so on, different vibration signals can be output according to entered characters. Further, a vibration signal of a specific default pattern can be output in response to a change in the scroll speed or the degree of scrolling. Accordingly, a user can notice an entered character, a scroll speed and so on through a tactile sense even without depending on the sense of sight and therefore can be provided with user convenience.
  • an identifying character to identify a current scrolling position can be displayed in the form of speech balloon or the like. Accordingly, a user can know a current scrolling position conveniently. Consequently, rapid search is enabled and search convenience can be provided.
  • the present invention can be applied to a user interface of various environments.

Abstract

The present invention relates to a mobile terminal and a method of controlling an operation of the same. The method of controlling an operation of a mobile terminal includes displaying a file list and scroll arrows for scrolling the file list on a touch screen. When the scroll arrow is touched and entered, the file list is scrolled at a scroll speed previously set in response to a time when the scroll arrow is touched and entered. A vibration signal to identify at least one of a scroll speed and a current scrolling position of the file list is output. Accordingly, when a file list, etc. is scrolled, a scroll speed or a current scrolling position can be easily identified by a tactile sense.

Description

    CROSS-REFERENCE TO RELATED APPLICATION
  • This application claims the priority benefit of Korean Patent Application No. 10-2007-0097896, filed on September 28, 2007 and No. 10-2007-0094836, filed on September 18, 2007 in the Korean Intellectual Property Office, the disclosure of which is incorporated herein by reference.
  • BACKGROUND OF THE INVENTION 1. Field of the Invention
  • The present invention relates to a mobile terminal in which a signal can be output or an identifying character can be displayed such that characters, a screen scroll speed, a current scrolling position and so on can be identified, and a method of controlling an operation of the mobile terminal.
  • 2. Description of the Related Art
  • A mobile terminal is a portable device equipped with one or more of functions for performing voice and video communications while being carried with, inputting and outputting information, storing data and so on. In line with the diversity of the functions, the mobile terminal has become equipped with complicated functions, such as capturing of photos or motion images, the play of music files or motion image files, gaming, reception of broadcasting, and wireless Internet, and therefore has been implemented in the form of a comprehensive multimedia player.
  • In order to implement the complicated functions, a variety of attempts have been made to mobile terminals, implemented in the multimedia player form, in terms of hardware or software. For example, one of the attempts can include a user interface environment in which a user can search or select functions easily and conveniently. Further, as the mobile terminal has been considered as one of personal belongings for expressing a user's personality, there is a need for a change in the designs of various forms.
  • However, a mobile terminal provides the function of outputting a key tone, etc. according to a pressed key when characters are input, but does not provide a function of distinguishing characters input by a tactile sense. In other words, a typical mobile terminal does provide the function of outputting a key tone or a vibration signal having a specific pattern according to a specific key pressed, but does not provide a function of distinguishing characters, such as input Korean consonants and vowels, the English alphabet, and numerals.
  • Further, the mobile terminal does provide the function of varying high-speed scrolling, the scroll speed, etc. when a file list and so on is scrolled, but does not provide a function of knowing a change in the scroll speed, a current scrolling position or the like.
  • When characters are input or a file list, etc. is scrolled, a user can know the input characters, the scroll speed and the like only visually. Accordingly, there is a limit in the configuration of a user interface available in various use environments.
  • SUMMARY OF THE INVENTION
  • It is, therefore, an object of the present invention to provide a mobile terminal in which a vibration signal, enabling input characters, a change in a screen scroll speed or a current scrolling position to be identified through a tactile sense, is output, and a method of controlling an operation of the same.
  • Another object of the present invention is to provide a mobile terminal in which an identifying character to easily identify a current scrolling position when a search list, etc. are scrolled is displayed, and a method of controlling an operation of the same.
  • In accordance with an embodiment of the present invention, there is provided a method of controlling an operation of a mobile terminal, including the steps of displaying a character input window in which characters can be entered by touch input on a touch screen, and when characters are entered by touch input through the character input window, outputting different vibration signals according to the entered characters.
  • In accordance with another embodiment of the present invention, there is provided a method of controlling an operation of a mobile terminal, including the steps of displaying a file list and scroll arrows for scrolling the file list on a touch screen, when the scroll arrow is touched and entered, scrolling the file list at a scroll speed previously set in response to a time when the scroll arrow is touched and entered, and outputting a vibration signal to identify at least one of a scroll speed and a current scrolling position of the file list.
  • In accordance with further another embodiment of the present invention, there is provided a method of controlling an operation of a mobile terminal, including the steps of displaying a search list and a scroll bar for scrolling the search list, and scrolling the search list in response to a moving direction of the scroll bar and displaying an identifying character for enabling a current scrolling position to be identified in the search list.
  • In accordance with an embodiment of the present invention, there is provided a mobile terminal, including a touch screen displaying a character input window in which characters can be entered through touch input, an alarm unit outputting vibration signals, and a controller for, when characters are entered by touch input through the character input window, controlling the alarm unit to output different vibration signals according to the entered characters.
  • In accordance with still embodiment of the present invention, there is provided a mobile terminal, including a touch screen on which a file list and scroll arrows for scrolling the file list are displayed, an alarm unit outputting vibration signals, and a controller for, when the scroll arrow is touched and entered, controlling the file list to be scrolled at a scroll speed previously set in response to a time when the scroll arrow is touched and entered and controlling the alarm unit to output a vibration signal to identify at least one of a scroll speed and a current scrolling position of the file list.
  • In accordance with still embodiment of the present invention, there is provided a mobile terminal, including a display unit on which a search list and a scroll bar for scrolling the search list are displayed, and a controller for scrolling the search list in response to a moving direction of the scroll bar and controlling an identifying character to be displayed such that a current scrolling position can be identified in the search list.
  • Furthermore, the present invention provides a computer-readable recording medium in which a program for executing the above method in a computer is recorded.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The present invention will become more fully understood from the detailed description given herein below and the accompanying drawings, which are given by illustration only, and thus are not limitative of the present invention, and wherein:
    • FIG. 1 is a block diagram of a mobile terminal in accordance with an embodiment of the present invention;
    • FIG. 2 is a front perspective view of the mobile terminal in accordance with an embodiment of the present invention;
    • FIG. 3 is a rear perspective view of the mobile terminal in accordance with an embodiment of the present invention;
    • FIG. 4 is a flowchart illustrating a method of controlling an operation of the mobile terminal in accordance with a first embodiment of the present invention;
    • FIG. 5 is a flowchart illustrating a method of controlling an operation of the mobile terminal in accordance with a second embodiment of the present invention;
    • FIGS. 6A and 6B are flowcharts illustrating a method of controlling an operation of the mobile terminal in accordance with a third embodiment of the present invention;
    • FIGS. 7 to 9 are diagrams to which reference is made in order to describe the method of controlling the operation of the mobile terminal in accordance with a first embodiment of the present invention along with screens displayed on the display unit;
    • FIG. 10 is a diagram to which reference is made in order to describe the method of controlling the operation of the mobile terminal in accordance with a second embodiment of the present invention along with a screen displayed on the display unit; and
    • FIGS. 11 to 15 are diagrams to which reference is made in order to describe the method of controlling the operation of the mobile terminal in accordance with a third embodiment of the present invention along with screens displayed on the display unit.
    DETAILED DESCRIPTION OF THE INVENTION
  • The present invention will now be described in detail in connection with specific embodiments with reference to the accompanying drawings.
  • It is to be understood that a mobile terminal described in this specification can include mobile phones, smart phones, notebook computers, terminals for digital broadcasting, personal digital assistants (PDAs), portable multimedia players (PMPs), navigation devices for GPS and so on.
  • FIG. 1 is a block diagram of a mobile terminal in accordance with an embodiment of the present invention. The mobile terminal in accordance with an embodiment of the present invention is described below with reference to FIG. 1 from a standpoint of constituent elements according to their functions. It is also to be noted that the suffix of constituent elements used in the following description, such as "module" and "unit", is simply assigned by considering the easiness of writing this specification, but is not specifically assigned by considering the importance and roles. Accordingly, the "module" and "unit" can be mixed in use.
  • Referring to FIG. 1, a mobile terminal 100 can include a wireless communication unit 110, an audio/video (A/V) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, memory 160, an interface unit 170, a controller 180, and a power supply unit 190. When the constituent elements are implemented in actual applications, two or more of the constituent elements can be combined into one constituent element or one constituent element can be divided into two or more constituent elements, if appropriate.
  • The wireless communication unit 110 can include a broadcasting receiving module 111, a mobile communication module 113, a wireless Internet module 115, a short-range communication module 117, a global positioning system (GPS) module 119 and so on.
  • The broadcasting receiving module 111 receives at least one of broadcasting signals and broadcasting-related information from an external broadcasting management server through broadcasting channels. The broadcasting channels can include a satellite channel, a terrestrial wave channel and the like. The broadcasting management server can refer to a server for creating and transmitting at least one of broadcasting signals and broadcasting-related information or a sever for receiving at least one of previously generated broadcasting signals and previously generated broadcasting-related information and transmitting it to a terminal.
  • The broadcasting-related information can refer to information pertinent to a broadcasting channel, a broadcasting program and/or a broadcasting service provider. The broadcasting signal can include not only TV broadcasting signals, radio broadcasting signals, and data broadcasting signals, but also broadcasting signals in which TV broadcasting signals or radio broadcasting signals are combined with data broadcasting signals. The broadcasting-related information can be provided over a mobile communication network. In this case, the broadcasting-related information can be received by the mobile communication module 113. The broadcasting-related information can exist in various forms. For example, the broadcasting-related information can exist in the form of the electronic program guide (EPG) of the digital multimedia broadcasting (DMB), the electronic service guide (ESG) of the digital video broadcast-handheld (DVB-H) or the like.
  • The broadcasting receiving module 111 receives broadcasting signals using various broadcasting systems. In particular, the broadcasting receiving module 111 can receive broadcasting signals using a digital broadcasting system, such as the digital multimedia broadcasting-terrestrial (DMB-T), the digital multimedia broadcasting-satellite (DMB-S), the media forward link only (MediaFLO), the digital video broadcast-handheld (DVB-H), and the integrated services digital broadcast-terrestrial (ISDB-T). The broadcasting receiving module 111 can be constructed to be suitable for not only the digital broadcasting systems, but also all broadcasting systems providing broadcasting signals. At least one of broadcasting signals and/or broadcasting-related information, received through the broadcasting receiving module 111, can be stored in the memory 160.
  • The mobile communication module 113 transmits and receives radio signals to and from at least one of a base station, an external terminal, and a server over a mobile communication network. Here, the radio signals can include voice call signals, video call signals, or various forms of data according to transmission/reception of text/multimedia messages.
  • The wireless Internet module 115 refers to a module for wireless Internet access. The wireless Internet module 115 can be built in the mobile terminal 100 or external to the mobile terminal 100. The short-range communication module 117 refers to a module for local area communication. Local area communication technology can employ Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee or the like. The GPS module 119 receives position information from a plurality of GPS satellites.
  • The A/V input unit 120 is adapted to input audio signals or video signals and can include a camera 121, a microphone 123, and so on. The camera 121 processes image frames, such as still images or motion images, which are captured by an image sensor in the video call mode or the capturing mode. The processed image frames can be displayed on a display unit 151.
  • The image frames processed by the camera 121 can be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. The camera 121 can be provided in plural numbers according to the configuration of a terminal.
  • The microphone 123 receives external sound signals in the call mode, the recording mode, the voice recognition mode, etc. and converts the received sound signals into electrical voice data. In the call mode, the processed voice data can be converted into a format, which can be transmitted to a mobile communication base station through the mobile communication module 113, and then output. The microphone 123 can employ a variety of noise removal algorithms for removing noise occurring in the process of receiving external sound signals.
  • The user input unit 130 generates key entry data, which is input by a user in order to control the operation of the terminal. The user input unit 130 can include the keypad, the dome switch, the touch pad (static pressure/constant electricity), the jog wheel, the jog switch, the finger mouse or the like. In particular, a mutually layered structure of the touch pad and the display unit 151, which will be described later on, can be referred to as a touch screen.
  • The sensing unit 140 senses a current status of the mobile terminal 100, such as a closed state of the mobile terminal 100, the position of the mobile terminal 100, whether a user touches the mobile terminal 100 or not, and so on and generates a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is a slide phone type, the sensing unit 140 can sense whether the slide phone is opened or not. The sensing unit 140 can also have the functions of sensing whether the power supply unit 190 supplies power or not, whether the interface unit 170 is connected to an external device, and so on.
  • The output unit 150 is constructed to output audio signals, video signals or alarm signals and can include the display unit 151, a sound output module 153, an alarm unit 155, and so on.
  • The display unit 151 displays information processed in the mobile terminal 100. For example, when the mobile terminal is in the call mode, the display unit 151 displays a user interface (UI) or a graphic user interface (GUI), which is pertinent to a call. When the mobile terminal 100 is in the video call mode or the capturing mode, the display unit 151 displays captured or received images individually or simultaneously and also displays a UI or a GUI.
  • Meanwhile, in the case in which the display unit 151 and the touch pad form the mutually layered structure and construct a touch screen as described above, the display unit 151 can also be used as an input device as well as the output device. When the display unit 151 consists of a touch screen, it can include a touch screen panel, a touch screen panel controller, and so on. In this case, the touch screen panel is a transparent panel attached to the outside and can be connected to an internal bus within the mobile terminal 100. The touch screen panel continues to monitor whether there is a touch input and, when there is a touch input, sends corresponding signals to the touch screen panel controller. The touch screen panel controller processes the corresponding signals received from the touch screen panel and transmits the corresponding data to the controller 180, so that the controller 180 can understand whether there has been a touch input or which area of the touch screen has been touched.
  • The display unit 151 can include at least one of a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, and a 3D display. Two or more display units 151 may exist according to the implementation type of the mobile terminal 100. For example, the mobile terminal 100 may be equipped with both an external display unit (not shown) and an internal display unit (not shown).
  • The sound output module 153 outputs audio data, which is received from the wireless communication unit 110 in the incoming call mode, the call mode, the record mode, the voice recognition mode, the incoming broadcasting mode or the like or stored in the memory 160. The sound output module 153 also outputs sound signals pertinent to the functions performed in the mobile terminal 100, for example, sound of a received call signal and sound of a received message. The sound output module 153 can include a speaker, a buzzer or the like.
  • The alarm unit 155 outputs signals to inform the occurrence of events in the mobile terminal 100. For example, events occurring in the mobile terminal 100 can include an incoming call signal, a received message, an entered key signal input and so on. The alarm unit 155 can also output signals to inform the occurrence of events in different ways other than the audio or video signals. For example, the alarm unit 155 can output the signals in vibration form. When a call signal is received or a message is received, the alarm unit 155 can generate a vibration signal in order to inform the reception of the call signal or message. Alternatively, when a key signal is input, the alarm unit 155 can generate a vibration signal as a feedback to the input key signal. A user can notice the occurrence of an event through the output of the vibration signal. It is to be understood that the signals to inform the occurrence of events can also be output through the display unit 151 or the sound output module 153.
  • The memory 160 can store programs necessary to process and control the controller 180 and also function to temporarily store input or output data (for example, a phonebook, messages, still images, motion images and the like).
  • The memory 160 can include at least one type of storage media, including a flash memory type, a hard disk type, a multimedia card micro type, card type memory (for example, SD memory, XD memory, and so on), RAM, and ROM. The mobile terminal 100 can also manage a web storage serving as the storage function of the memory 160 on an Internet.
  • The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. Examples of the external devices connected to the mobile terminal 100 can include a wired/wireless headset, an external charger, wired/wireless data ports, a memory card, a card socket such as subscriber identification module (SIM) /user identity module (UIM) cards, an audio input/output (I/O) terminal, a video I/O terminal, an earphone, and so on. The interface unit 170 can receive data or can be supplied with power from the external devices, transfer the data or power to respective constituent elements of the mobile terminal 100, and transmit data of the mobile terminal 100 to the external devices.
  • The controller 180 typically controls an operation of each of the elements and controls an overall operation of the mobile terminal 100. For example, the controller 180 can perform pertinent controls and processes for voice call, data communication, video telephony, and so on. The controller 180 can include a multimedia play module 181 for playing multimedia. The multimedia play module 181 can be constructed in hardware within the controller 180 or constructed in software separately from the controller 180.
  • The power supply unit 190 is supplied with external power source or internal power source and supplies power source necessary for the operation of the each constituent element under the control of the controller 180.
  • The mobile terminal pertinent to the present invention has been described so far from a viewpoint of the constituent elements according to its functions. Hereinafter, the mobile terminal related to the present invention is further described from a viewpoint of the constituent elements according to its external shape with reference to FIGS. 2 and 3. Of several types of mobile terminals, such as a folding type, a bar type, a swing type, and a sliding type, the bar type mobile terminal equipped with a full touch screen is described below as an example, for convenience of description. However, it is to be understood that the present invention is not limited to the bar type mobile terminal, but instead may be applied to all types of mobile terminals, including the above types.
  • FIG. 2 is a front perspective view of the mobile terminal in accordance with an embodiment of the present invention. Referring to FIG. 2, a casing constituting an external shape of the mobile terminal 100 is comprised of a front casing 100A-1 and a rear casing 100A-2. A variety of electronic components are built in the space formed by the front casing 100A-1 and the rear casing 100A-2. At least one middle casing can be further disposed between the front casing 100A-1 and the rear casing 100A-2. The casings can be formed by injecting synthetic resin or can be formed from metal such as stainless steel (STS) or titanium (Ti).
  • In a main body, more particularly, in the front casing 100A-1 are disposed the display module 151, a first sound output module 153a, a first camera 121a, and a first user input unit 130a. Further, a second user input unit 130b, a third user input unit 130c, and a microphone 123 can be disposed on the sides of the rear casing 100A-2.
  • The display unit 151 includes a LCD, an OLED or the like for visually displaying information. A touch pad can be overlapped with the display unit 151 in the layered structure, so the display unit 151 can operate as a touch screen in order to enable the input of information by the touch of a user.
  • The first sound output module 153a can be implemented in the form of a receiver or speaker. The first camera 121 a can be implemented to capture images or motion images of a user, and so on. Further, the microphone 123 can be implemented properly in such a way as to receive a user's voice, other sound and so on.
  • The first to third user input units 130a, 130b, and 130c can be collectively called the user input unit 130. The user input unit 130 can adopt any kind of a method as long as it supports a tactile manner.
  • For example, the user input unit 130 can be implemented using a dome switch or a touch pad, which is able to receive commands or information by push or touch manipulation of a user, or can be implemented using a wheel or jog method for rotating the key, or a method employing Joystick. In terms of the function, the first user input unit 130a is adapted to input commands such as the start, the end, and call. The second user input unit 130b can be used as a mode setting key for entering an operating mode, etc. The third user input unit 130c can operate as a hot key for activating special functions within the mobile terminal 100.
  • FIG. 3 is a rear perspective view of the mobile terminal shown in FIG. 2. Referring to FIG. 3, a fourth user input unit 130d, a fifth user input unit 130e, and the interface unit 170 can be disposed on the side of the rear casing 100A-2. A second camera 121b can be further mounted on the rear side of the rear casing 100A-2.
  • The second camera 121b has a photographing direction substantially opposite to that of the first camera 121a and can have different pixels from that of the first camera 121a. For example, the first camera 121a can have low pixels sufficiently enough to capture an image of a user face and transmit the captured image to a counterpart in the video call or the like. The second camera 121b captures general subjects and can have high pixels because a photographed subject is not transmitted immediately.
  • A sixth user input unit 130f can be installed around the second camera 121b. The sixth user input unit 130f can employ a jog wheel enabling the rotation input or the like.
  • A flash 125 and a mirror 126 can be further disposed adjacent to the second camera 121b. The flash 125 illuminates light to a subject when the subject is photographed by the second camera 121b. The mirror 126 reflects a user's face, etc. when the user wants to have his picture taken (self-photographing) using the second camera 121b.
  • A second sound output module (not shown) can be further disposed in the second rear casing 100A-2. The second sound output module can implement a stereo function together with the first sound output module 153a and can also be used for a call in a speakerphone mode.
  • An antenna (not shown) for receiving broadcasting signals, other than an antenna for a call, etc., can be disposed on one side of the second rear casing 100A-2. The antenna can be drawn out from the second rear casing 100A-2.
  • The interface unit 170 becomes a passage, enabling the mobile terminal 100 to exchange data, etc. with external devices. For example, the interface unit 170 can be at least one of a connector for connecting to an earphone, a port for near area communication, and power supply terminals for supplying power to the mobile terminal 100 in a wired or wireless manner. The interface unit 170 can be a card socket for receiving external cards, such as a SIM, a UIM and a memory card for storing information.
  • The power supply unit 190 for supplying power to the mobile terminal is mounted on the part of the rear casing 100A-2. The power supply unit 190 can be, for example, a rechargeable battery and can be detachably coupled to the rear casing 100A-2 for charging purpose, and so on.
  • It has been described above that the second camera 121 b and the like are disposed in the rear casing 100A-2, but the present invention is not limited to the above arrangement. Although the second camera 121 b is not separately included, the first camera 121 a can be rotatably formed so as to cover even the photographing direction of the second camera 121b.
  • FIG. 4 is a flowchart illustrating a method of controlling an operation of the mobile terminal in accordance with a first embodiment of the present invention. Referring to FIG. 4, the controller 180 controls a character input window in which characters, such as the Korean alphabet, the alphabet, Chinese characters, numerals, and a punctuation mark, can be input through touch input to be displayed on the display unit 151 consisting of a touch screen in response to a menu selected by a user, such as message transmission and search for a telephone number or a file, (S200). The controller 180 determines whether specific characters have been input by the touch input through the character input window (S205).
  • If, as a result of the determination, characters have been input through the character input window, the controller 180 controls different default vibration signals to be output in response to the input characters (S210). That is, the controller 180 controls the alarm unit 155 to output different vibration signals according to the input characters through the character input window.
  • Accordingly, a user can identify the input characters based on the output vibration signals. Here, a user can set the vibration signals, which are output according to the input characters, according to desired output patterns. In response to a driven menu, the controller 180 may control a character input through the character input window to be displayed in a specific area of the display unit 151 along with the output of a vibration signal.
  • The output of a vibration signal according to an input character is repeatedly performed until another operation menu displayed on the display unit 151 is selected. If it is determined that another operation menu item displayed on the display unit 151 has been selected (S215), the controller 180 controls an operation, corresponding to a selected operation menu, to be executed (S220).
  • Through the above process, different vibration signals are output according to input characters. Accordingly, a user can understand which character has been input based on an output vibration signal even through a tactile sense.
  • FIG. 5 is a flowchart illustrating a method of controlling an operation of the mobile terminal in accordance with a second embodiment of the present invention. Referring to FIG. 5, when a menu for searching a playable multimedia file, etc. is selected by a user, the controller 180 controls a file list in which file names, etc. are listed, and a scroll arrow for scrolling a file list to be displayed on the display unit 151 consisting of a touch screen (S250).
  • Here, the scroll arrow is displayed when all pieces of information within a screen displayed on the display unit 151 cannot be displayed or the like. When an up scroll arrow is touched, the controller 180 controls a list, etc., which is displayed on the screen, to be scrolled upwardly. When a down scroll arrow is touched, the controller 180 controls a list, etc., which is displayed on the screen, to be scrolled downwardly. Alternatively, the controller 180 may control a list, etc., which is displayed on the screen, to be scrolled to the left or right according to the shape of a file list, etc., which is displayed on the display unit 151 or the touch of the scroll arrow. Further, the above configuration can be applied identically when a scroll bar is used instead of the scroll arrow.
  • After the file list and the scroll arrow are displayed, the controller 180 determines whether the scroll arrow displayed on the display unit 150 has been touched and entered (S255). If, as a result of the determination, there is touch through the scroll arrow, the controller 180 controls the file list to be scrolled at a default scroll speed according to the time when the scroll arrow is touched and entered (S260). In other words, when there is a first touch through the scroll arrow, the controller 180 controls the file list to be scrolled at a basic speed. When the touch of the scroll arrow continues, the controller 180 controls the file list to be scrolled at a faster scroll speed step by step.
  • In the case in which the scroll bar is used, after the scroll bar is touched, a file list may be scrolled in response to a direction where the scroll bar is dragged. When the touch of the scroll bar continues, the file list may be scrolled at a faster scroll speed step by step.
  • If the scroll speed changes, the controller 180 controls a vibration signal to be output along with the scrolling of the file list (S265). That is, whenever the scroll speed changes, the controller 180 can control vibration signals of different patterns to be output. Alternatively, the controller 180 may control a vibration signal to be output such that a current scrolling position can be identified as well as the scroll speed according to use environment. For example, in the case in which scrolling of one page or a certain range is performed, the controller 180 may control a vibration signal to be output or in the case in which an initial letter of a file name in a file list, etc. changes, the controller 180 may control a vibration signal to be output. The scrolling of the file list and the output of the vibration signal are displayed repeatedly until the touch through the scroll arrow is finished (S270).
  • If it is determined that another operation menu item displayed on the display unit 151 other than the scroll arrow has been selected (S275), the controller 180 controls an operation, corresponding to the selected operation menu, to be executed (S280). The operation corresponding to the selected operation menu can include an operation for selecting and playing any one item in a file list, an operation for switching a menu for voice call, mail transmission, etc. and so on.
  • In the case in which a file list is scrolled through the above process, vibration signals can be output such that a change in the scroll speed, a current scrolling position, the degree of a scrolling progress and so on can be identified. Further, in the case in which the display unit 151 does not consist of a touch screen, a scroll arrow may be selected according to the entry of a key, which is defined to execute a scroll function, such that the same operation as that of the above embodiment is executed.
  • Moreover, although, in the above embodiment, a file list has been described as an example, the present invention is not necessarily limited to the case where the file list is scrolled, but can be applied to cases where other screen scrolling is necessary.
  • FIGS. 6A and 6B are flowcharts illustrating a method of controlling an operation of the mobile terminal in accordance with a third embodiment of the present invention. Referring to FIG. 6A, when a user selects a menu for searching a telephone number, a file or the like (S300), the controller 180 controls a search list in which a telephone number list, file names and so on are listed and a scroll bar for scrolling the search list to be displayed on the display unit 151 (S305).
  • The scroll bar indicates where is the information of a current screen located in the entire screen when all pieces of information cannot be displayed within a screen displayed on the display unit 151. The controller 180 also controls the contents of information, which is displayed on a screen, to be scrolled upward/downward or left/right as the scroll bar moves.
  • After the search list and the scroll bar are displayed, the controller 180 determines whether the scroll bar displayed on the display unit 150 has moved (S310). In the case in which the display unit 151 consists of a touch screen, the scroll bar can be moved in such a manner that the scroll bar is touched and dragged. Alternatively, the scroll bar may be moved using a Jog wheel key or a key defined to execute other scroll function.
  • If, as a result of the determination in step S310, the scroll bar has been moved according to the above method, the controller 180 controls the search list to be scrolled in response to a moving direction of the scroll bar (S315). In other words, when a moving direction of the scroll bar is downward, the controller 180 controls the search list to be scrolled downwardly and, when a moving direction of the scroll bar is upward, the controller 180 controls the search list to be scrolled upwardly. Alternatively, the controller 180 may control the search list to be scrolled to the left or right according to the form of a search list displayed on the display unit 151.
  • The controller 180 controls an identifying character for identifying a current scrolling position to be displayed in the form of speech balloon along with the scrolling of the search list (S320). The speech balloon is meant that speaking of persons in a cartoon, etc. is surrounded by a balloon shape and expressed. In the present embodiment, the speech balloon is used as a meaning to include the tooltip, which pops up when the mouse cursor in a web page, etc. is taken.
  • In addition, the identifying character, which is able to indicate a current scrolling position, can be indicated by the first letter in the name of an item corresponding to the current scrolling position. The first letter refers to the first letter in a word or sentence. However, when it is not necessarily necessary to indicate the identifying character as the first letter, an adequate character can be used according to use environment.
  • This scrolling of the search list and the identifying character of the speech balloon shape are executed repeatedly until the movement of the scroll bar is finished (S325).
  • If it is determined that any one item has been selected in the search list (S330), the controller 180 controls a detailed menu for the selected item to be displayed (S345). The controller 180 then controls an operation, which is selected in the detailed menu, to be executed (S350). Alternatively, the controller 180 may control a default operation, which corresponds to a selected item, to be immediately executed without displaying a detailed menu according to use environment.
  • If it is determined that another operation menu item displayed on the display unit 151 other than the search list has been selected (S335), the controller 180 controls an operation, corresponding to the selected operation menu, to be executed (S340).
  • In the case in which a search list is scrolled through the above process, a current scrolling position can be displayed in such a way as to be easily identified, and an operation necessary for an item selected in the search list may be executed. Further, although, in the above embodiment, a search list has been described as an example, the present invention is not necessarily limited to the case where the search list is scrolled, but can be applied to cases where other screen scrolling is necessary.
  • FIGS. 7 to 9 are diagrams to which reference is made in order to describe the method of controlling the operation of the mobile terminal in accordance with a first embodiment of the present invention along with screens displayed on the display unit.
  • FIGS. 7 to 9 show examples of a search screen 400, which can be used to search files, telephone numbers and so on by inputting characters by touch. Indicator icons are displayed at the top of the search screen 400. A display window 440 and a character input window 430 are displayed under the indicator icons. A letter entered through the character input window 430 is displayed on the display window 440. A window 420 for selecting and entering the Korean alphabet, the English capital and small letters, numerals and so on is displayed under the character input window 430. Menu items, such as icons 410 for selecting other menus, Search 415 for executing search, and Mode 420 for selecting a mode, are displayed under the window 420.
  • In this search screen 400, FIG. 7 shows a state where a '┐' key 431 displayed on the character input window 430 is touched and a letter '┐' is entered, and FIG. 8 shows a state where a '└' key 433 displayed on the character input window 430 is touched and a letter '┐' is entered. FIG. 9 shows a state where a '└' key 435 and a 'Add dot' key 437 are consecutively selected and '
    Figure imgb0001
    ' is consequently entered.
  • In this case, different vibration signals are output according to the entered Korean alphabet consonants '┐', '└', and '
    Figure imgb0002
    '. That is, when the respective keys displayed on the character input window 430 are touched and entered, different vibration signals are output. When a stroke is added or even when dual consonants, etc. are entered, different vibration signals are output. Accordingly, a user can notice which letter has been entered by a sense of vibration even with a tactile sense.
  • FIG. 10 is a diagram to which reference is made in order to describe the method of controlling the operation of the mobile terminal in accordance with a second embodiment of the present invention along with a screen displayed on the display unit. FIG. 10 shows an example of a play screen 500 of a multimedia file. A first window 510 on which a play state or pertinent information of a multimedia file, which is being played, is displayed is displayed on an upper portion of the play screen 500. A second window 520 on which a file list and scroll arrows 530 and 540 are displayed is displayed on a lower portion of the play screen 500.
  • In this play screen 500, when the upper scroll arrow 530 displayed on the second window 520 is touched, a file list is scrolled upward. When the lower scroll arrow 540 displayed on the second window 520 is touched, a file list is scrolled downward.
  • When the scroll arrows 530 and 540 are first touched, a file list is scrolled at a basic speed and, when the touch of the scroll arrows 530 and 540 continues, the scroll speed increases step by step. In this case, vibration signals of different patterns can be output whenever the scroll speed changes. Further, even when a specific range such as one page is scrolled, when a specific list is scrolled or the like, a vibration signal can be output.
  • Accordingly, a user can notice a change in the scroll speed, the degree of scrolling progress, a current scrolling position and so on through a tactile sense.
  • FIGS. 11 to 15 are diagrams to which reference is made in order to describe the method of controlling the operation of the mobile terminal in accordance with a third embodiment of the present invention along with screens displayed on the display unit.
  • First, FIG. 11 shows a search screen 600 on which a search list and a scroll bar are displayed. Indicator icons are displayed at the top of the search screen 600. An icon 625, indicating the search screen, is displayed under the indicator icons. Menu items, such as an icon 610 for selecting other menus, a menu 615 showing the contents of a selected file, and an icon 620 for moving to a previous menu, are displayed at the bottom of the search screen 600.
  • A search list 640, such as a telephone directory list and files, is displayed on the search screen 600. FIG. 11 shows that a telephone directory list is displayed. A vertical scroll bar 630 for scrolling items, which are displayed as a search list, downwardly is displayed on the left side of the search list 640. Scroll arrows may be displayed on upper or lower sides of the scroll bar according to use environment.
  • In this state, if the scroll bar 630 is moved by a method of touching & dragging the scroll bar, etc., an identifying character to identify a current scrolling position is displayed in the form of speech balloon. Here, the displayed character can be represented by the first letter in the name of an item corresponding to a current scrolling position. In FIG. 11, reference numeral 650a indicates that an identifying character, indicating that a current scrolling position is placed at an item that begins with the first letter 'A', is represented by the speech balloon shape.
  • FIG. 12 shows a state where the search list is scrolled downward when the scroll bar 630 moves downward. Reference numeral 650b indicates that an identifying character, indicating that a current scrolling position is placed at an item that begins with the first letter 'C', is represented by the speech balloon shape.
  • FIG. 13 shows a screen in which any one item is selected in the search list. As shown in FIG. 13, any one item 660 can be selected in the search list through touch input. If a detailed menu for the selected item exists, the corresponding detailed menu can be displayed. However, in the case where a default operation corresponding to a selected item has been set, the default operation may be executed immediately. Alternatively, when the touch input is short, a detailed menu may be displayed and, when the touch input is long, a default operation may be executed immediately.
  • FIG. 14 shows a screen 700 on which, when any one item is selected in a search list displaying a telephone directory list is selected, a corresponding detailed menu is displayed. FIG. 14 shows items such as the name of a selected telephone directory list, a mobile phone number, a home telephone number, an e-mail address, and a group. If a telephone number is selected in this detailed menu and 'Call' 450 is then pressed, a call can be made to a corresponding person. In order to select other option items, 'Options' 440 can be selected.
  • FIG. 15 shows a state screen 800 in which a call to the telephone number selected in the detailed menu of FIG. 14 is being requested. If there is a stored image corresponding to the telephone number of a person who has requested the call, the stored image can be displayed along with the person's telephone number. Alternatively, a keypad for entering numerals, texts, etc., may be displayed by selecting a menu item 'keypad' 810.
  • Meanwhile, the present invention can be implemented as a code readable by a processor in a recording medium readable by a processor included in a mobile terminal such as a mobile station modem (MSM). The processor-readable recording medium can include all kinds of recording devices in which data readable by the processor is stored. For example, the processor-readable recording medium can include ROM, RAM, CD-ROM, magnetic tapes, floppy disks, optical data storages, and so on, and can also be implemented in the form of carrier waves, such as transmission over the Internet. Further, the processor-readable recording medium can be distributed into computer systems connected over a network, so codes readable by a processor can be stored and executed in a distributed manner.
  • Further, the mobile terminal and the method of controlling the operation of the same in accordance with the present invention are not limited to the constructions and methods described in connection with the above embodiments, but the embodiments may be selectively combined and configured partially or entirely so that they can be modified in various manners.
  • In accordance with the present invention, in the event of message transmission, search for a telephone number or a file and so on, different vibration signals can be output according to entered characters. Further, a vibration signal of a specific default pattern can be output in response to a change in the scroll speed or the degree of scrolling. Accordingly, a user can notice an entered character, a scroll speed and so on through a tactile sense even without depending on the sense of sight and therefore can be provided with user convenience.
  • Further, in accordance with the present invention, in the case where a list for searching a telephone number list, a file list or the like is scrolled, an identifying character to identify a current scrolling position can be displayed in the form of speech balloon or the like. Accordingly, a user can know a current scrolling position conveniently. Consequently, rapid search is enabled and search convenience can be provided. In addition, the present invention can be applied to a user interface of various environments.
  • While the invention has been shown and described with respect to the specific embodiments, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention as defined in the following claims.

Claims (15)

  1. A method of controlling an operation of a mobile terminal equipped with a touch screen, the method comprising:
    displaying a character input window in which characters can be entered by touch input on the touch screen; and
    when characters are entered by touch input through the character input window, outputting different vibration signals according to the entered characters.
  2. The method of claim 1, further comprising:
    displaying the characters entered through the character input window on one area of the touch screen.
  3. The method of claim 1 or 2, wherein the character input window comprises at least one of a keypad input window, a handwriting recognition input window, a continuous handwriting input window, and a QWERTY input window.
  4. The method of any one preceding claim, further comprising:
    setting the different vibration signals, respectively.
  5. A method of controlling an operation of a mobile terminal equipped with a touch screen, the method comprising:
    displaying a file list and scroll arrows for scrolling the file list on the touch screen; when the scroll arrow is touched, scrolling the file list at a scroll speed corresponding to a time when the scroll arrow is touched and entered; and
    outputting a vibration signal to identify at least one of a scroll speed and a current scrolling position of the file list.
  6. The method of claim 5, wherein the file list includes a list for searching any one of playable multimedia files.
  7. The method of claim 5 or 6, further comprising:
    displaying specific operation menu items on the touch screen and executing an operation corresponding to an operation menu item selected by touch input, of the specific operation menu items.
  8. The method of any one of claims 5 to 7, further comprising:
    setting an output pattern of the vibration signal based on a user command.
  9. A method of controlling an operation of a mobile terminal, the method comprising:
    displaying a search list and a scroll bar for scrolling the search list; and
    scrolling the search list in response to a moving direction of the scroll bar and displaying an identifying character for enabling a current scrolling position to be identified in the search list.
  10. The method of claim 9, wherein the identifying character is displayed in a speech balloon form and/or
    includes a first letter in a name of an item corresponding to the current scrolling position and/or
    is displayed in an area adjacent to the scroll bar.
  11. The method of claim 9 or 10, wherein the search list and the scroll bar are displayed on a touch screen,
    and wherein the scroll bar is preferably moved in a direction where the scroll bar is touched and dragged.
  12. The method of claim 11, further comprising the step of displaying specific operation menu items on the touch screen and executing an operation corresponding to an operation menu item selected by touch input, of the specific operation menu items.
  13. The method of any one of claims 9 to 12, wherein the search list includes a list for searching any one of a telephone directory and files.
  14. The method of any one of claims 9 to 13, further comprising at least one of:
    when any one item is selected in the search list, displaying a detailed operation menu of the selected item; and
    when any one item is selected in the search list, executing an operation previously set with respect to the selected item.
  15. A mobile terminal comprising means configured to carry out the method of any one preceding claim.
EP08016452.8A 2007-09-18 2008-09-18 Mobile terminal and method of controlling operation of the same Active EP2040146B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020070094836A KR101414766B1 (en) 2007-09-18 2007-09-18 Mobile terminal and operation control method thereof
KR1020070097896A KR101418510B1 (en) 2007-09-28 2007-09-28 Mobile terminal and operation control method thereof

Publications (3)

Publication Number Publication Date
EP2040146A2 true EP2040146A2 (en) 2009-03-25
EP2040146A3 EP2040146A3 (en) 2013-07-03
EP2040146B1 EP2040146B1 (en) 2020-12-09

Family

ID=40125930

Family Applications (1)

Application Number Title Priority Date Filing Date
EP08016452.8A Active EP2040146B1 (en) 2007-09-18 2008-09-18 Mobile terminal and method of controlling operation of the same

Country Status (3)

Country Link
US (3) US8509854B2 (en)
EP (1) EP2040146B1 (en)
CN (1) CN102749997B (en)

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2911047A1 (en) * 2014-02-17 2015-08-26 Samsung Electronics Co., Ltd Method and apparatus for displaying information and electronic device adapted to the method
JP2015222570A (en) * 2010-11-12 2015-12-10 アップル インコーポレイテッド Device, method, and graphical user interface for navigating list of identifiers
EP2535799A3 (en) * 2011-06-13 2017-07-26 Samsung Electronics Co., Ltd. Apparatus and method for scrolling in device with touch screen
GB2548451A (en) * 2016-03-17 2017-09-20 Google Inc Method and apparatus to provide haptic feedback for computing devices
US9804759B2 (en) 2012-05-09 2017-10-31 Apple Inc. Context-specific user interfaces
US9916075B2 (en) 2015-06-05 2018-03-13 Apple Inc. Formatting content for a reduced-size user interface
US10055121B2 (en) 2015-03-07 2018-08-21 Apple Inc. Activity based thresholds and feedbacks
US10254948B2 (en) 2014-09-02 2019-04-09 Apple Inc. Reduced-size user interfaces for dynamically updated application overviews
US10272294B2 (en) 2016-06-11 2019-04-30 Apple Inc. Activity and workout updates
US10452253B2 (en) 2014-08-15 2019-10-22 Apple Inc. Weather user interface
US10606458B2 (en) 2012-05-09 2020-03-31 Apple Inc. Clock face generation based on contact on an affordance in a clock face selection mode
US10613743B2 (en) 2012-05-09 2020-04-07 Apple Inc. User interface for receiving user input
US10771606B2 (en) 2014-09-02 2020-09-08 Apple Inc. Phone user interface
CN111787175A (en) * 2019-06-18 2020-10-16 京瓷办公信息系统株式会社 Information processing apparatus
US10872318B2 (en) 2014-06-27 2020-12-22 Apple Inc. Reduced size user interface
US10990270B2 (en) 2012-05-09 2021-04-27 Apple Inc. Context-specific user interfaces
US11029838B2 (en) 2006-09-06 2021-06-08 Apple Inc. Touch screen device, method, and graphical user interface for customizing display of content category icons
US11467722B2 (en) 2007-01-07 2022-10-11 Apple Inc. Portable electronic device, method, and graphical user interface for displaying electronic documents and lists
US11604571B2 (en) 2014-07-21 2023-03-14 Apple Inc. Remote user interface
US11714536B2 (en) 2021-05-21 2023-08-01 Apple Inc. Avatar sticker editor user interfaces
US11921998B2 (en) 2020-05-11 2024-03-05 Apple Inc. Editing features of an avatar
US11972103B2 (en) 2022-10-07 2024-04-30 Apple Inc. Portable electronic device, method, and graphical user interface for displaying electronic documents and lists

Families Citing this family (102)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7958456B2 (en) 2005-12-23 2011-06-07 Apple Inc. Scrolling list with floating adjacent index symbols
CN102749997B (en) 2007-09-18 2016-06-22 微软技术许可有限责任公司 The method of the operation of mobile terminal and this mobile terminal of control
US8405621B2 (en) * 2008-01-06 2013-03-26 Apple Inc. Variable rate media playback methods for electronic devices with touch interfaces
KR101476182B1 (en) * 2008-01-09 2014-12-30 엘지전자 주식회사 Terminal and method for controlling the same
KR101474426B1 (en) * 2008-01-22 2014-12-19 엘지전자 주식회사 Mobile terminal and its method for controlling of vibrator
US20100058173A1 (en) * 2008-08-28 2010-03-04 Kabushiki Kaisha Toshiba Display processing apparatus, display processing method, and computer program product
US8456420B2 (en) * 2008-12-31 2013-06-04 Intel Corporation Audible list traversal
KR20100079502A (en) * 2008-12-31 2010-07-08 삼성전자주식회사 Method and device for performing scrolling in wireless terminal
US8839155B2 (en) * 2009-03-16 2014-09-16 Apple Inc. Accelerated scrolling for a multifunction device
US8984431B2 (en) 2009-03-16 2015-03-17 Apple Inc. Device, method, and graphical user interface for moving a current position in content at a variable scrubbing rate
WO2010123485A2 (en) * 2009-04-20 2010-10-28 Hewlett-Packard Development Company, L.P. Entering information into a communications device
US9658760B2 (en) * 2009-05-07 2017-05-23 Creative Technology Ltd. Methods for searching digital files on a user interface
KR101646922B1 (en) 2009-05-19 2016-08-23 삼성전자 주식회사 Operation Method of associated with a communication function And Portable Device supporting the same
CN102803981B (en) 2009-06-19 2016-09-21 皇家飞利浦电子股份有限公司 Memristor device is used for MRI RF coil
TWI494841B (en) * 2009-06-19 2015-08-01 Htc Corp Image data browsing methods and systems, and computer program products thereof
KR101667801B1 (en) * 2009-06-19 2016-10-20 삼성전자주식회사 Touch panel and electronic device including the touch panel
KR101658991B1 (en) * 2009-06-19 2016-09-22 삼성전자주식회사 Touch panel and electronic device including the touch panel
KR101588242B1 (en) 2009-07-13 2016-01-25 삼성전자주식회사 Apparatus and method for scroll of a portable terminal
US8624933B2 (en) 2009-09-25 2014-01-07 Apple Inc. Device, method, and graphical user interface for scrolling a multi-section document
CN102221958B (en) * 2010-04-16 2013-03-27 联想(北京)有限公司 Object display method, object switching method and electronic equipment
JPWO2011055816A1 (en) * 2009-11-09 2013-03-28 株式会社キャメロット Information terminal and input control program
JP5327017B2 (en) 2009-11-24 2013-10-30 ソニー株式会社 Remote operation device, remote operation system, information processing method and program using remote operation device
US20110163967A1 (en) * 2010-01-06 2011-07-07 Imran Chaudhri Device, Method, and Graphical User Interface for Changing Pages in an Electronic Document
KR101616875B1 (en) 2010-01-07 2016-05-02 삼성전자주식회사 Touch panel and electronic device including the touch panel
KR101631892B1 (en) 2010-01-28 2016-06-21 삼성전자주식회사 Touch panel and electronic device including the touch panel
JP5049360B2 (en) * 2010-01-29 2012-10-17 楽天株式会社 Server device, product information display program, product information display method, electronic commerce system, terminal device, and recording medium
US20110191699A1 (en) * 2010-02-02 2011-08-04 Dynavox Systems, Llc System and method of interfacing interactive content items and shared data variables
CN102782630A (en) * 2010-03-05 2012-11-14 富士通株式会社 Image display system, information processing apparatus, display apparatus, and image display method
KR101710523B1 (en) 2010-03-22 2017-02-27 삼성전자주식회사 Touch panel and electronic device including the touch panel
US9733705B2 (en) * 2010-04-26 2017-08-15 Nokia Technologies Oy Apparatus, method, computer program and user interface
US9715275B2 (en) 2010-04-26 2017-07-25 Nokia Technologies Oy Apparatus, method, computer program and user interface
US9791928B2 (en) 2010-04-26 2017-10-17 Nokia Technologies Oy Apparatus, method, computer program and user interface
KR101661728B1 (en) 2010-05-11 2016-10-04 삼성전자주식회사 User's input apparatus and electronic device including the user's input apparatus
EP2600231A4 (en) * 2010-07-30 2016-04-27 Sony Computer Entertainment Inc Electronic device, display method of displayed objects, and searching method
KR101809191B1 (en) 2010-10-11 2018-01-18 삼성전자주식회사 Touch panel
KR101735715B1 (en) 2010-11-23 2017-05-15 삼성전자주식회사 Input sensing circuit and touch panel including the input sensing circuit
KR101784436B1 (en) 2011-04-18 2017-10-11 삼성전자주식회사 Touch panel and driving device for the touch panel
KR101830965B1 (en) * 2011-08-03 2018-02-22 엘지전자 주식회사 Mobile Terminal And Method Of Controlling The Same
US8504940B1 (en) 2011-10-03 2013-08-06 Google Inc. Smooth hardware accelerated scrolling
KR101899972B1 (en) * 2011-12-21 2018-09-18 엘지전자 주식회사 Mobile terminal and control method thereof
JP6060966B2 (en) * 2012-03-06 2017-01-18 日本電気株式会社 TERMINAL DEVICE, TERMINAL DEVICE CONTROL METHOD, AND CONTROL PROGRAM
US20130311881A1 (en) * 2012-05-16 2013-11-21 Immersion Corporation Systems and Methods for Haptically Enabled Metadata
US9274696B1 (en) * 2012-07-06 2016-03-01 Path Mobile Inc Pte. Ltd. Scroll bar with time details
TW201423551A (en) * 2012-12-14 2014-06-16 Hon Hai Prec Ind Co Ltd Displaying apparatus, menu displaying device and method thereof
CN103885965A (en) * 2012-12-21 2014-06-25 鸿富锦精密工业(深圳)有限公司 Page loading management method and page loading management system
WO2014132882A1 (en) * 2013-02-27 2014-09-04 Necカシオモバイルコミュニケーションズ株式会社 Terminal device, information display method and recording medium
US20140372930A1 (en) * 2013-06-13 2014-12-18 Tencent Technology (Shenzhen) Company Limited Method and device for displaying a list view through a sliding operation
CN103699387B (en) * 2013-12-27 2018-01-23 金蝶软件(中国)有限公司 form processing method and system
JP2015138416A (en) * 2014-01-22 2015-07-30 キヤノン株式会社 Electronic device, its control method and program
USD765110S1 (en) * 2014-04-25 2016-08-30 Tencent Technology (Shenzhen) Company Limited Portion of a display screen with animated graphical user interface
USD763882S1 (en) * 2014-04-25 2016-08-16 Tencent Technology (Shenzhen) Company Limited Portion of a display screen with animated graphical user interface
CN105353945B (en) * 2014-08-22 2019-04-30 小米科技有限责任公司 List operation method and device
EP3189395A2 (en) 2014-09-02 2017-07-12 Apple Inc. Semantic framework for variable haptic output
CN110072131A (en) 2014-09-02 2019-07-30 苹果公司 Music user interface
USD771094S1 (en) * 2014-09-18 2016-11-08 Cheetah Mobile Inc. Display screen or portion thereof with graphical user interface
USD771690S1 (en) * 2014-09-18 2016-11-15 Cheetah Mobile Inc. Display screen or portion thereof with animated graphical user interface
CN105700800B (en) * 2014-11-27 2019-01-25 阿里巴巴集团控股有限公司 A kind of operating method of page info, device and electronic equipment
US9495088B2 (en) * 2014-12-26 2016-11-15 Alpine Electronics, Inc Text entry method with character input slider
CN104571871A (en) * 2015-01-26 2015-04-29 深圳市中兴移动通信有限公司 Method and system for selecting files
KR102040287B1 (en) * 2015-01-29 2019-11-27 삼성전자주식회사 Acoustic output device and control method thereof
JP2018508900A (en) * 2015-03-03 2018-03-29 イマージョン コーポレーションImmersion Corporation Wearable device surface tactile interaction
JP6281509B2 (en) * 2015-03-13 2018-02-21 京セラドキュメントソリューションズ株式会社 Data transmission device
CN104777985B (en) * 2015-03-20 2017-11-14 广东欧珀移动通信有限公司 A kind of method and terminal for checking information list
USD809522S1 (en) 2015-06-14 2018-02-06 Google Inc. Display screen with animated graphical user interface for an alert screen
USD803241S1 (en) 2015-06-14 2017-11-21 Google Inc. Display screen with animated graphical user interface for an alert screen
US9361011B1 (en) 2015-06-14 2016-06-07 Google Inc. Methods and systems for presenting multiple live video feeds in a user interface
USD807376S1 (en) 2015-06-14 2018-01-09 Google Inc. Display screen with animated graphical user interface for smart home automation system having a multifunction status
USD812076S1 (en) 2015-06-14 2018-03-06 Google Llc Display screen with graphical user interface for monitoring remote video camera
US10133443B2 (en) 2015-06-14 2018-11-20 Google Llc Systems and methods for smart home automation using a multifunction status and entry point icon
US10481645B2 (en) 2015-09-11 2019-11-19 Lucan Patent Holdco, LLC Secondary gesture input mechanism for touchscreen devices
CN105389108A (en) * 2015-10-16 2016-03-09 厦门美图移动科技有限公司 Identification method and device of touch operation of mobile terminal
USD797133S1 (en) 2016-01-07 2017-09-12 Invisalert Solutions, LLC Display screen with graphical user interface
CN105760083B (en) * 2016-01-15 2018-12-28 北京傲游天下科技有限公司 A kind of control unit for realizing browser interface fast scroll
DK179657B1 (en) 2016-06-12 2019-03-13 Apple Inc. Devices, methods and graphical user interfaces for providing haptic feedback
DK179823B1 (en) 2016-06-12 2019-07-12 Apple Inc. Devices, methods, and graphical user interfaces for providing haptic feedback
US10263802B2 (en) 2016-07-12 2019-04-16 Google Llc Methods and devices for establishing connections with remote cameras
USD882583S1 (en) 2016-07-12 2020-04-28 Google Llc Display screen with graphical user interface
DK179278B1 (en) 2016-09-06 2018-03-26 Apple Inc Devices, methods and graphical user interfaces for haptic mixing
DK201670720A1 (en) 2016-09-06 2018-03-26 Apple Inc Devices, Methods, and Graphical User Interfaces for Generating Tactile Outputs
CN111338469B (en) * 2016-09-06 2022-03-08 苹果公司 Apparatus, method and graphical user interface for providing haptic feedback
EP3513390B1 (en) 2016-09-14 2024-03-06 Invisalert Solutions, LLC Tamper resistant clasp and wristband apparatus and associated patient monitoring system and method of use
US10386999B2 (en) 2016-10-26 2019-08-20 Google Llc Timeline-video relationship presentation for alert events
USD843398S1 (en) 2016-10-26 2019-03-19 Google Llc Display screen with graphical user interface for a timeline-video relationship presentation for alert events
US11238290B2 (en) 2016-10-26 2022-02-01 Google Llc Timeline-video relationship processing for alert events
US10739943B2 (en) * 2016-12-13 2020-08-11 Cisco Technology, Inc. Ordered list user interface
US10992795B2 (en) 2017-05-16 2021-04-27 Apple Inc. Methods and interfaces for home media control
US11431836B2 (en) 2017-05-02 2022-08-30 Apple Inc. Methods and interfaces for initiating media playback
US10928980B2 (en) 2017-05-12 2021-02-23 Apple Inc. User interfaces for playing and managing audio items
CN111343060B (en) 2017-05-16 2022-02-11 苹果公司 Method and interface for home media control
KR102404636B1 (en) * 2017-05-16 2022-06-02 애플 인크. Tactile feedback for user interfaces
US20220279063A1 (en) 2017-05-16 2022-09-01 Apple Inc. Methods and interfaces for home media control
DK201770372A1 (en) * 2017-05-16 2019-01-08 Apple Inc. Tactile feedback for locked device user interfaces
US10819921B2 (en) 2017-05-25 2020-10-27 Google Llc Camera assembly having a single-piece cover element
US10352496B2 (en) 2017-05-25 2019-07-16 Google Llc Stand assembly for an electronic device providing multiple degrees of freedom and built-in cables
US10972685B2 (en) 2017-05-25 2021-04-06 Google Llc Video camera assembly having an IR reflector
US10365719B2 (en) * 2017-07-26 2019-07-30 Google Llc Haptic feedback of user interface scrolling with synchronized visual animation components
USD906359S1 (en) 2018-07-05 2020-12-29 Invisalert Solutions, Inc. Display screen with graphical user interface
EP3948517A1 (en) 2019-05-31 2022-02-09 Apple Inc. User interfaces for audio media control
US11010121B2 (en) 2019-05-31 2021-05-18 Apple Inc. User interfaces for audio media control
CN110337034B (en) * 2019-07-12 2022-02-11 青岛海信传媒网络技术有限公司 User interface display method and display equipment
US11392291B2 (en) 2020-09-25 2022-07-19 Apple Inc. Methods and interfaces for media control with dynamic feedback
US20220221966A1 (en) 2021-01-14 2022-07-14 Monday.com Ltd. Digital processing systems and methods for dual mode editing in collaborative documents enabling private changes in collaborative work systems

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5581275A (en) * 1992-02-28 1996-12-03 Hewlett-Packard Company Method and apparatus for locating a predetermined position in a computer file
US20020033795A1 (en) * 2000-01-19 2002-03-21 Shahoian Erik J. Haptic interface for laptop computers and other portable devices
GB2370208A (en) * 2000-12-18 2002-06-19 Symbian Ltd Computing device with user interface for navigating a contacts list
EP1310860A1 (en) * 2000-08-08 2003-05-14 NTT DoCoMo, Inc. Electronic apparatus, vibration generator, vibratory informing method and method for controlling information
US20030222536A1 (en) * 2002-05-31 2003-12-04 Morton Bruce Mckay Manually operable electronic apparatus
US20050210403A1 (en) * 2004-03-19 2005-09-22 Satanek Brandon L Scrollbar enhancement for browsing data
US20060049920A1 (en) * 2004-09-09 2006-03-09 Sadler Daniel J Handheld device having multiple localized force feedback
JP2006163460A (en) * 2004-12-02 2006-06-22 Alpine Electronics Inc Display-type inputting apparatus and scrolling method
US20060271870A1 (en) * 2005-05-31 2006-11-30 Picsel Research Limited Systems and methods for navigating displayed content
EP1752860A1 (en) * 2005-08-12 2007-02-14 LG Electronics Inc. Mobile terminal with touch screen providing haptic feedback and corresponding method

Family Cites Families (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4127554B2 (en) 1996-04-26 2008-07-30 三菱電機株式会社 Image display device
US5883612A (en) * 1996-10-24 1999-03-16 Motorola, Inc. Method for positioning a vibrating alert adjacent to a selected alert in selective call device
US9167073B2 (en) * 1999-08-12 2015-10-20 Hewlett-Packard Development Company, L.P. Method and apparatus for accessing a contacts database and telephone services
US6593949B1 (en) * 2000-01-06 2003-07-15 Microsoft Corporation Smart column for contact information on palm-sized computing devices and method and apparatus for displaying the same
KR100458389B1 (en) * 2000-09-29 2004-11-26 산요덴키가부시키가이샤 Telecommunication terminal device and method for displaying information
US7017123B2 (en) 2000-12-27 2006-03-21 National Instruments Corporation Graphical user interface including palette windows with an improved search function
US7698652B2 (en) * 2001-02-09 2010-04-13 Koninklijke Philips Electronics N.V. Rapid retrieval user interface designed around small displays and few buttons for searching long lists
FI112415B (en) * 2001-11-28 2003-11-28 Nokia Oyj Piezoelectric user interface
US20030224830A1 (en) * 2002-05-30 2003-12-04 Zhi-Yun Zhang Mobile telephone capable of displaying image of caller automatically and method for realize it
US20040204129A1 (en) * 2002-08-14 2004-10-14 Payne David M. Touch-sensitive user interface
US7418663B2 (en) * 2002-12-19 2008-08-26 Microsoft Corporation Contact picker interface
US7313760B2 (en) * 2002-12-19 2007-12-25 Microsoft Corporation Contact picker
JP4474838B2 (en) * 2003-03-20 2010-06-09 日本電気株式会社 Portable information terminal device and telephone directory display method in the device
US20050091604A1 (en) * 2003-10-22 2005-04-28 Scott Davis Systems and methods that track a user-identified point of focus
US8538997B2 (en) * 2004-06-25 2013-09-17 Apple Inc. Methods and systems for managing data
JP2006079136A (en) * 2004-09-06 2006-03-23 Fujitsu Component Ltd Tactile sense presentation device
WO2006030055A1 (en) * 2004-09-15 2006-03-23 Nokia Corporation Handling and scrolling of content on screen
US8964765B2 (en) 2004-11-12 2015-02-24 Broadcom Corporation Mobile handheld multi-media gateway and phone
JP4672347B2 (en) * 2004-12-01 2011-04-20 アルパイン株式会社 Operation input device with vibration function
US20060236264A1 (en) * 2005-04-18 2006-10-19 Microsoft Corporation Automatic window resize behavior and optimizations
US7385530B2 (en) * 2005-05-16 2008-06-10 Research In Motion Limited Key system for a communication device
CN1873602A (en) 2005-05-31 2006-12-06 皮克塞(研究)有限公司 System and methods for navigating displayed content
KR100710362B1 (en) 2005-08-12 2007-04-23 엘지전자 주식회사 Mobile communication terminal having touch screen
US20070136778A1 (en) 2005-12-09 2007-06-14 Ari Birger Controller and control method for media retrieval, routing and playback
KR100774158B1 (en) 2005-12-19 2007-11-07 엘지전자 주식회사 Method for Scrolling Data, Changing Page and Changing Data Display, and Mobile Phone thereby
US9082253B1 (en) * 2005-12-20 2015-07-14 Diebold Self-Service Systems Division Of Diebold, Incorporated Banking system controlled responsive to data bearing records
US8077019B2 (en) * 2006-01-19 2011-12-13 Qualcomm Incorporated Method of associating groups of classified source addresses with vibration patterns
TWI307855B (en) * 2006-03-08 2009-03-21 Htc Corp Item selection method, and machine readable medium thereof
US20070236474A1 (en) * 2006-04-10 2007-10-11 Immersion Corporation Touch Panel with a Haptically Generated Reference Key
US7556204B2 (en) * 2006-04-19 2009-07-07 Nokia Corproation Electronic apparatus and method for symbol input
US8694910B2 (en) 2006-05-09 2014-04-08 Sonos, Inc. User interface to enable users to scroll through a large list of items
US20070263014A1 (en) * 2006-05-09 2007-11-15 Nokia Corporation Multi-function key with scrolling in electronic devices
JP4753801B2 (en) * 2006-06-07 2011-08-24 ソニー・エリクソン・モバイルコミュニケーションズ株式会社 Information processing device, information processing method, information processing program, and portable terminal device
US7925986B2 (en) * 2006-10-06 2011-04-12 Veveo, Inc. Methods and systems for a linear character selection display interface for ambiguous text input
US20080146210A1 (en) * 2006-12-18 2008-06-19 Zaheen Somani System and method for associating items from a group with features provided by a mobile device
US7523412B2 (en) * 2006-12-26 2009-04-21 International Business Machines Corporation Method and system for providing a scroll-bar pop-up with quick find for rapid access of sorted list data
KR100894146B1 (en) * 2007-02-03 2009-04-22 엘지전자 주식회사 Mobile communication device and control method thereof
WO2008125130A1 (en) * 2007-04-12 2008-10-23 Nokia Corporation Keypad
US20080280600A1 (en) * 2007-05-08 2008-11-13 Samsung Electronics Co., Ltd. Geographic Mobile Address Book
CN102749997B (en) 2007-09-18 2016-06-22 微软技术许可有限责任公司 The method of the operation of mobile terminal and this mobile terminal of control

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5581275A (en) * 1992-02-28 1996-12-03 Hewlett-Packard Company Method and apparatus for locating a predetermined position in a computer file
US20020033795A1 (en) * 2000-01-19 2002-03-21 Shahoian Erik J. Haptic interface for laptop computers and other portable devices
EP1310860A1 (en) * 2000-08-08 2003-05-14 NTT DoCoMo, Inc. Electronic apparatus, vibration generator, vibratory informing method and method for controlling information
GB2370208A (en) * 2000-12-18 2002-06-19 Symbian Ltd Computing device with user interface for navigating a contacts list
US20030222536A1 (en) * 2002-05-31 2003-12-04 Morton Bruce Mckay Manually operable electronic apparatus
US20050210403A1 (en) * 2004-03-19 2005-09-22 Satanek Brandon L Scrollbar enhancement for browsing data
US20060049920A1 (en) * 2004-09-09 2006-03-09 Sadler Daniel J Handheld device having multiple localized force feedback
JP2006163460A (en) * 2004-12-02 2006-06-22 Alpine Electronics Inc Display-type inputting apparatus and scrolling method
US20060271870A1 (en) * 2005-05-31 2006-11-30 Picsel Research Limited Systems and methods for navigating displayed content
EP1752860A1 (en) * 2005-08-12 2007-02-14 LG Electronics Inc. Mobile terminal with touch screen providing haptic feedback and corresponding method

Cited By (38)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11029838B2 (en) 2006-09-06 2021-06-08 Apple Inc. Touch screen device, method, and graphical user interface for customizing display of content category icons
US11467722B2 (en) 2007-01-07 2022-10-11 Apple Inc. Portable electronic device, method, and graphical user interface for displaying electronic documents and lists
JP2015222570A (en) * 2010-11-12 2015-12-10 アップル インコーポレイテッド Device, method, and graphical user interface for navigating list of identifiers
EP2535799A3 (en) * 2011-06-13 2017-07-26 Samsung Electronics Co., Ltd. Apparatus and method for scrolling in device with touch screen
US10606458B2 (en) 2012-05-09 2020-03-31 Apple Inc. Clock face generation based on contact on an affordance in a clock face selection mode
US10613745B2 (en) 2012-05-09 2020-04-07 Apple Inc. User interface for receiving user input
US11740776B2 (en) 2012-05-09 2023-08-29 Apple Inc. Context-specific user interfaces
US9804759B2 (en) 2012-05-09 2017-10-31 Apple Inc. Context-specific user interfaces
US10496259B2 (en) 2012-05-09 2019-12-03 Apple Inc. Context-specific user interfaces
US10990270B2 (en) 2012-05-09 2021-04-27 Apple Inc. Context-specific user interfaces
US10613743B2 (en) 2012-05-09 2020-04-07 Apple Inc. User interface for receiving user input
EP2911047A1 (en) * 2014-02-17 2015-08-26 Samsung Electronics Co., Ltd Method and apparatus for displaying information and electronic device adapted to the method
US11250385B2 (en) 2014-06-27 2022-02-15 Apple Inc. Reduced size user interface
US11720861B2 (en) 2014-06-27 2023-08-08 Apple Inc. Reduced size user interface
US10872318B2 (en) 2014-06-27 2020-12-22 Apple Inc. Reduced size user interface
US11604571B2 (en) 2014-07-21 2023-03-14 Apple Inc. Remote user interface
US10452253B2 (en) 2014-08-15 2019-10-22 Apple Inc. Weather user interface
US11922004B2 (en) 2014-08-15 2024-03-05 Apple Inc. Weather user interface
US11042281B2 (en) 2014-08-15 2021-06-22 Apple Inc. Weather user interface
US11550465B2 (en) 2014-08-15 2023-01-10 Apple Inc. Weather user interface
US10771606B2 (en) 2014-09-02 2020-09-08 Apple Inc. Phone user interface
US11700326B2 (en) 2014-09-02 2023-07-11 Apple Inc. Phone user interface
US10254948B2 (en) 2014-09-02 2019-04-09 Apple Inc. Reduced-size user interfaces for dynamically updated application overviews
US10409483B2 (en) 2015-03-07 2019-09-10 Apple Inc. Activity based thresholds for providing haptic feedback
US10055121B2 (en) 2015-03-07 2018-08-21 Apple Inc. Activity based thresholds and feedbacks
US10572132B2 (en) 2015-06-05 2020-02-25 Apple Inc. Formatting content for a reduced-size user interface
US9916075B2 (en) 2015-06-05 2018-03-13 Apple Inc. Formatting content for a reduced-size user interface
CN107203260A (en) * 2016-03-17 2017-09-26 谷歌公司 The method and apparatus that touch feedback for computing device is provided
GB2548451A (en) * 2016-03-17 2017-09-20 Google Inc Method and apparatus to provide haptic feedback for computing devices
US10272294B2 (en) 2016-06-11 2019-04-30 Apple Inc. Activity and workout updates
US11660503B2 (en) 2016-06-11 2023-05-30 Apple Inc. Activity and workout updates
US11161010B2 (en) 2016-06-11 2021-11-02 Apple Inc. Activity and workout updates
US11148007B2 (en) 2016-06-11 2021-10-19 Apple Inc. Activity and workout updates
US11918857B2 (en) 2016-06-11 2024-03-05 Apple Inc. Activity and workout updates
CN111787175A (en) * 2019-06-18 2020-10-16 京瓷办公信息系统株式会社 Information processing apparatus
US11921998B2 (en) 2020-05-11 2024-03-05 Apple Inc. Editing features of an avatar
US11714536B2 (en) 2021-05-21 2023-08-01 Apple Inc. Avatar sticker editor user interfaces
US11972103B2 (en) 2022-10-07 2024-04-30 Apple Inc. Portable electronic device, method, and graphical user interface for displaying electronic documents and lists

Also Published As

Publication number Publication date
EP2040146A3 (en) 2013-07-03
EP2040146B1 (en) 2020-12-09
CN102749997A (en) 2012-10-24
US20160187984A1 (en) 2016-06-30
CN102749997B (en) 2016-06-22
US9191470B2 (en) 2015-11-17
US20090075694A1 (en) 2009-03-19
US8509854B2 (en) 2013-08-13
US10656712B2 (en) 2020-05-19
US20130310111A1 (en) 2013-11-21

Similar Documents

Publication Publication Date Title
EP2040146A2 (en) Mobile terminal and method of controlling operation of the same
KR101414766B1 (en) Mobile terminal and operation control method thereof
EP2020807A1 (en) Mobile terminal using touch screen and method of controlling the same
EP2107443B1 (en) Mobile terminal using proximity sensor and control method thereof
KR101556522B1 (en) Mobile terminal for providing haptic effect and control method thereof
EP2151980B1 (en) Mobile terminal with touch screen and method of processing messages using the same
EP2090972A2 (en) Mobile communication device equipped with touch screen and method of controlling the same
EP2166443A2 (en) Mobile terminal with transparent flexible display and operation method thereof
US20100066688A1 (en) Mobile terminal and method of controlling the mobile terminal
KR20110097467A (en) Method for inputting a string of charaters and apparatus thereof
KR20100020818A (en) Mobile terminal and operation control method thereof
KR20090121995A (en) Mobile terminal and control method thereof
KR20090076647A (en) Mobile terminal and operation control method thereof
KR20090076650A (en) Mobile terminal for inputting hangul
EP2172832A2 (en) Keypad display method of mobile terminal
KR20090076648A (en) Mobile terminal and control method thereof
KR20120001516A (en) Method for editing image contents in mobile terminal and mobile terminal using the same
KR101418510B1 (en) Mobile terminal and operation control method thereof
KR20100050319A (en) Mobile terminal and operation control method thereof
KR20090112440A (en) Mobile terminal and operation control method thereof
KR101501950B1 (en) Mobile terminal and operation control method thereof
KR20110037654A (en) Method for processing touch signal in mobile terminal and mobile terminal using the same
KR101534308B1 (en) Mobile terminal and operation control method thereof
KR20100105236A (en) Apparatus and method for inputting character in mobile terminal
KR101482114B1 (en) Mobile terminal having a function for changing UI and control method thereof

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA MK RS

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: LG ELECTRONICS INC.

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 3/048 20130101ALI20121221BHEP

Ipc: G06F 3/01 20060101AFI20121221BHEP

PUAL Search report despatched

Free format text: ORIGINAL CODE: 0009013

AK Designated contracting states

Kind code of ref document: A3

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA MK RS

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 3/01 20060101AFI20130529BHEP

Ipc: H04M 1/2745 20060101ALI20130529BHEP

Ipc: G06F 3/048 20130101ALI20130529BHEP

17P Request for examination filed

Effective date: 20131217

RBV Designated contracting states (corrected)

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

AKX Designation fees paid

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: MICROSOFT TECHNOLOGY LICENSING, LLC

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20180207

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Ref document number: 602008063548

Country of ref document: DE

Free format text: PREVIOUS MAIN CLASS: G06F0003010000

Ipc: G06F0003048200

RIC1 Information provided on ipc code assigned before grant

Ipc: G06F 3/0482 20130101AFI20200630BHEP

Ipc: G06F 3/01 20060101ALI20200630BHEP

Ipc: G06F 3/0488 20130101ALI20200630BHEP

Ipc: H04M 1/2745 20200101ALI20200630BHEP

Ipc: G06F 3/048 20130101ALI20200630BHEP

Ipc: G06F 3/0485 20130101ALI20200630BHEP

Ipc: H04M 1/2747 20200101ALI20200630BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20200812

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1344091

Country of ref document: AT

Kind code of ref document: T

Effective date: 20201215

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602008063548

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210309

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201209

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210310

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1344091

Country of ref document: AT

Kind code of ref document: T

Effective date: 20201209

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210309

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201209

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201209

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20201209

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201209

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201209

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG9D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210409

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201209

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201209

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201209

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201209

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201209

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201209

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201209

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602008063548

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210409

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201209

RAP4 Party data changed (patent owner data changed or rights of a patent transferred)

Owner name: MICROSOFT TECHNOLOGY LICENSING, LLC

26N No opposition filed

Effective date: 20210910

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201209

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201209

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201209

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20210930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210409

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201209

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210918

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210918

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210930

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210930

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20080918

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201209

P01 Opt-out of the competence of the unified patent court (upc) registered

Effective date: 20230501

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20230823

Year of fee payment: 16

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230822

Year of fee payment: 16

Ref country code: DE

Payment date: 20230822

Year of fee payment: 16