EP1744240B1 - Mobile phone and mobile phone control method - Google Patents

Mobile phone and mobile phone control method Download PDF

Info

Publication number
EP1744240B1
EP1744240B1 EP06250872A EP06250872A EP1744240B1 EP 1744240 B1 EP1744240 B1 EP 1744240B1 EP 06250872 A EP06250872 A EP 06250872A EP 06250872 A EP06250872 A EP 06250872A EP 1744240 B1 EP1744240 B1 EP 1744240B1
Authority
EP
European Patent Office
Prior art keywords
cursor
screen
push
button
grid line
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
EP06250872A
Other languages
German (de)
French (fr)
Other versions
EP1744240A1 (en
Inventor
Nobuo Shimizu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Toshiba Corp
Original Assignee
Toshiba Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Toshiba Corp filed Critical Toshiba Corp
Publication of EP1744240A1 publication Critical patent/EP1744240A1/en
Application granted granted Critical
Publication of EP1744240B1 publication Critical patent/EP1744240B1/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0489Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using dedicated keyboard keys or combinations thereof
    • G06F3/04892Arrangements for controlling cursor position based on codes indicative of cursor displacements from one discrete location to another, e.g. using cursor control keys associated to different directions or using the tab key
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72469User interfaces specially adapted for cordless or mobile telephones for operating the device by selecting functions from two or more displayed items, e.g. menus or icons

Definitions

  • the present invention relates to a mobile phone for remotely operating an information device, such as a personal computer, through a network, and a related method.
  • Information devices often connect to a network, such as a mobile phone connectable to the Internet or a PDA (Personal Digital Assistant) connectable to a wireless LAN (Local Area Network). Furthermore, a display apparatus of some information devices have a high resolution, and an image can be finely displayed. Accordingly, by connecting a first information device with a second information device remotely located such as a personal computer (Hereinafter, PC), the first information device can control the second information device and can access data stored on the second information device.
  • a network such as a mobile phone connectable to the Internet or a PDA (Personal Digital Assistant) connectable to a wireless LAN (Local Area Network).
  • a display apparatus of some information devices have a high resolution, and an image can be finely displayed. Accordingly, by connecting a first information device with a second information device remotely located such as a personal computer (Hereinafter, PC), the first information device can control the second information device and can access data stored on the second information device.
  • PC personal computer
  • a pointing device such as a mouse or a touch panel is generally used.
  • a mouse cursor can be moved in a moment to an arbitrary position on a screen of the PC.
  • a mouse button By immediately pushing a mouse button after moving the mouse cursor, various kinds of menu selection and data input can be executed.
  • a mobile phone typically includes numerical buttons to dial a telephone number, arrow buttons (directions of top and bottom and right and left) and a confirmation button for menu selection, and several buttons for special operation.
  • a cursor in case of remotely operating a PC using a mobile phone, in comparison with operation of the mouse of the PC, a cursor cannot be moved in a moment to an arbitrary position on a display of the mobile phone. For example, by pushing the arrow buttons (directions of top and bottom and right and left) repeatedly, the cursor is gradually moved to the arbitrary position on the display. Another suitable means to easily move the cursor to the arbitrary position is not actually considered.
  • DE-A-195 21 453 discloses a mobile phone controlled to remotely operate an information device, wherein a communication unit is configured to receive information displayed on the information device; a display device displays a part of the information on a screen; each of a plurality of operation buttons is configured to input an operation signal; a display control unit is configured to display a cursor on the screen, the cursor overlapping the part of the information; and an operation control unit is configured to move the cursor to a specific location of the screen in response to the operation signal.
  • the invention provides mobile phones as defined in Claims 1 and 2 and controlling methods as defined in Claims 8 and 9.
  • the present invention can be used for remotely operating a PC with high operability using standard operation buttons of the mobile phone.
  • Fig. 1 is a component example of an information device remote operation system connected with a mobile phone.
  • Fig.2 is a block diagram of a mobile phone.
  • Fig.3 is a display example of a display device of a mobile phone.
  • Fig. 4 is one example of operation buttons of a mobile phone.
  • Fig. 5 is a schematic diagram of operation of a mobile phone.
  • Fig. 6 is a schematic diagram of operation of a mobile phone according to a first embodiment.
  • Fig.8 is a schematic diagram of display status of the mobile phone according to the second embodiment.
  • Figs.9A ⁇ 9D are schematic diagrams of an operation of the mobile phone according to the second embodiment.
  • Fig.10 is a flow chart of an operation method of a mobile phone according to a third embodiment.
  • Figs.11A ⁇ 11D are schematic diagrams of a first operation of the mobile phone according to the third embodiment.
  • Figs.12A ⁇ 12C are schematic diagrams of a second operation of the mobile phone according to the third embodiment.
  • Figs.13A and 13B are schematic diagrams of a third operation of the mobile phone according to the third embodiment.
  • Figs.14A and 14B are schematic diagrams of a fourth operation of the mobile phone according to the third embodiment.
  • Figs.15A and 15B are schematic diagrams of a fifth operation of the mobile phone according to the third embodiment.
  • Figs.16A ⁇ 16E are schematic diagrams of the operation of a mobile phone according to a fourth embodiment.
  • Fig.1 is a block diagram of an information device remote operation system 1.
  • a mobile phone 2 is connected with an information device 3 via an electric communication circuit or network 4 and a base station 5.
  • the information device 3 is, for example, a personal computer.
  • the information device 3 located in an office or a home can be remotely operated using the mobile phone.
  • Screen information on a display 3a of the information device 3 is received via the electric communication circuit 4, and displayed on a display 2a of the mobile phone 2.
  • the display 2a of the mobile phone 2 is smaller than the display 3a of the information device 3. Accordingly, a part of the screen information on the display 3a is displayed on the display 2a.
  • a mouse cursor In case of directly operating the information device 3, by using a pointing device such as a mouse or a touch pad, a mouse cursor (Hereinafter, a cursor) can be moved in a moment to an arbitrary position on the display 3a.
  • Fig.2 is a block diagram of the mobile phone 2.
  • the mobile phone 2 includes a communication unit 20, a display control unit 21, a display 2a, an operation control unit 22, and an operation unit 23.
  • the communication unit 20 executes data communication with the information device 3 via the electric communication circuit 4.
  • the display control unit 21 controls the display 2a of the mobile phone 2 to display the screen information sent from the information device 3. Furthermore, the display control unit 21 controls the display 2a to display a cursor and grid lines (explained afterwards).
  • the display 2a is, for example, a liquid crystal display.
  • the operation control unit 22 executes various kinds of data conversion based on input data from operation buttons 24 of the operation unit 23.
  • Fig.3 shows screen information on the display 3a of the information device 3 as a remote operation object and a part of the screen information on the display 2a of the mobile phone 2.
  • the display 3a of the information device 3 such as the personal computer includes a relative large screen.
  • the screen is composed by pixels of "(1024 dots) X (768 dots)" (XGA standard) .
  • a screen of the display 2a may have a high resolution, the display 2a is smaller than the display 3a.
  • the screen is composed by pixels of "(240 dots) X (320 dots)" (QVGA standard).
  • Fig.4 is a schematic diagram of an operation panel (operation unit 32) of the mobile phone 2.
  • the operation unit 23 includes a plurality of operation buttons 24.
  • buttons of top and bottom and right and left i.e., "top” arrow button, "bottom” arrow button, “right” arrow button, and “left” arrow button, are located. Furthermore, on a center part, surrounded by the four arrow buttons, "confirmation” button is located.
  • dial buttons are located on lower part of the operation unit 23 .
  • the dial buttons include "1" button ⁇ "9” button located as ((three lines) X (three rows)), "0" button, "*” button, and "#” button. Furthermore, "call” button is prepared.
  • Fig. 5 is a schematic diagram to explain prior method for moving a cursor using the operation buttons 24.
  • a symbol (“+” surrounded by “o") represents a cursor.
  • arrow buttons of top and bottom and right and left are often used. Briefly, whenever the arrow buttons are pushed, the cursor is moved a moving distance d. In example of Fig. 5 , the cursor is moved to the right by pushing a "right” arrow button one time, and the cursor is moved to the bottom by pushing a "bottom” arrow button one time.
  • the moving distance d If the moving distance d is fixed, the cursor cannot be pointed on a middle point of the moving distance d. Accordingly, the moving distance d can be changed by set.
  • the equation (1) is a discrete equation. In order to simplify calculation, the equation (1) is approximated by following continuous equation (2). ⁇ 0 x ⁇ x ⁇ u / d ⁇ d ⁇ u + ⁇ x a ⁇ u ⁇ x / d ⁇ d ⁇ u / a + ⁇ 0 y ⁇ y ⁇ v / d ⁇ d ⁇ d ⁇ v + ⁇ y b ⁇ v ⁇ y / d ⁇ d ⁇ v / b
  • the moving distance d of the cursor by push of one time may be lengthened.
  • probability that a position depart from a target position is pointed on the screen is high.
  • frequency to repeatedly set the moving distance d increases, and actual operation is not effective for a user.
  • a button operation of the mobile phone 2 includes a long push (remain pushing for a while) and a short push (usual push operation) . Accordingly, the moving distance d may be changed between the long push and the short push. Furthermore, by continuously pushing the button after the long push, an operation status is transferred to "repeat" and the long push is repeated. Accordingly, the moving distance d may be changed by repeat times.
  • Fig. 6 is a schematic diagram of moving method of the cursor according to a first embodiment.
  • a cursor is compulsorily moved from the present position to a center of the screen.
  • the cursor In case that a moving destination (target position) is near the present position of the cursor, the cursor is not necessarily moved to the center. If the cursor is moved to the target position after moving the center by pushing the "call” button, irrespective of the present position of the cursor, the average of push times of operation buttons to move the cursor to the target position is 17.5. By considering push of "call” button, the average is 18.5
  • Fig.7 is a flow chart of operation example of the mobile phone 2 according to a second embodiment.
  • Figs.8 and 9 are schematic diagrams to explain operation examples of the mobile phone 2 according to the second embodiment.
  • a user In case of moving a cursor from the present position, a user first pushes a "call” button (ST1).
  • the mobile phone 2 changes processing from a usual operation mode to a quick moving mode of the cursor. Furthermore, by pushing the "call” button, as shown in Fig.8 , the display control unit 21 displays a large grid line (first grid line) of "(three lines) ⁇ (three rows)" on the display 2a. Nine large cells (first cell) are formed by this grid line (ST2).
  • the grid line is used for displaying the first cell.
  • method for discriminately displaying each cell is not limited to the grid line and any method may be used.
  • lattice points of each cell may be displayed, or a background color of each cell may be different.
  • a grid line is used to discriminate display of each cell.
  • another method to discriminately display may be used.
  • step ST3 In case of pushing the "call” button again (Yes at ST3), by deciding that previous operation is cancelled, the grid line is cleared (erased) and the processing is advanced to step ST1. In case of not pushing the "call” button, the processing is forwarded to step ST4.
  • a user pushes any button of nine dial buttons ("1" button ⁇ "9" button).
  • "1" button-"9” button are arranged as "(three lines) ⁇ (three rows)". As shown in Fig.8 , a large grid line corresponds to a position of each cell divided on the screen. Accordingly, a user can easily select a dial button corresponding to a target position of the cursor by watching cells on the display 2a.
  • Fig.9 shows a display example of a screen based on operation flow.
  • Fig. 9A shows a display example on which large grid line is displayed by pushing a "call" button at ST2.
  • a position of a cursor (left upper side) represents a present position of the cursor (before moving).
  • Fig.9B shows a display example after pushing a "4" button at ST4.
  • the cursor By pushing the "4" button, the cursor is moved to a center of a cell (left middle side) corresponding to a position of the "4" button.
  • small grid line (second grid line) of "(three lines) x (three rows)” is displayed in the cell. This grid line forms nine small cells (second cell) (ST5).
  • a user selectively pushes "1" button-"9” button corresponding to a target position.
  • "9 " button is pushed.
  • the cursor is moved to a position of the small cell corresponding to the "9” button.
  • all grid lines are cleared and a display status is returned to usual operation mode ( Fig.9D ) .
  • a vertical length and a horizontal length of the small cell are respectively one ninth.
  • the screen size of the display 2a is "(240 dot) X (320 dot)”
  • a size of the small cell is "(27 dot) X (36 dot)”.
  • the average of push times of operation buttons for cursor to move from the present position to the target position is about six, which is a quarter of average "twenty three" of prior art.
  • buttons necessary for cursor moving is greatly reduced. Accordingly, a cursor can be moved to a target position for a short time and operability is improved.
  • Fig.10 is a flow chart of operation of the mobile phone 2 according to a third embodiment.
  • Fig.11 is display example of the display 2a based on operation flow of the mobile phone 2 according to the third embodiment.
  • cursor moving is executed using dial buttons ("1" button ⁇ "9" button).
  • cursor moving is executed using arrow buttons (top and bottom and right and left).
  • buttons are simple. However, some user operates by confirming a position of the button. On the other hand, arrow buttons (top and bottom and right and left) are easy for the user to operate without confirming the position of the button (blind touch).
  • a moving direction of the cursor is more important than a position of the cursor on a screen. Accordingly, in the third embodiment, the cursor is displayed on a lattice point of grid line different from the second embodiment (cursor is displayed on a center of the cell). In this display mode, the cursor is moved on the grid line. Accordingly, the grid line represents a locus of the cursor and is congenial to the arrow buttons. As a result, quick operation is possible for the user.
  • the mobile phone 2 changes processing from usual operation mode to quick moving mode of cursor.
  • a special button For example, "call” button (first button)
  • Fig.11A shows this display status.
  • the grid line divides the screen into nine cells ((three lines) X (three rows)).
  • the third embodiment does not have such restriction. Accordingly, the number of grid lines and space between grid lines can be selected based on visibility. As shown in Fig .11 , a vertical space and a horizontal space between grid lines may be respectively equal. For example, in the third embodiment, a space between grid lines along a vertical direction and a horizontal direction are respectively 80 dots.
  • a user pushes the arrow buttons (top and bottom and right and left) while watching the display (blind touch) in order to get near the cursor from the present position to the target position.
  • the cursor is moved on the lattice point of each cell (formed by grid lines).
  • a user After moving the cursor to a position adjacent to the target point, a user pushes a special button (second button, for example, a "confirmation” button) (ST16).
  • a special button for example, a "confirmation” button
  • small grid lines (second grid line) dividing four cells (first cell) adjoining a lattice point of the cursor are displayed.
  • the small grid lines divide a large cell into nine small cells (second cell) .
  • Fig.11C shows this display status.
  • the large cell is respectively divided into three parts along a vertical direction and a horizontal direction.
  • a space between two small cells along the vertical direction and the horizontal direction is respectively 27 dots.
  • the cursor further nears the target position.
  • a moving unit of the cursor is the small cell. Accordingly, fine moving of the cursor is possible.
  • Fig.11D by one push of a "bottom” arrow button and one push of a "right” arrow button, the cursor is further moved near the target position.
  • a user pushes a "confirmation” button (ST22).
  • the cursor position is determined, and processing is returned from the quick moving mode of the cursor to the usual operation mode. Furthermore, all grid lines are cleared (ST23). Fig.11E shows this display status.
  • the cursor may be moved by unit of predetermined moving distance d (For example, 8 dots) using the arrow buttons (top and bottom and right and left) .
  • the cursor In case of moving the cursor on lattice points of the large grid line, the cursor is moved as 80 dots by one push of the arrow button. As mentioned-above, in the prior art (usual operation mode), a moving distance of one push of the arrow button is 8 dots. Accordingly, average of push times of button is one tenth of the equation (4), i.e., about 2.333.
  • the cursor In case of moving a cursor on lattice points of the small grid line, the cursor is moved on "3 X 3" small cells divided in the large cell. Accordingly, the average of push times more decreases than average of push times in case of moving a cursor on lattice points of the large grid lines. Briefly, the average of push times in case of moving a cursor on lattice points of the small grid lines is below 2.333.
  • a size of the small cell is "(27 dots) X (27 dots)". Accordingly, in the usual operation mode, average of push times by unit of 8 dots to finely adjust a cursor position is approximately calculated by the equation (5), i.e., 2.333.
  • average of push times of buttons of the mobile phone 2 of the third embodiment is calculated as follows. 2.333 + 2.333 + 2.333 + 3 ⁇ 10 times
  • above average “10” is larger.
  • above average “10” is below a half of the average "23”.
  • the cursor in the mobile phone 2 of the third embodiment, in the same way as the second embodiment, push times of operation buttons necessary for cursor moving is greatly reduced. Accordingly, the cursor can be moved to a target position for a short time, and the user's operability improves.
  • the cursor is often moved along a direction toward outside of a display area of the display 2a.
  • the moving destination is outside of the display area, a part of screen information on the display 2a is shifted along a reverse direction of the cursor moving direction, and the cursor is positioned on new screen information on the display 2a.
  • the display area of the small grid lines is automatically shifted (slide) along a moving direction of the cursor.
  • moving of the cursor using the small grid lines can be continually executed, and the user's operability improves.
  • the display area of the small grid lines and a view of screen information of the display 2a are automatically shifted along a reverse direction of the moving direction of the cursor as a space between large grid lines (ST20) .
  • new part of screen information (right side screen information not displayed up to the present) is displayed on the display 2a, moving of the cursor using the small grid lines can be executed, and the user' s operability improves.
  • Figs.15A and B show display examples of this cancel operation.
  • Figs.16A ⁇ 16E are schematic diagrams to explain operation of the mobile phone 2 according to a fourth embodiment.
  • Basic operation flow of the mobile phone 2 of the fourth embodiment is the same as the third embodiment of Fig.10 .
  • the cursor moves differently in case of changing the processing from usual operation mode to quick moving mode of cursor.
  • Fig. 16A shows this display status.
  • Other operation is same as the third embodiment.
  • the fourth embodiment adds the merit of the first embodiment to the merit of the third embodiment.
  • the processing can be accomplished by a computer-executable program, and this program can be realized in a computer-readable memory device.
  • the memory device such as a magnetic disk, a flexible disk, a hard disk, an optical disk (CD-ROM, CD-R, DVD, and so on), an optical magnetic disk (MD and so on) can be used to store instructions for causing a processor or a computer to perform the processes described above.
  • OS operation system
  • MW middle ware software
  • the memory device is not limited to a device independent from the computer. By downloading a program transmitted through a LAN or the Internet, a memory device in which the program is stored is included. Furthermore, the memory device is not limited to one. In the case that the processing of the embodiments is executed by a plurality of memory devices, a plurality of memory devices may be included in the memory device. The component of the device may be arbitrarily composed.

Description

    FIELD OF THE INVENTION
  • The present invention relates to a mobile phone for remotely operating an information device, such as a personal computer, through a network, and a related method.
  • BACKGROUND OF THE INVENTION
  • Information devices often connect to a network, such as a mobile phone connectable to the Internet or a PDA (Personal Digital Assistant) connectable to a wireless LAN (Local Area Network). Furthermore, a display apparatus of some information devices have a high resolution, and an image can be finely displayed. Accordingly, by connecting a first information device with a second information device remotely located such as a personal computer (Hereinafter, PC), the first information device can control the second information device and can access data stored on the second information device.
  • For example, a technique to operate a PC (software is previously installed) from a mobile phone or a PDA (WEB browser is usable) via a network is disclosed in the following.
    IBM Japan "Software realizing remote operation of PC from mobile phone", [online], press release, [retrieval on June 28, 2005], Internet <URL: http://www-06.ibm.com/jp/press/2002/05271.html>;
  • Furthermore, a technique to operate a PC (software is previously installed) from a WEB browser or a private viewer (predetermined language is usable) is disclosed in the following.
    AT&T Labs-Research In the Spotlight "PC World included AT&T Labs (Cambridge) Virtual Network Computer Software in its 1 April feature on the evaluation of remote PC software", [online], [retrieval on June 28, 2005], Internet <URL: http://www.research.att.com/spotlight/200204.html>;
  • Furthermore, by setting a relay server between a mobile phone and a PC and by communicating the relay server with the mobile phone using an original protocol, a system to operate the PC from the mobile phone is disclosed in the following.
    Masato NAKASU "Research of a computer remote operation system using a mobile phone", [online], Tsukuba University, [retrieval on June 28, 2005], Internet <URL: http://www.iplab.cs.tsukuba.ac.jp/~baru/research/keitai.html>;
  • In the technique disclosed in IBM Japan and NAKASU articles, screen information of the PC or input information from a keyboard or a mouse of the PC are transmitted between the PC and the mobile phone by predetermined communication protocol. Briefly, this technique relates to remote operation from the mobile phone to the PC.
  • When inputting data to a PC, except for the keyboard, a pointing device such as a mouse or a touch panel is generally used. By using the mouse, a mouse cursor can be moved in a moment to an arbitrary position on a screen of the PC. By immediately pushing a mouse button after moving the mouse cursor, various kinds of menu selection and data input can be executed.
  • On the other hand, a mobile phone typically includes numerical buttons to dial a telephone number, arrow buttons (directions of top and bottom and right and left) and a confirmation button for menu selection, and several buttons for special operation.
  • Accordingly, in case of remotely operating a PC using a mobile phone, in comparison with operation of the mouse of the PC, a cursor cannot be moved in a moment to an arbitrary position on a display of the mobile phone. For example, by pushing the arrow buttons (directions of top and bottom and right and left) repeatedly, the cursor is gradually moved to the arbitrary position on the display. Another suitable means to easily move the cursor to the arbitrary position is not actually considered.
  • An interface by connecting a mouse to a mobile phone is technically possible. However, in this use form, simple movability of the mobile phone falls. By considering operation of the mobile phone while a user's moving to a destination or an vehicle, this interface is not a practical solution method.
  • In this way, operability to remotely operate the PC using a mobile phone is greatly inferior to operability to directly operate the PC using a mouse.
  • DE-A-195 21 453 discloses a mobile phone controlled to remotely operate an information device, wherein
    a communication unit is configured to receive information displayed on the information device;
    a display device displays a part of the information on a screen;
    each of a plurality of operation buttons is configured to input an operation signal;
    a display control unit is configured to display a cursor on the screen, the cursor overlapping the part of the information; and
    an operation control unit is configured to move the cursor to a specific location of the screen in response to the operation signal.
  • From US-A-2004/0135819 it is further known to display a grid line representing a boundary of each cell on the screen and, in response to a push of a predetermined one of the plurality of operation buttons, to move the cursor form the present position to a center position.
  • The invention provides mobile phones as defined in Claims 1 and 2 and controlling methods as defined in Claims 8 and 9.
  • The present invention can be used for remotely operating a PC with high operability using standard operation buttons of the mobile phone.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • Fig. 1 is a component example of an information device remote operation system connected with a mobile phone.
  • Fig.2 is a block diagram of a mobile phone.
  • Fig.3 is a display example of a display device of a mobile phone.
  • Fig. 4 is one example of operation buttons of a mobile phone.
  • Fig. 5 is a schematic diagram of operation of a mobile phone.
  • Fig. 6 is a schematic diagram of operation of a mobile phone according to a first embodiment.
  • Fig.7 is a flow chart of an operation method of a mobile phone according to a second embodiment.
  • Fig.8 is a schematic diagram of display status of the mobile phone according to the second embodiment.
  • Figs.9A~9D are schematic diagrams of an operation of the mobile phone according to the second embodiment.
  • Fig.10 is a flow chart of an operation method of a mobile phone according to a third embodiment.
  • Figs.11A~11D are schematic diagrams of a first operation of the mobile phone according to the third embodiment.
  • Figs.12A~12C are schematic diagrams of a second operation of the mobile phone according to the third embodiment.
  • Figs.13A and 13B are schematic diagrams of a third operation of the mobile phone according to the third embodiment.
  • Figs.14A and 14B are schematic diagrams of a fourth operation of the mobile phone according to the third embodiment.
  • Figs.15A and 15B are schematic diagrams of a fifth operation of the mobile phone according to the third embodiment.
  • Figs.16A~16E are schematic diagrams of the operation of a mobile phone according to a fourth embodiment.
  • DETAILED DESCRIPTION OF THE EMBODIMENTS
  • Hereinafter, various embodiments of the present invention will be explained by referring to the drawings. The present invention is not limited to the following embodiments.
  • (The first embodiment)
    Fig.1 is a block diagram of an information device remote operation system 1.
  • In embodiments of the present invention, a mobile phone 2 is connected with an information device 3 via an electric communication circuit or network 4 and a base station 5. The information device 3 is, for example, a personal computer.
  • In the information device remote operation system 1, the information device 3 located in an office or a home, for example, can be remotely operated using the mobile phone.
  • Screen information on a display 3a of the information device 3 is received via the electric communication circuit 4, and displayed on a display 2a of the mobile phone 2. Normally, the display 2a of the mobile phone 2 is smaller than the display 3a of the information device 3. Accordingly, a part of the screen information on the display 3a is displayed on the display 2a.
  • On the other hand, in case of operating or inputting data from the mobile phone 2 to the information device 3, operation buttons set on the mobile phone 2 are used.
  • In case of directly operating the information device 3, by using a pointing device such as a mouse or a touch pad, a mouse cursor (Hereinafter, a cursor) can be moved in a moment to an arbitrary position on the display 3a.
  • In the mobile phone 2, portable movability is important, and the pointing device such as the mouse or the touch panel is not normally used. Accordingly, in the background art, moving operation of the cursor is not effective. In the present invention, technique to effectively operate moving of the cursor is provided. As a result, operability of remote operation by the mobile phone 2 rises.
  • Fig.2 is a block diagram of the mobile phone 2.
  • The mobile phone 2 includes a communication unit 20, a display control unit 21, a display 2a, an operation control unit 22, and an operation unit 23.
  • The communication unit 20 executes data communication with the information device 3 via the electric communication circuit 4. The display control unit 21 controls the display 2a of the mobile phone 2 to display the screen information sent from the information device 3. Furthermore, the display control unit 21 controls the display 2a to display a cursor and grid lines (explained afterwards).
  • The display 2a is, for example, a liquid crystal display.
  • The operation control unit 22 executes various kinds of data conversion based on input data from operation buttons 24 of the operation unit 23.
  • Fig.3 shows screen information on the display 3a of the information device 3 as a remote operation object and a part of the screen information on the display 2a of the mobile phone 2.
  • The display 3a of the information device 3 such as the personal computer includes a relative large screen. For example, the screen is composed by pixels of "(1024 dots) X (768 dots)" (XGA standard) . On the other hand, while a screen of the display 2a may have a high resolution, the display 2a is smaller than the display 3a. For example, the screen is composed by pixels of "(240 dots) X (320 dots)" (QVGA standard).
  • Accordingly, in case of displaying screen information of the display 3a of the information device 3 on the display 2a of the mobile phone 2, a part of the screen information is extracted and displayed on the display 2a.
  • Fig.4 is a schematic diagram of an operation panel (operation unit 32) of the mobile phone 2. The operation unit 23 includes a plurality of operation buttons 24.
  • On an upper part of the operation unit 23, four arrow buttons of top and bottom and right and left, i.e., "top" arrow button, "bottom" arrow button, "right" arrow button, and "left" arrow button, are located. Furthermore, on a center part, surrounded by the four arrow buttons, "confirmation" button is located.
  • On lower part of the operation unit 23, dial buttons are located. The dial buttons include "1" button ~"9" button located as ((three lines) X (three rows)), "0" button, "*" button, and "#" button. Furthermore, "call" button is prepared.
  • Fig. 5 is a schematic diagram to explain prior method for moving a cursor using the operation buttons 24.
  • In Fig.5, a symbol ("+" surrounded by "o") represents a cursor. In case of moving a cursor, arrow buttons of top and bottom and right and left are often used. Briefly, whenever the arrow buttons are pushed, the cursor is moved a moving distance d. In example of Fig. 5, the cursor is moved to the right by pushing a "right" arrow button one time, and the cursor is moved to the bottom by pushing a "bottom" arrow button one time.
  • At timing that the cursor is moved to a desired position, for example, by pushing a "confirmation" button, operation equivalent to click a mouse button of the information device 3 is realized.
  • If the moving distance d is fixed, the cursor cannot be pointed on a middle point of the moving distance d. Accordingly, the moving distance d can be changed by set.
  • For example, in status that the moving distance d of one time is 8 dot, assume that a cursor is moved to the right direction (+x direction) as 36 dot and the bottom direction (+y direction) as 40 dot. By pushing a "right" arrow button four times and pushing a "bottom" arrow button five times, the cursor is moved to a left side position as 4 dot from the target position. Accordingly, by setting the moving distance d as 4 dot and pushing the "right" arrow button one time, the cursor is moved to the target position. In this case, even if set operation of the moving distance d is excluded, push of operation buttons of ten times is necessary.
  • In case that a screen size of the mobile phone 2 is "a × b" dot, the moving distance is d dot and the present position of the cursor is (x, y), average of push times of the arrow buttons (top and bottom and right and left) necessary for moving is approximated by following equation (1). u = 0 , 1 , 2 , , x x u / d + u = x + 1 , x + 2 , , a u x / d / a + v = 0 , 1 , 2 , , y y v / d + v = y + 1 , y + 2 , , b v y / d / b
    Figure imgb0001
    In above equation (1), operation [p] is raised result of part below a decimal point of p.
  • The equation (1) is a discrete equation. In order to simplify calculation, the equation (1) is approximated by following continuous equation (2). 0 x x u / d d u + x a u x / d d u / a + 0 y y v / d d v + y b v y / d d v / b
    Figure imgb0002
  • By calculating the equation (2), following equation is obtained. x 2 a x + a 2 / 2 / a d + y 2 b y + b 2 / 2 / b d
    Figure imgb0003
    Briefly, in case that a screen size of the mobile phone 2 is "a × b" dot, the moving distance is d dot and the present position of the cursor is (x, y) , average of push times of the arrow buttons (top and bottom and right and left) necessary for moving is approximated by following equation (3).
  • x 2 a x + a 2 / 2 / a d + y 2 b y + b 2 / 2 / b d
    Figure imgb0004
    0 x a , 0 y b
    Figure imgb0005
    On assumption that a target point of the cursor is uniformly distributed on area of screen size "(a × b) dot", the equation (3) represents the average of push times.
  • Nowadays, a screen size of QVGA standard which is a general screen size of the mobile phone 2 is "240 × 320" dot. Accordingly, by assigning "a = 240, b = 320" and "d = 8" as the moving distance to the equation (3), following equation (4) is obtained. x 2 240 x + 28800 / 1920 + y 2 320 y + 51200 / 2560
    Figure imgb0006
    0 x 240 , 0 y 320
    Figure imgb0007
    A calculation result of the equation (4) is minimum 17.5 for " (x, y) = (120, 160) " (center on a screen of the display 2a), and maximum 35 for "(x, y) = (0, 0)" (corner of the screen). Average of the calculation result is 23.333.
  • In order to reduce push times of the operation button, the moving distance d of the cursor by push of one time may be lengthened. However, probability that a position depart from a target position is pointed on the screen is high. As a result, frequency to repeatedly set the moving distance d increases, and actual operation is not effective for a user.
  • A button operation of the mobile phone 2 includes a long push (remain pushing for a while) and a short push (usual push operation) . Accordingly, the moving distance d may be changed between the long push and the short push. Furthermore, by continuously pushing the button after the long push, an operation status is transferred to "repeat" and the long push is repeated. Accordingly, the moving distance d may be changed by repeat times.
  • However, the long push takes a longer time than the short push. Accordingly, above idea is not definite settlement means to reduce moving time of the cursor.
  • Fig. 6 is a schematic diagram of moving method of the cursor according to a first embodiment.
  • In the mobile phone 2 of the first embodiment, by pushing a special button (For example, "call" button), a cursor is compulsorily moved from the present position to a center of the screen. In the operation control unit 22 of the mobile phone 2, this operation is realized by setting position data of the cursor to a center coordinate "(x, y) = (0, 0)" on the screen when push of "call" button is recognized.
  • In case that a moving destination (target position) is near the present position of the cursor, the cursor is not necessarily moved to the center. If the cursor is moved to the target position after moving the center by pushing the "call" button, irrespective of the present position of the cursor, the average of push times of operation buttons to move the cursor to the target position is 17.5. By considering push of "call" button, the average is 18.5
  • As mentioned-above, in case that a cursor is located on arbitrary position of the screen (prior art), the average of push times is 23.333. Accordingly, in the mobile phone 2 of the first embodiment, the average of push times is reduced as about five times. As a result, push time of operation buttons to move the cursor to the target position is shortened and operability improves.
    (The second embodiment)
    Fig.7 is a flow chart of operation example of the mobile phone 2 according to a second embodiment. Figs.8 and 9 are schematic diagrams to explain operation examples of the mobile phone 2 according to the second embodiment.
  • In the mobile phone 2 of the second embodiment, in order to effectively move a cursor, "1" button-"9" button (first button), and one predetermine button, for example, "call" button (second button), are used.
  • In case of moving a cursor from the present position, a user first pushes a "call" button (ST1).
  • By pushing the "call" button, the mobile phone 2 changes processing from a usual operation mode to a quick moving mode of the cursor. Furthermore, by pushing the "call" button, as shown in Fig.8, the display control unit 21 displays a large grid line (first grid line) of "(three lines) × (three rows)" on the display 2a. Nine large cells (first cell) are formed by this grid line (ST2).
  • In Fig.8, the grid line is used for displaying the first cell. However, method for discriminately displaying each cell is not limited to the grid line and any method may be used. For example, lattice points of each cell may be displayed, or a background color of each cell may be different. In the following explanation, a grid line is used to discriminate display of each cell. However, as mentioned-above, another method to discriminately display may be used.
  • In case of pushing the "call" button again (Yes at ST3), by deciding that previous operation is cancelled, the grid line is cleared (erased) and the processing is advanced to step ST1. In case of not pushing the "call" button, the processing is forwarded to step ST4.
  • At step ST4, a user pushes any button of nine dial buttons ("1" button~"9" button). "1" button-"9" button are arranged as "(three lines) × (three rows)". As shown in Fig.8, a large grid line corresponds to a position of each cell divided on the screen. Accordingly, a user can easily select a dial button corresponding to a target position of the cursor by watching cells on the display 2a.
  • Fig.9 shows a display example of a screen based on operation flow. Fig. 9A shows a display example on which large grid line is displayed by pushing a "call" button at ST2. In Fig.9A, a position of a cursor (left upper side) represents a present position of the cursor (before moving).
  • Fig.9B shows a display example after pushing a "4" button at ST4. By pushing the "4" button, the cursor is moved to a center of a cell (left middle side) corresponding to a position of the "4" button. Additionally, small grid line (second grid line) of "(three lines) x (three rows)" is displayed in the cell. This grid line forms nine small cells (second cell) (ST5).
  • In case of pushing the "call" button again (Yes at ST6) , previous operation is decided to be canceled, the small grid line is cleared and processing is returned to ST3. In case of not pushing the "call" button, processing is forwarded to ST7.
  • At ST7, a user selectively pushes "1" button-"9" button corresponding to a target position. In Fig.9C, "9" button is pushed. By pushing the "9" button, the cursor is moved to a position of the small cell corresponding to the "9" button. Additionally, all grid lines are cleared and a display status is returned to usual operation mode (Fig.9D) . In the operation mode of Fig. 9D, the cursor is moved by unit of a moving distance d (For example, d = 8 dot) using arrow buttons (top and bottom and left and right) , and the cursor is lastly moved to the target position.
  • In comparison with a screen size of the display 2a, a vertical length and a horizontal length of the small cell are respectively one ninth. In case that the screen size of the display 2a is "(240 dot) X (320 dot)", a size of the small cell is "(27 dot) X (36 dot)". Accordingly, average of push times of the cursor to move from the present position in Fig. 9D to the target position is obtained by assigning "a = 27, b = 36, d = 8" to the equation (3). This is represented as following equation (5).
  • x 2 27 x + 364.5 / 216 + y 2 36 y + 648 / 288 + 3
    Figure imgb0008
    0 x 27 , 0 y 36
    Figure imgb0009
    "3" at last term of the equation (5) corresponds to one push of "call" button (ST1) and two pushes of dial button (ST4, ST7). In the equation (5), the minimum is 4.969, the maximum is 6.939, and the average is about 5.625.
  • Briefly, in the mobile phone 2 of the second embodiment, the average of push times of operation buttons for cursor to move from the present position to the target position is about six, which is a quarter of average "twenty three" of prior art.
  • As mentioned-above, in the mobile phone 2 of the second embodiment, push times of operation buttons necessary for cursor moving is greatly reduced. Accordingly, a cursor can be moved to a target position for a short time and operability is improved.
  • (The third embodiment)
    Fig.10 is a flow chart of operation of the mobile phone 2 according to a third embodiment. Fig.11 is display example of the display 2a based on operation flow of the mobile phone 2 according to the third embodiment.
  • In the second embodiment, cursor moving is executed using dial buttons ("1" button~"9" button). On the other hand, in the third embodiment, cursor moving is executed using arrow buttons (top and bottom and right and left).
  • Operation by dial buttons is simple. However, some user operates by confirming a position of the button. On the other hand, arrow buttons (top and bottom and right and left) are easy for the user to operate without confirming the position of the button (blind touch).
  • In case of moving a cursor using arrow buttons (top and bottom and right and left), a moving direction of the cursor is more important than a position of the cursor on a screen. Accordingly, in the third embodiment, the cursor is displayed on a lattice point of grid line different from the second embodiment (cursor is displayed on a center of the cell). In this display mode, the cursor is moved on the grid line. Accordingly, the grid line represents a locus of the cursor and is congenial to the arrow buttons. As a result, quick operation is possible for the user.
  • At ST10, by pushing a special button (For example, "call" button (first button)), the mobile phone 2 changes processing from usual operation mode to quick moving mode of cursor.
  • Furthermore, by pushing "call" button, large grid lines (first grid line) on which the present position of the cursor is one lattice point are displayed on a screen (ST11). Fig.11A shows this display status.
  • In the second embodiment, in order to coincide location of dial buttons with location of cells formed by grid lines, the grid line divides the screen into nine cells ((three lines) X (three rows)). However, the third embodiment does not have such restriction. Accordingly, the number of grid lines and space between grid lines can be selected based on visibility. As shown in Fig .11, a vertical space and a horizontal space between grid lines may be respectively equal. For example, in the third embodiment, a space between grid lines along a vertical direction and a horizontal direction are respectively 80 dots.
  • A user pushes the arrow buttons (top and bottom and right and left) while watching the display (blind touch) in order to get near the cursor from the present position to the target position. By one push of the arrow buttons, the cursor is moved on the lattice point of each cell (formed by grid lines).
  • In Fig.11B, by one push of a "bottom" arrow button and one push of a "right" arrow button, the cursor is moved from the present position to a position adjacent to the target position.
  • After moving the cursor to a position adjacent to the target point, a user pushes a special button (second button, for example, a "confirmation" button) (ST16).
  • By pushing the "confirmation" button, small grid lines (second grid line) dividing four cells (first cell) adjoining a lattice point of the cursor are displayed. The small grid lines divide a large cell into nine small cells (second cell) . Fig.11C shows this display status. In the third embodiment, the large cell is respectively divided into three parts along a vertical direction and a horizontal direction. A space between two small cells along the vertical direction and the horizontal direction is respectively 27 dots.
  • At ST18, by pushing the arrow buttons (top and bottom and right and left), the cursor further nears the target position. In this case, a moving unit of the cursor is the small cell. Accordingly, fine moving of the cursor is possible. In Fig.11D, by one push of a "bottom" arrow button and one push of a "right" arrow button, the cursor is further moved near the target position.
  • After moving the cursor near the target position, a user pushes a "confirmation" button (ST22). By pushing the "confirmation" button, the cursor position is determined, and processing is returned from the quick moving mode of the cursor to the usual operation mode. Furthermore, all grid lines are cleared (ST23). Fig.11E shows this display status.
  • In case of finely adjusting the cursor position by the usual operation mode, the cursor may be moved by unit of predetermined moving distance d (For example, 8 dots) using the arrow buttons (top and bottom and right and left) .
  • In case of moving the cursor on lattice points of the large grid line, the cursor is moved as 80 dots by one push of the arrow button. As mentioned-above, in the prior art (usual operation mode), a moving distance of one push of the arrow button is 8 dots. Accordingly, average of push times of button is one tenth of the equation (4), i.e., about 2.333.
  • In case of moving a cursor on lattice points of the small grid line, the cursor is moved on "3 X 3" small cells divided in the large cell. Accordingly, the average of push times more decreases than average of push times in case of moving a cursor on lattice points of the large grid lines. Briefly, the average of push times in case of moving a cursor on lattice points of the small grid lines is below 2.333.
  • A size of the small cell is "(27 dots) X (27 dots)". Accordingly, in the usual operation mode, average of push times by unit of 8 dots to finely adjust a cursor position is approximately calculated by the equation (5), i.e., 2.333.
  • Furthermore, by considering one push of the "call" button and two pushes of the "confirmation" button, average of push times of buttons of the mobile phone 2 of the third embodiment is calculated as follows. 2.333 + 2.333 + 2.333 + 3 10 times
    Figure imgb0010
    In comparison with average "6" of push times of the mobile phone 2 of the second embodiment, above average "10" is larger. However, in comparison with average "23" of push times of the prior art, above average "10" is below a half of the average "23".
  • As mentioned-above, in the mobile phone 2 of the third embodiment, in the same way as the second embodiment, push times of operation buttons necessary for cursor moving is greatly reduced. Accordingly, the cursor can be moved to a target position for a short time, and the user's operability improves.
  • In case of using the arrow buttons (top and bottom and right and left), the cursor is often moved along a direction toward outside of a display area of the display 2a. In this case, in the third embodiment, it is decided whether a moving destination of the cursor is outside of the display area (ST13) . In case that the moving destination is outside of the display area, a part of screen information on the display 2a is shifted along a reverse direction of the cursor moving direction, and the cursor is positioned on new screen information on the display 2a.
  • Figs.12A, 12B, and 12C show a concrete display example. Fig.12A shows one example of screen information of the display 3a of the information device 3. A part of the screen information (a region surrounded by left side rectangle in Fig.12A) is extracted and displayed on the display 2a of the mobile phone 2 as shown in Fig.12B.
  • In case of further moving the cursor from the present position on the display 2a of Fig. 12B to the right side (including target position) on the display 2a, the cursor cannot be moved to a target position because the target position is not included in the present screen information of the display 2a. Accordingly, in the third embodiment, for example, in case of pushing a "right" arrow button, a view (a part of the present screen information on the display 3a) is shifted (moved) to the left side on the display 2a as a space between grid lines. As a result, new part of screen information (right side screen information not displayed up to the present) is displayed on the display 2a, and the cursor can be moved to the target position on the new part of screen information.
  • By this operation as one push of the "right" arrow button, cursor moving and view moving can be simultaneously executed. Accordingly, high effective operability can be realized.
  • Furthermore, as shown in Fig.13A, in case of displaying small grid lines, it often happens that a cursor is moved to outside of display area of the small grid lines.
  • In the third embodiment, in this case, as shown in Fig. 13B, the display area of the small grid lines is automatically shifted (slide) along a moving direction of the cursor. As a result, moving of the cursor using the small grid lines can be continually executed, and the user's operability improves.
  • Furthermore, as shown in Fig.14A, in case of displaying small grid lines, it often happens that a cursor is moved to both outside of display area of the small grid lines and outside of display area of the display 2a.
  • In the third embodiment, in this case, as shown in Fig.14B, the display area of the small grid lines and a view of screen information of the display 2a are automatically shifted along a reverse direction of the moving direction of the cursor as a space between large grid lines (ST20) . As a result, new part of screen information (right side screen information not displayed up to the present) is displayed on the display 2a, moving of the cursor using the small grid lines can be executed, and the user' s operability improves.
  • In the third embodiment, in the same way as the second embodiment, cancel operation using the "call" button is possible.
  • At ST15 in Fig. 10, by pushing the "call" button, the large grid lines are cleared, and processing is returned to usual operation mode (ST10).
  • Furthermore, by pushing the "call" button during displaying small grid lines (Yes at ST21), the small grid lines are cleared, and processing is returned to the display status of large grid lines. Figs.15A and B show display examples of this cancel operation.
  • In the third embodiment, in case of changing the processing from the usual operation mode to the quick moving mode of cursor by pushing the "call" button, the present position of the cursor is not changed as shown in Fig.11A. Based on the kind of an application software operating on the information device 3, it happens that change of the present position of the cursor in the usual operation mode is regarded as specified information. However, in the third embodiment, this application software is not affected.
  • (The fourth embodiment)
  • Figs.16A~16E are schematic diagrams to explain operation of the mobile phone 2 according to a fourth embodiment.
  • Basic operation flow of the mobile phone 2 of the fourth embodiment is the same as the third embodiment of Fig.10. Compared to the third embodiment, the cursor moves differently in case of changing the processing from usual operation mode to quick moving mode of cursor.
  • In the mobile phone 2 of the fourth embodiment, by pushing the "call" button, large grid lines are displayed and the present position of the cursor is moved to a lattice point in the center of the display. Fig. 16A shows this display status. Other operation is same as the third embodiment.
  • As inferred from the equation (3), by setting an initial position of the cursor to the center of the display, irrespective of moving on each cell, average of push times of arrow buttons (top and bottom and right and left) can be minimized. In this meaning, the fourth embodiment adds the merit of the first embodiment to the merit of the third embodiment.
  • In the disclosed embodiments, the processing can be accomplished by a computer-executable program, and this program can be realized in a computer-readable memory device.
  • In the embodiments, the memory device, such as a magnetic disk, a flexible disk, a hard disk, an optical disk (CD-ROM, CD-R, DVD, and so on), an optical magnetic disk (MD and so on) can be used to store instructions for causing a processor or a computer to perform the processes described above.
  • Furthermore, based on an indication of the program installed from the memory device to the computer, OS (operation system) operating on the computer, or MW (middle ware software), such as database management software or network, may execute one part of each processing to realize the embodiments.
  • Furthermore, the memory device is not limited to a device independent from the computer. By downloading a program transmitted through a LAN or the Internet, a memory device in which the program is stored is included. Furthermore, the memory device is not limited to one. In the case that the processing of the embodiments is executed by a plurality of memory devices, a plurality of memory devices may be included in the memory device. The component of the device may be arbitrarily composed.
  • A computer may execute each processing stage of the embodiments according to the program stored in the memory device. The computer may be one apparatus such as a personal computer or a system in which a plurality of processing apparatuses are connected through a network. Furthermore, the computer is not limited to a personal computer. Those skilled in the art will appreciate that a computer includes a processing unit in an information processor, a microcomputer, and so on. In short, the equipment and the apparatus that can execute the functions in embodiments using the program are generally called the computer.

Claims (14)

  1. A mobile phone (2) having a function to remotely operate an information device (3), comprising:
    a communication unit (20) configured to receive information displayed on the information device (3);
    a display device (2a) displaying a part of the information;
    a plurality of operation buttons (24) each inputting an operation signal;
    a display control unit (21) configured to divide a screen of the display device (2a) into a plurality of cells; to discriminately display each of the plurality of cells on the screen, and to display a cursor on the screen, the cursor overlapping the part of the information; and
    an operation control unit (22) configured to move the cursor to one of the cells of the screen in response to the operation signal;
    characterised in that;
    said display control unit (21) is configured to display a grid line representing a boundary of each cell on the screen,
    and the plurality of operation buttons (24) includes first buttons of nine units arranged in lattices of three lines and three rows, and a second button of one unit; whereby, in response to a push of the second button,
    said display control unit (21) displays a first grid line dividing the screen into first cells of nine units of three lines and three rows, and the cursor located in one of the first cells;
    and, in response to a first push of one of the first buttons,
    said operation control unit (22) moves the cursor into one first cell corresponding to the first button of the first push, and
    said display control unit (21) displays a second grid line dividing the one first cell into second cells of nine units of three lines and three rows;
    and in response to a second push of one of the first buttons,
    said operation control unit (22) moves the cursor into one second cell corresponding to the first button of the second push, and
    said display control unit (21) clears the first and second grid lines.
  2. A mobile phone (2) having a function to remotely operate an information device (3), comprising:
    a communication unit (20) configured to receive information displayed on the information device (3);
    a display device (2a) displaying a part of the information;
    a plurality of operation buttons (24) each inputting an operation signal;
    a display control unit (21) configured to divide a screen of the display device (2a) into a plurality of cells, to discriminately display each of the plurality of cells on the screen, and to display a cursor on the screen, the cursor overlapping the part of the information; and
    an operation control unit (22) configured to move the cursor to one of the cells of the screen in response to the operation signal;
    characterised in that:
    said display control unit (21) is configured to display a grid line representing a boundary of each cell on the screen,
    and the plurality of operation buttons (24) includes arrow buttons indicating directions of top, bottom, right, and left, a first button of one unit, and a second button of one unit;
    whereby, in response to a push of the first button,
    said display control unit (21) divides the screen into a plurality of first cells, and displays a first grid line as the boundary of each first cell in which one lattice point is a present position of the cursor on the screen;
    and, in response to a first push of the arrow buttons,
    said operation control unit (22) moves the cursor on each lattice point of the first grid line in correspondence with a direction of the arrow buttons of the first push;
    and, in response to a first push of the second button,
    said display control unit (21) divides the first cell into a plurality of second cells, and displays a second grid line as the boundary of each second cell in which one lattice point is a present position of the cursor on a predetermined area centering around the present position of the cursor;
    and, in response to a second push of the arrow buttons,
    said operation control unit (22) moves the cursor on each lattice point of the second grid line in correspondence with a direction of the arrow buttons of the second push;
    and, in response to a second push of the second button,
    said display control unit (21) clears the first and second grid lines.
  3. The mobile phone according to claim 2, wherein the second button is located at a center of the arrow buttons.
  4. The mobile phone according to claim 2, wherein, when the cursor is moved to outside of a display area of the screen in response to a push of the arrow buttons, said display control unit slides the part of the information along a reverse direction of a moving direction of the cursor on the screen, and displays a new part of the information on the screen.
  5. The mobile phone according to claim 2, wherein, when the cursor is moved to outside of a display area of the second grid line in response to a push of the arrow buttons, said display control unit slides the display area of the second grid line along a reverse direction of a moving direction of the cursor on the screen.
  6. The mobile phone according to claim 2, wherein, when the first grid line is displayed, said display control unit clears the first grid line in response to a push of the first button.
  7. The mobile phone according to claim 2, wherein, when the second grid line is displayed, said display control unit displays the first grid line without the second grid line in response to a push of the first button.
  8. A method for controlling a mobile phone (2) remotely operating an information device (3), comprising:
    receiving information displayed on the information device (3);
    displaying a part of the information on a screen of the mobile phone (2);
    inputting an operation signal through a plurality of operation buttons (24);
    dividing the screen into a plurality of cells;
    discriminately displaying each of the plurality of cells on the screen;
    displaying a cursor on the screen, the cursor overlapping the part of the information; and
    moving the cursor to one of the cells of the screen in response to the operation signal;
    characterised by:
    at the discriminately displaying step,
    displaying a grid line representing a boundary of each cell on the screen,
    the plurality of operation buttons (24) including first buttons of nine units arranged on lattices of three lines and three rows, and second button of one unit;
    at the discriminately displaying step, in response to a push of the second button, displaying a first grid line dividing the screen into first cells of nine units of three lines and three rows, and the cursor located in one of the first cells;
    at the moving step, in response to a first push of one of the first buttons,
    moving the cursor into one first cell corresponding to the first button of the first push, and
    displaying a second grid line dividing the one first cell into second cells of nine units of three lines and three rows;
    and, in response to a second push of one of the first buttons,
    moving the cursor into one second cell corresponding to the first button of the second push, and
    clearing the first and second grid lines.
  9. A method for controlling a mobile phone (2) remotely operating an information device (3), comprising:
    receiving information displayed on the information device (3);
    displaying a part of the informtation on a screen of the mobile phone (2);
    inputting an operation signal through a plurality of operation buttons (24);
    dividing the screen into a plurality of cells;
    discriminately displaying each of the plurality of cells on the screen;
    displaying a cursor on the screen, the cursor overlapping the part of the information; and
    moving the cursor to one of the cells of the screen in response to the operation signal;
    characterised by:
    at the discriminately displaying step,
    displaying a grid line representing a boundary of each cell on the screen,
    the plurality of operation buttons (24) including arrow buttons indicating directions of top, bottom, right, and left, a first button of one unit, and a second button of one unit;
    at the discriminately displaying step, in response to a push of the first button,
    dividing the screen into a plurality of first cells, and
    displaying a first grid line as the boundary of each first cell in which one lattice point is a present position of the cursor on the screen;
    at the moving step, in response to a first push of the arrow buttons,
    moving the cursor on each lattice point of the first grid line in correspondence with a direction of the arrow buttons of the first push;
    in response to a first push of the second button,
    dividing the first cell into a plurality of second cells and
    displaying a second grid line as the boundary of each second cell in which one lattice point is a present position of the cursor on a predetermined area centering around the present position of the cursor;
    in response to a second push of the arrow buttons,
    moving the cursor on each lattice point of the second grid line in correspondence with a direction of the arrow buttons of the second push,
    and, in response to a second push of the second button,
    clearing the first and second grid lines.
  10. The method according to claim 9, wherein the second button is located at a center of the arrow buttons.
  11. The method according to claim 9, further comprising:
    when the cursor is moved to outside of a display area of the screen in response to push of the arrow buttons,
    sliding the part of the information along a reverse direction of a moving direction of the cursor on the screen; and displaying a new part of the information on the screen.
  12. The method according to claim 9, further comprising:
    when the cursor is moved to outside of a display area of the second grid line in response to a push of the arrow buttons,
    sliding the display area of the second grid line along a reverse direction of a moving direction of the cursor on the screen.
  13. The method according to claim 9, further comprising:
    when the first grid line is displayed,
    clearing the first grid line in response to a push of the first button.
  14. The method according to claim 9, further comprising:
    when the second grid line is displayed,
    displaying the first grid line without the second grid line in response to a push of the first button.
EP06250872A 2005-07-12 2006-02-17 Mobile phone and mobile phone control method Expired - Fee Related EP1744240B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2005203066A JP4619882B2 (en) 2005-07-12 2005-07-12 Mobile phone and remote control method thereof

Publications (2)

Publication Number Publication Date
EP1744240A1 EP1744240A1 (en) 2007-01-17
EP1744240B1 true EP1744240B1 (en) 2008-08-27

Family

ID=37075498

Family Applications (1)

Application Number Title Priority Date Filing Date
EP06250872A Expired - Fee Related EP1744240B1 (en) 2005-07-12 2006-02-17 Mobile phone and mobile phone control method

Country Status (6)

Country Link
US (1) US7526316B2 (en)
EP (1) EP1744240B1 (en)
JP (1) JP4619882B2 (en)
KR (1) KR100736195B1 (en)
CN (1) CN100559807C (en)
DE (1) DE602006002440D1 (en)

Families Citing this family (56)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101142544B (en) * 2005-04-08 2012-03-07 怀尔德彼康股份有限公司 Screen information edition device, method
EP1771002B1 (en) * 2005-09-30 2017-12-27 LG Electronics Inc. Mobile video communication terminal
WO2007063588A1 (en) * 2005-11-30 2007-06-07 Fujitsu Limited Information processor, electronic device, and program
GB0618979D0 (en) * 2006-09-27 2006-11-08 Malvern Scient Solutions Ltd Cursor control method
US20080120448A1 (en) * 2006-11-21 2008-05-22 Microsoft Corporation Remote mouse and keyboard using bluetooth
TWM318857U (en) * 2007-04-04 2007-09-11 Cal Comp Electronics & Comm Co Network communicator with function of presentation controller
JP5003377B2 (en) * 2007-09-21 2012-08-15 パナソニック株式会社 Mark alignment method for electronic devices
WO2009081994A1 (en) * 2007-12-25 2009-07-02 Nec Corporation Information processing device and information processing method
TW200935278A (en) * 2008-02-04 2009-08-16 E Lead Electronic Co Ltd A cursor control system and method thereof
JP5384848B2 (en) * 2008-04-28 2014-01-08 日本電気株式会社 Electronic device and pointing method therefor
ITFI20080103A1 (en) * 2008-05-22 2009-11-23 Fimi S R L METHOD AND APPARATUS FOR ACCESS TO COMMUNICATION AND / OR WRITING THROUGH THE USE OF A DEDICATED INTERFACE AND SCANNING CONTROL WITH AN EARLY-VISUAL VISUAL FEEDBACK.
CN102132240B (en) * 2008-09-26 2017-06-09 京瓷株式会社 Electronic equipment
US8527894B2 (en) * 2008-12-29 2013-09-03 International Business Machines Corporation Keyboard based graphical user interface navigation
US10013135B2 (en) 2009-03-20 2018-07-03 Microsoft Technology Licensing, Llc Adjustable user interfaces with movable separators
TWI486946B (en) * 2009-04-01 2015-06-01 Mstar Semiconductor Inc Method for moving a cursor and display apparatus using the same
FR2944900A1 (en) * 2009-04-22 2010-10-29 Jean Loup Gillot Screen object selection method for man-machine interface, involves placing object and indicator on visual bottoms comprising arrow, and directing arrow towards key of keyboard, where numerical character of keyboard is identical to indicator
CN102033691B (en) * 2009-09-30 2013-01-30 北大方正集团有限公司 Cursor movement prompting method and device
US20110225553A1 (en) * 2010-03-15 2011-09-15 Abramson Robert W Use Of Standalone Mobile Devices To Extend HID Capabilities Of Computer Systems
US20130139085A1 (en) * 2010-05-23 2013-05-30 Kenichi Ichino Operation Support Computer Program, Operation Support Computer System
EP2403227A1 (en) * 2010-06-30 2012-01-04 MStar Semiconductor, Inc Method for moving a cursor and display apparatus
JP2012014516A (en) * 2010-07-01 2012-01-19 Mstar Semiconductor Inc Method for moving cursor and display device using the same
WO2012117689A1 (en) * 2011-03-01 2012-09-07 パナソニック株式会社 Information terminal device and biological sample measurement device
CN102109963B (en) * 2011-03-25 2013-03-06 威盛电子股份有限公司 Method for cursor positioning on screen
US9850613B2 (en) 2011-09-09 2017-12-26 Panasonic Intellectual Property Management Co., Ltd. Laundry system, communication device, communication method, communication program and washing machine
US9565156B2 (en) 2011-09-19 2017-02-07 Microsoft Technology Licensing, Llc Remote access to a mobile communication device over a wireless local area network (WLAN)
US8490008B2 (en) 2011-11-10 2013-07-16 Research In Motion Limited Touchscreen keyboard predictive display and generation of a set of characters
US9310889B2 (en) 2011-11-10 2016-04-12 Blackberry Limited Touchscreen keyboard predictive display and generation of a set of characters
US9122672B2 (en) 2011-11-10 2015-09-01 Blackberry Limited In-letter word prediction for virtual keyboard
TWI448961B (en) * 2011-12-16 2014-08-11 Wistron Neweb Corp Electronic apparatus and control method thereof
US9557913B2 (en) 2012-01-19 2017-01-31 Blackberry Limited Virtual keyboard display having a ticker proximate to the virtual keyboard
US9152323B2 (en) 2012-01-19 2015-10-06 Blackberry Limited Virtual keyboard providing an indication of received input
DE112012000189B4 (en) 2012-02-24 2023-06-15 Blackberry Limited Touch screen keyboard for providing word predictions in partitions of the touch screen keyboard in close association with candidate letters
EP2830292B1 (en) 2012-03-19 2019-01-23 Nec Corporation Onboard information system
US9201510B2 (en) 2012-04-16 2015-12-01 Blackberry Limited Method and device having touchscreen keyboard with visual cues
US9292192B2 (en) 2012-04-30 2016-03-22 Blackberry Limited Method and apparatus for text selection
US8640252B2 (en) 2012-05-07 2014-01-28 International Business Machines Corporation Obfuscating entry of sensitive information
KR101337520B1 (en) * 2012-05-17 2013-12-05 삼성디스플레이 주식회사 Display apparatus
US9207860B2 (en) 2012-05-25 2015-12-08 Blackberry Limited Method and apparatus for detecting a gesture
JP5414843B2 (en) * 2012-05-31 2014-02-12 株式会社東芝 Electronic device, image data display control method, and program
US9116552B2 (en) * 2012-06-27 2015-08-25 Blackberry Limited Touchscreen keyboard providing selection of word predictions in partitions of the touchscreen keyboard
US9063653B2 (en) 2012-08-31 2015-06-23 Blackberry Limited Ranking predictions based on typing speed and typing confidence
US9524290B2 (en) 2012-08-31 2016-12-20 Blackberry Limited Scoring predictions based on prediction length and typing speed
CN102999224A (en) * 2012-12-29 2013-03-27 苏州市智诚光学科技有限公司 Notebook glass touch panel capable of positioning accurately
KR20150069801A (en) * 2013-12-16 2015-06-24 삼성전자주식회사 Method for controlling screen and electronic device thereof
US9436348B2 (en) * 2014-03-18 2016-09-06 Blackberry Limited Method and system for controlling movement of cursor in an electronic device
EP2985708A1 (en) * 2014-08-15 2016-02-17 Dassault Systèmes Navigation through the hierarchical structure of a three-dimensional modeled assembly of parts
CN105467874A (en) * 2015-11-30 2016-04-06 小米科技有限责任公司 Method and device for identifying categories of electronic devices on intelligent sockets
CN105630334B (en) * 2016-02-15 2019-08-02 青岛海信电器股份有限公司 A kind of method and device that control virtual mouse is mobile
CN106293097A (en) * 2016-08-18 2017-01-04 青岛海信医疗设备股份有限公司 A kind of cursor-moving method, device and armarium shown for medical treatment
CN106326648A (en) * 2016-08-18 2017-01-11 青岛海信医疗设备股份有限公司 Cursor moving method and device for medical display and medical equipment
CN106250711B (en) * 2016-08-18 2019-12-06 青岛海信医疗设备股份有限公司 Cursor moving method and device for medical display and medical equipment
CN106293098B (en) * 2016-08-18 2020-09-11 青岛海信医疗设备股份有限公司 Gesture-based cursor moving method and device for medical display
CN106325507B (en) * 2016-08-18 2019-02-15 青岛海信医疗设备股份有限公司 A kind of cursor-moving method, device and Medical Devices for medical treatment display
CN106325673A (en) * 2016-08-18 2017-01-11 青岛海信医疗设备股份有限公司 Cursor moving method and device for medical display and medical equipment
US20190149959A1 (en) 2017-11-16 2019-05-16 Motorola Solutions, Inc Method for controlling a virtual talk group memeber to perform an assignment
US11526322B2 (en) * 2018-08-25 2022-12-13 Microsoft Technology Licensing, Llc Enhanced techniques for merging content from separate computing devices

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19521453A1 (en) 1995-06-13 1996-12-19 Andre Knauf Cordless telephone or mobile telephone radio communication for dual operation as telephone or computer remote control
US6437803B1 (en) * 1998-05-29 2002-08-20 Citrix Systems, Inc. System and method for combining local and remote windows into a single desktop environment
JPH10312233A (en) * 1997-05-13 1998-11-24 Nec Corp Point designating method at information processing picture
US6795055B1 (en) * 2000-05-30 2004-09-21 Agilent Technologies, Inc. Devices, systems and methods for facilitating positioning of cursor on display device
US6545666B1 (en) * 2000-05-30 2003-04-08 Agilent Technologies, Inc. Devices, systems and methods for positioning cursor on display device
JP2002014773A (en) * 2000-06-28 2002-01-18 Toshiba Corp Portable information terminal
KR20020017682A (en) * 2000-08-31 2002-03-07 서평원 Multifunction telephon
CN1464719A (en) * 2002-06-06 2003-12-31 翁延鸣 Screen selection type mobile phone
DE10229068B3 (en) * 2002-06-28 2004-02-05 Fujitsu Siemens Computers Gmbh PDA (Personal Digital Assistant) with touch screen display
US20040135819A1 (en) * 2002-10-28 2004-07-15 Shalong Maa Computer remote control
JP2004184782A (en) * 2002-12-04 2004-07-02 Footcall Co Ltd Map information acquisition system, map information acquisition method, map information display terminal and program
WO2004063914A2 (en) * 2003-01-15 2004-07-29 Koninklijke Philips Electronics N.V. Handheld device with a display screen
US7409209B2 (en) * 2003-04-24 2008-08-05 Microsoft Corporation Telephony remote control
JP4603778B2 (en) * 2003-06-20 2010-12-22 キヤノン株式会社 Image display method and image display apparatus
WO2005041029A2 (en) * 2003-10-24 2005-05-06 Matsushita Electric Industrial Co., Ltd. Remote operation system, communication apparatus remote control system and document inspection apparatus
US7624192B2 (en) * 2003-12-30 2009-11-24 Microsoft Corporation Framework for user interaction with multiple network devices
JP2005301908A (en) * 2004-04-15 2005-10-27 Toshiba Corp Information apparatus remote control system
KR20050073435A (en) * 2005-06-23 2005-07-13 (주)한아이디 System for controlling home-network using television and method thereof

Also Published As

Publication number Publication date
DE602006002440D1 (en) 2008-10-09
CN1897597A (en) 2007-01-17
CN100559807C (en) 2009-11-11
KR20070008379A (en) 2007-01-17
KR100736195B1 (en) 2007-07-06
US7526316B2 (en) 2009-04-28
US20070015534A1 (en) 2007-01-18
EP1744240A1 (en) 2007-01-17
JP4619882B2 (en) 2011-01-26
JP2007027851A (en) 2007-02-01

Similar Documents

Publication Publication Date Title
EP1744240B1 (en) Mobile phone and mobile phone control method
KR100624523B1 (en) Information equipment remote operating system
EP1947556B1 (en) Mobile electronic apparatus with touch input device and display method using the same
EP1970799B1 (en) Electronic device and method of controlling mode thereof and mobile communication terminal
US7612762B2 (en) Method and system for navigating within an image
US20050248545A1 (en) Method, apparatus, and software program for processing information
GB2324232A (en) Apparatus and method for retrieving information in a mobile information terminal
EP1980953B1 (en) Character input device
US20060114224A1 (en) Electronic apparatus, input control apparatus, and input control program storage medium
GB2329813A (en) Touch screen GUI
US20150052476A1 (en) Display device, display control method, and program
US20100289764A1 (en) Electronic device, displaying method, and recording medium
WO2006049506A1 (en) A method for remote operation of a computer using a mobile device
JP2009205492A (en) Computer remote operation system
US20130130739A1 (en) Portable electronic device and control method
JP2010102671A (en) Electronic device
JP2001282415A (en) Information selecting method, system therefor and computer readable storage medium
JP4900955B2 (en) Remote operation system, control method and program
JP4435041B2 (en) Mobile phone and remote control method thereof
US8970493B2 (en) Information processing device for changing cursor display position, computer readable non-transitory recording medium, and information processing method
CN113311982A (en) Information selection method and device
KR101849720B1 (en) System and method for providing information in phases
KR20130066831A (en) The terminal and method which zooms in or out a part of touch screen area
KR101647057B1 (en) Phased information providing system and method
KR100658940B1 (en) Key navigation method of the mobile terminal

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20060223

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA HR MK YU

17Q First examination report despatched

Effective date: 20070802

AKX Designation fees paid

Designated state(s): DE FR GB

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): DE FR GB

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REF Corresponds to:

Ref document number: 602006002440

Country of ref document: DE

Date of ref document: 20081009

Kind code of ref document: P

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

26N No opposition filed

Effective date: 20090528

REG Reference to a national code

Ref country code: FR

Ref legal event code: ST

Effective date: 20091030

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20090901

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20090302

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20100202

Year of fee payment: 5

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20110217

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20110217