EP1744240B1 - Mobile phone and mobile phone control method - Google Patents
Mobile phone and mobile phone control method Download PDFInfo
- Publication number
- EP1744240B1 EP1744240B1 EP06250872A EP06250872A EP1744240B1 EP 1744240 B1 EP1744240 B1 EP 1744240B1 EP 06250872 A EP06250872 A EP 06250872A EP 06250872 A EP06250872 A EP 06250872A EP 1744240 B1 EP1744240 B1 EP 1744240B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- cursor
- screen
- push
- button
- grid line
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0489—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using dedicated keyboard keys or combinations thereof
- G06F3/04892—Arrangements for controlling cursor position based on codes indicative of cursor displacements from one discrete location to another, e.g. using cursor control keys associated to different directions or using the tab key
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72469—User interfaces specially adapted for cordless or mobile telephones for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
Definitions
- the present invention relates to a mobile phone for remotely operating an information device, such as a personal computer, through a network, and a related method.
- Information devices often connect to a network, such as a mobile phone connectable to the Internet or a PDA (Personal Digital Assistant) connectable to a wireless LAN (Local Area Network). Furthermore, a display apparatus of some information devices have a high resolution, and an image can be finely displayed. Accordingly, by connecting a first information device with a second information device remotely located such as a personal computer (Hereinafter, PC), the first information device can control the second information device and can access data stored on the second information device.
- a network such as a mobile phone connectable to the Internet or a PDA (Personal Digital Assistant) connectable to a wireless LAN (Local Area Network).
- a display apparatus of some information devices have a high resolution, and an image can be finely displayed. Accordingly, by connecting a first information device with a second information device remotely located such as a personal computer (Hereinafter, PC), the first information device can control the second information device and can access data stored on the second information device.
- PC personal computer
- a pointing device such as a mouse or a touch panel is generally used.
- a mouse cursor can be moved in a moment to an arbitrary position on a screen of the PC.
- a mouse button By immediately pushing a mouse button after moving the mouse cursor, various kinds of menu selection and data input can be executed.
- a mobile phone typically includes numerical buttons to dial a telephone number, arrow buttons (directions of top and bottom and right and left) and a confirmation button for menu selection, and several buttons for special operation.
- a cursor in case of remotely operating a PC using a mobile phone, in comparison with operation of the mouse of the PC, a cursor cannot be moved in a moment to an arbitrary position on a display of the mobile phone. For example, by pushing the arrow buttons (directions of top and bottom and right and left) repeatedly, the cursor is gradually moved to the arbitrary position on the display. Another suitable means to easily move the cursor to the arbitrary position is not actually considered.
- DE-A-195 21 453 discloses a mobile phone controlled to remotely operate an information device, wherein a communication unit is configured to receive information displayed on the information device; a display device displays a part of the information on a screen; each of a plurality of operation buttons is configured to input an operation signal; a display control unit is configured to display a cursor on the screen, the cursor overlapping the part of the information; and an operation control unit is configured to move the cursor to a specific location of the screen in response to the operation signal.
- the invention provides mobile phones as defined in Claims 1 and 2 and controlling methods as defined in Claims 8 and 9.
- the present invention can be used for remotely operating a PC with high operability using standard operation buttons of the mobile phone.
- Fig. 1 is a component example of an information device remote operation system connected with a mobile phone.
- Fig.2 is a block diagram of a mobile phone.
- Fig.3 is a display example of a display device of a mobile phone.
- Fig. 4 is one example of operation buttons of a mobile phone.
- Fig. 5 is a schematic diagram of operation of a mobile phone.
- Fig. 6 is a schematic diagram of operation of a mobile phone according to a first embodiment.
- Fig.8 is a schematic diagram of display status of the mobile phone according to the second embodiment.
- Figs.9A ⁇ 9D are schematic diagrams of an operation of the mobile phone according to the second embodiment.
- Fig.10 is a flow chart of an operation method of a mobile phone according to a third embodiment.
- Figs.11A ⁇ 11D are schematic diagrams of a first operation of the mobile phone according to the third embodiment.
- Figs.12A ⁇ 12C are schematic diagrams of a second operation of the mobile phone according to the third embodiment.
- Figs.13A and 13B are schematic diagrams of a third operation of the mobile phone according to the third embodiment.
- Figs.14A and 14B are schematic diagrams of a fourth operation of the mobile phone according to the third embodiment.
- Figs.15A and 15B are schematic diagrams of a fifth operation of the mobile phone according to the third embodiment.
- Figs.16A ⁇ 16E are schematic diagrams of the operation of a mobile phone according to a fourth embodiment.
- Fig.1 is a block diagram of an information device remote operation system 1.
- a mobile phone 2 is connected with an information device 3 via an electric communication circuit or network 4 and a base station 5.
- the information device 3 is, for example, a personal computer.
- the information device 3 located in an office or a home can be remotely operated using the mobile phone.
- Screen information on a display 3a of the information device 3 is received via the electric communication circuit 4, and displayed on a display 2a of the mobile phone 2.
- the display 2a of the mobile phone 2 is smaller than the display 3a of the information device 3. Accordingly, a part of the screen information on the display 3a is displayed on the display 2a.
- a mouse cursor In case of directly operating the information device 3, by using a pointing device such as a mouse or a touch pad, a mouse cursor (Hereinafter, a cursor) can be moved in a moment to an arbitrary position on the display 3a.
- Fig.2 is a block diagram of the mobile phone 2.
- the mobile phone 2 includes a communication unit 20, a display control unit 21, a display 2a, an operation control unit 22, and an operation unit 23.
- the communication unit 20 executes data communication with the information device 3 via the electric communication circuit 4.
- the display control unit 21 controls the display 2a of the mobile phone 2 to display the screen information sent from the information device 3. Furthermore, the display control unit 21 controls the display 2a to display a cursor and grid lines (explained afterwards).
- the display 2a is, for example, a liquid crystal display.
- the operation control unit 22 executes various kinds of data conversion based on input data from operation buttons 24 of the operation unit 23.
- Fig.3 shows screen information on the display 3a of the information device 3 as a remote operation object and a part of the screen information on the display 2a of the mobile phone 2.
- the display 3a of the information device 3 such as the personal computer includes a relative large screen.
- the screen is composed by pixels of "(1024 dots) X (768 dots)" (XGA standard) .
- a screen of the display 2a may have a high resolution, the display 2a is smaller than the display 3a.
- the screen is composed by pixels of "(240 dots) X (320 dots)" (QVGA standard).
- Fig.4 is a schematic diagram of an operation panel (operation unit 32) of the mobile phone 2.
- the operation unit 23 includes a plurality of operation buttons 24.
- buttons of top and bottom and right and left i.e., "top” arrow button, "bottom” arrow button, “right” arrow button, and “left” arrow button, are located. Furthermore, on a center part, surrounded by the four arrow buttons, "confirmation” button is located.
- dial buttons are located on lower part of the operation unit 23 .
- the dial buttons include "1" button ⁇ "9” button located as ((three lines) X (three rows)), "0" button, "*” button, and "#” button. Furthermore, "call” button is prepared.
- Fig. 5 is a schematic diagram to explain prior method for moving a cursor using the operation buttons 24.
- a symbol (“+” surrounded by “o") represents a cursor.
- arrow buttons of top and bottom and right and left are often used. Briefly, whenever the arrow buttons are pushed, the cursor is moved a moving distance d. In example of Fig. 5 , the cursor is moved to the right by pushing a "right” arrow button one time, and the cursor is moved to the bottom by pushing a "bottom” arrow button one time.
- the moving distance d If the moving distance d is fixed, the cursor cannot be pointed on a middle point of the moving distance d. Accordingly, the moving distance d can be changed by set.
- the equation (1) is a discrete equation. In order to simplify calculation, the equation (1) is approximated by following continuous equation (2). ⁇ 0 x ⁇ x ⁇ u / d ⁇ d ⁇ u + ⁇ x a ⁇ u ⁇ x / d ⁇ d ⁇ u / a + ⁇ 0 y ⁇ y ⁇ v / d ⁇ d ⁇ d ⁇ v + ⁇ y b ⁇ v ⁇ y / d ⁇ d ⁇ v / b
- the moving distance d of the cursor by push of one time may be lengthened.
- probability that a position depart from a target position is pointed on the screen is high.
- frequency to repeatedly set the moving distance d increases, and actual operation is not effective for a user.
- a button operation of the mobile phone 2 includes a long push (remain pushing for a while) and a short push (usual push operation) . Accordingly, the moving distance d may be changed between the long push and the short push. Furthermore, by continuously pushing the button after the long push, an operation status is transferred to "repeat" and the long push is repeated. Accordingly, the moving distance d may be changed by repeat times.
- Fig. 6 is a schematic diagram of moving method of the cursor according to a first embodiment.
- a cursor is compulsorily moved from the present position to a center of the screen.
- the cursor In case that a moving destination (target position) is near the present position of the cursor, the cursor is not necessarily moved to the center. If the cursor is moved to the target position after moving the center by pushing the "call” button, irrespective of the present position of the cursor, the average of push times of operation buttons to move the cursor to the target position is 17.5. By considering push of "call” button, the average is 18.5
- Fig.7 is a flow chart of operation example of the mobile phone 2 according to a second embodiment.
- Figs.8 and 9 are schematic diagrams to explain operation examples of the mobile phone 2 according to the second embodiment.
- a user In case of moving a cursor from the present position, a user first pushes a "call” button (ST1).
- the mobile phone 2 changes processing from a usual operation mode to a quick moving mode of the cursor. Furthermore, by pushing the "call” button, as shown in Fig.8 , the display control unit 21 displays a large grid line (first grid line) of "(three lines) ⁇ (three rows)" on the display 2a. Nine large cells (first cell) are formed by this grid line (ST2).
- the grid line is used for displaying the first cell.
- method for discriminately displaying each cell is not limited to the grid line and any method may be used.
- lattice points of each cell may be displayed, or a background color of each cell may be different.
- a grid line is used to discriminate display of each cell.
- another method to discriminately display may be used.
- step ST3 In case of pushing the "call” button again (Yes at ST3), by deciding that previous operation is cancelled, the grid line is cleared (erased) and the processing is advanced to step ST1. In case of not pushing the "call” button, the processing is forwarded to step ST4.
- a user pushes any button of nine dial buttons ("1" button ⁇ "9" button).
- "1" button-"9” button are arranged as "(three lines) ⁇ (three rows)". As shown in Fig.8 , a large grid line corresponds to a position of each cell divided on the screen. Accordingly, a user can easily select a dial button corresponding to a target position of the cursor by watching cells on the display 2a.
- Fig.9 shows a display example of a screen based on operation flow.
- Fig. 9A shows a display example on which large grid line is displayed by pushing a "call" button at ST2.
- a position of a cursor (left upper side) represents a present position of the cursor (before moving).
- Fig.9B shows a display example after pushing a "4" button at ST4.
- the cursor By pushing the "4" button, the cursor is moved to a center of a cell (left middle side) corresponding to a position of the "4" button.
- small grid line (second grid line) of "(three lines) x (three rows)” is displayed in the cell. This grid line forms nine small cells (second cell) (ST5).
- a user selectively pushes "1" button-"9” button corresponding to a target position.
- "9 " button is pushed.
- the cursor is moved to a position of the small cell corresponding to the "9” button.
- all grid lines are cleared and a display status is returned to usual operation mode ( Fig.9D ) .
- a vertical length and a horizontal length of the small cell are respectively one ninth.
- the screen size of the display 2a is "(240 dot) X (320 dot)”
- a size of the small cell is "(27 dot) X (36 dot)”.
- the average of push times of operation buttons for cursor to move from the present position to the target position is about six, which is a quarter of average "twenty three" of prior art.
- buttons necessary for cursor moving is greatly reduced. Accordingly, a cursor can be moved to a target position for a short time and operability is improved.
- Fig.10 is a flow chart of operation of the mobile phone 2 according to a third embodiment.
- Fig.11 is display example of the display 2a based on operation flow of the mobile phone 2 according to the third embodiment.
- cursor moving is executed using dial buttons ("1" button ⁇ "9" button).
- cursor moving is executed using arrow buttons (top and bottom and right and left).
- buttons are simple. However, some user operates by confirming a position of the button. On the other hand, arrow buttons (top and bottom and right and left) are easy for the user to operate without confirming the position of the button (blind touch).
- a moving direction of the cursor is more important than a position of the cursor on a screen. Accordingly, in the third embodiment, the cursor is displayed on a lattice point of grid line different from the second embodiment (cursor is displayed on a center of the cell). In this display mode, the cursor is moved on the grid line. Accordingly, the grid line represents a locus of the cursor and is congenial to the arrow buttons. As a result, quick operation is possible for the user.
- the mobile phone 2 changes processing from usual operation mode to quick moving mode of cursor.
- a special button For example, "call” button (first button)
- Fig.11A shows this display status.
- the grid line divides the screen into nine cells ((three lines) X (three rows)).
- the third embodiment does not have such restriction. Accordingly, the number of grid lines and space between grid lines can be selected based on visibility. As shown in Fig .11 , a vertical space and a horizontal space between grid lines may be respectively equal. For example, in the third embodiment, a space between grid lines along a vertical direction and a horizontal direction are respectively 80 dots.
- a user pushes the arrow buttons (top and bottom and right and left) while watching the display (blind touch) in order to get near the cursor from the present position to the target position.
- the cursor is moved on the lattice point of each cell (formed by grid lines).
- a user After moving the cursor to a position adjacent to the target point, a user pushes a special button (second button, for example, a "confirmation” button) (ST16).
- a special button for example, a "confirmation” button
- small grid lines (second grid line) dividing four cells (first cell) adjoining a lattice point of the cursor are displayed.
- the small grid lines divide a large cell into nine small cells (second cell) .
- Fig.11C shows this display status.
- the large cell is respectively divided into three parts along a vertical direction and a horizontal direction.
- a space between two small cells along the vertical direction and the horizontal direction is respectively 27 dots.
- the cursor further nears the target position.
- a moving unit of the cursor is the small cell. Accordingly, fine moving of the cursor is possible.
- Fig.11D by one push of a "bottom” arrow button and one push of a "right” arrow button, the cursor is further moved near the target position.
- a user pushes a "confirmation” button (ST22).
- the cursor position is determined, and processing is returned from the quick moving mode of the cursor to the usual operation mode. Furthermore, all grid lines are cleared (ST23). Fig.11E shows this display status.
- the cursor may be moved by unit of predetermined moving distance d (For example, 8 dots) using the arrow buttons (top and bottom and right and left) .
- the cursor In case of moving the cursor on lattice points of the large grid line, the cursor is moved as 80 dots by one push of the arrow button. As mentioned-above, in the prior art (usual operation mode), a moving distance of one push of the arrow button is 8 dots. Accordingly, average of push times of button is one tenth of the equation (4), i.e., about 2.333.
- the cursor In case of moving a cursor on lattice points of the small grid line, the cursor is moved on "3 X 3" small cells divided in the large cell. Accordingly, the average of push times more decreases than average of push times in case of moving a cursor on lattice points of the large grid lines. Briefly, the average of push times in case of moving a cursor on lattice points of the small grid lines is below 2.333.
- a size of the small cell is "(27 dots) X (27 dots)". Accordingly, in the usual operation mode, average of push times by unit of 8 dots to finely adjust a cursor position is approximately calculated by the equation (5), i.e., 2.333.
- average of push times of buttons of the mobile phone 2 of the third embodiment is calculated as follows. 2.333 + 2.333 + 2.333 + 3 ⁇ 10 times
- above average “10” is larger.
- above average “10” is below a half of the average "23”.
- the cursor in the mobile phone 2 of the third embodiment, in the same way as the second embodiment, push times of operation buttons necessary for cursor moving is greatly reduced. Accordingly, the cursor can be moved to a target position for a short time, and the user's operability improves.
- the cursor is often moved along a direction toward outside of a display area of the display 2a.
- the moving destination is outside of the display area, a part of screen information on the display 2a is shifted along a reverse direction of the cursor moving direction, and the cursor is positioned on new screen information on the display 2a.
- the display area of the small grid lines is automatically shifted (slide) along a moving direction of the cursor.
- moving of the cursor using the small grid lines can be continually executed, and the user's operability improves.
- the display area of the small grid lines and a view of screen information of the display 2a are automatically shifted along a reverse direction of the moving direction of the cursor as a space between large grid lines (ST20) .
- new part of screen information (right side screen information not displayed up to the present) is displayed on the display 2a, moving of the cursor using the small grid lines can be executed, and the user' s operability improves.
- Figs.15A and B show display examples of this cancel operation.
- Figs.16A ⁇ 16E are schematic diagrams to explain operation of the mobile phone 2 according to a fourth embodiment.
- Basic operation flow of the mobile phone 2 of the fourth embodiment is the same as the third embodiment of Fig.10 .
- the cursor moves differently in case of changing the processing from usual operation mode to quick moving mode of cursor.
- Fig. 16A shows this display status.
- Other operation is same as the third embodiment.
- the fourth embodiment adds the merit of the first embodiment to the merit of the third embodiment.
- the processing can be accomplished by a computer-executable program, and this program can be realized in a computer-readable memory device.
- the memory device such as a magnetic disk, a flexible disk, a hard disk, an optical disk (CD-ROM, CD-R, DVD, and so on), an optical magnetic disk (MD and so on) can be used to store instructions for causing a processor or a computer to perform the processes described above.
- OS operation system
- MW middle ware software
- the memory device is not limited to a device independent from the computer. By downloading a program transmitted through a LAN or the Internet, a memory device in which the program is stored is included. Furthermore, the memory device is not limited to one. In the case that the processing of the embodiments is executed by a plurality of memory devices, a plurality of memory devices may be included in the memory device. The component of the device may be arbitrarily composed.
Description
- The present invention relates to a mobile phone for remotely operating an information device, such as a personal computer, through a network, and a related method.
- Information devices often connect to a network, such as a mobile phone connectable to the Internet or a PDA (Personal Digital Assistant) connectable to a wireless LAN (Local Area Network). Furthermore, a display apparatus of some information devices have a high resolution, and an image can be finely displayed. Accordingly, by connecting a first information device with a second information device remotely located such as a personal computer (Hereinafter, PC), the first information device can control the second information device and can access data stored on the second information device.
- For example, a technique to operate a PC (software is previously installed) from a mobile phone or a PDA (WEB browser is usable) via a network is disclosed in the following.
IBM Japan "Software realizing remote operation of PC from mobile phone", [online], press release, [retrieval on June 28, 2005], Internet <URL: http://www-06.ibm.com/jp/press/2002/05271.html>; - Furthermore, a technique to operate a PC (software is previously installed) from a WEB browser or a private viewer (predetermined language is usable) is disclosed in the following.
AT&T Labs-Research In the Spotlight "PC World included AT&T Labs (Cambridge) Virtual Network Computer Software in its 1 April feature on the evaluation of remote PC software", [online], [retrieval on June 28, 2005], Internet <URL: http://www.research.att.com/spotlight/200204.html>; - Furthermore, by setting a relay server between a mobile phone and a PC and by communicating the relay server with the mobile phone using an original protocol, a system to operate the PC from the mobile phone is disclosed in the following.
Masato NAKASU "Research of a computer remote operation system using a mobile phone", [online], Tsukuba University, [retrieval on June 28, 2005], Internet <URL: http://www.iplab.cs.tsukuba.ac.jp/~baru/research/keitai.html>; - In the technique disclosed in IBM Japan and NAKASU articles, screen information of the PC or input information from a keyboard or a mouse of the PC are transmitted between the PC and the mobile phone by predetermined communication protocol. Briefly, this technique relates to remote operation from the mobile phone to the PC.
- When inputting data to a PC, except for the keyboard, a pointing device such as a mouse or a touch panel is generally used. By using the mouse, a mouse cursor can be moved in a moment to an arbitrary position on a screen of the PC. By immediately pushing a mouse button after moving the mouse cursor, various kinds of menu selection and data input can be executed.
- On the other hand, a mobile phone typically includes numerical buttons to dial a telephone number, arrow buttons (directions of top and bottom and right and left) and a confirmation button for menu selection, and several buttons for special operation.
- Accordingly, in case of remotely operating a PC using a mobile phone, in comparison with operation of the mouse of the PC, a cursor cannot be moved in a moment to an arbitrary position on a display of the mobile phone. For example, by pushing the arrow buttons (directions of top and bottom and right and left) repeatedly, the cursor is gradually moved to the arbitrary position on the display. Another suitable means to easily move the cursor to the arbitrary position is not actually considered.
- An interface by connecting a mouse to a mobile phone is technically possible. However, in this use form, simple movability of the mobile phone falls. By considering operation of the mobile phone while a user's moving to a destination or an vehicle, this interface is not a practical solution method.
- In this way, operability to remotely operate the PC using a mobile phone is greatly inferior to operability to directly operate the PC using a mouse.
-
DE-A-195 21 453 discloses a mobile phone controlled to remotely operate an information device, wherein
a communication unit is configured to receive information displayed on the information device;
a display device displays a part of the information on a screen;
each of a plurality of operation buttons is configured to input an operation signal;
a display control unit is configured to display a cursor on the screen, the cursor overlapping the part of the information; and
an operation control unit is configured to move the cursor to a specific location of the screen in response to the operation signal. - From
US-A-2004/0135819 it is further known to display a grid line representing a boundary of each cell on the screen and, in response to a push of a predetermined one of the plurality of operation buttons, to move the cursor form the present position to a center position. - The invention provides mobile phones as defined in
Claims Claims - The present invention can be used for remotely operating a PC with high operability using standard operation buttons of the mobile phone.
-
Fig. 1 is a component example of an information device remote operation system connected with a mobile phone. -
Fig.2 is a block diagram of a mobile phone. -
Fig.3 is a display example of a display device of a mobile phone. -
Fig. 4 is one example of operation buttons of a mobile phone. -
Fig. 5 is a schematic diagram of operation of a mobile phone. -
Fig. 6 is a schematic diagram of operation of a mobile phone according to a first embodiment. -
Fig.7 is a flow chart of an operation method of a mobile phone according to a second embodiment. -
Fig.8 is a schematic diagram of display status of the mobile phone according to the second embodiment. -
Figs.9A~9D are schematic diagrams of an operation of the mobile phone according to the second embodiment. -
Fig.10 is a flow chart of an operation method of a mobile phone according to a third embodiment. -
Figs.11A~11D are schematic diagrams of a first operation of the mobile phone according to the third embodiment. -
Figs.12A~12C are schematic diagrams of a second operation of the mobile phone according to the third embodiment. -
Figs.13A and 13B are schematic diagrams of a third operation of the mobile phone according to the third embodiment. -
Figs.14A and 14B are schematic diagrams of a fourth operation of the mobile phone according to the third embodiment. -
Figs.15A and 15B are schematic diagrams of a fifth operation of the mobile phone according to the third embodiment. -
Figs.16A~16E are schematic diagrams of the operation of a mobile phone according to a fourth embodiment. - Hereinafter, various embodiments of the present invention will be explained by referring to the drawings. The present invention is not limited to the following embodiments.
- (The first embodiment)
Fig.1 is a block diagram of an information deviceremote operation system 1. - In embodiments of the present invention, a
mobile phone 2 is connected with aninformation device 3 via an electric communication circuit ornetwork 4 and abase station 5. Theinformation device 3 is, for example, a personal computer. - In the information device
remote operation system 1, theinformation device 3 located in an office or a home, for example, can be remotely operated using the mobile phone. - Screen information on a
display 3a of theinformation device 3 is received via theelectric communication circuit 4, and displayed on adisplay 2a of themobile phone 2. Normally, thedisplay 2a of themobile phone 2 is smaller than thedisplay 3a of theinformation device 3. Accordingly, a part of the screen information on thedisplay 3a is displayed on thedisplay 2a. - On the other hand, in case of operating or inputting data from the
mobile phone 2 to theinformation device 3, operation buttons set on themobile phone 2 are used. - In case of directly operating the
information device 3, by using a pointing device such as a mouse or a touch pad, a mouse cursor (Hereinafter, a cursor) can be moved in a moment to an arbitrary position on thedisplay 3a. - In the
mobile phone 2, portable movability is important, and the pointing device such as the mouse or the touch panel is not normally used. Accordingly, in the background art, moving operation of the cursor is not effective. In the present invention, technique to effectively operate moving of the cursor is provided. As a result, operability of remote operation by themobile phone 2 rises. -
Fig.2 is a block diagram of themobile phone 2. - The
mobile phone 2 includes acommunication unit 20, adisplay control unit 21, adisplay 2a, anoperation control unit 22, and anoperation unit 23. - The
communication unit 20 executes data communication with theinformation device 3 via theelectric communication circuit 4. Thedisplay control unit 21 controls thedisplay 2a of themobile phone 2 to display the screen information sent from theinformation device 3. Furthermore, thedisplay control unit 21 controls thedisplay 2a to display a cursor and grid lines (explained afterwards). - The
display 2a is, for example, a liquid crystal display. - The
operation control unit 22 executes various kinds of data conversion based on input data fromoperation buttons 24 of theoperation unit 23. -
Fig.3 shows screen information on thedisplay 3a of theinformation device 3 as a remote operation object and a part of the screen information on thedisplay 2a of themobile phone 2. - The
display 3a of theinformation device 3 such as the personal computer includes a relative large screen. For example, the screen is composed by pixels of "(1024 dots) X (768 dots)" (XGA standard) . On the other hand, while a screen of thedisplay 2a may have a high resolution, thedisplay 2a is smaller than thedisplay 3a. For example, the screen is composed by pixels of "(240 dots) X (320 dots)" (QVGA standard). - Accordingly, in case of displaying screen information of the
display 3a of theinformation device 3 on thedisplay 2a of themobile phone 2, a part of the screen information is extracted and displayed on thedisplay 2a. -
Fig.4 is a schematic diagram of an operation panel (operation unit 32) of themobile phone 2. Theoperation unit 23 includes a plurality ofoperation buttons 24. - On an upper part of the
operation unit 23, four arrow buttons of top and bottom and right and left, i.e., "top" arrow button, "bottom" arrow button, "right" arrow button, and "left" arrow button, are located. Furthermore, on a center part, surrounded by the four arrow buttons, "confirmation" button is located. - On lower part of the
operation unit 23, dial buttons are located. The dial buttons include "1" button ~"9" button located as ((three lines) X (three rows)), "0" button, "*" button, and "#" button. Furthermore, "call" button is prepared. -
Fig. 5 is a schematic diagram to explain prior method for moving a cursor using theoperation buttons 24. - In
Fig.5 , a symbol ("+" surrounded by "o") represents a cursor. In case of moving a cursor, arrow buttons of top and bottom and right and left are often used. Briefly, whenever the arrow buttons are pushed, the cursor is moved a moving distance d. In example ofFig. 5 , the cursor is moved to the right by pushing a "right" arrow button one time, and the cursor is moved to the bottom by pushing a "bottom" arrow button one time. - At timing that the cursor is moved to a desired position, for example, by pushing a "confirmation" button, operation equivalent to click a mouse button of the
information device 3 is realized. - If the moving distance d is fixed, the cursor cannot be pointed on a middle point of the moving distance d. Accordingly, the moving distance d can be changed by set.
- For example, in status that the moving distance d of one time is 8 dot, assume that a cursor is moved to the right direction (+x direction) as 36 dot and the bottom direction (+y direction) as 40 dot. By pushing a "right" arrow button four times and pushing a "bottom" arrow button five times, the cursor is moved to a left side position as 4 dot from the target position. Accordingly, by setting the moving distance d as 4 dot and pushing the "right" arrow button one time, the cursor is moved to the target position. In this case, even if set operation of the moving distance d is excluded, push of operation buttons of ten times is necessary.
- In case that a screen size of the
mobile phone 2 is "a × b" dot, the moving distance is d dot and the present position of the cursor is (x, y), average of push times of the arrow buttons (top and bottom and right and left) necessary for moving is approximated by following equation (1). -
- By calculating the equation (2), following equation is obtained.
mobile phone 2 is "a × b" dot, the moving distance is d dot and the present position of the cursor is (x, y) , average of push times of the arrow buttons (top and bottom and right and left) necessary for moving is approximated by following equation (3). -
- Nowadays, a screen size of QVGA standard which is a general screen size of the
mobile phone 2 is "240 × 320" dot. Accordingly, by assigning "a = 240, b = 320" and "d = 8" as the moving distance to the equation (3), following equation (4) is obtained.display 2a), and maximum 35 for "(x, y) = (0, 0)" (corner of the screen). Average of the calculation result is 23.333. - In order to reduce push times of the operation button, the moving distance d of the cursor by push of one time may be lengthened. However, probability that a position depart from a target position is pointed on the screen is high. As a result, frequency to repeatedly set the moving distance d increases, and actual operation is not effective for a user.
- A button operation of the
mobile phone 2 includes a long push (remain pushing for a while) and a short push (usual push operation) . Accordingly, the moving distance d may be changed between the long push and the short push. Furthermore, by continuously pushing the button after the long push, an operation status is transferred to "repeat" and the long push is repeated. Accordingly, the moving distance d may be changed by repeat times. - However, the long push takes a longer time than the short push. Accordingly, above idea is not definite settlement means to reduce moving time of the cursor.
-
Fig. 6 is a schematic diagram of moving method of the cursor according to a first embodiment. - In the
mobile phone 2 of the first embodiment, by pushing a special button (For example, "call" button), a cursor is compulsorily moved from the present position to a center of the screen. In theoperation control unit 22 of themobile phone 2, this operation is realized by setting position data of the cursor to a center coordinate "(x, y) = (0, 0)" on the screen when push of "call" button is recognized. - In case that a moving destination (target position) is near the present position of the cursor, the cursor is not necessarily moved to the center. If the cursor is moved to the target position after moving the center by pushing the "call" button, irrespective of the present position of the cursor, the average of push times of operation buttons to move the cursor to the target position is 17.5. By considering push of "call" button, the average is 18.5
- As mentioned-above, in case that a cursor is located on arbitrary position of the screen (prior art), the average of push times is 23.333. Accordingly, in the
mobile phone 2 of the first embodiment, the average of push times is reduced as about five times. As a result, push time of operation buttons to move the cursor to the target position is shortened and operability improves.
(The second embodiment)
Fig.7 is a flow chart of operation example of themobile phone 2 according to a second embodiment.Figs.8 and9 are schematic diagrams to explain operation examples of themobile phone 2 according to the second embodiment. - In the
mobile phone 2 of the second embodiment, in order to effectively move a cursor, "1" button-"9" button (first button), and one predetermine button, for example, "call" button (second button), are used. - In case of moving a cursor from the present position, a user first pushes a "call" button (ST1).
- By pushing the "call" button, the
mobile phone 2 changes processing from a usual operation mode to a quick moving mode of the cursor. Furthermore, by pushing the "call" button, as shown inFig.8 , thedisplay control unit 21 displays a large grid line (first grid line) of "(three lines) × (three rows)" on thedisplay 2a. Nine large cells (first cell) are formed by this grid line (ST2). - In
Fig.8 , the grid line is used for displaying the first cell. However, method for discriminately displaying each cell is not limited to the grid line and any method may be used. For example, lattice points of each cell may be displayed, or a background color of each cell may be different. In the following explanation, a grid line is used to discriminate display of each cell. However, as mentioned-above, another method to discriminately display may be used. - In case of pushing the "call" button again (Yes at ST3), by deciding that previous operation is cancelled, the grid line is cleared (erased) and the processing is advanced to step ST1. In case of not pushing the "call" button, the processing is forwarded to step ST4.
- At step ST4, a user pushes any button of nine dial buttons ("1" button~"9" button). "1" button-"9" button are arranged as "(three lines) × (three rows)". As shown in
Fig.8 , a large grid line corresponds to a position of each cell divided on the screen. Accordingly, a user can easily select a dial button corresponding to a target position of the cursor by watching cells on thedisplay 2a. -
Fig.9 shows a display example of a screen based on operation flow.Fig. 9A shows a display example on which large grid line is displayed by pushing a "call" button at ST2. InFig.9A , a position of a cursor (left upper side) represents a present position of the cursor (before moving). -
Fig.9B shows a display example after pushing a "4" button at ST4. By pushing the "4" button, the cursor is moved to a center of a cell (left middle side) corresponding to a position of the "4" button. Additionally, small grid line (second grid line) of "(three lines) x (three rows)" is displayed in the cell. This grid line forms nine small cells (second cell) (ST5). - In case of pushing the "call" button again (Yes at ST6) , previous operation is decided to be canceled, the small grid line is cleared and processing is returned to ST3. In case of not pushing the "call" button, processing is forwarded to ST7.
- At ST7, a user selectively pushes "1" button-"9" button corresponding to a target position. In
Fig.9C, "9 " button is pushed. By pushing the "9" button, the cursor is moved to a position of the small cell corresponding to the "9" button. Additionally, all grid lines are cleared and a display status is returned to usual operation mode (Fig.9D ) . In the operation mode ofFig. 9D , the cursor is moved by unit of a moving distance d (For example, d = 8 dot) using arrow buttons (top and bottom and left and right) , and the cursor is lastly moved to the target position. - In comparison with a screen size of the
display 2a, a vertical length and a horizontal length of the small cell are respectively one ninth. In case that the screen size of thedisplay 2a is "(240 dot) X (320 dot)", a size of the small cell is "(27 dot) X (36 dot)". Accordingly, average of push times of the cursor to move from the present position inFig. 9D to the target position is obtained by assigning "a = 27, b = 36, d = 8" to the equation (3). This is represented as following equation (5). -
- Briefly, in the
mobile phone 2 of the second embodiment, the average of push times of operation buttons for cursor to move from the present position to the target position is about six, which is a quarter of average "twenty three" of prior art. - As mentioned-above, in the
mobile phone 2 of the second embodiment, push times of operation buttons necessary for cursor moving is greatly reduced. Accordingly, a cursor can be moved to a target position for a short time and operability is improved. - (The third embodiment)
Fig.10 is a flow chart of operation of themobile phone 2 according to a third embodiment.Fig.11 is display example of thedisplay 2a based on operation flow of themobile phone 2 according to the third embodiment. - In the second embodiment, cursor moving is executed using dial buttons ("1" button~"9" button). On the other hand, in the third embodiment, cursor moving is executed using arrow buttons (top and bottom and right and left).
- Operation by dial buttons is simple. However, some user operates by confirming a position of the button. On the other hand, arrow buttons (top and bottom and right and left) are easy for the user to operate without confirming the position of the button (blind touch).
- In case of moving a cursor using arrow buttons (top and bottom and right and left), a moving direction of the cursor is more important than a position of the cursor on a screen. Accordingly, in the third embodiment, the cursor is displayed on a lattice point of grid line different from the second embodiment (cursor is displayed on a center of the cell). In this display mode, the cursor is moved on the grid line. Accordingly, the grid line represents a locus of the cursor and is congenial to the arrow buttons. As a result, quick operation is possible for the user.
- At ST10, by pushing a special button (For example, "call" button (first button)), the
mobile phone 2 changes processing from usual operation mode to quick moving mode of cursor. - Furthermore, by pushing "call" button, large grid lines (first grid line) on which the present position of the cursor is one lattice point are displayed on a screen (ST11).
Fig.11A shows this display status. - In the second embodiment, in order to coincide location of dial buttons with location of cells formed by grid lines, the grid line divides the screen into nine cells ((three lines) X (three rows)). However, the third embodiment does not have such restriction. Accordingly, the number of grid lines and space between grid lines can be selected based on visibility. As shown in
Fig .11 , a vertical space and a horizontal space between grid lines may be respectively equal. For example, in the third embodiment, a space between grid lines along a vertical direction and a horizontal direction are respectively 80 dots. - A user pushes the arrow buttons (top and bottom and right and left) while watching the display (blind touch) in order to get near the cursor from the present position to the target position. By one push of the arrow buttons, the cursor is moved on the lattice point of each cell (formed by grid lines).
- In
Fig.11B , by one push of a "bottom" arrow button and one push of a "right" arrow button, the cursor is moved from the present position to a position adjacent to the target position. - After moving the cursor to a position adjacent to the target point, a user pushes a special button (second button, for example, a "confirmation" button) (ST16).
- By pushing the "confirmation" button, small grid lines (second grid line) dividing four cells (first cell) adjoining a lattice point of the cursor are displayed. The small grid lines divide a large cell into nine small cells (second cell) .
Fig.11C shows this display status. In the third embodiment, the large cell is respectively divided into three parts along a vertical direction and a horizontal direction. A space between two small cells along the vertical direction and the horizontal direction is respectively 27 dots. - At ST18, by pushing the arrow buttons (top and bottom and right and left), the cursor further nears the target position. In this case, a moving unit of the cursor is the small cell. Accordingly, fine moving of the cursor is possible. In
Fig.11D , by one push of a "bottom" arrow button and one push of a "right" arrow button, the cursor is further moved near the target position. - After moving the cursor near the target position, a user pushes a "confirmation" button (ST22). By pushing the "confirmation" button, the cursor position is determined, and processing is returned from the quick moving mode of the cursor to the usual operation mode. Furthermore, all grid lines are cleared (ST23).
Fig.11E shows this display status. - In case of finely adjusting the cursor position by the usual operation mode, the cursor may be moved by unit of predetermined moving distance d (For example, 8 dots) using the arrow buttons (top and bottom and right and left) .
- In case of moving the cursor on lattice points of the large grid line, the cursor is moved as 80 dots by one push of the arrow button. As mentioned-above, in the prior art (usual operation mode), a moving distance of one push of the arrow button is 8 dots. Accordingly, average of push times of button is one tenth of the equation (4), i.e., about 2.333.
- In case of moving a cursor on lattice points of the small grid line, the cursor is moved on "3
X 3" small cells divided in the large cell. Accordingly, the average of push times more decreases than average of push times in case of moving a cursor on lattice points of the large grid lines. Briefly, the average of push times in case of moving a cursor on lattice points of the small grid lines is below 2.333. - A size of the small cell is "(27 dots) X (27 dots)". Accordingly, in the usual operation mode, average of push times by unit of 8 dots to finely adjust a cursor position is approximately calculated by the equation (5), i.e., 2.333.
- Furthermore, by considering one push of the "call" button and two pushes of the "confirmation" button, average of push times of buttons of the
mobile phone 2 of the third embodiment is calculated as follows.mobile phone 2 of the second embodiment, above average "10" is larger. However, in comparison with average "23" of push times of the prior art, above average "10" is below a half of the average "23". - As mentioned-above, in the
mobile phone 2 of the third embodiment, in the same way as the second embodiment, push times of operation buttons necessary for cursor moving is greatly reduced. Accordingly, the cursor can be moved to a target position for a short time, and the user's operability improves. - In case of using the arrow buttons (top and bottom and right and left), the cursor is often moved along a direction toward outside of a display area of the
display 2a. In this case, in the third embodiment, it is decided whether a moving destination of the cursor is outside of the display area (ST13) . In case that the moving destination is outside of the display area, a part of screen information on thedisplay 2a is shifted along a reverse direction of the cursor moving direction, and the cursor is positioned on new screen information on thedisplay 2a. -
Figs.12A, 12B, and 12C show a concrete display example.Fig.12A shows one example of screen information of thedisplay 3a of theinformation device 3. A part of the screen information (a region surrounded by left side rectangle inFig.12A ) is extracted and displayed on thedisplay 2a of themobile phone 2 as shown inFig.12B . - In case of further moving the cursor from the present position on the
display 2a ofFig. 12B to the right side (including target position) on thedisplay 2a, the cursor cannot be moved to a target position because the target position is not included in the present screen information of thedisplay 2a. Accordingly, in the third embodiment, for example, in case of pushing a "right" arrow button, a view (a part of the present screen information on thedisplay 3a) is shifted (moved) to the left side on thedisplay 2a as a space between grid lines. As a result, new part of screen information (right side screen information not displayed up to the present) is displayed on thedisplay 2a, and the cursor can be moved to the target position on the new part of screen information. - By this operation as one push of the "right" arrow button, cursor moving and view moving can be simultaneously executed. Accordingly, high effective operability can be realized.
- Furthermore, as shown in
Fig.13A , in case of displaying small grid lines, it often happens that a cursor is moved to outside of display area of the small grid lines. - In the third embodiment, in this case, as shown in
Fig. 13B , the display area of the small grid lines is automatically shifted (slide) along a moving direction of the cursor. As a result, moving of the cursor using the small grid lines can be continually executed, and the user's operability improves. - Furthermore, as shown in
Fig.14A , in case of displaying small grid lines, it often happens that a cursor is moved to both outside of display area of the small grid lines and outside of display area of thedisplay 2a. - In the third embodiment, in this case, as shown in
Fig.14B , the display area of the small grid lines and a view of screen information of thedisplay 2a are automatically shifted along a reverse direction of the moving direction of the cursor as a space between large grid lines (ST20) . As a result, new part of screen information (right side screen information not displayed up to the present) is displayed on thedisplay 2a, moving of the cursor using the small grid lines can be executed, and the user' s operability improves. - In the third embodiment, in the same way as the second embodiment, cancel operation using the "call" button is possible.
- At ST15 in
Fig. 10 , by pushing the "call" button, the large grid lines are cleared, and processing is returned to usual operation mode (ST10). - Furthermore, by pushing the "call" button during displaying small grid lines (Yes at ST21), the small grid lines are cleared, and processing is returned to the display status of large grid lines.
Figs.15A and B show display examples of this cancel operation. - In the third embodiment, in case of changing the processing from the usual operation mode to the quick moving mode of cursor by pushing the "call" button, the present position of the cursor is not changed as shown in
Fig.11A . Based on the kind of an application software operating on theinformation device 3, it happens that change of the present position of the cursor in the usual operation mode is regarded as specified information. However, in the third embodiment, this application software is not affected. -
Figs.16A~16E are schematic diagrams to explain operation of themobile phone 2 according to a fourth embodiment. - Basic operation flow of the
mobile phone 2 of the fourth embodiment is the same as the third embodiment ofFig.10 . Compared to the third embodiment, the cursor moves differently in case of changing the processing from usual operation mode to quick moving mode of cursor. - In the
mobile phone 2 of the fourth embodiment, by pushing the "call" button, large grid lines are displayed and the present position of the cursor is moved to a lattice point in the center of the display.Fig. 16A shows this display status. Other operation is same as the third embodiment. - As inferred from the equation (3), by setting an initial position of the cursor to the center of the display, irrespective of moving on each cell, average of push times of arrow buttons (top and bottom and right and left) can be minimized. In this meaning, the fourth embodiment adds the merit of the first embodiment to the merit of the third embodiment.
- In the disclosed embodiments, the processing can be accomplished by a computer-executable program, and this program can be realized in a computer-readable memory device.
- In the embodiments, the memory device, such as a magnetic disk, a flexible disk, a hard disk, an optical disk (CD-ROM, CD-R, DVD, and so on), an optical magnetic disk (MD and so on) can be used to store instructions for causing a processor or a computer to perform the processes described above.
- Furthermore, based on an indication of the program installed from the memory device to the computer, OS (operation system) operating on the computer, or MW (middle ware software), such as database management software or network, may execute one part of each processing to realize the embodiments.
- Furthermore, the memory device is not limited to a device independent from the computer. By downloading a program transmitted through a LAN or the Internet, a memory device in which the program is stored is included. Furthermore, the memory device is not limited to one. In the case that the processing of the embodiments is executed by a plurality of memory devices, a plurality of memory devices may be included in the memory device. The component of the device may be arbitrarily composed.
- A computer may execute each processing stage of the embodiments according to the program stored in the memory device. The computer may be one apparatus such as a personal computer or a system in which a plurality of processing apparatuses are connected through a network. Furthermore, the computer is not limited to a personal computer. Those skilled in the art will appreciate that a computer includes a processing unit in an information processor, a microcomputer, and so on. In short, the equipment and the apparatus that can execute the functions in embodiments using the program are generally called the computer.
Claims (14)
- A mobile phone (2) having a function to remotely operate an information device (3), comprising:a communication unit (20) configured to receive information displayed on the information device (3);a display device (2a) displaying a part of the information;a plurality of operation buttons (24) each inputting an operation signal;a display control unit (21) configured to divide a screen of the display device (2a) into a plurality of cells; to discriminately display each of the plurality of cells on the screen, and to display a cursor on the screen, the cursor overlapping the part of the information; andan operation control unit (22) configured to move the cursor to one of the cells of the screen in response to the operation signal;characterised in that;said display control unit (21) is configured to display a grid line representing a boundary of each cell on the screen,and the plurality of operation buttons (24) includes first buttons of nine units arranged in lattices of three lines and three rows, and a second button of one unit; whereby, in response to a push of the second button,said display control unit (21) displays a first grid line dividing the screen into first cells of nine units of three lines and three rows, and the cursor located in one of the first cells;and, in response to a first push of one of the first buttons,said operation control unit (22) moves the cursor into one first cell corresponding to the first button of the first push, andsaid display control unit (21) displays a second grid line dividing the one first cell into second cells of nine units of three lines and three rows;and in response to a second push of one of the first buttons,said operation control unit (22) moves the cursor into one second cell corresponding to the first button of the second push, andsaid display control unit (21) clears the first and second grid lines.
- A mobile phone (2) having a function to remotely operate an information device (3), comprising:a communication unit (20) configured to receive information displayed on the information device (3);a display device (2a) displaying a part of the information;a plurality of operation buttons (24) each inputting an operation signal;a display control unit (21) configured to divide a screen of the display device (2a) into a plurality of cells, to discriminately display each of the plurality of cells on the screen, and to display a cursor on the screen, the cursor overlapping the part of the information; andan operation control unit (22) configured to move the cursor to one of the cells of the screen in response to the operation signal;characterised in that:said display control unit (21) is configured to display a grid line representing a boundary of each cell on the screen,and the plurality of operation buttons (24) includes arrow buttons indicating directions of top, bottom, right, and left, a first button of one unit, and a second button of one unit;whereby, in response to a push of the first button,said display control unit (21) divides the screen into a plurality of first cells, and displays a first grid line as the boundary of each first cell in which one lattice point is a present position of the cursor on the screen;and, in response to a first push of the arrow buttons,said operation control unit (22) moves the cursor on each lattice point of the first grid line in correspondence with a direction of the arrow buttons of the first push;and, in response to a first push of the second button,said display control unit (21) divides the first cell into a plurality of second cells, and displays a second grid line as the boundary of each second cell in which one lattice point is a present position of the cursor on a predetermined area centering around the present position of the cursor;and, in response to a second push of the arrow buttons,said operation control unit (22) moves the cursor on each lattice point of the second grid line in correspondence with a direction of the arrow buttons of the second push;and, in response to a second push of the second button,said display control unit (21) clears the first and second grid lines.
- The mobile phone according to claim 2, wherein the second button is located at a center of the arrow buttons.
- The mobile phone according to claim 2, wherein, when the cursor is moved to outside of a display area of the screen in response to a push of the arrow buttons, said display control unit slides the part of the information along a reverse direction of a moving direction of the cursor on the screen, and displays a new part of the information on the screen.
- The mobile phone according to claim 2, wherein, when the cursor is moved to outside of a display area of the second grid line in response to a push of the arrow buttons, said display control unit slides the display area of the second grid line along a reverse direction of a moving direction of the cursor on the screen.
- The mobile phone according to claim 2, wherein, when the first grid line is displayed, said display control unit clears the first grid line in response to a push of the first button.
- The mobile phone according to claim 2, wherein, when the second grid line is displayed, said display control unit displays the first grid line without the second grid line in response to a push of the first button.
- A method for controlling a mobile phone (2) remotely operating an information device (3), comprising:receiving information displayed on the information device (3);displaying a part of the information on a screen of the mobile phone (2);inputting an operation signal through a plurality of operation buttons (24);dividing the screen into a plurality of cells;discriminately displaying each of the plurality of cells on the screen;displaying a cursor on the screen, the cursor overlapping the part of the information; andmoving the cursor to one of the cells of the screen in response to the operation signal;characterised by:at the discriminately displaying step,displaying a grid line representing a boundary of each cell on the screen,the plurality of operation buttons (24) including first buttons of nine units arranged on lattices of three lines and three rows, and second button of one unit;at the discriminately displaying step, in response to a push of the second button, displaying a first grid line dividing the screen into first cells of nine units of three lines and three rows, and the cursor located in one of the first cells;at the moving step, in response to a first push of one of the first buttons,moving the cursor into one first cell corresponding to the first button of the first push, anddisplaying a second grid line dividing the one first cell into second cells of nine units of three lines and three rows;and, in response to a second push of one of the first buttons,moving the cursor into one second cell corresponding to the first button of the second push, andclearing the first and second grid lines.
- A method for controlling a mobile phone (2) remotely operating an information device (3), comprising:receiving information displayed on the information device (3);displaying a part of the informtation on a screen of the mobile phone (2);inputting an operation signal through a plurality of operation buttons (24);dividing the screen into a plurality of cells;discriminately displaying each of the plurality of cells on the screen;displaying a cursor on the screen, the cursor overlapping the part of the information; andmoving the cursor to one of the cells of the screen in response to the operation signal;characterised by:at the discriminately displaying step,displaying a grid line representing a boundary of each cell on the screen,the plurality of operation buttons (24) including arrow buttons indicating directions of top, bottom, right, and left, a first button of one unit, and a second button of one unit;at the discriminately displaying step, in response to a push of the first button,dividing the screen into a plurality of first cells, anddisplaying a first grid line as the boundary of each first cell in which one lattice point is a present position of the cursor on the screen;at the moving step, in response to a first push of the arrow buttons,moving the cursor on each lattice point of the first grid line in correspondence with a direction of the arrow buttons of the first push;in response to a first push of the second button,dividing the first cell into a plurality of second cells anddisplaying a second grid line as the boundary of each second cell in which one lattice point is a present position of the cursor on a predetermined area centering around the present position of the cursor;in response to a second push of the arrow buttons,moving the cursor on each lattice point of the second grid line in correspondence with a direction of the arrow buttons of the second push,and, in response to a second push of the second button,clearing the first and second grid lines.
- The method according to claim 9, wherein the second button is located at a center of the arrow buttons.
- The method according to claim 9, further comprising:when the cursor is moved to outside of a display area of the screen in response to push of the arrow buttons,sliding the part of the information along a reverse direction of a moving direction of the cursor on the screen; and displaying a new part of the information on the screen.
- The method according to claim 9, further comprising:when the cursor is moved to outside of a display area of the second grid line in response to a push of the arrow buttons,sliding the display area of the second grid line along a reverse direction of a moving direction of the cursor on the screen.
- The method according to claim 9, further comprising:when the first grid line is displayed,clearing the first grid line in response to a push of the first button.
- The method according to claim 9, further comprising:when the second grid line is displayed,displaying the first grid line without the second grid line in response to a push of the first button.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2005203066A JP4619882B2 (en) | 2005-07-12 | 2005-07-12 | Mobile phone and remote control method thereof |
Publications (2)
Publication Number | Publication Date |
---|---|
EP1744240A1 EP1744240A1 (en) | 2007-01-17 |
EP1744240B1 true EP1744240B1 (en) | 2008-08-27 |
Family
ID=37075498
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP06250872A Expired - Fee Related EP1744240B1 (en) | 2005-07-12 | 2006-02-17 | Mobile phone and mobile phone control method |
Country Status (6)
Country | Link |
---|---|
US (1) | US7526316B2 (en) |
EP (1) | EP1744240B1 (en) |
JP (1) | JP4619882B2 (en) |
KR (1) | KR100736195B1 (en) |
CN (1) | CN100559807C (en) |
DE (1) | DE602006002440D1 (en) |
Families Citing this family (56)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101142544B (en) * | 2005-04-08 | 2012-03-07 | 怀尔德彼康股份有限公司 | Screen information edition device, method |
EP1771002B1 (en) * | 2005-09-30 | 2017-12-27 | LG Electronics Inc. | Mobile video communication terminal |
WO2007063588A1 (en) * | 2005-11-30 | 2007-06-07 | Fujitsu Limited | Information processor, electronic device, and program |
GB0618979D0 (en) * | 2006-09-27 | 2006-11-08 | Malvern Scient Solutions Ltd | Cursor control method |
US20080120448A1 (en) * | 2006-11-21 | 2008-05-22 | Microsoft Corporation | Remote mouse and keyboard using bluetooth |
TWM318857U (en) * | 2007-04-04 | 2007-09-11 | Cal Comp Electronics & Comm Co | Network communicator with function of presentation controller |
JP5003377B2 (en) * | 2007-09-21 | 2012-08-15 | パナソニック株式会社 | Mark alignment method for electronic devices |
WO2009081994A1 (en) * | 2007-12-25 | 2009-07-02 | Nec Corporation | Information processing device and information processing method |
TW200935278A (en) * | 2008-02-04 | 2009-08-16 | E Lead Electronic Co Ltd | A cursor control system and method thereof |
JP5384848B2 (en) * | 2008-04-28 | 2014-01-08 | 日本電気株式会社 | Electronic device and pointing method therefor |
ITFI20080103A1 (en) * | 2008-05-22 | 2009-11-23 | Fimi S R L | METHOD AND APPARATUS FOR ACCESS TO COMMUNICATION AND / OR WRITING THROUGH THE USE OF A DEDICATED INTERFACE AND SCANNING CONTROL WITH AN EARLY-VISUAL VISUAL FEEDBACK. |
CN102132240B (en) * | 2008-09-26 | 2017-06-09 | 京瓷株式会社 | Electronic equipment |
US8527894B2 (en) * | 2008-12-29 | 2013-09-03 | International Business Machines Corporation | Keyboard based graphical user interface navigation |
US10013135B2 (en) | 2009-03-20 | 2018-07-03 | Microsoft Technology Licensing, Llc | Adjustable user interfaces with movable separators |
TWI486946B (en) * | 2009-04-01 | 2015-06-01 | Mstar Semiconductor Inc | Method for moving a cursor and display apparatus using the same |
FR2944900A1 (en) * | 2009-04-22 | 2010-10-29 | Jean Loup Gillot | Screen object selection method for man-machine interface, involves placing object and indicator on visual bottoms comprising arrow, and directing arrow towards key of keyboard, where numerical character of keyboard is identical to indicator |
CN102033691B (en) * | 2009-09-30 | 2013-01-30 | 北大方正集团有限公司 | Cursor movement prompting method and device |
US20110225553A1 (en) * | 2010-03-15 | 2011-09-15 | Abramson Robert W | Use Of Standalone Mobile Devices To Extend HID Capabilities Of Computer Systems |
US20130139085A1 (en) * | 2010-05-23 | 2013-05-30 | Kenichi Ichino | Operation Support Computer Program, Operation Support Computer System |
EP2403227A1 (en) * | 2010-06-30 | 2012-01-04 | MStar Semiconductor, Inc | Method for moving a cursor and display apparatus |
JP2012014516A (en) * | 2010-07-01 | 2012-01-19 | Mstar Semiconductor Inc | Method for moving cursor and display device using the same |
WO2012117689A1 (en) * | 2011-03-01 | 2012-09-07 | パナソニック株式会社 | Information terminal device and biological sample measurement device |
CN102109963B (en) * | 2011-03-25 | 2013-03-06 | 威盛电子股份有限公司 | Method for cursor positioning on screen |
US9850613B2 (en) | 2011-09-09 | 2017-12-26 | Panasonic Intellectual Property Management Co., Ltd. | Laundry system, communication device, communication method, communication program and washing machine |
US9565156B2 (en) | 2011-09-19 | 2017-02-07 | Microsoft Technology Licensing, Llc | Remote access to a mobile communication device over a wireless local area network (WLAN) |
US8490008B2 (en) | 2011-11-10 | 2013-07-16 | Research In Motion Limited | Touchscreen keyboard predictive display and generation of a set of characters |
US9310889B2 (en) | 2011-11-10 | 2016-04-12 | Blackberry Limited | Touchscreen keyboard predictive display and generation of a set of characters |
US9122672B2 (en) | 2011-11-10 | 2015-09-01 | Blackberry Limited | In-letter word prediction for virtual keyboard |
TWI448961B (en) * | 2011-12-16 | 2014-08-11 | Wistron Neweb Corp | Electronic apparatus and control method thereof |
US9557913B2 (en) | 2012-01-19 | 2017-01-31 | Blackberry Limited | Virtual keyboard display having a ticker proximate to the virtual keyboard |
US9152323B2 (en) | 2012-01-19 | 2015-10-06 | Blackberry Limited | Virtual keyboard providing an indication of received input |
DE112012000189B4 (en) | 2012-02-24 | 2023-06-15 | Blackberry Limited | Touch screen keyboard for providing word predictions in partitions of the touch screen keyboard in close association with candidate letters |
EP2830292B1 (en) | 2012-03-19 | 2019-01-23 | Nec Corporation | Onboard information system |
US9201510B2 (en) | 2012-04-16 | 2015-12-01 | Blackberry Limited | Method and device having touchscreen keyboard with visual cues |
US9292192B2 (en) | 2012-04-30 | 2016-03-22 | Blackberry Limited | Method and apparatus for text selection |
US8640252B2 (en) | 2012-05-07 | 2014-01-28 | International Business Machines Corporation | Obfuscating entry of sensitive information |
KR101337520B1 (en) * | 2012-05-17 | 2013-12-05 | 삼성디스플레이 주식회사 | Display apparatus |
US9207860B2 (en) | 2012-05-25 | 2015-12-08 | Blackberry Limited | Method and apparatus for detecting a gesture |
JP5414843B2 (en) * | 2012-05-31 | 2014-02-12 | 株式会社東芝 | Electronic device, image data display control method, and program |
US9116552B2 (en) * | 2012-06-27 | 2015-08-25 | Blackberry Limited | Touchscreen keyboard providing selection of word predictions in partitions of the touchscreen keyboard |
US9063653B2 (en) | 2012-08-31 | 2015-06-23 | Blackberry Limited | Ranking predictions based on typing speed and typing confidence |
US9524290B2 (en) | 2012-08-31 | 2016-12-20 | Blackberry Limited | Scoring predictions based on prediction length and typing speed |
CN102999224A (en) * | 2012-12-29 | 2013-03-27 | 苏州市智诚光学科技有限公司 | Notebook glass touch panel capable of positioning accurately |
KR20150069801A (en) * | 2013-12-16 | 2015-06-24 | 삼성전자주식회사 | Method for controlling screen and electronic device thereof |
US9436348B2 (en) * | 2014-03-18 | 2016-09-06 | Blackberry Limited | Method and system for controlling movement of cursor in an electronic device |
EP2985708A1 (en) * | 2014-08-15 | 2016-02-17 | Dassault Systèmes | Navigation through the hierarchical structure of a three-dimensional modeled assembly of parts |
CN105467874A (en) * | 2015-11-30 | 2016-04-06 | 小米科技有限责任公司 | Method and device for identifying categories of electronic devices on intelligent sockets |
CN105630334B (en) * | 2016-02-15 | 2019-08-02 | 青岛海信电器股份有限公司 | A kind of method and device that control virtual mouse is mobile |
CN106293097A (en) * | 2016-08-18 | 2017-01-04 | 青岛海信医疗设备股份有限公司 | A kind of cursor-moving method, device and armarium shown for medical treatment |
CN106326648A (en) * | 2016-08-18 | 2017-01-11 | 青岛海信医疗设备股份有限公司 | Cursor moving method and device for medical display and medical equipment |
CN106250711B (en) * | 2016-08-18 | 2019-12-06 | 青岛海信医疗设备股份有限公司 | Cursor moving method and device for medical display and medical equipment |
CN106293098B (en) * | 2016-08-18 | 2020-09-11 | 青岛海信医疗设备股份有限公司 | Gesture-based cursor moving method and device for medical display |
CN106325507B (en) * | 2016-08-18 | 2019-02-15 | 青岛海信医疗设备股份有限公司 | A kind of cursor-moving method, device and Medical Devices for medical treatment display |
CN106325673A (en) * | 2016-08-18 | 2017-01-11 | 青岛海信医疗设备股份有限公司 | Cursor moving method and device for medical display and medical equipment |
US20190149959A1 (en) | 2017-11-16 | 2019-05-16 | Motorola Solutions, Inc | Method for controlling a virtual talk group memeber to perform an assignment |
US11526322B2 (en) * | 2018-08-25 | 2022-12-13 | Microsoft Technology Licensing, Llc | Enhanced techniques for merging content from separate computing devices |
Family Cites Families (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE19521453A1 (en) | 1995-06-13 | 1996-12-19 | Andre Knauf | Cordless telephone or mobile telephone radio communication for dual operation as telephone or computer remote control |
US6437803B1 (en) * | 1998-05-29 | 2002-08-20 | Citrix Systems, Inc. | System and method for combining local and remote windows into a single desktop environment |
JPH10312233A (en) * | 1997-05-13 | 1998-11-24 | Nec Corp | Point designating method at information processing picture |
US6795055B1 (en) * | 2000-05-30 | 2004-09-21 | Agilent Technologies, Inc. | Devices, systems and methods for facilitating positioning of cursor on display device |
US6545666B1 (en) * | 2000-05-30 | 2003-04-08 | Agilent Technologies, Inc. | Devices, systems and methods for positioning cursor on display device |
JP2002014773A (en) * | 2000-06-28 | 2002-01-18 | Toshiba Corp | Portable information terminal |
KR20020017682A (en) * | 2000-08-31 | 2002-03-07 | 서평원 | Multifunction telephon |
CN1464719A (en) * | 2002-06-06 | 2003-12-31 | 翁延鸣 | Screen selection type mobile phone |
DE10229068B3 (en) * | 2002-06-28 | 2004-02-05 | Fujitsu Siemens Computers Gmbh | PDA (Personal Digital Assistant) with touch screen display |
US20040135819A1 (en) * | 2002-10-28 | 2004-07-15 | Shalong Maa | Computer remote control |
JP2004184782A (en) * | 2002-12-04 | 2004-07-02 | Footcall Co Ltd | Map information acquisition system, map information acquisition method, map information display terminal and program |
WO2004063914A2 (en) * | 2003-01-15 | 2004-07-29 | Koninklijke Philips Electronics N.V. | Handheld device with a display screen |
US7409209B2 (en) * | 2003-04-24 | 2008-08-05 | Microsoft Corporation | Telephony remote control |
JP4603778B2 (en) * | 2003-06-20 | 2010-12-22 | キヤノン株式会社 | Image display method and image display apparatus |
WO2005041029A2 (en) * | 2003-10-24 | 2005-05-06 | Matsushita Electric Industrial Co., Ltd. | Remote operation system, communication apparatus remote control system and document inspection apparatus |
US7624192B2 (en) * | 2003-12-30 | 2009-11-24 | Microsoft Corporation | Framework for user interaction with multiple network devices |
JP2005301908A (en) * | 2004-04-15 | 2005-10-27 | Toshiba Corp | Information apparatus remote control system |
KR20050073435A (en) * | 2005-06-23 | 2005-07-13 | (주)한아이디 | System for controlling home-network using television and method thereof |
-
2005
- 2005-07-12 JP JP2005203066A patent/JP4619882B2/en not_active Expired - Fee Related
-
2006
- 2006-02-16 US US11/354,938 patent/US7526316B2/en not_active Expired - Fee Related
- 2006-02-17 EP EP06250872A patent/EP1744240B1/en not_active Expired - Fee Related
- 2006-02-17 DE DE602006002440T patent/DE602006002440D1/en not_active Expired - Fee Related
- 2006-02-28 CN CNB2006100093745A patent/CN100559807C/en not_active Expired - Fee Related
- 2006-02-28 KR KR1020060019648A patent/KR100736195B1/en not_active IP Right Cessation
Also Published As
Publication number | Publication date |
---|---|
DE602006002440D1 (en) | 2008-10-09 |
CN1897597A (en) | 2007-01-17 |
CN100559807C (en) | 2009-11-11 |
KR20070008379A (en) | 2007-01-17 |
KR100736195B1 (en) | 2007-07-06 |
US7526316B2 (en) | 2009-04-28 |
US20070015534A1 (en) | 2007-01-18 |
EP1744240A1 (en) | 2007-01-17 |
JP4619882B2 (en) | 2011-01-26 |
JP2007027851A (en) | 2007-02-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1744240B1 (en) | Mobile phone and mobile phone control method | |
KR100624523B1 (en) | Information equipment remote operating system | |
EP1947556B1 (en) | Mobile electronic apparatus with touch input device and display method using the same | |
EP1970799B1 (en) | Electronic device and method of controlling mode thereof and mobile communication terminal | |
US7612762B2 (en) | Method and system for navigating within an image | |
US20050248545A1 (en) | Method, apparatus, and software program for processing information | |
GB2324232A (en) | Apparatus and method for retrieving information in a mobile information terminal | |
EP1980953B1 (en) | Character input device | |
US20060114224A1 (en) | Electronic apparatus, input control apparatus, and input control program storage medium | |
GB2329813A (en) | Touch screen GUI | |
US20150052476A1 (en) | Display device, display control method, and program | |
US20100289764A1 (en) | Electronic device, displaying method, and recording medium | |
WO2006049506A1 (en) | A method for remote operation of a computer using a mobile device | |
JP2009205492A (en) | Computer remote operation system | |
US20130130739A1 (en) | Portable electronic device and control method | |
JP2010102671A (en) | Electronic device | |
JP2001282415A (en) | Information selecting method, system therefor and computer readable storage medium | |
JP4900955B2 (en) | Remote operation system, control method and program | |
JP4435041B2 (en) | Mobile phone and remote control method thereof | |
US8970493B2 (en) | Information processing device for changing cursor display position, computer readable non-transitory recording medium, and information processing method | |
CN113311982A (en) | Information selection method and device | |
KR101849720B1 (en) | System and method for providing information in phases | |
KR20130066831A (en) | The terminal and method which zooms in or out a part of touch screen area | |
KR101647057B1 (en) | Phased information providing system and method | |
KR100658940B1 (en) | Key navigation method of the mobile terminal |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20060223 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA HR MK YU |
|
17Q | First examination report despatched |
Effective date: 20070802 |
|
AKX | Designation fees paid |
Designated state(s): DE FR GB |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): DE FR GB |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REF | Corresponds to: |
Ref document number: 602006002440 Country of ref document: DE Date of ref document: 20081009 Kind code of ref document: P |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20090528 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20091030 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20090901 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20090302 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20100202 Year of fee payment: 5 |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20110217 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20110217 |