JP2006155327A - Remote operation system for computer - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a remote operation system for computers, which can easily remote control a computer even from an operating-side computer that dose not have a coordinate pointing device. <P>SOLUTION: A display target area move control part 24 moves a display target area to be reproduced and displayed on a display screen 12 of a remote operation apparatus 6 in an operated screen, based on signals from a direction indicating operation body 36. A pointer position control part 26 moves a pointer position on the operated screen by the same amount in the same direction synchronized with move of the display target area. As a result, on the display screen 12 of the remote operation apparatus 6, the pointer position is seen so as to be fixed to the display screen 12. If the direction indicating operation body 36 is operated so that a desired part in a desired display target area is positioned at the fixed pointer position on the display screen 12, move of a display target area and pointer position specification can be simultaneously performed only by operating the direction indicating operation body 36. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a technique for remotely operating a computer.

  Computer remote control systems (for example, “remote desktop” systems used in Windows®-based OSs) that operate computers at remote locations using other computers are known. Various systems to which a remote operation system is applied, such as a sexual condition experience service system (see Patent Document 1), a home care remote support system (see Patent Document 2), and the like, have also been announced.

  FIG. 10 is a block diagram for explaining a conventional remote control system 152 for a computer. In the system 152, the operating computer 156 acquires the screen display information of the operated computer 154 via an information communication network (not shown), and displays it on its own display screen (not shown). And displayed as an operated screen.

  A user 158 of the computer 156 operates a keyboard and a mouse (not shown) of the computer 156 while viewing the operated screen displayed on the display screen of the computer 156 on the operating side. Information input from the keyboard or mouse of the computer 156 is transmitted to the computer 154 via the information communication network. The computer 154 performs information processing based on the transmitted information.

  By repeating such processing, the user 158 can operate the computer 154 at a remote location using the computer 156 at a nearby location. By utilizing system 152, user 158 can conveniently operate work computer 154 from home computer 156, for example.

  However, in the system 152, the remote operation cannot be performed unless the computer 156 to be operated is not near the user 158 in the first place. Therefore, for example, even if it becomes necessary to operate the computer 154 at work from the outside, the user cannot operate the computer 156 remotely unless he / she carries the computer 156.

In order to solve such a problem, it has been proposed to use a mobile phone as the operating computer 156 in the system 152. If a mobile phone can be used as the computer 156, it is possible for anyone, anytime, anywhere to operate the computer 154 at a remote location in view of its penetration rate, carrying rate, mobile phone wireless network maintenance status, etc. Become.
JP 2004-62515 A JP 2004-258835 A

  However, in the system 152 described above, if a mobile phone is used as the operating computer 156, the following problem occurs. Generally, a cellular phone does not include a coordinate designation device (such as a mouse, a touch pad, or a touch panel) for directly designating a pointer position (coordinates) in a screen. Therefore, a method of moving the pointer position using a direction indicating device such as a cross key (see 78 in FIG. 4) can be considered.

  On the other hand, since the display screen of the mobile phone is often smaller than that of the computer 154 to be operated, only a part of the operated screen is displayed on the display screen of the mobile phone. In such a case, the operated screen must be scrolled within the display screen of the mobile phone, and the direction indicating device described above must be used to indicate the direction of scrolling. For this reason, a direction indicating device such as a cross key cannot be used as a dedicated device for moving the pointer position.

  In this case, a method in which the function of the direction indicating device is switched between the pointer position movement mode and the scroll mode by another key operation or the like can be considered. However, in the case of a mobile phone, since compactness is emphasized, the actual situation is that the arrangement and operability of each key are not considered so much, and the key operation is not always easy. On the other hand, since the display screen is small, the switching frequency between the pointer position movement mode and the scroll mode is high. For this reason, with such a method, it is difficult to perform remote operation without stress.

  The present invention solves the problems of such a conventional system, and the computer to be operated can be easily remotely operated even from an operating computer having no coordinate designation device such as a general mobile phone. The purpose is to provide a remote control system.

  A remote operation system for a computer according to the present invention comprises an operated computer, a display unit having a display screen, and an operation unit having a direction indicating operation body for indicating a direction, and the operated computer is provided via an information communication network. A remote operation device for remote operation, the remote operation device acquiring screen display information of the operated computer via an information communication network, and displaying the operation display on the display screen of the remote operation device. A remote operation control unit that reproduces and displays and controls to generate a remote operation command based on a signal from the operation unit of the remote operation device and send it to the operated computer via the information communication network, The control unit determines a display target area to be reproduced and displayed on the display screen of the remote control device among the operated screens based on the signal from the direction indicating operation body. The display target area movement control unit that controls to move the display target area and the pointer position on the operated screen are linked to the movement of the display target area in the same direction as the display target area and the display target And a pointer position control unit that controls to move the same amount as the movement amount of the region.

  A remote operation device according to the present invention is a remote operation device that includes a display unit having a display screen and an operation unit having a direction indicating operation body for indicating a direction, and remotely operates an operated computer via an information communication network. In addition, the screen display information of the operated computer is acquired via the information communication network, reproduced and displayed as the operated screen on the display screen of the remote operation device, and remotely operated based on a signal from the operation unit of the remote operation device. A remote operation control unit is provided for controlling the command to be generated and sent to the operated computer via the information communication network. The remote operation control unit reproduces and displays the command on the display screen of the remote operation device among the operated screens. A display target region movement control unit for controlling the display target region to be moved in a direction corresponding to the signal based on a signal from the direction indicating operation body; A pointer position control unit that controls the inter position to move in the same direction as the movement direction of the display target area and the same amount as the movement amount of the display target area in conjunction with the movement of the display target area. It is characterized by this.

  A program according to the present invention includes a display unit having a display screen and an operation unit having a direction indicating operation body for instructing a direction, and remotely operating the operated computer via an information communication network. A program that functions as an operation device, the remote operation device obtains screen display information of an operated computer via an information communication network, reproduces and displays it as an operated screen on the display screen of the remote operation device, and A remote operation control unit that controls to generate a remote operation command based on a signal from the operation unit of the remote operation device and send it to the operated computer via the information communication network is provided. The display target area to be reproduced and displayed on the display screen of the remote control device among the operation screens, based on the signal from the direction indicating operation body, the direction corresponding to the signal The display target area movement control unit that controls the movement and the pointer position on the operated screen are linked to the movement of the display target area in the same direction as the movement direction of the display target area, and the amount of movement of the display target area And a pointer position control unit that controls to move the same amount.

  A method for remotely operating a computer according to the present invention uses a remote operation device having a display unit having a display screen and an operation unit having a direction indicating operation body for indicating a direction, and is operated via an information communication network. A method of remotely operating a computer, wherein screen display information of an operated computer is acquired via an information communication network, reproduced and displayed as an operated screen on a display screen of a remote operation device, and from an operation unit of the remote operation device A remote operation control step for controlling to generate a remote operation command based on the signal and send it to the operated computer via the information communication network, the remote operation control step comprising: A display for controlling the display target area to be reproduced and displayed on the display screen based on a signal from the direction indicating operation body in a direction corresponding to the signal. The display area movement control step and the pointer position on the operated screen are moved in the same direction as the movement direction of the display target area and the same amount as the movement amount of the display target area in conjunction with the movement of the display target area. And a pointer position control step for controlling.

  The features of the present invention can be broadly shown as described above, but the configuration and contents thereof, together with the objects and features, will be further clarified by the following disclosure in view of the drawings.

  A remote operation system for a computer according to claim 1 includes an operated computer, a display unit having a display screen, and an operation unit having a direction indicating operation body for indicating a direction, and the operated computer via an information communication network. A remote control device for remotely operating the remote control device, wherein the remote control device acquires screen display information of the operated computer via the information communication network and displays the operated screen on the display screen of the remote control device. And a remote operation control unit that controls to generate a remote operation command based on a signal from the operation unit of the remote operation device and send it to the operated computer via the information communication network. The operation control unit determines the display target area to be reproduced and displayed on the display screen of the remote control device among the operated screens based on the signal from the direction indicating operation body. The display target area movement control unit that controls to move the display target area and the pointer position on the operated screen are linked to the movement of the display target area in the same direction as the display target area and the display target And a pointer position control unit that controls to move the same amount as the movement amount of the region.

  A remote operation device according to claim 2 comprises a display unit having a display screen and an operation unit having a direction indicating operation body for indicating a direction, and remotely operates the operated computer via an information communication network. The screen display information of the operated computer is acquired via the information communication network, reproduced and displayed as the operated screen on the display screen of the remote operation device, and remotely controlled based on the signal from the operation unit of the remote operation device. A remote operation control unit that controls to generate an operation command and send it to the operated computer via the information communication network, and the remote operation control unit reproduces and displays it on the display screen of the remote operation device among the operated screens. A display target region movement control unit for controlling the display target region to be moved in a direction corresponding to the signal based on a signal from the direction indicating operation body; A pointer position control unit that controls the inter position to move in the same direction as the movement direction of the display target area and the same amount as the movement amount of the display target area in conjunction with the movement of the display target area. It is characterized by this.

  According to a third aspect of the present invention, there is provided a program comprising a display unit having a display screen and an operation unit having a direction indicating operation body for indicating a direction, and remotely operating the operated computer via an information communication network. A program that functions as a remote operation device, the remote operation device acquires screen display information of an operated computer via an information communication network, and reproduces and displays it as an operated screen on the display screen of the remote operation device. A remote operation control unit that controls to generate a remote operation command based on a signal from the operation unit of the remote operation device and send it to the operated computer via the information communication network, the remote operation control unit includes: The display target area to be reproduced and displayed on the display screen of the remote control device among the operated screens, based on the signal from the direction indicating operation body, the direction corresponding to the signal The display target area movement control unit that controls the movement and the pointer position on the operated screen are linked to the movement of the display target area in the same direction as the movement direction of the display target area, and the amount of movement of the display target area And a pointer position control unit that controls to move the same amount.

  A recording medium on which the program according to claim 4 is recorded is characterized in that the program is recorded.

  According to a sixth aspect of the present invention, there is provided a remote operation method for a computer through an information communication network using a remote operation device including a display unit having a display screen and an operation unit having a direction indicating operation body for indicating a direction. A method for remotely operating an operation computer, wherein screen display information of an operated computer is acquired via an information communication network, reproduced and displayed as an operated screen on a display screen of a remote operation device, and an operation unit of the remote operation device A remote operation control step for controlling to generate a remote operation command based on a signal from the computer and sending it to the operated computer via the information communication network, and the remote operation control step includes a remote operation of the operated screen. A display for controlling the display target area to be reproduced and displayed on the display screen of the apparatus to move in a direction corresponding to the signal based on a signal from the direction indicating operation body. The display area movement control step and the pointer position on the operated screen are moved in the same direction as the movement direction of the display target area and the same amount as the movement amount of the display target area in conjunction with the movement of the display target area. And a pointer position control step for controlling.

  In other words, in these systems, devices, programs, and recording media and methods that record the programs, the display target area to be reproduced and displayed on the display screen of the remote control device among the operation target screens is a signal from the direction indicating operation body. Based on this, the pointer is moved in the direction corresponding to the signal, and the pointer position on the operated screen is linked to the movement of the display target area in the same direction as the display target area, and the display target area is moved. The same amount as the amount is moved.

  Accordingly, when the display target area on the operated screen is moved by operating the direction indicating operation body, the pointer position on the operated screen follows this and moves by the same amount. As a result, on the display screen of the remote control device, the displayed operation screen appears to move in the direction opposite to the movement direction of the display target area, and the pointer position seems to be fixed with respect to the display screen. Looks like.

  For this reason, if the direction indicating operation body is operated so that the desired portion in the desired display target area on the operated screen is positioned at the pointer position fixed on the display screen, only the operation of the direction indicating operation body is performed. It is possible to simultaneously move the display target area and specify the pointer position.

  That is, even if the operation side computer does not have a coordinate designating device such as a general mobile phone, it can be easily operated by a simple operation if it has a direction indicating operation body (direction indicating device). Remote control is possible.

  In the system, the apparatus, the program, or the recording medium on which the program is recorded, the operation unit further includes a scale operation body, and the remote operation control unit reduces the scale of the operated screen reproduced and displayed on the display screen. , A scale control unit that controls to change based on a signal from the scale operating body, and a unit movement amount of the display target area based on the signal from the direction indicating operating body to control to change in conjunction with the scale change And a unit movement amount control unit.

  In the method according to claim 7, the operation unit further includes a scale operation body, and the remote operation control step changes the scale of the operation screen reproduced and displayed on the display screen based on a signal from the scale operation body. A scale control step for controlling the unit movement amount, and a unit movement amount control step for controlling the unit movement amount of the display target area based on the signal from the direction indicating operation body in conjunction with the change of the scale. It is characterized by this.

  In other words, in these systems, devices, programs, and recording media and methods recording the programs, the scale of the operation screen reproduced and displayed on the display screen of the remote control device is further based on the signal from the scale operation body. In addition to the change, the unit movement amount of the display target area based on the signal from the direction indicating operation body is changed in conjunction with the change of the scale.

  Therefore, if the scale operation body is operated to change the scale of the operation screen to be reproduced and displayed, the unit movement amount of the display target area is automatically changed in conjunction therewith. For this reason, when the direction indicating operation body is operated, the display target area can be always moved with the optimum unit movement amount according to the scale of the operation screen being reproduced and displayed. That is, it becomes possible to further remotely operate the operated computer easily without stress.

  In the claims, the “remote operation command” is generated directly or indirectly based on a signal from the operation unit of the remote operation device, and is operated via the information communication network to operate the operated computer. A signal sent to a computer. In the embodiment, the scale change command, the display target area movement command, the pointer position movement command, the selection command, the character string input command, and the like shown in FIG. 6 correspond to this.

  The “unit movement amount of the display target area” refers to the movement amount of the display target area on the operated screen per unit operation of the direction indicating operation body. Here, the “unit operation” is a concept including both a single operation and an operation within a unit time.

  FIG. 1 is a block diagram showing a configuration of a remote operation system 2 which is a remote operation system for a computer according to an embodiment of the present invention. The remote operation system 2 includes an operated computer 4 and a remote operation device (operation side computer) 6, which are a LAN (Local Area Network), a WAN (Wide Area Network), and the Internet. The communication is possible via the information communication network 8. FIG. 2 is a block diagram showing the configuration of the remote control device 6.

  As shown in FIG. 1, the remote control device 6 acquires screen display information of the operated computer 4 via the information communication network 8, and reproduces and displays it as an operated screen on the display screen 12 (see FIG. 2). .

  The user 158 of the remote operation device 6 operates the operation unit 32 (see FIG. 2) while viewing the operated screen displayed on the display screen 12. The remote operation control unit 18 (see FIG. 2) of the remote operation device 6 performs internal information processing based on information input from the operation unit 32, or generates a remote operation command to generate an information communication network 8. Or sent to the computer 4 to be operated.

  The operated computer 4 performs information processing based on the transmitted remote operation command. When it is necessary to send new screen display information to the remote operation device 6 due to changes in the screen display information of the operated computer 4 due to this information processing, the information is sent via the information communication network 8. To do.

  By repeating such processing, the user 158 can remotely operate the operated computer 4 using the remote operation device 6. Of the remote operation system 2, general remote operation processing is performed by, for example, a “remote desktop” system used in a Windows (trademark) OS or a “VNC (virtual network computing)” system of RealVNC. Since it is the same as the processing in the conventional known remote control system, detailed description is omitted.

  Next, the remote control device 6 will be described in detail with reference to FIG. The remote operation device 6 includes a display unit 10 having a display screen 12, a memory unit 14, a communication interface unit 16 for communicating with the operated computer 4 via the information communication network 8, a remote operation control unit 18, And an operation unit 32.

  The operation unit 32 includes a scale operation body 34, a direction instruction operation body 36, a selection operation body 38, and a character string operation body 40.

  The scale operation body 34 is used to change the scale of the operated screen of the operated computer 4 reproduced and displayed on the display screen 12 of the remote operation device 6.

  The direction indicating operation body 36 is used to indicate a direction, for example, a direction in the display screen 12 of the remote operation device 6.

  The character string operating body 40 is used for inputting a character string. Here, the “character string” refers to one or more sentence components and is a concept including letters, numbers, and symbols.

  The selection operation body 38 is used to select a selection target element corresponding to the pointer position among the selection target elements constituting the operated screen reproduced and displayed on the display screen 12 of the remote operation device 6. Here, the “selection target element” refers to an element to be selected by the selection operation body 38. For example, in addition to visual information on the operated screen such as an icon, a character string, a part of or the entire image, these The visual information is defined or includes a coordinate point on the operated screen that can be defined. Further, “putting a selection target element into a selected state” means designating the selection target element as an information processing target to be executed later.

  The remote operation control unit 18 acquires screen display information of the operated computer 4 via the information communication network 8 and reproduces and displays it as an operated screen on the display screen 12 of the remote operation device 6, and also operates the remote operation device 6. Based on the signal from the unit 32, control is performed such that internal processing is performed or a remote operation command is generated and sent to the operated computer 4 via the information communication network 8.

  The remote operation control unit 18 includes a scale control unit 20, a unit movement amount control unit 22, a display target area movement control unit 24, a pointer position control unit 26, a selection control unit 28, and a character string input control unit 30. And.

  The display target area movement control unit 24 selects a display target area to be reproduced and displayed on the display screen 12 of the remote operation device 6 among the operated screens, based on a signal from the direction indicating operation body 36, and a direction corresponding to the signal. Control to move to.

  The pointer position control unit 26 moves the pointer position on the operated screen in the same direction as the movement direction of the display target area and the same amount as the movement amount of the display target area in conjunction with the movement of the display target area. Control.

  The scale control unit 20 controls to change the scale of the operation screen reproduced and displayed on the display screen 12 based on a signal from the scale operation body 34.

  The unit movement amount control unit 22 controls to change the unit movement amount of the display target area based on the signal from the direction indicating operation body 36 in conjunction with the change of the scale of the operated screen.

  The selection control unit 28 selects a selection target element corresponding to the pointer position among the selection target elements constituting the operated screen reproduced and displayed on the display screen 12 of the remote control device 6 based on the signal from the selection operation body 38. Is controlled to be in a selected state.

  The character string input control unit 30 controls to input a character string based on a signal from the character string operating body 40.

  FIG. 3 is a block diagram showing an example of the hardware configuration of the operated computer 4 and the remote operation device (operation side computer) 6 constituting the remote operation system 2 shown in FIG. 1. The mobile phone 6 is used as the remote operation device. This is an example when used. In this example, a mobile phone wireless network 8a and the Internet 8b are used as the information communication network 8.

  As shown in FIG. 3, the mobile phone 6 is a recording medium in which a program on the mobile phone 6 side of this system is recorded. The mobile phone 6 executes a program recorded in the memory 70 corresponding to the memory unit 14 in FIG. CPU 62 corresponding to remote operation control unit 18, LCD (liquid crystal display device) 64 corresponding to display unit 10, operation key group 74 corresponding to operation unit 32, and computer 4 to be operated via information communication network 8. A communication interface 72 corresponding to the communication interface unit 16, a microphone 66 and a speaker 68.

  The operation key group 74 includes a first function key 76a and a second function key 76b (also referred to as function keys 76) that function as the scale operation body 34, a cross key 78 that functions as the direction indicating operation body 36, and a selection operation body 38. And a numeric keypad 82 (consisting of a plurality of keys) as the character string operating body 40.

  The mobile phone 6 has the original functions of the mobile phone such as a transmission / reception function. However, since these functions and the hardware configuration for realizing these functions are the same as the conventional ones, description thereof is omitted. .

  The operated computer 4 has the same configuration as a general personal computer or server computer. The operated computer 4 loads a hard disk 50 as a storage device, which is a recording medium on which the program on the operated computer 4 side of this system is recorded, and the program recorded on the hard disk 50 into a main memory (not shown) and executes it. CPU 42 as a control means, LCD 44 as a display device, keyboard 46 and mouse 48 as input devices, and a communication interface 52 for communicating with the mobile phone 6 and the like via the information communication network 8.

  FIG. 4 is a drawing showing an example of the external configuration of the mobile phone 6 (a front view in use). An LCD 64 is arranged at the top of the drawing, and an operation key group 74 is arranged below the LCD 64.

  FIG. 5 is a flowchart illustrating an example of a process flow in the remote operation system 2. FIG. 6 is a flowchart showing in detail an example of “information processing based on key operation” (step S2) shown in FIG. 7 to 9 are drawings conceptually showing the situation on the operated screen 90 for explaining the processing in FIG. 5, and FIG. 7 is a scale change command sending process (step S12), FIG. FIG. 9 relates to a display area movement command sending process (step S15) and a pointer position moving command sending process (step S16).

  Based on FIGS. 3-9, the process in the remote control system 2 is demonstrated. As shown in FIG. 5, the CPU 62 of the mobile phone 6 shown in FIG. 3 monitors the key operation (step S1). When detecting the key operation, the CPU 62 determines what key operation has been performed, Information processing predetermined for each operation is performed (step S2).

  In step S2, the CPU 62 performs processing such as sending the content of the key operation as it is as a remote operation command to the operated computer 4 in accordance with the key operation, or performing arithmetic processing based on the key operation. A process of sending the result to the operated computer 4 as a remote operation command is performed. A specific example of the process in step S2 will be described later.

  The CPU 42 of the operated computer 4 monitors a remote operation command from the mobile phone 6 (step S5). When receiving the remote operation command, the CPU 42 determines what remote operation command is received, and determines the remote operation command. Information processing predetermined for each is performed (step S6).

  In step S <b> 6, the CPU 42 performs a process of taking the key operation input of the mobile phone 6 as it is as the key operation input of the operated computer 4 in accordance with the received remote operation command, or the mobile phone 6 based on the key operation of the mobile phone 6. In addition to performing processing such as calculation processing performed on the telephone 6 as input to the operated computer 4, information processing on an application program based on these inputs is performed.

  The CPU 42 of the operated computer 4 monitors whether it is necessary to send the screen display information (information to be displayed on the LCD 44 of the operated computer 4) to the mobile phone 6 (step S7). If it is determined that there is a part, the whole or part of the screen display information is sent to the mobile phone 6 (step S8).

  In step S7, for example, the CPU 42 changes the screen display information as a result of the information processing in step S6, and the operation screen to be displayed on the display screen 12 of the LCD 64 of the mobile phone 6 due to the change in the screen display information. When it is determined that the display content changes, it is determined that part or all of the new screen display information needs to be sent to the mobile phone 6.

  However, even if it is determined in step S7 that the display content of the operation screen to be displayed on the display screen 12 of the mobile phone 6 changes, the display content after the change has already been stored in the memory 70 of the mobile phone 6. If stored, it may be determined that it is not necessary to send the changed screen display information to the mobile phone 6.

  The CPU 62 of the mobile phone 6 monitors whether or not there is a change in the content to be displayed on the display screen 12 of the LCD 64 (step S3). If there is a change, the display content on the display screen 12 is updated. (Step S4).

  In step S3, for example, when the CPU 62 receives new screen display information sent out in step S8, the CPU 62 determines that the content to be displayed on the display screen 12 of the LCD 64 is changed. In step S3, even if new screen display information is not received from the computer 4 to be operated, it is determined that the contents to be displayed on the display screen 12 of the LCD 64 are changed by the internal processing of the mobile phone 6. In some cases.

  In this way, processing in the remote operation system 2 proceeds.

  Next, an example of the process of step S2 in FIG. 5 will be described with reference to FIG. The CPU 62 of the mobile phone 6 determines whether the key operation in step S1 is a scale change instruction, a display target area movement instruction, a selection instruction, or a character string input instruction (step S11, step S14, step S17, step S19).

  In this embodiment, when the function key 76 is operated, the CPU 62 determines that a scale change instruction has been given (step S11), generates a scale change instruction as a remote operation instruction, and operates the computer 4 to be operated. (Step S12).

  An example of the procedure of the scale change command sending process in step S12 will be described. Assuming that the scale of the operation screen 90 is S, assuming that the resolution of the display screen (not shown) of the LCD 44 of the operation computer 4 is, for example, “1280 × 1024”, the operation screen 90 shown in FIG. The size (number of constituent pixels) is “1280 × 1024” × S.

  On the other hand, if the sizes (number of constituent pixels) of the display target areas 92 and 94 shown in FIG. 7 and the resolution of the display screen 12 of the mobile phone 6 are all equal, the resolution of the display screen 12 of the mobile phone 6 is For example, assuming that it is “240 × 320”, the sizes of the display target areas 92 and 94 and the like are all fixed sizes of “240 × 320”.

  Therefore, in this case, the display screen 12 of the mobile phone 6 includes display target areas 92 and 94 having a size of “240 × 320” pixels among the operation screen 90 having a size of “1280 × 1024” × S pixels. Etc. will be displayed. That is, the ratio of the display target area to the operated screen 90 increases as the scale S of the operated screen 90 decreases, and as a result, the operated screen 90 is further reduced on the display screen 12 of the mobile phone 6. Will be displayed.

  In the example shown in FIG. 7, the display target area 92 is obtained when the scale of the operated screen 90 is S = S1, and the display target area 94 is the scale of the operated screen 90 S = S2 = S1 /. 2 is the case.

  In this embodiment, the reciprocal 1 / S of the scale S is stored in a scale storage area (not shown) of the memory 70 of the mobile phone 6. For example, when the first function key 76a among the function keys 76 is operated, the CPU 62 determines that the enlargement instruction is given among the scale change instructions, and calculates the reciprocal 1 / S stored in the scale storage area. A positive positive value (for example, “1”) is subtracted from the reciprocal 1 / S read and read, or the read reciprocal 1 / S is divided by a predetermined value (for example, “2”) exceeding “1”. Then, a smaller new reciprocal 1 / S is calculated, and the calculated new reciprocal 1 / S is written into the scale storage area and sent to the operated computer 4 as a scale change command (enlargement command).

  On the other hand, when the second function key 76b among the function keys 76 is operated, the CPU 62 determines that the reduction instruction is given among the scale change instructions, and calculates the inverse 1 / S stored in the scale storage area. A positive predetermined value (for example, “1”) is added to the reciprocal 1 / S read and read, or a predetermined value (for example, “2”) exceeding “1” is multiplied to the read reciprocal 1 / S. Then, a larger new reciprocal 1 / S is calculated, and the calculated new reciprocal 1 / S is written to the scale storage area and sent to the operated computer 4 as a scale change command (reduction command).

  The operated computer 4 that has received the scale change command receives a new operation screen 90 having a size of “1280 × 1024” × S pixels based on the received scale change command (that is, a new reciprocal 1 / S). Among them, screen display information constituting a display target area having a size of “240 × 320” pixels is sent to the mobile phone 6 (see step S8), and the mobile phone 6 updates the display screen 12 based on this. (See step S4).

  As shown in FIG. 7, in this embodiment, the scale change (enlargement or reduction) processing is performed with the pointer position defined by the tip of the arrow of the pointer 93 on the operated screen 90 as a fixed point (reference position). Like to do. Therefore, even if the scale change process is performed, the pointer position of the pointer 13 displayed on the display screen 12 of the mobile phone 6 does not change.

  As shown in FIG. 6, a unit movement amount changing process is performed following step S12 (step S13). As will be described later (see FIG. 9), by operating the cross key 78, the display target area 92 on the operated screen 90, for example, in a desired direction up, down, left, or right, corresponding to the operation direction (instruction direction). Can be moved to. In this case, the amount of movement of the display target area 92 is generally determined in proportion to the number of operations of the cross key 78, the operation duration, and the like.

  In step S13, the unit movement amount of the cross key 78 (that is, the movement amount of the display target area on the operated screen 90 per unit operation of the cross key 78) is set to the new scale S calculated in step S12. Processing to change based on is performed.

  In step S13, the CPU 62 of the mobile phone 6 reads the reciprocal 1 / S stored in the scale storage area of the memory 70, and a predetermined mathematical formula (N = f) based on the read reciprocal 1 / S. According to (S)), a new unit movement amount N (N is expressed by the number of pixels, for example) is calculated. That is, as long as the unit movement amount N is given as a function of the scale S, its specific calculation formula is not particularly limited, but is preferably given by the following formula (1).

N = P × (1 / S) ^Q (1)

  In Equation (1), P is a coefficient (P ≠ 0), and Q is a power multiplier (Q ≠ 0). The sign of the coefficient P is not particularly limited, but if it is positive, the operation direction of the cross key 78 and the moving direction of the display target area are preferably matched.

  The value of the power multiplier Q in the formula (1) is not particularly limited. However, if Q ≧ 1, the scale S is changed and the operation screen 90 is enlarged and displayed on the display screen 12. This is preferable because the amount of movement of the display target area on the display screen 12 per unit operation of the key 78 does not become larger than before enlargement.

  If power factor Q> 1 in Equation (1), the scale S is changed and the operated screen 90 is enlarged and displayed on the display screen 12, and the cross key 78 is displayed on the display screen 12 per unit operation. This is more preferable because the amount of movement of the display target area is smaller than that before enlargement. In such a configuration, when the operation screen 90 is reduced and displayed on the display screen 12, it is often desired to roughly move the display target area on the display screen 12, and when the display screen 12 is enlarged, the display screen 12 is displayed. It is noted that there are many cases in which it is often desired to finely move the display target area. With such a configuration, the operated computer 4 can be easily remotely operated without stress.

  Assuming that the power multiplier Q≈2 in the equation (1), when the scale S is changed and the operated screen 90 is enlarged and displayed on the display screen 12, the cross key 78 is displayed on the display screen 12 per unit operation. It is more preferable because the amount of movement of the display target area changes almost in inverse proportion to the enlargement ratio. For example, when the operation screen 90 is enlarged and displayed on the display screen 12 twice as much as the original, the amount of movement of the display target area on the display screen 12 per unit operation of the cross key 78 is about 1 from the original. / 2.

  FIG. 8 is a cross-sectional view of the cross key 78 when the scale S is changed and the operation screen 90 is enlarged and displayed twice on the display screen 12 when the power factor Q = 2 in the equation (1). It is a figure for demonstrating how the movement amount (unit movement amount N) of the display object area | region on the to-be-operated screen 90 per unit operation changes.

  Before the scale S is changed, the display target area is changed from, for example, the display target area 106 to the display target area 108 by the unit operation of the cross key 78 (that is, the display target area is indicated by 108 from the position indicated by 106). Move to position).

  Here, the scale S is doubled to the original, and the operated screen 90 is enlarged and displayed on the display screen 12 twice the original (that is, the size of the operated screen 90 is also represented by the length ratio). The display target area is changed from, for example, the display target area 102 to the display target area 104 by the unit operation of the cross key 78 (that is, the display target area is changed from the position indicated by 102 to 104). Move to the position shown).

  In this case, according to the equation (1), the unit movement amount N is changed from the value indicated by the arrow 107 shown in FIG. It turns out that it has changed to 1/4 of. On the other hand, since the operated screen 90 is enlarged and displayed on the display screen 12 twice as much as the original, the display screen per unit operation of the cross key 78 is eventually increased by reducing the scale S to twice the original. The amount of movement of the display target area on 12 is ½ of the original.

  The unit movement amount N calculated in this way is stored in a unit movement amount storage area (not shown) of the memory 70, and a display target area movement command sending process (step S15) and a pointer position movement command sending process to be described later. Referenced in (step S16).

  Returning to FIG. 6, when the cross key 78 is operated, the CPU 62 determines that a display target area movement instruction has been given (step S14), and displays the display target area movement command and the pointer position as a remote operation command. A movement command is generated and sent to the operated computer 4 (steps S15 and S16).

  An example of the procedure of the display target area movement command sending process in step S15 will be described. When the cross key 78 is operated, the CPU 62 determines the direction of the operation, reads the unit movement amount N stored in the unit movement amount storage area of the memory 70, and displays the operation of the cross key 78 on the operated screen 90. A display target area movement command is generated that includes moving the display target area by a unit movement amount N (pixel) in a direction corresponding to the operation direction (display target area movement direction). It is sent to the computer 4 to be operated.

  As shown in FIG. 6, following step S15, pointer position movement command transmission processing is performed (step S16). An example of the procedure of the pointer position movement command sending process in step S16 will be described. In this step, the CPU 62 moves the pointer position on the operated screen 90 by the unit movement amount N in the display target area movement command in the display target area movement direction in the display target area movement command generated in step S15. A pointer position movement command containing the above is generated and sent to the operated computer 4 as a remote operation command.

  The operated computer 4 that has received the display target area moving command and the pointer position moving command receives the display target area by the unit movement amount N in the display target area moving direction on the operated screen 90 based on the received commands. In addition, processing is performed so that the pointer position is moved, and screen display information constituting a new display target area after processing is sent to the mobile phone 6 (see step S8). The display screen 12 is updated (see step S4).

  In this way, the display target area movement command and the pointer position movement command are executed by operating the cross key 78, and the display target area on the operated screen 90 is changed from, for example, the display target area 92 to the display target area 96 shown in FIG. (That is, the display target area moves from the position shown in 92 to the position shown in 96), and the pointer 93 on the operated screen 90 also moves by the same amount in the same direction as the display target area.

  As a result, when the cross key 78 is operated, the display target area moves on the display screen 12, but the pointer 13 does not move and remains fixed. For this reason, if the cross key 78 is operated so that the desired portion of the desired display target area on the operated screen 90 comes to the pointer 13 fixed to the display screen 12, only the operation of the cross key 78 can be performed. The movement of the display target area and the designation of the pointer position can be performed simultaneously.

  In other words, even if the cellular phone 6 does not have a coordinate designating device such as a mouse, it is easy to remotely operate the operated computer 4 without stress as long as it has a direction indicating device such as a cross key 78. It becomes possible to operate.

  In this embodiment, the pointer 13 is displayed at the center of the display screen 12. Since human vision has the highest resolution near the center (viewpoint) of the visual field, the pointer 13 is placed in the center of the display screen 12 so that the entire state of the display screen 12 can be grasped while gazing at the pointer 13. be able to. For this reason, the operated computer 4 can be remotely operated without further stress.

  Returning to FIG. 6, when the selection key 80 is operated, the CPU 62 determines that a selection instruction is given (step S <b> 17), generates a selection command as a remote control command, and sends it to the operated computer 4. It is sent out (step S18). This selection command corresponds to, for example, a command (signal) generated by a left click of the mouse in a computer equipped with a mouse.

  The operated computer 4 that has received the selection command processes the selection target element such as an icon at a position corresponding to the position of the pointer 93 on the operated screen 90 based on the received selection command. At the same time, the processed screen display information is sent to the mobile phone 6 (see step S8), and the mobile phone 6 updates the display screen 12 based on this (see step S4).

  Next, as shown in FIG. 6, when the numeric keypad 82 is operated, the CPU 62 determines that a character string input instruction has been given (step S19), and generates a character string input command as a remote operation command. Then, it is sent to the operated computer 4 (step S20).

  The numeric keypad 82 is composed of a plurality of keys. In this example, as shown in FIG. 4, the numeric keypad 82 includes ten numeric keys “0” to “9” and two symbol keys “*” and “#”. ing. Each key constituting the numeric keypad 82 corresponds to a different character or the like according to an input mode (for example, a numeric mode, an English character mode, a kana mode, etc.). For example, the “2” key is “2”, “A, B or C (identified by the number of operations)”, “Kana line (identified by the number of operations) in the numeric mode, the English character mode, and the kana mode, respectively. Is supported.

  An example of the procedure of the character string input command transmission process in step S20 will be described. In this step, the CPU 62 determines what the current input mode is, determines the type and the number of operations of the operated numeric keypad 82, determines the input character, etc. based on these, and determines the character, etc. A character string input command having the content of the input is generated and sent to the operated computer 4 as a remote control command.

  In addition, the operated computer 4 that has received the character string input command performs processing so as to take in characters and the like designated in the received character string input command as input, and sends the processed screen display information to the mobile phone 6. Based on this (see step S8), the mobile phone 6 updates the display screen 12 (see step S4).

  By repeating such processing, the operated computer 4 can be remotely operated using the mobile phone 6.

  Note that steps S1 to S4 in FIG. 5 correspond to the remote operation control unit 18 in FIG. Further, step S11 to step S12 in FIG. 6 correspond to the scale control unit 20 in FIG. 2, and step S13 corresponds to the unit movement amount control unit 22. Similarly, steps S14 to S15 correspond to the display target area movement control unit 24, and step S16 corresponds to the pointer position control unit 26. Steps S17 to S18 correspond to the selection control unit 28, and steps S19 to S20 correspond to the character string input control unit 30.

  In this embodiment, a remote operation command such as a scale change command, a display target area movement command, a pointer position movement command, a selection command, and a character string input command generated in the mobile phone 6 is sent to the operated computer 4. New screen display information (new screen display information) constituting a new display target area reflecting the information processing result executed by the operated computer 4 based on the remote operation command is received from the operated computer 4 each time. The display screen 12 of the mobile phone 6 is updated, but the present invention is not limited to this.

  For example, when the memory 70 has a sufficient capacity, the screen display information constituting the display target area previously displayed on the display screen 12 is stored in the memory 70, and the new screen display information is stored in the memory 70. If it is determined that it is included in the displayed screen display information, the display screen 12 is updated based on the screen display information stored in the memory 70 without sending the new screen display information from the operated computer 4. It can also be configured.

  Further, the operation screen 90 includes a larger amount of screen display information including the screen display information (current screen display information) constituting the display target area currently displayed on the display screen 12, preferably the current screen display information. The entire screen display information, more preferably, the entire screen display information at the maximum scale (for example, S = 1) including the current screen display information is stored in the memory 70, and the new screen display information is stored in the memory 70. If the screen display information stored in the memory 70 is determined to be included, the new screen display information is not sent from the operated computer 4 on the basis of the screen display information stored in the memory 70. The display screen 12 can also be configured to be updated.

  When it is determined that the new screen display information is partially included in the screen display information stored in the memory 70, the new screen display information is included in the screen display information stored in the memory 70 among the new screen display information. The screen display information stored in the memory 70 is used for the existing part, and only the part not included in the screen display information stored in the memory 70 among the new screen display information is transmitted from the operated computer 4. It can also be configured.

  Furthermore, it can also be set as the structure which combined these. By adopting these configurations, the amount of information communication between the operated computer 4 and the mobile phone 6 can be reduced. For this reason, it is possible to realize a remote operation system with a quick response and less stress.

  In the above-described embodiment, when the cross key 78 of the cellular phone 6 is operated, a display target area movement command and a pointer position movement command are generated and sent to the operated computer 4 as remote operation commands. The screen display information constituting the new display target area reflecting both the display target area moving process and the pointer position moving process executed by the operated computer 4 based on the command is received from the operated computer 4 and Although the display screen 12 of the telephone 6 is configured to be updated, the present invention is not limited to this.

  For example, focusing on the point that the pointer position seems to be fixed on the display screen 12 of the mobile phone 6, the pointer display control on the display screen 12 of the mobile phone 6 is the control of the pointer position on the operated computer 4. It can also be configured to be performed separately. That is, control is performed so that the pointer is fixedly displayed at a specific position (preferably substantially at the center) of the display screen 12 of the mobile phone 6 regardless of the content of the screen display information sent from the operated computer 4. .

  In this case, for example, when the cross key 78 of the cellular phone 6 is operated, only the display target area movement command is generated and transmitted to the operated computer 4 as the remote operation command, and the operated computer is based on the command. 4 is configured to receive the screen display information constituting the new display target area reflecting only the result of the display target area moving process executed in 4 from the operated computer 4 and update the display screen 12 of the mobile phone 6. be able to.

  Further, after that, when the selection key 80 is operated, a pointer position movement command and a selection command are generated and transmitted to the operated computer 4 as remote control commands, and the pointer position is determined by the operated computer 4 based on the commands. The screen display information constituting the new display target area reflecting the result of the selection process executed by the operated computer 4 is received from the operated computer 4 while the movement process and the selection process are executed. What is necessary is just to comprise so that the display screen 12 may be updated. Note that the pointer position movement process in this case is limited to the internal process of the operated computer 4, and the result of the process is not reflected in the screen display information sent from the operated computer 4.

  According to this configuration, the pointer position movement process in the operated computer 4 is not performed when the cross key 78 of the mobile phone 6 is operated, and then the operated computer 4 is operated for the first time when the selection key 80 is operated. Since the pointer position movement process is performed, the process in the operated computer 4 can be reduced.

  In each of the above-described embodiments, a mobile phone has been described as an example of a remote control device. However, the present invention is not limited to this. As long as it is a communicable device provided with an operation unit having a direction indicating operation body and a display unit, in addition to a mobile phone, for example, a game computer, a television receiver, a car navigation device, a facsimile device, etc. The invention can be applied.

  In each of the above-described embodiments, the cross key has been described as an example of the direction indicating operation body. However, the present invention is not limited to this. The present invention can also be applied when the direction indicating operation body is, for example, a joystick.

  Further, in each of the above-described embodiments, the case where the operated computer and the remote operation device are connected on a one-to-one basis has been described as an example, but the present invention is not limited to this. For example, the present invention can also be applied to a case where an operated computer and a remote operation device are connected in a one-to-many, many-to-one, or many-to-many manner.

  In each of the above-described embodiments, the information communication network has been described as an example of a combination of the Internet and a mobile phone wireless network. However, the present invention is not limited to this. A variety of wireless or wired communication means alone or in any combination corresponds to the information communication network in the present invention.

  In each of the above-described embodiments, the program on the remote operation device side constituting the remote operation system is executed by being installed in the memory of the remote operation device (cellular phone). However, the holding form of the program is not limited to this. For example, the program may be recorded on, for example, an external memory card, CD-ROM, flexible disk, magnetic tape or the like. Further, the program may be distributed via a wired or wireless information communication network.

  Further, the recording mode and distribution mode of the program and data are not particularly limited. In addition to recording or distributing on a recording medium in a form that can be directly executed, it can also be recorded or distributed on a recording medium in a compressed form so as to be decompressed and used, for example.

  In each of the above-described embodiments, the case where each function of FIG. 2 is realized using a computer has been described as an example. However, part or all of the function of FIG. 2 is configured using hardware logic. It may be.

  The above block diagram, hardware configuration, external configuration, flowchart, etc. are given as examples, and the present invention is not limited to the above block diagram, hardware configuration, external configuration, flowchart, etc. Absent.

  Although the present invention has been described above as a preferred embodiment, the terminology has been used for description rather than limitation and departs from the scope and spirit of the present invention. Without departing from the scope of the appended claims. Also, while the above describes only some exemplary embodiments of the present invention in detail, those skilled in the art will recognize the exemplary implementations described above without departing from the novel teachings and advantages of the present invention. It will be readily appreciated that many variations in form are possible. Accordingly, all such modifications are intended to be included within the scope of the present invention.

It is a block diagram which shows the structure of the remote control system 2 by one Embodiment of this invention. 3 is a block diagram showing a configuration of a remote control device 6. FIG. 2 is a block diagram illustrating an example of a hardware configuration of an operated computer 4 and a remote operation device (operation side computer) 6. FIG. 2 is a diagram illustrating an example of an external configuration of a mobile phone 6. 4 is a flowchart illustrating an example of a process flow in the remote operation system 2. 6 is a flowchart showing an example of step S2 shown in FIG. 5 in detail. It is a drawing conceptually showing the situation on the operated screen 90, and relates to a scale change command sending process (step S12). It is a drawing conceptually showing the situation on the operated screen 90, and relates to the unit movement amount changing process (step S13). It is a drawing conceptually showing the situation on the operated screen 90, and relates to a display area movement command sending process (step S15) and a pointer position moving command sending process (step S16). It is a block diagram for demonstrating the conventional remote control system of a computer.

Explanation of symbols

6: Remote operation device 12: Display screen 24: Display target area movement control unit 26: Pointer position control unit 36: Direction indication operation body

Patent Applicant Hitachi System & Service Co., Ltd. Applicant Agent Patent Attorney Koichi Tagawa

Claims (7)

A computer to be operated;
A remote control device comprising: a display unit having a display screen; and an operation unit having a direction indicating operation body for indicating a direction, and remotely operating the operated computer via an information communication network;
A system comprising:
The remote control device is
Acquires the screen display information of the operated computer via the information communication network, reproduces and displays it as the operated screen on the display screen of the remote operation device, and generates a remote operation command based on the signal from the operation unit of the remote operation device A remote operation control unit for controlling to be sent to the operated computer via the information communication network,
The remote control unit is
A display target area movement control unit that controls to move a display target area to be reproduced and displayed on the display screen of the remote control device among the operated screens based on a signal from the direction indicating operation body. When,
A pointer position control unit for controlling the pointer position on the operated screen to move in the same direction as the movement direction of the display target area and the same amount as the movement amount of the display target area in conjunction with the movement of the display target area; ,
Having
A remote control system for a computer. A remote operation device comprising a display unit having a display screen and an operation unit having a direction indicating operation body for indicating a direction, and remotely operating an operated computer via an information communication network,
Acquires the screen display information of the operated computer via the information communication network, reproduces and displays it as the operated screen on the display screen of the remote operation device, and generates a remote operation command based on the signal from the operation unit of the remote operation device A remote operation control unit for controlling to be sent to the operated computer via the information communication network,
The remote control unit is
A display target area movement control unit that controls to move a display target area to be reproduced and displayed on the display screen of the remote control device among the operated screens based on a signal from the direction indicating operation body. When,
A pointer position control unit for controlling the pointer position on the operated screen to move in the same direction as the movement direction of the display target area and the same amount as the movement amount of the display target area in conjunction with the movement of the display target area; ,
Having
Remote control device characterized by. The operation side computer is provided with a display unit having a display screen and an operation unit having a direction indicating operation body for instructing a direction, and functions as a remote operation device for remotely operating the operated computer via an information communication network. A program,
The remote control device is
Acquires the screen display information of the operated computer via the information communication network, reproduces and displays it as the operated screen on the display screen of the remote operation device, and generates a remote operation command based on the signal from the operation unit of the remote operation device A remote operation control unit for controlling to be sent to the operated computer via the information communication network,
The remote control unit is
A display target area movement control unit that controls to move a display target area to be reproduced and displayed on the display screen of the remote control device among the operated screens based on a signal from the direction indicating operation body. When,
A pointer position control unit for controlling the pointer position on the operated screen to move in the same direction as the movement direction of the display target area and the same amount as the movement amount of the display target area in conjunction with the movement of the display target area; ,
Having
A program characterized by   A recording medium on which the program according to claim 3 is recorded. In the system of claim 1, the device of claim 2, the program of claim 3 or the recording medium on which the program of claim 4 is recorded,
The operation unit is
Scale operation body,
Further comprising
The remote control unit is
A scale control unit that controls to change the scale of the operated screen reproduced and displayed on the display screen based on a signal from the scale operating body;
A unit movement amount control unit that controls to change the unit movement amount of the display target area based on a signal from the direction indicating operation body in conjunction with the change of the scale;
Further provided,
It is characterized by. A method of remotely operating an operated computer via an information communication network using a remote operation device comprising a display unit having a display screen and an operation unit having a direction indicating operation body for indicating a direction,
Acquires the screen display information of the operated computer via the information communication network, reproduces and displays it as the operated screen on the display screen of the remote operation device, and generates a remote operation command based on the signal from the operation unit of the remote operation device Remote control step for controlling to be sent to the operated computer via the information communication network,
The remote control step includes
A display target area movement control step for controlling to move a display target area to be reproduced and displayed on the display screen of the remote control device among the operated screens based on a signal from the direction indicating operation body. When,
A pointer position control step for controlling the pointer position on the operated screen to move in the same direction as the movement direction of the display target area and in the same amount as the movement amount of the display target area in conjunction with the movement of the display target area; ,
Having
A method for remotely operating a computer. The method of claim 6 wherein:
The operation unit is
Scale operation body,
Further comprising
The remote operation control step includes:
A scale control step for controlling to change the scale of the operated screen reproduced and displayed on the display screen based on a signal from the scale operating body;
A unit movement amount control step for controlling to change the unit movement amount of the display target area based on the signal from the direction indicating operation body in conjunction with the change of the scale;
Further provided,
It is characterized by.

Images