JP2011107738A - Pointing device, input processing device, input processing method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a pointing device for providing an operation environment allowing a user to easily select a desired cursor position. <P>SOLUTION: The pointing device includes a pointing operation unit 2 for detecting an operation input of cursor position information on a display screen, a pressure sensor 32 for detecting a continuous change in pressing force according to a pressing amount of a user, a switch 31 arranged to be pressed in the same pressing direction as the pressure sensor 32 and detecting two states of an ON state and an OFF state, and a communication unit 6 for outputting operation information of the pointing operation unit 2, the pressure sensor 32, and the switch 31. The communication unit 6 outputs information indicating the pressing force detected by the pressure sensor 32 together with information indicating the operation input detected by the pointing operation unit 2 until state transition by the pressing operation by the switch 31 is detected. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a pointing device that performs an operation input of cursor position information on a display screen, an input processing device that performs an input process on the operation input of the pointing device, an input processing method, and a program.

  In recent years, with the spread of television receivers equipped with Web browsers, living-installed personal computers, and the like, opportunities for inputting information using a remote controller are increasing. As a pointing method for the operating environment of the remote controller, a method in which the cursor on the display screen directly moves in the direction instructed by the remote controller (hereinafter also referred to as direct pointing) is excellent in task execution time and intuition.

  As a problem of direct pointing, it has been pointed out that high-precision click operation is difficult due to camera shake when the remote controller housing is gripped. In general, the click operation by the remote controller is performed by holding the remote controller housing with one hand and pressing a button with its thumb. Click mistakes due to camera shake when this button is pressed occur more frequently when the remote controller is operated compared to devices such as a mouse.

  In addition, since the remote controller is operated and viewed at a certain distance from the display screen, there is a problem in that the visibility of the display screen is reduced.

  As an invention for solving these problems described above, for example, there is a technique disclosed in Patent Document 1. The invention disclosed in Patent Document 1 is a technique that facilitates clicking by enlarging a screen and a target and improves visibility.

JP 2009-43156 A

  However, the invention disclosed in Patent Document 1 has a problem that the operation burden on the user is heavy because the pointing device needs to be tilted to the left and right to enlarge the screen.

  The present invention has been proposed in view of such a situation, and provides a pointing device that provides an operating environment in which a user can easily select a desired cursor position, and an operation input of the pointing device. It is an object of the present invention to provide an input processing device, an input processing method, and a program for performing input processing.

  As a means for solving the above-described problem, a pointing device according to the present invention includes a pointing operation unit that detects an operation input of cursor position information on a display screen, and a continuous pressing force according to a pressing amount by a user. A pressure sensor that detects a change, a switch that is arranged to be pressed in the same pressing direction as the pressure sensor, and that detects two states of an ON state and an OFF state, the pointing operation unit, the pressure sensor, and An output unit that outputs operation information of the switch, and the output unit displays information indicating the pressing force detected by the pressure sensor until the transition of the state due to the pressing operation is detected by the switch. The information is output in association with information indicating the operation input detected by the operation unit.

  An input processing device according to the present invention includes a pointing operation unit that detects an operation input of cursor position information on a display screen, a pressure sensor that detects a continuous change in pressing force according to a pressing amount by a user, The pressure sensor is arranged so as to be pressed in the same pressing direction as the pressure sensor, and detects the two states of an ON state and an OFF state, and the pressure sensor until a state transition due to a pressing operation is detected by the switch A pointing operation amount changing unit for reducing the amount of movement of the cursor position per unit operation input amount by the pointing operation unit, and a cursor position decreased by the pointing operation amount changing unit with an increase in the pressing force detected by A cursor coordinate calculation unit for calculating the coordinates of the cursor position based on the amount of movement of the cursor, and the pointing operation amount variable. Calculated by the cursor coordinate calculation unit when a change in state due to a pressing operation is detected by the switch, and a cursor size determination unit that reduces the cursor size on the display screen as the amount of movement of the cursor position by the unit decreases. An action generating unit that generates an action corresponding to the cursor position indicated by the coordinates.

  The input processing method according to the present invention includes a pointing operation unit that detects an operation input of cursor position information on a display screen, a pressure sensor that detects a continuous change in pressing force according to a pressing amount by a user, An input acquisition step for acquiring operation input information of a pointing device that is arranged to be pressed in the same pressing direction as the pressure sensor and that includes a switch that detects two states of an ON state and an OFF state, and the switch Pointing operation amount change that decreases the amount of movement of the cursor position per unit operation input amount by the pointing operation unit as the pressing force detected by the pressure sensor increases until a state transition due to a pressing operation is detected Step and the movement amount of the cursor position decreased by the pointing operation amount changing step. A cursor coordinate calculating step for calculating the coordinates of the cursor position, a cursor size determining step for reducing the cursor size on the display screen in accordance with a decrease in the movement amount of the cursor position by the pointing operation amount changing step, and pressing by the switch An action generation step of generating an action corresponding to the cursor position indicated by the coordinates calculated by the cursor coordinate calculation step when a state transition due to an operation is detected.

  The program according to the present invention includes a pointing operation unit that detects an operation input of cursor position information on a display screen, a pressure sensor that detects a continuous change in pressing force according to a pressing amount by a user, and the pressure An input acquisition step for acquiring operation input information of a pointing device that is arranged so as to be pressed in the same pressing direction as the sensor and that detects two states of an ON state and an OFF state, and a pressing operation by the switch A pointing operation amount changing step for decreasing the amount of movement of the cursor position per unit operation input amount by the pointing operation unit as the pressing force detected by the pressure sensor increases until a state transition due to Based on the amount of movement of the cursor position decreased by the pointing operation amount changing step, A cursor coordinate calculating step for calculating the coordinates of the sol position, a cursor size determining step for reducing the cursor size on the display screen in accordance with a decrease in the movement amount of the cursor position by the pointing operation amount changing step, and pressing by the switch A program for causing a computer to execute an input process having an action generation step for generating an action corresponding to the cursor position indicated by the coordinate calculated by the cursor coordinate calculation step when a state transition due to an operation is detected is there.

  An input processing device according to the present invention includes a pointing operation unit that detects an operation input of cursor position information on a display screen, a pressure sensor that detects a continuous change in pressing force according to a pressing amount by a user, The coordinates of the cursor position are calculated based on a switch that is arranged to be pressed in the same pressing direction as the pressure sensor and detects two states of an ON state and an OFF state, and an operation input amount by the pointing operation unit. The zoom ratio of the display screen is calculated such that the value increases as the pressing force detected by the pressure sensor increases until a state transition due to a pressing operation is detected by the cursor coordinate calculation unit and the switch. Based on the zoom rate calculation unit, the coordinates calculated by the cursor coordinate calculation unit, and the zoom rate calculated by the zoom rate calculation unit An enlarged area calculating unit that calculates an enlarged area of the display screen, an enlarged screen display unit that displays an enlarged area calculated by the enlarged area calculating unit on the display screen, and a state transition caused by a pressing operation is detected by the switch. A zoom rate fixing unit that controls the enlarged screen display unit so as to fix the zoom rate of the display screen.

  The input processing method according to the present invention includes a pointing operation unit that detects an operation input of cursor position information on a display screen, a pressure sensor that detects a continuous change in pressing force according to a pressing amount by a user, An input acquisition step for acquiring operation input information of a pointing device that is arranged to be pressed in the same pressing direction as the pressure sensor and that detects a switch between an ON state and an OFF state, and the pointing operation With the increase of the pressing force detected by the pressure sensor until the transition of the state due to the pressing operation is detected by the switch, the cursor coordinate calculating step for calculating the coordinates of the cursor position based on the operation input amount by the unit A zoom ratio calculating step for calculating the zoom ratio of the display screen such that the value becomes large, and the cursor coordinate calculation Based on the coordinates calculated by the step and the zoom ratio calculated by the zoom ratio calculation step, an enlargement area calculation step for calculating an enlargement area of the display screen, and an enlargement area calculated by the enlargement area calculation step An enlarged screen display step for displaying an enlarged image on the display screen, and a zoom rate fixing step for performing an enlarged display in which the zoom rate of the display screen is fixed when a state transition due to a pressing operation is detected by the switch.

  The program according to the present invention includes a pointing operation unit that detects an operation input of cursor position information on a display screen, a pressure sensor that detects a continuous change in pressing force according to a pressing amount by a user, and the pressure An input acquisition step for acquiring operation input information of a pointing device that is arranged to be pressed in the same pressing direction as the sensor and that detects two states of an ON state and an OFF state, and by the pointing operation unit The cursor coordinate calculation step for calculating the coordinates of the cursor position based on the operation input amount, and the value as the pressing force detected by the pressure sensor increases until the state transition due to the pressing operation is detected by the switch. A zoom ratio calculation step for calculating the zoom ratio of the display screen so as to increase; and the cursor coordinate calculation step. An enlarged area calculating step for calculating an enlarged area of the display screen based on the coordinates calculated by the zoom and the zoom ratio calculated by the zoom ratio calculating step, and the enlarged area calculated by the enlarged area calculating step. An input having an enlarged screen display step for enlarging and displaying an area on the display screen, and a zoom rate fixing step for performing an enlarged display in which the zoom rate of the display screen is fixed when a state transition due to a pressing operation is detected by the switch A program for causing a computer to execute processing.

  In the present invention, information indicating the pressing force detected by the pressure sensor is operated by a pointing operation until a switch arranged to be pressed in the same pressing direction as the pressure sensor detects a state transition due to the pressing operation. By reflecting the cursor position on the operation of the display screen for displaying, an operation environment that allows the user to easily select the desired cursor position can be provided.

1 is a diagram illustrating an overall configuration of a system to which the present invention is applied. It is a figure which shows the whole structure of the pointing device to which this invention was applied. It is a figure which shows the specific structure of a button operation part. It is a figure which shows the specific structure of a button operation part. It is a figure which shows the whole structure of an input processing apparatus. It is a flowchart for demonstrating the specific control of a cursor position. It is a figure for demonstrating the change of a display screen when changing the pressure value which the pressure value 1 acquisition means acquired in three steps. It is a flowchart for demonstrating the process which generates the action of the mouse click by a mouse click means. It is a flowchart for demonstrating the concrete control of a zoom process. It is a figure for demonstrating the change of a display screen when changing the pressure value which the pressure value 2 acquisition means acquired into three steps.

  A pointing device to which the present invention is applied is a device that performs operation input of cursor position information on a display screen, and is used by being incorporated in an input processing system 100 as shown in FIG. 1, for example.

  That is, an input processing system 100 to which the present invention is applied includes a pointing device 1, an input processing device 7 that performs input processing on an operation input of the pointing device 1, and an input processing device 7, as shown in FIG. A display 8a for displaying a display screen 8 of a graphic interface corresponding to the pointing operation of the pointing device 1 while reflecting the input processing;

  The pointing device 1 is not particularly limited as long as the cursor position information on the display screen 8 is operated and input. In particular, a configuration capable of performing direct pointing by one-hand holding as shown in FIG. 1 is preferable. That is, it is preferable that the casing of the pointing device 1 has a size and shape suitable for one-hand grip.

  Here, direct pointing refers to an operation in which the cursor 9 on the display screen 8 moves in the pointing direction P of the pointing device 1. The position of the cursor 9 may not exactly correspond to the instruction direction P. In order to realize this operation, the pointing device 1 includes a pointing operation unit 2 equipped with, for example, a biaxial gyro sensor, and inputs of each axis are set to values defined by the horizontal coordinate axis X and the vertical coordinate axis Y of the cursor 9. Can be converted. If the pointing operation unit 2 can convert the input of each axis into values defined by the horizontal coordinate axis X and the vertical coordinate axis Y of the cursor 9, the input of each axis can be performed in addition to the gyro sensor described above. You may make it use the mechanism equipped with a detection mechanism, or a direction sensor and an acceleration sensor.

  The input processing device 7 receives operation input information of the pointing device 1 from the pointing device 1 via wireless communication or wired communication, and performs input processing as described later on the received operation input information. Then, the input processing device 7 outputs image information corresponding to the graphic interface reflecting the operation input subjected to the input process to the display 8a.

  The display 8 a displays the image information output from the input processing device 7 on the display screen 8.

  In the input processing system 100 configured as described above, a specific configuration of the pointing device 1 will be described with reference to FIG.

  That is, the pointing device 1 includes a pointing operation unit 2, a button operation unit 3, a microcomputer 4, a memory 5, and a communication unit 6.

  As described above, the pointing operation unit 2 can convert the input of each axis into values defined by the horizontal coordinate axis X and the vertical coordinate axis Y of the cursor 9, and supplies the converted pointing information to the microcomputer 4. To do. Specifically, the pointing operation unit 2 supplies the microcomputer 4 with information indicating the amount of movement of the cursor position according to the unit operation input amount that is converted into values defined by the horizontal coordinate axis X and the vertical coordinate axis Y.

  The button operation unit 3 is an operation unit that receives a pressing operation input by a user. The pointing device 1 only needs to include at least one button operation unit 3, but in the present embodiment, the pointing device 1 will be described as including two button operation units 3a and 3b. The button operation units 3a and 3b are collectively referred to as the button operation unit 3.

  Each button operation unit 3 includes a switch 31 and a pressure sensor 32.

  The switch 31 is arranged so as to be pressed in the same pressing direction as the pressure sensor 32, detects two states of an ON state and an OFF state, and supplies the detected ON / OFF information to the microcomputer 4. Here, the switch 31 may be any switch as long as it can detect a transition of a state due to a pressing operation, but in this embodiment, the switch 31 is described as having a configuration that detects a transition from an OFF state to an ON state. .

  The pressure sensor 32 detects a continuous change in the pressing force according to the pressing amount by the user, and supplies information indicating the detected pressing force to the microcomputer 4. The pressure sensor 32 preferably has a high number of detectable steps. For example, the pressure sensor 32 includes a pressure-sensitive conductive rubber and a pressure-sensitive membrane switch whose electric resistance value varies smoothly according to the pressing force.

  As described above, the button operation unit 3 is arranged so that the switch 31 and the pressure sensor 32 are pressed in the same pressing direction. For example, as shown in FIG. 3 or FIG. Consists of structure.

  FIG. 3A is a top view of the button operation unit 3 disposed on the casing surface of the pointing device 1, and FIG. 3B is a cross-sectional view of the button operation unit 3.

  In other words, the button operation unit 3 is provided with a switch 31 below the key top 33 as shown in FIG. Further, the button operation unit 3 has a pressure sensor 32 incorporated in the key top 33 and continuously detects the pressing force applied to the pressing surface 34. The switch 31 and the pressure sensor 32 are electrically connected to the microcomputer 4. It is preferable that the pressing surface 34 has a size suitable for pressing with a thumb, for example.

  When the pressing force is applied to the pressing surface 34, the button operating unit 3 having the configuration shown in FIG. 3 continuously detects the pressing force, and when the pressing force exceeds a certain value, the pressure sensor The switch 31 provided at the lower portion of the switch 32 changes from the OFF state to the ON state.

  Further, as shown in FIG. 4, the button operation unit 3 may include a switch 31 and a pressure sensor 32. FIG. 4A is a top view of the button operation unit 3 disposed on the housing surface of the pointing device 1, and FIG. 4B is a cross-sectional view of the button operation unit 3.

  That is, as shown in FIG. 4A, the button operation unit 3 includes, for example, a pressing surface 36 to which the pressing force of the abdomen of the finger is applied within a range suitable for pressing with the finger, and the tip of the finger. And a pressing surface 38 to which the pressing force is applied. The button operation unit 3 is provided with a switch 31 below the key top 35 that forms the pressing surface 36, and a pressure sensor 32 below the key top 37 that forms the pressing surface 38, and applies the pressing force applied to the pressing surface 38. Detect continuously.

  In the button operation unit 3 having the configuration shown in FIG. 4, for example, when a pressing force is applied to the pressing surface 38 from the tip of the finger, the pressure sensor 32 continuously detects the pressing force, and the finger is further pressed. Thus, the belly portion of the finger presses the pressing surface 36 adjacent to the pressing surface 38, and the switch 31 is changed from the OFF state to the ON state.

  The button operation unit 3 has a configuration as shown in FIG. 3 or FIG. 4, and continuously presses the pressure sensor 32 according to the pressing amount by the user until the switch 31 changes from the OFF state to the ON state. Detect changes. Here, the button operation unit 3 configured as shown in FIG. 3 detects the transition from the OFF state to the ON state by the switch 31 when the pressure applied to the pressure sensor 32 exceeds a predetermined value. Can do. On the other hand, in the button operation unit 3 configured as shown in FIG. 4, the switch 31 and the pressure sensor 32 are arranged in parallel within a range suitable for pressing with a finger. In a state where an arbitrary pressure value is added to the state, the state detected by the switch 31 by the pressing operation of the user can be changed from the OFF state to the ON state.

  The microcomputer 4 transmits a command signal stored in the memory 5 from the communication unit 6 to the input processing device 7 in accordance with the detected voltage of the switch 31, the pressure sensor 32, and the pointing operation unit 2. The communication unit 6 preferably employs a wireless standard, but may employ a wired standard.

  In the pointing device 1 having the above-described configuration, the button operation unit 3 continuously presses the pressure sensor 32 according to the pressing amount by the user until the switch 31 detects the state transition due to the pressing operation. Detecting a change in pressure, the communication unit 6 outputs the detected information to the input processing device 7 so that the operation input information that allows the user to easily select a desired cursor position is input processing. It can output to the apparatus 7 side. That is, the pointing device 1 displays information indicating the pressing force detected by the pressure sensor 32 until the switch 31 arranged to be pressed in the same pressing direction as that of the pressure sensor 32 detects a state transition due to the pressing operation. The cursor position desired by the user can be easily obtained by outputting to the input processing device 7 in association with the pointing operation input information and reflecting the cursor position 9 operated by the pointing operation on the operation of the display screen 8. It is possible to provide an operating environment that can be selected.

  In order to perform input processing on the operation input information output from such a pointing device 1, the input processing device 7 specifically has a configuration as shown in FIG.

  That is, the input processing device 7 includes an input acquisition unit 71 that acquires information output from the pointing device 1, a coordinate calculation unit 72 that calculates the coordinates of the cursor position, and a cursor display unit 73 that displays a cursor on the display screen 8. A zooming processing unit 74 that performs zooming processing, mouse click means 75 that generates a mouse click action, and zooming fixing means 76 that fixes the zooming process.

  The input acquisition unit 71 includes a switch 1 state acquisition unit 711, a switch 2 state acquisition unit 712, a pointing operation amount acquisition unit 713, a pressure value 1 acquisition unit 714, and a pressure value 2 acquisition unit 715.

  The switch 1 state acquisition unit 711 and the switch 2 state acquisition unit 712 acquire the states of the switches 31 of the two button operation units 3a and 3b of the pointing device 1, respectively. That is, the switch 1 state acquisition unit 711 acquires the ON / OFF state of the switch 31 of the button operation unit 3a. The switch 2 state acquisition unit 712 acquires the ON / OFF state of the switch 31 of the button operation unit 3b.

  The pointing operation amount acquisition unit 713 acquires an input value by the pointing operation unit 2 in order to calculate the operation input amount defined by the vertical coordinate X and the vertical coordinate axis Y on the display screen 8.

  The pressure value 1 acquisition unit 714 and the pressure value 2 acquisition unit 715 acquire the pressure values of the pressure sensors 32 of the two button operation units 3a and 3b of the pointing device 1, respectively. That is, the pressure value 1 acquisition unit 714 acquires the pressure value of the pressure sensor 32 of the button operation unit 3a. Moreover, the pressure value 2 acquisition means 715 acquires the pressure value of the pressure sensor 32 of the button operation part 3b.

  The coordinate calculation unit 72 includes a pointing operation amount changing unit 721 and a cursor coordinate calculation unit 722.

  The pointing operation amount changing unit 721 decreases the pointing operation input amount acquired by the pointing operation amount acquiring unit 713 as the pressure value acquired by the pressure value 1 acquiring unit 714 increases. That is, the pointing operation amount changing unit 721 decreases the movement amount of the cursor position per unit operation input amount by the pointing operation amount acquiring unit 713 as the pressing force detected by the pressure sensor 32 increases. Here, when the pressure value of the pressure sensor 32 is 0, the amount of decrease in the pointing operation input amount is preferably 0. Further, it is preferable to set the pointing operation input amount to 0 based on the pressure value of the pressure sensor 32 immediately before the switch 31 transits from the OFF state to the ON state.

  The cursor coordinate calculation unit 722 calculates the coordinate information of the cursor position, that is, the coordinate points defined by the horizontal coordinate axis X and the vertical coordinate axis Y, based on the pointing operation input amount reduced by the pointing operation amount changing unit 721.

  The cursor display unit 73 includes a cursor size determination unit 731 and a cursor display unit 732.

  The cursor size determining unit 731 changes the size of the cursor displayed on the display screen 8 based on the pointing operation input amount changed by the pointing operation amount changing unit 721. The cursor size determination unit 731 further reduces the cursor size as the movement amount of the cursor position by the pointing operation amount changing unit 721 decreases.

  The pictorial symbol used for the cursor is generally an arrow symbol, but the cursor in this embodiment is not limited to the arrow symbol, and other pictorial symbols such as a rectangular symbol, a circular symbol, a cross symbol, etc. It may be used.

  The cursor display unit 732 displays a cursor of a size changed by the cursor size determination unit 731 at a position defined by the horizontal coordinate axis X and the vertical coordinate axis Y calculated by the cursor coordinate calculation unit 722 on the display screen 8.

  Here, specific control of the cursor position realized by the coordinate calculation unit 72 and the cursor display unit 73 in the input processing device 7 will be described with reference to FIG.

  In step S <b> 11, the coordinate calculation unit 72 causes the pointing operation amount changing unit 721 to decrease the pointing operation input amount acquired by the pointing operation amount acquisition unit 713 as the pressure value acquired by the pressure value 1 acquisition unit 714 increases. Let Then, the process proceeds to step S12.

  In step S12, the input processing device 7 determines whether or not the pointing operation input amount reduced by the pointing operation amount changing means 721 is 0. When the pointing operation input amount is 0, the input processing device 7 proceeds to step S13, and the pointing operation input amount is changed. When the input amount is not 0, the process proceeds to step S14.

  In step S <b> 13, the cursor display unit 73 fixes the cursor size by the cursor size determination unit 731. In addition, the coordinate calculation unit 72 fixes the coordinates of the cursor position.

  In step S <b> 14, the cursor display unit 73 changes the size of the cursor displayed on the display screen 8 based on the pointing operation input amount decreased by the pointing operation amount changing unit 721 by the cursor size determining unit 731. Then, the process proceeds to step S15.

  In step S <b> 15, the coordinate calculation unit 72 uses the cursor coordinate calculation unit 722 to calculate coordinate points defined by the horizontal coordinate axis X and the vertical coordinate axis Y based on the pointing operation amount reduced by the pointing operation amount changing unit 721. . Then, the process proceeds to step S16.

  In step S16, the cursor display unit 73 changes the cursor size determination unit 731 in step S16 to the position defined by the horizontal coordinate axis X and the vertical coordinate axis Y calculated by the cursor coordinate calculation unit 722 in step S15 on the display screen 8. A cursor of the specified size is displayed.

  Here, the upper and lower limit values of the pressure value acquired by the pressure value 1 acquisition means 714 are divided into three, and the display screen 8 by the processing according to steps S11 to S16 when it is increased for each divided unit pressure value. These changes are shown in FIGS. 7A, 7B, and 7C, respectively.

  As shown in FIG. 7A, FIG. 7B, and FIG. 7C, in the input processing device 7, as the pressure value acquired by the pressure value 1 acquisition means 714 increases, the cursor position changes. The cursor movable area 24 is limited, and the cursor can be stopped when the mouse is clicked. Here, as described above, in the button operation unit 3a of the pointing device 1, when the pressing force is continuously applied to the pressure sensor 32, the switch 31 also detects the state transition in conjunction with this operation. Can generate a mouse click action according to the operation of the switch 31 while restricting the cursor movable region 24, and as a result, can suppress a click error due to a camera shake that occurs when the pointing device 1 is held with one hand. it can.

  The zooming processing unit 74 includes a zoom ratio calculating unit 741, an enlarged area calculating unit 742, and an enlarged screen display unit 743.

  The zoom rate calculation unit 741 calculates the zoom rate of the display screen 8 based on the pressure value acquired by the pressure value 2 acquisition unit 715. The zoom rate calculation means 741 preferably sets the zoom rate when the pressure value is 0 to 1 and increases the zoom rate as the pressure value increases.

  The enlarged area calculation unit 742 displays the display image of the display screen 8 based on the zoom rate calculated by the zoom rate calculation unit 741 and the position defined by the horizontal coordinate axis X and the vertical coordinate axis Y calculated by the cursor coordinate calculation unit 722. The enlargement area at is calculated. For example, when the display screen 8 is a screen that performs rectangular display, the enlarged area calculation unit 742 preferably calculates the vertex coordinates of the rectangle as the enlarged area.

  The enlarged screen display means 743 displays the enlarged area calculated by the enlarged area calculation means 742 over the entire display area of the display screen 8.

  The mouse click means 75 generates an action corresponding to the cursor position indicated by the coordinates calculated by the cursor coordinate calculation means 722 when the state transition due to the pressing operation is detected by the switch 31. Specifically, the mouse click unit 75 is defined by the horizontal coordinate axis X and the vertical coordinate axis Y calculated by the cursor coordinate calculation unit 722 when the switch state acquired by the switch 1 state acquisition unit 711 transitions from the OFF state to the ON state. The mouse click ON action is generated at the position where the mouse is clicked, and when the switch state is OFF, the mouse click OFF action is generated at the position defined by the horizontal coordinate axis X and the vertical coordinate axis Y.

  That is, as shown in the flowchart of FIG. 8, the mouse click unit 75 continues to generate an action of turning the mouse click at the current coordinates until the switch state acquired by the switch 1 state acquisition unit 711 is turned on (step S21, S22). When the switch state acquired by the switch 1 state acquisition unit 711 is turned on, the mouse click unit 75 generates a mouse click ON action at the current coordinates (step S23), and then returns to step S21.

  Here, until the button operation unit 3 of the pointing device 1 detects the state transition due to the pressing operation by the switch 31, the pressure sensor 32 detects a continuous change in the pressing force according to the pressing amount by the user. Therefore, the mouse click means 75 can perform an action of turning on the mouse click while the cursor position is fixed as described above. In this way, in the input processing system 100, the cursor movement amount adjustment operation and the mouse click operation are completed with one button, so that an operation system that is easy for the user to understand can be realized.

  In addition, the mouse click means 75 is used when the pressure value 1 acquisition means 714 further acquires an increase in the pressing force after the switch 31 detects the state transition, that is, after the transition from the OFF state to the ON state. The acquired result may be used to make a transition to an action in which the icon selected by the mouse click ON action can be dragged and dropped at the cursor position after the movement.

  The zooming fixing unit 76 fixes the display on the display screen 8 when the switch state acquired by the switch 2 state acquisition unit 712 transitions from the OFF state to the ON state, and when the switch state transitions from the ON state to the OFF state. Unpin this display. Here, when the zooming fixing unit 76 is fixing the display, even if the pressure value acquired by the pressure value 2 acquisition unit 715 decreases with respect to the zooming processing unit 74, the zoom ratio at the time of fixing is reduced to the minimum magnification. Hold as.

  Here, specific control of zooming processing realized by the above-described zooming processing unit 74 and zooming fixing means 76 in the input processing device 7 will be described with reference to FIG.

  In step S31, the zooming processing unit 74 calculates and sets the zoom rate of the display screen 8 based on the pressure value acquired by the pressure value 2 acquiring unit 715 by the zoom rate calculating unit 741. Then, the process proceeds to step S32.

  In step S32, the zooming processing unit 74 uses the enlargement area calculating unit 742 as a fixed point at the position defined by the horizontal coordinate axis X and the vertical coordinate axis Y calculated by the cursor coordinate calculating unit 722, and the zoom ratio calculating unit 741 calculates the zoom. Based on the rate, an enlarged region in the display image of the display screen 8 is calculated. Then, the process proceeds to step S33.

  In step S <b> 33, the zooming processing unit 74 causes the enlarged screen display unit 743 to display the enlarged region calculated by the enlarged region calculating unit 742 over the entire display area of the display screen 8.

  Corresponding to the processing of the zooming processing unit 74, the coordinate calculation unit 72 performs a filtering process for eliminating a minute input of the pointing operation or a limiter process for invalidating a predetermined or less pointing operation amount. In particular, it is preferable to increase the intensity of these processes according to the zoom ratio. In this way, when the enlarged display is performed, it is possible to prevent the cursor position from moving violently according to the operation by the pointing operation unit 2 and to prevent the screen from being difficult to see and a click mistake due to camera shake. . Then, the process proceeds to step S34.

  In step S <b> 34, the zooming fixing unit 76 determines whether the switch has been pressed and transitioned from the OFF state to the ON state based on the switch state acquired by the switch 2 state acquisition unit 712. When the switch is pressed, the process proceeds to step S35, and when the switch is not pressed, the process returns to step S31.

  In step S35, the zooming fixing means 76 fixes the display on the display screen 8. Here, it is assumed that the pressing operation to be determined in step S34 is released and the switch 2 state acquisition unit 712 has acquired the switch OFF state. Then, the process proceeds to step S36.

  In step S <b> 36, the zooming fixing unit 76 determines whether or not the switch has been pressed and transitioned from the OFF state to the ON state based on the switch state acquired by the switch 2 state acquisition unit 712. When the switch is pressed, the process proceeds to step S37, and when the switch is not pressed, the process returns to step S35.

  In step S37, the zooming fixing unit 76 releases the fixing of the enlarged region in step S35. Then, the process returns to step S31.

  Here, the upper and lower limit values of the pressure value acquired by the pressure value 2 acquisition means 715 are divided into three, and the display screen 8 by the processing according to step S31 to step S37 when it is increased for each divided unit pressure value. The changes are shown in FIGS. 10A, 10B, and 10C, respectively.

  As shown in FIG. 10A, FIG. 10B, and FIG. 10C, in the input processing device 7, as the pressure value acquired by the pressure value 2 acquisition unit 715 increases, the zooming fixed point 25 is increased. Since the zooming of the enlarged region 26 with respect to the reference point is realized, the visibility in the operating environment of the remote controller can be improved. In this way, the input processing device 7 can perform an instant zooming process according to the pressing operation of the pressure sensor 32 of the button operation unit 3b of the pointing device 1, so that, for example, in Web browsing, the entire page It is possible to realize an operating environment for smoothly switching between bird's-eye view and partial browsing, and a function for prompting the attention of the audience during the presentation. In particular, when the switch 2 state acquisition unit 712 acquires a state detected by the switch 31 of the button operation unit 3 having the configuration shown in FIG. 4, an arbitrary pressure is applied to the pressure sensor 32 by the button operation unit 3. In the state where the value is added, the state detected by the switch 31 by the pressing operation of the user can be changed from the OFF state to the ON state. Thus, it can be fixed by the zooming fixing means 76.

  Moreover, in the pointing device 1, the input operation device 7 controls the position of the cursor position in the above-described steps S11 to S16 by arranging the button operation units 3a and 3b adjacent to a position where it can be pressed with one finger. However, it is possible to perform a zooming process in steps S31 to S37, thereby providing an operating environment in which the user checks the desired cursor position and click position on the enlarged screen and suppresses click mistakes due to camera shake. Can do.

  In addition, this invention is not limited only to the above embodiment, Of course, a various change is possible in the range which does not deviate from the summary of this invention.

  100 input processing system, 1 pointing device, 2 pointing operation section, 24 cursor movable area, 25 zooming fixed point, 26 enlargement area, 3, 3a, 3b button operation section, 31 switch, 32 pressure sensor, 33 key top, 34 pressing surface , 35 key top, 36 pressing surface, 37 key top, 38 pressing surface, 4 microcomputer, 5 memory, 6 communication unit, 7 input processing unit, 71 input acquisition unit, 711 switch 1 state acquisition means, 712 switch 2 state acquisition Means 713 pointing operation amount acquisition means 714 pressure value 1 acquisition means 715 pressure value 2 acquisition means 72 coordinate calculation unit 721 pointing operation amount change means 722 cursor coordinate calculation means 73 cursor display unit 731 cursor size determination Means, 732 Sol display means 74 zooming process unit, 741 a zoom rate calculating means, 742 enlarged area calculating means, 743 larger screen display unit, 75 a mouse click means 76 zooming fixing means 8 display screen, 8a displays, 9 cursor

Claims (7)

A pointing operation unit that detects an operation input of cursor position information on the display screen;
A pressure sensor for detecting a continuous change in pressing force according to the pressing amount by the user;
A switch that is arranged to be pressed in the same pressing direction as the pressure sensor, and detects two states of an ON state and an OFF state;
The pointing operation unit, the pressure sensor, and an output unit that outputs operation information of the switch,
The output unit associates the information indicating the pressing force detected by the pressure sensor with the information indicating the operation input detected by the pointing operation unit until a state transition due to a pressing operation is detected by the switch. A pointing device for outputting. A pointing operation unit that detects an operation input of cursor position information on the display screen;
A pressure sensor for detecting a continuous change in pressing force according to the pressing amount by the user;
A switch that is arranged to be pressed in the same pressing direction as the pressure sensor, and detects two states of an ON state and an OFF state;
Pointing that decreases the amount of movement of the cursor position per unit operation input amount by the pointing operation unit as the pressing force detected by the pressure sensor increases until a state transition due to a pressing operation is detected by the switch An operation amount changing section;
A cursor coordinate calculation unit that calculates the coordinates of the cursor position based on the movement amount of the cursor position decreased by the pointing operation amount change unit;
A cursor size determining unit that reduces the cursor size on the display screen in accordance with a decrease in the amount of movement of the cursor position by the pointing operation amount changing unit;
An input processing device comprising: an action generating unit that generates an action corresponding to the cursor position indicated by the coordinates calculated by the cursor coordinate calculating unit when a state transition due to a pressing operation is detected by the switch. A pointing operation unit that detects an operation input of cursor position information on the display screen, a pressure sensor that detects a continuous change in pressing force according to a pressing amount by a user, and a pressing direction that is the same as that of the pressure sensor. An input acquisition step of acquiring operation input information of a pointing device, which is arranged so as to include a switch that detects two states of an ON state and an OFF state;
Pointing that decreases the amount of movement of the cursor position per unit operation input amount by the pointing operation unit as the pressing force detected by the pressure sensor increases until a state transition due to a pressing operation is detected by the switch An operation amount changing step;
A cursor coordinate calculating step for calculating the coordinates of the cursor position based on the movement amount of the cursor position decreased by the pointing operation amount changing step;
A cursor size determining step for reducing the cursor size on the display screen in accordance with a decrease in the amount of movement of the cursor position by the pointing operation amount changing step;
And an action generation step of generating an action corresponding to the cursor position indicated by the coordinates calculated in the cursor coordinate calculation step when a state transition due to a pressing operation is detected by the switch. A pointing operation unit that detects an operation input of cursor position information on the display screen, a pressure sensor that detects a continuous change in pressing force according to a pressing amount by a user, and a pressing direction that is the same as that of the pressure sensor. An input acquisition step of acquiring operation input information of a pointing device, which is arranged so as to include a switch that detects two states of an ON state and an OFF state;
Pointing that decreases the amount of movement of the cursor position per unit operation input amount by the pointing operation unit as the pressing force detected by the pressure sensor increases until a state transition due to a pressing operation is detected by the switch An operation amount changing step;
A cursor coordinate calculating step for calculating the coordinates of the cursor position based on the movement amount of the cursor position decreased by the pointing operation amount changing step;
A cursor size determining step for reducing the cursor size on the display screen in accordance with a decrease in the amount of movement of the cursor position by the pointing operation amount changing step;
Causing the computer to perform an input process including an action generation step of generating an action corresponding to the cursor position indicated by the coordinates calculated by the cursor coordinate calculation step when a state transition due to a pressing operation is detected by the switch Program for. A pointing operation unit that detects an operation input of cursor position information on the display screen;
A pressure sensor for detecting a continuous change in pressing force according to the pressing amount by the user;
A switch that is arranged to be pressed in the same pressing direction as the pressure sensor, and detects two states of an ON state and an OFF state;
A cursor coordinate calculation unit that calculates the coordinates of the cursor position based on an operation input amount by the pointing operation unit;
A zoom ratio calculation unit that calculates a zoom ratio of the display screen such that the value increases as the pressing force detected by the pressure sensor increases until a state transition due to a pressing operation is detected by the switch;
An enlarged region calculating unit that calculates an enlarged region of the display screen based on the coordinates calculated by the cursor coordinate calculating unit and the zoom rate calculated by the zoom rate calculating unit;
An enlarged screen display unit that enlarges and displays the enlarged region calculated by the enlarged region calculation unit;
An input processing apparatus comprising: a zoom rate fixing unit that controls the enlarged screen display unit so that the zoom rate of the display screen is fixed when a state transition due to a pressing operation is detected by the switch. A pointing operation unit that detects an operation input of cursor position information on the display screen, a pressure sensor that detects a continuous change in pressing force according to a pressing amount by a user, and a pressing direction that is the same as that of the pressure sensor. An input acquisition step of acquiring operation input information of a pointing device, which is arranged so as to include a switch that detects two states of an ON state and an OFF state;
A cursor coordinate calculating step for calculating the coordinates of the cursor position based on the operation input amount by the pointing operation unit;
A zoom ratio calculating step for calculating a zoom ratio of the display screen such that the value increases as the pressing force detected by the pressure sensor increases until a state transition due to a pressing operation is detected by the switch;
An enlarged area calculating step for calculating an enlarged area of the display screen based on the coordinates calculated by the cursor coordinate calculating step and the zoom ratio calculated by the zoom ratio calculating step;
An enlarged screen display step for magnifying and displaying the enlarged area calculated in the enlarged area calculating step on the display screen;
An input processing method comprising: a zoom rate fixing step of performing an enlarged display in which a zoom rate of the display screen is fixed when a state transition due to a pressing operation is detected by the switch. A pointing operation unit that detects an operation input of cursor position information on the display screen, a pressure sensor that detects a continuous change in pressing force according to a pressing amount by a user, and a pressing direction that is the same as that of the pressure sensor. An input acquisition step of acquiring operation input information of a pointing device, which is arranged so as to include a switch that detects two states of an ON state and an OFF state;
A cursor coordinate calculating step for calculating the coordinates of the cursor position based on the operation input amount by the pointing operation unit;
A zoom ratio calculating step for calculating a zoom ratio of the display screen such that the value increases as the pressing force detected by the pressure sensor increases until a state transition due to a pressing operation is detected by the switch;
An enlarged area calculating step for calculating an enlarged area of the display screen based on the coordinates calculated by the cursor coordinate calculating step and the zoom ratio calculated by the zoom ratio calculating step;
An enlarged screen display step for magnifying and displaying the enlarged area calculated in the enlarged area calculating step on the display screen;
A program for causing a computer to execute an input process including a zoom rate fixing step of performing an enlarged display in which the zoom rate of the display screen is fixed when a state transition due to a pressing operation is detected by the switch.

Images