JP2013047864A - Information input apparatus, information input method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information input apparatus using a clickable rotation type input device which has such a good operability that the apparatus enables a user to correctly depress a switch on the input device by a finger without shifting a depression position.SOLUTION: An information input apparatus comprises: a position movement information calculation unit 5 for converting rotation information acquired when a user has operated a rotary member into position movement information and position information; a position movement information series storage unit 6 for storing position movement information for a predetermined time; and a position information series storage unit 7 for storing position information for a predetermined time. When a switch of an input device is depressed, a depression start position estimation unit 18 estimates a depression start position when the user starts depressing an operation member 210, by using the position movement information stored in the position movement information series storage unit 6 and the position information stored in the position information series storage unit 7. Thus, even when a finger of the user slightly shifts on depressing a switch, a user can correctly input a position where he/she intended to.

Description

  The present invention relates to an information input apparatus and method for operating a GUI screen of an electronic apparatus, and more particularly to an information input apparatus, information input method and program for operating a GUI screen using a rotary input device such as a trackball. It is.

  Rotational input devices such as trackballs and jog rollers are well known as one of input devices for operating a GUI (Graphical User Interface) screen displayed on a display device such as a PC or a mobile phone. It has been. In an information input device using a rotary input device, the user moves the cursor on the GUI screen by turning the rotary member of the rotary input device such as a trackball ball or jog roller with a finger or hand. Intuitive GUI operation according to the movement of the user's finger or hand can be performed.

  By the way, in a general GUI operation, in addition to a position input operation for moving a cursor on the screen, an operation for determining an object such as an icon or a button on the screen, for example, an operation represented by a left click of the mouse. Is required. Therefore, in a conventional information input device using a rotary input device, such an operation for determining an object has been realized by pressing a button disposed near the rotary input device once or twice. It was.

  For example, to select and confirm (execute) any icon on the screen, first turn the rotating member of the rotary input device with your finger to move the cursor on the screen to the target icon, This is realized by an operation of pressing the button arranged near the rotary system input device once or twice, away from the rotary member. However, in this case, the user needs to remove his / her finger from the rotating member at least once, and there is a problem that the user cannot perform continuous and natural finger operation.

  Therefore, as one of the methods for improving the operability of the general rotary system input device as described above, a clickable (with a rotary switch configured to move up and down and a mechanical switch disposed just below the rotary member ( A clickable input device is known (see, for example, Patent Document 1). When a clickable rotary input device is used, an operation for selecting / determining an object on the GUI screen can be realized by an operation of pushing the rotating member downward and pushing a switch immediately below. For example, in the operation of selecting and confirming (executing) an arbitrary icon on the GUI screen, the user turns the rotating member with a finger and moves the cursor on the screen to the target icon, and then moves the rotating member as it is. This can be achieved by pushing down.

  In other words, in an information input device using a clickable rotary input device, the user can perform a continuous and natural operation without removing the finger from the rotary member. The operational feeling can be improved. However, while the operational feeling is improved, in a clickable rotary input device, when the switch under the rotating member is pushed with a finger, the rotating member moves due to the pressing force, and the cursor is displaced. There are cases (hereinafter referred to as “push”).

  In particular, if the size of the object on the screen is small and the distance between adjacent objects is narrow, the object near the target object will be selected / confirmed if the cursor position is shifted slightly. Misoperations occur frequently. Therefore, in order to solve the problem of the click of the clickable rotation system input device described above, in Patent Document 2, the rotation operation of the user just before the user pushes the rotating member downward and pushes the switch immediately below is invalidated by a certain amount. By doing so, a method for preventing the blurring has been proposed.

  FIG. 12 shows an information input system using a clickable rotary input device having a conventional anti-push function described in Patent Document 2. As shown in FIG. 12, the information input system includes a clickable rotary input device 100, a position movement information calculation unit 104, a position movement information sequence storage unit 105, a screen display device 500, and a cursor position calculation unit 106. A cursor display control unit 108, an object arrangement storage unit 109, an object display control unit 111, an object selection detection unit 112, an object determination unit 113, and a cursor movement invalidation unit 114.

  The clickable rotation system input device 100 includes a rotation member 101, a mechanical switch 102, and a rotation information detection unit 103. The rotating member 101 has a ball (sphere) shape, and the user can rotate the upper part of the ball with a finger. In addition, the switch 102 is disposed directly below in the vertical direction when viewed from the operation surface of the rotating member 101. When the user presses the rotating member 101 downward with a pressing force of a certain value or more, the switch 102 is also pressed. The switch 102 is turned on.

  The rotation information detection unit 103 detects rotation information of the rotating member 101 (a direction in which the rotating member 101 is rotated and a rotational movement amount) when the user rotates the rotating member 101 with a finger. Based on the rotation information (rotation direction and amount of rotation) of the rotating member 101 detected by the rotation information detection unit 103, the position movement information calculation unit 104 is based on position movement information (position movement in the X direction) in the orthogonal coordinate system. And the amount of position movement in the Y direction). The position movement information sequence storage unit 105 stores the position movement information obtained from the position movement information calculation unit 104 for a predetermined time.

  The screen display device 500 includes a display screen such as a liquid crystal display. On the display screen included in the screen display device 500, a GUI screen that is an operation screen of an electronic device operated by the clickable rotary input device 100 is displayed. The cursor position calculation unit 106 obtains the position of the cursor on the GUI screen displayed on the screen display device 500. The cursor display control unit 108 displays a cursor on the GUI screen based on the cursor position calculated by the cursor position calculation unit 106.

  The object arrangement storage unit 109 stores arrangement information of each object indicating how to arrange objects such as icons, buttons, and menus on the GUI screen. The object display control unit 111 displays each object on the GUI screen based on the object arrangement information. The object selection detection unit 112 detects an object currently selected by the user from among a plurality of objects displayed on the GUI screen based on the position of the cursor.

  The object determination unit 113 determines the object detected by the object selection detection unit 112 when the user presses the switch 102 of the clickable rotation system input device 100. The cursor movement invalidating unit 114 invalidates the cursor movement on the GUI screen for a certain period of time immediately before the switch 102 is turned on when the user presses the rotating member 101 and the switch 102 is turned on.

  FIG. 13 is an external view of a GUI screen in a conventional information input device. As shown in FIG. 13, the screen display device 500 displays a GUI screen 501 for operating an electronic device. On the GUI screen 501, a cursor 107 and objects 110 (a) to 110 (c) are displayed. The cursor 107 is displayed on the GUI screen 501 and is operated as a pointer by the information input device.

  The operation of the information input device using the clickable rotation system input device having the conventional anti-shake function configured as described above will be described below. Here, referring to FIG. 13, the user selects target object 110 (b) for objects 110 (a) to 110 (c) arranged on GUI screen 501 displayed on screen display device 500, and A series of operations to be confirmed (executed) will be described. When the user rotates the rotation member 101 with a finger to move the cursor 107 displayed on the GUI screen 501, the rotation information detection unit 103 displays the rotation direction and the rotation movement amount of the rotation member 101. 101 is detected as rotation information.

  Based on the rotation information detected by the rotation information detection unit 103, the position movement information calculation unit 104 calculates the position movement information in the orthogonal coordinate system, that is, the position movement amount in the X direction and the position movement amount in the Y direction. Calculate and sequentially store in the position movement information sequence storage unit 105. The position movement information sequence storage unit 105 stores the latest position movement amount obtained from the position movement information calculation unit 104 by a predetermined number. The cursor position calculation unit 106 calculates the position of the cursor 107 displayed on the GUI screen 501 by using the oldest position movement amount among the fixed number of pieces of position movement information stored in the position movement information series storage unit 105. .

  The cursor display control unit 108 displays the cursor 107 on the GUI screen 501 based on the cursor position obtained from the cursor position calculation unit 106. In addition, the object selection detection unit 112 reads the arrangement information of each object 110 (a) to 110 (c) displayed on the GUI screen 501 from the object arrangement storage unit 109 and is obtained from the cursor position calculation unit 106. By comparing with the cursor position, it is determined whether or not the cursor 107 is on the display area of each object 110 (a) to 110 (c).

  For example, as shown in the GUI screen 501 of FIG. 13, when the cursor 107 is on the display area of the object 110 (b), the object selection detection unit 112 has the cursor 107 on the display area of the object 110 (b). And the identification number of the object 110 (b) is output to the object display control unit 111. When the identification number of the object 110 (b) is input from the object selection detection unit 112, the object display control unit 111 changes the display of the object 110 (b), for example, the size and the color, 110 (b) is selected.

  Further, in order to determine the object 110 (b) selected by the user, when the rotary member 101 is pushed in and the switch 102 is turned on, the switch 102 outputs pressing information to the object selection detection unit 112. When the pressing information is input from the switch 102, the object selection detection unit 112 outputs the identification number of the detected object 110 (b) to the object determination unit 113. When the identification number of the object 110 (b) is input from the object selection detection unit 112, the object determination unit 113 regards the object 110 (b) as being determined by the user, and outputs the identification number to the object display control unit 111. At the same time, a confirmation process corresponding to the object is executed.

  When the identification number of the object 110 (b) is input from the object determination unit 113, the object display control unit 111 changes the display of the object 110 (b), for example, the size and the color, etc. Present that (b) has been confirmed. When the pressing information is input from the switch 102, the cursor movement invalidation unit 114 deletes all the fixed number of position movement information stored in the position movement information series storage unit 105, and sets the cursor movement invalidation information as the cursor position. It outputs to the calculation part 106.

  When the cursor movement invalidation information is input, the cursor position calculation unit 106 does not change the position of the cursor 107 from the time of input, and continues to hold the position of the cursor 107 before the invalidation information is input. In other words, in the conventional example, when the user pushes the rotating member 101 and turns on the switch 102, the change of the position movement of the cursor 107 for a certain number immediately before the switch is turned on is invalidated. Accordingly, even if the rotary member 101 is rotated sideways by the pressing force when the switch 102 is pushed in, the cursor position is held at the position before pushing, so that the position of the cursor 107 is shifted sideways. Pushing does not occur.

JP-A-1-290021 JP-A-5-143228

  However, in the conventional configuration, when the switch 102 is turned on, the position movement information invalidated by the cursor movement invalidation unit 114 is always a fixed number, that is, the time for invalidating the position movement information. Since the position is always constant, depending on the speed at which the user operates the rotating member 101, for example, depending on the speed at which the rotating member 101 is turned or the speed at which the user rotates, the position is invalidated on the assumption that it is a position movement caused by the pushing motion. There is a problem that a difference between the amount of movement and the amount of position movement due to the actual pushing motion increases, resulting in an erroneous operation.

  For example, when the user slowly presses the rotating member 101, the user starts pressing the rotating member 101 because the time for the user to press the rotating member 101 becomes longer than the time for invalidating the predetermined position movement information. In some cases, it may not be possible to invalidate the position movement due to the occasional push. As described above, in the object confirming operation, when the prevention of the shake cannot be accurately performed, an object different from the object that the user tried to confirm is selected and confirmed, resulting in an erroneous operation. In particular, erroneous operations frequently occur when the size of each object displayed on the GUI screen 501 and the distance between adjacent objects are small.

  On the other hand, in order to solve the above problem, in the conventional configuration, if the time for invalidating the position movement information is lengthened, that is, if the number of the position movement information stored in the position movement information sequence storage unit 105 is increased, the high accuracy It is possible to prevent the squeeze. However, immediately after the user operates the rotating member 101, the cursor 107 on the GUI screen 501 is not displayed or the time during which the cursor 107 does not move is lengthened, which causes a problem that the operation feeling becomes very bad.

  The present invention solves the above-described conventional problems, and can prevent the shaking with high precision regardless of the speed at which the user operates the rotating member. When the rotating member is turned, the cursor on the GUI screen is immediately turned. An object of the present invention is to provide an information input device with a good operational feeling.

  In order to solve the above-described conventional problems, an information input device according to an aspect of the present invention is an information input device including a clickable rotation system input device, and the clickable rotation system input device has a rotation member. The information input device includes an operation member configured to be movable up and down, a switch that is pressed when the user pushes the operation member, and a rotation information detection unit that detects rotation information when the rotation member rotates. A position movement information calculation unit that obtains position movement information and position information from rotation information, a position movement information sequence storage unit that stores position movement information for a predetermined time, and a predetermined time A position information sequence storage unit for storing position information, and a plurality of position movement information and position information sequence records stored in the position movement information sequence storage unit when the switch is pressed. Based on the stored plural pieces of position information are in part, and a pressing start position estimating unit that estimates a pressing start position at which the user starts pressing the operating member.

  According to this configuration, when the user presses the switch of the clickable rotation system input device in order to perform the object determination operation, the pressing start position estimation unit and the position movement information stored in the position movement information sequence storage unit Based on the position information stored in the position information series storage unit, a position originally intended to be pressed by the user is estimated. By using this estimated position as a true pressed position that replaces the position where the switch is completely pressed, an information input device with an anti-blurring function with improved operability can be provided.

  Preferably, the information input device further includes a GUI (Graphical User Interface) based on one of the position information stored in the position information series storage unit and the pressing start position estimated by the pressing start position estimation unit. You may provide the cursor position calculation part which calculates the position of the cursor on a screen.

  Further preferably, the information input device further includes an object arrangement storage unit storing object arrangement information indicating an area in which at least one object is arranged on the GUI screen, and an object arrangement acquired from the object arrangement storage unit Based on the information, the object display control unit that displays at least one object on the GUI screen, and the user among the at least one object based on the object placement information and the cursor position obtained from the cursor position calculation unit. You may provide the object selection detection part which detects the selected object.

  Further, the information input device further determines whether or not the pressing start position estimating unit estimates the pressing start position based on the object arrangement information detected by the object selection detecting unit and the cursor position obtained from the cursor position calculating unit. You may provide the camera shake correction control part to determine.

  According to this configuration, it is determined whether or not the pressing start position needs to be estimated, and the pressing start position estimation processing can be executed only when necessary. Therefore, it is possible to improve the response speed of the entire input operation. In particular, when the size of an object on the GUI screen is sufficiently large compared to the maximum blur width due to the shake, there is little possibility of an erroneous operation due to the push, so that the response speed of the entire input operation is greatly improved. Is possible.

  The information input device further includes a pressing start position based on arrangement information of the first object detected by the object selection detection unit and at least one second object in the vicinity of the first object. There may be provided a camera shake correction control unit that determines whether or not to estimate.

  As a result, the camera shake correction control unit dynamically changes the threshold value for determining whether to perform the camera shake correction processing based on the arrangement relationship between the selected object and the objects in the vicinity thereof. Thus, it is possible to provide an information input device with less response error and excellent response speed.

  Preferably, the pressing start position estimating unit presses when the user starts to press the operation member based on the plurality of pieces of position movement information stored in the position movement information sequence storage unit when the switch is pressed. A pressing start time estimating unit that estimates the starting time, and a pressing start position determining unit that obtains the position information of the pressing start time as the pressing start position using the position information stored in the position information series storage unit. Good.

  Specifically, the pressing start time estimation unit, based on a plurality of position movement information stored in the position movement information series storage unit, an operation amount calculation unit for obtaining at least one type of user operation amount on the operation member; You may provide the stop time detection part which estimates the time when the user's operation with respect to the operation member stopped using at least 1 or more types of operation amount.

  More specifically, the position movement information includes position movement information in an orthogonal coordinate system calculated based on the rotation information when the user rotates the rotating member. Using the position movement information, the operation speed of the user's operation member is calculated as the operation amount, and the stop time detection unit calculates the time when the operation speed is equal to or less than a predetermined value in advance to the user's operation member. You may obtain | require as operation stop time and estimate this time as a pressing start time.

  As a result, it is estimated that the user's operation speed with respect to the operation member is equal to or lower than the threshold value for the first time, and the user clicks the clickable rotary system input device at the estimated position. Can be processed. Therefore, regardless of the speed at which the user's finger pushes the operation member, it is possible to prevent the push-motion with high accuracy, and it is possible to provide an information input device with a push-motion prevention function that has improved operability as compared with the prior art.

  The pressing start time estimation unit includes an operation amount calculation unit that obtains at least one type of user operation amount on the operation member based on a plurality of pieces of position movement information stored in the position movement information sequence storage unit, and at least one type Using the above operation amount, the presence / absence of a user's pushing operation with respect to the operation member is detected, and when a shaking is detected, a shaking start time detecting unit for obtaining a time immediately before the occurrence of the shaking May be provided.

  Specifically, the pressing start time estimation unit further includes an operation direction calculation unit that obtains an operation direction of the user with respect to the operation member based on a plurality of pieces of position movement information stored in the position movement information sequence storage unit. The shake start time detection unit detects whether or not the user pushes the operation member against the operation member using at least one type of operation amount obtained from the operation amount calculation unit and the operation direction obtained from the operation direction calculation unit. However, when a user's pressing motion is detected, the time immediately before the occurrence of the pressing motion may be obtained using at least one type of operation amount and operation direction.

  Thereby, for example, even when it is difficult to accurately detect the stop state of the rotating member when the user starts to press the operating member because the operation amount of the user with respect to the operating member is generally small, In addition to the user's operation amount, a sudden change in the user's operation direction with respect to the operation member can be detected, and these can be used to increase the detection accuracy of the push and the estimated start position of the press.

  According to the information input device and the like of the present invention, it is possible to accurately prevent a user from pushing, regardless of the speed at which the user presses the operation member, and when the operation member is operated with a finger, the cursor on the GUI screen is immediately displayed. It is possible to obtain an effect that the operation feeling is good by moving.

1 is an external view of an information input system using an information input device according to an embodiment of the present invention. Schematic diagram showing the structure of the clickable rotary input device 1 The block diagram which shows the structure of the information input device in Embodiment 1 of this invention. The figure of the GUI screen in Embodiment 1 of this invention The block diagram which shows the structure of the pressing start position estimation part of the information input device in Embodiment 1 of this invention. The flowchart which shows the flow of a process of the information input device in Embodiment 1 of this invention. FIG. 9 is a block diagram showing a configuration of a pressing start position estimating unit in the first modification of the first embodiment. The block diagram which shows the structure of the information input device in Embodiment 2 of this invention. The flowchart which shows the flow of a process of the information input device in Embodiment 2 of this invention. External view of GUI screen in modification of embodiment 2 of the present invention The block diagram which shows the hardware constitutions of the computer system which implement | achieves the information input device in Embodiment 1, 2 of this invention Block diagram showing the configuration of a conventional information input device External view of GUI screen in conventional information input device

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(Embodiment 1)
FIG. 1 is an external view of an information input system using an information input device according to an embodiment of the present invention. As shown in FIG. 1, the information input system includes an information input device 200 and a screen display device 300. The information input device 200 is an operation device for operating the GUI screen 9 displayed on the screen display device 300.

  The screen display device 300 is a display device that displays a GUI screen 9 for operating an electronic device. The information input device 200 includes a clickable rotary input device 1 as a sensor for inputting a user's finger or hand operation. The clickable rotary input device 1 includes an operation member 210 having four rotation members 2 (balls) arranged symmetrically in the vertical and horizontal directions and a switch 3.

  The user can move the cursor 11 displayed on the GUI screen 9 by moving a finger in contact with the rotary member 2 of the clickable rotary system input device 1 such as a general trackball.

  The screen display device 300 includes a screen display unit 8 and a screen control unit 400. The screen display unit 8 is a display device such as a liquid crystal display. The screen display unit 8 includes information on electronic devices operated by the information input device 200, for example, AV devices such as televisions, DVRs (Digital Video Recorders), car audios, PCs (Personal Computers), mobile phones, car navigation systems, etc. A GUI screen 9 for operating the device is displayed.

  Further, the GUI screen 9 displays a plurality of objects necessary for the user to perform an operation using the GUI, for example, icon buttons, menus, and the like, and a cursor 11 for pointing to them. The screen control unit 400 is a control unit that generates the GUI screen 9 and displays it on the screen display unit 8.

  FIG. 2 is a schematic diagram showing the structure of the clickable rotary input device 1. As shown in FIG. 2, in the clickable rotary input device 1, the upper part of each rotating member 2 protrudes from the upper surface of the operation member 210, and when the user traces the upper surface of the operation member 210 with a finger, The upper part is designed to rotate.

  Further, the operation member 210 is supported from the back by a spring structure 220 or the like. The user can operate (ON-OFF operation) the switch 3 installed on the back side of the operation member 210 by pushing the operation member 210 with a finger or releasing the finger. Accordingly, the user can perform a so-called click operation in the GUI environment without removing the finger from the operation member 210.

  FIG. 3 is a block diagram of the information input device 200 according to Embodiment 1 of the present invention. As shown in FIG. 3, the information input device 200 includes a clickable rotation system input device 1, a position movement information calculation unit 5, a position movement information sequence storage unit 6, a position information sequence storage unit 7, and a cursor position calculation. Unit 10, cursor display control unit 12, object arrangement storage unit 13, object display control unit 15, object selection detection unit 16, object determination unit 17, and pressing start position estimation unit 18.

  The clickable rotation system input device 1 includes an operation member 210 having four rotation members 2, a switch 3, and a rotation information detection unit 4. When the user's finger traces the upper surface of the operation member 210, each rotating member 2 rotates according to the movement of the user's finger and outputs an electrical signal corresponding to the rotation. The method for detecting the rotation of the rotating member 2 may be any of a method using a general biaxial rotary encoder, a method using an optical sensor, a method using a magnetic sensor, and the like.

  The switch 3 is, for example, a mechanical switch or the like, and the ON state and the OFF state change alternately by a pressing operation. The switch 3 is disposed directly below the input surface of the operation member 210 (that is, the back side of the operation member 210). Since the operation member 210 is supported by the above-described spring structure or the like, when the user pushes the operation member 210 downward with a pressing force equal to or greater than a certain value, the switch 3 is also pushed in so that the switch 3 can be turned on. In addition, a clickable rotary input device 1 is configured. In order to reduce the thickness of the device, the switch 3 may be a piezoelectric sensor that turns on with a pressing force equal to or greater than a certain level corresponding to the pressing force of the spring instead of the mechanical switch.

  The rotation information detection unit 4 uses the electrical signal obtained from each rotation member 2 to rotate information about each rotation member 2 when the user traces the upper surface of the operation member 210 with a finger, for example, the rotation member 2 rotates. The time, the direction in which the rotating member 2 is rotated, the amount of rotational movement, and the like are detected every unit time. As described above, the clickable rotating system input device 1 outputs the rotation information of each rotating member 2 and the ON / OFF signal of the switch 3 in accordance with a user operation.

  Based on the rotation information (rotation direction and amount of rotation) of each rotating member 2 detected by the rotation information detection unit 4, the position movement information calculation unit 5 performs position movement information (X at an arbitrary time) in the orthogonal coordinate system. Position movement amount in the direction and position movement amount in the Y direction). Further, the calculated position movement information is sequentially added to calculate the position information in the input area (input space) of the clickable rotary input device 1, that is, the position in the X direction and the position in the Y direction at an arbitrary time.

  The position movement information sequence storage unit 6 stores the position movement information detected by the position movement information calculation unit 5 for a predetermined time. Further, the position information series storage unit 7 stores the position information detected by the position movement information calculation unit 5 for a predetermined time. The cursor position calculation unit 10 obtains the position of the cursor 11 (see FIG. 4 described later) displayed on the GUI screen 9. The cursor display control unit 12 displays the cursor 11 on the GUI screen 9 based on the cursor position calculated by the cursor position calculation unit 10.

  The object arrangement storage unit 13 displays object arrangement information of each object indicating how to arrange the objects 14 (a) to 14 (c) such as icons, buttons, menus, etc. on the GUI screen 9 shown in FIG. 4. Remember. Specifically, the object arrangement information is a position where each object is to be displayed on the GUI screen 9, and is represented by, for example, two-dimensional or three-dimensional coordinates.

  The object display control unit 15 displays the objects 14 (a) to 14 (c) on the GUI screen 9 based on the object arrangement information acquired from the object arrangement storage unit 13. Specifically, the object display control unit 15 reads out the arrangement information of the objects 14 (a) to 14 (c) stored in the object arrangement storage unit 13, and based on the arrangement information of the corresponding object, the GUI screen Each object is displayed on 9. Further, the object display control unit 15 changes the size, color, etc. of the object currently selected by the user, and presents that the object is selected to the user.

  Based on the position of the cursor 11, the object selection detection unit 16 detects the object currently selected by the user from among the plurality of objects 14 (a) to 14 (c) displayed on the GUI screen 9. The object determination unit 17 determines the object detected by the object selection detection unit 16 when the user presses the switch 3 of the clickable rotary input device 1. Specifically, the identification number of the object is output to the object display control unit 15. Further, if necessary, a confirmation process corresponding to the object is executed.

  The pressing start position estimating unit 18 stores the position movement information and the position information series stored in the position movement information series storage unit 6 when the switch 3 is pressed on the GUI screen 9 to determine the object selected by the user. Based on the position information stored in the unit 7, the pressing start position when the user's finger starts to press the operation member 210 is estimated.

  FIG. 4 is a diagram of the GUI screen 9 according to the first embodiment of the present invention. As shown in FIG. 4, a cursor 11 and objects 14 (a) to 14 (c) are displayed on the GUI screen 9. The GUI screen 9 is an operation environment using a GUI for operating an electronic device operated by the information input device 200. The cursor 11 is displayed on the GUI screen 9 and points to an object on the GUI screen 9 as a pointer by the information input device 200. The objects 14 (a) to 14 (c) are, for example, icons, buttons, menus, and the like used in the GUI environment.

  Next, FIG. 5 shows a block diagram showing the configuration of the pressing start position estimating unit 18 according to Embodiment 1 of the present invention. As shown in FIG. 5, the pressing start position estimating unit 18 includes a pressing start time estimating unit 20 and a pressing start position determining unit 23. The pressing start time estimation unit 20 estimates the pressing start time when the user's finger starts to press the operation member 210 based on the position movement information stored in the position movement information series storage unit 6.

  The pressing start position determination unit 23 refers to the pressing start time acquired from the pressing start time estimation unit 20 and the position information stored in the position information series storage unit 7, and is a clickable rotation system of the pressing start time. Position information in the input area (input space) of the input device 1 is obtained. Thereafter, the pressing start position determination unit 23 estimates the position information as a pressing start position when the user's finger starts to press the rotating member 2, and outputs the position information to the cursor position calculation unit 10.

  The pressing start time estimation unit 20 includes an operation amount calculation unit 21 and a stop time detection unit 22. The operation amount calculation unit 21 obtains at least one type of user operation amount for the operation member 210 based on the position movement information stored in the position movement information series storage unit 6. As the operation amount specifically obtained, an operation distance, an operation speed, an operation acceleration, and the like of the user's finger with respect to the operation member 210 within a predetermined time can be considered. The stop time detection unit 22 estimates the time when the operation of the user's finger on the operation member 210 is stopped using at least one type of operation amount acquired from the operation amount calculation unit 21.

  FIG. 6 is a flowchart showing the flow of processing of the information input device in the present embodiment. In the present embodiment, the operation of the information input device configured as described above will be described below. It should be noted that here, the user uses the clickable input device 1 and clicks the object 14 (a) to 14 (c) arranged on the GUI screen 9 displayed on the screen display unit 8. A series of operations for selecting (b) and confirming (executing) will be described as a specific example.

  When the user traces the upper part of the operation member 210 with a finger to move the cursor 11 displayed on the GUI screen 9, each rotating member 2 rotates according to the movement of the finger. The rotation information detection unit 4 detects the direction (rotation direction) and the amount of rotation movement of the rotation member 2 when the user traces the upper surface of the operation member 210 with a finger per unit time (S201). Output to the calculation unit 5.

  The position movement information calculation unit 5 uses the rotation information (the rotation direction and the amount of rotation movement) of each rotating member 2 detected by the rotation information detection unit 4 to use the position movement information (X at an arbitrary time) in an orthogonal coordinate system. The position movement amount in the direction and the position movement amount in the Y direction) and position information (the position in the X direction and the position in the Y direction at an arbitrary time) are calculated (S202).

  Hereinafter, a method for calculating the position movement information and the position information in the orthogonal coordinate system from the rotation direction and the rotation movement amount of each rotating member 2 will be specifically described. First, the position movement information in the orthogonal coordinate system of each rotary member 2 is calculated from the rotation direction and the rotational movement amount of each rotary member 2.

  For example, if the rotational direction and rotational movement amount of each rotating member 2 at an arbitrary time t (t ≧ 0) are Θi (t) and ri (t) (i = 1 to 4: the number of the rotating member), each rotation Position movement information dxi (t), dyi (t) (i = 1 to 4: number of rotating member) of the member 2 in the orthogonal coordinate system is obtained by the following (Expression 1).

However, Θi (t) is an angle, and 0 ° ≦ Θi (t) ≦ 360 °. Ri (t) is a distance and is a real number of 0 or more.

  Next, the position movement information dx (t) and dy (t) corresponding to the entire rotation member 2 is calculated using the following (Formula 2) using the position movement information corresponding to the four rotation members 2. To do.

However, max (dxi (t)) is the maximum value of dxi (t) (i = 1 to 4), and max (dyi (t)) is the maximum value of dyi (t) (i = 1 to 4). Indicates.

  Note that the position movement information corresponding to the entire rotation member 2 may use not only the maximum value of the position movement information corresponding to each rotation member 2 but also an average value or a total value. Finally, using the position movement information dx (t) and dy (t) corresponding to the entire rotating member 2, the position information x (t) and y (t) (t ≧ 1) is calculated using the following (Equation 3).

Note that x (0) and y (0) are initial positions in the input area of the clickable rotary input device 1, and are predetermined coordinate values.

  The above is the method for calculating the position movement information and the position information in the orthogonal coordinate system from the rotation direction and the rotation movement amount of each rotating member 2. The position movement information calculation unit 5 stores the position movement information dx (t) and dy (t) calculated by the above method in the position movement information sequence storage unit 6 and the position information x (t) and y (t). The information is sequentially stored in the position information series storage unit 7 (S203).

  Also, the cursor position calculation unit 10 calculates the position of the cursor 11 displayed on the GUI screen 9 using at least one or more pieces of position information stored in the position information series storage unit 7 (S204). For example, the time when the user started the operation of the clickable rotary input device 1 is to, and the position information stored in the position information series storage unit 7 is x (t), y (t) (t = to, to + 1, .., T), assuming that the initial position (position at time to) of the cursor 11 on the GUI screen 9 is (X (to), Y (to)), the cursor 11 at the current time t on the GUI screen 9 The position (X (t), Y (t)) is obtained by the following (formula 4).

However, α and β are conversion coefficients for mapping the input area of the clickable rotary input device 1 to the area of the GUI screen 9, and are real numbers.

  Next, the cursor display control unit 12 displays the cursor 11 on the GUI screen 9 of the screen display unit 8 based on the cursor position (X (t), Y (t)) obtained from the cursor position calculation unit 10. (S205). Further, the object display control unit 15 reads the arrangement information of the objects 14 (a) to 14 (c) stored in the object arrangement storage unit 13 and, based on the corresponding arrangement information, the GUI screen of the screen display unit 8 Each object is displayed on 9.

  Next, the object selection detection unit 16 reads the arrangement information of the objects 14 (a) to 14 (c) displayed on the GUI screen 9 from the object arrangement storage unit 13. Thereafter, it is determined whether the cursor 11 is on the display area of each object by comparing the read arrangement information with the cursor position obtained from the cursor position calculation unit 10 (S206). If the cursor 11 is on one of the display areas of the objects 14 (a) to 14 (c) (Yes in S206), the object selection detection unit 16 considers that the user has selected the corresponding object. The identification number of the object is output to the object display control unit 15.

  When the object identification number is input from the object selection detection unit 16, the object display control unit 15 changes the display of the object corresponding to the identification number, for example, the size and color, and the object is displayed to the user. Is selected (S207). On the other hand, when the object selection detection unit 16 determines that the cursor 11 is not on the object display area (No in S206), the cursor display control unit 12 passes the process to the rotation information detection unit 4 again (S201). ).

  More specific description will be given with reference to FIG. It is assumed that the user traces the upper part of the operation member 210 with his / her finger, moves each rotating member 2, and moves the cursor 11 to the object 14 (b) on the GUI screen 9. At this time, the object selection detection unit 16 determines that the cursor 11 is on the display area of the object 14 (b) (Yes in S206), and outputs the identification number of the object 14 (b) to the object display control unit 15. .

  Next, when the identification number of the object 14 (b) is input from the object selection detection unit 16, the object display control unit 15 displays the display of the object 14 (b) on the GUI screen 9, for example, the size and color. The change is presented to the user that the object 14 (b) has been selected (S207).

  Next, in order to confirm the selected object (in the above example, the object 14 (b)), when the user presses the operation member 210 and turns on the switch 3 (Yes in S208), the switch 3 displays the pressing information. The data is output to the pressing start position estimating unit 18, the cursor position calculating unit 10, and the object selection detecting unit 16. When the pressing information is input from the switch 3, the pressing start position estimating unit 18 first determines a pressing start time that is an estimated value of the time when the user's finger starts pressing the operation member 210 from the pressing start time estimating unit 20. get.

  The pressing start position determination unit 23 refers to the pressing start time acquired from the pressing start time estimation unit 20 and the position information stored in the position information series storage unit 7, and is clickable at the pressing start time. Position information on the input area of the rotary system input device 1 is obtained (S209), and is output to the cursor position calculation unit 10 as a pressing start position when the user's finger starts to press the operation member 210. For example, if the pressing start time is Ts, position information (x (Ts), y (Ts)) at that time is output from the pressing start position determining unit 23 to the cursor position calculating unit 10 as the pressing start position. The

  Next, when the pressing information is input from the switch 3, the cursor position calculating unit 10 displays the cursor position displayed on the GUI screen 9 instead of the position information stored in the position information series storage unit 7. The calculation is performed based on (Equation 4) from the pressing start position obtained by the estimation unit 18 (S210). Then, the cursor display control unit 12 displays the cursor 11 on the GUI screen 9 of the screen display unit 8 based on the cursor position (X (t), Y (t)) obtained from the cursor position calculation unit 10. (S211).

  Next, the object selection detection unit 16 determines that the position of the cursor 11 obtained from the cursor position calculation unit 10 is an object (for example, the objects 14 (a) to 14 (c)), as in the case where the switch 3 is not turned on. It is determined whether or not it is on the display area (S212). As a result, when the cursor 11 overlaps with any display area of the objects 14 (a) to 14 (c) (Yes in S212), the object selection detection unit 16 considers that the user has selected the corresponding object, The identification number of the corresponding object (for example, the object 14 (b)) is output to the object determination unit 17 (S213).

  When the object identification number is input from the object selection detection unit 16, the object confirmation unit 17 regards the object corresponding to the identification number as being confirmed by the user, and outputs the identification number to the object display control unit 15. Further, if necessary, a confirmation process corresponding to the object is executed. When the object identification number is input from the object confirmation unit 17, the object display control unit 15 changes the display of the object corresponding to the identification number, for example, the size and color, and confirms the object to the user. Presented (S214).

  Next, the operation of the object determination unit 17 will be described with a specific example in the case where the cursor 11 is on the display area of the object 14 (b) as shown in FIG. In order to determine the object 14 (b) selected by the user, when the operation member 210 is pushed in and the switch 3 is turned on, the object determination unit 17 causes the object 14 corresponding to the identification number input from the object selection detection unit 16. Assume that (b) is confirmed by the user.

  As a result, the object confirmation unit 17 outputs the identification number of the object 14 (b) to the object display control unit 15, and the confirmation process corresponding to the object 14 (b) (for example, the object 14 (b) is an application icon. If it is, the application is started). When the identification number of the object 14 (b) is input from the object determination unit 17, the object display control unit 15 changes the display of the object 14 (b) on the GUI screen 9, for example, the size, color, etc. On the other hand, the fact that the object 14 (b) has been confirmed is presented.

  Next, the operation of the press start time estimation unit 20 in the present embodiment will be described in detail. First, the operation amount calculation unit 21 reads position movement information for a predetermined time before the pressing time included in the pressing information from the position movement information series storage unit 6, and moves the finger of the user with respect to the operating member 210. At least one operation amount such as an operation distance, an operation speed, and an operation acceleration is obtained. For example, position movement information at a certain time t is expressed as (dx (t), dy (t)).

  Here, if the time when the user clicks on the clickable rotary system input device 1 (the time when the switch 3 is actually turned on) is T, the operation amount calculation unit 21 performs n operations for a predetermined time as the operation amount. The operation speed v (t) (t = T-1, T-2,..., Tn) is calculated by the following (Equation 5).

  Next, it is considered that the operation of the user's finger on the operation member 210 is stopped by the stop time detection unit 22 using the operation amount such as the operation distance, the operation speed, and the operation acceleration obtained by the operation amount calculation unit 21. Find the time when Specifically, the time when the user's operation amount becomes equal to or less than a predetermined value set as a threshold is set as the stop time. For example, if the operation speed is used as the operation amount and the threshold value of the operation speed that the finger is considered to have stopped is Vs, among the n operation speeds v (t) for a predetermined time, v (t) The first time t satisfying ≦ Vs is set as the stop time Ts.

In addition, as stop time,
The time when the amount of finger operation is less than the predetermined value and the time less than the predetermined value exceeds the predetermined time, or
・ Time when the amount of operation of two or more types of fingers falls below a predetermined value, or
The time when the amount of operation of two or more types of fingers falls below a predetermined value and the time below the predetermined value exceeds a predetermined time;
Etc. may be used.
Finally, the stop time detection unit 22 outputs the obtained stop time Ts to the press start position determination unit 23 as the press start time.

The above is description of operation | movement of the pressing start time estimation part 20 in this Embodiment.
In the information input apparatus according to the present embodiment configured as described above, when the switch 3 is turned on by pressing the operation member 210 of the clickable rotary input device 1 to confirm the object selected by the user, the switch 3 N pieces of position movement information for a predetermined time stored in the position movement information series storage unit 6 immediately before the button is pressed and a predetermined amount of time stored in the position information series storage unit 7 Using the n pieces of position information, the pressing start position estimating unit 16 can estimate the pressing start position when the user's finger starts to press the operation member 210.

  That is, when the output of the switch 3 is actually turned on, the pressing start position estimation unit 16 estimates that the user has started to press the operation member 210 instead of the position indicated by the clickable rotary input device 1. By using the pressing start position that is the time position, it is possible to prevent the clickable rotation system input device 1 from being shaken. Therefore, when the user's finger presses the operation member 210, the object selected by the user can be accurately determined even if the user's finger is slightly shaken by the pressing force of the user's finger. Misoperations can be reduced.

  Further, as in the conventional information input device, when the switch 3 is turned ON, a method of invalidating a certain number of position movement information obtained from the operation member 210, that is, the cursor movement on the GUI screen 9 is constant. Unlike the method of preventing the blurring by disabling the time, in the present embodiment, before the switch 3 is turned ON, the user originally has the position where the operation speed of the user operation member becomes equal to or less than the threshold value. It is presumed that it is a pressing start position desired to be pressed, and processing is performed assuming that the switch 3 of the clickable rotary input device 1 is turned on at this estimated position.

Therefore, it is possible to accurately prevent the pushing motion without being affected by the speed at which the user presses the operation member 210 with a finger. Therefore, in Embodiment 1 of this invention, operativity can be improved compared with the conventional information input device.
In the present embodiment, the pressing start time estimating unit 20 of the pressing start position estimating unit 18 may be configured as shown in FIG. 7 below instead of the configuration shown in FIG.

(Modification 1)
FIG. 7 is a block diagram illustrating a configuration of the pressing start time estimation unit 25 in the first modification of the first embodiment. In this modification, the same parts as those in the embodiment shown in FIG. 5 are denoted by the same reference numerals, and detailed description thereof is omitted. As shown in FIG. 7, the pressing start time estimation unit 25 in this modification includes an operation amount calculation unit 21, a stop time detection unit 22, an operation direction calculation unit 30, and a pressing start time detection unit 31. . Here, this modification is different from the embodiment shown in FIG. 5 in that the pressing start time estimating unit 25 further includes an operation direction calculating unit 30 and a pressing start time detecting unit 31. . Therefore, these components will be described below.

  The operation direction calculation unit 30 obtains the operation direction of the user's finger with respect to the operation member 210 based on the position movement information stored in the position movement information series storage unit 6. The push start time detection unit 31 includes at least one or more types of operation amounts (for example, operation distance, operation speed, operation acceleration, etc.) obtained from the operation amount calculation unit 21, operation directions obtained from the operation direction calculation unit 30, And the presence or absence of the user's finger pressing with respect to the operation member 210 is detected using the stop time at which the user's finger should be regarded as having stopped with respect to the operation member 210 obtained from the stop time detection unit 22. In addition, when the camera shake is detected, the camera shake start time detection unit 31 obtains a time immediately before the camera shake occurs and outputs this as a press start time when the user's finger starts to press the operation member 210. .

  The operation of the press start time estimation unit 25 configured as described above will be described below. First, as described above, when the pressing information is input by pressing the switch 3, the operation amount calculation unit 21 sets the position for a predetermined time before the pressing time when the pressing information is input. The movement information is acquired from the position movement information series storage unit 6. Next, the operation amount calculation unit 21 obtains at least one operation amount such as an operation distance, an operation speed, and an operation acceleration of the user's finger with respect to the operation member 210 using the acquired plurality of pieces of position movement information.

  Next, when one or more types of operation amounts are input from the operation amount calculation unit 21, the stop time detection unit 22 uses the operation amounts to stop the operation of the user's finger on the operation member 210. The time that is considered to be obtained is obtained and output as the stop time. Specifically, the time when the finger operation amount becomes equal to or less than a predetermined value set as a threshold value is set as the stop time. For example, if the operation speed is used as the operation amount and the threshold value of the operation speed that the finger is considered to have stopped is Vs, among the n operation speeds v (t) for a predetermined time, v (t) The first time t satisfying ≦ Vs is set as the stop time Ts.

  Further, the operation direction calculation unit 30 acquires position movement information for a predetermined time before the pressing time when the pressing information is input from the position movement information series storage unit 6. Next, the operation direction calculation unit 30 obtains the operation direction of the user's finger with respect to the operation member 210 using the acquired plurality of pieces of position movement information. For example, assuming that the pressing time is T and the position movement information at a certain time t is (dx (t), dy (t)), the operation direction calculation unit 30 has n pieces for a predetermined time before T. The operation direction θ (t) (t = T−1, T−2,..., T−n) is calculated by the following (formula 6).

  Next, the push start time detection unit 31 calculates the operation amount obtained from the operation amount calculation unit 21, the operation direction obtained from the operation direction calculation unit 30, and the stop time detected by the stop time detection unit 22. It is used to detect whether or not the operation member 210 has been shaken when the user's finger presses it. Specifically, the operation amount and the operation direction of the user's finger are each greater than or equal to a predetermined value from the stop time Ts at which the user's finger is considered to have stopped until the press time T when the switch 3 is pressed. Sometimes it is considered that there has been a shake.

  For example, assuming that the operation amount of the user's finger with respect to the operation member 210 is the operation speed v (t) (see Equation 5), the operation direction is θ (t), and the threshold of the operation speed that the user's finger is depressing is determined. If Vb and the threshold value of the operation direction are Θb, if v (t) and θ (t) between time Ts and time T-1 satisfy the blurring condition expressed by (Equation 7) below, The shake start time detection unit 31 regards that the user's finger is shaken.

  It should be noted that the condition for detecting the shaking may be a condition that the above-mentioned pushing state continues for a predetermined time or more. If the push start time detecting unit 31 detects a push shake, the push start time detecting unit 31 obtains a time Tb (where Ts <Tb <T-1) immediately before detecting the push shake. This is output as the pressing start time. For example, among the times t satisfying (Equation 7), the time closest to Ts may be Tb.

  In the press start time estimation unit 25 in the present modification described above, the shake start time detection unit 31 uses the operation amount and operation direction of the user's finger to push the operation member 210. Whether or not (push) is detected, and only when a push is detected, the time immediately before detecting the push is output as the pressing start time. In other words, the shake start time detection unit 31 according to the present modification pushes against the operation member 210 a sudden change in the operation amount or the operation direction of the user's finger after the user's finger is once stopped. It is determined as a shake, and the time immediately before the occurrence of the push is detected as the press start time.

  Therefore, for example, even when it is difficult to accurately detect the stop state of the finger when the operation member 210 starts to be pressed because the operation amount of the user's finger is small as a whole, a highly accurate pressing start time is set. Can be sought. For example, when a very large number of objects are displayed on the GUI screen 9, the user needs to select the target object accurately, and the amount of finger operation on the operation member 2 is very small as a whole. Become. In this case, it is very difficult to detect the time when the movement of the finger is stopped. However, in the present embodiment, it is possible to reduce erroneous operations related to the detection of the shaking by the above-described configuration in which a sudden change in the operation direction is detected together with the operation amount in estimating the stop time.

In the present embodiment, the feature amount of both the operation amount and the operation direction of the user's finger is used in order for the push start time detection unit 31 to detect the push motion. However, only one of the feature amounts is used. In this case, it is also possible to detect the pushing motion.
In this modification, the pressing start time estimation unit 25 does not necessarily have the stop time detection unit 22. In this case, for example, the push start time detection unit 31 acquires the operation amount calculated from the operation amount calculation unit 21 and determines whether or not the operation amount is equal to or less than a threshold value.
The above is the description of the first modification in the first embodiment.

  In the first embodiment described above and its modification, the information input device 200 shown in FIG. 3 includes a cursor position calculation unit 10, a cursor display control unit 12, an object arrangement storage unit 13, an object display control unit 15, and an object. The selection detection unit 16 and the object determination unit 17 may not be provided. When the information input device 200 does not include the cursor position calculation unit 10, the cursor display control unit 12, the object arrangement storage unit 13, the object display control unit 15, the object selection detection unit 16, and the object determination unit 17, the screen control unit 400 may include a cursor position calculation unit 10, a cursor display control unit 12, an object arrangement storage unit 13, an object display control unit 15, an object selection detection unit 16, and an object determination unit 17.

  In this case, the information input device 200 transmits at least one or more pieces of position information stored in the position information series storage unit 7 to the cursor position calculation unit 10 included in the screen control unit 400 using wired or wireless. . Further, the pressing information when the switch 3 is turned on is transmitted to the cursor position calculation unit 10 and the object selection detection unit 16 included in the screen control unit 400. Furthermore, when the switch 3 is turned ON, the estimated press start position estimated by the press start position estimating unit 18 is transmitted to the cursor position calculating unit 10 included in the screen control unit 400.

  With the above configuration, even if the cursor position calculation unit 10 and the cursor display control unit 12 are not included in the information input device 200, the cursor position calculation unit 10 can calculate the cursor position displayed on the GUI screen 9, Based on the cursor position, the cursor display control unit 12 can display the cursor 11 on the GUI screen 9.

  Even if the object arrangement storage unit 13, the object display control unit 15, and the object selection detection unit 16 are not included in the information input device 200, the object selection detection unit 16 can output the cursor position output from the cursor position calculation unit 10. Based on the object arrangement information stored in the object arrangement storage unit 13, the object selected by the user can be detected, and the object display control unit 15 sends the identification number of the selected object from the object selection detection unit 16. Can be displayed on the GUI screen 9 that the object has been selected.

  Even if the object determination unit 17 is not included in the information input device 200, when the switch 3 is turned on, the object selection detection unit 16 receives the pressing information from the switch 3, and the object selected at that time The identification number is output to the object determination unit 17, so that the object determination unit 17 can determine (execute) the object.

As described above, the information input device 200 including the pressing start position estimation unit that estimates the pressing start position at which the user turns on the switch 3 has been described in the first embodiment and the modifications thereof.
Next, a second embodiment will be described, which further includes a push-motion correction control unit that determines whether or not the pressing start position should be estimated.

(Embodiment 2)
FIG. 8 is a block diagram of the information input device 201 according to Embodiment 2 of the present invention. In the present embodiment, the same parts as those in the first embodiment shown in FIG. 3 are denoted by the same reference numerals, and detailed description thereof is omitted. As shown in FIG. 8, the information input device 201 in the present embodiment includes a clickable rotation system input device 1, a position movement information calculation unit 5, a position movement information sequence storage unit 6, and a position information sequence storage unit 7. A pressing start position estimation unit 18, a shake correction control unit 19, a cursor position calculation unit 10, a cursor display control unit 12, an object arrangement storage unit 13, an object display control unit 15, and an object selection detection unit. 16 and an object determination unit 17.

The difference between the present embodiment shown in FIG. 8 and the embodiment shown in FIG. 3 is that it is provided with a shake correction control unit 19, which will be described below. .
On the GUI screen 9, the shake correction control unit 19 performs the shake correction on the basis of the object arrangement information detected by the object selection detection unit 16 and the position of the cursor 11 obtained from the cursor position calculation unit 10. When it is determined whether or not to perform the blurring correction, the pressing start position estimating unit 18 is made to estimate the pressing start position.

  Next, a detailed description will be given of a method for determining whether or not to perform the shake correction processing by the shake correction control unit 19. In the shake correction control unit 19, the object detected by the object selection detection unit 16 based on the cursor position before correction is the same as the object detected by the object selection detection unit 16 based on the cursor position corrected by the pressing start position estimation unit 18. It is determined whether or not to perform the camera shake correction process depending on whether or not there is a high possibility of becoming.

  In other words, when it is highly likely that they will be the same, it is determined not to perform the shake correction process, and otherwise, it is determined to perform the shake correction process. Specifically, the maximum blur width of the cursor position due to the shaking of the user's finger against the operation member 210 is defined, and even if the current cursor position is corrected by the maximum blur width, the object selected before and after the correction is selected. In the case of the same, it may be determined that the shake correction process is not performed.

  More specific description will be given with reference to FIG. As shown in FIG. 10, the current cursor position on the GUI screen 9 is (X, Y), and the arrangement information of the selected object 14 (b) is (Rx, Ry, W, H) (where Rx , Ry indicate the lower left coordinate position of the object 14 (b) on the GUI screen 9, and W and H indicate the width and height of the object 14 (b)). Also, let B be the maximum shake width of the user's finger with respect to the operation member 210.

  At this time, if the cursor position (X, Y) (before correction) satisfies the following (Equation 8), the camera shake correction control unit 19 determines not to perform camera shake correction.

(Rx <X−B) and (X + B <Rx + W) and (Ry <Y−B) and (Y + B <Ry + H) (Formula 8)
It should be noted that the maximum blur width B is not a fixed value with respect to vertical / left / right / left / right pressing blur, but may be set to different values for the vertical / horizontal directions.

  The processing flow of the embodiment described above will be described with reference to FIG. As in the first embodiment, the user can use the clickable rotary input device 1 for the objects 14 (a) to 14 (c) arranged on the GUI screen 9 displayed on the screen display unit 8. A series of operations for selecting and confirming (executing) the target object 14 (b) will be described as a specific example (see FIG. 10).

  As already described, the configuration of the present embodiment is obtained by adding the shake correction control unit 19 to the first embodiment shown in FIG. Therefore, the same processing as that in the first embodiment is performed for each component in FIG. 8 other than the blur correction control unit 19. That is, with respect to the objects 14 (a) to 14 (c) arranged on the GUI screen 9 displayed on the screen display unit 8, the target object 14 (b) is displayed using the rotary input device 1 that is clickable by the user. In a series of operations to select and confirm (execute), the operation of each component until the user selects the target object 14 (b) is the same as in the first embodiment.

Therefore, here, in order to confirm the object 14 (b) selected by the user on the GUI screen 9, the operation member 210 of the clickable rotary input device 1 is pushed in and the switch 3 is turned on (Yes in S208). The subsequent operation will be described.
When the user turns on the switch 3 by pressing the clickable rotary input device 1 (Yes in S208), the switch 3 pushes down the press information, the shake correction control unit 19, the cursor position calculation unit 10, and the object selection detection unit 16 Output to.

  When the pressing information is input from the switch 3, the shake correction control unit 19 displays an object (for example, the cursor 11 overlaps on the GUI screen 9) currently selected by the user on the GUI screen 9 (for example, , The identification number of the object 14 (b)) is acquired from the object selection detection unit 16. Further, the shake correction control unit 19 reads out the arrangement of the object 14 (b) from the object arrangement storage unit 13 using the identification number acquired from the object selection detection unit 16.

  Further, the shake correction control unit 19 obtains the current position of the cursor 11 on the GUI screen 9 from the cursor position calculation unit 10 (that is, the time when the push correction control unit 19 obtains the pressed information). Then, using the placement information and cursor position of the object 14 (b) currently selected by the user, the shake correction control unit 19 determines whether to perform the shake correction processing (S301).

  When the camera shake correction control unit 19 determines to perform the camera shake correction process (Yes in S301), the camera shake correction start information is output to the press start position estimating unit 18 and the press start position estimating unit 18 Let the camera shake correction process. When the push start correction information is input, the pressing start position estimation unit 18 stores the position movement information stored in the position movement information sequence storage unit 6 and the position information sequence storage as already described in the first embodiment. Based on the position information stored in the unit 7, a pressing start position when the user's finger starts to press the operation member 210 is estimated and output to the cursor position calculating unit 10 (S302).

  After that, the cursor position calculation unit 10 that has acquired the pressing start position calculates the cursor position (S303). Thereafter, the operation until the object is determined by the object determination unit 17 is the same as the operation described in the first embodiment, and is omitted here. On the other hand, when it is determined not to perform the shake correction process (No in S301), the shake correction control unit 19 outputs the shake correction stop information to the object selection detection unit 16. The object selection detection unit 16 that has acquired the shake correction stop information outputs the identification number of the selected object to the object determination unit 17.

More specifically, the object selection detection unit 16 receives the pressing information from the switch 3 and receives the shake correction stop information from the shake correction control unit 19, the currently selected object 14 (b ) Identification number is output to the object determination unit 17.
The subsequent operation of the object determination unit 17 (S213) and the operation of the object display control unit 15 (S214) are the same as those described in the first embodiment, and thus description thereof is omitted here.

  In the present embodiment described above, the shake correction control is performed using the current cursor position on the GUI screen 9 and the arrangement information of the object currently selected by the user (that is, the cursor 11 overlaps). The unit 19 determines whether or not there is a high possibility that the same object is selected when the cursor position is changed by the push blur correction. As a result, when there is a high possibility that they are the same, the information input device 201 does not perform the shake correction.

  That is, in the present embodiment, as in the first embodiment shown in FIG. 3, when the user turns on the switch 3, the pressing start position estimating unit 18 does not always perform the blur correction. The camera shake correction process is performed only when the user cannot determine the target object due to the camera shake, that is, when there is a high possibility that an erroneous operation will occur. Therefore, the present embodiment can improve the response speed of the entire input operation as compared with the first embodiment. In particular, when the size of the object on the GUI screen 9 is sufficiently larger than the maximum blur width caused by the push-motion, the possibility of an erroneous operation due to the push-motion is low, so that the entire input operation is compared with the first embodiment. It is possible to greatly improve the response speed.

  It should be noted that the camera shake correction control unit 18 according to the present embodiment determines whether to perform the camera shake correction, the object placement information detected by the object selection detection unit 16, and the cursor 11 obtained from the cursor position calculation unit 10. In addition to the position of the position of the object, further, the object is detected based on the arrangement information of the first object detected by the object selection detection unit 16 and at least one or more second objects in the vicinity of the first object. You may determine whether correction | amendment is possible.

  Hereinafter, as a modification of the present embodiment, a shake correction control unit 19 that determines whether or not the shake correction can be performed using the arrangement information of the objects in the vicinity of the detected object will be described with reference to FIG. .

(Modification of Embodiment 2)
FIG. 10 shows the GUI screen 9 in the present embodiment. As shown in FIG. 10, an object detected by the object selection detection unit 16 is an object 14 (b), and objects in the vicinity thereof are objects 14 (a) and 14 (c). At this time, the shake correction control unit 19 reads the arrangement information of the objects 14 (a) to 14 (c) from the object arrangement storage unit 13 and is detected by the object selection detection unit 16 (that is, the cursor 11 overlaps). The gaps G (ab) and G (bc) on the arrangement of the object 14 (b) and the neighboring objects 14 (a) and 14 (c) are obtained.

  As described above, the camera shake correction control unit 19 determines whether to perform camera shake correction using (Equation 8). At this time, the maximum camera cursor position shake caused by the user's finger shake is determined. The width B is changed according to the arrangement gaps G (ab) and G (bc) instead of a predetermined fixed value. Specifically, the shake correction control unit 19 determines G (ab) and G (bc) by comparing with two kinds of predetermined thresholds Gs and Gb (where Gs <Gb). That is, when both G (ab) and G (bc) are smaller than the threshold value Gs, the frequency of erroneous operation due to the shake is high, and the shake correction control unit 19 sets the maximum shake width B in advance from the normal value. Set a smaller value by a specific value. As a result, the camera shake correction control unit 19 determines to perform more camera shake correction processing.

  Further, when both G (ab) and G (bc) are larger than the threshold value Gb, since the frequency of erroneous operation due to the shake is low, the shake correction control unit 19 sets the maximum shake width B in advance from the normal value. Set a larger value by a specific value. As a result, the camera shake correction control unit 19 determines to perform less camera shake correction processing.

As described above, in addition to the current cursor position on the GUI screen 9 and the arrangement information of the object selected by the user, the shake correction process is performed based on the arrangement relationship between the selected object and the object in the vicinity thereof. By dynamically changing the threshold value for determining whether or not to perform the information, an information input device that is less likely to be erroneously operated by the shake and excellent in the response speed can be provided.
Heretofore, the second embodiment of the information input device 201 including the shake correction control unit 19 and the modifications thereof have been described.

  In the above-described information input device, a push start position by the user (that is, a position in the input region of the clickable rotary input device 1 that is estimated that the user has started pressing the operation member 210) is pushed. Prevented.

In each embodiment, the operating member 210 of the clickable rotary input device 1 has four rotating members 2 (balls). However, like the trackball, the operating member 210 includes only a single rotating member. Or an arbitrary number n (n ≧ 1).

  In each embodiment, the clickable input device 1 including the operation member 210 having the rotation member 2, the switch 3, and the rotation information detection unit 4, the cursor 11, and the objects 14 (a) to 14 (c). Each processing unit other than the screen display unit 8 on which the GUI screen 9 including the above is displayed is configured by dedicated hardware. Alternatively, the same function may be realized by software using a computer. . Specifically, the information input device described in the first and second embodiments can be realized by a computer.

  FIG. 11 is a block diagram illustrating a hardware configuration of a computer system that implements the information input device 200. The computer 34 includes a CPU (Central Processing Unit) 44, a ROM (Read Only Memory) 46, a RAM (Random Access Memory) 48, and a hard disk 50.

  The ROM 46 stores programs and data necessary for the operation of the computer 34. The RAM 48 stores data such as parameters at the time of program execution. The hard disk 50 stores programs and data. The CPU 44 executes those programs. Further, a communication modem 52 that performs communication with another computer via a computer network and a CD-ROM (Compact Disc-Read Only Memory) device 40 may be provided. In this case, the CPU 44 may execute a program read via the CD-ROM device 40 or the communication modem 52. The bus 54 connects the clickable rotation system input device 1, the CPU 44, the ROM 46, the RAM 48, the hard disk 50, the communication modem 52, the CD-ROM device 40, and the screen display device 300 to each other.

  Furthermore, some or all of the constituent elements constituting each of the above-described devices may be configured by one system LSI (Large Scale Integration). The system LSI is an ultra-multifunctional LSI manufactured by integrating a plurality of components on a single chip, and specifically, a computer system including a microprocessor, ROM, RAM, and the like. . A computer program is stored in the RAM. The system LSI achieves its functions by the microprocessor operating according to the computer program.

  Furthermore, some or all of the constituent elements constituting each of the above-described devices may be configured from an IC card that can be attached to and detached from each device or a single module. The IC card or module is a computer system that includes a microprocessor, ROM, RAM, and the like. The IC card or the module may include the super multifunctional LSI described above. The IC card or the module achieves its function by the microprocessor operating according to the computer program. This IC card or this module may have tamper resistance.

  Further, the present invention may be the method described above. Further, the present invention may be a computer program that realizes these methods by a computer, or may be a digital signal composed of the computer program.

  Furthermore, the present invention provides a computer-readable recording medium such as a flexible disk, hard disk, CD-ROM, MO, DVD, DVD-ROM, DVD-RAM, BD (Blu-ray Disc). (Registered trademark)), a memory card such as a USB memory or an SD card, or a semiconductor memory. Further, the digital signal may be recorded on these recording media.

  Further, the present invention may transmit the computer program or the digital signal via an electric communication line, a wireless or wired communication line, a network represented by the Internet, a data broadcast, or the like.

  The present invention may be a computer system including a microprocessor and a memory, wherein the memory stores the computer program, and the microprocessor operates according to the computer program.

  In addition, the program or the digital signal is recorded on the recording medium and transferred, or the program or the digital signal is transferred via the network or the like, and is executed by another independent computer system. It is good.

  Furthermore, the above embodiment and the above modification examples may be combined.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  The information input device according to the present invention has an effect of preventing a user from shaking and performing a more reliable operation in a GUI operation using a clickable rotary input device, and has a screen. It is useful as an information input device and information input method for electronic equipment and the like.

DESCRIPTION OF SYMBOLS 1,100 Clickable rotation system input device 2,101 Rotating member 3,102 Switch 4,103 Rotation information detection part 5,104 Position movement information calculation part 6,105 Position movement information series storage part 7 Position information series storage part 8 Screen Display unit 9, 501 GUI screen 10, 106 Cursor position calculation unit 11, 107 Cursor 12, 108 Cursor display control unit 13, 109 Object arrangement storage unit 14 (a) -14 (c), 110 (a) -110 (c ) Object 15, 111 Object display control unit 16, 112 Object selection detection unit 17, 113 Object determination unit 18, 24 Press start position estimation unit 19 Push correction control unit 20, 25 Press start time estimation unit 21 Operation amount calculation unit 22 Stop time detection unit 23 Press start position determination unit 30 Operation direction Out section 31 press shake start time detecting section 114 cursor movement invalidating unit 200, 201 the information input device 210 operating member 220 the spring structure 300, 500 screen display 400 screen control unit

Claims (14)

An information input device equipped with a clickable rotary input device,
The clickable rotating system input device has a rotating member and is configured to be movable up and down;
A switch that is pressed when the user pushes the operation member, and a rotation information detection unit that detects rotation information when the rotation member rotates,
The information input device includes:
A position movement information calculation unit for obtaining position movement information and position information from the rotation information;
A position movement information sequence storage unit for storing the position movement information for a predetermined time,
A position information series storage unit that stores the position information for a predetermined time,
When the switch is pressed, the user operates the operation based on the plurality of position movement information stored in the position movement information sequence storage unit and the plurality of position information stored in the position information sequence storage unit. An information input device comprising: a pressing start position estimating unit that estimates a pressing start position when starting to press a member. The pressing start position estimating unit is pressed when the user starts pressing the operation member based on the plurality of position movement information stored in the position movement information series storage unit when the switch is pressed. A pressing start time estimating unit for estimating a starting time;
The information input device according to claim 1, further comprising: a pressing start position determination unit that obtains position information at the pressing start time as a pressing start position using the position information stored in the position information series storage unit. The pressing start time estimating unit, based on a plurality of the position movement information stored in the position movement information series storage unit, an operation amount calculation unit for obtaining at least one type of user operation amount on the rotating member;
The information input device according to claim 2, further comprising: a stop time detection unit that estimates a time when a user operation on the operation member stops using the at least one type of operation amount. The operation amount calculation unit calculates an operation speed for the operation member of the user as the operation amount using the plurality of position movement information,
The stop time detection unit obtains a time when the operation speed is equal to or lower than a predetermined value as a time when a user operation on the operation member is stopped, and estimates the time as the press start time. The information input device according to claim 3. The pressing start time estimating unit, based on a plurality of the position movement information stored in the position movement information series storage unit, an operation amount calculation unit for obtaining at least one type of user operation amount on the operation member;
Using at least one or more types of operation amounts, the presence or absence of a user's pushing operation on the operation member is detected, and when the pressing motion is detected, the time immediately before the occurrence of the pressing motion is determined. The information input device according to claim 2, further comprising a shake start time detection unit. The pressing start time estimation unit further includes an operation direction calculation unit that obtains an operation direction of the user with respect to the operation member based on the plurality of position movement information stored in the position information series storage unit,
The push start time detecting unit uses the at least one type of operation amount obtained from the operation amount calculating unit and the operation direction obtained from the operation direction calculating unit to push the user into the operation member. 6. When the presence or absence of a camera shake is detected, and when the camera shake is detected, the time immediately before the occurrence of the camera shake is obtained using the at least one type of operation amount and the operation direction. Information input device. The information input device further includes a GUI (Graphical User Interface) based on one of the position information stored in the position information series storage unit and the pressing start position estimated by the pressing start position estimation unit. The information input device according to claim 1, further comprising a cursor position calculation unit that calculates a cursor position on the screen. The information input device further includes:
An object arrangement storage unit storing object arrangement information indicating an area in which at least one or more objects are arranged on the GUI screen;
An object display control unit that displays the at least one object on the GUI screen based on the object arrangement information acquired from the object arrangement storage unit;
The object selection detection part which detects the object currently selected by the said user among the said at least 1 or more objects based on the said object arrangement | positioning information and the said cursor position obtained from the said cursor position calculation part. The information input device described. In the information input device, the pressing start position estimating unit further determines the pressing start position based on the object arrangement information detected by the object selection detecting unit and the cursor position obtained from the cursor position calculating unit. The information input device according to claim 8, further comprising a shake correction control unit that determines whether to estimate. The information input device further starts the pressing based on arrangement information between the first object detected by the object selection detection unit and at least one second object in the vicinity of the first object. The information input device according to claim 8, further comprising a shake correction control unit that determines whether to estimate the position. An information input method using a clickable rotary input device,
The clickable rotating system input device has a rotating member and is configured to be movable up and down;
A switch that is pressed when the user pushes the operation member, and rotation information detection means that detects rotation information when the rotation member rotates,
The information input method is:
A position movement information calculation step for obtaining position movement information and position information from the rotation information;
A position movement information sequence storage step for storing the position movement information for a predetermined time,
A position information sequence storing step for storing the position information for a predetermined time,
When the switch is pressed, the user operates the operation based on the plurality of position movement information stored in the position movement information sequence storage unit and the plurality of position information stored in the position information sequence storage unit. An information input method including a pressing start position estimating step for estimating a pressing start position when the member starts to be pressed. The program which makes a computer perform the information input method of Claim 11. A computer-readable recording medium on which the program according to claim 12 is recorded. An integrated circuit for inputting information using a clickable rotary input device,
The clickable rotating system input device has a rotating member and is configured to be movable up and down;
A switch that is pressed when the user pushes the operation member, and rotation information detection means that detects rotation information when the rotation member rotates,
The integrated circuit comprises:
A position movement information detector for obtaining position movement information and position information from the rotation information;
A position movement information sequence storage unit for storing the position movement information for a predetermined time,
A position information series storage unit that stores the position information for a predetermined time,
When the switch is pressed, the user operates the operation based on the plurality of position movement information stored in the position movement information sequence storage unit and the plurality of position information stored in the position information sequence storage unit. An integrated circuit comprising: a pressing start position estimating unit that estimates a pressing start position when starting to press a member.