JP2009265897A - Hand-held information processor, controller, control system and control method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To improve convenience in operation by a hand-held remote pointing device having a numeric character and character input function. <P>SOLUTION: This device can be folded. An MPU (Micro Processing Unit) 19 decides whether or not an open state of a main body (numeric character and character input is enabled) is detected by a changeover detector 26. When the open state of the main body is detected, the MPU 19 stops transmission of a movement command output by a sensor unit 17, so that movement of a pointer on a screen is stopped. Thus, the transmission of the movement command is stopped when the main body is opened, so that a complicated operation for character input is eliminated, and operability is improved. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a handheld information processing apparatus that processes information. Further, the present invention provides a method for controlling a GUI (Graphical User Interface) operation by receiving information transmitted from an input device when the handheld information processing device is a spatial operation type input device. The present invention relates to a control device, its control system, and control method.

  Pointing devices such as a mouse and a touch pad are mainly used as a GUI controller that is widely used in PCs (Personal Computers). The GUI is not limited to the conventional HI (Human Interface) of a PC, but has begun to be used as an interface for AV equipment and game machines used in a living room or the like, for example, using a television as an image medium. As such a GUI controller, various pointing devices that can be operated by a user in space have been proposed (see, for example, Patent Document 1).

  By the way, it is assumed that the user performs character input and other operations using a keyboard while using a pointing device that communicates with the PC main body. In such a case, for example, there is a method in which the PC displays a keyboard by software, that is, a keyboard by GUI, on the screen and allows the user to select a character. However, when the user selects a character on the screen using the pointing device, the operation feels complicated for the user. In addition, it is conceivable that the user performs so-called handwriting input using a pointing device instead of using a keyboard, but this is also complicated.

  In order to solve the above problem, for example, a remote controller having a numeric and character input function has been commercialized by Thomson, France (Gyration Media Center Remotes).

JP 2001-56743 A

  However, in the above-mentioned Thomson product, the remote controller moves by the force of the user pressing a button when inputting characters, and the pointer on the screen also moves along with the movement. To prevent this, a button is provided on the remote controller to move the pointer only when it is pressed, and the remote controller can be operated by keeping the button pressed by the user. And move the pointer. However, an operation in which the user moves the pointer by pressing the button and moving the pointer can be complicated for the user.

  In view of the circumstances as described above, an object of the present invention is to improve the operability when the user operates the handheld information processing device in a predetermined operation form, the handheld information processing device, the control device, A control system and a control method are provided.

  In order to achieve the above object, a handheld information processing apparatus according to an embodiment of the present invention includes a main body, an output unit, a detection unit, and a control unit.

  The main body is operated by the user in a first operation mode and a second operation mode different from the first operation mode. The output means outputs a movement command for moving a UI displayed on the screen according to the movement of the main body. The detection means detects switching between the first operation mode and the second operation mode of the main body. When the main body is operated in the first operation mode, the control unit causes the output unit to output the movement command to move the UI on the screen, and the second operation mode. When the main body is operated, the decorrelation processing is executed to make the UI state on the screen uncorrelated with the movement of the main body.

That is, in response to the detection of switching between the first and second operation modes, whether a movement command for moving the UI is output or whether a decorrelation process is executed is automatically switched. Therefore, when the user changes the operation mode of the main body, the user does not feel inconvenience or complexity of the operability.
The switching of the operation mode means that the user intentionally switches the input operation method to the main body.

  The main body may include an operation key operated by the user and a storage mechanism that stores the operation key. In the detection means, a mode in which the operation key is stored by the storage mechanism is defined as the first operation mode, and a mode in which the operation key is exposed without being stored by the storage mechanism is defined as the second operation mode. The switching may be detected.

  The operation keys stored by the storage mechanism during the pointing operation are exposed during the operation in the second operation mode, and the decorrelation process is executed in the second operation mode. Thereby, when the operation is performed with the operation key, the UI does not move according to the movement of the main body, so that the user's operational feeling is improved. In addition, if the operation key is exposed during the pointing operation, an erroneous operation of the operation key, for example, the operation key may be unintentionally pressed by the user, but this is prevented in the embodiment of the present invention. Can do.

  The main body has a switch, and the control means has an input operation by the switch by the user while the main body is operated in the second operation mode and the decorrelation process is being executed. The movement command may be output by the output means in order to stop the decorrelation processing and move the UI on the screen.

  When the user operates the switch, the user can move the UI even when the operation key is exposed in the second operation mode.

  The main body is connected to connect the first body and the second body so that the first body, the second body, and the first body and the second body move relative to each other. And a mechanism. The detection means uses the state in which the first body and the second body are in a first relative position as the first operation mode, and the first body and the second body are in a first relative position. The switching may be detected with the second operation form being in a second relative position different from the position.

  The main body may have a touch panel type display capable of displaying a touch panel screen. The detection means detects the switching, with a form in which a user can perform a touch operation via the touch panel screen as the second operation form and a form in which the touch operation is released as the first operation form. May be. That is, the process for moving the UI and the decorrelation process are switched depending on whether or not a touch operation is possible.

  The main body may be operated by the user in a first posture in the first operation mode, and may be operated in a second posture different from the first posture in the second operation mode. That is, the user's way of holding the main body is different between the first operation mode and the second operation mode.

  The output means may include an acceleration sensor that detects acceleration of the main body. The detection means may detect the switching according to a change in gravitational acceleration detected by the acceleration sensor.

  The output means includes a sensor having a first detection axis and a second detection axis, and the movement of the main body in both the first direction and the second direction different from the first direction by the sensor. Is detected. The output means is configured to move the UI along an axis on the screen corresponding to the first direction, and a first movement according to the movement of the main body in the first direction. A command and a second movement command according to the movement of the main body in the second direction for moving the UI along an axis on the screen corresponding to the second direction; The movement command may be output.

  When the main body is operated in the first operation mode, the control means causes the first and second detection axes to detect the movement of the main body in the first and second directions, respectively. j The control means causes the output means to output the first and second movement commands corresponding to the detected movement of the main body, and the main body operates in the second operation mode. In this case, the movement of the main body in the first direction is detected by the second detection axis, and the first movement command corresponding to the movement of the main body detected by the second detection axis is You may make it output by an output means.

  For example, when switching from the first operation mode to the second operation mode is detected and the posture of the main body changes, the second detection axis corresponds to the first direction according to the posture change. Is set. As described above, since the detection axis automatically changes in accordance with the switching between the first and second operation modes, the pointing operation can be performed in any operation mode. In this case, when the main body is operated in the second operation mode, the control means detects the movement of the main body in the second direction with the first detection axis, and the movement of the main body detected with the first detection axis. A second movement command corresponding to the above may be output by the output means.

  Alternatively, a sensor including a third detection axis different from both directions of the first and second detection axes may be used as follows. The sensor has a third detection axis. When the main body is operated in the first operation mode, the control means causes the output means to output the first and second movement commands corresponding to the detected movement of the main body, and When the main body is operated in the second operation mode, the movement of the main body in the first and second directions is detected by the second and third detection axes, and the detected The first and second movement commands corresponding to the movement of the main body may be output by the output means.

  The main body is connected to connect the first body and the second body so that the first body, the second body, and the first body and the second body move relative to each other. And a mechanism. That is, the above inventions can be applied to a main body having at least two bodies.

  The connection mechanism may have a hinge shaft along the first detection shaft for opening and closing the second body with respect to the first body.

  The connection mechanism may include a slide mechanism that slides the second body in a direction along the first detection axis with respect to the first body.

  The connection mechanism may include a rotation mechanism that has a rotation axis in a direction along the second detection axis and rotates the second body with the rotation axis with respect to the first body. .

  A handheld information processing apparatus according to another aspect of the present invention includes a main body, an output unit, a detection unit, and a control unit.

  The main body is operated by the user in a first operation mode and a second operation mode different from the first operation mode. The output means includes a sensor having a first detection axis and a second detection axis, and movement of the main body in both the first direction and a second direction different from the first direction by the sensor. And a first movement command according to the movement of the main body in the first direction for moving the UI along an axis on the screen corresponding to the first direction, and A second movement command corresponding to the movement of the main body in the second direction is output to move the UI along an axis on the screen corresponding to the second direction. The detection means detects switching between the first operation mode and the second operation mode of the main body. When the main body is operated in the first operation mode, the control means detects the movement of the main body in the first and second directions with the first and second detection axes, respectively. The first and second movement commands corresponding to the movements of the main body detected by the first and second detection axes, respectively, are output by the output means, and in the second operation mode, the When the main body is operated, the movement of the main body in the first direction is detected by the second detection axis, and the first movement according to the movement of the main body detected by the second detection axis is detected. A movement command is output by the output means.

  A control device according to an aspect of the present invention is a control device that controls movement of a UI displayed on a screen based on a movement command and shape information output from a handheld information processing device, , Determination means, generation means, and execution means.

  The handheld information processing apparatus outputs a main body operated by a user in a first operation form and a second operation form different from the first operation form, and the movement command corresponding to the movement of the main body. Switching between the output means and the first operation mode and the second operation mode of the main body is detected, and the main body is operated in any one of the first operation mode and the second operation mode. Morphological information output means for outputting the morphological information, which is information on whether or not.

  The receiving means receives the movement command and the form information. The determination unit determines whether the main body is operated in one of the first operation form and the second operation form based on the form information. The generating means is configured to coordinate the UI on the screen based on the received movement command to move the UI on the screen when the main body is operated in the first operation mode. Generate information. When the main body is operated in the second operation mode, the execution means executes a decorrelation process for making the state of the UI on the screen uncorrelated with the movement of the main body. .

  The premise part of “to be” is described in order to clarify the contents of the present invention, and the present inventor and the present applicant are conscious of known techniques for the premise part. is not.

  A control system according to an aspect of the present invention includes a control unit having a main body, an output unit, a detection unit, a handheld information processing apparatus having a control unit, a reception unit, and a generation unit.

  The main body is operated by the user in a first operation mode and a second operation mode different from the first operation mode. The output means outputs a movement command for moving a UI displayed on the screen according to the movement of the main body. The detection means detects switching between the first operation mode and the second operation mode of the main body. When the main body is operated in the first operation mode, the control unit causes the output unit to output the movement command to move the UI on the screen, and the second operation mode. When the main body is operated, the decorrelation processing is executed to make the UI state on the screen uncorrelated with the movement of the main body. The receiving means receives the movement command. The generation unit generates coordinate information of the UI on the screen in order to move the UI on the screen based on the received movement command.

  A control system according to another aspect of the present invention includes a handheld information processing apparatus including a main body, an output unit, and a configuration information output unit, a reception unit, a determination unit, a generation unit, and an execution unit. And a control device.

  The main body is operated by the user in a first operation mode and a second operation mode different from the first operation mode. The output means outputs a movement command corresponding to the movement of the main body. The form information output means detects the switching of the first operation form and the second operation form of the main body, and the main body is in any form of the first operation form and the second operation form. Outputs morphological information that is information on whether or not to operate. The receiving means receives the movement command and the form information. The determination unit determines whether the main body is operated in one of the first operation form and the second operation form based on the form information. The generating means is configured to coordinate the UI on the screen based on the received movement command to move the UI on the screen when the main body is operated in the first operation mode. Generate information. When the main body is operated in the second operation mode, the execution means executes a decorrelation process for making the state of the UI on the screen uncorrelated with the movement of the main body. .

  A control method according to an aspect of the present invention is based on a movement of a main body operated by a user in a first operation form and a second operation form different from the first operation form by a handheld information processing apparatus. The movement command for moving the UI displayed on the screen is output. The handheld information processing apparatus detects the switching between the first operation mode and the second operation mode of the main body. When the main body is operated in the first operation mode, the movement command is output by the handheld information processing apparatus to move the UI on the screen. When the main body is operated in the second operation mode, a non-correlation process for changing the state of the UI on the screen to a state uncorrelated with the movement of the main body is performed by a handheld information processing device. Executed.

A control method according to another aspect of the present invention is a control method for a control device that controls movement of a UI displayed on a screen based on a movement command and shape information output from a handheld information processing device. The movement command and the form information are received. Based on the form information, it is determined which of the first operation form and the second operation form the body is operated in. When the main body is operated in the first operation mode, coordinate information of the UI on the screen is generated based on the received movement command to move the UI on the screen. . When the main body is operated in the second operation mode, a decorrelation process is performed to make the UI state on the screen uncorrelated with the movement of the main body.
The premise part of “to be” is described in order to clarify the contents of the present invention, and the present inventor and the present applicant are conscious of known techniques for the premise part. is not.

  In the above description, the elements described as “to means” may be realized by hardware, or may be realized by both software and hardware. When implemented in both software and hardware, the hardware includes at least a storage device that stores software programs. Typically, the hardware is a CPU (Central Processing Unit), MPU (Micro Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory), DSP (Digital Signal Processor), FPGA (Field Programmable Gate Array). ), ASIC (Application Specific Integrated Circuit), NIC (Network Interface Card), WNIC (Wireless NIC), modem, optical disk, magnetic disk, and flash memory are selectively used.

  As described above, according to the present invention, it is possible to improve the operability when the user operates the handheld information processing apparatus in a predetermined operation form using buttons or other mechanisms.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a diagram showing a control system according to an embodiment of the present invention. The control system 100 includes a display device 5, a control device 40, and a handheld information processing device 1. Hereinafter, the handheld information processing apparatus is simply referred to as an input device.

  FIG. 2A is a plan view showing the input device 1, and FIG. 2B is a side view thereof. The input device 1 is, for example, a foldable device, and FIG. 3 is a plan view showing a state in which the input device 1 is opened.

  The input device 1 is large enough to be held by the user. The input device 1 includes a main body 10 and an operation unit 14 provided on the outer surface of the main body 10. The operation unit 14 includes, for example, a determination button 11, a button 12 adjacent to the determination button 11, a wheel button 13, and a plurality of operation keys described later. The decision button 11 may have a function of a left button of a mouse as an input device used in a PC, for example, and the button 12 adjacent to the button 11 may have a function of a right button. The wheel button 13 is mainly used as a button having a function of a mouse wheel button.

  For example, “drag and drop” may be performed by moving the input device 1 by long-pressing the button 11, opening a file by double clicking the button 11, and scrolling the screen 3 by the wheel button 13. The arrangement of the buttons 11 and 12 and the wheel button 13 and the contents of the issued command can be changed as appropriate.

  The input device 1 includes a first body 31, a second body 32, and a hinge portion 33 having a hinge shaft for opening and closing the bodies 31 and 32. As shown in FIG. 3, a plurality of operation keys 34 are arranged on the inner surfaces of the first body 31 and the second body 32, and these operation keys 34 are exposed when the main body 10 is opened. . When the main body 10 is closed, the operation key 34 is hidden. That is, the main body 10 includes a storage mechanism that stores the operation keys 34.

  Each operation key 34 typically has a keyboard function and arrangement for commonly used character input, but is not limited to this function and arrangement. These operation keys 34 are mainly used when the user inputs characters, numbers, other symbols, and the like to the control device 40.

  FIG. 4 is a diagram schematically illustrating an internal configuration of the input device 1. FIG. 5 is a block diagram showing an electrical configuration of the input device 1.

  The input device 1 includes a sensor unit 17, a switching detector 26, a control unit 30, and a battery (not shown).

  FIGS. 6A and 6B are perspective views showing the sensor unit 17.

  As shown in FIG. 6A, the sensor unit 17 includes an acceleration sensor unit 16 that detects acceleration along mutually different angles, for example, two orthogonal axes (X axis and Y axis). That is, the acceleration sensor unit 16 includes two sensors, an acceleration sensor 161 in the X-axis direction and an acceleration sensor 162 in the Y-axis direction.

  Further, as shown in FIG. 6B, the sensor unit 17 includes an angular velocity sensor unit 15 that detects angular acceleration about the two orthogonal axes. That is, the angular velocity sensor unit 15 includes two sensors, an angular velocity sensor 151 in the yaw direction and an angular velocity sensor 152 in the pitch direction.

  The acceleration sensor unit 16 and the angular velocity sensor unit 15 are packaged and mounted on a first surface on the circuit board 25 and a second surface opposite to the first surface. As described above, the acceleration sensor unit 16 and the angular velocity sensor unit 15 are respectively disposed on both the first surface and the second surface of the circuit board 25, thereby reducing the area of the main surface of the circuit board 25. Can do. Therefore, the sensor unit 17 can be reduced in size. Thereby, the sensor unit 17 is easily incorporated into the main body 10. In particular, a device of a type in which each operation key 34 is housed like the folding type input device 1 needs to design the first body 31 and the second body 32 to be thin. Therefore, the sensor unit 17 according to the present embodiment is useful.

  As the yaw and pitch angular velocity sensors 151 and 152, vibration type gyro sensors that detect Coriolis force proportional to the angular velocity are used. The X-axis and Y-axis acceleration sensors 161 and 162 may be any type of sensor such as a piezoresistive type, a piezoelectric type, or a capacitance type. The angular velocity sensor 151 or 152 is not limited to the vibration type gyro sensor, and a rotary top gyro sensor, a laser ring gyro sensor, a gas rate gyro sensor, or the like may be used.

  In the description of FIGS. 2 to 4, for the sake of convenience, the longitudinal direction of the main body 10 is the Z ′ direction, and the direction (thickness direction) in which the first body 31 and the second body 32 are arranged is the X ′ direction. Further, the width direction of the main body 10 is defined as a Y ′ direction. In this case, the sensor unit 17 is built in the main body 10 so that the surface of the circuit board 25 on which the acceleration sensor unit 16 and the angular velocity sensor unit 15 are mounted is substantially parallel to the X′-Y ′ plane. . Accordingly, as described above, both sensor units 16 and 15 detect physical quantities related to the two axes of the X ′ axis and the Y ′ axis. The sensor unit 17 is arranged so that the X′-axis direction, which is the direction of acceleration detected by the acceleration sensor 161 in the X′-axis direction, is along the hinge axis of the hinge portion 33.

  For convenience of explanation, hereinafter, a coordinate system that moves together with the input device 1, that is, a coordinate system that is fixed to the input device 1 is represented by an X ′ axis, a Y ′ axis, and a Z ′ axis. A coordinate system on a stationary earth, that is, an inertial coordinate system is represented by an X axis, a Y axis, and a Z axis. Regarding the movement of the input device 1, the direction of rotation around the X ′ axis is called the pitch direction, the direction of rotation around the Y ′ axis is called the yaw direction, and the rotation around the Z ′ axis (roll axis) direction. The direction may be referred to as a roll direction.

  The switching detector 26 detects switching between one operation mode of the input device 1 and another operation mode. That is, the switching detector 26 detects switching between the closed state and the opened state of the main body 10 of the input device 1. As the switching detector 26, a known sensor such as a mechanical sensor, a magnetic sensor, an optical sensor, or a pressure sensor may be used.

  The control unit 30 includes a main board 18, an MPU 19 (or CPU) mounted on the main board 18, a crystal oscillator 20, a transmitter 21, and an antenna 22 printed on the main board 18.

  The MPU 19 incorporates necessary volatile and nonvolatile memories. The MPU 19 receives a detection signal from the sensor unit 17, an operation signal from the operation unit 14, the operation key 34, and the like. The MPU 19 performs various arithmetic processes in order to generate a predetermined control signal corresponding to these input signals. The memory may be provided separately from the MPU 19. The MPU 19 is not limited, and a DSP, FPGA, ASIC, or the like may be used.

  Typically, the sensor unit 17 outputs an analog signal. In this case, the MPU 19 includes an A / D (Analog / Digital) converter. However, the sensor unit 17 may be a unit including an A / D converter.

  The transmitter 21 transmits a control signal (input information or a predetermined command) generated by the MPU 19 to the control device 40 via the antenna 22 as an RF radio signal, for example.

  The crystal oscillator 20 generates a clock and supplies it to the MPU 19.

  The control device 40 is a computer and includes an MPU 35 (or CPU), a RAM 36, a ROM 37, a display control unit 42, a video RAM 41, an antenna 39, a receiver 38, and the like.

  The receiver 38 receives the control signal transmitted from the input device 1 via the antenna 39. The MPU 35 analyzes the control signal and performs various arithmetic processes. The display control unit 42 mainly generates screen data to be displayed on the screen 3 of the display device 5 in accordance with the control of the MPU 35. The video RAM 41 serves as a work area for the display control unit 42 and temporarily stores the generated screen data.

  The control device 40 may be a device dedicated to the input device 1, but may be a PC or the like. The control device 40 is not limited to a PC, and may be a computer integrated with the display device 5, or may be an audio / visual device, a projector, a game device, a car navigation device, or the like.

  Examples of the display device 5 include a liquid crystal display and an EL (Electro-Luminescence) display, but are not limited thereto. Alternatively, the display device 5 may be a device integrated with a display capable of receiving a television broadcast or the like.

  FIG. 7 is a diagram illustrating an example of the screen 3 displayed on the display device 5. On the screen 3, UIs such as an icon 4 and a pointer 2 are displayed. An icon is an image of the function of a program on a computer, an execution command, or the contents of a file on the screen 3. The horizontal direction on the screen 3 is the X-axis direction, and the vertical direction is the Y-axis direction. In order to facilitate understanding of the following description, it is assumed that the UI to be operated by the input device 1 is a pointer 2 (so-called cursor) unless otherwise specified.

  FIGS. 8A and 8B are diagrams illustrating a state where the user holds the input device 1. In addition to the buttons 11, 12, and 13, the input device 1 may include various operation buttons (not shown) and operation units such as a power switch that are provided in a remote controller that operates a television or the like. In this way, when the user holds the input device 1, the input device 1 is moved in the air or the operation unit 14 is operated, whereby the input information is output to the control device 40, and the UI is displayed by the control device 40. Be controlled.

  Next, a typical example of how to move the input device 1 and the movement of the pointer 2 on the screen 3 due to this will be described.

  As shown in FIGS. 8A and 8B, the user holds the side of the input device 1 on which the buttons 11 and 12 are arranged so as to face vertically upward. Now, the vertically upward direction corresponds to the Y-axis direction. In this state, the circuit board 25 (see FIG. 6) of the sensor unit 17 is nearly parallel to the screen 3 of the display device 5, and the two axes that are the detection axes of the sensor unit 17 are horizontal axes on the screen 3. It corresponds to the (X axis) and the vertical axis (Y axis). Hereinafter, the posture of the input device 1 shown in FIGS. 8A and 8B is referred to as a basic posture.

As shown in FIG. 8A, in the basic posture state, the user swings the wrist or arm in the left-right direction, that is, the yaw direction. At this time, the acceleration sensor 161 in the X ′ axis direction detects the acceleration a _x in the X ′ axis direction, and the angular velocity sensor 151 in the yaw direction detects the angular velocity ω _ψ around the Y ′ axis. Based on these detection values, the control device 40 controls the display of the pointer 2 so that the pointer 2 moves in the X-axis direction.

On the other hand, as shown in FIG. 8B, the user swings his / her wrist or arm in the vertical direction, that is, the pitch direction in the basic posture state. At this time, the acceleration sensor 162 in the Y ′ axis direction detects the acceleration a _y in the Y ′ axis direction, and the angular velocity sensor 152 in the pitch direction detects an angular velocity ω _θ around the X ′ axis. Based on these detection values, the control device 40 controls the display of the pointer 2 so that the pointer 2 moves in the Y-axis direction.

  The MPU 19 of the input device 1 is typically based on the acceleration value and the angular velocity value acquired at each predetermined first clock, and typically, the velocity value in the X-axis direction and the velocity value in the Y-axis direction at each first clock. Are calculated and output. Depending on the speed value calculation method, the MPU 19 may output speed values in the X-axis and Y-axis directions for each second clock slower than the first clock.

  The control device 40 converts the displacement in the yaw direction per unit time of the input device 1 into the displacement amount of the pointer 2 on the X axis on the screen 3, and the displacement in the pitch direction per unit time on the screen 3 The pointer 2 is moved by converting it into a displacement amount of the pointer 2 on the Y axis. Typically, the MPU 19 of the control device 40 supplies the speed value supplied for each of the first or second clock numbers to the speed value supplied for the (n−1) th time, to the nth time. Add the speed value. Thus, the velocity value supplied for the nth time corresponds to the displacement amount of the pointer 2, and the coordinate information on the screen 3 of the pointer 2 is generated. In this case, the MPU 19 of the control device 40 mainly functions as coordinate information generating means.

  Next, the basic operation of the control system 100 configured as described above will be described. FIG. 9 is a flowchart showing the operation.

The input device 1 is turned on. For example, when the user turns on a power switch or the like provided in the input device 1 or the control device 40, the input device 1 is powered on. When the power is turned on, a biaxial angular velocity signal is output from the angular velocity sensor unit 15. The MPU 19 obtains the first angular velocity value ω _ψ and the second angular velocity value ω _θ from the biaxial angular velocity signal (step 101).

When the input device 1 is turned on, a biaxial acceleration signal is output from the acceleration sensor unit 16. The MPU 19 acquires the first acceleration value a _x and the second acceleration value a _y based on the biaxial acceleration signal (step 102). This acceleration value signal is a signal corresponding to the attitude of the input device 1 at the time when the power is turned on.

  The MPU 19 typically performs Steps 101 and 102 in synchronization with each other at a predetermined clock cycle.

The MPU 19 obtains speed values (first speed value V _x , second speed value V _y ) by a predetermined calculation based on the acceleration values (a _x , a _y ) and the angular velocity values (ω _ψ , ω _θ ). Calculate (step 103). The first velocity value V _x is a velocity value in the direction along the X axis, and the second velocity value V _y is a velocity value in the direction along the Y axis. This speed value calculation method will be described later in detail. In this respect, for example, the MPU 19 and the sensor unit 17 (or the transmitter unit 21 added thereto) function as output means for outputting a movement command for moving the pointer 2 on the screen 3.

Thus, in the present embodiment, the acceleration values (a _x , a _y ) are not simply integrated to calculate the velocity values (V _x , V _y ), but the acceleration values (a _x , a _y ) are calculated. ) And angular velocity values (ω _ψ , ω _θ ), the velocity values are (V _x , V _y ). Thereby, as will be described later, an operational feeling of the input device 1 that matches the user's intuition is obtained, and the movement of the pointer 2 on the screen 3 also exactly matches the movement of the input device 1. However, the velocity values (V _x , V _y ) are not necessarily obtained based on the acceleration values (a _x , a _y ) and the angular velocity values (ω _ψ , ω _θ ). For example, the acceleration values (a _x , a _y) ) May be simply integrated to calculate the velocity values (V _x , V _y ).

The MPU 19 transmits information including the obtained velocity values (V _x , V _y ) as a movement command to the control device 40 via the transmitter 21 and the antenna 22 (step 104).

The MPU 35 of the control device 40 receives the velocity value (V _x , V _y ) information via the antenna 39 and the receiver 38 (step 105). Since the input device 1 transmits the speed values (V _x , V _y ) at every predetermined clock, that is, at every unit time, the control device 40 receives this, and in the X-axis and Y-axis directions at every unit time Can be obtained.

  The MPU 35 calculates the coordinate values (X (t), Y on the screen 3) of the pointer 2 according to the acquired displacement amounts in the X-axis and Y-axis directions per unit time from the following expressions (1) and (2). (t)) (coordinate information) is generated (step 106) (generating means). By generating the coordinate value, the MPU 35 controls the display so that the pointer 2 moves on the screen 3 (step 107).

X (t) = X (t-1) + V _x (1)
Y (t) = Y (t -1) + V y ··· (2).

In FIG. 9, the input device 1 performs the main calculation to calculate the velocity values (V _x , V _y ). In the embodiment shown in FIG. 10, the control device 40 performs main calculations.

  As shown in FIG. 10, steps 201 and 202 are the same processes as steps 101 and 102. The input device 1 transmits, for example, information on the detected value that is the biaxial acceleration value and biaxial angular velocity value output from the sensor unit 17 to the control device 40 (step 203). The MPU 35 of the control device 40 receives the detected value information (step 204) and executes the same processing as steps 103, 106 and 107 (steps 205 to 207).

  Next, the operation of the input device 1 when the user opens and closes the main body 10 of the input device 1 will be described. FIG. 11 is a flowchart showing the operation.

The MPU 19 determines whether or not the state in which the main body 10 is opened is detected by the switching detector 26 (step 301). When it is detected that the main body 10 is open, the MPU 19 stops the movement command transmission (transmission of velocity values (V _x , V _y )) in step 104 shown in FIG. 9 (step 302). Thereby, the movement of the pointer 2 on the screen 3 is stopped. When transmission of the movement command is stopped in this way, in step 302, the calculation of the speed value in step 102 may also be stopped.

  When the switching detector 26 does not detect that the main body 10 is opened, that is, when the main body 10 is closed, the MPU 19 executes steps 101 to 104 shown in FIG. 9 (step 303). That is, the movement command is transmitted, and the control device 40 executes steps 105 to 107 shown in FIG. 9 so that the pointer 2 moves on the screen 3.

  When transmission of the movement command is stopped (step 302), the MPU 19 determines whether or not the switching detector 26 has detected that the main body 10 is closed (step 304). When the main body 10 is closed, the process returns to step 303.

  When the switching detector 26 does not detect that the main body 10 is closed, that is, when the main body 10 is open, the MPU 19 determines whether or not an input operation has been performed by the user via the operation key 34 (step 305). ).

  When an input operation is performed by the user via the operation key 34, the MPU 19 generates a command corresponding to the input operation of the operation key 34 (step 306), and transmits this to the control device 40 as necessary. Here, for example, the user inputs characters, numbers, and other symbols to the input device 1 via the operation keys 34. The control device 40 receives the command and executes predetermined processing such as character input in accordance with the command. The input operation using the operation key 34 is not limited to the input operation of characters, numbers, and other symbols, and may be an input operation when executing various programs included in the control device 40 or the input device 1.

  If there is no input operation by the operation key 34 in step 305, the process returns to step 304.

  In this way, the posture of the main body 10 differs between the operation mode operated when the main body 10 is opened and the operation mode operated when the main body 10 is closed, and the user holds the main body 10. Is different. In the present embodiment, when the main body 10 is in the open state, the transmission of the movement command is stopped, so that troublesome operations such as character input are eliminated and the operability is improved. When the user performs a pointing operation, the main body 10 is folded and the operation keys 34 are stored. Therefore, for example, when the operation key is exposed at the time of the pointing operation, there is a possibility that the operation key is erroneously operated, for example, the user presses the operation key without intention, but this embodiment prevents this. be able to.

  In step 302 described above, the MPU 19 is not limited to a mode in which transmission of the movement command is stopped. The MPU 19 may perform a decorrelation process for making the state of the pointer 2 on the screen 3 uncorrelated with the movement of the main body 10.

The non-correlation process includes the following processes in addition to outputting a command for stopping the output of the movement command.
1) For example, a process for outputting a command for setting the movement amount of the pointer 2 on the screen to zero,
2) Processing to output a command for hiding the pointer 2;
3) Processing for outputting a command for changing the image of the pointer 2 to a predetermined image;
4) Processing to output a command so that the movement amount of the pointer 2 sufficiently exceeds the range of the screen size;
5) A process of moving the pointer 2 to, for example, the end of the screen 3 (or a predetermined coordinate position) at a constant speed or a determined movement regardless of the movement of the main body 10;
In addition, various non-correlation processes can be mentioned.

  The control device 40 may mainly execute the process shown in FIG. In this case, for example, when it is detected in step 301 that the main body 10 is open, the input device 1 transmits the information to the control device 40 as form information that is operation form information. The control device 40 receives the configuration information, and the MPU 35 of the control device 40 determines, based on the configuration information, what operation mode the main body 10 is currently in, that is, whether the main body 10 is open or closed. Judge either one. Then, the MPU 35 executes either one of generating coordinate information of the pointer in accordance with the movement command or executing the decorrelation process based on which operation mode of the main body 10 is. In this case, the decorrelation process is at least one of 2) to 5) described above. Also in step 304, the input device 1 may similarly transmit the form information to the control device 40.

  FIG. 12 is a block diagram showing an electrical configuration of an input device according to another embodiment of the present invention. In the following description, the same components, functions, and the like included in the input device 1 shown in FIGS. 2 and 3 will be simplified or omitted, and different points will be mainly described.

  The input device 101 includes an operation switch 27 that is turned ON / OFF by a user. The operation switch 27 is, for example, a switch for stopping the decorrelation process and returning the movement process of the pointer 2 while the decorrelation process is being executed while the user opens the main body 10.

  The appearance of the input device 101 may be the same as that of the input device 1 shown in FIGS. The operation switch 27 is typically provided on the inner surface of the main body 10 of the input device 1 according to the above embodiment, but may be provided on the outer surface of the main body 10. The operation switch 27 may be configured by one of a plurality of operation keys 34 or a combination of two or more thereof, or may be a dip switch such as a slide switch or a rotary switch.

  FIG. 13 is a flowchart showing the operation of the input device 101.

  Steps 401 to 404 are the same processes as steps 301 to 304 in FIG.

  In step 405, the MPU 19 determines whether or not the operation switch 27 is turned on by a user operation (step 405). When the operation switch 27 is not turned on, the MPU 19 executes the same processing as steps 305 and 306 in FIG. 11 (steps 406 and 407).

  When the operation switch 27 is turned on, the MPU 19 executes the processing of steps 101 to 104 in FIG. 9 as in step 403 (step 408). That is, the MPU 19 transmits a movement command to move the pointer 2 even when the main body 10 is open. In this case, in a state where the main body 10 is open, the user may hold and operate the main body 10 so that each detection axis of the sensor unit 17 corresponds to the coordinate axis on the screen of the pointer 2. If the user performs an input operation using the operation key 34 with the main body 10 open (YES in step 409), the MPU 19 generates a command corresponding to the input operation (step 410), and is necessary. Send this in response.

  When the operation switch 27 is turned off (YES in step 411), the process returns to step 406.

  Thus, even when the main body 10 is being opened, when the user turns on the operation switch 27, a pointing operation is possible, and convenience is improved.

  The control device 40 may mainly execute the processing shown in FIG. In this case, for example, the control device 40 may execute the decorrelation process in step 402. In this case, in steps 401 and 404, the input device 101 may transmit the form information to the control device 40. In steps 405 and 411, information on ON / OFF of the operation switch of the input device 101 is transmitted to the control device 40, and the control device 40 receives the information and generates the coordinates of the pointer 2 based on the information. Any one of the decorrelation processes may be executed.

  In the input device 101 according to the embodiment shown in FIGS. 12 and 13, as described above, the main body 10 is set so that the user corresponds to the detection axes of the sensor unit 17 and the coordinate axes of the pointer 2 on the screen. We explained the case of operating by holding. However, as described below, there is also an embodiment in which the detection axis is shifted by software.

  FIG. 14 is a perspective view showing a sensor unit according to another embodiment. FIG. 15 is a block diagram showing an electrical configuration of the input device 201 including the sensor unit 117.

  The sensor unit 117 shown in FIG. 14 differs from the sensor unit 17 in that the acceleration sensor unit 116 has a triaxial acceleration sensor and the angular velocity sensor unit 115 has a triaxial angular velocity sensor. . That is, the acceleration sensor unit 116 has an acceleration sensor that detects acceleration in the Z′-axis direction, which is not included in the acceleration sensor unit 16. Further, the angular velocity sensor unit 115 has an angular velocity sensor that detects an angular velocity in the roll direction around the Z ′ axis, which is not included in the angular velocity sensor unit 15. 6A and 6B, the angular velocity sensor unit 115 is mounted on the surface of the circuit board 25 opposite to the surface on which the acceleration sensor unit 116 is mounted.

  As shown in FIG. 15, the input device 201 includes the sensor unit 117 and the operation switch 27 described in FIG. The appearance of the input device 201 on which the sensor unit 117 is mounted may be the same as that of the input device 1 shown in FIGS.

  FIG. 17 is a diagram illustrating the relationship between the posture of the screen 3 of the sensor unit 117 and the display device 5 when a pointing operation is performed with the main body 10 of the input device 201 closed. In this case, the Y-axis direction is the vertical upward direction, and the relationship of the sensor unit 117 with respect to the screen 3 is the posture shown in FIGS. 6 (A) and 6 (B).

  FIG. 18 is a diagram illustrating the relationship between the posture of the screen 3 of the sensor unit 117 and the display device 5 when a pointing operation is performed with the main body 10 of the input device 201 open. The X ′ axis and the Z ′ axis in the posture of the sensor unit 117 shown in FIG. 17 correspond to the Z ′ axis and the X ′ axis in the posture of the sensor unit 117 shown in FIG. The Y ′ axis does not change in FIGS. 17 and 18. That is, in FIG. 18, the Z ′ axis and the Y ′ axis correspond to the X axis and the Y axis (see FIG. 6) on the screen 3.

  FIG. 16 is a flowchart showing the operation of the input device 201 when the operation mode is changed by the user.

  Steps 501 to 507 are the same processes as steps 401 to 407 shown in FIG.

  When the operation switch 27 is turned on in step 505, the MPU 19 shifts the detection axis of the sensor unit 117 (step 508). That is, in the operation mode in which the main body 10 is closed, the acceleration sensor unit 116 uses the acceleration sensor in the X′-axis direction to detect the acceleration in the X-axis direction. However, in the operation mode in which the main body 10 is opened, For the detection, an acceleration sensor in the Z′-axis direction is used. In the operation mode in which the main body 10 is closed, the angular velocity sensor around the X ′ axis is used for detecting the angular velocity in the pitch direction around the X axis by the angular velocity sensor unit 115, but the operation mode in which the main body 10 is opened is used. Then, an angular velocity sensor around the Z ′ axis is used for the detection. By shifting the detection axis in this way, the user can perform a pointing operation with the body 10 opened as shown in FIG. 17B with little awareness of the posture of the body 10. (Step 509).

  Steps 509 to 512 are the same processes as steps 409 to 411 shown in FIG. In step 509, the processing of steps 101 to 104 shown in FIG. 9 is executed using the Z ′ axis and the Y ′ axis as detection axes. That is, the angular velocity around the Z ′ axis is set as the angular velocity in the pitch direction, and the acceleration in the Z ′ axis direction is processed as the acceleration in the left-right direction on the screen 3.

  In step 513, when the MPU 19 detects that the main body 10 is closed as shown in FIG. 17A (YES in step 513), the MPU 19 shifts the detection axis of the sensor unit 117 back to the original state. (Step 514). Thereafter, the process returns to step 503.

  The control device 40 may mainly execute the process shown in FIG. In this case, in steps 501, 504, and 513, the input device 201 may transmit the form information to the control device 40. In steps 505 and 512, information on ON / OFF of the operation switch of the input device 201 may be transmitted to the control device 40.

  FIG. 18A is a plan view showing one operation mode of an input device according to another embodiment of the present invention. FIG. 18B is a plan view showing another operation mode of the input device.

  The input device 251 is typically used for a remote controller of a TV or other AV (Audio Visual) device. The electrical configuration of the input device 251 may be that shown in FIG. 5 or FIG. 12, for example.

  The input device 251 includes a main body 210 having an operation unit 114. The first body 231 and the second body 232 of the main body 210 are connected by a hinge portion 233 (see FIG. 18A) so as to be opened and closed. Among the operation units 114, the operation unit 114 provided on the outer surface of the main body 10 includes a determination button 111 and various other buttons 112, 113, 119, and 120. The button 119 is a volume adjustment button, and the button 120 is a TV broadcast wave channel selection button.

  As shown in FIG. 18B, the operation unit 114 provided on the inner surface of the main body 10 among the operation units 114 includes a plurality of operation keys 134. The operation key 134 is an operation key that is less frequently used than the various buttons 111 to 113, 119, and 120 provided on the outer surface of the main body 10 as illustrated in FIG. The plurality of operation keys 134 typically include operation keys for operating the recording / playback device.

  The sensor unit 17 incorporated in the first body 231 may be the same as the sensor unit 17 shown in FIG. 2, FIG. 3, FIG. The sensor unit 17 is arranged in the main body 210 in the same arrangement as the input device 1 shown in FIGS. That is, as described in FIG. 8, when the user grasps the input device 251 in the basic posture, the detection surface of the acceleration sensor unit 16 along the X′-Y ′ axis is substantially along the screen 3. The sensor unit 17 is disposed in the main body 210. In addition, the sensor unit 17 is disposed in the main body 210 so that the hinge axis of the hinge portion 233 is along the X′-axis direction, which is the direction of acceleration detected by the acceleration sensor 161 in the X′-axis direction of the sensor unit 17. ing.

  Using the input device 251 configured in this manner, the user can perform a pointing operation and other various input operations on a TV (or other AV device), a PC, and the like. The input device 251 can execute the processing shown in FIG. 11 or FIG. 13, for example.

  FIG. 19A is a plan view showing one operation mode of the input device according to still another embodiment of the present invention. FIG. 19B is a plan view showing another operation mode of the input device.

  Similar to the input device 251 shown in FIG. 18, the input device 301 is typically used for a TV, other AV (Audio Visual) equipment, and a remote controller of a PC. The electrical configuration of the input device 301 may be any one of the configurations shown in FIGS. 5, 12, and 15, for example.

  The main body 310 has an operation unit 314 including various buttons 311 to 313, 316, and 315 on the outer surface, and a plurality of operation keys 334 on the inner surface. The plurality of operation keys 334 typically have a keyboard arrangement and functions for character input, but are not limited to these arrangements and functions. As shown in FIG. 19B, the main body 310 is configured to be slidable so that the first body 331 and the second body 332 are opened and closed, and a plurality of operation keys are exposed or stored by the opening and closing operation. Or

  The main body 310 incorporates the sensor unit 17 or 117 described above. In addition, the sensor unit 17 or 117 is arranged so that the first body 331 and the second body 332 slide relative to each other in the X′-axis direction, which is the direction of acceleration detected by the acceleration sensor 161 in the X′-axis direction. It is arranged in the main body 310.

  The input device 301 configured as described above can execute any one of the processes shown in the flowcharts of FIGS. 11, 13, and 16.

  FIG. 20A is a plan view showing one operation mode of the input device according to still another embodiment of the present invention. FIG. 20B is a plan view showing another operation mode of the input device.

  As with the input devices 251 and 301 shown in FIGS. 18 and 19, the input device 401 is typically used for a TV, other AV (Audio Visual) equipment, and a PC remote controller.

  FIG. 21 is a block diagram showing an electrical configuration of the input device 401. The input device 401 includes a main body 410 having a touch panel type display 420. The display 420 is controlled by the display control unit 423. The main body 410 is provided with an operation unit 414 including an enter button 411 and other various buttons 413, 415, 416, and the like.

  As shown in FIG. 20B, the display 420 typically displays an operation key having a keyboard layout and functions for character input as a touch panel screen 421. In the operation mode shown in FIG. 20B, the user operates the display 420 with the longitudinal direction of the display 420 facing sideways.

  The main body 410 incorporates the sensor unit 17 described above. The sensor unit 17 is disposed in the main body 410 so that the detection surface of acceleration in the X ′ and Y ′ axis directions substantially follows the screen 3 when the user grasps the main body 410 in the basic posture.

For example, the following means 1) to 4) can be considered as triggers for starting a touch panel mode in which an input operation by a touch operation on the touch panel screen 421 can be performed on the display 420 and ending (releasing) the touch panel mode. .
1) When the user touches the display 420, the touch panel mode is activated. In addition, when the user touches a key for ending displayed on the touch panel screen 421, the touch panel mode ends. Alternatively, an operation button for ending the touch panel mode may be provided on the main body 410.
2) A button for operating the touch panel mode ON / OFF is provided on any of the operation units 414. When the user turns on the switch, the touch panel mode is activated, and when the user turns off the switch, the touch panel mode ends.
3) When the user shakes the main body 410 a predetermined number of times, the touch panel mode starts or ends. When the user shakes the main body 410, the acceleration sensor unit 16 or 116 detects the acceleration corresponding thereto, so that the MPU 19 activates or ends the touch panel mode at that time.
4) When the user changes the main body 410 from the posture of the main body 410 shown in FIG. 20A to the posture of the main body 410 shown in FIG. 20B, the touch panel mode is activated. When the user changes the main body 410 so that the main body 410 illustrated in FIG. 20A changes from the main body 410 illustrated in FIG. 20B to the main body 410, the touch panel mode ends. This is realized by the MPU 19 monitoring the direction of gravity detected by the acceleration sensor in the X′-axis direction of the sensor unit 17. For example, when the user operates the input device 401 in the operation mode illustrated in FIG. 20A in a state where the input device 401 is substantially close to a stationary state instead of the pointing operation, the X′-axis direction is the gravity direction. Are orthogonal, the acceleration in the X′-axis direction is relatively small. On the other hand, when the user operates the input device 401 in the operation mode shown in FIG. 20B in a state where the input device 401 is substantially close to a stationary state instead of the pointing operation, the X′-axis direction is the gravitational direction. Substantially matches. Therefore, when the input device 401 is substantially close to a stationary state, the acceleration in the X′-axis direction is larger in the operation mode shown in FIG. 20B than in the operation mode shown in FIG. Thereby, it is possible to detect the switching of the operation mode.

  In the cases 1) to 4), at least the MPU 19 or at least the MPU 19 and the acceleration sensor in the X′-axis direction function as detection means for detecting triggers for starting and ending the touch panel mode.

  FIG. 22 is a flowchart showing the operation of the input device 401 when the operation mode is changed by the user.

  The main difference between the process shown in FIG. 22 and the process shown in FIG. 11 is that in step 601, it is determined whether or not to activate the touch panel mode, and in step 604, the touch panel mode is changed. The determination of whether or not to end is executed. When there is a user input operation on the touch panel screen 421 (YES in Step 606), the MPU 19 generates a command corresponding to the input operation (Step 607).

  The input device 401 including the touch panel display 420 as described above may include the operation switch 27 illustrated in FIG. 152 and the like, and execute the same processing as the processing illustrated in FIG. Alternatively, the input device 401 may include the sensor unit 117 illustrated in FIG. 15 and the like, and execute the same processing as the processing illustrated in FIG.

  As described in 4) above, a change in posture is detected by a change in acceleration in the X′-axis direction, and the operation mode is switched using this detection as a trigger. This is also applicable to the above-described input device 1 (see FIGS. 2 and 3), 101, 151, 201, and 301 (see FIG. 19).

  The control device 40 may mainly execute the process shown in FIG. In this case, in steps 601 and 604, the input device 401 may transmit to the control device 40 form information indicating whether or not the input device 401 is currently in the touch panel mode operation form.

  FIG. 23 is a plan view showing an input device according to still another embodiment of the present invention.

  The input device 451 includes a main body 460 having a first surface 461 and a second surface 462. A determination button 471, other buttons 472, and the like are provided on the first surface 461 of the main body 460. Various buttons or operation keys 474 are also provided on the second surface 462 of the main body 460. In addition, the sensor unit 17 is built in the main body 460.

  The sensor unit 17 may be the same as the sensor unit 17 shown in FIG. The sensor unit 17 is disposed in the main body 460 so that the X′-Y ′ detection surface including the X ′ axis and the Y ′ axis is orthogonal to both the first surface 461 and the second surface 462. Yes. The user performs a pointing operation by grasping the main body 460 of the input device 451 so that the X′-Y ′ detection surface is substantially along the screen 3.

  FIG. 24A is a diagram illustrating the posture of the sensor unit 17 with respect to the screen 3 when the input device 451 is operated by the user in one operation mode. FIG. 24B is a diagram illustrating the posture of the sensor unit 17 with respect to the screen 3 when the input device 451 is operated by the user in another operation mode.

  FIG. 24B shows a state in which the user has rotated the main body 460 about 90 ° around the Z axis from the posture of the input device 451 shown in FIG. By rotating the main body 460 by 90 ° in this manner, the user can operate the operation key 474 with the second surface 462 facing upward, for example. The operation keys 474 and the like are buttons for inputting characters, numbers, and other symbols, for example, but are not limited thereto.

  The posture change of the main body 460 may be detected by a switch operated by a user or a change in gravity acceleration on the Y ′ axis as described in 4) in the input device 401.

  As described above, when the main body 460 is rotated by 90 °, the detection axes of the X ′ axis and the Y ′ axis are interchanged. That is, in the posture shown in FIG. 20B, the X′-axis direction corresponds to the vertical direction (Y-axis direction) on the screen 3, and the Y′-axis direction corresponds to the horizontal direction (X-axis direction) on the screen 3. It is only necessary to generate such a movement command.

  As a process of the MPU 19, when the user operates the above switch or when a change in posture of the main body 460 is detected by any one of changes in gravitational acceleration, the MPU 19 stops transmitting the movement command, and the sensor The detection axis of the unit 17 is shifted. For example, when the operation switch 27 (see FIGS. 12 and 15 and the like) is turned ON, the MPU 19 acquires the acceleration and angular velocity of the main body 460 using the detection axis after the shift, and generates based on them. The moved command may be transmitted to the control device 40.

Hereinafter, a method of calculating the velocity values (V _x , V _y ) in step 103 in FIG. 9 and step 205 in FIG. 10 will be described. FIG. 25 is a flowchart showing the operation of the input device 1 (the control device 40 in FIG. 10). FIG. 26 is a diagram for explaining the basic concept of this speed value calculation method.

  FIG. 26 is a view of the user who operates the input device 1 while swinging the input device 1 in the left-right direction (yaw direction), for example. As shown in FIG. 26, when the user operates the input device 1 naturally, the input device 1 is operated by at least one of wrist rotation, elbow rotation, and arm base rotation. Therefore, when comparing the movement of the input device 1 with the rotation of the wrist, elbow and arm base, the following 1.2. It can be seen that there is a relationship.

1. The angular velocity value ω _ψ around the Y-axis of the portion where the acceleration sensor unit 16 of the input device 1 is disposed (hereinafter referred to as the tip) is the angular velocity due to the wrist rotation, the angular velocity due to the elbow rotation, and the angular velocity due to the rotation of the base of the arm. Is a composite value of
2. Yaw direction of the velocity values V _x of the tip of the input device 1, wrists, elbows, and the base of the angular velocity of the arm, respectively, the distance between the wrist and the distal end portion, the distance between the elbow and the tip portion, and the base of the arm This is a composite value obtained by multiplying the distance from the tip.

Here, regarding the rotational movement of the input device 1 in a minute time, the input device 1 is parallel to the Y axis, and a central axis (first central axis or second central axis) whose position changes with time. Can be thought of as rotating around. When the distance between the central axis whose position changes with time and the tip of the input device 1 is the rotation radius R _ψ (t) around the Y axis (first rotation radius or second rotation radius) The relationship between the velocity value V _x at the tip of the input device 1 and the angular velocity value ω _ψ is expressed by the following equation (3). That is, the velocity value V _x in the yaw direction is a value obtained by multiplying the angular velocity value ω _ψ about the Y axis by the distance R _ψ (t) between the central axis and the tip. In the present embodiment, the acceleration sensor unit 16 and the angular velocity sensor unit 15 are integrally disposed on the circuit board 25 of the sensor unit 17. Accordingly, the rotation radius R (t) is the distance from the central axis to the sensor unit 17. However, when the acceleration sensor unit 16 and the angular velocity sensor unit 15 are arranged apart from each other in the main body 10, as described above, the distance from the central axis to the acceleration sensor unit 16 is the rotation radius R (t). Become.

V _x = R _ψ (t) · ω _ψ (3).

  As shown in Expression (3), the relationship between the velocity value at the tip of the input device 1 and the angular velocity value is a proportional relationship, that is, a correlation with a proportional constant R (t).

Equation (3) is modified to obtain equation (4).
R _ψ (t) = V _x / ω _ψ (4).

  The right side of Equation (4) is the speed dimension. The correlation is not lost even if the velocity value and the angular velocity value represented on the right side of the equation (4) are differentiated to obtain a dimension of acceleration or a time change rate of acceleration. Similarly, the correlation is not lost even if the velocity value and the angular velocity value are respectively integrated to obtain a displacement dimension.

  Therefore, the following equations (5), (6), and (7) are obtained by using the velocity and angular velocity represented on the right side of equation (4) as the dimensions of displacement, acceleration, and acceleration time change rate, respectively.

R _ψ (t) = x / ψ (5)
R _ψ (t) = a _x / Δω _ψ (6)
R _ψ (t) = Δa _x / Δ (Δω _ψ ) (7).

Of the above formulas (4), (5), (6), and (7), for example, paying attention to formula (6), if the acceleration value a _x and the angular velocity value Δω _ψ are known, the radius of rotation R _ψ ( It can be seen that t) is required. As described above, the first acceleration sensor 161 detects an acceleration value a _x in the yaw direction, the first angular velocity sensor 151 detects an angular velocity value omega _[psi about the Y axis. Therefore, if the angular velocity value ω _ψ around the Y axis is differentiated and the angular acceleration value Δω _ψ around the Y axis is calculated, the turning radius R _ψ (t) around the Y axis can be obtained.

If the rotation radius R _ψ (t) around the Y axis is known, the rotation radius R _ψ (t) is multiplied by the angular velocity value ω _ψ around the Y axis detected by the first angular velocity sensor 151. Then, the velocity value V _{x in} the X-axis direction of the input device 1 is obtained (see formula (3)). That is, the operation amount itself of the user's rotation is converted into a linear velocity value in the X-axis direction and becomes a velocity value that matches the user's intuition. Therefore, since the movement of the pointer 2 becomes a natural movement with respect to the movement of the input device 1, the operability of the input device by the user is improved.

  This speed value calculation method can also be applied when the user operates the input device 1 by swinging it in the vertical direction (pitch direction).

In FIG. 25, an example in which Expression (6) is used will be described. Referring to FIG. 25, MPU 19 of input device 1 calculates angular acceleration values (Δω _ψ , Δω _θ ) by differentiating the angular velocity values (ω _ψ , ω _θ ) acquired in step 101 (step 701).

The MPU 19 uses the acceleration values (a _x , a _y ) and the angular acceleration values (Δω _ψ , Δω _θ ) acquired in step 102, respectively, around the Y axis and X according to equations (6) and (8), respectively. A rotation radius (R _ψ (t), R _θ (t)) around the axis is calculated (step 702).
R _ψ (t) = a _x / Δω _ψ (6)
R _θ (t) = a _y / Δω _θ (8).

When the radius of rotation is calculated, the velocity values (V _x , V _y ) are calculated using equations (3) and (9) (step 703).

V _x = R _ψ (t) · ω _ψ (3)
V _y = R _θ (t) · ω _θ (9)
As described above, the operation amount of the rotation of the input device 1 by the user is converted into linear velocity values in the X-axis and Y-axis directions, and the velocity value matches the user's intuition.

Further, since the acceleration values (a _x , a _y ) detected by the acceleration sensor unit 16 are used as they are, the calculation amount is reduced, and the power consumption of the input device 1 can be reduced.

The MPU 19 may acquire (a _x , a _y ) for each predetermined clock from the acceleration sensor unit 16 and calculate velocity values (V _x , V _y ) so as to synchronize with it. Alternatively, the MPU 19 may calculate the velocity value (V _x , V _y ) once for each sample of the plurality of acceleration values (a _x , a _y ).

Next, as in FIG. 25, another embodiment in which the velocity values (V _x , V _y ) are calculated using the rotation radius will be described. FIG. 27 is a flowchart showing the operation of the input device 1. In FIG. 27, an example in which the above equation (7) is used will be described.

Referring to FIG. 27, the MPU 19 of the input device 1 performs a differentiation operation on the acquired acceleration values (a _x , a _y ). Thereby, the time change rate (Δa _x , Δa _y ) of acceleration is calculated (step 801). Similarly, the MPU 19 performs a second-order differential operation on the acquired angular acceleration values (ω _ψ , ω _θ ) to obtain the angular acceleration time change rates (Δ (Δω _ψ )) and Δ (Δω _θ )). Calculate (step 802).

When the time rate of change in angular velocity is calculated, the MPU 19 determines whether or not the absolute value | Δ (Δω _θ ) | of the time rate of change in angular acceleration around the Y axis exceeds a threshold th1 (step 803). . The | Δ (Δω _θ) | when exceeding the threshold value th1, the MPU 19 is the time rate of change .DELTA.a _x of the acceleration in the X-axis direction, divided by the time rate of change of angular velocity about the Y axis Δ (Δω _θ) Thus, the rotation radius R _ψ (t) around the Y axis is calculated (step 804). That is, the time rate of change .DELTA.a _x of the acceleration in the X-axis direction, calculates the ratio between the time rate of change of the angular velocity around the Y-axis delta ([Delta] [omega _theta) as the rotation radius R _[psi (t) (Equation (7)). The threshold value th1 of | Δ (Δω _θ ) | can be set as appropriate.

The signal of the rotation radius R _ψ (t) is passed through, for example, a low-pass filter (step 805). Information on the radius of rotation R _ψ (t) from which high-frequency noise has been removed by the low-pass filter is stored in the memory (step 806). In this memory, the signal of the rotation radius R _ψ (t) is updated and stored every predetermined clock.

The MPU 19 of the input device 1 calculates the velocity value V _x in the X-axis direction by multiplying the rotation radius R _ψ (t) by the angular velocity value ω _θ around the Y-axis (step 808).

On the other hand, when the above | Δ (Δω _θ ) | is equal to or less than the threshold th1, the MPU 19 reads the turning radius R _ψ (t) stored in the memory (step 807). The read rotation radius R _ψ (t) is multiplied by the angular velocity value ω _θ around the Y axis to calculate the velocity value V _x in the X axis direction (step 808).

  There are the following two reasons why the processes in steps 801 to 808 are performed.

One is to obtain the linear velocity that matches the user's intuition by _obtaining the rotation radius R _ψ (t) of the above equation (7).

The second is to remove the influence of gravity in the process of calculating the velocity values (V _x , V _y ). When the input device 1 is tilted from the basic posture in the roll direction or the pitch direction, a detection signal different from the actual movement of the input device 1 is output due to the influence of gravity. For example, when the input device 1 is tilted in the pitch direction, the acceleration sensor 162 outputs a gravity acceleration component value. Therefore, when the influence of each component value of the gravitational acceleration is not removed, the movement of the pointer 2 becomes a movement that does not match the user's sense.

  FIG. 28 is a diagram for explaining the influence of gravity on the acceleration sensor unit 16. FIG. 28 is a diagram of the input device 1 as viewed in the Z direction.

  In FIG. 28A, it is assumed that the input device 1 is in the basic posture and is stationary. At this time, the output of the first acceleration sensor 161 is substantially 0, and the output of the second acceleration sensor 162 is an output corresponding to the gravitational acceleration G. However, as shown in FIG. 28B, for example, when the input device 1 is tilted in the roll direction, the first and second acceleration sensors 161 and 162 indicate the acceleration values of the respective gradient components of the gravitational acceleration G. To detect.

  In this case, in particular, the first acceleration sensor 161 detects the acceleration in the X-axis direction even though the input device 1 does not actually move in the X-axis direction. In the state shown in FIG. 28 (B), when the input device 1 is in the basic posture as shown in FIG. 28 (C), the acceleration sensor unit 16 receives inertial forces Ix and Iy as indicated by broken arrows. This is equivalent to the state and is indistinguishable for the acceleration sensor unit 16. As a result, the acceleration sensor unit 16 determines that the acceleration in the diagonally downward direction to the left as indicated by the arrow is applied to the input device 1 and outputs a detection signal different from the actual movement of the input device 1. Moreover, since the gravitational acceleration G always acts on the acceleration sensor unit 16, the integral value of acceleration for obtaining the speed from the acceleration increases, and the amount of the pointer 2 displaced obliquely increases in an accelerated manner. When the state transitions from FIG. 28A to FIG. 28B, it can be said that the operation that suits the user's intuition is to prevent the pointer 2 on the screen 3 from moving.

  FIG. 29 is a diagram for explaining the influence of gravitational acceleration when the input device 1 is swung in the pitch direction, and is a diagram of the input device 1 viewed in the X direction.

  For example, when the input device 1 is rotated in the pitch direction and tilted as shown in FIG. 29B from the basic posture state of the input device 1 as shown in FIG. The gravitational acceleration G detected by the second acceleration sensor 162 when in the posture decreases. As shown in FIG. 29C, the input device 1 cannot be distinguished from the inertia force I in the upper pitch direction.

  Therefore, the time change rate of the component value of the gravitational acceleration generated by the movement of the input device 1 is higher than the time change rate of the acceleration value paying attention to the movement inertia component (only movement) of the input device 1 by the user's operation. Take advantage of small things. The time change rate of the component value of the gravitational acceleration is on the order of 1/10 of the time change rate of the moving inertia component value by the user's operation. The value output from the acceleration sensor unit 16 is a value obtained by synthesizing both of them. That is, the signal output from the acceleration sensor unit 16 is the gravitational acceleration in the rate of change of the moving inertia component value by the user's operation. This is a signal on which a low-frequency component value that is a component value is superimposed.

  Therefore, in step 801, the acceleration value is subjected to differential calculation to obtain the time change rate of the acceleration, thereby removing the time change rate of the gravity acceleration component value. Thereby, even if the change in the component force of the gravitational acceleration due to the inclination of the input device 1 occurs, the turning radius can be obtained appropriately, and an appropriate speed value can be calculated from this turning radius.

  The low frequency component value may include, for example, a temperature drift of the acceleration sensor unit 16 or a DC offset value in addition to the gravity acceleration component value.

In the present embodiment, since Equation (7) is used, in step 802, the angular velocity value ω _θ is second-order differentiated, and noise in a high frequency range is added to the calculated value of the angular velocity. If this | Δ (Δω _θ ) | is large, there is no problem, but if it is small, the S / N deteriorates. If | Δ (Δω _θ ) | in which S / N deteriorates is used for calculation of R _ψ (t) in step 808, the accuracy of R _ψ (t) and the velocity value V _x deteriorates.

Therefore, in step 803, the temporal rate of change Δ (Δω _θ ) of the angular velocity around the Y axis calculated in step 802 is used. When Δ (Δω _θ ) is equal to or smaller than the threshold th1, the rotation radius R _ψ (t) with less noise previously stored in the memory is read (step 807), and the read rotation radius R _ψ (t) is This is used for calculating the velocity value V _x in step 808.

In steps 809 to 814, the MPU 19 calculates the velocity value V _y in the Y-axis direction, as in the processes from the above steps 803 to 808. That is, the MPU 19 determines whether or not the absolute value | Δ (Δω _θ ) | of the angular velocity around the X axis exceeds the threshold value th1 (step 809). A rotation radius R _θ (t) around the X axis is calculated using the time rate of change of the angular velocity (step 810).

The signal of the rotation radius R _θ (t) is passed through the low-pass filter (step 811) and stored in the memory (step 812). If it is equal to or smaller than the threshold th1, the turning radius R _θ (t) stored in the memory is read (step 813), and the velocity value V _{y in the} pitch direction is calculated based on the turning radius R _θ (t). (Step 814).

  In the present embodiment, the threshold value is set to the same value th1 in both the yaw direction and the pitch direction, but different threshold values may be used in both directions.

In step 803, instead of Δ (Δω _θ ), the angular acceleration value (Δω _θ ) may be determined based on a threshold value. Similarly, in step 809, instead of Δ (Δω _ψ ), the angular acceleration value (Δω _ψ ) may be determined based on the threshold value. In the flowchart shown in FIG. 27, equation (7) is used to calculate the radius of rotation R (t), but when equation (6) is used, angular acceleration values (Δω _ψ , Δω _θ ) are calculated. Therefore, the angular acceleration values (Δω _ψ , Δω _θ ) may be determined based on the threshold value.

  Embodiments according to the present invention are not limited to the embodiments described above, and other various embodiments are conceivable.

  Although the input device according to each of the above embodiments has shown a form in which input information is wirelessly transmitted to the control device, the input information may be transmitted by wire.

  In each of the above embodiments, the UI that moves on the screen in accordance with the movement of the input device has been described as a pointer. However, the UI is not limited to the pointer, and may be a character image or another image.

  Instead of the operation switch 27, the input devices 101 and 201 or the control device 40 may include a program using a GUI having the same function as the function of the operation switch 27. In this case, for example, the user may perform a switch ON / OFF operation using the GUI.

  The detection axes of the angular velocity sensor unit 15 and the acceleration sensor unit 16 of the sensor unit 17 do not necessarily have to be orthogonal to each other like the X ′ axis and the Y ′ axis described above. In that case, the respective accelerations projected in the axial directions orthogonal to each other are obtained by calculation using trigonometric functions. Similarly, the angular velocities around the mutually orthogonal axes can be obtained by calculation using trigonometric functions.

  Instead of the input devices 1, 251, and 301, an input device including a main body in which the first body and the second body rotate relatively with the Y′-axis direction as a rotation axis may be used. In this case, typically, the ends of the first body and the second body are connected to each other by a connection mechanism having the rotation shaft. In such an embodiment, the operation mode of the main body when the relative rotation angle of the first and second bodies is at the first rotation angle corresponds to the first operation mode. The operation mode of the main body when the first and second bodies are at a second rotation angle different from the first rotation angle corresponds to the second operation mode.

The input device 1 (or the input devices 101, 201, 251, 301, 401 shown in the other embodiments, hereinafter referred to as the input device 1, etc.) includes, for example, the acceleration sensor unit 16 or 116, and the angular velocity sensor unit. A configuration without 15 or 115 is also conceivable. In this case, the velocity values (V _x , V _y ) are obtained in step 103 by integrating the acceleration values (a _x , a _y ) detected by the acceleration sensor unit 16. However, in this case, angular velocities (ω _ψ , ω _θ ) around the Y and X axes cannot be obtained. Instead of the acceleration sensor unit 16, the acceleration may be calculated by an image sensor.

In FIG. 25, the calculation method of the velocity values (V _x , V _y ) is shown. Without being limited to these methods, the MPU 19 may calculate velocity values (V _x , V _y ) corresponding to the angular velocity values detected by the angular velocity sensor unit 15. For example, the velocity value corresponding to the angular velocity value is a velocity value calculated by a predetermined arithmetic expression (a function of the angular velocity value and the velocity value) or a velocity value read from the memory using a lookup table. In this case, the acceleration values (a _x , a _y ) obtained by the acceleration sensor unit 16 need not be used.

  Instead of the angular velocity sensor unit 15, an angle sensor or an angular acceleration sensor may be used. Examples of the angle sensor include a geomagnetic sensor and an image sensor. For example, when a three-axis geomagnetic sensor is used, the amount of change in the angle value is detected. In this case, the angular velocity value is obtained by differentially calculating the angle value. The angular acceleration sensor is configured by a combination of a plurality of acceleration sensors, and an angular velocity value is obtained by integrating the angular acceleration value obtained by the angular acceleration sensor. In the meaning of these embodiments, the MPU 19 or 35 mainly functions as a calculation unit that outputs an angle-related value as a value related to an angle.

For example, in the case of calculating the rotation radius R (t) as described above, the angular acceleration sensor that detects angular acceleration around the Y ′ axis and the X ′ axis, or a sensor that detects an angle may be used. In this case, the angular velocity values (ω _ψ , ω _θ ) are obtained by integrating the angular acceleration values detected by the angular acceleration sensor. Alternatively, the angular velocity values (ω _ψ , ω _θ ) are obtained by differentiating the angle values detected by the angle sensor.

It is a figure which shows the control system which concerns on one embodiment of this invention. (A) is a top view which shows an input device, (B) is the side view. It is a top view which shows the state which the input device opened. It is a figure which shows typically the internal structure of an input device. It is a block diagram which shows the electric constitution of an input device. It is a perspective view which shows a sensor unit. It is a figure which shows the example of the screen displayed on a display apparatus. It is a figure which shows a mode that the user grasped the input device. It is a flowchart which shows operation | movement of a control system. It is a flowchart which shows operation | movement of a controlled system when a control apparatus performs main calculation. It is a flowchart which shows operation | movement of an input device when a user opens and closes the main body of an input device. It is a block diagram which shows the electric constitution of the input device which concerns on other embodiment of this invention. 13 is a flowchart showing an operation of the input device shown in FIG. It is a perspective view which shows the sensor unit which concerns on other embodiment. It is a block diagram which shows the electric constitution of an input device provided with the sensor unit shown in FIG. FIG. 16 is a flowchart showing an operation of the input device shown in FIG. 15 when an operation form is changed by a user. It is a figure for demonstrating the form which the detection axis | shaft of a sensor unit shifts. (A) is a top view which shows one operation form of the input device which concerns on other embodiment of this invention. (B) is a top view which shows the other operation form of the input device. (A) is a top view which shows one operation form of the input device which concerns on another embodiment of this invention. (B) is a top view which shows the other operation form of the input device. (A) is a top view which shows one operation form of the input device which concerns on another embodiment of this invention. (B) is a top view which shows the other operation form of the input device. FIG. 21 is a block diagram showing an electrical configuration of the input device shown in FIG. 20. FIG. 21 is a flowchart showing an operation of the input device shown in FIG. 20 when an operation form is changed by a user. It is a top view which shows the input device which concerns on another embodiment of this invention. (A) is a figure which shows the attitude | position of the sensor unit with respect to a screen when the input device shown in FIG. 23 is operated by the user with one operation form. (B) is a figure which shows the attitude | position of the sensor unit with respect to a screen when the input device is operated by the user with another operation form. It is a flowchart which shows operation | movement of the input device about one Embodiment of the calculation method of a speed value. It is a figure for demonstrating the basic view of the calculation method of a speed value. It is a flowchart which shows operation | movement of the input device about other embodiment which calculates a speed value using a turning radius. It is a figure for demonstrating the influence of the gravity on an acceleration sensor unit. It is a figure for demonstrating the influence of gravitational acceleration when an input device is shaken in the pitch direction, and is the figure which looked at the input device in the X direction.

Explanation of symbols

1, 101, 201, 251, 301, 401, 451... Input device (handheld information processing apparatus)
2 ... Pointer 3 ... Screen 10, 210, 310, 410, 460 ... Main body 14, 114, 314, 414 ... Operation unit 17, 117 ... Sensor unit 19 ... MPU
26 ... Switching detector 27 ... Operation switch 30 ... Control unit 31, 231, 331 ... First body 32, 232, 332 ... Second body 33, 233 ... Hinge part 34, 134, 334, 474 ... Operation key 40 ... Control device 100 ... Control system 420 ... Display 421 ... Touch panel screen

Claims (20)

A main body operated by a user in a first operation form and a second operation form different from the first operation form;
Output means for outputting a movement command for moving the UI displayed on the screen according to the movement of the main body;
Detecting means for detecting switching between the first operation mode and the second operation mode of the main body;
When the main body is operated in the first operation mode, the movement command is output by the output means to move the UI on the screen, and the main body is operated in the second operation mode. And a control unit that executes a decorrelation process for making the UI state on the screen uncorrelated with the movement of the main body. The handheld information processing apparatus according to claim 1,
The body is
An operation key operated by the user;
A storage mechanism for storing the operation keys;
In the detection means, a mode in which the operation key is stored by the storage mechanism is defined as the first operation mode, and a mode in which the operation key is exposed without being stored by the storage mechanism is defined as the second operation mode. A hand-held information processing apparatus that detects the switching. The handheld information processing apparatus according to claim 2,
The body has a switch,
The control means stops the decorrelation process when there is an input operation by the switch by the user while the main body is operated in the second operation mode and the decorrelation process is being executed. A hand-held information processing apparatus that causes the output unit to output the movement command to move the UI on the screen. The handheld information processing apparatus according to claim 1,
The body is
A first body;
A second body;
A connection mechanism for connecting the first body and the second body so that the first body and the second body move relative to each other;
The detection means uses the state in which the first body and the second body are in a first relative position as the first operation mode, and the first body and the second body are in a first relative position. A hand-held information processing apparatus that detects the switching by using a state at a second relative position different from a position as the second operation mode. The handheld information processing apparatus according to claim 1,
The main body has a touch panel type display capable of displaying a touch panel screen,
The detection means detects the switching with the form in which the user can perform a touch operation via the touch panel screen as the second operation form and the form in which the touch operation is released as the first operation form. The handheld information processing apparatus according to claim 1,
The main body is operated by the user in a first posture in the first operation mode, and is operated in a second posture different from the first posture in the second operation mode. apparatus. The handheld information processing apparatus according to claim 6,
The output means includes an acceleration sensor that detects acceleration of the main body,
The detection means detects the switching according to a change in gravitational acceleration detected by the acceleration sensor. The handheld information processing apparatus according to claim 3,
The output means includes a sensor having a first detection axis and a second detection axis, and the movement of the main body in both the first direction and the second direction different from the first direction by the sensor. A first movement command according to a movement of the main body in the first direction for detecting the movement of the UI along an axis on the screen corresponding to the first direction; and A second movement command corresponding to the movement of the main body in the second direction for moving the UI along an axis on the screen corresponding to the second direction. Output as a handheld information processing device. The handheld information processing apparatus according to claim 8,
When the main body is operated in the first operation mode, the control means detects the movement of the main body in the first and second directions with the first and second detection axes, respectively. When the output means outputs the first and second movement commands corresponding to the detected movement of the main body, and the main body is operated in the second operation mode, the first The movement of the main body in the direction is detected by the second detection axis, and the first movement command corresponding to the movement of the main body detected by the second detection axis is output by the output means. Processing equipment. The handheld information processing apparatus according to claim 8,
The sensor has a third detection axis;
When the main body is operated in the first operation mode, the control means detects the movement of the main body in the first and second directions with the first and second detection axes, respectively. When the output means outputs the first and second movement commands corresponding to the detected movement of the main body, and the main body is operated in the second operation mode, the first and second The movement of the main body in the second direction is detected by the second and third detection axes, and the output means outputs the first and second movement commands according to the detected movement of the main body. A hand-held information processing device that outputs the data. The handheld information processing apparatus according to claim 8,
The body is
A first body;
A second body;
A hand-held information processing apparatus comprising: a connection mechanism that connects the first body and the second body so that the first body and the second body move relatively. The handheld information processing apparatus according to claim 11,
The hand-held information processing apparatus, wherein the connection mechanism has a hinge axis along the first detection axis for opening and closing the second body with respect to the first body. The handheld information processing apparatus according to claim 11,
The connection mechanism includes a slide mechanism that slides the second body in a direction along the first detection axis with respect to the first body. The handheld information processing apparatus according to claim 11,
The connection mechanism has a rotation mechanism having a rotation axis in a direction along the second detection axis, and rotating the second body with the rotation axis with respect to the first body. . A main body operated by a user in a first operation form and a second operation form different from the first operation form;
A sensor having a first detection axis and a second detection axis, wherein the sensor detects movement of the main body in both the first direction and a second direction different from the first direction, A first movement command according to the movement of the main body in the first direction, and a second movement direction in order to move the UI along an axis on the screen corresponding to the first direction; Output means for outputting a second movement command corresponding to the movement of the main body in the second direction for moving the UI along the corresponding axis on the screen;
Detecting means for detecting switching between the first operation mode and the second operation mode of the main body;
When the main body is operated in the first operation mode, movements of the main body in the first and second directions are detected by the first and second detection axes, respectively. The output means outputs the first and second movement commands corresponding to the movement of the main body detected by the second detection axis, and the main body is operated in the second operation mode. In this case, the movement of the main body in the first direction is detected by the second detection axis, and the first movement command corresponding to the movement of the main body detected by the second detection axis is output. A hand-held information processing apparatus comprising: control means for outputting by the means. A main body operated by a user in a first operation form and a second operation form different from the first operation form, an output means for outputting a movement command corresponding to the movement of the main body, and the first of the main body Morphological information, which is information indicating whether the main body is operated in one of the first operation form and the second operation form, when switching between one operation form and the second operation form is detected. A control device that controls the movement of a UI displayed on a screen based on the movement command and the configuration information output from a handheld information processing device including output configuration information output means;
Receiving means for receiving the movement command and the configuration information;
A determination means for determining whether the main body is operated in one of the first operation form and the second operation form based on the form information;
Generation of generating coordinate information of the UI on the screen based on the received movement command to move the UI on the screen when the main body is operated in the first operation mode Means,
Execution means for executing decorrelation processing for making the state of the UI on the screen uncorrelated with the movement of the body when the body is operated in the second operation mode. Control device. A main body operated by a user in a first operation form and a second operation form different from the first operation form;
Output means for outputting a movement command for moving the UI displayed on the screen according to the movement of the main body;
Detecting means for detecting switching between the first operation mode and the second operation mode of the main body;
When the main body is operated in the first operation mode, the movement command is output by the output means to move the UI on the screen, and the main body is operated in the second operation mode. A handheld information processing apparatus having control means for executing a decorrelation process for making the UI state on the screen uncorrelated with the movement of the main body;
Receiving means for receiving the movement command;
A control system comprising: a generation unit configured to generate coordinate information of the UI on the screen in order to move the UI on the screen based on the received movement command. A main body operated by a user in a first operation form and a second operation form different from the first operation form;
Output means for outputting a movement command according to the movement of the main body;
Information on whether the main body is operated in one of the first operation form and the second operation form is detected by detecting switching between the first operation form and the second operation form of the main body. A handheld information processing apparatus having morphological information output means for outputting morphological information,
Receiving means for receiving the movement command and the configuration information;
A determination means for determining whether the main body is operated in one of the first operation form and the second operation form based on the form information;
Generation of generating coordinate information of the UI on the screen based on the received movement command to move the UI on the screen when the main body is operated in the first operation mode Means,
And executing means for executing a decorrelation process for making the UI state on the screen uncorrelated with the movement of the body when the body is operated in the second operation mode. A control system comprising a control device. The UI displayed on the screen is moved in accordance with the movement of the main body operated by the user in the first operation form and the second operation form different from the first operation form by the handheld information processing apparatus. Output a move command for
By detecting the switching between the first operation mode and the second operation mode of the main body by a handheld information processing device,
When the main body is operated in the first operation mode, the movement command is output to move the UI on the screen by a handheld information processing device,
When the main body is operated in the second operation mode, a hand-held information processing device performs a decorrelation process for making the UI state on the screen uncorrelated with the movement of the main body. Control method to execute. A main body operated by a user in a first operation form and a second operation form different from the first operation form, an output means for outputting a movement command corresponding to the movement of the main body, and the first of the main body Morphological information, which is information indicating whether the main body is operated in one of the first operation form and the second operation form, when switching between one operation form and the second operation form is detected. A control method for a control device that controls movement of a UI displayed on a screen based on the movement command and the configuration information output from a handheld information processing device including output configuration information output means,
Receiving the movement command and the form information;
Based on the form information, determine whether the main body is operated in the first operation form or the second operation form,
When the main body is operated in the first operation mode, in order to move the UI on the screen, the coordinate information of the UI on the screen is generated based on the received movement command,
When the main body is operated in the second operation mode, a control method for executing a decorrelation process for making the UI state on the screen uncorrelated with the movement of the main body.

Images