JP2004171520A - Operation instruction device, operation instruction method, and operation instruction program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an operation instruction device complying with the physical exercise ability of a user. <P>SOLUTION: The operation instruction device comprises a sensor 201 placed in a device main body at approximately its center and detecting the physical exercise value of the device body. The user holds the device to conduct motion instructed by a motion contents instruction section 202 in the initial setting mode. The physical exercise value detected by the sensor 201 is normalized by a motion analysis section 203. The motion detection regions of the individual user are set by a motion detection region setting section 204. An operation contents allocation section 205 acquires the operation instruction contents by the function of the device to generate an operation instruction table allocated to each operation instruction content at each region of the motion detection regions. An operation determination section 206 determines whether the physical exercise value informed from the operation analysis section 203 is located in any region of the motion detection regions or not and outputs the allocated operation instruction contents to the device. <P>COPYRIGHT: (C)2004,JPO

Description

  The present invention relates to an operation instruction device that outputs an operation instruction to a built-in portable information device.

  2. Description of the Related Art In recent years, miniaturization of portable information devices such as cellular phones has progressed, and the screen display area has become narrower, and the display content that can be displayed on one entire screen has to be limited. On the other hand, mobile phones and the like have more functions and the number of menu items is 100 or more. Therefore, the menu items have a complicated hierarchical structure. The user needs to repeat a complicated button operation and select an intended menu item.

For this reason, as a method of complementing this complicated button operation, for example, a technique described in Patent Document 1 has been proposed. In this technique, the movement of the information processing apparatus main body based on a user's operation is detected, and the display content of a display screen is switched to enlarge or reduce according to the movement direction and the movement amount.
Further, for example, Patent Literature 2 discloses a technique of performing an operation instruction such as switching display contents of a display screen of a portable information device by distinguishing types of a user operation such as “shake” and “hit”.

In the above two conventional techniques, the exercise value of the portable information device is detected, and the contents of the display screen and the like are switched according to the exercise value. The motion value is fixedly determined in advance.
JP-A-6-4208 USP 6,369,794

  However, there is an individual difference in the user's operation, and the exercise value detected in the operation of the elderly with weak power is too small, the exercise value is determined to be an error, and the content of a predetermined display screen or the like may be switched. Can not. Further, if the user operation is too strong, it is detected as a malfunction due to dropping or dropping of the portable information device, and similarly, the contents of a predetermined display screen or the like cannot be switched.

In addition, even if the user is an individual, he or she is good at moving, and moving right and left may have a large exercise value, but swinging back and forth may have a small exercise value.
The display contents of the display screen are switched when swung right and left, but the display contents may not be switched when swung back and forth.
The present invention has been made in view of the above problems, and provides an operation instruction device and a method thereof that can output a correct operation instruction to a portable information device main body in consideration of the strength or ability of a different operation for each user. The purpose is to provide.

In order to solve the above problem, the present invention is based on a motion value detected due to a specific motion of a specific user, a motion detection region setting means for setting a motion detection region, when the user receives an operation, Operating means for activating said motion detection area setting means.
I'm supposed to.

According to the above configuration, an operation detection area corresponding to a different operation is set for each user, so that a user-specific operation instruction device corresponding to a different operation strength for each user can be provided.
The operation instructing device is incorporated in the device main body, and in the initial setting mode, an operation content instructing means for instructing a plurality of operation contents, and a motion value of the device main body caused by a user operation for each of the specified operation contents. The apparatus further comprises: a motion value detecting means for detecting; and an operation content allocating means for allocating each operation instruction content to each of the set operation detection areas according to a plurality of operation instruction contents for each function of the device main body. .

With such a configuration, in the initial setting mode, the operation instruction content can be assigned to the operation detection area according to the user's operation.
In addition, the plurality of operation contents is an operation of shaking the three-dimensional axes in the positive and negative directions, and the operation is repeated a plurality of times, and the motion value detecting means includes a three-dimensional acceleration sensor. The motion detection area setting means stores, for each motion, a maximum value of an acceleration value output from the three-dimensional acceleration sensor within a predetermined time for the number of motions, and calculates an average value; A threshold calculation unit that calculates a threshold of a lower limit and an upper limit of a positive direction or a negative direction of each axis according to a calculation formula, based on an average value calculated for each strength of the axis in the positive or negative direction, A setting unit that sets a range between the lower threshold value and the upper threshold value in the motion detection area in each direction.

With such a configuration, it is possible to set an operation detection area in which the user's operation can be correctly recognized using the exercise value detected by the exercise value detection unit.
In addition, in a mode other than the initial setting mode, the motion value detected by the motion value detecting means is assigned by the operation content allocating means to the determination means for determining in which region the motion value is present and the motion value existing area. Instruction output means for outputting operation instruction contents to the device main body is further provided.

With such a configuration, the user can easily output the operation instruction content to the device by holding the device main body and performing a predetermined operation.
Further, in the determination means, when the exercise value is within a predetermined value from the lower threshold or the upper threshold of any of the regions, only the value of the difference from the lower threshold or the upper threshold, Updating means for shifting the lower threshold and the upper threshold of the area is further provided.

With such a configuration, when the operation slightly deviates from the operation detection area set in the initial setting mode, it is determined that the user's operation has changed, and the operation instruction content can be output in subsequent operations. Shift the motion detection area.
Further, a calculation formula used by the threshold value calculation unit is:

であることとしている。
このような構成によって、動作検出領域を設定するしきい値を経験的に得られた計算式で正しく計算することができる。

It is to be.
With such a configuration, the threshold value for setting the motion detection area can be correctly calculated by a calculation formula obtained empirically.

The operation content assigning means selects a one-dimensional, two-dimensional, or three-dimensional motion detection area according to the number of operations and the direction of the operation instruction content, and selects an area that intuitively matches each operation instruction content. Each operation instruction content is assigned.
With such a configuration, whether the motion detection area is a plane or a space is selected according to the number and direction of the operation instruction contents. If the user moves to, the user's operation can be performed efficiently because the device is intuitively matched by, for example, shaking the device to the right.

Further, the motion value detecting means is constituted by a three-dimensional acceleration sensor, and the motion detection area setting means sets the motion detection area based on a distance obtained by integrating the detected acceleration value twice. .
With such a configuration, the motion value can be converted from the acceleration value detected by the sensor to the distance, and the motion detection area can be set.

Further, the exercise value detecting means includes a gyro, and the operation content assigning means changes a viewpoint direction of a display image displayed on a display unit of the device main body based on an angular acceleration detected by the gyro. The content of the operation instruction is assigned to each area of the motion detection area.
With such a configuration, the angular acceleration is detected as a motion value, and the operation instruction content for changing the viewpoint direction of the display image is assigned to each area of the motion detection area, so that the display image can be viewed from different directions with an intuitive operation. Can be.

  Further, the present invention is an operation instruction method having a sensor incorporated in an apparatus main body and detecting a movement value of the apparatus main body caused by a user operation, wherein in an initial setting mode, an operation content instruction for instructing a plurality of operation contents. A step, a motion value detecting step of detecting, by the sensor, a motion value of the device main body caused by a user motion for each of the specified operation contents, and an operation for each of the operation contents based on the plurality of detected motion values. An operation detection area setting step of setting a detection area; an operation content assignment step of assigning each operation instruction content to each area of the set operation detection area according to a plurality of operation instruction contents for each function of the device main body; In a mode other than the setting mode, a determination step of determining in which region the exercise value detected in the exercise value detection step exists; The operation instruction contents assigned by the operation content allocation step are to having an instruction output step of outputting to the device body.

According to such a method, in the initial setting mode, the exercise value of the device main body contributing to the user's operation is detected and the operation detection area is set. Can be output to
An operation instruction program which is incorporated in the apparatus main body, has a sensor for detecting a movement value of the apparatus main body due to a user operation, and causes a computer to execute an operation instruction method of outputting an operation instruction to the apparatus main body, In the setting mode, an operation content instructing step of instructing a plurality of operation contents, a motion value detecting step of detecting, by the sensor, a motion value of the device main body caused by a user operation for each of the specified operation contents, An operation detection area setting step of setting an operation detection area for each operation content based on a plurality of motion values, and each area of the set operation detection area set according to a plurality of operation instruction contents for each function of the device main body. An operation content allocating step of allocating each operation instruction content to a motion value, and determining in which region the motion value detected in the motion value detecting step exists. And an instruction output step of outputting to the device body the operation instruction content assigned in the operation content assigning step to the region where the exercise value exists.

  By causing a computer to execute such an operation instruction program, it is possible to realize an operation instruction device corresponding to a user's individual operation.

Hereinafter, an embodiment of an operation instruction device according to the present invention will be described with reference to the drawings.
(Embodiment 1)
FIG. 1 is an external view of Embodiment 1 of a portable information device incorporating an operation instruction device according to the present invention.
A display unit 102 for displaying information is provided on a front surface of the portable information device 101. A three-dimensional acceleration sensor 104 is incorporated substantially at the center of the housing 103 of the portable information device 101. An operation recognition button 105 is provided on the right side of the housing 103 so as to protrude.

When the user holds the casing 103 of the portable information device 101 and presses the operation recognition button 105, the acceleration value of the casing 103 detected by the three-dimensional acceleration sensor 104 is output.
With the three-dimensional acceleration sensor 104 as the center, the horizontal direction indicated by arrows 106 and 107 of the housing 103 is the X axis, the vertical direction indicated by arrows 108 and 109 is the Y axis, and the front-rear direction indicated by arrows 110 and 111. Is the Z axis. Further, the three-dimensional acceleration sensor 104 outputs the right direction 107, the upward direction 108, and the forward direction 110 as positive values, and outputs the respective reverse directions as negative values.

FIG. 2 is a configuration diagram of the above-described embodiment of the operation instruction device according to the present invention.
The operation instruction device includes an operation detection unit 201, an operation content instruction unit 202, an operation analysis unit 203, an operation detection area setting unit 204, an operation content allocation unit 205, an operation determination unit 206, and an output unit 207. And
The motion detection unit 201 includes, for example, the three-dimensional acceleration sensor 104, detects a motion of the portable information device 101 in which the operation instruction device is built, and outputs an acceleration value to the motion analysis unit 203. It should be noted that the output to the operation breaking unit 203 is performed while the operation recognition button 103 is being pressed or for a predetermined period after being pressed, for example, 0.5 seconds.

FIG. 3 is an explanatory diagram of the acceleration value detected by the motion detection unit 201. As shown in (a), the X axis, the Y axis, and the Z axis are set as described with reference to FIG. 1 with the center of the three-dimensional acceleration sensor 104 as the origin. When the housing 103 moves, acceleration values for each axis are detected as shown in (b), (c), and (d).
Now, at time t, if the values of the waveforms on each axis (X, Y, Z axes) are Lx, Ly, and Lz, the direction vector L is

で示される。式（１）で示される方向ベクトルによって、原点（３次元加速度センサ１０４の中心）からの方向が示されている。
この時刻ｔにおいて動作認識ボタン１０３が押下されると、所定の期間△ｔの
間、例えば１／１００秒間隔で、動作検出部２０１は、動作解折部２０３に検出した加速度値を出力する。または、動作認識ボタン１０３が押下されている間、所定の間隔で検出した加速度値を出力する。

Indicated by The direction from the origin (the center of the three-dimensional acceleration sensor 104) is indicated by the direction vector represented by Expression (1).
When the motion recognition button 103 is pressed at this time t, the motion detection unit 201 outputs the detected acceleration value to the motion breaking unit 203 for a predetermined period Δt, for example, at intervals of 1/100 second. Alternatively, the acceleration value detected at predetermined intervals is output while the motion recognition button 103 is being pressed.

When the operation instruction device is in the initial setting mode, the operation content instruction unit 202 displays the operation content of the user holding the housing 103.
Note that the initial setting mode is displayed on a menu screen when the power of the portable information device 101 is turned on, and the initial setting mode can be selected. A reset switch is also provided on this menu screen, and when the user using the portable information device 101 is changed, if the reset switch is selected, an initial setting mode is set.

  FIG. 4 shows an example of an operation content instruction screen displayed on the display unit 102 of the portable information device 101 in response to an instruction from the operation content instruction unit 202. The screen 401 is a message “Please hold the housing and shake it to the right”. When the operation is different from the instruction, the message on the screen 402 is displayed by an error instruction from the operation breaking unit 203. Is displayed. Also, the screen 403 is a message of the next operation content, “Please shake the main body to the right”. In addition, a message is displayed that the user should shake strongly and weakly in the directions indicated by arrows 106, 108, 109, 110, and 111 in FIG.

In response to this, when the user performs an operation while holding the casing 103 of the portable information device 101, the acceleration value detected by the operation detection unit 201 is output to the operation analysis unit 203.
Note that the instruction content of the operation content instruction unit 202 is also notified to the operation breaking unit 203.
When receiving a notice of the instruction content from the operation content instructing unit 202 and when the sign of the acceleration value output from the motion detecting unit 201 does not match the instruction content, the operation breaking unit 203 outputs an error to the operation content instructing unit 202. Notify instructions. That is, in the case of the instruction content to be swung rightward, when the acceleration value indicates “positive”, the operation is the operation corresponding to the instruction content, but when the acceleration value indicates “negative”, the operation is contrary to the instruction content. At this time, an error instruction is notified to the operation content instruction unit 202.

The motion analysis unit 203 notifies the motion detection area setting unit 204 of a series of acceleration values output from the motion detection unit 201, for example, the maximum value of the acceleration value notified at the time Δt, along with the direction and the strength of the instruction content. I do.
When the mode is not the initial setting mode, the direction and the maximum value are notified to the operation determination unit 206.

Here, the motion analysis unit 203 normalizes the acceleration value output from the motion detection unit 201 to + 2G to 127 and −2G to -127 and notifies the motion detection area setting unit 204 or the operation determination unit 206 of the acceleration value.
The motion detection area setting unit 204 calculates the average value of the maximum acceleration values for each direction and strength notified from the motion breaking unit 203.

FIG. 5 shows the maximum acceleration value of the user 1 and the average value thereof stored in the storage unit of the motion detection area setting unit 204. The motion detection area in the direction is set from the average value of the acceleration corresponding to the strong motion in the same direction. The sign of the acceleration value is omitted.
In FIG. 5, “10” trials are performed for each operation content. However, if an average value is calculated from at least “3” trials, the motion detection area can be correctly set.

  The lower threshold and the upper threshold in each direction are calculated using the following equations (2) and (3).

具体例を示すと、図５に示した方向５０１を右方向とするユーザ動作の強弱についての平均最大加速度５０２、５０３の値を式（２）、式（３）にそれぞれ代入すると、

As a specific example, substituting the values of the average maximum accelerations 502 and 503 for the strength of the user action with the direction 501 shown in FIG. 5 to the right as equations (2) and (3) respectively:

式（４）、式（５）で、右方向の動作検出領域の下限しきい値と上限しきい値とが得られる。
動作検出領域設定部２０４は、ユーザ１の右方向に振る動作を検出する動作検出領域として、下限しきい値と上限しきい値との間の領域、即ち、動作解折部２０３が通知する加速度値「１９〜６１」の領域を設定する。

Equations (4) and (5) provide the lower threshold and upper threshold of the rightward motion detection area.
The motion detection area setting unit 204 sets an area between the lower threshold and the upper threshold as the motion detection area for detecting the rightward motion of the user 1, that is, the acceleration notified by the motion analysis unit 203. An area of a value “19 to 61” is set.

The motion detection area setting unit 204 sets a motion detection area for each of the positive and negative directions in the X, Y, and Z axes, and notifies the operation content allocating unit 205.
Since the area is independently set for each of the positive and negative directions in each direction, if the determination is made only in the one-dimensional (one-axis) direction, the two-dimensional plane (two-axis) is not related to the area in other directions. Alternatively, if a determination is made in a three-dimensional space (three-axis direction), areas in other directions are also involved.

FIG. 6 is a comparison diagram illustrating a motion detection area of the user 1 set by the motion detection area setting unit 204 and a motion detection area of the user 2 and the like set by the motion detection area setting unit of another operation instruction device. is there.
Comparing the rightward motion 601 and the leftward motion 602 of the user 1 reveals that the leftward motion 602 has a higher acceleration value, and even individuals may be better or weaker depending on the direction. I can understand.

Also, it can be understood that there is an individual difference similarly when comparing the rightward movements 601 and 603 of the user 1 and the user 2.
Therefore, if a fixed operation detection area is used regardless of each user as in the related art, there may be a problem that a user operation is detected as a malfunction.
When the reset switch (not shown) is selected, it means that the user who uses the operation instruction device has been changed, so the motion detection area setting unit 204 discards the set motion detection area and newly sets the motion detection area. Make settings.

Upon receiving the notification of the operation instruction content for each function from the portable information device 101, the operation content allocation unit 205 allocates the operation instruction content to the operation detection area set by the operation detection area setting unit 204.
FIG. 7 is a diagram illustrating an example of the operation instruction content notified to the operation content allocation unit 205. The operation content 701 is a menu operation using the function 702, and the focus content is an instruction content. The number of operations 703 is “4”, the direction 704 is “left”, “right”, These are the X and Y directions of “up” and “down”. “1” is added as a number 705 for identifying the operation instruction content 701.

The operation instruction content allocating unit 205 allocates each operation instruction content to the motion detection area as shown in FIG.
The motion detection area 801 includes an area 802 between the lower limit threshold and the upper threshold in the right direction, an area 803 between the lower threshold and the upper threshold in the left direction, and a lower limit in the upper direction. An area 804 between the threshold value and the upper threshold value, and an area 805 between the lower and upper threshold values in the downward direction, are respectively "right", "left", and "left" of the focus. The operation instruction contents of the “up” and “down” directions are assigned. Here, the intersection of each lower threshold value and the intersection of the corresponding upper threshold value are connected by a straight line to divide each boundary.

The motion detection area 801 after the assignment is divided into four on a two-dimensional plane.
When assigning each operation instruction content 701 to each of the areas 802 to 805 of the motion detection area 801, the operation content assignment unit 205 assigns an identification number “1” and stores it as an operation instruction table.
As described above, the operation instruction contents of the operation detection area 801 correspond to the user's operation contents, so that the portable information device 101 can be operated by intuitive operation.

In other words, the user's operation of gripping the casing 103 and swinging to the left corresponds to the operation instruction content “move focus to the left”, and “moving focus to the right” corresponds to “move the focus to the right”. Similarly, "shake up" corresponds to "move focus", and "shake down" corresponds to "move focus down".
FIG. 9 is a diagram showing the contents of operation instructions for another function.
“2” is added to the number 902 in correspondence with the operation instruction content 901, and a function 903 “browse homepage” of the operation instruction content 901 is also described. The number of operations 904 is “6”, and the direction 905 is a three-axis direction of “up, down, left, right, front”.

The operation content allocating unit 205 divides the motion detection area set by the motion detection area setting unit 204 into six areas in a three-dimensional space, and allocates an operation instruction content 901 to each area.
FIG. 10 is an explanatory diagram of the motion detection area. “Move slider (link) up” is assigned to the area 1002 of the motion detection area 1001, “Move slider (link) down” is assigned to the area 1003, and “Slider left” is assigned to the area 1004. (Move (link)) is assigned, “move slider (link) to the right” is assigned to area 1005, “return to previously operated link destination” is assigned to area 1006, and area 1007 is assigned to previous Go to the operated link destination ".

When assigning each operation instruction content 901 to each of the areas 1002 to 1007 of the motion detection area 1001, the operation content assignment unit 205 assigns a number “2” to identify the operation instruction content and stores the number as an operation instruction table.
In addition, the operation content allocating unit 205 has received a notification from the portable information device 101 as to which number the content currently displayed on the display unit 102 corresponds to the operation instruction content.

When the initial setting mode is canceled and the menu is displayed on the display unit 102 of the portable information device 101, the user 1 grips the portable information device 101, presses down the operation recognition button 105, and shakes up. The motion detection unit 201 detects an acceleration value and outputs the value to the motion analysis unit 203 at predetermined intervals.
The motion analysis unit 203 normalizes the input acceleration value, and notifies the operation determination unit 206 of the maximum value in the X, Y, and Z axis directions.

  When receiving the notification of the maximum acceleration values in the X, Y, and Z-axis directions notified from the operation breaking unit 203, the operation determining unit 206 is located in any area of the operation instruction table stored in the operation content allocating unit 205. Is determined. Here, as the operation instruction table, an operation instruction table with a number that matches the identification number notified by the operation content assignment unit 205 from the portable information device 101 and that identifies the content currently displayed on the display unit 102 is selected.

As described above, since the menu is displayed, the number “1” is notified. An operation instruction table having a number “1” that matches the number “1” is selected.
FIG. 11 is a diagram schematically illustrating the operation instruction table with the number “1”. The respective directions 802 to 805 of the operation instruction table 1101 are associated with “right”, “left”, “up”, and “down”, which are the directions of the focus movement, which are the contents of the operation instruction.

If the notified maximum acceleration values in the X, Y, and Z axis directions are “−5”, “40”, and “1”, respectively, since the direction vector exists on the point 1102, it is determined that the point is within the area 804. Then, the corresponding operation instruction content of “moving the focus upward” is read and notified to the output unit 207.
When the direction vector is within the central rectangular area 1103 surrounded by the areas 802 to 805, the operation determining unit 206 does not notify the content of the operation instruction as an error. Similarly, when it is outside the areas 802 to 805, it is determined that a malfunction has occurred, and the operation instruction is not notified.

  Further, when there is a direction vector near the boundary area, the lower limit threshold value in the right direction is A, the upper limit threshold value in the right direction is B, the lower limit threshold value in the upper direction is C, and the upper limit threshold value in the upper direction is When D is set, for example, when A <X <B and C <Y <D, the equation (6) is calculated.

式（６）のＳの値が正のとき、領域８０２にあると判定し、Ｓの値が負のとき、領域８０４にあると判定する。他の境界領域でも同様の判定がなされる。
なお、番号「２」で識別される操作指示テーブルが選択されている場合も、操作判定部２０６は、動作検出領域のいずれの領域１００２〜１００７に方向ベクトルが存在するのか判定する。図１０に示した領域１００２〜１００７で囲まれる領域１００８は、誤差領域として判定されないのも同様である。

When the value of S in Expression (6) is positive, it is determined that the pixel is in the area 802, and when the value of S is negative, it is determined that the pixel is in the area 804. Similar determinations are made in other boundary areas.
In addition, even when the operation instruction table identified by the number “2” is selected, the operation determination unit 206 determines which of the motion detection areas 1002 to 1007 has the direction vector. A region 1008 surrounded by regions 1002 to 1007 shown in FIG. 10 is similarly not determined as an error region.

The output unit 207 outputs the operation instruction content notified from the operation determination unit 206 to the portable information device 101.
As a result, the portable information device 101 updates the display content of the display unit 102 and performs the specified process.
Next, the operation of the above embodiment will be described with reference to the flowcharts of FIGS.

FIG. 12 is a flowchart illustrating the operation in the initial setting mode.
First, the operation content instructing unit 202 causes the display unit 102 to display an instruction screen for instructing the user to perform an operation performed by gripping the housing 103 (S1202).
When the user presses the motion recognition button 105 and moves the housing 103, the motion detection unit 201 detects an acceleration value, which is a motion value of the main body of the portable information device 101, and outputs the acceleration value to the motion breaking unit 203 ( S1204).

The motion analysis unit 203 determines whether the input exercise value is a value corresponding to the instructed motion (S1206).
If the value is not a corresponding value, the operation content instruction unit 202 displays an instruction screen for instructing the operation content again (S1208), and returns to S1204.
If the motion is correct, the motion detection area setting unit 204 receives the notification of the motion value from the motion breaking unit 203, records the motion value (S1210), and determines whether a predetermined number of motion values have been recorded. (S1212). If not, the process returns to S1202, and if so, it is determined whether there is a strong or weak motion value corresponding to the instruction operation (S1214). If not, the process returns to S1202, and if there is, it is determined whether or not there is a motion value corresponding to all the motion contents (S1216). If not, the process returns to S1202. The threshold value and the upper limit threshold are set (S1218), and the process ends.

FIG. 13 is a flowchart illustrating the operation of the operation content assignment unit.
The operation content assignment unit 205 acquires the operation instruction content for each function of the portable information device 101 (S1302), and acquires the number of operations and the direction (S1304).
Next, it is determined from the number of operations and the direction whether or not the determination can be made in one axis direction (S1306). For example, if the direction is “up and down” or “left and right”, it is determined that the determination is possible and the one-dimensional area Then, the operation instruction content is allocated to each area of the motion detection area, an operation instruction table is generated and stored (S1308), and the process proceeds to S1316.

If the determination cannot be made in the one-axis direction, it is determined whether the determination can be made in the two-axis direction (S1310). For example, if the direction is “upper right” or “up / down / left / right”, it is determined that the operation is possible, the operation instruction content is assigned to each area of the motion detection area on the two-dimensional plane, and an operation instruction table is generated and stored ( S1312), and proceeds to S1316.
If the determination cannot be made in the two-axis direction, for example, “up, down, left, right” or “up, down, left, right, back”, an operation instruction content is assigned to each area of the motion detection area in the three-dimensional space, and an operation instruction table is generated. Is stored (S1314).

In S1316, the operation content assignment unit 205 determines whether there is still a function for which an operation instruction table has not been generated (S1316). If there is, the process returns to S1302; otherwise, the process ends.
FIG. 14 is a flowchart illustrating an operation of determining the operation content from the exercise value of the portable information device 101 main body.
The motion detection unit 201 waits for detection of an acceleration value, which is a motion value (S1402), and outputs the motion value to the motion analysis unit 203 (S1404).

The motion analysis unit 203 normalizes the input exercise value, and notifies the operation determination unit 206 of the maximum value (S1406).
The operation determination unit 206 acquires the operation instruction table currently being operated by the portable information device 101 and stored in the operation content allocation unit 205 (S1408), and determines whether the notified exercise value is any of the motion detection areas. It is determined whether or not the area exists (S1410).

If it is not in any area, the process returns to S1402, and if it is in any area, the contents of the operation instruction assigned to that area are read (S1412).
When receiving the notification of the operation instruction read from the operation determination unit 206, the output unit 207 outputs the operation instruction to the portable information device 101 (S1414), and ends the process.
(Embodiment 2)
FIG. 15 is a configuration diagram of an operation instruction device according to a second embodiment of the present invention.

The difference is that an updating unit 1501 is provided in addition to the configuration of the operation instruction device according to the first embodiment. A configuration unique to the present embodiment, which is different from the first embodiment, will be described.
When the operation determination unit 206 determines that the motion value notified from the motion analysis unit 203 does not exist in any of the motion detection regions, the operation determination unit 206 calculates a difference between the lower limit or the upper threshold of the adjacent region. . When the difference is equal to or smaller than a predetermined value, for example, “3”, the updating unit 1501 is notified of the value, the direction, and whether the threshold is the lower threshold or the upper threshold.

The updating unit 1501 shifts the motion detection area set by the motion detection area setting unit 204 in a direction out of the area.
That is, when the rightward upper limit threshold is “61” (see FIG. 6), and when the rightward motion value notified to the operation determining unit 206 is “63”, the updating unit 1501 The difference “2”, the right direction, and the notification that the upper limit threshold value has been received are received.

The updating unit 1501 updates the positive (rightward) lower limit threshold of the X-axis set by the motion detection area setting unit 204 from “19” to “21” and changes the upper threshold to “21”. From "61" to "63". Thereby, the motion detection area is updated. Further, the update unit 1501 instructs the operation content allocation unit 205 to update the operation instruction table.
The operation content allocating unit 205 allocates an operation instruction content to each of the new motion detection areas for an operation instruction table generated for each function that needs to be updated, and updates the operation instruction table.

As described above, in the present embodiment, even if the motion detection area is initially set based on the exercise value according to the user's personality, the motion of the user may gradually change, and it is possible to cope with this. Things.
In the case where the operation determination unit 206 cannot continuously determine the user's operation, the mode is forcibly returned to the initial setting mode, and the user is required to perform a strong or weak swing operation in each direction. The threshold may be recalculated.
(Embodiment 3)
In each of the above embodiments, the motion detection area is set in the virtual space based on the value obtained by normalizing the acceleration value detected by the three-dimensional acceleration sensor 104 as the motion value. Is set as the movement distance to set the motion detection area.

Note that the configuration of the present embodiment is almost the same as the configuration of the first embodiment shown in FIG. 2, and therefore, the description will be made using the configuration as it is, and only the parts unique to the present embodiment will be described.
The motion analysis unit 203 calculates the moving distance of the housing 103 by integrating the input acceleration value twice at time t.
In the initial setting mode, the motion detection area setting unit 204 is notified of the moving distance for each direction a plurality of times by the motion analysis unit 203. The motion detection area setting unit 204 sets the motion detection area with the maximum value of the moving distance in each direction as a range.

Upon receiving the notification of the operation instruction content for each function, the operation content allocation unit 205 allocates the operation instruction content to each area of the motion detection area according to the number and direction of the operations.
FIG. 16 shows a state in which the motion detection region is divided into two in each of the three-dimensional directions and divided into 64 regions. The internal division is omitted. This motion detection area 1601 is a three-dimensional space in which the position of the three-dimensional acceleration sensor 104 is the origin of the X-axis, Y-axis, and Z-axis.

The user can give various operation instructions by adjusting the moving direction and the moving distance of the housing 103.
The operation determination unit 206 determines which of the motion detection areas 1601 is the motion detection area based on the movement distance in each axis direction notified from the motion analysis unit 203, reads out the operation instruction content assigned to the area, and outputs the operation instruction content. Notify.

As shown in FIG. 16, the distance of the motion detection area 1601 differs depending on each direction. This reflects the strengths and weaknesses of the user's actions.

(Embodiment 4)
In each of the above embodiments, an acceleration sensor is used for the motion detection unit 201. However, in the fourth embodiment, a gyro for detecting angular acceleration is used instead of the acceleration sensor.

As the content of the operation instruction, the viewpoint direction of the display screen is rotated according to the angle calculated from the detected angular acceleration.
For example, as shown in FIG. 17A, a person looking at the front is displayed on the display unit 102. When the user rotates the housing 103 clockwise by θ around the Y axis as the rotation axis, the operation determination unit 206 reads an operation instruction “rotate the viewpoint direction by θ”.
The output unit 207 outputs the operation instruction to the portable information device 101.

As a result, as shown in FIG. 17 (b), the person rotated sideways by the angle θ is displayed on the display unit 102.
In the present embodiment, the angle calculated by the motion analysis unit 203 and the rotation angle in the viewpoint direction, which is the content of the operation instruction, are made to match. May be repeated several times, and the angle as the motion detection area may be made to correspond to the rotation angle of the operation instruction content based on the average value or the like.

Alternatively, the angle change amount may be detected by a tilt sensor or the like.
Although the configuration of each of the above embodiments is shown in the configuration diagrams of FIG. 2 and FIG. 15, it goes without saying that the functions of each component may be realized by a program that causes a computer to execute the functions.

  The operation instruction device according to the present invention can be used as a device that outputs an operation instruction to a portable information device such as a PDA or a mobile phone.

1 is an external view of a first embodiment of a portable information device incorporating an operation instruction device according to the present invention. It is a lineblock diagram of the above-mentioned embodiment of the operation instruction device concerning the present invention. FIG. 3 is an explanatory diagram of a motion value detected by a motion detection unit according to the embodiment. It is a figure showing the example of a display screen instructed by the operation contents instructing part of the above-mentioned embodiment. It is a figure which shows the maximum acceleration value of the intensity | strength of each direction notified to the motion detection area setting part of the said embodiment from a motion breaking part, and the calculated average value. It is a figure which shows the threshold value of the lower limit and upper limit of the motion detection area | region of the user 1 set by the motion detection area setting part of the said embodiment, and those values of the user 2 etc. as a reference example. FIG. 7 is a diagram illustrating operation instruction contents notified from the portable information device to the operation contents allocation unit of the embodiment. FIG. 9 is a diagram illustrating an operation detection area assigned to the operation instruction content by the operation content allocation unit of the embodiment. FIG. 14 is a diagram illustrating another operation instruction content notified from the portable information device to the operation content allocation unit of the embodiment. FIG. 9 is a diagram illustrating an operation detection area assigned to another operation instruction content by the operation content allocation unit of the embodiment. FIG. 4 is a diagram schematically illustrating an operation instruction table stored in an operation content assignment unit according to the embodiment. It is a flowchart explaining the setting operation | movement of the operation | movement detection area of the said embodiment. It is a flowchart explaining the operation | movement which allocates a motion detection area to the content of the operation instruction of the said embodiment. It is a flowchart explaining operation | movement in the operation determination part of the said embodiment. It is a lineblock diagram of Embodiment 2 of the operation instruction device according to the present invention. It is an explanatory view of division of each area of a motion detection area of a third embodiment of the operation instruction device according to the present invention. FIG. 10 is an explanatory diagram of operation instruction contents of an operation instruction device according to a fourth embodiment of the present invention.

Explanation of reference numerals

101 portable information device 102 display unit 103 housing 104 three-dimensional acceleration sensor 105 operation recognition button 201 operation detection unit 202 operation content instruction unit 203 operation analysis unit 204 operation detection area setting unit 205 operation content allocation unit 206 operation determination unit 207 output unit 1501 Update section

Claims (11)

An operation detection area setting unit that sets an operation detection area based on a movement value detected due to a specific operation of a specific user;
An operation instruction device, comprising: an operation unit that activates the operation detection area setting unit when receiving an operation from a user. The operation instruction device is incorporated in the device body,
An operation content instructing means for instructing a plurality of operation contents in the initial setting mode;
Exercise value detection means for detecting an exercise value of the device main body caused by the user operation for each of the specified operation contents,
2. The operation according to claim 1, further comprising operation content assigning means for assigning each operation instruction content to each of the set operation detection areas according to a plurality of operation instruction contents for each function of the device main body. Pointing device. The plurality of operation contents is an operation of shaking the three-dimensional axes in the positive and negative directions, and the operation is repeated a plurality of times,
The motion value detecting means includes a three-dimensional acceleration sensor,
The operation detection area setting means,
An average value calculation unit that stores the maximum value of the acceleration value output from the three-dimensional acceleration sensor within a predetermined time for each operation for the number of operations, and calculates an average value;
A threshold calculation unit that calculates a threshold of a lower limit and an upper limit of a positive direction or a negative direction of each axis according to a calculation formula based on an average value calculated for each strength of the positive direction or the negative direction of each axis; ,
3. The operation instruction device according to claim 2, further comprising: a setting unit that sets a range between a lower threshold and an upper threshold in a motion detection area in each direction. Except in the initial setting mode, the exercise value detected by the exercise value detection means, a determination means to determine in which region exists,
4. The operation instruction device according to claim 3, further comprising: instruction output means for outputting, to the device body, the operation instruction content assigned by the operation content assignment means to an area where a motion value exists.   In the determination means, when the exercise value deviates from the lower threshold or the upper threshold of any of the regions by a predetermined value or less, the difference between the exercise value and the lower threshold or the upper threshold is determined by the value of the region. 5. The operation instruction device according to claim 4, further comprising updating means for shifting the lower threshold value and the upper threshold value of the operation. The calculation formula used by the threshold value calculation unit is:

The operation instruction device according to claim 3, wherein: The operation content assigning means includes:
A one-dimensional, two-dimensional, or three-dimensional motion detection area is selected according to the number of operations and the direction of the operation instruction content, and each operation instruction content is assigned to an area that intuitively matches each operation instruction content. The operation instruction device according to claim 2, wherein The motion value detecting means includes a three-dimensional acceleration sensor,
The operation detection area setting means,
3. The operation instruction device according to claim 2, wherein the operation detection area is set based on a distance obtained by integrating the detected acceleration value twice. The motion value detecting means is composed of a gyro,
The operation content assigning means includes:
3. An operation instruction content for changing a viewpoint direction of a display image displayed on a display unit of the device body based on an angular acceleration detected by the gyro is assigned to each of the motion detection areas. Operation instruction device according to the above. An operation instruction method that is incorporated in the device main body and has a sensor that detects a movement value of the device main body caused by a user operation,
An operation content instruction step of instructing a plurality of operation contents in the initial setting mode;
An exercise value detection step of detecting, with the sensor, an exercise value of the device main body caused by a user operation for each of the specified operation contents,
An operation detection area setting step of setting an operation detection area for each operation based on a plurality of detected motion values;
An operation content assigning step of assigning each operation instruction content to each of the set operation detection areas according to a plurality of operation instruction contents for each function of the device main body,
Except for the initial setting mode, the exercise value detected in the exercise value detection step, a determination step to determine in which region exists,
An instruction output step of outputting, to the device body, the operation instruction content assigned in the operation content assignment step to an area where a motion value exists. An operation instruction program that is incorporated in the device main body, has a sensor that detects a movement value of the device main body caused by a user operation, and causes a computer to execute an operation instruction method of outputting an operation instruction to the device main body,
An operation content instruction step of instructing a plurality of operation contents in the initial setting mode;
An exercise value detection step of detecting, with the sensor, an exercise value of the device main body caused by a user operation for each of the specified operation contents,
An operation detection area setting step of setting an operation detection area for each operation based on a plurality of detected motion values;
An operation content assigning step of assigning each operation instruction content to each of the set operation detection areas according to a plurality of operation instruction contents for each function of the device main body,
A determination step of determining in which region the exercise value detected in the exercise value detection step is present,
An instruction output step of outputting, to the device body, the operation instruction content assigned in the operation content assignment step to an area where a motion value exists.

Images