JP2000148351A - Operation instruction output device giving operation instruction in accordance with kind of user's action and computer-readable recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain an operation instruction output device which converts an operation instruction corresponding to the movement of a device body by detecting the movement of the device body and distinguishing the kind of a user's action which generated the action. SOLUTION: A movement detecting part 101 detects the movement of a device body. A movement analyzing part 102 analyzes a movement direction, strength and the number of times from the detected movement. A user's action analyzing part 103 finds the frequency distribution of the movement from the detected movement and analyzes the kind of the user's action. A processing deciding part 104 has a storing part which stores an operation instruction corresponding to the movement direction of the device, etc., and the kind of the user's action and outputs an operation instruction corresponding to analysis results of the parts 102 and 103 to an information processor.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an operation instruction output device which detects a movement of a device main body caused by a user's operation and outputs an operation instruction corresponding to the detection result.

[0002]

2. Description of the Related Art In a technology such as virtual reality, the motion of a human body is digitally coded by using a data glove or a position sensor (for example, 3 SPACE system manufactured by POLHEUS, USA) or the like to which a magnetic conversion technology is applied, and is input to a computer. Screen control and operation instructions are performed. In recent years, sensors for detecting an operation, for example, an acceleration sensor have become smaller and more accurate, and are incorporated in a portable information processing device to detect the movement of a device and perform information processing according to the movement. Techniques are disclosed.

For example, in the technique disclosed in Japanese Patent Application Laid-Open No. 6-4208, a sensor for detecting the movement of a device body and a motion analysis for obtaining the direction of movement and rotation, the amount of change and the number of times based on the output of the sensor. There is a device that includes a unit and instructs processing contents according to the direction of movement or rotation of the main body, the amount of change, or the number of times. When this device is moved up and down and left and right, the movement analysis unit calculates the amount of movement in the up and down direction and the amount of movement in the left and right direction based on the output of the detection sensor provided therein, and displays them on the liquid crystal display panel. Processing such as scrolling the contents of a sentence or the like in the direction of movement by the number of pixels corresponding to the obtained movement amount, or moving the cursor displayed on the liquid crystal display panel is performed.

[0004]

However, in the above-mentioned conventional apparatus, the type of operation of the user with respect to the apparatus main body, for example, "shaking" and "hitting" are not distinguished, so that the types of processing contents that can be instructed are limited. ing. In addition, if the user accidentally hits something while moving the device main body, there is a disadvantage that the user is instructed to perform processing that is not intended by the user.

SUMMARY OF THE INVENTION In view of the above problems, the present invention prevents an erroneous operation, diversifies the contents of an operation instruction, and a computer-readable program storing a program for causing a computer to perform the functions of the apparatus. It is intended to provide a recording medium.

[0006]

According to another aspect of the present invention, there is provided an operation instruction output device which outputs an operation instruction to an information processing apparatus and causes the apparatus to perform a process based on the operation instruction. Storage means for storing an operation instruction corresponding to a combination of at least one or more of the movement direction, strength, and number of times of the operation instruction output device main body and the type of operation of the user who caused the movement; Motion detecting means for detecting a motion of the apparatus main body accompanying the motion, motion analyzing means for analyzing at least one of a motion direction, strength, and the number of times from the detected motion, and a type of user's motion from the detected motion. A user operation analysis unit for analyzing, an operation instruction corresponding to a combination of analysis results of the movement analysis unit and the user operation analysis unit, read from the storage unit, and the operation instruction is read by the information processing apparatus It is set to be equipped with the read output means for outputting.

[0007]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of an operation instruction output device according to the present invention will be described below with reference to the drawings. (First Embodiment) FIG. 1 is a configuration diagram of an operation instruction output device according to a first embodiment of the present invention. This operation instruction output device includes a motion detection unit 101, a motion analysis unit 102, a user motion analysis unit 103, and a process determination unit 104.

FIG. 2 is a diagram showing a hardware configuration of the operation instruction output device. The motion detection unit 101 is realized by an acceleration sensor 201, a signal amplifier (amplifier) 202, and an analog / digital (A / D) converter 203. The motion analysis unit 102 and the user motion analysis unit 103
And the ROM 205 and the RAM 206. The processing determining unit 104 includes a CPU 204, a ROM 205, and a RAM 2
06 and the communication device 207. The A / D converter 203, the CPU 204, the ROM 205, and the RAM 20
6 and the communication device 207 are connected to a bus 208.

The motion detecting unit 101 includes an acceleration sensor 201
The acceleration amount acting on the amplifier 2 is sampled at a predetermined time interval, for example, 1/100 second, and the analog voltage change is measured by the amplifier 2.
The signal is amplified by an A / D converter 203, converted into digital data by an A / D converter 203, and output to a motion analysis unit 102 and a user motion analysis unit 103 via a bus 208. FIG. 3 is a diagram showing the appearance of this device and the specific arrangement of the acceleration sensor 201 of the motion detection unit 101.

In the motion detecting section 101, two acceleration sensors 301 and 302 are provided with a housing 303 of the operation instruction output device main body.
It is provided inside. Acceleration sensor 301, 302
Are arranged on orthogonal detection axes 305 and 306 so as to detect a movement in a two-dimensional plane parallel to the front surface 304 of the housing 303. When detecting movement in only one direction, a single acceleration sensor may be used. When detecting movement of the housing 303 in a three-dimensional space, detection may be further performed perpendicular to the detection axes 305 and 306. A third acceleration sensor may be provided on the axis.

An operation start button 308 may be provided on the front surface 307 of the housing 303 to detect the movement of the housing 303 while the user presses the button 308. Note that a contact sensor that senses a user's contact may be provided in the housing 303 to detect movement while the housing 303 is held by hand. Note that these buttons 308
The movement of the housing 303 may be analyzed when the output level from the acceleration sensor exceeds a predetermined threshold value (ThHigh, ThLow) without providing a contact sensor or a contact sensor.

FIGS. 4A and 4B show a motion detecting section 101.
FIG. 5 is an explanatory diagram of output data obtained in FIG. 4A is an acceleration curve output from the acceleration sensor 302, for example, when the operation instruction output device is shaken once in the positive direction of the detection axis 306 and stopped. The reciprocal of the time required for this one operation, that is, the frequency f1
Is about 1 to 5 Hz.

A curve 402 shown in FIG. 4B is, for example, an acceleration curve output from the acceleration sensor 301, and is obtained when the operation instruction output operation is hit once in the positive direction of the detection axis 305. The frequency f2 in this case is 100 to 150
Hz. As described above, the frequency differs depending on the type of operation applied to the user's operation instruction output device, for example, the difference between “shake” and “hit”. The present invention reflects this difference in the type of user operation in the content of the operation instruction.

Next, the motion analyzer 102 will be described. The motion analysis unit 102 analyzes the sign, magnitude, and inflection point of the acceleration data obtained from the motion detection unit 101 to analyze the direction, strength, and number of motions, and determines the obtained result for processing. Notify section 104. As can be seen from the hardware configuration of the motion analysis unit 102 (see FIG. 2), the motion analysis unit 1
In step 02, analysis processing is performed by the CPU 204 in accordance with a program stored in the ROM 205.

The method of analysis processing will be described with reference to the flowcharts shown in FIGS. First, processing according to the flowchart shown in FIG. 5 will be described. At this time, the RAM 206
Is used as the analysis result buffer. Here, it is assumed that the acceleration value output from the motion detection unit 101 is indicated by a dashed line 701 shown in FIG.

The motion analysis unit 102 is provided with the user's button 30
8, the motion analysis process is started by triggering the pressing of the button 8 or the change in the output values of the acceleration sensors 301 and 302. First, the buffer 206 holding the analysis result is cleared (S50).
1), the values of the variables DataSum, Maxsum, and Counter are initialized to “0” (S502). Next, one acceleration value output from the motion detection unit 101 is acquired (S503), and the value is set to a predetermined threshold value (positive ThHigh and negative ThLo).
w) is determined (S504), and if not, the process proceeds to S512, and if not, the variable DataSum is determined.
(S505). Where the variable DataSum
Represents the speed because it integrates (accumulates) the acceleration value.

Next, the absolute value of the variable DataSum is equal to the threshold Thr.
It is determined whether or not esholdSum is exceeded (S50)
6). In FIG. 7A, the dashed line 702 indicates ThresholdS
um. The value of the variable DataSum is the speed curve 703
Indicated by When it is determined that the value has exceeded the value, for example, at time T2 in FIG.
(S507), | DataSum |> | MaxSum |
Is determined (S508). If not, S
Returning to 503, if affirmative, the variable DataSu is added to the variable MaxSum.
The value of m is substituted (S509), and the process returns to S503. This processing of S509 continues until time T3.

If it is determined that it does not exceed, for example, it is determined whether or not MaxSum = 0 at times T1 and T4 in FIG. 7A (S510). If not, ie, time T
In step 4, MaxSum is written to the analysis result buffer 206 (S511), and the process returns to S502. If affirmative, S51
In step 2, the value of the variable Couter is increased by "1". next,
It is determined whether or not the value of the variable Counter exceeds a predetermined value EndCount (S513). If not, the process returns to S503, and if affirmative, it is determined whether or not the analysis result buffer 206 is not empty (S514). ). If it is empty, the motion analysis process is terminated.
6 determines the contents of the variable MaxSum written in 6
04 (S515), and the process ends.

The value of EndCount is set depending on the sampling interval of the acceleration value in S503, and is adjusted so that the process is terminated when the time until time T1 or the time after time T4 continues for several seconds. . The value of EndCount may be changed by the user. The value of the variable MaxSum notified to the process determining unit 104 is as shown in FIG.
Is the integral value at time T3, and physically means the maximum speed when the operation instruction device is shaken.

The sign of the variable MaxSum indicates whether the variable is moved in the positive or negative direction, and the magnitude indicates whether the swing is strong or weak. Also, FIG. 7A shows that the value of MaxSum is only one, so that the number of times of swing is “1”. next,
FIG. 7B shows the acceleration value output from the motion detection unit 101.
The case shown by the broken line 704 shown in FIG.

In this case, the variable DataSum at time T5
Is first written to the analysis result buffer 206 in S511 as a variable MaxSum. Thereafter, between the time T6 and the time T7, the speed curve 705 is changed to the ThresholdSum 706.
In step S512, the value of the variable Counter is increased by “1”.
Is not exceeded, the processing is not terminated, and
1, the value of the variable DataSum at time T8 is changed to the variable MaxSu
m is written to the analysis result buffer 206 a second time.

When the motion analysis unit 102 acquires an acceleration value as shown in FIG.
MaxSum is notified to the processing determining unit 104. Note that S515
At the time of notifying the processing determination unit 104 of the contents of the analysis result buffer 206, it also notifies which of the acceleration sensors 301 and 302 the analysis result is.

In step S503, one acceleration value is obtained in response to the output from the motion detection unit 101. However, the acceleration value may be obtained one by one by temporarily storing it in the RAM 206. Good. Note that S50
As shown in FIG. 8, the judgment at 4 is that, in the motion detection unit 101, the output values from the acceleration sensors 301 and 302 exceed the first threshold value (ThHigh) on the plus side or the second threshold value on the minus side. When the acceleration value is smaller than the threshold value (ThLow) and the acceleration value is output (with signal processing), it becomes unnecessary.

Therefore, the motion detecting section 101 sets the time t
The acceleration values are output to the motion analysis unit 102 and the user motion analysis unit 103 at 1 to t2 and t3 to t4, and the time t0 to t1,
Nothing is output after t2 to t3 and t4. Such processing and the determination in S504 are performed by the acceleration sensors 301 and 3
This is to avoid unnecessary processing with the output of an acceleration value having a small error level from 02.

Next, an analysis process according to the flowchart shown in FIG. 6 without using the analysis result buffer 206 will be described.
The motion analysis unit 102 first initializes the values of the variables DataSum and MaxSum to “0” (S601), determines whether or not there is an end instruction (S602), and ends the process if there is. In addition,
The termination instruction is determined based on whether or not the button 308 is released. Alternatively, the termination instruction may be received from the processing determination unit 104 after outputting the operation instruction to the information processing apparatus.

When there is no end instruction, the motion detecting section 10
1 is sampled (S60).
3) Update the variable DataSum by adding the acceleration value to the variable DataSum (S604). Next, it is determined whether or not the absolute value of the variable DataSum exceeds the threshold ThresholdSum (S6).
05), if not exceeded, it is determined whether or not the variable MaxSum = 0 (S606). If affirmative, the process returns to S602, and if negative, the process proceeds to S609. If it is determined in S605 that the value exceeds the absolute value, the absolute value of the variable DataSum is
It is determined whether or not the sum exceeds the absolute value (S60).
7) If negative, return to S602; if affirmative, variable
Substituting the value of the variable DataSum into MaxSum (S608),
Return to 602.

In step S609, the value of the variable MaxSum is notified to the processing determining unit 104, and the process returns to step S601. The difference between this analysis method and the above-described analysis method using the analysis result buffer 206 is that the processing determination unit 1 determines the maximum value or the minimum value of the variable MaxSum.
04 are notified sequentially or collectively, and are not essentially different.

Next, the user operation analysis unit 103 will be described. Upon receiving the analysis instruction from the motion analysis unit 102, the user motion analysis unit 103 performs a fast Fourier transform on the time-series acceleration values output from the motion detection unit 101, and notifies the processing determination unit 104 of the peak value of the frequency. At this time, the peak value of the frequency is lower than the predetermined frequency (FR
When the frequency is less than (EQ_LOW) or exceeds a predetermined frequency (FREQ_HIGH) on the high frequency side, the processing determination unit 104 is notified of prohibition of the output of the operation instruction.

The user motion analysis unit 103 is also analyzed by the CPU 204 in accordance with a program stored in the ROM 205, similarly to the motion analysis unit 102. FIG.
9 is a flowchart for explaining the processing of the user operation analysis unit 103. Upon receiving an instruction to start analysis from the motion analysis unit 102, the user motion analysis unit 103
1 to obtain the time-series acceleration values output from S1 (S90).
1).

Next, FFT (Fast Fourier Transform) processing of the obtained acceleration curve is performed to obtain a frequency distribution (S90).
2). FIG. 10A shows an acceleration curve 1001 due to a user continuously “shaking” the housing 303.
FIG. 10B shows a frequency distribution curve 1002 obtained by the FFT processing. Frequency distribution curve 1002
Peak position 1003 is 1 to 5 Hz.

FIG. 11A shows a case where the user places two
FIG. 11B shows an acceleration curve 1101 obtained by the “hitting” operation twice, and FIG. 11B shows a frequency distribution curve 1102 obtained by the FFT processing. Frequency distribution curve 11
The peak position 1103 of 02 is 100 to 150 Hz. The user operation analysis unit 103 notifies the processing determination unit 104 of the frequency at the main peak position of the obtained frequency distribution curve and the type of the detected acceleration sensor (S903), and ends the processing.

Note that in S903, FIG.
A frequency whose peak position is a frequency lower than the first frequency (FREQ_LOW) 1004 on the low frequency side or a frequency higher than the second frequency 1005 on the same high frequency (FREQ_HIGH) side indicated by a dashed line in FIG. When the distribution curve is obtained, the processing determination unit 104 is notified that the operation instruction is not output in place of the notification of the frequency. The first frequency 1004 is set to, for example, 1 Hz. The frequency distribution having a peak position below the first frequency is analyzed when the housing 303 is placed at an inclined position and moves naturally. The second frequency 1005 is set to, for example, 200 Hz. The frequency distribution having the peak position at a position exceeding the second frequency is analyzed when the housing 303 is hit or dropped. Therefore, the first frequency 1004
And the second frequency 1005 are set, and the processing determination unit 10
4 prevents an erroneous operation instruction from being output to the information processing apparatus.

Next, the processing determining unit 104 will be described. The processing determination unit 104 has a processing determination table recorded in the ROM 205 in advance. Motion analysis unit 10
2 and the peak position of the frequency distribution notified from the user operation analysis unit 103,
The corresponding operation instruction in the processing determination table is read out and output to the information processing device via the communication device 207. The communication device 207 outputs an infrared signal indicating an operation instruction from a window provided on the front surface 304 of the housing 303 to a light receiving unit (not shown) provided in the information processing device via an infrared transmission path.

FIG. 12 is a view for explaining the contents of the processing decision table 1201. Here, the sensor 1 corresponds to the acceleration sensor 301, and the sensor 2 corresponds to the acceleration sensor 302. For the sensor 1 from the user operation analysis unit 103, refer to the classification column of the low frequency 1202 when the frequency of the notified peak position is a predetermined value, for example, 50 Hz or less, and to the classification column of the high frequency 1203 when the frequency exceeds the predetermined value. I do.

If the value of the variable MaxSum notified from the motion analysis unit 102 is positive, the column of the forward direction 1204 is
If the value is negative, the column in the negative direction 1205 is set. If the value of the variable MaxSum is two or more, ie, plus or minus, continuous 1206 is set.
If there is no notification, the instruction contents are read by referring to the columns of “0” 1207 if there is no notification. The same applies to the notification for the sensor 2.

For example, the peak position of the frequency of the sensor 1 from the user motion analysis unit 103 is 6 Hz, and the motion analysis unit 102
Is notified that the variable MaxSum is a positive value, and when there is no notification about the sensor 2,
At 02, the “upward movement” 1208 corresponding to the “0” column of the sensor 2 in the forward direction column 1204 is read as the content of the operation instruction, and output from the communication device 207 to the information processing device.

Further, there is no notification about the sensor 1, and the sensor 2 has a frequency peak position of 2 Hz and a variable Ma.
When xSum is notified that it has a positive value, sensor 1
In the “0” column 1207 of “No.” and in the low frequency column of the sensor 2, “Move right” 1209 in the forward direction column is read and output to the information processing apparatus. As described above, the user shakes the housing 303 of the operation instruction device to “move” the cursor position and the screen content displayed on the display screen of the information processing device in the same direction as the movement direction of the housing 303. Can be output.

As can be seen from the processing determination table 1201, the processing determination unit 104 can distinguish “0” (no motion), “forward”,
“Low frequency”, “High frequency” that can be distinguished from “negative direction” and “continuous positive / negative” by notification from the user operation analysis unit 103
Thus, the contents of the seven operation instructions can be determined for one sensor. Therefore, when two sensors are installed, a maximum of 49 processing contents can be determined.

However, in the present embodiment, the movement processing system (up, down, right, upper right, lower right, upper left, lower left, lower left , Previous page, next page, first page), screen processing system (zoom in,
There are 16 types of processing contents: zoom-out) and command (operation cancellation, re-operation, selection). Next, the overall operation of the present embodiment will be described with reference to the flowchart in FIG.

First, when the motion detection unit 101 starts motion detection by pressing the button 308 by the user or the like,
The motion analysis unit 102 is instructed to start motion analysis (S
1301). The motion analysis unit 102 determines whether or not there is a motion (S1302).
03 is instructed to start the user motion analysis, and when there is no instruction, S
Move to 1306.

Upon receiving the instruction to start the user operation analysis, the user operation analysis unit 103 analyzes the frequency distribution (S1).
303). It is determined whether the frequency peak value is less than FREQ_LOW or exceeds FREQ_HIGH (S1).
304). If affirmative, the process moves to S1306. This prevents an erroneous operation instruction from being output when the operation instruction device is hit.

If not, the process determining unit 104 determines the content of the operation instruction from the result of the motion analysis and the result of the user motion analysis, and outputs the operation instruction to the information processing apparatus (S130).
5). In step S1306, the motion detection unit 101 determines whether the motion has been stopped. If the motion has not been stopped, the process returns to step S1302. If the motion has been stopped, an instruction to stop the motion analysis has been given to the motion analysis unit 102 (S1307). To end.

In the above embodiment, the CPU 204 processes the user motion analysis unit 103 in accordance with the fast Fourier transform processing program recorded in the ROM 205. However, as shown in FIG. In parallel with the processing of the motion analysis unit 102, fast Fourier transform can be performed. Although the process determination table 1201 is stored in the ROM 205 in advance, a storage device 1402 is provided in the process determination unit 104 to change and hold the operation instruction contents of the process determination table for each user, It may be changed dynamically according to preference.

In the processing determining unit 104, the peak position of the frequency notified from the user operation analyzing unit 103 is classified into two types of user operations of low frequency and high frequency. Alternatively, the content of various operation instructions may be included. Also, the processing determining unit 1
04 uses only the sign of the variable MaxSum notified from the motion analysis unit 102, but in consideration of its absolute value,
The strength of the user's operation may also be an element for determining the operation instruction.

In the hardware configuration shown in FIG. 2, an operation instruction is output from the communication device 207 to the information processing device. However, as shown in FIG. 15, the bus 208 is directly connected to the information processing device. Alternatively, the display screen of the information processing apparatus may be controlled. In the above embodiment, the predetermined frequency on the high frequency side (FREQ_HIGH)
The peak position of the frequency exceeding
Although the output of the operation instruction from the processing determination unit 104 is prohibited when the analysis is performed in the above, as another embodiment, the value of the variable MaxSum analyzed by the motion analysis unit 102 at that time is recorded. It can be used as an accident record of the operation instruction output device. This makes it possible to analyze the cause of the device failure caused by dropping or hitting the device.

(Embodiment 2) Next, an operation instruction output apparatus according to Embodiment 2 of the present invention will be described. In this operation instruction output device, instead of performing the FFT processing by the user motion analysis unit 103 of the first embodiment, the amount of change in the acceleration value is calculated to distinguish the type of the user motion. Other components are substantially the same as those in the first embodiment.

When the time-series data (acceleration curve) 1601 of the acceleration value shown in FIG. 16 is obtained from the motion detection unit 101, the user operation analysis unit obtains the differential value dv / dt which is the change amount of the acceleration value per unit time. Calculate the average value in one series. From the motion detection unit 101, the error level (positive Th
When the absolute value exceeds the acceleration value (High or less, minus Th or more), a voltage value v proportional to the acceleration value is output at a predetermined sampling interval (for example, 2 ms).
That is, since dt is constant, the absolute value of the difference between the acceleration values (voltage values) (| v1-v0 |, | v
2-v1 |, | v3-v2 |, ... | v19-v18
|) And the average of those values is calculated
Notify. When there are n sampling points in one series for performing the user motion analysis, the output value D is represented by Expression (1).

[0048]

(Equation 1)

When the output of the acceleration value from the motion detecting unit 101 is a gradual change in the acceleration value as shown in FIG. 4A, the average differential value D calculated by the output equation (1) becomes a small value. In the case of a sharp change as shown in FIG. 4B, the output differential value average value D becomes a large value. Processing decision unit 1
04 compares the average value D of the acceleration differential value output from the user motion analysis unit 103 with a predetermined value,
It is determined whether the user's operation is a low-frequency operation that is slowly shaken or a high-frequency operation when the user is hit, and the process determination table 1201 illustrated in FIG. 12 is applied.

Note that the user operation analysis unit 103 determines that the average differential value D calculated by the equation (1) is equal to a predetermined threshold A
Less than CCEL_LOW or predetermined threshold ACCEL_
If the value exceeds HIGH, the processing determination unit 104 is notified not to output the content of the operation instruction. Embodiment 1
This is a value corresponding to FREQ_LOW and FREQ_HIGH in order to prevent noise from being output or output of an erroneous operation instruction when dropped.

ACCEL_LOW, ACCEL_H
The value of IGH is set according to the maximum output value of the acceleration sensors 301 and 302. For example, ACCEL_LOW is set to a value of 0.1 times the maximum output value, and ACCEL_HIGH is set to a value of 0.7 times the maximum output value, so that processing for a very slow operation and a violent operation is not performed. be able to.

The operation of the user operation analysis unit 103 is shown in a flowchart shown in FIG. User operation analysis unit 103
Acquires the time series data of the acceleration value (S1701),
The average value D of the differential value is calculated according to the equation (1) (S170).
2), the value D is notified to the processing determining unit 104 (S17).
03), end the processing. The operation of the present embodiment is different from the operation of the first embodiment shown in FIG. 13 only in S1304. Instead of S1304, the user action analysis unit determines that the average differential value D is equal to the predetermined threshold ACCE.
Less than L_LOW or predetermined threshold ACCEL_HIG
It is determined whether or not H is exceeded.

(Embodiment 3) Next, an operation instruction output apparatus according to Embodiment 3 of the present invention will be described. This operation instruction output device has substantially the same configuration as that of the first embodiment, but differs in the analysis method in the user motion analysis unit 103. User operation analysis unit 103 according to the first embodiment
Calculates the acceleration curve output from the motion detection unit 101 as FF
Although the frequency distribution was obtained by performing T processing, in the present embodiment, the processing is determined by analyzing whether the acceleration curve output from the motion detecting unit 101 is a high-frequency component or a low-frequency component by wavelet transform. Notify section 104.

The wavelet transform is a kind of filter that extracts only a waveform similar to a previously prepared waveform from a certain waveform. Regarding wavelet transform, "Mathematical method for wavelet applied signal analysis"
(Tokyo Denki University Press, Charles K. Chuwi, 19
97) etc., and the description is omitted. A specific example of the wavelet transform will be described with reference to FIG.

In FIG. 18, when an acceleration curve 1801 output from the motion detection unit 101 is obtained, a mother wavelet 1802 of a frequency to be detected, for example, 100 Hz is obtained.
Are moved in parallel on the time axis, and the product 1803 with the acceleration curve 1801 is calculated. Note that the mother wavelet 1802 uses a rectangular wave. Acceleration curve 180
At 1, the waveform starting from time t0 has a shape similar to that of mother wavelet 1802, and the product value 18
03 is a large positive value. When the waveform of the acceleration curve is significantly different from that of the mother wavelet, for example, in the case of an acceleration curve having a frequency of several Hz, both the positive and negative product values are output, and when the product values are integrated in one series, the value becomes close to 0. It can be seen that there is no waveform of the frequency to be detected. Similarly, when a wavelet transform is performed using a 5 Hz mother wavelet, a waveform of an acceleration curve having a low frequency close to 5 Hz can be detected. The user operation analysis unit performs an analysis process using a plurality of mother wavelets around a high frequency band, for example, around 100 Hz and a plurality of mother wavelets around a low frequency band, for example, around 5 Hz.
The result is notified to the processing determining unit 104.

Since the wavelet transform can detect the strength and the position of occurrence of the acceleration curve, it can also be used for the motion analysis processing in the motion analysis unit 102. Since the user's operation in the case where the high-frequency "hitting" operation is performed next to the frequency "shaking" operation can also be analyzed, the processing determination unit 104 can determine the content of the processing in the composite operation. Further, it is also possible to analyze an acceleration curve output by a complex method in which high-frequency detection is performed by wavelet transform, and low-frequency detection is performed by the acceleration curve differentiation method described in the second embodiment. Further, the frequency range to be detected is not limited to the high frequency and the low frequency, and three or more types of frequency ranges may be detected according to the number that can be processed by the processing determination unit 104. In addition, the mother wavelet for performing the wavelet transform is a rectangular wave, but this is to reduce the amount of calculation when performing the product with the analysis waveform, and to increase the detection accuracy, the
An echies wavelet or the like may be used.

(Embodiment 4) Next, an operation instruction output device according to Embodiment 4 of the present invention will be described. Although the configuration of this operation instruction output device is substantially the same as the configuration of the first embodiment shown in FIG. 1, the configuration is such that the motion analysis unit 102 and the user motion analysis unit 103 mutually notify the analysis result. Are different. Hereinafter, the configuration unique to the present embodiment will be mainly described. The motion analysis unit 102 sequentially compares the acceleration value output from the motion detection unit 101 with a predetermined reference value, and analyzes the motion direction based on the sign (positive or negative) of the acceleration value when the predetermined reference value is first exceeded. Then, the strength of the motion is analyzed by measuring the time during which the acceleration value exceeds the reference value.

The user motion analysis unit 103 includes the motion analysis unit 1
Based on the time during which the acceleration value measured in 02 exceeds the reference value, it is determined whether the user action is “shake” or “hit”. In the first embodiment, the motion analysis unit 102 integrates the acceleration value output from the motion detection unit 101, but in the present embodiment, measures the time during which the acceleration value exceeds a predetermined reference value. Therefore, it is not necessary to integrate the acceleration value because the strength is analyzed. Therefore,
It is also possible to use an analog comparator instead of the A / D converter 203 of the motion detection unit 101 shown in FIG.

The processing contents of the motion analysis unit 102 and the user motion analysis unit 103 according to the present embodiment will be described using the acceleration curves shown in FIGS. 19 and 20 as examples. FIG. 19 shows an acceleration curve 1901 output from the acceleration sensor 302, for example.
In this case, the user shakes the operation instruction output device once in the positive direction of the detection axis 306 and stops the operation instruction output device.

FIG. 20 also shows an acceleration curve 2001 output from the acceleration sensor 302, in which the user hits the operation instruction output device once in the positive direction of the detection axis 306. In both figures, the vertical axis represents the acceleration sensor 30.
2 shows the voltage output from FIG. 2, and the horizontal axis shows time.

The first reference value shown by the broken line in FIG.
SwingThresholds 1902 and 1903 are voltage values corresponding to acceleration values that normally exceed when the user shakes the operation instruction output device. This SwingThreshold is, for example, 1G
(G is a gravitational acceleration), but this value may be changed by a user or an operation instruction output device. Although the voltage output from the acceleration sensor 302 is a voltage, the voltage and the acceleration
Since this voltage is proportional, a predetermined conversion coefficient is multiplied by 1 G
Is obtained.

The first reference value shown by the broken line in FIG.
SwingThresholds 1902 and 1903 are the same as those in FIG. ± Ta which is a second reference value also shown by a broken line
pThreshold 2002 and 2003 are voltage values corresponding to acceleration values that normally exceed when the user hits the operation instruction output device. The TapThreshold is set to, for example, a value corresponding to 2.5 G, but this value may be changed by a user or an operation instruction output device.

The value of this TapThreshold is SwingThreshold
Is absolutely larger than the value of the threshold value, and the absolute value of the acceleration value does not exceed the value of the TapThreshold when the user action is “shake”. First, a case where the acceleration curve 1901 shown in FIG. 19 is output by a user operation will be described. First, the motion analysis unit 102 calculates the acceleration curve 1 from the motion detection unit 101.
The output of the acceleration value indicated by reference numeral 901 is sequentially received at predetermined time intervals, for example, every 2 milliseconds, and the absolute value of the acceleration value is Sw.
It is determined whether it exceeds ingThreshold. Time T1
When it is determined that the absolute value of the acceleration value exceeds the SwingThreshold, the time during which it is determined that the absolute value has exceeded the SwingThreshold is measured. At this time, the direction of the motion is analyzed from the sign of the acceleration at time T1 (positive at this time). Further, the motion analysis unit 10
2 is Ta where the absolute value of the acceleration value is larger than SwingThreshold.
It is determined whether or not pThreshold (see FIG. 20) is exceeded.
The acceleration curve 190 in FIG. 19 in which the user action is “shake”
In 1, no acceleration value whose absolute value exceeds TapThreshold appears.

When the motion analysis unit 102 determines that the absolute value of the acceleration value has become equal to or smaller than SwingThreshold at time T2,
The time t1 from the time T1 to the time T2 is obtained, and the intensity of the motion is analyzed based on the time t1. The user motion analysis unit 103 is notified that the time t1 and the absolute value of the acceleration have become equal to or smaller than the SwingThreshold. The motion analysis unit 102 calculates the time T
After 2, a notification of the acceleration value is received from the motion detection unit 101, and it is determined whether or not the absolute value of the acceleration value exceeds SwingThreshold. When it is determined that the time has passed at time T3, the fact is notified to the user operation analysis unit 103.

The time t3 between the time T3 and the time T4 is
Although the absolute value of the acceleration exceeds SwingThreshold,
Since this is the reverse acceleration that occurs when the user's motion “shake” is stopped, it is not measured. The absolute value of the acceleration at time T4
If it is determined that it has become equal to or smaller than the SwingThreshold, the fact is notified to the user operation analysis unit 103. Note that FIG. 19 shows the acceleration curve 1901 in which the user action “shakes” once, so that the absolute value of the swing curve is changed again after the time T2.
Although an acceleration value exceeding hold does not appear, when it does, it is analyzed as the number of movements.

The motion analysis unit 102 is the user motion analysis unit 1
Upon receiving an instruction from 03 to notify the processing determination unit 104 of the analysis result, the processing unit 104 notifies the processing determination unit 104 of the movement direction, the movement strength, and the number of movements. Upon receiving the notification that the absolute value of the acceleration is equal to or less than SwingThreshold from the motion analyzing unit 102, the user motion analysis unit 103 Alternatively, a time t4 until a predetermined time elapses is measured. The predetermined time is, for example, 100 milliseconds,
This is a time when it can be considered that there is no motion input such as “shake” or “hit” of the user action.

When the predetermined time has elapsed, the user motion analysis unit 103 is notified by the motion analysis unit 102.
The type of user action is analyzed based on the time exceeding SwingThreshold or TapThreshold. In addition, the motion analysis unit 102
The analysis result, such as the movement direction, which has been analyzed, is
Instruct to notify. The user operation analysis unit 103
When it is notified that both of the reference values of SwingThreshold and TapThreshold have been exceeded, "hit" of the user operation is prioritized. This is because whenever an acceleration value exceeding the TapThreshold is output, an acceleration value exceeding the SwingThreshold is output.

The acceleration curve 19 shown in FIG.
01 from the motion detection unit 101 to the motion analysis unit 10
2, the motion analysis unit 102 notifies the user motion analysis unit 103 of the fact that SwingThreshold has been exceeded and the time t1. After a lapse of a predetermined time (for example, 100 milliseconds) from time T4, the user action analysis unit 103 analyzes that the user action is “shake” and notifies the processing determination unit 104.

When analyzing the user action, the user action analysis unit 103 sets the time exceeding the SwingThreshold to a predetermined first time.
Time, for example, less than 10 milliseconds or TapThresho
If the time exceeding ld is longer than a predetermined second time, for example, 20 milliseconds, the processing decision unit 104 is notified of the malfunction without notifying the type of operation. Furthermore, Swin
The time exceeding gThreshold is a predetermined third time, for example, 40
Similarly, when the operation time is longer than 0 milliseconds, the operation determination unit 104 is notified of the malfunction without notifying the operation type.

The first time is for excluding short-term vibrations not intended by the user, and the third time is for the case where the present apparatus is operated while riding in a car or the like that accelerates for several seconds. Is excluded. In the second time, TapThres of the acceleration generated when the user hits the apparatus with a finger
Since the time exceeding the hold is usually about several milliseconds to about 10 milliseconds, an accident or a failure of the apparatus is excluded.

Next, the processing contents of the motion analysis unit 102 and the user motion analysis unit 103 will be described using the acceleration curve shown in FIG. 20 as an example. The motion analysis unit 102 determines whether or not the absolute value of the acceleration value sequentially output from the motion detection unit 101 exceeds SwingThreshold. If it is determined at time T5 that the absolute value of the acceleration value exceeds SwingThreshold, the motion analysis unit 102 Measure the time you have. In addition, the sign of the acceleration at the time when the speed is exceeded is defined as the movement direction.

Further, the motion analysis unit 102 determines whether or not the absolute value of the output acceleration value exceeds the TapThreshold. If it is determined that the acceleration value has exceeded the threshold value at time T6, the motion analysis unit 102 measures the duration of the excess. While the time exceeding the TapThreshold is being measured, it is not measured as the time exceeding the SwingThreshold. If it is determined at time T7 that the acceleration value has become equal to or less than the TapThreshold, the time t6 during which the acceleration value has exceeded the TapThreshold is notified to the user motion analysis unit 103. Further, the time until the absolute value of the acceleration value becomes equal to or smaller than the SwingThreshold is measured.
This is a time until the time becomes equal to or less than gThreshold, and is a short time obtained by subtracting a time t6 exceeding the TapThreshold from a time t5 from time T5 to time T8. However, this time (t5−t6) is set to the SwingThr.
Although the notification is made together with the notification that the value has become equal to or smaller than eshold, the user operation analysis unit 103 does not consider it. After the time T8, in the acceleration curve 2001, the absolute value of the acceleration value does not exceed SwingThreshold. When instructed by the user motion analysis unit 103 to notify the analysis result to the process determination unit 104, the motion analysis unit 102 notifies the process determination unit 104 of the motion direction and the motion intensity. At this time, when measuring two times corresponding to the movement strength,
When the time exceeding the SwingThreshold and the TapThreshold is measured, only the time exceeding the TapThreshold, for example, the time t6, is notified to the processing determining unit 104.

The user motion analysis unit 103 includes the motion analysis unit 1
02, when the absolute value of the acceleration value becomes equal to or less than SwingThreshold, the motion analysis unit 102 further sends SwingT
A time t8 is received until the notification that the threshold has been exceeded is received or a predetermined time elapses. When it is measured that the predetermined time has elapsed before the movement analysis unit 102 has notified that SwingThreshold has been exceeded, the motion analysis unit 102 is instructed to notify the processing determination unit 104 of the analysis result.

Further, the user motion analysis unit 103 calculates the time t exceeding the TapThreshold notified from the motion analysis unit 102.
6 is not longer than the predetermined second time, and notifies the processing determination unit 104 that the user action is “hit”. The processing determining unit 104 reads a corresponding operation instruction in the processing determining table 1201 based on the analysis results from the motion analyzing unit 102 and the user motion analyzing unit 103, as in the first to third embodiments, and sets the communication device. Output to the information processing device via Note that, in the present embodiment, “low frequency” 1202 of the process determination table 1201 described above, etc.
Items such as “high frequency” 1203 are “shake”,
The operation instruction is read as “hit”.

Further, upon receiving the notification of the malfunction from the user operation analysis unit 103, the processing determination unit 104 transmits an operation instruction from the processing determination table even if the notification of the analysis result is received from the motion analysis unit 102. Do not read. Next, the operation of the present embodiment will be described with reference to the flowcharts of FIGS.

First, the motion analysis unit 102 sets an initial value “0” to each variable (S2102). The variable accFlag is
This is a variable indicating whether or not the absolute value of the acceleration value output from the motion detection unit 101 has exceeded a predetermined reference value, for example, the value of SwingThreshold. The variable swingCounter is a variable indicating the time when the absolute value of the acceleration value has exceeded SwingThreshold.
In the present embodiment, since the acceleration value is output every 2 milliseconds, if the value of the swingCounter is doubled, the time exceeding the reference value is obtained in millisecond units.

The variable tapCounter indicates that the absolute value of the acceleration value is Ta.
It is a variable indicating the time that exceeded pThreshold.
Doubling the value of ounter gives the time above the reference value in milliseconds. The variable idleCounter is a variable included in the user motion analysis unit 103,
This is performed simultaneously with the initialization of each variable. Variable idleCounter
Indicates that the absolute value of the acceleration value is once the reference value (SwingThreshol
It is a variable that indicates the time when the value falls below the reference value after exceeding d). Similarly, when the value is doubled, the time when the value becomes equal to or less than the reference value is obtained in milliseconds.

The variable swingDirect is a reference value SwingThreshol
This is a variable indicating the sign of the acceleration value when d exceeds d, and the value of the variable direct is given. The variable tapDirect is the reference value T
This is a variable indicating the sign of the acceleration value when it exceeds apThreshold, and is given similarly to the variable swingDirect. Variable dir
ect is a variable indicating a sign when the acceleration value exceeds the reference value, and “1” is given when the sign is positive, and “−1” is given when the sign is negative, and indicates the movement direction. Things.

Next, the motion analysis section 102
The acceleration value output from 01 is acquired every 2 milliseconds and substituted for the variable acc. The variable acc indicates an acceleration value (S21).
04). The absolute value of the variable acc is the first reference value SwingThreshol
It is determined whether d is exceeded (S2106). If it exceeds, the variable accFlag is set to “1” and the user operation analysis unit 103 is instructed to set the variable idleCounter to “0” (S2108). The user operation analysis unit 103 receives the instruction, and receives the variable idleCounter
Is set to “0”.

Next, the motion analysis unit 102 determines whether or not the value of the variable acc exceeds “0” (S 2110), and if so, gives “1” to the variable direct (S 2112).
If it is below, “−1” is given to the variable direct (S211)
4). The motion analysis unit 102 determines whether the absolute value of the variable acc exceeds the second reference value TapThreshold (S
2116). If not, it is determined whether the value of the variable swingDirect is “0” (S2118). If “0”, the value of the variable direct is substituted into the variable swingDirect (S2120). Leave the variable swingD
It is determined whether the values of irect and the variable direct are the same (S2122). If they are the same, "1" is added to swingCounter (S2124). If not, it is determined whether or not there is an instruction from the user motion analysis unit 103 to notify the analysis result to the processing determination unit 104 (S2126).
If not, the process returns to S2104, and if instructed, notifies the processing determination unit 104 of the value of the variable swingDirect indicating the direction of movement and the value of the variable swingCounter indicating the strength of movement (S2104).
2128), and the process ends.

If the motion analysis unit 102 determines in S2116 that the absolute value of the variable acc exceeds the second reference value TapThreshold, it determines whether the variable tapDirect is “0” (S2130). If "0", the variable tapD
The value of the variable direct is substituted for irect (S2132),
If it is not "0", leave it as is, and change the variables tapDirect and d.
It is determined whether the value with irect is the same (S213)
4). If they are the same, "1" is added to the variable tapCounter (S2136), and if not, the flow moves to S2126.

When the motion analyzing unit 102 determines in S2106 that the absolute value of the variable acc is equal to or smaller than SwingThreshold, it determines whether or not the variable accFlag is "1" (S2138). To
If “1”, the process proceeds to S2202, which is the process of the user action analysis unit 103. User operation analysis unit 103
Adds “1” to the variable idleCounter (S2202),
Next, it is determined whether or not the variable idleCounter exceeds a predetermined IDLE # TIME (S2204).
Returning to 104, if it exceeds, the analysis result is determined by the processing decision unit 1.
04 to the motion analysis unit 102 (S2).
206). Here, IDLE_TIME refers to the time during which it is considered that there is no motion input such as “shake” or “hit” of the user motion, and is set to “50” corresponding to 100 milliseconds, for example.

Next, the user action analysis unit 103 sets the variable ta
It is determined whether or not pDirect is “0” (S220).
8) If not, tapCounter exceeds “0”, and
It is determined whether it is less than TAP # TIME # MAX (S2210). Here, TAP_TIME_MAX corresponds to the above-described second predetermined time, and is, for example, “10” because the acceleration value is output every 2 milliseconds. If no, the processing determination unit 104 is notified of the malfunction (S2212),
It returns to S2102. When the result is affirmative, the process determination unit 104 is notified that the type of the user action is “hit” (S2214), and the process returns to S2102.

In S2208, the user operation analysis unit 1
In step 03, when it is determined that the variable tapDirect is “0”, it is determined whether the variable swingDirect is “0” (S2216). If it is “0”, the process returns to S2102.
If not, it is determined whether the variable swingCounter is greater than SWING # TIME # MIN and less than SWING # TIME # MAX (S2218). Here, SWING_TIME_MIN corresponds to the above-described predetermined first time, and is, for example, “5” because the acceleration value is output every 2 milliseconds. SWIN
G # TIME # MAX corresponds to the third time described above, and is similarly “200”.

If not, the processing decision unit 104 is notified of the malfunction (S2220), and the process returns to S2102. When the result is affirmative, the process determining unit 104 is notified that the type of the user action is “shake” (S2222),
It returns to S2102. In this embodiment, the processing of the acceleration value output from one acceleration sensor has been described for the sake of simplicity. However, as in the other embodiments described above, the operation using a plurality of acceleration sensors is performed. The instruction content may be determined.

In the present embodiment, SwingThreshold
And two threshold values, TapThreshold, and analyzed the type of user action to “shake” and “hit”, but by setting more reference values, the types of actions to be analyzed were increased,
As a result, the content of the operation instruction output by the process determining unit 104 can be further increased. In the present embodiment, the user motion analysis unit 103 determines that a malfunction has occurred when the time exceeding the TapThreshold exceeds the above-described predetermined second time. The value is about twice the value of TapThreshold, for example, 5G
When a value corresponding to the threshold value is set as a threshold value and an acceleration exceeding the threshold value is output, it means that the apparatus main body has been dropped or hit, and it may be determined that a malfunction has occurred. Similarly, when an acceleration value of less than 1 G is output, it may be determined that the device is malfunctioning.

In the first, second, third, and fourth embodiments, an acceleration sensor is used for the motion detection unit 101, but an angular acceleration sensor may be used instead of the acceleration sensor. For example, in the acceleration sensor 301, the detection axis 30
Although acceleration in five directions was detected, the acceleration sensor 3
By providing an angular acceleration sensor at position 01, when the user holds the operation instruction output device by hand and performs a rotating operation, the angular acceleration of the rotational movement starting from the wrist is tangential to the detection axis 305 direction. Is detected as

(Application Example) An application example of the operation instruction output device described in the above embodiment will be described below. 1. Application to Mobile Phone The operation instruction output device is incorporated in the mobile phone, and the user performs “shaking” or “hitting” operation of the mobile phone main body, and the following processing is executed according to the type of the operation.

(1) When the mobile phone is ringing, if the mobile phone is hit twice from the top of the pocket (there is a possibility of malfunctioning once), the ring tone is stopped and the mode is switched to the manner mode. Switch. (2) When the alarm of the mobile phone is sounding, if the mobile phone is hit twice from above the pocket, the alarm stops.

(3) When calling the mobile phone, the mobile phone body
Tap twice to stop calling. When a call is made to the wrong destination, a cancel operation can be performed in a hurry. (4) When searching for a call destination from the telephone directory registered in the mobile phone, the list is switched by "shaking" the mobile phone body, and when the call destination is displayed, "hit" is called.

(5) The scrolling of the electronic mail or the like displayed on the display screen of the mobile phone is started by "shaking" the mobile phone main body and stopped by "hitting". (6) The electronic pet displayed on the mobile phone is set to “hand” by “shaking” and “sit” by “hitting”. (7) The color of the backlight on the display screen of the mobile phone is switched by “shake”.

(8) Various sounds are generated in accordance with the direction and strength of the “shake” of the mobile phone main body and the “hit” location of the mobile phone main body. (9) The random number is generated by "shaking" the mobile phone, and the generation of the random number is stopped by "slapping" to enhance the game. (10) Information about "shaking" and "hitting" of the mobile phone is transmitted to the mobile phone of the call destination, and the image displayed on the display screen of the mobile phone of the call destination is operated and sound effects are generated. Or vibrating the mobile phone itself at the other end of the call.

2. Application to Mobile Terminal (Computer) An operation instruction output device is incorporated in the mobile terminal, and the mobile terminal executes the following processing according to the instruction output from the operation instruction output device. (1) When the user “shakes” the mobile terminal body,
The selection cursor on the menu displayed on the mobile terminal is moved, and the user “hits” to stop the selection cursor and select the menu.

(2) Wristwatch type PDA (Personal)
When the user wearing the Digital Assistants “shakes” his arm left and right, the latest information is displayed on the display screen of the PDA. 3. Application to remote controller An operation instruction output device is incorporated in the remote controller,
In response to the instruction output from the operation instruction output device, the remote controller outputs the following instruction to the output destination device.

(1) Remote controller for TV The TV remote controller outputs a channel switching instruction when the user swings left and right, and outputs a volume adjustment instruction when the user swings up and down. Is output. (2) VTR (VIDEO TAPE RECORD)
R) Remote controller When the user taps the remote controller when the tape of the VTR stops, the VTR starts "playing" the tape. To "rewind".

When the user taps the remote controller during tape playback of the VTR, the user "stops" the playback, swings right and left to perform "fast forward playback", and swings up and down to perform "rewind playback". When the user "hits" the remote controller when rewinding the tape of the VTR, the rewinding is stopped.

(3) Illumination Remote Controller The user adjusts the amount of light by “swinging” the remote controller left and right, and cuts off the power by “hitting”. (4) Remote Controller for MD (Mini Disc) When the user “hits” the remote controller twice, the power is turned “ON” or “OFF”, and “waves” left and right to “start” the song. In the first to fourth embodiments,
Although the motion analysis unit 102, the user motion analysis unit 103, and the process determination unit 104 have been described as performing processing in accordance with a program stored in the ROM 205 or the like illustrated in FIG. 2 or the like, the program is stored in a recording medium such as a CD-ROM. Recording or distributing this program on the Internet, and applying to such an operation instruction output device having no function of identifying the type of user operation, to obtain an operation instruction output device having such a function Is also possible.

[0098]

As described above, the present invention relates to an operation instruction output device which outputs an operation instruction to an information processing apparatus and causes the apparatus to perform a process based on the operation instruction. Storage means for storing an operation instruction corresponding to a combination of at least one or more of the movement direction, strength, and number of movements of the main body and the type of operation of the user who caused the movement; Motion detection means for detecting the motion of the motion, motion analysis means for analyzing at least one or more of the motion direction, intensity and the number of times from the detected motion,
A user operation analyzing unit that analyzes a type of a user operation from the detected movement; and an operation instruction corresponding to a combination of analysis results of the movement analysis unit and the user operation analysis unit is read from the storage unit, and the operation instruction is read. Reading output means for outputting to the information processing apparatus. With such a configuration, it is possible to cause the information processing device to execute various processing contents by distinguishing the type of operation of the user using the operation instruction output device.

The motion detecting means detects the acceleration of the apparatus main body over time, and the motion analyzing means integrates the acceleration value output from the motion detecting means with time to determine the motion direction and strength of the device. At least one of the number of times is analyzed. With such a configuration, the movement of the apparatus can be detected by, for example, an inexpensive acceleration sensor, and at least one of the direction, the strength, and the number of the movement can be analyzed by a simple process.

Further, the user motion analysis means includes a fast Fourier transform analysis unit for obtaining a frequency distribution by a fast Fourier transform from a time-dependent acceleration curve output from the motion detection means and analyzing a type of the user motion. I have it. With such a configuration, by analyzing the frequency distribution, the type of user's operation can be distinguished by frequency.

Further, the user operation analysis means inhibits the output of the read-out output means when the obtained frequency distribution has a frequency peak lower than the first frequency or higher than the second frequency. Section. With such a configuration, it is possible to prevent the information processing device from executing an erroneous process even when an unexpected situation such as dropping the operation instruction output device occurs.

Further, the user motion analyzing means differentiates the time-dependent acceleration curve output from the motion detecting means, calculates the differential value according to a predetermined formula, and analyzes the type of the user motion. And a differential analysis unit. With such a configuration, it is possible to determine the type of user operation by a simple process. Further, the user operation analysis means inhibits the output of the read-out output means when the average value of the differential value obtained by the differentiation is less than a first threshold value or exceeds a second threshold value. An output prohibition unit is further provided. With such a configuration, it is possible to prevent the information processing device from executing an erroneous process even when an unexpected situation such as dropping the operation instruction output device occurs.

The user motion analyzing means performs a wavelet transform on the time-dependent acceleration curve output from the motion detecting means, detects a predetermined frequency component, and analyzes the type of the user's motion. Part. With such a configuration, the type of user's operation can be accurately distinguished by frequency.

The storage means further stores an operation instruction corresponding to the order of the type of the user's operation, and the user operation analysis means stores the predetermined frequency component of the predetermined frequency component detected by the wavelet transform analysis unit. An operation order analysis unit that analyzes the type of the user's operation in accordance with the order of appearance; It has an order-corresponding operation instruction unit for outputting to the device. With such a configuration, various operation instructions can be output to the information processing device.

The user movement analyzing means measures time during which the absolute value of the acceleration value output from the movement detecting means exceeds each of the plurality of reference values, and analyzes the type of the user movement. It has an analysis unit. With such a configuration, it is possible to distinguish types of user actions according to a plurality of reference values. Further, the user motion analysis means, when the absolute value of the acceleration value output from the motion detection means is less than a first threshold value or more than a second threshold value, outputs the output of the read-out output means. An output prohibition unit for prohibition is further provided. With such a configuration, it is possible to prevent the information processing device from executing an erroneous process even when an unexpected situation such as dropping the operation instruction output device occurs.

The motion detecting means detects the acceleration of the apparatus main body over time, and the motion analyzing means calculates the acceleration at the time when the acceleration value output from the motion detecting means exceeds a plurality of reference values. And the time exceeding the reference value are measured, and at least one or more of the movement direction, the strength, and the number of movements of the device are analyzed, and the user movement analysis means includes an acceleration value measured by the movement analysis means. The type of the user's action is analyzed based on the time during which the absolute value of exceeds the reference value. With such a configuration, a simple process of measuring the time during which the detected acceleration value exceeds a plurality of reference values is used to distinguish the type of user's operation,
Various processing contents can be executed by the information processing apparatus.

The motion detecting means detects the angular acceleration of the apparatus main body over time, and the motion analyzing means integrates the angular acceleration value output from the motion detecting means with time to determine the motion direction of the device. At least one of the strength and the number of times is analyzed. With such a configuration, various operation instructions can be output to the information processing device by applying a rotation operation starting from the wrist to the operation instruction output device held by the user's hand.

Further, the user motion analyzing means obtains a frequency distribution by a fast Fourier transform from a time-dependent angular acceleration curve output from the motion detecting means, and analyzes a type of the user's motion by a fast Fourier transform analyzing unit. It has to have. With such a configuration, the type of user operation can be distinguished by analyzing the frequency distribution.

The motion detecting means detects the angular acceleration of the main body of the apparatus over time, and the motion analyzing means determines a point in time when the angular acceleration value output from the motion detecting means exceeds a plurality of reference values. Measuring the sign of the angular acceleration and the time exceeding the reference value, analyzing at least one or more of the direction and strength of the movement of the device and the number of times, and the user movement analysis means is measured by the movement analysis means. The type of motion of the user is analyzed based on the time during which the absolute value of the angular acceleration value exceeds the reference value. With such a configuration, a simple process of measuring the time during which the detected angular acceleration value exceeds a plurality of reference values is performed, and the type of the user's operation is distinguished, and various processing contents are provided to the information processing apparatus. Can be executed.

Further, the plurality of reference values are a first reference value and a second reference value larger than the first reference value, and the user motion analysis means is measured by the motion analysis means. When the time exceeding the first reference value is shorter than a predetermined first time, and when the time exceeding the second reference value measured by the motion analysis means is longer than a predetermined second time. And an output prohibiting unit for prohibiting the output of the read output unit. With such a configuration,
Even if an unexpected situation such as dropping the operation instruction output device occurs, it is possible to prevent the information processing device from executing erroneous processing.

Further, the first reference value is set to a value corresponding to an acceleration value or an angular acceleration value generated when the user shakes the apparatus main body, and the second reference value is set by the user. Is set to a value corresponding to an acceleration value or an angular acceleration value generated when the user hits, and the user action analysis unit sets the type of action of the user to “shake” and “hit”.
And to analyze it. With such a configuration, for example, by setting the first reference value to a value corresponding to 1 G (G is gravitational acceleration) and setting the second reference value to a value corresponding to 2.5 G, the user's operation can be improved. A distinction can be made between "shake" and "hit".

Further, according to the present invention, the operation instruction output device according to claim 1 is incorporated in a mobile phone as the information processing device, and a processing mode of the mobile phone is changed by an operation instruction output from the read-out output means. You are going to. With such a configuration, the operability of the mobile phone including the operation instruction output device is further improved. According to another aspect of the present invention, there is provided a mobile phone, wherein the operation instruction output device according to claim 1 is incorporated, and the operation mode output from the read-out output unit is received to change a processing mode of the mobile phone.
With such a configuration, the operability of the mobile phone incorporating the operation instruction output device is further improved.

Further, the present invention includes a detecting unit for detecting a movement of the apparatus main body accompanying a user's operation, outputting an operation instruction to the information processing apparatus, and causing the apparatus to perform a process based on the operation instruction. A computer-readable recording medium applied to the output device, wherein the motion analysis means analyzes at least one of a motion direction, a strength, and the number of times from the detected motion, and a motion of a user's motion from the detected motion. At least one of a movement direction, a strength, and the number of times of operation of the operation instruction output device main body, the operation instruction corresponding to a combination of analysis results of the movement analysis means and the user operation analysis means; The operation instruction corresponding to the combination of the above and the type of operation of the user who caused the movement is read from the storage unit storing the operation instruction, and the operation instruction is output to the information processing apparatus. And a computer-readable recording medium recording a program to exert function in the computer of each unit of a read output means that. With such a configuration, the operation instruction output device having the motion detection unit can be a device that can output various operation instructions.

[Brief description of the drawings]

FIG. 1 is a first embodiment of an operation instruction output device according to the present invention;
FIG.

FIG. 2 is a diagram showing a hardware configuration of the embodiment.

FIG. 3 is an explanatory diagram of an external appearance of an operation instruction output device according to the embodiment and a specific arrangement of a motion detection unit.

FIG. 4A is a diagram illustrating an acceleration curve “when the player shakes once” output from the acceleration sensor of the motion detection unit according to the embodiment. (B) is a figure which similarly shows the acceleration curve of "when hit once".

FIG. 5 is a flowchart illustrating an example of an analysis process of a motion analysis unit according to the embodiment.

FIG. 6 is a flowchart illustrating another example of the analysis processing of the motion analysis unit according to the embodiment.

FIG. 7A is a diagram illustrating an integral curve of an acceleration value “when the player shakes once” obtained by the motion analysis unit of the embodiment. (B) is a figure which similarly shows the integral curve of the acceleration value "when it shakes continuously".

FIG. 8 is an explanatory diagram of a threshold when outputting an acceleration value of the motion detection unit according to the embodiment.

FIG. 9 is a flowchart illustrating an analysis process of a user motion analysis unit according to the embodiment.

FIG. 10A is a diagram illustrating an acceleration curve by a “shake” operation output from the motion detection unit of the embodiment. (B) is a diagram showing a frequency distribution curve obtained by the user motion analysis unit from the above (a) by FFT processing.

FIG. 11A is a diagram illustrating an acceleration curve by a “hitting” operation output from the motion detection unit of the embodiment. (B) is a diagram showing a frequency distribution curve obtained by the user motion analysis unit from the above (a) by FFT processing.

FIG. 12 is a diagram illustrating the contents of a processing determination table stored in a processing determining unit according to the embodiment.

FIG. 13 is a flowchart illustrating the operation of the embodiment.

FIG. 14 is a configuration diagram of a modified example of the above embodiment.

FIG. 15 is a configuration diagram of a modified example of the above embodiment.

FIG. 16 is an explanatory diagram illustrating the contents of an analysis process performed by a user action analysis unit according to the second embodiment of the operation instruction output device according to the present invention.

FIG. 17 is a flowchart illustrating an operation of a user operation analysis unit according to the embodiment.

FIG. 18 is an explanatory diagram for explaining the content of wavelet processing in a user motion analysis unit according to a third embodiment of the operation instruction output device according to the present invention.

FIG. 19 is an acceleration “when the player shakes once” output from the motion detection unit for explaining the processing performed by the motion analysis unit and the user motion analysis unit according to the fourth embodiment of the operation instruction output device according to the present invention. It is a figure showing an example of a curve.

FIG. 20 is a diagram illustrating an example of an acceleration curve “when hit once” as in FIG. 19;

FIG. 21 is a flowchart illustrating an operation of the motion analysis unit according to the embodiment.

FIG. 22 is a flowchart illustrating an operation of a user operation analysis unit according to the embodiment.

[Explanation of symbols]

 101 motion detection unit 102 motion analysis unit 103 user motion analysis unit 104 processing determination unit 201, 301, 302 acceleration sensor 202 amplifier 203 A / D converter 204 CPU 205 ROM 206 RAM 207 communication device 208 bus 303 housing 308 operation start button 1401 FFT calculator 1402 Storage device

Claims (19)

[Claims] 1. An operation instruction output device that outputs an operation instruction to an information processing device and causes the device to perform a process based on the operation instruction. Storage means for storing an operation instruction corresponding to a combination of at least one or more of the actions of the user who caused the movement; movement detection means for detecting the movement of the apparatus main body accompanying the user's movement; A motion analysis unit that analyzes at least one of a motion direction, a strength, and a number of times from the detected motion; a user motion analysis unit that analyzes a type of a user's motion from the detected motion; A readout output unit that reads out an operation instruction corresponding to a combination of the analysis result with the user operation analysis unit from the storage unit and outputs the operation instruction to the information processing device. That the operation instruction output device. 2. The motion detecting means detects the acceleration of the apparatus main body with time, and the motion analyzing means integrates the acceleration value output from the motion detecting means with time to determine the motion direction and strength of the device. The operation instruction output device according to claim 1, wherein at least one of the number of times and the number of times of the operation are analyzed. 3. A fast Fourier transform analysis unit that obtains a frequency distribution by a fast Fourier transform from a temporal acceleration curve output from the motion detection unit and analyzes a type of the user's movement, The operation instruction output device according to claim 2, further comprising: 4. The method according to claim 1, wherein the user operation analyzing means is configured to determine whether the frequency distribution is less than the first frequency or the second frequency.
4. The operation instruction output device according to claim 3, further comprising: an output prohibiting unit that prohibits the output of the read-out output unit when there is a frequency peak exceeding the frequency. 5. The user motion analysis means analyzes the type of the user motion by differentiating a time-dependent acceleration curve output from the motion detection means and calculating a differential value according to a predetermined formula. The operation instruction output device according to claim 2, further comprising a differential analysis unit that performs the operation. 6. When the average value of the differential values obtained by differentiating is less than a first threshold value or exceeds a second threshold value, the user operation analysis means outputs the output of the read-out output means. 6. The operation instruction output device according to claim 5, further comprising an output prohibition unit for prohibiting the operation. 7. The wavelet transform analysis means for wavelet transforming the time-dependent acceleration curve output from the motion detecting means, detecting a predetermined frequency component and analyzing the type of the user's motion. The operation instruction output device according to claim 2, further comprising a unit. 8. The storage unit further stores an operation instruction corresponding to an order of a type of a user's operation, and the user operation analysis unit stores a predetermined frequency component of a predetermined frequency component detected by the wavelet transform analysis unit. An operation order analysis unit that analyzes the type of the user's operation in accordance with the order of appearance; the read-out output unit reads an operation instruction corresponding to the order of the type of the user's operation; The operation instruction output device according to claim 7, further comprising an order corresponding operation instruction unit that outputs the operation instruction to the device. 9. The user motion analysis unit measures the time during which the absolute value of the acceleration value output from the motion detection unit exceeds each of a plurality of reference values, and analyzes the type of the user's motion. The operation instruction output device according to claim 2, further comprising an analysis unit. 10. The reading / outputting means when the absolute value of the acceleration value output from the motion detecting means is less than a first threshold value or more than a second threshold value. The operation instruction output device according to claim 9, further comprising an output prohibition unit that prohibits the output of the operation instruction. 11. The motion detecting means detects the acceleration of the apparatus main body over time, and the motion analyzing means calculates the acceleration at the time when the acceleration value output from the motion detecting means exceeds a plurality of reference values, respectively. And the time exceeding the reference value is measured, and at least one or more of the movement direction and the strength of the device and the number of times are analyzed. The user movement analysis means includes an acceleration value measured by the movement analysis means. 2. The operation instruction output device according to claim 1, wherein the type of operation of the user is analyzed based on a time when an absolute value of the user exceeds a reference value. 12. The motion detecting means detects the angular acceleration of the apparatus main body with time, and the motion analyzing means integrates the angular acceleration value output from the motion detecting means with time to determine the motion direction of the device. 2. The operation instruction output device according to claim 1, wherein at least one of the strength and the number of times is analyzed. 13. A fast Fourier transform analysis unit for obtaining a frequency distribution by a fast Fourier transform from a time-dependent angular acceleration curve output from the motion detection means and analyzing a type of the user's movement. The operation instruction output device according to claim 12, comprising: 14. The motion detecting means detects the angular acceleration of the apparatus main body over time, and the motion analyzing means determines when the angular acceleration value output from the motion detecting means exceeds a plurality of reference values, respectively. Measuring the sign of the angular acceleration and the time exceeding the reference value, analyzing at least one or more of the direction and strength and the number of movements of the device, and the user movement analysis means is measured by the movement analysis means. 2. The operation instruction output device according to claim 1, wherein the type of operation of the user is analyzed based on a time when an absolute value of the angular acceleration value exceeds a reference value. 15. The plurality of reference values are a first reference value and a second reference value larger than the first reference value, wherein the user motion analysis unit is measured by the motion analysis unit. When the time exceeding the first reference value is shorter than a predetermined first time, and when the time exceeding the second reference value measured by the motion analysis means is longer than a predetermined second time. 15. The operation instruction output device according to claim 11, further comprising an output prohibition unit for prohibiting the output of the read output unit. 16. The first reference value is set to a value corresponding to an acceleration value or an angular acceleration value generated when the user shakes the apparatus main body, and the second reference value is set by the user to the apparatus main body. Is set to a value corresponding to an acceleration value or an angular acceleration value generated when hitting, and the user action analysis means analyzes the type of action of the user as “shake” and “hit”. The operation instruction output device according to claim 15, wherein: 17. The operation instruction output device according to claim 1, wherein the operation instruction output device is incorporated in a mobile phone as the information processing device, and changes a processing mode of the mobile phone according to an operation instruction output from the readout output unit. Characteristic operation instruction output device. 18. A mobile phone, wherein the operation instruction output device according to claim 1 is incorporated, and receives an operation instruction output from said read-out output means, and changes a processing mode of the mobile phone. mobile phone. 19. An operation instruction output device, comprising: a detection unit that detects a movement of the apparatus main body in accordance with a user's operation, outputs an operation instruction to an information processing apparatus, and causes the apparatus to perform a process based on the operation instruction. A computer-readable recording medium for analyzing at least one of a motion direction, a strength, and a number of times from a detected motion; and analyzing a type of a user's motion from the detected motion. User operation analysis means; and an operation instruction corresponding to a combination of analysis results of the movement analysis means and the user operation analysis means, at least one or more of the movement direction, strength, and number of times of the operation instruction output device main body, and the movement thereof. Is read from the storage unit storing the operation instruction corresponding to the combination with the type of the user's operation that caused the
A computer-readable recording medium in which a program for causing a computer to perform the functions of each unit including a readout output unit that outputs an operation instruction to the information processing apparatus is recorded.