JP2005092722A - Operation recognition device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an operation recognition device capable of performing personal identification, by utilizing the detection signal of a portable three-dimensional acceleration sensor. <P>SOLUTION: The operation recognition device comprises the portable three-dimensional acceleration sensor 1 for sensing three-dimensional acceleration; a feature extracting means 22 for extracting the time transition of the three-dimensional acceleration detected by the portable three-dimensional acceleration sensor as the amount of feature; a feature database 24 for retaining the reference feature of the three-dimensional acceleration; a matching processing means 23 for executing the matching between the amount of feature extracted by the feature extracting means and the reference feature retained in the feature database; and a certification realization signal outputting means 25 for outputting a certification realization signal when the matching processing means succeeds in the matching. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a motion recognition apparatus using a portable three-dimensional acceleration sensor.

  Conventionally, a computer input device using a three-dimensional acceleration sensor as disclosed in Patent Documents 1 to 5 is known. These recognize the attitude, position, and motion path of the input device using acceleration detection signals in the xyz three-axis directions, and perform screen operations according to the output of the three-dimensional acceleration sensor. In addition, as disclosed in Patent Document 6, there is also known one that outputs a musical sound corresponding to a signal of a three-dimensional acceleration sensor.

However, conventionally, there is no known technique that uses a three-dimensional acceleration sensor, analyzes the feature amount of the detection signal, and uses this for personal authentication.
JP 2003-29915 A JP 2002-196869 A JP 2002-297284 A Japanese Patent Laid-Open No. 11-85387 JP-A-9-212288 JP 2003-76368 A

  The present invention has been made in view of such a conventional technical problem, and an object of the present invention is to provide an operation recognition device capable of performing personal authentication using a detection signal of a portable three-dimensional acceleration sensor. To do.

  The motion recognition apparatus according to the first aspect of the present invention is a portable three-dimensional acceleration sensor that senses three-dimensional acceleration, and a feature amount that extracts a temporal transition of the three-dimensional acceleration detected by the portable three-dimensional acceleration sensor as a feature amount. Extraction means, a feature quantity database that holds reference feature quantities of three-dimensional acceleration, and matching that executes matching between the feature quantities extracted by the feature quantity extraction means and reference feature quantities held in the feature quantity database Processing means and output means for outputting an authentication establishment signal when the matching processing means succeeds in matching.

  According to a second aspect of the present invention, in the motion recognition apparatus according to the first aspect, the feature amount extraction means extracts when an arbitrary user makes a special movement for personal recognition using the portable three-dimensional acceleration sensor. Reference feature quantity registration means for registering a feature quantity as the reference feature quantity in the feature quantity database is provided.

  According to a third aspect of the present invention, in the motion recognition apparatus according to the first or second aspect, a sound signal generating unit that generates a sound string signal corresponding to the feature amount extracted by the feature amount extracting unit, and a sound signal generating unit And a speaker that outputs an audible sound string to be generated.

  According to a fourth aspect of the present invention, in the motion recognition apparatus according to any one of the first to third aspects, the feature amount extraction means uses a time transition of a time differential value of the three-dimensional acceleration detected by the portable three-dimensional acceleration sensor as a feature amount. It is characterized by doing.

  According to the present invention, the temporal transition of the three-dimensional acceleration detected by the three-dimensional acceleration sensor is used as a feature amount, matching with the reference feature amount stored in the feature amount database is performed, and authentication is performed when the matching is successful. By outputting the establishment signal, the motion recognition device can be used as a personal authentication device or an input confirmation sound generator together with personal authentication.

  In addition, by using the temporal transition of the time differential value of the three-dimensional acceleration detected by the portable three-dimensional acceleration sensor as a feature value, matching using a feature value that is not affected by gravitational acceleration can be performed. Can be increased.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a system configuration diagram of a motion recognition apparatus according to the first embodiment of the present invention, FIG. 2 shows a functional configuration of the motion recognition apparatus according to the first embodiment, and FIG. The structure of a type | mold three-dimensional acceleration sensor is shown.

  As shown in FIG. 1, the system configuration of the motion recognition apparatus according to the present embodiment includes a portable three-dimensional acceleration sensor 1 having a size and weight that can be arbitrarily moved by a user, which will be described later. The computer system 100 includes software for taking in a three-dimensional acceleration signal detected by the three-dimensional acceleration sensor 1 and executing authentication processing. The size of the computer system 100 is not particularly limited, and any cellular phone, PDA, notebook personal computer may be used as long as it has a built-in CPU and performs various operations by installing various application software. Any computer, desktop personal computer, workstation, etc. can be used depending on the application.

  As shown in FIG. 2, the motion recognition apparatus according to the present embodiment includes a portable three-dimensional acceleration sensor 1 and a signal processing apparatus 2 connected to the portable three-dimensional acceleration sensor 1 in a wired or wireless manner. The signal processing apparatus 2 is incorporated as a program in the computer system 100. Here, for convenience of explanation, the processing function is divided into blocks.

  The portable three-dimensional acceleration sensor 1 shown in detail in FIG. 3 is a size that a user can hold in his hand and can be moved freely. Among them, two 2's having the same specifications and performance in this embodiment are included. The axial acceleration sensors 11 and 12 are fixed in a perpendicular positional relationship. The portable three-dimensional acceleration sensor 1 also includes a noise filter 13 for filtering the outputs of the two two-axis acceleration sensors 11 and 12, and an A / D for A / D converting the acceleration detection signal that has passed through the noise filter 13. A conversion unit 14, a communication interface (I / F) 15 that transmits a digital signal of the A / D conversion conversion unit 14 to the signal processing device 2 side, and a sensor control unit 16 that controls the portable three-dimensional acceleration sensor 1 It has been incorporated. For example, a serial interface such as RS232C can be used for the communication I / F 15, but the present invention is not limited to this. A wireless communication interface may also be used.

  A one-chip microcomputer having each function can be used for each element of the portable three-dimensional acceleration sensor 1. The biaxial acceleration sensors 11 and 12 include, for example, Analog Devices, Inc. Acceleration Sensor ADXL202, Microchip Technology Inc. for sensor control and serial conversion. One-chip microcomputer PIC16F84 can be used. Further, a three-dimensional acceleration sensor can be adopted instead of the two two-axis acceleration sensors, and the acceleration detection method is arbitrary.

  As shown in FIG. 2, the signal processing device 2 receives the digital signal of the acceleration detection signal sent from the three-dimensional acceleration sensor 1 via the communication interface, and inputs acceleration data for performing predetermined signal processing to be described later. The processing unit 21 extracts a feature amount from the data string processed by the acceleration data input processing unit 21 by a predetermined calculation process. In the reference feature amount registration mode, the extracted feature amount is used as a reference feature amount in the feature amount database 24. The feature amount extraction unit 22 to be registered, the motion recognition processing unit 23 that performs the matching process on the reference feature amount held in the feature amount database 24 in the feature recognition unit 22 in the motion recognition mode, As described above, the feature amount database 24 and the motion recognition processing unit 23 that hold the reference feature amount in association with the user ID have succeeded in matching. An authentication establishment signal output unit 25 for outputting the authentication establishment signal when.

  When personal authentication is established in the signal processing device 2 and the authentication establishment signal output unit 25 outputs an authentication establishment signal, this signal is input to the authentication confirmation processing unit 3 of the software of the computer, and thereafter the execution of the software is executed. to enable. For example, it enables computer user authentication, access permission to a certain website, login permission for online shopping, and the like.

  In the feature quantity database 24, password information and reference feature quantities are registered in association with each other. As will be described later, for example, the user uses the portable three-dimensional acceleration sensor 1 for a password "ABCD". It is also possible to adopt a method in which a feature amount corresponding to an operation of drawing “O △ □ ◇” by itself is associated and registered as a password-compatible reference feature amount. Alternatively, the user holds the portable three-dimensional accelerometer 1 in the password “ABCD” and follows the circle symbol “O” in order “fast clockwise, medium fast, counterclockwise fast, counterclockwise. It is also possible to adopt a method in which a feature amount corresponding to a drawing operation is associated with each other and registered as a reference feature amount corresponding to a password. Furthermore, it is also possible to register the feature quantity of the movement “◯ △ □ ◇” from the beginning as the reference feature quantity.

  Each processing unit temporarily stores data in a memory as necessary, and reads out the data to perform necessary processing. Furthermore, it is assumed that the operator 2 can perform an input intervention with a keyboard or a pointing device in the registration process of the feature amount database 24 in the apparatus 2.

  Next, the operation of the motion recognition apparatus according to the first embodiment having the above configuration will be described. The portable three-dimensional acceleration sensor 1 detects and outputs a three-dimensional acceleration when the user holds it in a hand and moves it arbitrarily. In the case of the present embodiment, the three-dimensional acceleration is obtained by two two-axis acceleration sensors arranged perpendicularly to each other, so that the two axes of both of the two-axis acceleration sensors 11 and 12 have a total of four axes (this embodiment In this embodiment, the acceleration signal data string of x-axis acceleration signal becomes two data strings) is transmitted to the signal processing unit 2.

  The acceleration data input processing unit 21 of the signal processing device 2 receives the acceleration signal data string from the three-dimensional acceleration sensor 1 and aligns the signal intensity using the two data strings of the x-axis that is a common axis, thereby Align the signal strength of the acceleration signal of each three-dimensional axis. For example, if the intensity of the x-axis acceleration signal in the other zx 2-axis acceleration sensor 12 is 1.1 times larger than the x-axis acceleration signal in one xy 2-axis acceleration sensor 11, z in the zx 2-axis acceleration sensor 12 The signal strength is made uniform by reducing the strength of the acceleration signal of the shaft to 1 / 1.1.

  Since the acceleration signal of the acceleration sensor is affected by the gravitational acceleration, the acceleration data input processing unit 21 further performs time differentiation on the acceleration data string of each of the three-dimensional axes at every predetermined sampling time, and the acceleration time The rate of change is obtained in a time series, and this is output as a three-dimensional acceleration data string for feature quantity extraction.

  The feature amount extraction unit 22 obtains a frequency component based on the time series data of the acceleration change obtained by the acceleration data input processing unit 21, and sets it as the feature amount. It is also possible to use the data string itself of the three-dimensional speed change rate as a feature amount.

  The feature quantity extraction unit 22 registers the extracted feature quantity data in the feature quantity database 24 in association with the user identification information (ID) in the reference feature quantity registration mode. For example, for Mr. A's personal authentication, when Mr. A holds the portable three-dimensional acceleration sensor 1 and draws “○ △ □ ◇” in order, the acceleration change rate data string is the password for Mr. A's personal authentication. It registers as. Alternatively, Mr. A registers the character password “ABCD”, and the characteristic amount when Mr. A moves to write “ABCD” with the three-dimensional acceleration sensor 1 in the air is displayed. It is also possible to register in association with the password “ABCD”.

  The feature amount extraction unit 22 outputs the extracted feature amount data string to the operation recognition processing unit 23 as it is in the operation authentication mode.

  The motion recognition processing unit 23 refers to the feature quantity data string from the feature quantity extraction unit 22 and refers to the feature quantity database 24 to perform a matching process. In this matching process, for example, in the case of Mr. A's personal authentication, Mr. A's reference feature quantity data string registered in the feature quantity database 24 is read using the first inputted Mr. A's ID as a key, and this A three-dimensional distance between the reference feature value data string and the input feature value data string is calculated, and if the degree of coincidence is equal to or less than a predetermined threshold, authentication is established, and otherwise, denial is made. The authentication establishment signal output unit 25 outputs an authentication establishment signal to the authentication confirmation processing unit 3 when the operation recognition processing unit 23 determines that the operation authentication is established.

  If the authentication confirmation processing unit 3 receives the authentication establishment signal, for example, the process following the establishment of personal authentication in the software running on the computer, such as user authentication of the computer, permission to access a certain website, permission to log in to online shopping, etc. Will continue.

  In general, even if you draw the same ○, △, ◇, etc. in the air, the strength and drawing speed will vary depending on the individual, and even if you draw faster or slower, the speed will vary depending on the individual. The three-dimensional acceleration signal waveform varies depending on the individual. Accordingly, the portable three-dimensional acceleration sensor 1 is provided to draw a predetermined figure or character in the air, and the feature quantity of the three-dimensional acceleration waveform is registered in the feature quantity database 24 by drawing the same figure or letter in advance. If matching processing is performed with a certain reference feature amount, matching is established for the same individual, but matching is not established even if the same figure or character is drawn for different users. Of course, even for the same user, matching is not achieved if the movement is different from that at the time of the reference feature registration operation or if the speed and strength of drawing are made extremely different.

  FIG. 4 shows the processing result of the detection signal of the three-dimensional acceleration sensor when the user holding the portable three-dimensional acceleration sensor 1 draws a figure in the air on the computer system 100. The graphic displayed in the main window 101 displays the change in three-dimensional acceleration, and the measurement value display window 102 displays the change in the three-dimensional acceleration with time as a graph in comparison with the reference feature amount. . Since the acceleration change is sensitive, the moving average is taken here to make the rate of change moderate, and the change of the moving average value is also used for feature amount authentication. A window 103 is an acceleration window, a window 104 is an acceleration change rate window, and a window 105 is a feature extraction result window.

  According to the operation authentication device of the present embodiment using this phenomenon, it is easier to input a password than when inputting characters from a keyboard for personal authentication of a user. Also, it is possible to provide a product using a cheap product.

  Next, the operation | movement authentication apparatus of the 2nd Embodiment of this invention is demonstrated using FIG. In the operation authentication device according to the second embodiment, when the user performs an authentication operation with the portable three-dimensional acceleration sensor 1, the operation authentication device outputs a sound corresponding to the movement of the sensor 1 by the user. It is characterized in that the authentication operation can be performed while confirming whether or not the movement being performed matches the registration operation.

  In the present embodiment, the portable three-dimensional acceleration sensor 1 is the same as that of the first embodiment. The signal processing device 2 includes the same acceleration data input processing unit 21, feature amount extraction unit 22, motion recognition processing unit 23, feature amount database 24, and authentication establishment signal output unit 25 as in the first embodiment. A sound signal generator 26 and a speaker 27 are additionally provided.

  Next, the operation of the operation authentication device according to the second embodiment will be described. When the user moves the portable three-dimensional acceleration sensor 1, the three-dimensional acceleration or the rate of change of the three-dimensional acceleration is used as a feature amount. In the reference feature registration mode, this is used as a reference feature amount in the feature database 24. The process of registering in association with the identification information (ID) and performing personal authentication by matching with the reference feature quantity of the corresponding user registered in the feature quantity database 24 in the personal authentication mode is the same as in the first embodiment. It is.

  In the present embodiment, when the feature quantity extraction unit 22 extracts a feature quantity, the sound signal generation unit 26 generates a sound corresponding to the feature quantity, and outputs the sound through the speaker 27 as an audible sound. The correlation between the sound signal and the feature amount is set in advance. For example, the frequency of the acceleration or acceleration change rate is associated with the sound frequency, and the amplitude of the acceleration or acceleration change rate signal and the strength of the sound are Associate.

  As a result, according to the motion authentication device of the second embodiment, the acceleration change when the user sequentially draws, for example, “◯ △ □ ◇” in the reference feature value registration mode as in the first embodiment. When a user remembers a sound string that is output in real time from the speaker 27 when registering the rate data string as a password for Mr. A's personal authentication, the user next uses the same “○ △ □” for personal authentication. When “◇” is drawn in order, the corresponding sound sequence is output in real time, so that the user can detect whether or not the figure for personal authentication drawn by the user is the same as that at the time of registration together with the display on the screen 101. It can be confirmed by checking whether or not the sound string that is output in real time when 1 is moved is substantially the same as that at the time of registration. For example, if a sound higher or lower than the sound at the time of registration is output, it can be determined that the figure is wrong, and if the sound is too loud, it can be determined that writing is too fast. In addition, although the sound string that was generated when the sensor 1 was moved when the reference feature amount was registered was “pip, pop, pad, pip”, the sound string that was generated when the sensor 1 was moved for personal authentication was “ If it is “Pip, Pip, Pip, Pappa”, it is intuitive to the user by feedback of the sound string that the figure itself drawn by moving the sensor 1 due to the difference in the sound string and the order of the figure are wrong. It can be understood.

The block diagram which shows the system configuration | structure of the operation | movement authentication apparatus of the 1st Embodiment of this invention. The block diagram which shows the function structure of the said 1st Embodiment. The block diagram which shows the internal structure of the portable three-dimensional acceleration sensor in the said 1st Embodiment. Explanatory drawing of the personal authentication screen by the said 1st Embodiment. The block diagram which shows the function structure of the operation | movement authentication apparatus of the 2nd Embodiment of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 3D acceleration sensor 2 Signal processing apparatus 3 Authentication confirmation process part 11,12 Two-axis acceleration sensor 13 Noise filter 14 A / D converter 15 Communication interface 16 Control part 21 Acceleration data input process part 22 Feature-value extraction part 23 Motion recognition Processing unit 24 Feature amount database 25 Authentication establishment signal output unit 26 Sound signal generation unit 27 Speaker 100 Computer system

Claims (4)

A portable 3D acceleration sensor for sensing 3D acceleration;
Feature amount extraction means for extracting temporal transition of the three-dimensional acceleration detected by the portable three-dimensional acceleration sensor as a feature amount;
A feature amount database that holds reference feature amounts of three-dimensional acceleration;
Matching processing means for performing matching between the feature quantity extracted by the feature quantity extraction means and a reference feature quantity held in the feature quantity database;
An operation recognition apparatus comprising: output means for outputting an authentication establishment signal when the matching processing means succeeds in matching.   The feature quantity extracted by the feature quantity extraction unit when an arbitrary user makes a special movement for personal recognition using the portable three-dimensional acceleration sensor is registered as the reference feature quantity in the feature quantity database. The motion recognition apparatus according to claim 1, further comprising a reference feature amount registration unit.   A sound signal generating unit that generates a sound string signal corresponding to the feature amount extracted by the feature amount extracting unit; and a speaker that outputs the sound string generated by the sound signal generating unit as an audible sound. The motion recognition apparatus according to claim 1 or 2, characterized in that The operation according to any one of claims 1 to 3, wherein the feature amount extraction unit uses a temporal transition of a time differential value of the three-dimensional acceleration detected by the portable three-dimensional acceleration sensor as a feature amount. Recognition device.

Images