JP2019075034A - Information processing apparatus, information processing method, and information processing program - Google Patents

Abstract

To reduce the burden of a user and output character information according to an input operation.SOLUTION: An identification unit (125) identifies a finger movement including a finger-to-finger contact using the vibration amplitude and intensity of a detection signal from a sensor array (14) indicating changes of major muscles, the number of contacts, and a signal distribution pattern, identifies character information corresponding to the movement of a finger identified by the detection signal from the sensor array (14) by referring to a template unit (126) in which a correspondence between the movement of the finger and the character information is stored, causes a display unit (18) to display the character information as an identification result, and transmits the character information to another information processing apparatus via a communication unit (16). In that manner, character information is output only by the movement of a user's finger, thus improving the usability.SELECTED DRAWING: Figure 1

Description

  The disclosed technology relates to an information processing apparatus, an information processing method, and an information processing program.

  Various input devices for inputting information by the user have been realized. For example, there is known a technique of imaging a contact of a user's phalanx and outputting information from an imaging result (see Patent Document 1).

  In the technology described in Patent Document 1, a camera captures an image in which a contact body is in contact with a phalanx, and outputs information corresponding to the phalanx pressed by the user.

International Publication 2013/168508 brochure

The first aspect of the disclosed technology is
A detection unit that detects a predetermined finger movement;
The movement of the finger detected by the detection unit is based on the correspondence relationship in which different information is associated with each of a plurality of different movements of the predetermined finger and the movement of the finger detected by the detection unit. An output unit that outputs information corresponding to the movement of the finger detected by the detection unit when any of the plurality of movements is detected;
An information processing apparatus comprising:

The second aspect of the disclosed technology is
A detection unit that detects a change in the wrist;
An output unit that outputs information based on the correspondence relationship in which different information is associated with each detected change in the wrist;
An information processing apparatus comprising:

The third aspect of the disclosed technology is
A detection unit that detects expansion and contraction of the wrist accompanying movement of the finger and outputs a detection signal;
A storage unit configured to pattern the detection signal and to store predetermined information corresponding to each pattern or a correspondence in which a command is associated;
An output unit that outputs the predetermined information or a command based on the detection signal and the correspondence relationship;
An information processing apparatus comprising:

The fourth aspect of the disclosed technology is
Detecting the change in the wrist;
An output step of outputting information based on a correspondence relationship in which different information is made to correspond to each detected change in the wrist;
Information processing method including

The fifth aspect of the disclosed technology is
Detecting the expansion and contraction of the wrist accompanying the movement of the finger and outputting a detection signal;
Storing the pattern of the detection signal and storing predetermined information corresponding to each pattern or a correspondence relationship in which a command is associated;
An output step of outputting the predetermined information or command based on the detection signal and the correspondence relationship;
Information processing method including

A sixth aspect of the disclosed technology is
It is an information processing method including making a computer perform processing of an output part of the above-mentioned information processor.

A seventh aspect of the disclosed technology is
An information processing program for causing a computer to function as an output unit of the information processing apparatus.

It is a block diagram showing an example of composition of an information processor concerning this indication. It is an image figure showing an example showing typically a user's left hand. It is an image figure which shows an example of a sensor array, (A) is a top view of a sensor array, (B) has shown the side view. An example of detection by the sensor array is shown, in which (A) is an image of movement of a finger of a user, FIG. It is a schematic diagram which shows an example of the sensor array with which a user's wrist was mounted | worn, (A) shows an example of a mounting state, (B) shows the side view of a sensor array. It is an image figure which shows the specific example of a sensor array, (A) shows the state as which character information was displayed on the display part, (B) has shown the perspective view of a sensor array. It is an image figure which shows an example of the structure of a sensor array, (A) shows a contracted state, (B) has shown the extended state. It is an image figure showing an example of a detection signal accompanying movement of a user's finger. An example which matched character information to a phalanx is shown, (A) is the character information by a 1st template, (B) is the schematic diagram which made the character information by a 2nd template correspond. An example of a motion of a user's finger by contact of a plurality of fingers is shown, (A) is a state where all the user's fingers were bent, (B) is a mimetic diagram showing a state where all the user's fingers were spread. The other example of a motion of a user's finger by contact of a plurality of fingers is shown, (A) is a state where a wrist is also bent from a state where all the user's fingers are bent, (B) is a case where all the user's fingers are bent It is a schematic diagram which shows a state. It is an image figure showing an example of a template for every kind of character. It is an image figure which shows an example of the table which shows the correspondence of the movement of a user's finger, and character information. It is an image figure which shows an example of the table which shows the correspondence of the movement of a user's finger, and a command. It is a block diagram showing an example of composition at the time of realizing a device main part of an information processor with a computer. It is a flowchart which shows the flow of the process by an information processing program. The timepiece of a 1st modification is shown, (A) is a top view of the visual observation side of a display part, (B) is a side view. The information processing apparatus of a 2nd modification is shown, (A) is a side view, (B) is a top view.

Hereinafter, embodiments will be described with reference to the drawings.
The present disclosure describes an information processing apparatus 10 that outputs information based on the movement of a user's finger as an example of an information processing apparatus according to the disclosed technology.

  In the present disclosure, the information processing apparatus 10 detects a predetermined finger movement, and the detected finger movement is detected using a correspondence in which different information is associated with each of a plurality of predetermined finger different movements. In the case of any of a plurality of movements, information corresponding to the detected movement of the finger is output. That is, the information processing apparatus 10 according to the present disclosure detects movements of fingers of a plurality of different users as an input operation, and outputs predetermined information corresponding to the movements of the detected fingers of the user.

  Further, in the present disclosure, the case of using character information as an example of different information to be associated with each of a plurality of different movements of a predetermined finger will be described. In the following description, it is assumed that the character information uses information indicating hiragana characters, alphanumeric characters, and symbols corresponding to each of the keys in the keyboard which is an example of the input device of the computer.

  Note that the character information can include, in addition to hiragana characters, alphanumeric characters, and symbols, information of a key indicating command input. In addition, the character information is not limited to information corresponding to each of the keys in the keyboard, and includes katakana and kanji in Japanese syllabary, upper and lower case letters in English, and symbols and characters not in the keyboard. be able to.

  Although the information processing apparatus 10 that outputs information based on the movement of the user's finger is described as an example of the information processing apparatus according to the disclosed technology, the information processing apparatus according to the disclosed technology is based on the movement of the user's finger The present invention is not limited to the information processing apparatus 10 that outputs information. That is, the movement of the user is not limited to the finger, and is applicable to an information processing apparatus that outputs information based on the movement of a part of the user's body.

  Further, in another present disclosure, the information processing apparatus 10 detects a change in the vicinity of the wrist (for example, expansion and contraction of the wrist) due to movement of at least one of a tendon and a muscle of the wrist, and differs for each detected movement of the wrist. The information is output using the correspondence in which the information is made to correspond. That is, the information processing apparatus 10 according to the present disclosure detects a plurality of different wrist movements as an input operation, and outputs predetermined information corresponding to the detected wrist movements. Since changes in the area around the wrist (for example, expansion and contraction of the wrist) are changed by the movement of the user's finger, the movement of the finger is grasped by detecting changes in the area around the wrist (for example, expansion and contraction of the wrist). Recognize the intended operation.

FIG. 1 shows an example of the configuration of an information processing apparatus 10 according to the present disclosure.
As shown in FIG. 1, the information processing apparatus 10 includes an apparatus main body 12 as an output unit that outputs character information based on the movement of a user's finger. The device body 12 is connected to a sensor array 14 as a detection unit, a communication unit 16 and a display unit 18 such as a display as a display unit. Power is supplied to the information processing apparatus 10 from a power supply (not shown) such as a battery.

  The sensor array 14 is a functional unit that functions as a detection unit that detects the movement of the user's finger, and outputs a detection signal of the sensor array 14 to the device body 12.

  Here, the movement of the user's finger targeted in the present disclosure will be described. In the present disclosure, in order to simplify the description of the movement of the finger of the user, the movement of the finger in the left hand of the user will be described as an example. Note that the present disclosure is not limited to finger movement in the left hand, but may be finger movement in the right hand, and may be applied to finger movement in both the left hand and the right hand.

FIG. 2 schematically shows the left hand of the user. FIG. 2 (A) shows the palm side of the user, and FIG. 2 (B) shows the back side of the hand.
The user's left hand moves around the joints of each finger by the stretching action of the muscles connected to the bones constituting each finger. That is, it is possible to detect the movement of the user's finger by detecting the state of the muscle moving each finger. For example, as an example of a muscle moving each finger, there are mentioned the flexor carpal flexor muscle M1, the flexor digitus flexor muscle M2, the palmar palm muscle M3, and the flexor carpal flexor muscle M4. Each of the ulnar carpal flexor M1, the flexor digit M2, the palmar muscle M3, and the groin flexor M4 exhibits remarkable movement around the wrist by moving each finger, for example, around the wrist It may be possible to visually check the condition in which the tendon is lifted from the arm. In the following description, at least one muscle of the flexor carpalflex M1, the flexor digit M2, the palmar long muscle M3, and the flexor carpal M4 may be referred to as a main muscle.

  Therefore, in the present disclosure, with regard to the movement of the user's finger, the movement of each finger is detected by detecting the state of muscles moving each finger, that is, the change (expansion and contraction) around the wrist that is the arm around the finger. Do. Specifically, the sensor array 14 outputs a detection signal indicating pressure and pressure fluctuation around the user's left wrist according to the movement of the user's finger to the device body 12.

  FIG. 3 shows a sensor array 14 which is an example of a sensor that detects the condition of muscles moving each finger. FIG. 3A shows a plan view of the sensor array 14, and FIG. 3B shows a side view of the sensor array 14.

  As shown in FIGS. 3A and 3B, the sensor array 14 includes a flexible elongated support substrate 14D attached to the periphery of the forearm, that is, the wrist. In the elongated support base 14D, a plurality of pressure elements 14A each for detecting pressure acting from the main muscle of the forearm working when bending a finger is arranged along the forearm side of the elongated support base 14D. The pressure sensor 14C is attached. One end of a signal line 14B is connected to each of the plurality of pressure elements 14A, and the other end of each of the signal lines 14B is connected to the apparatus main body 12 (input unit 121) shown in FIG. Each individual signal corresponding to the pressure detected by each of the plurality of pressure elements 14A is output to the apparatus body 12 as a detection signal via the signal line 14B.

  Therefore, the distribution of the individual signals of each of the plurality of pressure elements 14A, which is a detection signal output from the sensor array 14, is in the state in which each finger is moved from the calm state of the main muscle (state in which no force is applied to each finger). It corresponds. Therefore, by making the character information correspond in advance to each of the different detection signals from the sensor array 14, it becomes possible to output the character information corresponding to the movement of the user's finger. The device body 12 executes output processing of character information corresponding to the movement of the user's finger.

  FIG. 4 shows an example of a detection signal by the sensor array 14. FIG. 4A shows a state in which all the fingers of the user are bent (a so-called state of goo) as an example of the movement of the fingers of the user wearing the sensor array 14. 4 (B) shows a detection signal of the sensor array 14 in the state of FIG. 4 (A), and FIG. 4 (c) shows a discontinuance view in the longitudinal direction around the sensor array 14.

  As shown in FIG. 4 (B), in the detection signal of the sensor array 14, the peak PM1 of the individual signal appears corresponding to the contraction of the flexor carpal flexor muscle M1. In addition, the peak PM2 of the individual signal appears corresponding to the contraction of the flexor digit M 2, the peak PM 3 of the individual signal corresponding to the contraction of the long palm M 3, and the peak corresponding to the contraction of the carpal flexor M 4 A peak PM4 of the signal appears.

  In the following description, each signal of the plurality of pressure elements 14A is referred to as an individual signal, and a group of signals of the plurality of pressure elements 14A is referred to as a detection signal. It may be described as a signal.

  The sensor array 14 is not limited to the long pressure detector 14C in which a plurality of pressure elements 14A are arranged. For example, it may be a stress sensor array in which stress sensors based on capacitive sensors and resistive sensors are arranged in one dimension.

Further, the sensor array 14 is not limited to a pressure detector, and a plurality of power elements each for detecting power generated from a main muscle of a forearm when bending a finger is a surface on the forearm side of the elongated support base It may be a power detector arranged along.
Alternatively, an optical element (not shown) that optically detects an uneven pattern due to a change around the wrist (for example, expansion and contraction of the wrist) may be used for detection.

FIG. 5 schematically shows an example of the sensor array 14 when the sensor array 14 is attached to the user's wrist.
FIG. 5A shows an example of a state in which the sensor array 14 is attached to the wrist of the user, and FIG. 5B shows a side view of the sensor array 14. In the example shown in FIG. 5, the sensor array 14 is a flexible wristband attached around the forearm, that is, the wrist, as an elongated support substrate 14D. Moreover, in the example shown in FIG. 5, the case where the display part 18 is incorporated in elongate support base material 14D which is a wristband is shown.

An example of a more specific sensor array 14 is shown in FIG.
FIG. 6A shows a state in which character information is displayed on the display unit 18 provided on the surface of the elongated support base 14D which is a wristband. FIG. 6 (B) shows a perspective view of the sensor array 14 provided on the back surface of the elongated support substrate 14D, that is, on the wrist side of the user.

  By the way, when the user attaches the wristband, that is, the elongated support base 14D to the wrist, it is preferable that the sensor array 14 and the user's wrist are in close contact. This is to make it possible to detect, with each of the plurality of pressure elements 14A, the pressure acting from the muscle such as the main muscle of the forearm that works when the user bends a finger. Therefore, in the present disclosure, when the user attaches the wristband, that is, the elongated support substrate 14D to the wrist, the sensor array 14 is configured to be pressed to the wrist side of the user.

FIG. 7 shows an example of a structure for pressing the sensor array 14 against the wrist of the user.
In the example shown in FIG. 7, a telescopic member 14E is provided between the sensor array 14 and the elongated support base 14D. FIG. 7A shows a contracted state, and FIG. 7B shows an expanded state. Although illustration is omitted, by providing a holding portion such as a clip for holding the contracted state shown in FIG. 7A, the contracted state shown in FIG. 7A to an expanded state shown in FIG. 7B. The migration can be performed by the user's operation.

  In the present disclosure, the device body 12 illustrated in FIG. 1 corresponds to learning processing for obtaining a correspondence with the character information corresponding to the movement of the user's finger using the detection signal of the sensor array 14 and the movement of the user's finger. Execute output processing of character information.

  As shown in FIG. 1, the device body 12 includes an input unit 121, a signal processing unit 122, a determination unit 123, a learning unit 124, an identification unit 125, a template unit 126, an output unit 127, and a display control unit 128. In the device body 12, a detection signal from the sensor array 14 is input to the signal processing unit 122 via the input unit 121. The input unit 121 has an input side connected to the sensor array 14 and an output side connected to the signal processing unit 122. The input detection signal of the sensor array 14 is subjected to shaping processing such as noise removal and output. Function unit having the following function.

  The information processing device 10 is an example of the information processing device of the present disclosure. The determination unit 123 and the identification unit 125 are an example of a detection unit of the present disclosure. The identification unit 125 and the output unit 127 are an example of the output unit of the present disclosure. The display control unit 128 and the display unit 18 are examples of the display unit of the present disclosure.

  The signal processing unit 122 is a functional unit that performs signal processing to convert an input detection signal, that is, a plurality of individual signals into pressure signals converted to pressure. The output side of the signal processing unit 122 is configured to be connectable to the learning unit 124 or the identification unit 125 via the determination unit 123, and the pressure signal subjected to the signal processing is learned according to the operation mode of the apparatus main body 12. Alternatively, it is output to the identification unit 125.

  The determination unit 123 is a functional unit that functions as a switch that sets the operation mode of the apparatus body 12 to any one of the input operation mode and the learning mode. The input operation mode is a mode for outputting character information corresponding to the movement of the user's finger. In the input operation mode, the determination unit 123 connects the signal processing unit 122 and the identification unit 125. On the other hand, the learning mode learns the correspondence between the movement of the user's finger for outputting the character information corresponding to the movement of the user's finger in the input operation mode and the character information corresponding to the movement of the user's finger. It is a mode. In the learning mode, the determination unit 123 connects the signal processing unit 122 and the learning unit 124.

  The setting of the mode, that is, the setting to any one of the input operation mode and the learning mode is determined in advance by the determination unit 123 so as to be set according to the automatic determination or the determination by the user operation. One example of setting by automatic determination is that the mode is set by the number of times of powering on the device main body 12 of the information processing device 10. For example, the determination unit 123 may be configured such that the learning mode is set to the apparatus main body 12 of the information processing apparatus 10 at the first power-on and the input operation mode is set from the next time onwards. On the other hand, as an example of setting based on the determination of the operation of the user, the mode may be set by the mode setting operation by the movement of the finger of the user. For example, the movement of the user's finger (hereinafter referred to as mode determination operation) with respect to the transition to one of the input operation mode and the learning mode (hereinafter referred to as mode determination operation) The learning mode or the input operation mode may be set according to the movement of the finger. The details regarding the specification of the movement of the user's finger will be described later.

  Note that the determination unit 123 includes, for example, a mode determination switch, and switches to either the input operation mode or the learning mode by the mode determination switch, that is, any one of the signal processing unit 122 and the identification unit 125 or the learning unit 124. You may make it connect with one side.

  When the learning mode is set, the learning unit 124 determines (learns) the correspondence of the character information corresponding to the movement of the user's finger using the detection signal from the sensor array 14 and the correspondence Are stored in the template unit. The first output side of the learning unit 124 is connected to the display control unit 128, and the second output side is connected to the template unit 126. In the learning mode, the learning unit 124 outputs the character information to the display control unit 128 so that the character information for learning the correspondence relationship is displayed on the display unit 18. Next, the learning unit 124 uses the detection signal from the sensor array 14 as a result of the user performing the movement of the finger corresponding to the character information displayed on the display unit 18, and the character corresponding to the movement of the user's finger Find (learn) the correspondence of information. Then, the learning unit 124 stores the correspondence of the learning results in the template unit 126. The details of the learning process in the learning unit 124 in the learning mode will be described later.

  The identification unit 125 is a functional unit having a function of identifying character information corresponding to the movement of the user's finger when the input operation mode is set. The template unit 126 stores a plurality of correspondences between the movement of the user's finger and the character information, and the identification unit 125 corresponds to the correspondence between the movement of the user's finger stored in the template unit 126 and the character information. It is possible to refer to. That is, the first input side of the identification unit 125 is connected to the output side of the signal processing unit 122, the second input side is connected to the template unit 126, and the correspondence relationship stored in the template unit 126 is used. The movement of the user's finger is determined, and the character information corresponding to the determined movement of the user's finger is identified. The identification unit 125, whose output side is connected to the output unit 127, outputs character information corresponding to the movement of the user's finger to the output unit 127. The details of the input operation process in the identification unit 125 in the input operation mode will be described later.

  The output unit 127 is a functional unit having a function of outputting character information to an external device of the apparatus main body 12. In the present disclosure, as an example of an external device, a case where a communication unit 16 communicating with another information processing apparatus and a display unit 18 such as a display are connected to the apparatus main body 12 will be described. First, the output unit 127 is connected to the communication unit 16 so as to output the input character information to the communication unit 16. When the communication unit 16 transmits character information, character information corresponding to the movement of the user's finger is received by an information processing apparatus different from the information processing apparatus 10. The output unit 127 is also connected to the display unit 18 via the display control unit 128. The display control unit 128 outputs a display signal to the display unit 18 so that the character information from the output unit 127 is displayed on the display unit 18. As a result, character information corresponding to the movement of the user's finger is displayed on the display unit 18.

  Although the present disclosure describes the case where the communication unit 16 and the display unit 18 are connected to the device body 12 as an example of the external device, any one of the communication unit 16 and the display unit 18 may be used as the external device. Also, the external device is not limited to the communication unit 16 and the display unit 18, and may be another device.

Next, the learning process performed by the learning unit 124 in the learning mode will be described.
The learning process relates to the correspondence between the movement of the user's finger and the character information corresponding to the movement of the user's finger, in which the identification is enhanced to identify each of a plurality of different movements of the user's finger. It is a process to obtain. When the learning mode is set by the determination unit 123, the learning unit 124 uses the detection signal from the sensor array 14 to obtain the correspondence of the character information to the movement of the user's finger. Then, the obtained correspondence relationship is stored in the template unit 126.

First, the movement of the user's finger will be described.
The detection signal from the sensor array 14 indicates the movement of each finger of the user. That is, detection signals are output from the sensor array 14 according to different movements of each finger of the user. For example, the detection signal from the sensor array 14 changes according to the position where each finger is bent. That is, different detection signals are output from the sensor array 14 corresponding to different states of each finger of the left hand according to the bent position of each finger of the left hand.

  However, defining different states of each finger of the left hand by bending each finger of the left hand increases the burden on the user compared to bending the fingers freely, such as restricting how to bend the fingers. . Further, with slight finger bending, the difference between the detection signals output from the sensor array 14 is small, and the device may be complicated as if the detection signals are determined with high accuracy.

Therefore, in the present disclosure, the motion of the user's finger is detected by general finger motion. In the present disclosure, as an example of a general finger motion, a finger motion in which fingers are brought into contact with each other is used as a motion of a user's finger.
On the other hand, in the left hand, since there are many contactable parts between the fingers, there is a possibility that the movement of the finger of the user may be erroneously detected due to the deviation of the contact position. For this reason, in the present disclosure, the contactable portions of the fingers are predetermined.

  As shown in FIG. 2, in the user's left hand, the thumb Uo is divided by a joint from the base of the finger into two phalanxes called a base and a last. In addition, the index finger Us, the middle finger Un, the ring finger Uk, and the little finger Uc, which are fingers other than the thumb, are each divided into three phalanxes called base, middle, and last from the base of the finger by two joints. Here, each of the 12 areas of 3x4 by the phalanx on the finger other than the thumb is capable of the contact of the thumb Uo. That is, it is possible to make contact with the end of the thumb Uo and each of the base, middle and end of the index finger Us, the middle finger Un, the ring finger Uk, and the little finger Uc.

  Therefore, in the present disclosure, as a site for bringing the fingers into contact with each other, the last section of the thumb Uo and any of the base section of the index finger Us, the middle finger Un, the ring finger Uk, and the little finger Uc, the middle section, and the last section Determined. Therefore, the detection signal from the sensor array 14 is used to contact the site of the last segment of the thumb Uo with each of the base, middle, and last segments of the index finger Us, the middle finger Un, the ring finger Uk, and the small finger Uc. By determining, it is possible to identify the movement of the user's finger. In the present disclosure, when the fingers are brought into contact with each other, the thumb Uo is a predetermined finger on the instruction side in the input operation, and the other finger is a finger on the instructed side.

  In addition, the site | part which the thumb Uo contacts can include a part of palm. For example, the site of the palm on each side of the index finger Us, the middle finger Un, the ring finger Uk, and the little finger Uc is a site adjacent to the base of each finger, and contact with the thumb Uo is possible. Thus, in the present disclosure, the finger-to-finger contact may define the end segment of the thumb Uo and the other finger segments or the other finger segments and the palm segment.

  Here, the contact between the fingers when detecting the movement of the user's finger can be detected by the vibration amplitude of the detection signal generated at the time of the contact.

FIG. 8 shows an example of the detection signal output from the sensor array 14 in accordance with the movement of the user's finger.
In the example shown in FIG. 8, the case where the average value of each individual signal of several pressure element 14A output from the sensor array 14 was made into a detection signal is shown.

  When the fingers are in contact with each other, at least one of the main muscles, the flexor carpalflex M1, the flexor digit M2, the palmar long muscle M3, and the carpal flexor M4 vibrates. This vibration appears in the detection signal output from the sensor array 14.

  As shown in FIG. 8, the characteristic W0 of the detection signal indicates the characteristic of the detection signal in a state where all the fingers of the user are bent (a so-called state of goo). In the state where the user's fingers are all bent, each of the ulnar carpal flexor M1, the flexor digit M2, the palmar muscle M3, and the flexor cario M4 changes, and only one user's finger is moved. In comparison, the magnitude of the detection signal is increased. Further, in a state in which the user's fingers are all bent, the end segments of the fingers other than the thumb Uo contact the palm, and the detection signal reaches its maximum value at time t1 and vibrates with the maximum amplitude H0. The detection signal value Dav0 of the vibration center is taken as the strength of the detection signal in a state where all the user's fingers are bent (a state of so-called goo).

  Further, the characteristic W1 indicates the characteristic in a state in which the end segment of the thumb Uo is in contact with the base segment of the index finger Us. In the characteristic W1, the value becomes maximum at time t2, vibrates with the maximum amplitude H1, and becomes the strength of the detection signal of the detection signal value Dav1 of the vibration center. Furthermore, the characteristic W2 of the detection signal shown in FIG. 8 shows the characteristic in a state in which the end segment of the thumb Uo is in contact with the middle segment of the index finger Us which is the same finger as the characteristic W1. The characteristic W2 has a maximum value at time t3 and vibrates with the maximum amplitude H2, and the intensity of the detection signal of the detection signal value Dav2 of the vibration center is obtained.

  The characteristic W3 indicates the characteristic in a state in which the last node portion of the thumb Uo and the base portion of the index finger Us are in contact with each other twice in time series. In the characteristic W1, the maximum value is obtained at the times t4 and t5, and oscillation occurs at the maximum amplitude H1, and the intensity of the detection signal of the detection signal value Dav1 of the vibration center is obtained.

  Thus, the strength of the detection signal changes according to the contact site between the fingers. Therefore, from the strength of the detection signal, it can be determined that the contact site has changed in the same finger touched by the end segment of the thumb Uo. In addition, when the same site is touched multiple times, the change in the intensity of the detection signal is zero or small. That is, when the last part of the thumb Uo is brought into contact with different parts of the same finger, the change in the main muscle is similar to the change in the intensity of the detection signal. Therefore, by detecting the change in the intensity of the detection signal, it is detected that at least the end node part of the thumb Uo has shifted to a state in which it is in contact with different parts of the same finger. Thereby, the movement of the finger of the user can be identified by specifying each of the intensities of the detection signals from different contact sites between the fingers.

  By the way, when contact is made between the last part of the thumb Uo and the part of the phalange of a finger other than the thumb Uo as contact between fingers, when the contact is transferred to the different parts of the phalange of the finger, the strength of the detection signal is There may be coincidence or near intensity. On the other hand, the contact of different finger segments with the last segment of the thumb Uo results in different changes in the main muscles. That is, the intensity of each individual signal of pressure element 14A corresponding to each of the flexor carpal flexor M1, the flexor digit M2, the palmar muscle M3, and the groin flexor M4 is different, and the signal distribution of the sensor array 14 ( FIG. 4B shows different signal distribution patterns. Therefore, for each of the index finger Us, middle finger Un, ring finger Uk, and little finger Uc, the signal distribution in the case where the last segment of the thumb Uo is in contact is detected in advance and stored as a signal distribution pattern. Can be used to determine the other finger with which the thumb is in contact. The signal distribution pattern to be detected in advance uses intensity values of individual signals of the pressure element 14A corresponding to each of the flexor carpal flexor M1, the flexor digitus flexor M2, the long palmar muscle M3, and the flexor carpal flexor M4. Can. In addition, the relative relationship of the strengths of the individual signals of the pressure element 14A corresponding to each of the flexor carpal flexor muscle M1, the flexor digitus flexor muscle M2, the long palmar muscle M3, and the flexor carpal flexor muscle M4 may be used.

  Here, when the fingers are brought into contact with each other, the thumb Uo is a predetermined finger on the instruction side in the input operation, and the other finger is a finger on the indicated side. There are at least 12 sites. On the other hand, the character information corresponding to the movement of the finger in the learning process includes 50 sounds, characters such as alphanumeric characters and symbols, and is not sufficient as a region in the case of constructing the correspondence. Therefore, in the present disclosure, character information is divided into a plurality of groups, and character information predetermined as a representative of each group (hereinafter referred to as representative character information) is made to correspond to the finger segment of a finger other than the thumb Uo. . Then, the correspondence of the character information in the group is switched by the same phrase.

  In the present disclosure, the movement of the user's finger is to be distinguishable by finger-to-finger contact and the number of contacts to the same site. That is, the number of contacts to the same part of the phalanx is included as movement of the user's finger. Thereby, the character information in the grouped group can be made to correspond to one phrase. For example, it is made to respond | correspond to representative character information by one touch to the same site | part by contact of fingers, and it is made to respond | correspond sequentially to the character information in a group according to the contact frequency which followed in time series. In a specific example, the character information of the "A" line is set as representative character information for the 50 sounds, and the representative character information and the character information of the "I" line to the "O" line in the representative character information are defined in one group. For example, the representative character information "A" corresponds to one contact between fingers, and the character information "I" corresponds to two contacts to the same part, sequentially according to the number of contacts. Character information is supported.

  The character information includes hiragana, alphanumeric characters, symbols and the like, and it is difficult to make all of them distinguishable by the contact between fingers and the number of contacts to the same part. Therefore, in the present disclosure, character information is classified by character types, for example, hiragana, alphanumeric characters, and symbols, and a template is defined for each classified character type (details will be described later).

  FIG. 9 schematically shows an example in which character information is made to correspond to each phalanx of each finger on the indicated side. In FIG. 9, character information is not drawn on the phalanx of the user's finger, but schematically shows that the character information is associated with each phalanx of each finger. FIG. 9A shows an example in which the character information of the “A” line is made to correspond to the representative character information for the 50 sounds as the first template. Further, FIG. 9B shows an example in which arrow symbol information is made to correspond to representative character information as a second template.

  Therefore, in the learning process, the character information is made to correspond to the movement of the user's finger specified by the detection signal of the sensor array 14 described above. That is, based on the detection signal of the sensor array 14, the user who identified the movement of the user's finger by the touched finger, the phalanx, the signal distribution pattern at the time of contact, and the number of contacts to the same site The correspondence between the finger movement and the character information is determined.

Next, the learning process performed in the learning mode will be described according to the learning procedure. In the learning process, the learning unit 124 sequentially executes the first learning procedure to the fourth learning procedure.
The first learning procedure of the learning process is a process of presenting to the user information prompting the movement of a finger to be learned. Here, processing is performed to display display information prompting contact between the fingers. That is, the learning unit 124 illustrated in FIG. 1 outputs, to the display control unit, display information prompting contact between the fingers. The display control unit 128 controls the display information from the learning unit 124 to be displayed on the display unit 18. This display information is information that urges the user to touch at least the thumb Uo and the finger that specifies any one of the index finger Us, the middle finger Un, the ring finger Uk, and the little finger Uc. In addition, the display information includes information prompting the fingers to make contact with each other a plurality of times. That is, processing is performed to display on the display unit 18 display information prompting the user to make contact between the fingers a plurality of times.

  The display information displayed on the display unit 18 is preferably a message that can be intuitively understood by the user. For example, the display information which urges finger-to-finger contact due to contact between the last segment of the thumb Uo and the portion of the phalanx of the index finger Us includes a message such as "Please touch the thumb and forefinger". In addition, the display information for prompting the finger segment of the finger includes the “forefinger tip” corresponding to the last segment, the “index finger middle” corresponding to the middle segment, and the “index finger” corresponding to the root segment And the like.

  The next second learning procedure is a process of acquiring the detection signal of the sensor array 14 and specifying the signal form of the detection signal with respect to the movement of the user's finger. The user refers to the display information displayed on the display unit 18 in the first learning procedure, and moves the finger by the contact between the specified fingers. A detection signal of the sensor array 14 with respect to the movement of the user's finger is obtained. Then, the detection signal of the sensor array 14 is used to specify information indicating the signal form of the movement of the user's finger. In the present disclosure, as information indicating the signal form specified using the detection signal of the sensor array 14, the vibration amplitude vid of the detection signal at the time of contact, the intensity Dav of the detection signal, the signal distribution pattern Pt of the sensor array 14, and multiple times Each piece of information of the time interval Th in the case of continuous contact is used.

The vibration amplitude vid of the detection signal at the time of contact is information used to detect contact between fingers. The strength Dav of the detection signal is information used to detect the phalanx when the fingers are in contact with each other. For example, the intensity Dav of the detection signal is derived using the following equation (1). Further, the vibration amplitude vid of the detection signal is derived using the intensity Dav of the detection signal using the following equation (2).
Dav = (D1 + D2 + D3 +... + Dm) / m (1)
vid = Dav (max) -Dav (min) (2)
However, Di (1 ≦ i ≦ m) is the strength of the individual signal of the ith pressure element 14A, and m is the total number of pressure elements 14A. Also, Dav (max) is the maximum value of the intensity Dav, and Dav (min) is the minimum value of the intensity Dav.

  In addition, the detection signal is an individual signal of pressure element 14A corresponding to each with the measure power of flexor muscle M1, the flexor digit M 2 muscle, the palmar long muscle M 3 and the groin flexor muscle M 4 as main muscles for noise suppression. It is preferred to use. In this case, the main muscle may specify, for example, the pressure element 14A from the maximum intensity to the fourth intensity at the peak of the signal distribution of the individual signals of the pressure element 14A in the sensor array 14 (FIG. 4B) reference). Further, the strength Dav of the detection signal may be weighted by multiplying the individual signal of the pressure element 14A by a predetermined coefficient in order to enhance the discriminability. In the following description, a case where detection signals by individual signals of four pressure elements 14A corresponding to four main lines are used will be described.

The signal distribution pattern Pt of the sensor array 14 is information used to detect a finger when the fingers are in contact with each other. The time interval Th in the case where the finger is touched a plurality of times consecutively is information used to detect one time interval in the case where the fingers are touched a plurality of times at the unified site. The signal distribution pattern Pt of the sensor array 14 uses the strengths of the individual signals of the corresponding pressure elements 14A, with the four types of muscles M1 to M4 as main muscles. The signal distribution pattern Pt using the intensity of the individual signals of the main muscle can be expressed by the following equation (3).
Pt = (D _M1 , D _M2 , D _M3 , D _M4 ) (3)
However, D _M1 , D _M2 , D _M3 and D _M4 are individual signals of the pressure element 14A corresponding to each of the flexor carpal flexor M1, the flexor digit M 2, the palmar muscle M 3 and the flexor carpal M 4 It is strength.

  The next third learning procedure is a process of repeating the first learning procedure and the second learning procedure until information indicating the signal form of each of the finger movements of different users is specified. The third learning procedure identifies information indicating each signal form caused by contact between different fingers. That is, information indicating the signal form at the time of contact with at least the forefinger segment of the thumb Uo and the base, middle segment, and distal segment of the index finger Us, middle finger Un, ring finger Uk, and little finger Uc is identified. Ru.

  In addition, the detection signal of the other phalanx of the same finger can be estimated from the detection signal by contact with the site of the last segment of the thumb Uo and any one phalanx of the designated finger as contact between the fingers. In this case, the first learning procedure and the second learning procedure for each phalanx of the same finger can be omitted. For example, the detection signal by the contact between the last part of the thumb Uo and the last part of the index finger Us has a relative relation with the detection signals of the other parts of the index finger, ie, the base and middle parts of the index finger Us. In this case, detection signals of other phalanxes of the same finger can be estimated from the relative relationship.

Further, the first learning procedure and the second learning procedure include, in addition to the identification of the information indicating the signal form caused by the contact between the fingers, the identification of the information indicating the signal form caused by the contact between the plurality of fingers.
FIG. 10 shows an example of the movement of the user's finger due to the contact between a plurality of fingers. FIG. 10A shows a state in which all the fingers of the user are bent (a state of so-called goo). FIG. 10B shows a state in which all the fingers of the user are spread (a so-called par state).

  The state in which all the fingers of the user shown in FIG. 10B are spread can be set as the reference state of the movement of the user's finger as the Heisei state. Therefore, when transitioning from the state in which all the user's fingers shown in FIG. 10B are spread (the so-called par) to the state in which all the fingers shown in FIG. 10A are bent (the so-called go). Information is identified that indicates the signal morphology for the user's finger movement.

  FIG. 11 shows another example of the movement of the user's finger due to the contact between the plurality of fingers. FIG. 11A shows a state in which the wrist is bent at an angle θ from a state in which all the fingers of the user are bent (so-called goo state). Further, FIG. 11 (B) shows a state in which all the fingers of the user are bent (a so-called state of goo) as in FIG. 10 (A).

  The movement of the finger of the user shown in FIGS. 10 and 11 can be made to correspond to character information, but is preferably made to correspond to information related to operations such as commands and instructions. In the present disclosure, an example in which the movement of the finger of the user illustrated in FIG. 10 corresponds to an activation command for activating the information processing device 10 and a stop command for stopping the information processing device 10 will be described. Also, an example of the case where the movement of the user's finger shown in FIG. 11 corresponds to the learning mode transition command of the mode determination operation indicating transition to the learning mode will be described. Of course, the technique according to the present disclosure is not limited to making the movement of the user's finger shown in FIGS. 10 and 11 correspond to the start and stop commands of the information processing apparatus 10.

  Next, the fourth learning procedure is processing of generating a table in which the character information is associated with the information indicating the identified signal form, that is, a table indicating the correspondence between the movement of the user's finger and the character information. .

  Here, the character information includes hiragana, alphanumeric characters, symbols, and the like, and it is difficult to make all of them distinguishable by the contact between fingers and the number of contacts to the same part. Therefore, in the present disclosure, character information is classified by character types, for example, hiragana, alphanumeric characters, and symbols, and a template is defined for each classified character type.

  FIG. 12 shows an example of a template for each predetermined character type. In the example shown in FIG. 12, a template of character information classified according to the type of "Hiragana" is shown as a first template. Also, a template of character information classified according to the type of “symbol” is shown as a second template. Similarly, a template of character information classified according to the type of "English character" is shown as a third template, and a template of character information classified according to the type of "number" is shown as a fourth template.

  Therefore, in the fourth learning procedure, a correspondence in which the character information according to the template is associated with the information indicating the specified signal form is generated as a table.

  FIG. 13 shows an example of a table showing the correspondence between the movement of the user's finger and the character information. In the example shown in FIG. 13, a template of character information classified according to the type of character is shown as a first template. Also, a template of character information classified according to the type of “symbol” is shown as a second template. Similarly, a template of character information classified according to the type of "English character" is shown as a third template, and a template of character information classified according to the type of "number" is shown as a fourth template.

  FIG. 14 shows an example of a table showing the correspondence between the movement of the user's finger and the command. In the example shown in FIG. 14, "cancel" indicates a cancel command instructing cancellation (or deletion) of character input, "switch" indicates a switch command instructing switching of a template, and "conversion" indicates a hiragana character. It shows a conversion command instructing conversion to kanji.

Next, in the fourth learning procedure, a table indicating the correspondence between the generated movement of the user's finger and the command is stored as a learning result in the template unit 126 (see FIG. 1).
Further, different detection signals from the sensor array 14 are patterned, and a table indicating correspondences for associating character information or commands with each of the patterned detection signals is stored in the template unit 126 (see FIG. 1). May be

  In the above-described learning processing, although the case where contact between the user's fingers is urged to associate the contact area and the number of contacts with the character information has been described, the user is allowed to set the contact area corresponding to the character information. May be That is, the user may specify the part corresponding to the character information by including the character information in the display information displayed on the display unit 18. For example, character information is displayed on the display unit 18, and movement of the user's finger corresponding to the displayed character information, that is, contact between fingers is promoted. Then, the user brings the desired fingers into contact with each other as the correspondence of the displayed character information. This determines the movement of the user's finger corresponding to the text information. Therefore, a template desired by the user, ie, a user-defined template is constructed.

  In the present disclosure, the learning unit 124 performs the learning process for obtaining the correspondence with the character information corresponding to the movement of the user's finger. However, the present invention is limited to performing the learning process in the device body 12 It is not a thing. For example, the correspondence with the character information corresponding to the movement of the user's finger may be obtained in advance, and the learning result obtained in advance may be stored in the template unit 126. When the learning result obtained in advance is stored in the template unit 126, the determination unit 123 and the learning unit 124 can be omitted.

Next, input operation processing performed by the identification unit 125 in the input operation mode will be described.
The input operation process is a process of identifying character information corresponding to the movement of the user's finger using the detection signal from the sensor array 14 and the table stored in the template unit 126 when the input operation mode is set. It is.

  In the input operation process, the identification unit 125 sequentially executes the first to fourth input procedures.

  The first input procedure of the input operation process is a process of prompting transition to a state where input operation can be performed by the movement of the user's finger. That is, when performing an input operation by the movement of the user's finger, display information indicating that the input operation has been shifted is displayed on the display unit 18 to notify the user. Therefore, the identification unit 125 outputs the display information of the predetermined symbol to the display control unit 128 via the output unit 127 so that the display information such as the predetermined symbol is displayed on the display unit 18. The display control unit 128 controls the display information from the identification unit 125 to be displayed on the display unit 18. The display of the display information may include blinking of display information of a symbol such as an underbar.

  In addition, it is preferable to perform a calibration process when the user wears the sensor array 14 before shifting to a state in which the input operation can be performed by the movement of the user's finger. The calibration process is an individual attachment setting process when the sensor array 14 is attached, and includes calibration of a detection signal of the sensor array 14 and specification of the pressure element 14A of the sensor array 14 corresponding to the main muscle. That is, when the user wears the sensor array 14, the value of the vibration amplitude of the detection signal of the sensor array 14 and the attachment position of the sensor array 14 with respect to the main muscle differ for each user. The calibration process is a process of calibrating various values which differ for each user to values suitable for the user wearing the sensor array 14. Specifically, the calibration process executes a process of matching values different for each user to the table stored in the template unit 126. The different values for each user include the vibration amplitude vid of the detection signal at the time of touch, the intensity Dav of the detection signal, the signal distribution pattern Pt of the sensor array 14, and the value of the time interval Th in the case of continuous contact several times. Can be mentioned.

  The next second input procedure is a process of detecting the movement of the finger performing an input operation. That is, in the second input procedure, the detection signal of the sensor array 14 is acquired, and information indicating the signal form of the detection signal with respect to the movement of the user's finger is specified based on the detection signal of the sensor array 14. Here, the information indicating the signal form of the detection signal includes the vibration amplitude vid of the detection signal at the time of contact, the intensity Dav of the detection signal, the signal distribution pattern Pt of the sensor array 14, and the number of times of contact in a plurality of successive contacts Use each information of

  Next, the third input procedure is a process of identifying character information corresponding to the movement of the specified finger. That is, in the third input procedure, the signal form of the detection signal specified in the second input procedure is compared with the signal form of the detection signal in the table stored in the template unit 126, and the coincidence or the fitness becomes the maximum value. The signal form of the detection signal on the table is specified. Next, character information corresponding to the movement of the finger is identified from the table stored in the template unit 126 by extracting character information corresponding to the signal form of the detection signal on the specified table.

  The degree of matching is derived using the intensity Dav of the detection signal, the ratio of each of the signal distribution patterns Pt of the sensor array 14, and the like. For example, the degree of fitness may be the difference between the intensity Dav identified in the second input procedure and the intensity Dav on the table, and the difference between the signal distribution pattern Pt identified in the second input procedure and the signal distribution pattern Pt on the table However, it is derived using an arithmetic expression that has been determined in advance so that the degree of matching becomes higher as it becomes smaller.

  The next fourth input procedure is processing of outputting character information corresponding to the movement of the finger. That is, in the fourth input procedure, the character information identified in the third input procedure is output to the display control unit 128 via the output unit 127. The display control unit 128 controls the display information from the identification unit 125 to be displayed on the display unit 18. As a result, the display unit 18 displays character information corresponding to the movement of the finger. In the fourth input procedure, the character information identified in the third input procedure is output to the communication unit 16 via the output unit 127. As the communication unit 16 transmits the character information as described above, the character information corresponding to the movement of the user's finger is received by the information processing apparatus different from the information processing apparatus 10.

The apparatus main body 12 of the information processing apparatus 10 that executes a process including the learning process and the input operation process can be realized by a computer.
FIG. 15 shows an example of the configuration of a computer 12X in which the apparatus body 12 of the information processing apparatus 10 is realized by a computer.

  As shown in FIG. 15, the computer 12X includes a central processing unit (CPU) 12A, a random access memory (RAM) 12B, a read only memory (ROM) 12C, and an input / output interface (I / O) 12D via a bus 12E. Each connected. The sensor array 14, the communication unit 16, and the display unit 18 are connected to the I / O 12D.

  The ROM 12 </ b> C stores an information processing program 12 </ b> P that executes processing including learning processing and input operation processing relating to the correspondence between the movement of the finger and the character information. The CPU 12A reads the information processing program 12P from the ROM 12C and develops the information processing program 12P on the RAM 12B, and executes processing by the information processing program 12P. When the CPU 12A executes the processing by the information processing program 12P, the computer 12X operates as the apparatus main body 12 shown in FIG. The information processing program 12P may be provided and distributed by a recording medium such as a CD-ROM.

  Next, processing by the computer 12X operating as the device main body 12 of the information processing device 10 according to the present disclosure will be described.

  FIG. 16 shows the flow of processing by the information processing program 12P. The information processing program 12P is executed by the CPU 12A when the computer 12X is powered on.

  First, in step S100, a detection signal of the sensor array 14 is acquired. In this step S100, the intensities Di of the individual signals of the m pressure elements 14A included in the detection signal from the sensor array 14 are acquired, and the intensity Dav of the detection signal is derived using the equation (1). In the next step S102, a negative determination is repeated until the intensity Dav derived in step S100 exceeds a predetermined threshold value Ds, and if an affirmative determination is made, the process proceeds to step S104.

  The processes of step S100 and step S102 are an example of the process of activating the information processing apparatus 10. That is, when the movement (see FIG. 10) of the user's finger corresponding to the start command of the information processing apparatus 10 is identified, the process proceeds to step S104.

  In step S104, determination processing as to whether the learning mode or the input operation mode is performed. In this step S104, the detection signal of the sensor array 14 is acquired, and it is determined whether the movement of the finger of the user (see FIG. 11) which is a mode determination operation indicating transition to the learning mode. That is, when the mode determination operation is specified, the process proceeds to step S106.

  The processes of steps S100 to S104 correspond to the processes performed by the determination unit 123.

  When the movement of the user's finger, which is a mode determination operation indicating transition to the learning mode, is specified, in step S106, for example, the learning process is sequentially performed according to the first learning procedure to the fourth learning procedure, and then this process is performed. End the routine The process of step S106 is an example of the process executed by the learning unit 124.

  On the other hand, when the mode determination operation is not specified, such as when there is no change in the user's finger movement in step S104, processing in the input operation mode after step S108 is performed.

  In step S108, a calibration process is performed to calibrate various values which differ for each user to values suitable for the user wearing the sensor array 14. As described above, the calibration process is an installation setting process for each individual when the sensor array 14 is attached, the calibration of the detection signal of the sensor array 14 and the identification of the pressure element 14A of the sensor array 14 corresponding to the main muscle To be done. By executing this calibration process, various values that are different for each user are calibrated, and fluctuation of values when the sensor array 14 is attached by different users is suppressed. Further, even in the case of the same user, when the fluctuation of the value of the vibration amplitude of the detection signal or the displacement of the mounting position occurs with the passage of time, the influence of the fluctuation of the value is suppressed.

  In the next step S110, an initial display process is performed to notify that the input operation by the movement of the user's finger has become possible. Execution of this initial display process enables the user to confirm that the state has been shifted to a state where input operation is possible. The initial display process of step S110 is an example of the process of the first input procedure of the input operation process described above.

  After the initial display process is performed, in step S112, a detection signal of the sensor array 14 is acquired. In this step S112, the intensity Di of the individual signal of each pressure element 14A corresponding to the main muscle included in the detection signal from the sensor array 14 is acquired, and the intensity Dav of the detection signal is derived. Also, in step S112, using the detection signal from the sensor array 14, the vibration amplitude vid of the detection signal, the signal distribution pattern Pt of the detection signal, and the number of contacts in a plurality of successive contacts at time intervals Th are detected. .

  In the next step S114, it is determined whether the fingers are in contact by determining the strength Dav of the detection signal and the vibration amplitude vid. That is, when the intensity Dav exceeds the predetermined intensity Do as the minimum value of the finger movement (Dav> Do) and the vibration amplitude vid of the detection signal is detected, an affirmative determination is made in step S114, and the process proceeds to step S116. Migrate On the other hand, if a negative determination is made in step S114, the process returns to step S112.

  Next, in step S116, the movement of the finger is detected by specifying the information indicating the signal form of the detection signal. That is, the intensity Dav of the detection signal derived and detected in step S112, the signal distribution pattern Pt, and the number of times of contact are specified as the signal form corresponding to the movement of the finger. The processes of steps S112 to S116 are an example of the process of the second input procedure of the input operation process described above.

  In the next step S118, character information is identified using the signal form specified in step S116. That is, in step S118, the signal form of the detection signal corresponding to the movement of the finger identified in step S116 is compared with the signal form of the detection signal in the table stored in the template unit 126. Then, the signal form of the detection signal on the table where the coincidence or the matching degree is the maximum value is specified. Next, character information corresponding to the movement of the finger is identified from the table stored in the template unit 126 by extracting character information corresponding to the signal form of the detection signal on the specified table. The process of step S118 is an example of the process of the third input procedure of the input operation process described above.

  In the next step S120, the character information is displayed on the display unit 18 by outputting the character information identified in step S118. That is, in step S120, the character information identified in step S118 is output to the display control unit 128 via the output unit 127. As a result, the display unit 18 displays character information corresponding to the movement of the finger. In step S120, character information is output to the communication unit 16 via the output unit 127. As the communication unit 16 transmits the character information as described above, the character information corresponding to the movement of the user's finger is received by the information processing apparatus different from the information processing apparatus 10. The process of step S120 is an example of the process of the fourth input procedure of the input operation process described above.

  Next, in step S122, similarly to step S100, the detection signal of the sensor array 14 is acquired to derive the strength Dav of the detection signal, and the negative determination is repeated until the derived strength Dav exceeds a predetermined threshold Ds. If it is determined, this processing routine is ended. On the other hand, if a negative determination is made in step S122, the process returns to step S112. The process of step S122 corresponds to the process of ending the input operation in the information processing apparatus 10. That is, when the movement (see FIG. 10) of the user's finger corresponding to the stop command for stopping the information processing apparatus 10 is identified, the processing routine is ended.

  As described above, in the present disclosure, the movement of the finger of the user due to the contact between the fingers is specified from the change in the muscle of the forearm, and character information corresponding to the movement of the finger of the user is output. That is, the character information is output by using the movement of the finger due to the contact between the fingers as the input operation. As a result, it is not required to carry or install an input device such as a touch panel and a keyboard for the user to output character information. Therefore, the usability is improved.

  Further, in the present disclosure, the movement of the finger of the user due to the contact between the fingers is associated with the character information corresponding to the key of the keyboard input, for example, and the corresponding character information is output by detecting the contact between the fingers. . As described above, since the movement of the finger due to the contact between the fingers is used as the input operation, the identification of the movement of the finger of the user is improved as compared to detecting the movement of only each finger of the user.

  Also, in the present disclosure, the finger movement is identified from muscle fluctuations in the forearm, particularly the wrist, so direct detection of the finger movement itself by the imaging device is not necessary. In addition, it is not necessary to directly detect the movement of the finger itself by the contact sensor. This reduces the burden on the user. In addition, since it is sufficient to detect only the movement of muscles in the forearm, especially the wrist, the wearing feeling is the same as that of a wrist band, a watch, etc., and the burden on the body at the time of wearing is reduced.

  Furthermore, since the movement of the finger due to the contact between the fingers is used as the input operation, it is possible to obtain a pressing feeling as if the finger operation for bringing the fingers into contact with one another pressed the key of the keyboard. For this reason, it is possible to provide the user with a sense of use of the touch input device such as the touch panel and the keyboard.

  Although the present disclosure has described the case of outputting character information corresponding to the movement of a finger, the character information is not limited to one character such as 50 sounds, alphanumeric characters, and symbols, and a plurality of character information It may be string information combining. Further, in the present disclosure, the case where the character information is associated with the movement of the finger has been described, but instead of the character information, image information may be associated.

  Further, in the present disclosure, the case where the contact between the fingers is detected by the vibration amplitude of the detection signal generated at the time of contact has been described, but the present invention is not limited to the vibration amplitude of the detection signal. For example, when the gradient of the rising characteristic of the detection signal exceeds a predetermined threshold, the fingers may be in contact with each other. In addition, when the signal widths of the maximum value and the minimum value of the detection signal exceed a predetermined threshold, the fingers may be in contact with each other.

  Further, in the present disclosure, the case where the thumb Uo of the left hand is the predetermined finger on the instruction side in the input operation and the other finger of the left hand is the finger on the indicated side has been described. It is not limited to contact between fingers by fingers. For example, the finger of the right hand may be at least one of the finger on the pointing side and the finger on the pointing side. In this case, it is preferable that a detection unit for detecting the movement of the finger is provided at least on the forearm that detects the movement of the finger on the side indicated.

  Further, in the present disclosure, the contact between fingers by the thumb as a finger on the instruction side and the finger other than the thumb as a finger on the instruction side has been described. . In this case, any one finger other than the thumb may be defined as a finger on the instruction side, and contact between the fingers may be detected.

  In addition, although the present disclosure mainly describes the contact between the thumb and the other fingers than the thumb, the contact between the fingers is not limited to one finger each. For example, the plurality of fingers may be at least one of the pointing finger and the pointed finger. By doing this, the character information that can be associated with the movement of the finger is increased.

  Furthermore, although the present disclosure has described an example of the information processing apparatus 10 using the sensor array 14 (see FIG. 6) in the form of a wristband as an example of a detection unit that detects finger movement, the information processing apparatus 10 is dedicated. It is not limited to the application to the wrist band. For example, the present invention may be applied to a portable terminal such as a watch provided with the communication unit 16 that communicates with another information processing apparatus.

FIG. 17 shows a timepiece 10A including a communication unit 16 and a display unit 18 as a first modification. FIG. 17 (A) shows a plan view of the watch 10A on the viewing side of the display unit 18, and FIG. 17 (B) shows a side view of the watch 10A.
As shown in FIG. 17, in the first modified example, a long pressure detector 14C is attached to the inside of the timepiece 10A, that is, the contact side to the wrist of the user. As described above, in the case of a portable terminal including the communication unit 16 and the display unit 18, the information processing device of the present disclosure can be easily applied.

  In addition, although the present disclosure describes an example of the information processing apparatus 10 using the sensor array 14 (see FIG. 6) as an example of a detection unit that detects the movement of a finger, the detection unit is limited to the sensor array 14 is not. For example, the shape of the forearm may be detected to compensate for the detection signal from the sensor array 14.

FIG. 18 shows an information processing apparatus 10B as a second modified example. FIG. 18 (A) is a side view, and FIG. 18 (B) is a plan view.
As shown in FIG. 18, the information processing apparatus 10 </ b> B of the second modified example includes a bending sensor 15. The bending sensor 15 is attached to a flexible elongated support substrate 14D attached to the sensor array 14 around the user's forearm, ie, the wrist. The bending sensor 15 is a sensor for detecting the degree of bending of the elongated support base 14D. The degree of bending is a value that increases as the amount of bending changing from the initial state (e.g., a planar state) of the elongated support base 14D increases. For example, it can be derived by setting the initial state to 1 and dividing the curvature R (= 1 / R).

  The outer peripheral shape of the wrist changes as the user moves each finger. Along with the change in the outer peripheral shape of the wrist, the shape of the elongated support base 14D also changes. The bending sensor 15 detects a change in the shape of the elongated support base 14D. That is, by detecting the degree of bending of the elongated support base 14D by the bending sensor 15, a change in the outer peripheral shape of the user's wrist is detected. Since the degree of bending of the elongated support base 14D detected by the bending sensor 15 corresponds to the fluctuation of the wrist surface of the user, it is considered to correspond to the sum of detection signals of the sensor array 14. Therefore, by using the degree of bending detected by the bending sensor 15 as a signal indicating the sum of the detection signals of the sensor array 14, the calculation of the sum of the individual signals becomes unnecessary, and the calculation load is reduced.

  By the way, the detection signal from the sensor array 14 may change depending on the direction of the user's hand. Therefore, when the detection signal from the sensor array 14 changes according to the direction of the user's hand, a detector for detecting the direction of the hand, for example, an acceleration sensor, which has previously determined correction values of the detection signal corresponding to the direction of the hand. The detection signal from the sensor array 14 is corrected with a correction value corresponding to the direction of the hand. By doing this, it is possible to suppress and handle the fluctuation of the detection signal of the sensor array 14 which fluctuates due to the change of the hand direction of the user.

  Also, the user may intentionally change the hand direction when conveying certain information. Therefore, as a third modification, the information processing apparatus 10 is configured to include the operation of specifying the user's movement including the operation of changing the direction of the user's hand, thereby specifying the movement to output the character information. Is extended to the movement of the user. That is, in the present disclosure, an example in which the movement of the finger corresponding to the signal form of the detection signal from the sensor array 14 is specified and the character information corresponding to the movement of the specified finger is output has been described. Information indicating the hand direction is added to this signal form. By this, information can be further added to the character information corresponding to the movement of the finger, or different information can be replaced.

  Although the embodiments related to the disclosed technology have been described, the technical scope of the disclosed technology is not limited to the scope described in the above embodiments. Various changes or modifications can be added to the above-described embodiment without departing from the scope of the disclosed technology, and a form to which the modifications or improvements are added is also included in the technical scope of the disclosed technology. In addition, all documents, patent applications and technical standards described in this specification are as specific and individual as the individual documents, patent applications and technical standards are incorporated by reference. Incorporated herein by reference.

  Further disclose the following matters with respect to the present disclosure.

(Section 1)
A detection unit that detects a predetermined finger movement;
The plurality of movements of the finger detected by the detection unit are based on the correspondence relationship in which different information is made to correspond to the plurality of different movements of the predetermined finger and the movement of the finger detected by the detection unit. An output unit that outputs information corresponding to the movement of the finger detected by the detection unit if the movement is any one of the movements;
An information processing apparatus provided with

(Section 9)
On the computer
An information processing method including performing processing of an output unit of the information processing device described in item 1.

(Section 10)
An information processing program for causing a computer to function as an output unit of the information processing apparatus described in item 1.

(Section 11)
A detection unit that detects a change in the wrist;
An output unit that outputs information based on the correspondence relationship in which different information is associated with each detected change in the wrist;
An information processing apparatus provided with

(Section 12)
A detection unit that detects expansion and contraction of the wrist accompanying movement of the finger and outputs a detection signal;
A storage unit configured to pattern the detection signal and to store predetermined information corresponding to each pattern or a correspondence in which a command is associated;
An output unit that outputs the predetermined information or a command based on the detection signal and the correspondence relationship;
An information processing apparatus provided with

(Section 13)
Detecting the change in the wrist;
An output step of outputting information based on a correspondence relationship in which different information is made to correspond to each detected change in the wrist;
Information processing method including:

(Section 14)
Detecting the expansion and contraction of the wrist accompanying the movement of the finger and outputting a detection signal;
Storing the pattern of the detection signal and storing predetermined information corresponding to each pattern or a correspondence relationship in which a command is associated;
An output step of outputting the predetermined information or command based on the detection signal and the correspondence relationship;
Information processing method including:

(Section 15)
On the computer
An information processing method including performing processing of an output unit of the information processing apparatus described in item 11 or item 12.

(Section 16)
An information processing program for causing a computer to function as an output unit of the information processing apparatus described in item 11 or item 12.

DESCRIPTION OF SYMBOLS 10 information processing apparatus 10A clock 10B information processing apparatus 12 apparatus main body 12X computer 14 sensor array 14A pressure element 14B signal line 14C pressure detector 14D elongated support base 14E stretchable member 16 communication unit 18 display unit 121 input unit 122 signal processing unit 123 Determination unit 124 Learning unit 125 Identification unit 126 Template unit 127 Output unit 128 Display control unit

Claims (16)

A detection unit that detects a predetermined finger movement;
The plurality of movements of the finger detected by the detection unit are based on the correspondence relationship in which different information is made to correspond to the plurality of different movements of the predetermined finger and the movement of the finger detected by the detection unit. An output unit that outputs information corresponding to the movement of the finger detected by the detection unit if the movement is any one of the movements;
An information processing apparatus provided with The plurality of different movements of the predetermined finger are:
The information processing apparatus according to claim 1, wherein the predetermined finger movement is for each contacting node when the predetermined fingertip of the finger touches each of a plurality of different clauses of another finger. The plurality of different movements of the predetermined finger are:
The information processing apparatus according to claim 2, wherein the information processing apparatus includes the movement of the predetermined finger in which the predetermined fingertip of the finger touches each of a plurality of different clauses of another finger a plurality of times. The predetermined finger is a thumb,
The information processing apparatus according to claim 2 or 3, wherein the plurality of different segments of the other finger are a last segment, a middle segment, and a base segment of each of the index finger, the middle finger, the ring finger, and the little finger. The detection unit is
A flexible elongated support substrate attached to the forearm;
A plurality of pressure elements each for detecting pressure acting from a main muscle of a forearm working when bending a finger includes a pressure detector arranged along a surface on the forearm side of the elongated support base. The information processing apparatus according to any one of claims 4 to 10. The information processing apparatus according to claim 5, wherein the main muscle is at least one of a flexor carpal flexor, a flexor digitum flexor, a long palmar muscle, and a flexor carpal flexor. The different information is
The information processing apparatus according to any one of claims 1 to 6, including any one of a part of the Japanese syllabary, a number, and a part of a symbol. The information processing apparatus according to any one of claims 1 to 7, further comprising a display unit configured to display the information output from the output unit. On the computer
An information processing method including performing processing of an output unit of the information processing apparatus according to any one of claims 1 to 8.   An information processing program for causing a computer to function as an output unit of the information processing apparatus according to any one of claims 1 to 8. A detection unit that detects a change in the wrist;
An output unit that outputs information based on the correspondence relationship in which different information is associated with each detected change in the wrist;
An information processing apparatus provided with A detection unit that detects expansion and contraction of the wrist accompanying movement of the finger and outputs a detection signal;
A storage unit configured to pattern the detection signal and to store predetermined information corresponding to each pattern or a correspondence in which a command is associated;
An output unit that outputs the predetermined information or a command based on the detection signal and the correspondence relationship;
An information processing apparatus provided with Detecting the change in the wrist;
An output step of outputting information based on a correspondence relationship in which different information is made to correspond to each detected change in the wrist;
Information processing method including: Detecting the expansion and contraction of the wrist accompanying the movement of the finger and outputting a detection signal;
Storing the pattern of the detection signal and storing predetermined information corresponding to each pattern or a correspondence relationship in which a command is associated;
An output step of outputting the predetermined information or command based on the detection signal and the correspondence relationship;
Information processing method including: On the computer
An information processing method including performing processing of an output unit of the information processing apparatus according to claim 11 or 12.   An information processing program for causing a computer to function as an output unit of the information processing apparatus according to claim 11 or 12.