WO2022239357A1 - 指点字装置 - Google Patents
指点字装置 Download PDFInfo
- Publication number
- WO2022239357A1 WO2022239357A1 PCT/JP2022/006932 JP2022006932W WO2022239357A1 WO 2022239357 A1 WO2022239357 A1 WO 2022239357A1 JP 2022006932 W JP2022006932 W JP 2022006932W WO 2022239357 A1 WO2022239357 A1 WO 2022239357A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- finger
- unit
- information
- wearing
- output unit
- Prior art date
Links
- 230000033001 locomotion Effects 0.000 claims abstract description 77
- 238000001514 detection method Methods 0.000 claims abstract description 35
- 238000012545 processing Methods 0.000 claims abstract description 13
- 210000003811 finger Anatomy 0.000 claims description 285
- 210000003813 thumb Anatomy 0.000 claims description 30
- 230000001133 acceleration Effects 0.000 claims description 11
- 210000000707 wrist Anatomy 0.000 claims description 8
- 210000001142 back Anatomy 0.000 claims 1
- 230000003203 everyday effect Effects 0.000 abstract 1
- 230000006870 function Effects 0.000 description 60
- 230000005540 biological transmission Effects 0.000 description 27
- 238000004364 calculation method Methods 0.000 description 20
- 210000004247 hand Anatomy 0.000 description 13
- 230000001771 impaired effect Effects 0.000 description 13
- 230000000694 effects Effects 0.000 description 12
- 239000000463 material Substances 0.000 description 11
- 230000000844 anti-bacterial effect Effects 0.000 description 8
- 238000000034 method Methods 0.000 description 8
- 238000001035 drying Methods 0.000 description 7
- 241000894006 Bacteria Species 0.000 description 6
- 241000700605 Viruses Species 0.000 description 6
- 230000009471 action Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 239000000835 fiber Substances 0.000 description 4
- 230000007246 mechanism Effects 0.000 description 4
- 239000000126 substance Substances 0.000 description 4
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 4
- 238000006243 chemical reaction Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 239000011347 resin Substances 0.000 description 3
- 229920005989 resin Polymers 0.000 description 3
- 206010011878 Deafness Diseases 0.000 description 2
- 208000032041 Hearing impaired Diseases 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 238000012217 deletion Methods 0.000 description 2
- 230000037430 deletion Effects 0.000 description 2
- 238000002474 experimental method Methods 0.000 description 2
- 239000004744 fabric Substances 0.000 description 2
- 230000005057 finger movement Effects 0.000 description 2
- 210000004905 finger nail Anatomy 0.000 description 2
- 208000015181 infectious disease Diseases 0.000 description 2
- 230000002458 infectious effect Effects 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 239000002184 metal Substances 0.000 description 2
- 229910052751 metal Inorganic materials 0.000 description 2
- 229920000728 polyester Polymers 0.000 description 2
- 238000003825 pressing Methods 0.000 description 2
- 239000005871 repellent Substances 0.000 description 2
- 230000000638 stimulation Effects 0.000 description 2
- 238000005406 washing Methods 0.000 description 2
- LFQSCWFLJHTTHZ-UHFFFAOYSA-N Ethanol Chemical compound CCO LFQSCWFLJHTTHZ-UHFFFAOYSA-N 0.000 description 1
- HBBGRARXTFLTSG-UHFFFAOYSA-N Lithium ion Chemical compound [Li+] HBBGRARXTFLTSG-UHFFFAOYSA-N 0.000 description 1
- 240000007594 Oryza sativa Species 0.000 description 1
- 235000007164 Oryza sativa Nutrition 0.000 description 1
- GWEVSGVZZGPLCZ-UHFFFAOYSA-N Titan oxide Chemical compound O=[Ti]=O GWEVSGVZZGPLCZ-UHFFFAOYSA-N 0.000 description 1
- 238000010521 absorption reaction Methods 0.000 description 1
- 230000000840 anti-viral effect Effects 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 230000006735 deficit Effects 0.000 description 1
- 239000002781 deodorant agent Substances 0.000 description 1
- 238000009792 diffusion process Methods 0.000 description 1
- 239000013013 elastic material Substances 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 239000007788 liquid Substances 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 229910001416 lithium ion Inorganic materials 0.000 description 1
- 239000007769 metal material Substances 0.000 description 1
- 230000003183 myoelectrical effect Effects 0.000 description 1
- 239000002105 nanoparticle Substances 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000035515 penetration Effects 0.000 description 1
- 239000012466 permeate Substances 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 235000009566 rice Nutrition 0.000 description 1
- 238000010079 rubber tapping Methods 0.000 description 1
- 238000009958 sewing Methods 0.000 description 1
- 238000004659 sterilization and disinfection Methods 0.000 description 1
- OGIDPMRJRNCKJF-UHFFFAOYSA-N titanium oxide Inorganic materials [Ti]=O OGIDPMRJRNCKJF-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B21/00—Teaching, or communicating with, the blind, deaf or mute
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B21/00—Teaching, or communicating with, the blind, deaf or mute
- G09B21/001—Teaching or communicating with blind persons
- G09B21/003—Teaching or communicating with blind persons using tactile presentation of the information, e.g. Braille displays
- G09B21/004—Details of particular tactile cells, e.g. electro-mechanical or mechanical layout
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B21/00—Teaching, or communicating with, the blind, deaf or mute
- G09B21/02—Devices for Braille writing
Definitions
- the present invention relates to a finger braille device that is used by being worn on the fingers of the hand.
- finger braille A technique called finger braille is known as one of the means of communication for the visually impaired.
- finger braille for example, six fingers, which are the index, middle and ring fingers of both hands, are used as six points of braille, and the intention is conveyed to others by typing braille with the fingers.
- This finger Braille is basically a way for visually impaired people to receive information through an interpreter and communicate with the outside world.
- some electronic finger-mounted finger Braille devices have been proposed to reduce the burden on the interpreter or to receive and transmit information even when the interpreter is not present.
- Patent Document 1 discloses a finger Braille device that allows a user to easily perceive which finger is being stimulated by tactile stimulation elements attached to a plurality of fingers giving different tactile stimulation to each finger. Disclose. However, Patent Document 1 provides a tactile stimulus to a finger by rotating a weight with a driving motor, etc., and it is not possible to type finger Braille and convey the intention of the typed finger Braille to another person. In other words, in Patent Document 1, it is not possible to bidirectionally transmit finger braille between users. On the other hand, Patent Literature 2 discloses a finger braille device capable of bi-directionally transmitting finger braille between users.
- finger Braille devices are worn on the human hand, which is an important part of the body for human tactile functions.
- finger pads hereinafter referred to as finger pads
- palms are most important for tactile functions.
- the visually impaired it is necessary for the visually impaired to have the finger Braille device on when they want to.
- the tactile function of the finger pads is required at the same time. In that case, the visually impaired person has to remove the finger braille device once, which impairs the constant portability.
- Patent document 2 discloses a finger braille device that can release a finger pad, but this device has a button (piezoelectric sensor) as an input means protruding from the tip of the finger. Therefore, the button may become an obstacle when the tactile function of the finger pad is required, so the finger braille device also needs to be removed.
- a button piezoelectric sensor
- the finger braille device of the present invention includes an output unit for transmitting a signal corresponding to an action, a main unit for receiving the signal from the output unit and performing predetermined processing, and holding the output unit and the main unit, and and a fitting for attaching to the.
- the output unit in the present invention is provided on the finger of the hand by the attachment, and includes a motion detection section that detects motion of the finger.
- the main unit according to the present invention receives motion information corresponding to the motion of the finger detected by the motion detection unit, and identifies characters based on the received motion information.
- the main unit in the present invention preferably includes in advance related information for associating motion information with the identified character, and identifies the character by matching the motion information received from the output unit with the related information. do.
- the main unit in the present invention preferably identifies the function to be executed based on the operation information received from the output unit.
- the main body unit in the present invention is provided in advance with relevant information for associating operation information with the specified function, and by comparing the operation information received from the output unit with the relevant information, the function is detected. identify the
- the main unit in the finger braille device of the present invention preferably includes in advance related information for associating specified characters with motion information, and compares the motion information received from the output unit with the related information to determine the characters. Identify.
- the main unit in the finger braille device of the present invention preferably identifies the function to be executed based on the motion information received from the output unit.
- the main unit in the finger braille device of the present invention preferably includes in advance related information for associating the motion information with the specified function, and compares the motion information received from the output unit with the related information to determine the function. Identify.
- the finger braille device of the present invention preferably comprises three output units corresponding to the index finger, the middle finger and the ring finger, respectively, and the motion detectors of each of the three output units detect the back of each finger of the index finger, the middle finger and the ring finger. placed on the side of
- the preferred motion detection units are arranged between the first and second joints of the index finger, middle finger and ring finger.
- the finger Braille device of the present invention preferably comprises an output unit corresponding to the thumb, and the motion detection section of the output unit is arranged on the back side of the thumb.
- the motion detection unit is preferably arranged between the first joint and the second joint of the thumb.
- the main unit is preferably provided on the back of the hand by means of an attachment.
- a preferred mounting device comprises a first retainer, a second retainer and a band.
- the first holding part holds each of the three output units and is fitted to each of the index finger, middle finger and ring finger.
- the second holding part is connected to the first holding part, holds the main body unit, and is provided only on the back side of the hand.
- the band is connected to the second holding part and wound around a person's wrist.
- a preferred motion detection unit consists of a 3-axis acceleration sensor. Further, in the finger Braille device of the present invention, preferably the output unit and the main body unit are worn on the left hand and the right hand, respectively, by means of fittings.
- the output unit provided on the finger of the hand by the attachment includes the motion detection section that detects the motion of the finger. Since the motion detection unit can detect the braille motion of the finger even when worn on the back side of the finger, the pad of the finger, which is important for human tactile functions, can be opened without being covered by the element of the finger braille device.
- a finger Braille device is provided which minimizes the need to be removed and is excellent in always-carryability in daily life.
- FIG. 1 is a diagram showing a schematic configuration of a finger braille system according to a first embodiment of the present invention
- FIG. 2 is a diagram showing a schematic configuration of an input/output signal unit of the mounting-side device of FIG. 1
- FIG. 2 is a diagram showing a schematic configuration of a main unit of the mounting-side device of FIG. 1
- FIG. FIG. 2 is an example in which the wear-side device of FIG. 1 is worn on a hand, and is a view from the back side of the hand
- FIG. 2 is an example in which the wear-side device of FIG. 1 is worn on a hand, and is a view from the palm side
- FIG. 10 is a diagram showing a schematic configuration of a finger braille system according to a second embodiment of the present invention
- FIG. 10 is an example in which the wear-side device of FIG. 9 is worn on the hand, and is a view from the back side of the hand.
- FIG. 10 is an example in which the wear-side device of FIG. 9 is worn on a hand, and is a view from the palm side;
- FIG. 4 shows numeric keys and function keys assigned to the left and right hands; It is a table
- a finger Braille system 1 according to an embodiment of the present invention will be described below with reference to FIGS. 1 to 13 attached.
- a finger Braille system 1A according to the first embodiment and a finger Braille system 1B according to the second embodiment will be described below.
- a first embodiment capable of performing finger braille with three fingers on one hand
- a second embodiment capable of performing finger braille with four fingers on one hand
- the finger Braille system 1A includes a wearer device 3A worn by a visually impaired person to use the hand, and a non-worn device 5 that is not attached to the hand of the visually impaired person. .
- the wearing-side device 3A of the finger Braille system 1A is always portable so that the hearing-impaired person can reduce the frequency of taking it off in his/her daily life.
- This always-carrying property is realized by opening the finger pads of the hand on which the device 3A is worn without being covered by the device 3A.
- this constant portability is realized by allowing the palm of the user's hand, on which the device 3A is worn, to be left open without being covered by the device 3A.
- the mounting side device 3A will be described with reference to FIGS. 1, 2 and 3.
- FIG. The wearing side device 3A corresponds to the finger Braille device of the present invention, and the finger Braille device of the present invention is intended for the transmission function of the wearing side device 3A.
- the wearing-side device 3A has a function of receiving information and a function of transmitting information on the basis of the wearer. In the receiving function, the wearer receives information through the finger by vibrating the vibrating section 11 . In the receiving function, information on finger Braille is sent from the non-wearing device 5 to the wearing device 3A, and the vibrating section 11 vibrates based on this information.
- the transmission function transmits information as a signal that the motion detection unit 13 detects that the wearer moves his/her finger for finger Braille. Then, the transmission function sends information about finger braille from the wearing side device 3A to the non-wearing side device 5.
- the mounting-side device 3A includes three input/output units 10A, 10B, and 10C, a main unit 50 for transmitting and receiving signals with the input/output units 10A, 10B, and 10C, the input/output units 10A, Signal cables 30A, 30B, and 30C connecting each of 10B and 10C and the main unit 50 are provided.
- the wear-side device 3A is worn on both left and right hands, and the input/output units 10A, 10B, and 10C are attached to the index finger, middle finger, and ring finger of each hand.
- the wearing side device 3A can be attached to the wearer's hand, but does not interfere with the use of the finger pad. This is one of the requirements for constant portability.
- the input/output units 10A, 10B, and 10C may be collectively referred to as the input/output unit 10
- the signal cables 30A, 30B, and 30C may be collectively referred to as the signal cable 30.
- the input/output unit 10 (10A, 10B, 10C) includes, as shown in FIG. 2, a vibrating section 11 that implements a reception function and an operation detection section 13 that implements a transmission function.
- the input/output unit 10 receives an electric signal from the non-wearing device 5 and transmits it to the vibration unit 11, and receives the acceleration detected by the motion detection unit 13 and 5 is provided.
- the vibration unit 11, the motion detection unit 13, and the transmission/reception unit 15 are only the minimum components of each input/output unit 10, and the input/output unit 10 can include other components.
- hardware consisting of a circuit correction mechanism and the like for these minimum configurations to operate without malfunctioning
- illumination fixtures consisting of LEDs (Light Emitting Diodes) that blink when information is received and transmitted can be included.
- the receiving function of the vibrating section 11 provides electronic Braille information to the wearer as vibration.
- the vibrating section 11 is composed of a device that vibrates based on electronic information, such as an eccentric vibration motor or a piezoelectric actuator.
- the electronic Braille information is received by the vibrating section 11 from the main unit 50 via the transmitting/receiving section 15 .
- the vibrating units 11 are attached to each of the six fingers of the right hand and left hand, the index finger, the middle finger, and the ring finger. Vibration can be transmitted. Specifically, by combining the presence or absence of vibration for each of the six fingers, the wearer can receive 2 to the power of 6, that is, 64 types of finger braille information. These 64 types of finger Braille signals can be easily converted into multiple languages using a character-Braille conversion correspondence table uniquely defined in many countries around the world.
- the transmission function by the motion detection unit 13 is such that the wearer performs a motion intended as finger braille information with the fingertip, the motion detection unit 13 detects the motion as a three-dimensional waveform, and an electric signal corresponding to the detected three-dimensional waveform is generated. is transmitted to the main unit 50 via the signal cable 30 .
- the motion detector 13 is typically composed of a three-dimensional acceleration sensor. When the wearing-side device 3A is attached to both left and right hands of the wearer, the transmission function is executed for each of the six fingers.
- the motion detector 13 is one of the requirements for the wearing-side device 3A to be always portable.
- the main unit 50 is connected to the input/output unit 10 via the signal cable 30 as shown in FIG.
- the main unit 50 as shown in FIG. and a second transmission/reception unit 57 that performs transmission/reception.
- a calculation section 53 that performs calculations required for the reception function and the transmission function.
- command information is issued to the input/output unit 10 via the signal cable 30, or to the non-wearing device 5 via wireless communication 110, for example, Bluetooth (registered trademark). and a command unit 55 that issues command information.
- the main unit 50 includes a CPU (Central Processing Unit) that executes programs, It has a ROM (Read Only Memory) that stores programs and fixed information, and a RAM (Read Only Memory) as a work memory that develops programs and information for execution by the CPU. The same applies to the non-wearing side device 5 to be described later.
- a CPU Central Processing Unit
- ROM Read Only Memory
- RAM Read Only Memory
- first transmission/reception section 51, the calculation section 53, the command section 55, and the second transmission/reception section 57 are merely the minimum configurations in each main body unit 50, and the main body unit 50 can have other configurations.
- a power supply mechanism that supplies power to the main unit 50 and the input/output unit 10
- hardware consisting of a circuit correction mechanism for operating these minimum configurations without malfunctioning, and an LED that blinks when information is received and transmitted. and the like.
- This also applies to the non-wearing side device 5, which will be described later.
- the calculation unit 53 calculates and processes information regarding the transmission function as follows.
- the calculation unit 53 processes the three-dimensional waveform information transmitted from the motion detection unit 13 of the input/output unit 10, thereby converting the three-dimensional waveform information into corresponding electronic character information related to finger Braille.
- the converted character information is transferred to the non-wearing device 5 via the second transmission/reception unit 57 and displayed as characters on the non-wearing device 5 . Since the wearing-side device 3A is attached to both the left and right hands, six types of three-dimensional waveform information corresponding to the six fingers are transmitted to the calculation unit 53, and the calculation unit 53 receives the six types of three-dimensional waveform information. 64 types of character information are generated by arithmetically processing the dimensional waveform information. A specific example of braille operation by the main unit 50 will be described in the second embodiment.
- FIGS. 4 and 5 the mounting-side device 3A includes a mounting tool 20 for mounting the input/output unit 10, the signal cable 30 and the main unit 50 on the human hand.
- the input/output unit 10 , the signal cable 30 and the main unit 50 are held by the wearing tool 20 and attached to a person's hand by the wearing tool 20 .
- the wearing tool 20 covering the human hand is shown in gray, but this is for clarifying the distinction from the human hand. does not represent The same applies to FIGS. 10 and 11 of the second embodiment.
- the wearing tool 20 is open on the side ahead of the first joints of the three fingers to be worn, and is open on the palm side.
- the configuration of the mounting tool 20 is one of the requirements for the mounting side device 3A to always be portable, as will be described later in detail.
- the mounting tool 20 holds the input/output unit 10, a first holding portion 21 attached to the finger F, a main body unit 50, a second holding portion 23 corresponding to the back of the hand B, and a second holding portion. 23 and a band 25 wound around the wrist R.
- first holding portion 21 includes first holding portions 21A, 21B, and 21C corresponding to index finger FA, middle finger FB, and ring finger FC, respectively.
- the first holding portions 21A, 21B, and 21C each have a tubular or sheath-like structure so as to be fitted around the index finger FA, middle finger FB, and ring finger FC.
- the first holding portions 21A, 21B, and 21C cover the first joint J1 to the second joint J2 of the index finger FA, middle finger FB, and ring finger FC on the back side of the hand B. .
- the first holding portions 21A, 21B, and 21C straddle the first joint J1 and the second joint J2 of the index finger FA, middle finger FB, and ring finger FC, respectively, as shown in FIG. It covers the range up to the third joint J3. Therefore, even when the wearing tool 20 is worn, the tip sides of the first joints J1 of the index finger FA, the middle finger FB, and the ring finger FC are not covered with the first holding portions 21A, 21B, and 21C. be released.
- the finger pads FP1, FP2, and FP3 at the tips of the respective first joints J1 are open.
- the first holding portions 21A, 21B, 21C are provided with pockets 22A, 22B, 22C on the fingernail FN side, respectively, as shown in FIGS. 4 and 6(a), (b).
- Input/output units 10A, 10B and 10C are accommodated in respective pockets 22A, 22B and 22C.
- the pockets 22A, 22B, and 22C have a two-layer structure consisting of an inner layer 22 in and an outer layer 22 out on the finger nail FN side, that is, on the finger back side. be.
- This two-layer structure pocket also applies to the second holding portion 23 described below.
- the pocket as a means for housing and holding the input/output units 10A, 10B, and 10C is merely an example. Other means such as pasting can be employed.
- the input/output units 10A, 10B, and 10C are preferably provided between the first joint J1 and the second joint J2.
- the second holding portion 23 is provided on the back side B of the human hand and holds the main unit 50.
- the second holding portion 23 includes a holding portion 23A that holds the main body unit 50, a first connection portion 23B that connects the holding portion 23A and the first holding portions 21A, 21B, and 21C, and a holding portion 23B. a second connection portion 23C that connects the portion 23A and the band 25;
- the second holding part 23 is provided on the side of the back of the hand B by being supported by the first holding parts 21A, 21B, 21C and the band 25, and is itself fixed to the back of the hand B. Instead, the palm P is open as shown in FIG.
- the holding portion 23A faces the inner layer 23 in provided on the back side B of the hand when the second holding portion 23 is worn on the hand. and an outer layer 23 out .
- a space between the inner layer 23 in and the outer layer 23 out constitutes a pocket 23D that accommodates the main unit 50 .
- the body unit 50 can be fixed to one or both of the inner layer 23 in and the outer layer 23 out with hook-and-loop fasteners, for example, in order to restrict the movement of the body unit 50 inside the pocket 23D.
- the inner layer 23 in and the outer layer 23 out can be sewn together to seal the inside thereof.
- the first connecting part 23B covers the back side of the hand B while connecting the holding part 23A and the first holding parts 21A, 21B, 21C.
- the first connecting portion 23B covers the index finger FA, the middle finger FB and the ring finger FC on the palm P side.
- the band 25 is wrapped around the person's wrist R to fix the wearing device 20 to the person's hand.
- the band 25 is a strip-shaped member, and as shown in FIG. 5, both ends 25A and 25B are provided with, for example, hook-and-loop fasteners, and the one end 25A and the other end 25B are joined together. , is fixed to the wrist R of the person.
- FIGS. 4 and 5 [Relationship between mounting state of mounting tool 20 and human hand: FIGS. 4 and 5]
- the wearing tool 20 is worn on a human hand, and as shown in FIG.
- the FP3 is opened without being covered with the wearing tool 20.
- ⁇ Also as shown in FIG. 5, the palm P is not covered with the wearing tool 20 and is open.
- the wearing device 20 is made of a material such as a highly elastic chemical fiber in order to reduce the burden on the hand of the person wearing the wearing device 20. .
- this material has quick-drying properties.
- This quick-drying property includes, for example, antibacterial polyester, which is both rapid in water penetration, diffusion and drying.
- the quick-drying property in the present invention is not limited to this form, and can be shaded by materials that are difficult for water to permeate, such as metal materials and plastic materials.
- Non-wearing side device 5 FIG. 8
- the non-wearing device 5 includes a transmitting/receiving unit 61 for transmitting/receiving information to/from the main body unit 50 of the mounting device 3A, an input unit 63 for inputting finger Braille information to the mounting device 3A, and a finger point receiving from the mounting device 3A.
- a display unit 65 displays character information and finger braille information input from the input unit 63 .
- the non-wearing device 5 also includes a control section 67 that controls operations of the transmission/reception section 61 , the input section 63 and the display section 65 .
- the input unit 63 corresponds to input keys
- the display unit 65 corresponds to an LCD (Liquid Crystal Display).
- the wearing side device 3A worn on the human hand has the following effects.
- the wearing-side device 3A has three finger pads FP1, FP2, FP3 and the palm P open.
- the wearing device 3A is always portable.
- the tactile functions of finger pads and palms are very important for hearing-impaired people so that they can spend their daily lives in the same way as healthy people.
- the finger pad up to the first joint has the most important tactile function, and if the skin of this part is open even in the state where the wearing-side device 3A is worn, the tactile function will be hindered. no.
- the finger pads FP1, FP2, FP3 and the palm P may be collectively referred to as finger pads and the like hereinafter.
- the effects of not covering the finger pads and the like with the wearing tool 20 are effective against infectious viruses and bacteria. That is, it is possible to selectively clean or disinfect the finger pad or the like while wearing the wearing device 3A.
- Deaf and deaf people, like healthy people need frequent washing or disinfection of their hands to protect themselves from viruses and bacteria, as well as to avoid transmitting viruses and bacteria to others during public activities.
- the wearing-side device 3A is made of a quick-drying material, even if the material forming the wearing tool 20 becomes moist due to washing or the like, it will dry quickly. In this way, the growth of infectious viruses and bacteria can be suppressed.
- the wearing-side device 3A adopts a triaxial acceleration sensor as an example of the motion detection unit 13, and in a state in which the three finger pads FP1, FP2, and FP3 are opened, the braille of the index finger FA, the middle finger FB, and the ring finger FC is displayed. Motion can be detected.
- the piezoelectric sensor disclosed in Patent Document 2 it is necessary to provide the piezoelectric sensor on the side of the finger pad in order to detect braille movement. Therefore, when the piezoelectric sensor is used, the finger pad cannot be released, which limits the tactile function.
- the input/output unit 10 incorporates an LED light that lights up when receiving or transmitting information, and the main unit 50 is provided with an LED light linked to the remaining amount of power.
- Bluetooth registered trademark
- Original software was designed, installed as application software in the non-wearing device 5, and a lithium-ion battery capable of 24-hour operation was used.
- the input/output unit 10 and the main unit 50 are each configured with a resin housing made by a 3D printer, and together with an electric cable connecting them, have a waterproof structure. It should be noted that the structure is such that only the electrodes of two poles are open to the main unit 50 side, and the circuit is such that power can be supplied from an external power source.
- the harness 20 is made by sewing an antibacterial polyester fabric that is rich in stretchability, water absorption and quick drying properties.
- a plurality of character information and input work information by physical motion mainly with fingertips are defined as sign language, and input work is simplified through learning by the wearer of the wearing side device 3A.
- frequently used character information such as "yes”, “no”, “thank you”, “hello”, etc., "delete one character”, “confirm input text by finger braille output”, “sentence confirmation”
- Three-dimensional waveforms corresponding to frequently used input work information such as "transmission of information” were defined as sign language, and the wearer repeatedly learned and memorized them.
- the reading accuracy is enhanced by the machine learning function.
- the wearer was operated to output text information through these sign language actions. As a result, it was found that the workability of the wearer was shortened from several seconds to about one minute per operation, and the finger Braille system 1A could be handled with practicality for daily use by the visually impaired.
- FIGS. 9 to 11 a finger Braille system 1B according to a second embodiment will be described with reference to FIGS. 9 to 11.
- FIG. The finger Braille system 1A is based on the premise that the three fingers of one hand, namely the index finger, the middle finger and the ring finger, are used, but the finger Braille system 1B uses four fingers, which are the above three fingers plus the thumb. is assumed. In other words, the finger Braille system 1B adds a thumb to the operation of the smartphone, for example, and gives the operation of the thumb a function as a function key. Note that the finger braille system 1B includes common parts with the finger braille system 1A.
- the same components as those of the finger braille system 1A are denoted by the same reference numerals as those of the finger braille system 1A, and the finger braille system 1B will be described focusing on the differences from the finger braille system 1A.
- the finger Braille system 1B includes a wearer device 3B worn by the visually impaired person to wear on the hand and a non-worn device 5 that is not attached to the hand of the visually impaired person. .
- the finger braille system 1B is always portable like the finger braille system 1A.
- the wearing-side device 3B of the finger Braille system 1B includes an input-output unit 10D in addition to the input-output units 10A, 10B, and 10C of the wearing-side device 3A.
- the wearing-side device 3B like the wearing-side device 3A, has a function of receiving information and a function of transmitting information based on the wearer.
- the mounting device 3B includes four input/output units 10A, 10B, 10C, and 10D, a main unit 50 for transmitting and receiving signals to and from the input/output units 10A, 10B, 10C, and 10D, and an input device.
- Signal cables 30A, 30B, 30C, and 30D connecting the main unit 50 and the output units 10A, 10B, 10C, and 10D are provided.
- the wear-side device 3B is worn on both left and right hands, and the input/output units 10A, 10B, 10C, and 10D are attached to the index finger, middle finger, ring finger, and thumb of each hand, for example.
- the wearing-side device 3B although it can be attached to the hand of the wearer, the pad of each finger is open and does not hinder the use of the pad.
- the input/output unit 10 (10A, 10B, 10C, 10D) of the mounting-side device 3B has a vibrating section 11, a motion detecting section 13, and a transmitting/receiving section in the same manner as the input/output unit 10 of the first embodiment. 15.
- the functions and configurations of the vibration unit 11, the motion detection unit 13, and the transmission/reception unit 15 are also the same as those of the first embodiment described above.
- the wearing-side device 3B targets four fingers of one hand.
- the vibrating units 11 are attached to each of the eight fingers of the right hand and left hand, each of the thumb, index finger, middle finger, and ring finger. Vibration can be transmitted to fingers. Specifically, combining presence/absence of vibration for each of the eight fingers enables expression of 2 to the eighth power, that is, 256 combinations. In addition to character information, various command keys used for input/output of digital terminals and input of combinations thereof can be assigned.
- the main unit 50 is connected to the input/output units 10 (10A to 10D) via signal cables 30 (30A to 30D) to transmit information to the input/output units 10 and to the input/output units.
- the main body unit 50 includes the first transmission/reception section 51, the calculation section 53, the command section 55, and the second transmission/reception section 57, as described above with reference to FIG.
- 256 types of three-dimensional waveform information corresponding to eight fingers are transmitted to the calculation unit 53, and the calculation unit 53 receives the 3-dimensional waveform information of the 256 types.
- character and command information is generated by combining 256 types of waveform information.
- This three-dimensional information is based on the motion of each finger detected by the motion detection unit 13 of the input/output unit 10 provided for each finger, for example, a motion simulating a key press. sent to Actions that simulate pressing a key are hereinafter abbreviated as touch actions.
- a specific example of braille processing by the computing unit 53 will be described later.
- the mounting device 3B includes an input/output unit 10 and a mounting device 20.
- the input/output unit 10, the signal cable 30, and the main unit 50 are held by the mounting device 20 and connected to each other by the mounting device 20. worn on the human hand.
- first holding portion 21 corresponds to thumb FD in addition to first holding portions 21A, 21B, and 21C corresponding to index finger FA, middle finger FB, and ring finger FC, respectively.
- a first holding portion 21D is provided.
- the first holding portions 21A, 21B, 21C, and 21D have a ring shape that covers the vicinity of the first joint J1 of the thumb FD. Therefore, even when the wearing tool 20 is worn, the finger pads FP1 to FP4 of the index finger FA, the middle finger FB, the ring finger FC and the thumb FD at the tip of the first joint J1 are released.
- the ring-shaped first holding parts 21A to 21D of the wearing device 3B do not have the pocket 22D provided in the wearing device 3A, and the input/output units 10A to 10D are fixed on the back B side of the hand.
- the second holding portion 23 provided on the back side of the human hand B includes a holding portion 23A, a first connecting portion 23B and a second connecting portion 23C. are the same as in the first embodiment. however, also, the band 25 is wound around the wrist R of the person, and both ends 25A and 25B are joined, as in the first embodiment.
- Non-wearing side device 5 As for the non-wearing side device 5, a computer device such as a smartphone or a tablet is applied as in the first embodiment, and as shown in FIG. And prepare.
- the non-wearing device 5 also includes a control section 67 that controls operations of the transmission/reception section 61 , the input section 63 and the display section 65 .
- the input/output units 10A, 10B, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, 10C, and 10B are provided for index finger LA, middle finger LB, ring finger LC, thumb LD, index finger RA, middle finger RB, ring finger RC, and thumb RD. 10D is provided.
- Each of the input/output units 10 (10A, 10B, 10C, 10D) is provided with a motion detection unit 13, and when a touch motion of each finger is detected by the motion detection unit 13, information corresponding to the touch motion is detected. is transmitted to the main unit 50 via the transmitting/receiving section 15 .
- the information corresponding to the touch operation includes information on numeric keys and function keys assigned to each finger.
- the numeric key 1 is included as information corresponding to the touch operation of the index finger LA
- the function key R is included as information corresponding to the touch operation of the thumb RD.
- the calculation unit 53 of the main unit 50 receives information (operation information) corresponding to the touch operation via the first transmission/reception unit 51 .
- the calculation unit 53 performs character identification and other processing in the finger Braille system 1B based on the received motion information.
- the arithmetic unit 53 can identify numeric keys and function keys, and in addition, information that associates the identified numeric keys and function keys with characters (hiragana) and functions to be executed. (related information).
- An example of related information is shown in FIG. An example of processing in the calculation unit 53 will be described with reference to FIG. 13 .
- the related information, as shown in FIG. 13, includes English alphabets, numbers, etc., but other related information may include, for example, Japanese hiragana and other languages.
- the calculation unit 53 identifies "B" of the English alphabet by collating it with related information.
- the computing unit 53 compares them with related information, Identify the "W" of the English alphabet.
- the operation unit 53 is set to a mode corresponding to English alphabets.
- the specified character information is transmitted to the non-wearing device 5 via the second transmission/reception unit 57 and displayed on the display unit 65 thereof.
- calculation unit 53 receives the numeric key 1 (index finger LA) as the operation information, it identifies the number "1" by matching it with related information. Similarly, upon receiving numeric key 2 (middle finger LB) and numeric key 4 (index finger RA) as motion information, calculation unit 53 identifies the number "9" by matching it with related information. When processing numerals, the operation unit 53 is set to a mode corresponding to English alphabets.
- operation unit 53 Upon receiving function key L (thumb LD) as operation information, operation unit 53 identifies enter (En.) by collating it with related information. Specifying this enter is synonymous with pressing the Enter key of a personal computer. Another example relates to Cursor Keys, and when the operation section 53 receives the L key (thumb LD) and numeric key 1 as operation information, it specifies that the upward cursor is pressed. The calculation unit 53 can also identify leftward, downward, and rightward cursors.
- operation unit 53 identifies and executes the end of the program (P end). Further, upon receiving function key L (thumb LD) and numeric keys 1 and 2, operation unit 53 identifies and executes deletion of the phrase that has been input so far. Furthermore, upon receiving function key L (thumb LD) and numerical keys 1, 2, and 3, operation unit 53 specifies and executes deletion of all documents that have been input so far. Further, upon receiving function key R (thumb RD) and numeric keys 1, 2, and 3, operation unit 53 specifies and executes reading out of all the documents that have been input so far.
- the finger braille system 1B has the following effects in addition to the same effects as the finger braille system 1A.
- the finger braille system 1B is based on the premise that four fingers are used on each hand to add the thumb, so in addition to being able to efficiently operate the smartphone, it is possible to realize functional processing other than characters. become.
- the first holding portions 21A to 21D of the finger braille system 1B are ring-shaped. Therefore, even if the wearer's fingers vary considerably in thickness and length, if the first holding portions 21A to 21D are made of an elastic material, the load on the wearer can be reduced and the first holding portions 21A to 21D can be held.
- the holders 21A to 21D can be easily attached. Also, the manufacturing cost can be minimized.
- the above finger braille system 1 has been explained on the premise that it is used in a Japanese environment. Visually-impaired people can use this device easily by learning how to input Braille with fingers. In addition, when a visually impaired person has an impairment in any of the index finger, the middle finger, and the ring finger, the input/output unit can be transferred to another finger, or the vibration position can be shifted in the longitudinal direction of the finger.
- the wearing-side devices 3A and 3B can transmit character information in sign language in addition to braille information by using the motion detection unit 13 consisting of a triaxial acceleration sensor. That is, a secondary feature of the triaxial acceleration sensor is that it can read a three-dimensional waveform, and this conversion mechanism can also be applied to character conversion of sign language information. For example, it is possible to input/output and erase characters with simpler sign language or actions similar to sign language than input as finger braille, such as converting "yes" and "no" into characters and erasing finger braille for typos. become. In recent years, the ability to read 3D waveforms has dramatically improved through techniques such as machine learning.
- the devices 3A and 3B can be used as devices for inputting both sign language and finger braille information and for outputting character information in response to the input from the wearer's point of view.
- this technology it is possible to use it in a wider range of environments by recognizing waveforms in three-dimensional space without tapping the fixed surface instead of using the dotted waveform on the fixed surface for the transmission of finger Braille information.
- a series of these programs can be installed and used on smartphones and personal computers as application software.
- a three-axis acceleration sensor is used as the motion detection unit 13, but this is merely an example of motion detection means, and the present invention is applicable to other sensors capable of detecting finger motions, such as optical sensors and strain sensors. , a myoelectric potential sensor, or the like can be used. These sensors can detect finger movements without applying an external force other than the finger movements.
- a metal ring that does not get wet with liquids such as water and alcohol, or a water-repellent resin can be used as the first holding portion 21 of the mounting side devices 3A and 3B. Even when a metal ring or a water-repellent resin ring is used as the first holding portion 21, the method of fixing the input/output unit 10 basically conforms to the method illustrated in FIG. Moreover, it is also possible to employ a three-dimensional modeling method for manufacturing the mounting tool 20 .
- the quick-drying fabric is effective in suppressing the generation of viruses and bacteria, but it is more active to wear it by using a material with a surface that exhibits antibacterial and antiviral effects. You can take measures to protect yourself from the harm of viruses and bacteria and prevent them from being transmitted.
- the material for attachment can be selected from chemical fibers shown in the list of antibacterial, deodorant, and antibacterial chemical fibers published on the website of the Japan Chemical Fibers Association.
- a solution having antibacterial and antibacterial effects such as a titanium oxide nanoparticle solution, is applied to cover the wearing material with an antibacterial film.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Business, Economics & Management (AREA)
- Educational Technology (AREA)
- Educational Administration (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
一方で、視聴覚障碍者にとって、自身が望むときに指点字装置が装着されていることが必要である。ところが、指点字装置を介して他人に意思を伝えたいときに同時に指腹による触覚機能が必要なことがある。そうなると、視聴覚障碍者は、指点字装置を一旦は取り外さなければならず、常時携行性を損なう。特許文献2には指腹を解放できる指点字装置が開示されているが、この装置は入力手段としてのボタン(圧電センサ)が指の先端から突出している。したがって、指腹による触覚機能が必要なときにこのボタンが障害となるおそれがあるので、この指点字装置についても取り外しが必要になる。
本発明における出力ユニットは、装着具により手の指に設けられるとともに、指の動作を検知する動作検知部を備える。
本発明における本体ユニットは、動作検知部で検知される指の前記動作に対応する動作情報を受信するとともに、受信した前記動作情報に基づいて文字を特定する。
本発明における本体ユニットは、好ましくは、出力ユニットから受信する動作情報に基づいて実行すべき機能を特定する。
本発明における本体ユニットは、好ましくは、動作情報と特定される前記機能とが関連付けられる関連情報を予め備え、前記出力ユニットから受信する前記動作情報と前記関連情報とを照合することにより、前記機能を特定する、
本発明の指点字装置における本体ユニットは、好ましくは、出力ユニットから受信する動作情報に基づいて実行すべき機能を特定する。
本発明の指点字装置における本体ユニットは、好ましくは、動作情報と特定される機能とが関連付けられる関連情報を予め備え、出力ユニットから受信する動作情報と関連情報とを照合することにより、機能を特定する。
本発明の指点字装置において、好ましくは、動作検知部が、親指の第1関節と第2関節の間に配置される。
本発明の指点字装置において、好ましくは、本体ユニットが、装着具により手の甲に設けられる。
第1保持部は、3つの出力ユニットのそれぞれを保持するとともに、人差し指、中指および薬指のそれぞれに嵌められる。
第2保持部は、第1保持部と連なり、本体ユニットを保持するとともに、手の甲の側にだけ対応して設けられる。
バンドは、第2保持部と連なり、人の手首に巻き回される。
親指に対応する出力ユニットを備える場合には、第1保持部は、対応する出力ユニットを保持するとともに、親指に嵌められる。
また、本発明の指点字装置において、好ましくは、出力ユニットおよび本体ユニットは、装着具により左手および右手のそれぞれに装着される。
指点字システム1Aは、図1に示すように、視聴覚障碍者が手に装着して使用する装着側装置3Aと、視聴覚障碍者の手への装着に関わらない非装着側装置5と、を備える。指点字システム1Aの装着側装置3Aは、視聴覚障碍者が日常生活において取り外す頻度を少なくできる常時携行性を備える。この常時携行性は、装着側装置3Aを装着した手の指腹が装着側装置3Aで覆われることなく開放させることにより実現される。さらにこの常時携行性は、装着側装置3Aを装着した手のひらが装着側装置3Aで覆われることなく開放されることにより実現される。
装着側装置3Aについて、図1、図2および図3を参照して説明する。なお、装着側装置3Aが本発明の指点字装置に対応するとともに、本発明の指点字装置は装着側装置3Aの発信機能を対象としている。
[装着側装置3Aの機能]
装着側装置3Aは、装着される者を基準にして、情報の受信機能と発信機能を備える。
受信機能は、振動部11が振動することで装着者が指を介して情報を受信する。そして、受信機能においては、非装着側装置5から装着側装置3Aへ指点字に関する情報が送られ、この情報に基づいて振動部11が振動する。また、発信機能は、装着者が指点字のために指を動かすことを動作検知部13が検知した信号として情報を発信する。そして、発信機能は、装着側装置3Aから非装着側装置5に向けて指点字に関する情報が送られる。
装着側装置3Aは、図1に示すように、三つの入出力ユニット10A,10B,10Cと、入出力ユニット10A,10B,10Cとの信号の送受信を行う本体ユニット50と、入出力ユニット10A,10B,10Cのそれぞれと本体ユニット50とを接続する信号ケーブル30A,30B,30Cと、を備える。装着側装置3Aは、左右の両手に装着され、それぞれの手において、入出力ユニット10A,10B,10Cは、それぞれ人差し指、中指、薬指に取り付けられる。
入出力ユニット10(10A,10B,10C)は、図2に示すように、受信機能を実現する振動部11と、発信機能を実現する動作検知部13と、を備える。また、入出力ユニット10は、非装着側装置5からの電気信号を受信し、かつ振動部11に向けて送信するとともに、動作検知部13で検出された加速度を受信し、かつ非装着側装置5に向けて送信する送受信部15を備える。
なお、振動部11、動作検知部13および送受信部15は、それぞれの入出力ユニット10における最小限の構成にすぎず、入出力ユニット10は他の構成要素を備えることができる。例えば、これら最小限の構成が誤動作することなく動作するための回路補正機構等からなるハードウェア、情報の受発信時に点滅するLED(Light Emitting Diode)などからなる照明具を伴うことができる。
振動部11による受信機能は、電子的な点字情報を、装着者に対して振動として提供する。振動部11は、例えば偏芯振動モータ、圧電アクチュエータなどの電子的な情報に基づいて振動する機器から構成される。電子的な点字情報は、本体ユニット50から送受信部15を介して振動部11が受信する。
動作検知部13による送信機能は、装着者が指点字情報として意図する動作を指先で行い、その動作を動作検知部13が3次元波形として検知し、検知された3次元波形に対応する電気信号が信号ケーブル30を介して本体ユニット50に送信される。動作検知部13は、典型的には3次元加速度センサから構成される。装着側装置3Aが装着者の左右の両手に付けられると、6本の指のそれぞれについて送信機能が実行される。動作検知部13は、装着側装置3Aが常時携行性を有するための要件の一つである。
本体ユニット50は、図1に示すように、信号ケーブル30を介して入出力ユニット10に接続され、入出力ユニット10への情報の送信および入出力ユニット10からの情報の受信を担う。本体ユニット50は、この機能を実現するために、図3に示すように、装着側装置3Aの入出力ユニット10との情報送受信を担う第1送受信部51と、非装着側装置5との情報送受信を担う第2送受信部57と、を備える。また、第1送受信部51と第2送受信部57の間には、受信機能および送信機能に必要な演算を実行する演算部53を備える。また、演算部53による演算結果に基づいて、信号ケーブル30を介して入出力ユニット10に指令情報を発するか、または、無線通信110、例えばBluetooth(登録商標)を介して非装着側装置5に指令情報を発する指令部55と、を備える。
本体ユニット50は、プログラムを実行するCPU(Central Processing Unit)と、
プログラムや固定情報を格納するROM(Read Only Memory)と、CPUによる実行のためにプログラムや情報を展開するワークメモリとしてのRAM(Read Only Memory)と、を備えている。後述する非装着側装置5も同様である。
演算部53は、入出力ユニット10の動作検知部13から送信される3次元波形情報を処理することで、3次元波形情報をそれに対応する指点字に関する電子的な文字情報に変換する。変換された文字情報は、第2送受信部57を介して非装着側装置5に転送され、非装着側装置5に文字として表示される。
装着側装置3Aは、左右の両手に付けられるので、演算部53に送信されるのは、6本の指に対応する6種類の3次元波形情報であり、演算部53はこの6種類の3次元波形情報を演算処理することで、64種類の文字情報が生成される。
本体ユニット50による点字操作の具体例は、第2実施形態において説明する。
次に、図4および図5を参照して、装着側装置3Aを手に装着する例を説明する。
装着側装置3Aは、図4および図5に示すように、入出力ユニット10、信号ケーブル30および本体ユニット50を人の手に装着するための装着具20を備える。入出力ユニット10、信号ケーブル30および本体ユニット50は、装着具20に保持されながら装着具20により人の手に装着される。なお、図4および図5において、人の手を覆っている装着具20を灰色で示しているが、これは人の手との区別を明らかにするためのものであり、装着具20の色彩を表現しているものではない。第2実施形態の図10および図11も同様である。
第1保持部21は、図4および図5に示すように、人差し指FA、中指FBおよび薬指FCのそれぞれに対応する第1保持部21A,21B,21Cを備える。第1保持部21A,21B,21Cは、それぞれが人差し指FA、中指FBおよび薬指FCの周囲に嵌められるように筒状または鞘状の構造を有している。
次に、第2保持部23は、図4および図5に示されるように、人の手の甲Bの側に設けられ、本体ユニット50を保持する。
第2保持部23は、図4に示すように、本体ユニット50を保持する保持部23Aと、保持部23Aと第1保持部21A,21B,21Cとを接続する第1接続部23Bと、保持部23Aとバンド25とを接続する第2接続部23Cと、を備える。第2保持部23は、図4に示すように、第1保持部21A,21B,21Cとバンド25に支持されることで手の甲Bの側に設けられるが、それ自体は手の甲Bに固定されるものではなく、手のひらPは図5に示すように開放されている。
次に、バンド25は、図4および図5に示すように、人の手首Rに巻き回されことで、装着具20を人の手に固定する。バンド25は、帯状の部材であり、図5に示すように、その両方の端部25A,25Bに例えば面ファスナが設けられ、一方の端部25Aと他方の端部25Bが接合されることで、人の手首Rに固定される。
装着具20は人の手に装着されるが、図5に示されるように、人差し指FA、中指FBおよび薬指FCの第1関節J1より先端の側、とりわけこの3本の指腹FP1,FP2,FP3は装着具20で覆われておらずに開放される。また、図5に示されるように、手のひらPは装着具20で覆われておらずに開放される。
装着具20を構成する素材は任意であるが、装着具20を装着した人の手の動作の負担を小さくするために、伸縮性に優れた化学繊維などからなる素材で構成されることが好ましい。特に、この素材は速乾性を有することが好ましい。この速乾性は、水の浸透、拡散および乾燥がともに迅速な、例えば抗菌性のポリエステルを挙げることができる。ただし、本発明における速乾性はこの形態に限らず、水が浸透しにくい素材、例えば金属材料、プラスチック材料が陰られる。
次に、非装着側装置5について図8を参照して説明する。非装着側装置5はコンピュータ装置、より具体的にはスマートフォン、タブレット端末などが適用される。
非装着側装置5は装着側装置3Aの本体ユニット50との情報送受信を担う送受信部61と、装着側装置3Aへの指点字情報を入力する入力部63と、装着側装置3Aから受信する指点字情報および入力部63から入力される指点字情報を表示部65と、を備える。また、非装着側装置5は、送受信部61、入力部63および表示部65の動作を制御する制御部67を備える。
スマートフォンに適用される場合、入力部63は入力キーが対応し、表示部65はLCD(Liquid Crystal Display)が対応する。
指点字システム1Aにおいて、人の手に装着される装着側装置3Aは、以下の効果を奏する。
装着側装置3Aは、3本の指腹FP1,FP2,FP3および手のひらPは開放される。これにより、装着側装置3Aは常時携行性を有する。つまり、視聴覚障碍者にとって、健常者と同様の日常生活を過ごすために、指腹および手のひらの触覚機能は大変重要である。特に、第1関節までの指腹は最も重要な触覚機能を有しており、装着側装置3Aを装着した状態であってもこの部分は肌が開放されていれば、触覚機能が妨げられることはない。なお、指腹FP1,FP2,FP3および手のひらPを、以下では指腹等と総称することがある。
装着側装置3Aは、動作検知部13に一例として3軸加速度センサを採用することによって、3本の指腹FP1,FP2,FP3を開放させた状態において、人差し指FA、中指FBおよび薬指FCの点字動作を検出できる。例えば、特許文献2に開示される圧電センサを用いると、点字動作を検出するためには指腹の側に圧電センサを設ける必要がある。したがって、圧電センサを用いると指腹を開放させることができないため、触覚機能に制約を与えてしまう。
なお、入出力ユニット10の振動部11には偏芯振動モータを、動作検知部13として3次元波形の読み込みができる3次元加速度センサを用いた。なお、情報の受発信時に点灯するLEDライトを入出力ユニット10に組み込み、本体ユニット50には電源の残量と連動するLEDライトを設けた。本体ユニット50と非装着側装置5の連動にはBluetooth(登録商標)を無線媒体として用いた。
独自のソフトウェアを設計し、非装着側装置5にアプリケーションソフトウェアとしてインストールし、24時間駆動が可能なリチウムイオンバッテリを用いた。さらに入出力ユニット10と本体ユニット50はそれぞれ3Dプリンタによる樹脂製の筐体で構成し、これらを接続する電気ケーブルと併せて防水構造とした。なお、本体ユニット50側に2極の電極のみが開放する構造として外部電源からの電力供給が可能となる回路とした。併せて装着具20は伸縮性、吸水性および速乾性に富む抗菌性のポリエステル生地を縫製して作成した。
具体的には「はい」、「いいえ」、「ありがとうございます」、「こんにちは」等、頻繁に使う文字情報と、「一文字消去」、「入力文章の指点字出力による確認」、「文章確定と情報の発信」等の頻繁に用いる入力作業情報に対応する3次元波形を手話として定義し、装着者に繰り返し学習を受けてもらった上で記憶した。同時に装着側装置3Aの側では機械学習機能で読み取り精度を高めた。
十分に実用可能レベルまで装着者の理解と装置の機能を高めた上で、装着者にこれらの手話動作を通して文字情報の出力操作を行った。その結果、装着者の作業性は一動作当り数秒から1分程度短縮され、指点字システム1Aは視聴覚障碍者の日常の使用に対して、実用性をもって取り扱えることがわかった。
次に第2実施形態に係る指点字システム1Bについて図9~図11を参照して説明する。指点字システム1Aが片手について、人差し指、中指および薬指の3本の指を使用することを前提としていたが、指点字システム1Bは以上の3本に親指を加えた4本の指を使用することを前提とする。つまり、指点字システム1Bは、例えばスマートフォンの操作に親指を加え、この親指の操作にファンクションキーとしての機能を与える。なお、指点字システム1Bは指点字システム1Aと共通部分を含んでいる。したがって、以下においては、指点字システム1Aと同じ構成については指点字システム1Aと同じ符号を付すとともに、指点字システム1Aとの相違点を中心にして指点字システム1Bを説明する。
指点字システム1Bは、図9に示すように、視聴覚障碍者が手に装着して使用する装着側装置3Bと、視聴覚障碍者の手への装着に関わらない非装着側装置5と、を備える。指点字システム1Bは指点字システム1Aと同様に常時携行性を備える。指点字システム1Bの装着側装置3Bは、装着側装置3Aの入出力ユニット10A,10B,10Cに加えて、入出力ユニット10Dを備える。
装着側装置3Bは、装着側装置3Aと同様に、装着される者を基準にして、情報の受信機能と発信機能を備える。
装着側装置3Bは、図9に示すように、四つの入出力ユニット10A,10B,10C,10Dと、入出力ユニット10A,10B,10C,10Dとの信号の送受信を行う本体ユニット50と、入出力ユニット10A,10B,10C,10Dのそれぞれと本体ユニット50とを接続する信号ケーブル30A,30B,30C,30Dと、を備える。装着側装置3Bは、左右の両手に装着され、それぞれの手において、入出力ユニット10A,10B,10C,10Dは、一例としてそれぞれ人差し指、中指、薬指および親指に取り付けられる。装着側装置3Bについても、装着者の手に取り付けられるものの、それぞれの指の指腹は開放されており指腹を使う支障にはならない。
装着側装置3Bの入出力ユニット10(10A,10B,10C,10D)は、図示を省略するが、第1実施形態の入出力ユニット10と同様に、振動部11、動作検知部13および送受信部15を備える。振動部11、動作検知部13および送受信部15の機能、構成も先に説明した第1実施形態と同様である。
ただし、装着側装置3Bは片手について4本の指を対象とする。したがって、装着側装置3Bが装着者の左右の両手に付けられると、右手と左手、それぞれの親指、人差し指、中指、薬指の計8本の指のそれぞれに振動部11が取り付けられるので、計8本の指に振動を伝達させることができる。具体的には、8本の指のそれぞれに振動の有無を組み合わせると、2の8乗、つまり256通りの組み合わせを発現できる。文字情報に加えてデジタル端末の入出力に用いられる様々なコマンドキーやそれらの組み合わせの入力を割り振ることができる。
本体ユニット50は、第1実施形態と同様に、信号ケーブル30(30A~30D)を介して入出力ユニット10(10A~10D)に接続され、入出力ユニット10への情報の送信および入出力ユニット10からの情報の受信を担う。本体ユニット50は、この機能を実現するために、図3を参照して先に説明したように、第1送受信部51、演算部53、指令部55および第2送受信部57を備える。
次に、図10および図11を参照して、装着側装置3Bを手に装着する例を説明する。
装着側装置3Bは、装着側装置3Aと同様に、入出力ユニット10、装着具20を備え、入出力ユニット10、信号ケーブル30および本体ユニット50は、装着具20に保持されながら装着具20により人の手に装着される。
第1保持部21A,21B,21C,21Dは、親指FDの第1関節J1の近傍を周囲から覆う指輪型の形状を有している。したがって、装着具20を装着した状態においても、人差し指FA、中指FB、薬指FCおよび親指FDの第1関節J1よりも先端の指腹FP1~FP4は開放される。
次に、人の手の甲Bの側に設けられる第2保持部23は、図10および図11に示されるように、保持部23A、第1接続部23Bよび第2接続部23Cを備える点および機能が第1実施形態と同様である。ただし、
また、バンド25についても、第1実施形態と同様に、人の手首Rに巻き回され、両方の端部25A,25Bが接合される。
非装着側装置5については、第1実施形態と同様に、スマートフォン、タブレットなどのコンピュータ装置が適用され、図8に示したように、送受信部61、入力部63、指点字情報を表示部65と、を備える。また、非装着側装置5は、送受信部61、入力部63および表示部65の動作を制御する制御部67を備える。
以下、第2実施形態に係る指点字システム1Bを用いて指点字を実行する例を説明する。
よく知られるように、公知の点字キーボードは、点字の6点の番号を両手の指に割り当てる。具体的には、図12に示すように、左手LHの人差し指LA、中指LB、薬指LCの順に1,2,3が割り当てられ、右手RHの人差し指RA、中指RB、薬指RCの順に4,5,6が割り当てられる。これらを数値キーと称するが、本実施形態においても同様に数値キーが割り当てられる。第2実施形態においては、図12に示されるように、左手LHの親指LDと右手RHの親指RDのそれぞれにファンクションキー(機能キー)としてのLおよびRが割り当てられる。
特定された文字情報は第2送受信部57を介して非装着側装置5に送信され、その表示部65に表示される。ここまでの文字の特定は、第1実施形態においても実施できるが、次の機能キーをも含む動作情報に基づく処理は、第2実施形態において実施ができるようになる。
他の例として、カーソル・キー(Cursor Key)に関するものがあり、演算部53は、動作情報としてLキー(親指LD)と数値キー1を受信すると、上向きのカーソルが押されるのを特定する。左向き、下向きおよび右向きのカーソルについても、演算部53は特定できる。
指点字システム1Bは、指点字システム1Aと同様の効果を奏するのに加えて、以下の効果を奏する。
指点字システム1Bは、それぞれの手において親指を加える4本の指を使用することを前提とするので、効率的にスマートフォンの操作ができるのに加えて、文字以外の機能的な処理を実現できるようになる。
また、指点字システム1Bの第1保持部21A~21Dは指輪型をなしている。したがって、装着者の指の太さ、長さにかなり幅があったとしても、第1保持部21A~21Dを弾性力のある素材で作製すれば、装着者の負担を小さくしながら、第1保持部21A~21Dを容易に装着できる。また、その製造コストを最小限に抑えることができる。
また視聴覚障碍者が人差し指、中指、薬指のいずれかに障害をもつ場合、他の指に入出力ユニットを振り替えたり、振動位置を指の長手方向の前後方向にずらしたりして利用できる。
3A,3B 装着側装置
5 非装着側装置
10,10A,10B,10C 入出力ユニット
11 振動部
13 動作検知部
15 送受信部
20 装着具
21,21A,21B,21C 第1保持部
22A,22B,22C ポケット
22in 内側層
22out 外側層
23 第2保持部
23A 保持部
23in 内層
23out 外層
23B 第1接続部
23C 第2接続部
23D ポケット
25 バンド
25A,25B 端部
30,30A,30B,30C 信号ケーブル
50 本体ユニット
51 第1送受信部
53 演算部
55 指令部
57 第2送受信部
61 送受信部
63 入力部
65 表示部
67 制御部
110 無線通信
LH 左手
RH 右手
B 手の甲
F 指
R 手首
FA,LA,RA 人差し指
FB,LB,RB 中指
FC,LC,RC 薬指
LD,RD 親指
FN 爪
FP1,FP2,FP3 指腹
J1 第1関節
J2 第2関節
J3 第3関節
Claims (13)
- 動作に応じる信号を発信する出力ユニットと、
前記出力ユニットからの前記信号を受信して所定の処理を行う本体ユニットと、
前記出力ユニットおよび本体ユニットを保持するとともに、人の手に装着するための装着具と、を備え、
前記出力ユニットは、
前記装着具により前記手の指に設けられるとともに、前記指の前記動作を検知する動作検知部を備え、
前記本体ユニットは、
前記動作検知部で検知される前記指の前記動作に対応する動作情報を受信するとともに、受信した前記動作情報に基づいて文字を特定する、
ことを特徴とする指点字装置。 - 前記本体ユニットは、
前記動作情報と特定される前記文字とが関連付けられる関連情報を予め備え、
前記出力ユニットから受信する前記動作情報と前記関連情報とを照合することにより、前記文字を特定する、
請求項1に記載の指点字装置。 - 前記本体ユニットは、
前記出力ユニットから受信する前記動作情報に基づいて実行すべき機能を特定する、
請求項1または請求項2に記載の指点字装置。 - 前記本体ユニットは、
前記動作情報と特定される前記機能とが関連付けられる関連情報を予め備え、
前記出力ユニットから受信する前記動作情報と前記関連情報とを照合することにより、前記機能を特定する、
請求項3に記載の指点字装置。 - 人差し指、中指および薬指のそれぞれに対応する3つの前記出力ユニットを備え、
3つの前記出力ユニットのそれぞれの前記動作検知部は、前記人差し指、前記中指および前記薬指のそれぞれの指背の側に配置される、
請求項1から請求項4のいずれか一項に記載の指点字装置。 - 前記動作検知部は、
前記人差し指、前記中指および前記薬指のそれぞれの第1関節と第2関節の間に配置される、
請求項5に記載の指点字装置。 - 親指に対応する前記出力ユニットを備え、
当該出力ユニットの前記動作検知部は、前記親指の指背の側に配置される、
請求項5または請求項6に記載の指点字装置。 - 前記動作検知部は、
前記親指の第1関節と第2関節の間に配置される、
請求項7に記載の指点字装置。 - 前記本体ユニットは、
前記装着具により前記手の甲に設けられる、
請求項1から請求項8のいずれか一項に記載の指点字装置。 - 前記装着具は、
前記人差し指、前記中指および前記薬指のそれぞれに嵌められ、3つの前記出力ユニットのそれぞれを保持するとともに、前記人差し指、前記中指および前記薬指のそれぞれに嵌められる第1保持部と、
前記第1保持部と連なり、前記本体ユニットを保持するとともに、前記手の甲の側にだけ対応して設けられる第2保持部と、
前記第2保持部と連なり、人の手首に巻き回されるバンドと、を備える、
請求項6から請求項9のいずれか一項に記載の指点字装置。 - 前記装着具は、
前記出力ユニットを保持するとともに、前記親指に嵌められる前記第1保持部と、
前記第1保持部と連なり、前記本体ユニットを保持するとともに、前記手の甲の側にだけ対応して設けられる前記第2保持部と、
前記第2保持部と連なり、人の手首に巻き回されるバンドと、を備える、
請求項10に記載の指点字装置。 - 前記動作検知部は、3軸加速度センサからなる、
請求項1から請求項11のいずれか一項に記載の指点字装置。 - 前記出力ユニットおよび前記本体ユニットは、
前記装着具により左手および右手のそれぞれに装着される、
請求項1から請求項12のいずれか一項に記載の指点字装置。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2023514849A JP7370508B2 (ja) | 2021-05-13 | 2022-02-21 | 指点字装置 |
US18/502,104 US20240069633A1 (en) | 2021-05-13 | 2023-11-06 | Finger braille device |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2021081373 | 2021-05-13 | ||
JP2021-081373 | 2021-05-13 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US18/502,104 Continuation-In-Part US20240069633A1 (en) | 2021-05-13 | 2023-11-06 | Finger braille device |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022239357A1 true WO2022239357A1 (ja) | 2022-11-17 |
Family
ID=84029042
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2022/006932 WO2022239357A1 (ja) | 2021-05-13 | 2022-02-21 | 指点字装置 |
Country Status (3)
Country | Link |
---|---|
US (1) | US20240069633A1 (ja) |
JP (1) | JP7370508B2 (ja) |
WO (1) | WO2022239357A1 (ja) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6230135B1 (en) * | 1999-02-02 | 2001-05-08 | Shannon A. Ramsay | Tactile communication apparatus and method |
JP2001324922A (ja) * | 2000-05-17 | 2001-11-22 | Yamaha Corp | 情報伝達方法および情報伝達システム |
JP2002091668A (ja) * | 2000-09-12 | 2002-03-29 | Nippon Hoso Kyokai <Nhk> | 情報入力装置 |
CN103839458A (zh) * | 2014-03-26 | 2014-06-04 | 郑家近 | 一种新盲文系统 |
JP2020046666A (ja) * | 2018-09-14 | 2020-03-26 | 一般社団法人ハートウエアラボ | 指点字システム及び指点字装置 |
US20200168121A1 (en) * | 2016-04-27 | 2020-05-28 | Bonocle, Inc. | Device for Interpretation of Digital Content for the Visually Impaired |
-
2022
- 2022-02-21 WO PCT/JP2022/006932 patent/WO2022239357A1/ja active Application Filing
- 2022-02-21 JP JP2023514849A patent/JP7370508B2/ja active Active
-
2023
- 2023-11-06 US US18/502,104 patent/US20240069633A1/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6230135B1 (en) * | 1999-02-02 | 2001-05-08 | Shannon A. Ramsay | Tactile communication apparatus and method |
JP2001324922A (ja) * | 2000-05-17 | 2001-11-22 | Yamaha Corp | 情報伝達方法および情報伝達システム |
JP2002091668A (ja) * | 2000-09-12 | 2002-03-29 | Nippon Hoso Kyokai <Nhk> | 情報入力装置 |
CN103839458A (zh) * | 2014-03-26 | 2014-06-04 | 郑家近 | 一种新盲文系统 |
US20200168121A1 (en) * | 2016-04-27 | 2020-05-28 | Bonocle, Inc. | Device for Interpretation of Digital Content for the Visually Impaired |
JP2020046666A (ja) * | 2018-09-14 | 2020-03-26 | 一般社団法人ハートウエアラボ | 指点字システム及び指点字装置 |
Also Published As
Publication number | Publication date |
---|---|
JPWO2022239357A1 (ja) | 2022-11-17 |
JP7370508B2 (ja) | 2023-10-30 |
US20240069633A1 (en) | 2024-02-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Ozioko et al. | Smart tactile gloves for haptic interaction, communication, and rehabilitation | |
Zhu et al. | Soft, wearable robotics and haptics: Technologies, trends, and emerging applications | |
Yang et al. | Supernumerary robotic limbs: A review and future outlook | |
US20170316717A1 (en) | Semi-wearable Device for Interpretation of Digital Content for the Visually Impaired | |
US20170119553A1 (en) | A haptic feedback device | |
US20180014744A1 (en) | Motor-activated multi-functional wrist orthotic | |
Gantenbein et al. | Intention detection strategies for robotic upper-limb orthoses: a scoping review considering usability, daily life application, and user evaluation | |
Motti et al. | Introduction to wearable computers | |
Vertongen et al. | Design of a 3D printed hybrid mechanical structure for a hand exoskeleton | |
Zeng et al. | Designing a brain computer interface using emotiv headset and programming languages | |
US20200168121A1 (en) | Device for Interpretation of Digital Content for the Visually Impaired | |
WO2022239357A1 (ja) | 指点字装置 | |
Saypulaev et al. | A review of robotic gloves applied for remote control in various systems | |
ES2926994T3 (es) | Sistema de conversión de los movimientos relacionados con la lengua de signos en voz y/o texto escrito | |
JPWO2022239357A5 (ja) | ||
JP2001236177A (ja) | マウス | |
JP2009113184A (ja) | 受動的力覚フィードバック装置および受動的力覚フィードバックシステム | |
Hung et al. | Prototyping of Haptic Datagloves for Deafblind People | |
KR20210051277A (ko) | 모션 측정을 수행하는 웨어러블 장치 및 그 제조 방법 | |
CN111367416A (zh) | 一种虚拟现实手套及虚拟现实交互系统 | |
KR20210041469A (ko) | 손가락 움직임 보조용 장갑 | |
Zeagler | Designing textile-based wearable on-body electronic interfaces utilizing vibro-tactile proprioceptive display | |
KR20010110615A (ko) | 피부의 움직임을 감지하여 작동되는 정보입력장치와 이를이용한 이동정보처리장치와 컴퓨터와 이동통신기기 | |
Sanford et al. | Grip pressure measurements during activities of daily life | |
ES2561927B1 (es) | Sistema multisensor para rehabilitación e interacción de personas con discapacidad |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22807064 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2023514849 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 11202308476S Country of ref document: SG |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 22807064 Country of ref document: EP Kind code of ref document: A1 |