TW202033173A - Intelligent laser-sensing virtual walking stick device for the visually impaired for achieving the function of a voice interactive assistant and preventing the ears from losing the ability of listening environmental sounds due to the use of general earphones - Google Patents

Abstract

This invention relates to an intelligent laser-sensing virtual walking stick device for the visually impaired individual. The main structure includes a grip shell body for being gripped by the visually impaired people. Instead of the structure of a real walking stick, the high-frequency ultrasound of an infrared sensor and an infrared radar positioning system are used to detect the obstacles on the road, and a camera device and the image recognition technology of a recognition database are further used to determine the name and actual size of a detected object. Then, a microprocessor and a vibration simulator are used to simulate the vibration effect of touching an object. Moreover, with the wireless connection of a voice communication device and a bone conductor, it is able to communicate with the visually impaired individual in real time, so as to achieve the function of a voice interactive assistant, prevent the ears from losing the ability of listening environmental sounds due to the use of general earphones, and guide the destination via a navigation device. Therefore, the intelligent laser-sensing virtual walking stick device for the visually impaired individual may enable the visually impaired individual to take care of themselves in daily life as normal people.

Description

Intelligent laser sensing virtual walking stick device for the blind

The present invention is to provide an intelligent laser sensing virtual walking stick device for the blind, in particular to a virtual walking stick without a physical stick body using high-tech technologies such as laser sensing, image recognition, damping vibration, bone vibration conduction, etc. An intelligent laser sensing virtual walking stick device for the blind that cooperates with GPS navigation function to provide life information guidance.

Press, the blind person explores the world with a cane, and often understands the cognition of the environment in wrong attempts. The function of this cane is at stake for the blind person’s well-being. The use of the guide stick requires the visually impaired person to hold the guide stick and tap the ground back and forth to detect the surrounding environment and obstacles. The average person also judges that the blind person is a blind person because he uses a walking stick. Willing to lend a helping hand, but if the blind can take care of themselves, sometimes based on self-esteem or other factors, they don’t want others to recognize that they are blind or the help of a dick.

Although some public facilities are equipped with blind body-applied devices, such as blind guide bricks, it is possible to avoid injury due to the inability to detect the surrounding environment as much as possible. However, in actual life, the construction of these public facilities is often not comprehensive, which causes many inconveniences in the users’ lives. For example, even if an obstacle is detected, it is impossible to know what the obstacle is, or its size. Why, and make blind people unable to avoid them, and even make them vulnerable.

However, there are the following problems and deficiencies when using the above-mentioned guide cane, which needs to be improved:

1. There must be a tangible cane, and it is easy to be discriminated against by others.

2. The 3C auxiliary functions of smart life are not complete, and blind people cannot take care of their lives by themselves.

3. A guide stick with voice function, because wearing headphones, will affect the original hearing of the blind.

Therefore, how to solve the above-mentioned conventional problems and deficiencies is the direction that the creators of the present invention and related manufacturers engaged in this industry urgently want to study and improve.

Therefore, in view of the above-mentioned deficiencies, the creator of the present invention collected relevant information, evaluated and considered from multiple parties, and based on years of experience in this industry, through continuous trials and modifications, he designed this kind of laser sensing , Image recognition, damping vibration, bone vibration conduction and other high-tech technologies, creating a virtual cane without a physical cane, and an intelligent laser sensing virtual cane device for blind people that can cooperate with GPS navigation to provide life information guidance. .

The main purpose of the present invention is to integrate the infrared sensor, the photographing device, the identification database and the vibration simulator to effectively simulate the function of the walking stick and realize the purpose of the virtual walking stick.

Another main purpose of the present invention is to cooperate with the ear bone vibration transducer, so that the function of the voice communication device will not affect the hearing of the blind, so that the navigation device can perform its functions.

In order to achieve the above-mentioned object, the main structure of the present invention includes: a holding shell, the holding shell is provided with a microprocessor, and the holding shell is provided with an infrared sensor electrically connected to the microprocessor The device is used to feed back the size of the sensing object and the distance from the sensing object, and one side of the infrared sensor is provided with a photographing device electrically connected to the microprocessor, and the photographing device is electrically connected to a Hold the identification database in the housing, and a vibration simulator electrically connected to the microprocessor is provided on one side of the infrared sensor, which is in the same position of the holding housing according to the appearance position of the sensing object A voice communication device electrically connected to the microprocessor is provided in the holding housing, and an ear bone vibration transducer is wirelessly connected, and an electrical connection to the voice communication is provided in the holding housing The navigation device of the device, and a power supply device electrically connected to the microprocessor is provided in the holding case.

When a blind person uses the present invention as his blind guide, it detects obstacles on the road through the infrared sensor's high-frequency ultrasonic wave and infrared radar positioning system, instead of the structure of the physical cane, and avoids discrimination by others, and can use photography The image recognition technology of the device and the recognition database determines the specific name and actual size of the sensing object, and informs the user in real time through a voice communication device, and the voice communication device uses ear bone vibration transducers instead of earphone communication to avoid influence The user’s hearing, coupled with the navigation device, allows the user to go to the set destination just like a normal person.

With the above-mentioned technology, it is possible to break through the problems of tangible crutches, which are commonly used as guide sticks, are easily discriminated by others, have incomplete functions that cannot allow blind people to take care of themselves, and that the voice function provided by earphones will affect the ability of the blind. , To achieve the practical progress of the above advantages.

1, 1a, 1b, 1c‧‧‧hold the shell

11a‧‧‧RF Sensing Components

111a‧‧‧RFID tag

12b‧‧‧Light-emitting element

13, 13b‧‧‧Switch

14c‧‧‧ Ergonomic curved surface

15c‧‧‧Physiological sensing device

2. 2a‧‧‧Microprocessor

3. 3b‧‧‧Infrared sensor

31‧‧‧High Frequency Ultrasonic Generator

32‧‧‧Radar Locator

33‧‧‧Signal Receiver

34b‧‧‧Laser generator

4‧‧‧Photographic installation

41‧‧‧Identification Database

42‧‧‧Light Filling Element

5‧‧‧Vibration Simulator

6, 6a‧‧‧Voice communication device

61, 61a‧‧‧ Ear bone vibration transducer

611a‧‧‧Radio component

7, 7a‧‧‧Navigation device

71a‧‧‧Life Information Platform

8‧‧‧Power supply device

9‧‧‧Obstacle

The first figure is a perspective view of a preferred embodiment of the present invention.

The second figure is a block diagram of a preferred embodiment of the present invention.

The third diagram is a diagram of the use state of the preferred embodiment of the present invention.

The fourth figure is a schematic diagram of sensing in a preferred embodiment of the present invention.

The fifth figure is a schematic diagram of the vibration simulation of the preferred embodiment of the present invention.

The sixth figure is a block diagram of the operation flow of the preferred embodiment of the present invention.

The seventh figure is a schematic diagram of voice communication in a preferred embodiment of the present invention.

The eighth figure is a schematic diagram (1) of another preferred embodiment of the present invention.

The ninth figure is a schematic diagram (2) of another preferred embodiment of the present invention.

Figure 10 is a schematic diagram of a light source according to another preferred embodiment of the present invention.

Figure eleven is a diagram of another preferred embodiment of the present invention in use.

In order to achieve the above-mentioned objectives and effects, the technical means and structure adopted by the present invention are illustrated in detail below to illustrate the features and functions of the preferred embodiments of the present invention for a complete understanding.

Please refer to the first and second figures, which are a three-dimensional perspective view and a structural block diagram of a preferred embodiment of the present invention. From the figures, it can be clearly seen that the present invention includes: a holding shell 1; The microprocessor 2 in the holding housing 1; an infrared sensor 3 arranged on the holding housing 1 and electrically connected to the microprocessor 2, for feedback of the size and The distance of the sensing object, the infrared sensor 3 includes a high-frequency ultrasonic generator 31, a radar locator 32, and a signal receiver for receiving the feedback information of the high-frequency ultrasonic generator 31 and the radar locator 32 33; at least one photographing device 4 located on the side of the infrared sensor 3 and electrically connected to the microprocessor 2, and the holding housing 1 is provided with a light-filling element 42 located on the side of the photographing device 4 One is located in the holding housing 1 and electrically connected to the identification database 41 of the photographing device 4; one is located on the side of the infrared sensor 3 and is electrically connected to the vibration simulator 5 of the microprocessor 2 , Based on the appearance position of the sensing object, vibration is generated at the same position of the holding housing 1; a voice communication device 6 arranged in the holding housing 1 and electrically connected to the microprocessor 2, It is wirelessly connected to an ear bone vibration transducer 61; a navigation device 7 arranged in the holding housing 1 and electrically connected to the voice communication device 6; and a navigation device 7 arranged in the holding housing 1 and electrically connected The power supply device 8 of the microprocessor 2, this embodiment The power supply device 8 uses a rechargeable battery as an example, and can be connected to a USB connector for charging in a non-use state.

Based on the above description, the structure of this technology can be understood, and based on the corresponding cooperation of this structure, high-tech technologies such as laser sensing, image recognition, damping vibration, and bone vibration conduction can be used to create a non-physical rod. The virtual walking stick can also cooperate with GPS navigation function to provide life information guidance and other advantages, and the detailed explanation will be explained below.

Please refer to the first to seventh figures together, which are the three-dimensional perspective view to the voice communication schematic diagram of the preferred embodiment of the present invention. When the above-mentioned components are assembled, it can be clearly seen from the figures that the present invention is The appearance is only presented by a holding shell 1. The user holds it in his hand like a flashlight at first glance. It is a virtual cane without a physical long crutches, and it is not easy to be recognized by others as blind. It can cooperate with the microprocessor 2, the infrared sensor 3, the vibration simulator 5, the voice communication device 6, the ear bone vibration transducer 61 and other components to assist the user, so that he can maintain his/her current life condition by himself. Self-esteem is not discriminated against by others (as shown in the third picture).

Specifically, please refer to Figures 4 to 6. The implementation principle of the virtual cane is based on holding the infrared sensor 3 at the front end of the housing 1, and using its high frequency ultrasonic generator 31 to generate UHF (Ultra High Frequency, the UHF ultrasonic wave with a frequency of 300MHz to 3GHz), and infrared radar positioning using the radar locator 32 to sense obstacles 9 (ie, sensing objects) on the road. The radar locator 32 can emit a cross-shaped thunder When the cross-shaped laser light touches an obstacle 9, it will produce changes in the shape, distance and displacement of the center of the cross. The high-frequency ultrasonic generator 31 can sense the obstacle 9 within about ten meters and use the grip Hold the signal receiver 33 below the front end of the housing 1, and transfer the two sensing signals to the microprocessor 2 for calculation (this embodiment uses both ultrasonic and infrared to perform the operation, but alternative use also belongs to the present invention To determine the distance to the obstacle 9, the direction of the obstacle 9, and the actual size of the obstacle 9, plus the camera device 4 holding the front end of the housing 1, the obstacle 9 can be captured in real time The image of is compared with a large number of pre-stored object appearance data in the identification database 41. When the comparison results match, the user can know the actual name of the obstacle 9 sensed. If the use environment is dark, the light supplement element 42 can be turned on through the switch 13 to assist the operation of the photographing device 4 and improve the accuracy of image recognition.

When the obstacle 9 is sensed, the vibration simulator 5 is used to generate damped vibration in the same direction according to the position of the obstacle 9 relative to the cross-shaped laser light. For example, as shown in the fifth figure, if the cross-shaped laser light emitted by the radar locator 32 is operated by the user, the cross-shaped laser When the left side of the light touches the obstacle 9, the vibration simulator 5 will produce a damping vibration effect on the left side of the holding shell 1, thereby simulating the effect of a physical walking stick, allowing the user to know the direction of the obstacle 9 and The damped vibration is based on the speed at which the user moves the laser light, and the microprocessor 2 simulates and calculates the impact force when the physical cane touches the obstacle 9, and after the collision, the amplitude is gradually reduced to reflect the grip of the shell体1上。 Body 1.

The actual name of the aforementioned obstacle 9 is wirelessly connected (for example, Bluetooth connection) to an ear bone vibration transducer 61 through the voice communication device 6, so that the actual name of the obstacle 9 is transmitted through the ear bone vibration transducer 61 Inform the user that since the ear bone vibration transducer 61 is an ear-hook design, it does not need to be inserted into the ear hole and will not affect the user’s original hearing. Naturally, it can avoid the loss of the ability to listen to environmental sounds due to the earphones. At the same time, it receives messages from the voice communication device 6. Among them, the ear bone vibration transmitter 61 uses the technology of converting sound into mechanical vibrations of different frequencies, passing through the human skull, bone labyrinth, inner ear lymph, spiral organ, auditory nerve, and auditory center To deliver sound waves. Compared with the traditional sound conduction method that generates sound waves through the diaphragm, bone conduction eliminates many sound wave transmission steps, and can achieve clear sound reproduction in a noisy environment, and sound waves will not be affected by diffusion in the air. others. Therefore, the ear bone vibration transducer 61 can be effectively used with the navigation device 7. The user only needs to send the destination instruction (such as bus stop number XXX) to the voice communication device 6, and the GPS system in the navigation device 7 can read the user The location of, the path to the destination is planned, and the content of the path is notified through the voice communication device 6 and the ear bone vibration transducer 61 (as shown in the seventh figure).

Please also refer to the eighth and ninth figures, which are schematic diagrams (1) and schematic diagrams (2) of another preferred embodiment of the present invention. It can be clearly seen from the figure that this embodiment is different from The above embodiments are similar, but they further include a life information platform 71a connected to the navigation device 7a, a radio element 611a connected to the voice communication device 6a, and a radio frequency sensor located on the side of the holding shell 1a.测Component 11a. As shown in the eighth figure, in this embodiment, a radio frequency sensing element 11a is provided at the front end of the holding housing 1a to sense the RFID tag 111a. When used, it must be pre-embedded in blind bricks or fixed buildings ( For example, the RFID tag 111a in the mailbox), when the radio frequency sensing element 11a detects the RFID tag 111a, the information in the RFID tag 111a can be transmitted to the microprocessor 2a, and then through the voice communication device 6a and ear bone vibration transmission The device 61a informs the user that it can also cooperate with the life information platform 71a (such as a cloud server or mobile application) to connect to the smart city information network and the navigation device 7a to provide complete life assistant information, such as public transportation. The transfer guidance, traffic light guidance, convenience store guidance, etc., further strengthen the function of the navigation device 7a Yes, and the sound-receiving element 611a of the voice communication device 6a can be integrated into the earbone vibration transducer 61a, so that the user's destination instructions are more naturally received by the voice communication device 6a. It is even possible to provide an automatic learning function through the life information platform 71a, allowing the present invention to automatically learn the life habits of the blind, such as height, virtual walking stick height, habit perception distance, etc., and intelligently correct all behaviors in the living environment area.

Please also refer to the tenth figure, which is a schematic diagram of the light source of another preferred embodiment of the present invention. It can be clearly seen from the figure that this embodiment is similar to the above-mentioned embodiment, except for the infrared sensor. There is a laser generator 34b on one side of 3b, and at least one light emitting element 12b on the side of the holding shell 1b away from the infrared sensor 3b. In this way, the laser generator 34b holding the front end of the housing 1b emits laser rays (such as red visible light) to let other passers-by know that the blind person is using a virtual cane, and the rear end of the holding housing 1b is provided with a light emitting The element 12b can be used as a night warning light to remind passers-by of the presence of users. Of course, these two functions can be manually turned on by the user by holding the switch 13b on the housing 1b.

Please also refer to Figure 11, which is a diagram of the use state of another preferred embodiment of the present invention. It can be clearly seen from the figure that this embodiment is similar to the above-mentioned embodiment, only in the grip At least one ergonomic curved surface 14c is formed on the surface of the housing 1c, and at least one physiological sensing device 15c is provided on one side of the holding housing 1c. The design of the ergonomic curved surface 14c allows the user to hold it for a long time without feeling uncomfortable, and while holding it, the physiological sensing device 15c can be used to automatically help the user to measure it regularly or irregularly. Physiological data can be used to track the user's health status, such as pulse, body fat measurement.

However, the above descriptions are only preferred embodiments of the present invention, and are not limited to the scope of the present invention. Therefore, all simple modifications and equivalent structural changes made by using the description and drawings of the present invention should be the same. It is included in the scope of the patent of the present invention, and it is hereby stated.

In summary, the intelligent laser sensing virtual cane device for the blind of the present invention can indeed achieve its effects and purposes when used. Therefore, the present invention is an invention with excellent practicability and meets the requirements of an invention patent. Yan filed an application in accordance with the law, and I hope that the review committee will grant the invention as soon as possible to protect the hard work of the creator. If the review committee has any doubts, please feel free to write instructions, and the creator will do our best to cooperate with you.

1‧‧‧Hold the shell

2‧‧‧Microprocessor

3‧‧‧Infrared sensor

31‧‧‧High Frequency Ultrasonic Generator

32‧‧‧Radar Locator

33‧‧‧Signal Receiver

4‧‧‧Photographic installation

41‧‧‧Identification Database

42‧‧‧Light Filling Element

5‧‧‧Vibration Simulator

6‧‧‧Voice communication device

7‧‧‧Navigation device

8‧‧‧Power supply device

Claims (10)

An intelligent laser-sensing virtual walking stick device for the blind, which mainly includes: a holding shell; a microprocessor arranged in the holding shell; and one arranged on the holding shell and electrically connected to the microprocessor The infrared sensor of the device provides feedback on the size of the sensing object and the distance from the sensing object; at least one camera device is provided on the side of the infrared sensor and electrically connected to the microprocessor; The holding shell is electrically connected to the identification database of the photographing device; a vibration simulator which is arranged on the side of the infrared sensor and is electrically connected to the microprocessor is based on the orientation of the sensing object, Vibration is generated at the same position of the holding shell; a voice communication device arranged in the holding shell and electrically connected to the microprocessor is wirelessly connected to an ear bone vibration transducer; one is arranged in the holding shell A navigation device in the housing and electrically connected to the voice communication device; and a power supply device arranged in the holding housing and electrically connected to the microprocessor. The intelligent laser sensing virtual walking stick device for the blind as described in item 1 of the scope of patent application, wherein the infrared sensor has a high-frequency ultrasonic generator, a radar locator, and a device for receiving the high-frequency ultrasonic generator and the radar positioning The signal receiver of the feedback information of the device. The intelligent laser sensing virtual walking stick device for the blind as described in item 1 of the scope of patent application, wherein the infrared sensor has a laser generator on one side. The intelligent laser sensing virtual walking stick device for the blind as described in item 1 of the scope of the patent application further includes a life information platform linking the navigation device. The intelligent laser sensing virtual cane device for the blind as described in item 4 of the scope of patent application further includes an information linking radio element of the voice communication device for receiving voice commands from the user. The intelligent laser sensing virtual walking stick device for the blind as described in item 4 of the scope of patent application further includes a radio frequency sensing element arranged on one side of the holding shell. The intelligent laser sensing virtual cane device for the blind as described in the first item of the patent application further includes at least one physiological sensing device arranged on one side of the holding shell. The smart laser sensing virtual walking stick device for the blind as described in the first item of the patent application, wherein the holding shell has at least one light-emitting element on a side facing away from the infrared sensor. The intelligent laser sensing virtual walking stick device for the blind as described in item 1 of the patent application, wherein at least one ergonomic curved surface is formed on the surface of the holding shell. The smart laser sensing virtual walking stick device for the blind as described in item 1 of the patent application, wherein the holding shell is provided with a light-filling element located on one side of the photographing device.

Images