CN109527733A - A kind of intelligent crutch - Google Patents

A kind of intelligent crutch Download PDF

Info

Publication number
CN109527733A
CN109527733A CN201811401130.0A CN201811401130A CN109527733A CN 109527733 A CN109527733 A CN 109527733A CN 201811401130 A CN201811401130 A CN 201811401130A CN 109527733 A CN109527733 A CN 109527733A
Authority
CN
China
Prior art keywords
module
microprocessor
audio collection
bluetooth
video acquisition
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811401130.0A
Other languages
Chinese (zh)
Inventor
蔡金萍
赵曜
兰上炜
吴家湖
郑俊杰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong University of Technology
Original Assignee
Guangdong University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong University of Technology filed Critical Guangdong University of Technology
Priority to CN201811401130.0A priority Critical patent/CN109527733A/en
Publication of CN109527733A publication Critical patent/CN109527733A/en
Pending legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A45HAND OR TRAVELLING ARTICLES
    • A45BWALKING STICKS; UMBRELLAS; LADIES' OR LIKE FANS
    • A45B3/00Sticks combined with other objects
    • AHUMAN NECESSITIES
    • A45HAND OR TRAVELLING ARTICLES
    • A45BWALKING STICKS; UMBRELLAS; LADIES' OR LIKE FANS
    • A45B3/00Sticks combined with other objects
    • A45B3/02Sticks combined with other objects with illuminating devices
    • A45B3/04Sticks combined with other objects with illuminating devices electrical
    • AHUMAN NECESSITIES
    • A45HAND OR TRAVELLING ARTICLES
    • A45BWALKING STICKS; UMBRELLAS; LADIES' OR LIKE FANS
    • A45B9/00Details
    • AHUMAN NECESSITIES
    • A45HAND OR TRAVELLING ARTICLES
    • A45BWALKING STICKS; UMBRELLAS; LADIES' OR LIKE FANS
    • A45B9/00Details
    • A45B9/02Handles or heads
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/183Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a single remote source
    • AHUMAN NECESSITIES
    • A45HAND OR TRAVELLING ARTICLES
    • A45BWALKING STICKS; UMBRELLAS; LADIES' OR LIKE FANS
    • A45B9/00Details
    • A45B2009/005Shafts
    • A45B2009/007Shafts of adjustable length, e.g. telescopic shafts

Abstract

The present invention provides a kind of intelligent crutch, including wand body, and microprocessor, bluetooth module, power module, memory module, audio collection module, video acquisition module, image capture module are provided in wand body;Power module and microprocessor, bluetooth module, memory module, audio collection module, video acquisition module, image capture module are electrically connected;Bluetooth module, memory module, audio collection module, video acquisition module, image capture module are electrically connected with the microprocessor;The audio collection module, video acquisition module, image capture module and the memory module are electrically connected;Bluetooth module and external human-computer interaction module wireless communication connect.A kind of intelligent crutch provided by the invention shows the way by building scene Recognition model and for user;User's local environment scene is effectively recorded simultaneously, can observe the location of user information in real time, can inform its people at the first time at the time of emergency.

Description

A kind of intelligent crutch
Technical field
The present invention relates to smart machine applied technical fields, more particularly to a kind of intelligent crutch.
Background technique
With the growth at age, the ability of the various aspects such as memory, vision of people is all declined, on ordinary days in old man it is certain The company of sons and daughters, activity is frequently encountered danger situation outside, such as lost to wander away, fall accidentally, or even is knocked down by vehicle, and causes trouble Person's escape, finally without institute's accountability.
With the development of electronics technology, a kind of simple instrument of the intelligent crutch as auxiliary walking can give old man one Fixed help, reduce old man go astray from the group, sons and daughters can find at the first time when accident occurs for old man and protect old man, avoid by Secondary injury, but existing intelligent crutch only has the function of GPS positioning, barrier prompting, route planning etc., but its function in the market Can be single, old man's local environment scene can not be recorded, at the time of emergency without institute's accountability.
Summary of the invention
The present invention is to overcome existing intelligent crutch to exist to have a single function, and old man's local environment scene can not be recorded, Technological deficiency without institute's accountability when unexpected generation, provides a kind of intelligent crutch.
In order to solve the above technical problems, technical scheme is as follows:
A kind of intelligent crutch, including wand body are provided with microprocessor, bluetooth module, power module, memory mould in the wand body Block, audio collection module, video acquisition module, image capture module;Wherein:
The power module and the microprocessor, bluetooth module, memory module, audio collection module, video acquisition module, Image capture module is electrically connected;
The bluetooth module, memory module, audio collection module, video acquisition module, image capture module with it is described micro- Processor is electrically connected;
The audio collection module, video acquisition module, image capture module and the memory module are electrically connected;
The bluetooth module and external human-computer interaction module wireless communication connect.
Wherein, the intelligent crutch further includes the illuminant module and lighting module being arranged in wand body, the lighting module It is electrically connected by illuminant module and the power module.
Wherein, the power module main body is 5V Switching Power Supply.
Wherein, the main body of the microprocessor is stm32 chip.
Wherein, the illuminant module main body is luminosity sensor.
Wherein, the wand body includes Adjustable bracing bar and the handle that is arranged on Adjustable bracing bar;The wand body is also set up There is key module;The key module and the microprocessor are electrically connected;Wherein:
The microprocessor, bluetooth module, memory module, audio collection module, key module are arranged on the handle; The video acquisition module, image capture module, power module are arranged on the Adjustable bracing bar;The illuminant module and institute Lighting module is stated to be arranged on handle.
Wherein, described image acquisition module, audio collection module combine the GPS position information of external human-computer interaction module, Dangerous object and the object space and distance are identified by RGB-D image reconstruction, construct scene Recognition model, specifically Process the following steps are included:
S1: acquired image is pre-processed, including denoising, filtering and mean value;
S2: collected audio is pre-processed, including is denoised, filtered;
S3: the picture signal pre-processed, audio signal input CNN neural network are subjected to convolutional calculation;
S4: when proceeding to third time convolution, output fusion convolutional layer simultaneously continues convolutional calculation;
S5: it when proceeding to the 6th convolution, outputs data to ROI adaptive pool and estimates network like physical property;
S6: the ROI adaptive pool that fusion is respectively outputted to each layer is carried out like physical property estimation network output result by what is obtained Layer;
S7: label of the fusion convolutional layer by the location information of two layers of full articulamentum combination GPS is output to SoftMax and realizes occasion Classification, and occasion classification data is transmitted into ROI adaptive pool layer;
S8: the ROI adaptive pool layer for obtaining merging a variety of data is output to SoftMax by two layers of full articulamentum, is exported Object classification result;
S9: the relevant informations such as position and the distance of object are obtained according to object classification result.
In above scheme, the external human-computer interaction module includes mobile phone and bluetooth headset, and user is by the indigo plant on crutch After tooth module, bluetooth headset and mobile phone are interconnected, that is, it can be used;Power module is used to power to crutch modules;Storage Device module is for keeping in the information such as image, video, audio;Bluetooth module is by audio collection module, the information of image capture module It is sent to mobile phone, scene Recognition model is constructed together with the GPS system of mobile phone, and information is told information by bluetooth headset User;Video acquisition module is for the case where acquiring roadside, and if any special circumstances, user opens video by key module Acquisition module can record the environment around lower user;Illuminant module can be with the brightness of real-time judge ambient enviroment, intelligent control The opening and closing of lighting module and adjusting to lighting module brightness.
In above scheme, mobile phone receives image and audio signal from crutch mobile phone by bluetooth module, and signal is deposited Enter the local image and audio signal combination cellphone GPS for simultaneously transmitting crutch according to the trained model of mobile phone of mobile phone to carry out fastly Then the scene Recognition of speed carries out Context awareness, the position of the object of environment-identification according to the scene combination image information of subdivision With the information such as distance, if dangerous commission, such as automobile, the then position of the automobile obtained identification and range information generate language Message breath is transferred to bluetooth headset by Bluetooth of mobile phone, user is reminded to avoid danger.
In above scheme, mobile phone is after the information for getting crutch upload, cloud on synchronized update, and user and relatives can be with It is so convenient that inquire environment locating for user, it can effectively avoid the problem that old man wanders away, it also can be at the first time after unexpected generation It is on the scene, the video information that inquiry crutch is recorded.
Compared with prior art, the beneficial effect of technical solution of the present invention is:
A kind of intelligent crutch provided by the invention is provided with multiple functions module and transfers data to hand using bluetooth module Machine constructs scene Recognition model and is shown the way by bluetooth headset for user;Video, image and audio are recorded by crutch simultaneously Information, user local environment scene is effectively recorded, the location of user information can be observed in real time, in accident Its people can be informed when generation at the first time.
Detailed description of the invention
Fig. 1 is the structural diagram of the present invention;
Fig. 2 is each module connection diagram of the present invention;
Fig. 3 is scene Recognition model training flow chart.
Wherein: 1, handle;2, Adjustable bracing bar;3, microprocessor;4, bluetooth module;5, power module;6, memory mould Block;7, audio collection module;8, video acquisition module;9, image capture module;10, illuminant module;11, lighting module;12, it presses Key module.
Specific embodiment
The attached figures are only used for illustrative purposes and cannot be understood as limitating the patent;
In order to better illustrate this embodiment, the certain components of attached drawing have omission, zoom in or out, and do not represent the ruler of actual product It is very little;
To those skilled in the art, the omitting of some known structures and their instructions in the attached drawings are understandable.
The following further describes the technical solution of the present invention with reference to the accompanying drawings and examples.
Embodiment 1
As shown in Figure 1 and Figure 2, a kind of intelligent crutch, including wand body, be provided in the wand body microprocessor 3, bluetooth module 4, Power module 5, memory module 6, audio collection module 7, video acquisition module 8, image capture module 9;Wherein:
The power module 5 and the microprocessor 3, bluetooth module 4, memory module 6, audio collection module 7, video acquisition Module 8, image capture module 9 are electrically connected;
The bluetooth module 4, memory module 6, audio collection module 7, video acquisition module 8, image capture module 9 are and institute State the electric connection of microprocessor 3;
The audio collection module 7, video acquisition module 8, image capture module 9 and the memory module 6 are electrically connected;
The bluetooth module 4 is connected with external human-computer interaction module wireless communication.
More specifically, the intelligent crutch further includes the illuminant module 10 and lighting module 11 being arranged in wand body, described Lighting module 11 is electrically connected by illuminant module 10 and the power module 5.
More specifically, 5 main body of power module is 5V Switching Power Supply.
More specifically, the main body of the microprocessor 3 is stm32 chip.
More specifically, 10 main body of illuminant module is luminosity sensor.
More specifically, the wand body includes Adjustable bracing bar 2 and the handle 1 that is arranged on Adjustable bracing bar;The wand body It is additionally provided with key module 12;The key module 12 is electrically connected with the microprocessor 3;Wherein:
The microprocessor 3, bluetooth module 4, memory module 6, audio collection module 7, key module 12 are arranged at described On handle 1;The video acquisition module 8, image capture module 9, power module 5 are arranged on the Adjustable bracing bar 2;It is described Illuminant module 12 and the lighting module 11 are arranged on handle 1.
In the specific implementation process, key module controls the logical of power module 5 and other modules by microprocessor 12 It is disconnected.
More specifically, as shown in figure 3, described image acquisition module 9, audio collection module 7 combine external human-computer interaction mould The GPS position information of block identifies dangerous object and the object space and distance by RGB-D image reconstruction, building Scene Recognition model, detailed process the following steps are included:
S1: acquired image is pre-processed, including denoising, filtering and mean value;
S2: collected audio is pre-processed, including is denoised, filtered;
S3: the picture signal pre-processed, audio signal input CNN neural network are subjected to convolutional calculation;
S4: when proceeding to third time convolution, output fusion convolutional layer simultaneously continues convolutional calculation;
S5: it when proceeding to the 6th convolution, outputs data to ROI adaptive pool and estimates network like physical property;
S6: the ROI adaptive pool that fusion is respectively outputted to each layer is carried out like physical property estimation network output result by what is obtained Layer;
S7: label of the fusion convolutional layer by the location information of two layers of full articulamentum combination GPS is output to SoftMax and realizes occasion Classification, and occasion classification data is transmitted into ROI adaptive pool layer;
S8: the ROI adaptive pool layer for obtaining merging a variety of data is output to SoftMax by two layers of full articulamentum, is exported Object classification result;
S9: the relevant informations such as position and the distance of object are obtained according to object classification result.
In the specific implementation process, the external human-computer interaction module includes mobile phone and bluetooth headset, and user is by crutch On bluetooth module 4, bluetooth headset and mobile phone interconnected after, that is, can be used;Power module 5 is used to supply to crutch modules Electricity;Memory module 6 is for keeping in the information such as image, video, audio;Bluetooth module 4 is by audio collection module 7, Image Acquisition The information of module 9 is sent to mobile phone, scene Recognition model is constructed together with the GPS system of mobile phone, and information is passed through bluetooth ear Machine tells information to user;Video acquisition module 9 is for the case where acquiring roadside, and if any special circumstances, user is by pressing Key module 12, which opens video acquisition module 8, can record the environment around lower user;Illuminant module 10 can be with real-time judge around The brightness of environment, the opening and closing of intelligent control lighting module 11 and the adjusting to 11 brightness of lighting module.
In the specific implementation process, mobile phone receives image and audio signal from crutch mobile phone by bluetooth module 4, will The local image and audio signal combination cellphone GPS that crutch is transmitted according to mobile phone trained model simultaneously of signal deposit mobile phone Quick scene Recognition is carried out, Context awareness, the object of environment-identification are then carried out according to the scene combination image information of subdivision Position and the information such as distance, if dangerous commission, such as automobile, then the position of the automobile obtained identification and range information Voice messaging is generated, bluetooth headset is transferred to by Bluetooth of mobile phone, user is reminded to avoid danger.
In the specific implementation process, mobile phone is after the information for getting crutch upload, cloud on synchronized update, user and parent People can be convenient inquire environment locating for user, can effectively avoid the problem that old man wanders away, it is unexpected occur after also can the One time was on the scene, the video information that inquiry crutch is recorded.
In the specific implementation process, a kind of intelligent crutch provided by the invention is provided with multiple functions module and utilizes indigo plant Tooth module 4 transfers data to mobile phone, constructs scene Recognition model and is shown the way by bluetooth headset for user;Simultaneously by turning Cane records the information of video, image and audio, and user's local environment scene is effectively recorded, can observe user in real time Location information can inform its people at the first time at the time of emergency.
Obviously, the above embodiment of the present invention be only to clearly illustrate example of the present invention, and not be pair The restriction of embodiments of the present invention.For those of ordinary skill in the art, may be used also on the basis of the above description To make other variations or changes in different ways.There is no necessity and possibility to exhaust all the enbodiments.It is all this Made any modifications, equivalent replacements, and improvements etc., should be included in the claims in the present invention within the spirit and principle of invention Protection scope within.

Claims (7)

1. a kind of intelligent crutch, including wand body, it is characterised in that: be provided with microprocessor (3), bluetooth module in the wand body (4), power module (5), memory module (6), audio collection module (7), video acquisition module (8), image capture module (9);Wherein:
The power module (5) and the microprocessor (3), bluetooth module (4), memory module (6), audio collection module (7), video acquisition module (8), image capture module (9) are electrically connected;
The bluetooth module (4), memory module (6), audio collection module (7), video acquisition module (8), Image Acquisition mould Block (6) is electrically connected with the microprocessor (3);
The audio collection module (7), video acquisition module (8), image capture module (6) and the memory module (6) electricity Property connection;
The bluetooth module (4) and external human-computer interaction module wireless communication connect.
2. a kind of intelligent crutch according to claim 1, it is characterised in that: further include the illuminant module being arranged in wand body (10) it is electrically connected with lighting module (11), the lighting module (11) by illuminant module (10) and the power module (5).
3. a kind of intelligent crutch according to claim 1, it is characterised in that: power module (5) main body is 5V switch Power supply.
4. a kind of intelligent crutch according to claim 1, it is characterised in that: the main body of the microprocessor (3) is stm32 Chip.
5. a kind of intelligent crutch according to claim 2, it is characterised in that: illuminant module (10) main body is luminosity biography Sensor.
6. a kind of intelligent crutch according to claim 1, it is characterised in that: the wand body include Adjustable bracing bar (2) and The handle (1) being arranged on Adjustable bracing bar (2);The wand body is additionally provided with key module (12);The key module (12) It is electrically connected with the microprocessor (3);Wherein:
The microprocessor (3), bluetooth module (4), memory module (6), audio collection module (7), key module (12) are equal It is arranged on the handle (1);The video acquisition module (8), image capture module (9), power module (5) are arranged described On Adjustable bracing bar (2);The illuminant module (10) and the lighting module (11) are arranged on handle (1).
7. described in any item a kind of intelligent crutchs according to claim 1 ~ 6, it is characterised in that: described image acquisition module (9), Audio collection module (7) combines the GPS position information of external human-computer interaction module, identifies there is danger by RGB-D image reconstruction The object and the object space and distance of danger, construct scene Recognition model, detailed process the following steps are included:
S1: acquired image is pre-processed, including denoising, filtering and mean value;
S2: collected audio is pre-processed, including is denoised, filtered;
S3: the picture signal pre-processed, audio signal input CNN neural network are subjected to convolutional calculation;
S4: when proceeding to third time convolution, output fusion convolutional layer simultaneously continues convolutional calculation;
S5: it when proceeding to the 6th convolution, outputs data to ROI adaptive pool and estimates network like physical property;
S6: the ROI adaptive pool that fusion is respectively outputted to each layer is carried out like physical property estimation network output result by what is obtained Layer;
S7: label of the fusion convolutional layer by the location information of two layers of full articulamentum combination GPS is output to SoftMax and realizes occasion Classification, and occasion classification data is transmitted into ROI adaptive pool layer;
S8: the ROI adaptive pool layer for obtaining merging a variety of data is output to SoftMax by two layers of full articulamentum, is exported Object classification result;
S9: the relevant informations such as position and the distance of object are obtained according to object classification result.
CN201811401130.0A 2018-11-22 2018-11-22 A kind of intelligent crutch Pending CN109527733A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811401130.0A CN109527733A (en) 2018-11-22 2018-11-22 A kind of intelligent crutch

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811401130.0A CN109527733A (en) 2018-11-22 2018-11-22 A kind of intelligent crutch

Publications (1)

Publication Number Publication Date
CN109527733A true CN109527733A (en) 2019-03-29

Family

ID=65849436

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811401130.0A Pending CN109527733A (en) 2018-11-22 2018-11-22 A kind of intelligent crutch

Country Status (1)

Country Link
CN (1) CN109527733A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112019960A (en) * 2019-05-28 2020-12-01 深圳市冠旭电子股份有限公司 Method for monitoring scenes by utilizing earphone, device and readable storage medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015196895A1 (en) * 2014-06-24 2015-12-30 陈凯柏 Lighting device controlled by image recognition system
WO2018093796A1 (en) * 2016-11-15 2018-05-24 Magic Leap, Inc. Deep learning system for cuboid detection
CN207575415U (en) * 2017-03-14 2018-07-06 南京信息工程大学 A kind of intelligent blind-guiding crutch

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015196895A1 (en) * 2014-06-24 2015-12-30 陈凯柏 Lighting device controlled by image recognition system
WO2018093796A1 (en) * 2016-11-15 2018-05-24 Magic Leap, Inc. Deep learning system for cuboid detection
CN207575415U (en) * 2017-03-14 2018-07-06 南京信息工程大学 A kind of intelligent blind-guiding crutch

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112019960A (en) * 2019-05-28 2020-12-01 深圳市冠旭电子股份有限公司 Method for monitoring scenes by utilizing earphone, device and readable storage medium

Similar Documents

Publication Publication Date Title
US10963681B2 (en) Face concealment detection
WO2015169072A1 (en) Spectacles for blind person
CN107978051A (en) A kind of access control system and method based on recognition of face
CN107247945A (en) A kind of ward sufferer monitor system and monitoring method based on Kinect device
CN104127301A (en) Smart glasses for guiding blind person and guiding method thereof
CN110368275A (en) A kind of blind-guidance robot and blind guiding system, blind-guiding method
CN102848918A (en) Fatigue driving detection control system based on physiological signal collection and control method thereof
CN205432239U (en) If respiratory sensor's gauze mask and respiratory frequency monitored control system
CN208366352U (en) A kind of guide equipment
CN111938608A (en) AR (augmented reality) glasses, monitoring system and monitoring method for intelligent monitoring of old people
CN107038844A (en) One kind nurse robot
CN209405201U (en) A kind of intelligent apparatus of assisting blind navigation
CN109360374A (en) A kind of falling over of human body automatic early-warning system based on Internet of Things
CN106937909A (en) A kind of intelligent assisting blind glasses system
CN207182596U (en) One kind warning cyberdog
CN108355200A (en) A kind of novel and multifunctional intelligent infusion device of paediatrics
CN106618981A (en) Blind living assistant system based on Internet of things and blind crutch with the system
CN109527733A (en) A kind of intelligent crutch
CN104574749A (en) Wireless remote-monitoring anti-theft system
CN206757843U (en) A kind of wearable emergency alarm help facility
CN205507538U (en) Two -wheeled robot
CN205353491U (en) Eyeshield intelligence glasses
CN205268515U (en) Help capable ware system
CN104516485A (en) Glasses and mobile phone interaction system based on idea control
CN105639904A (en) Interactive protective walking stick for old people and control method thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190329