WO2024103469A1 - Intelligent walking stick navigation robot having walking aid function and daily carrying function - Google Patents

Intelligent walking stick navigation robot having walking aid function and daily carrying function Download PDF

Info

Publication number
WO2024103469A1
WO2024103469A1 PCT/CN2022/138188 CN2022138188W WO2024103469A1 WO 2024103469 A1 WO2024103469 A1 WO 2024103469A1 CN 2022138188 W CN2022138188 W CN 2022138188W WO 2024103469 A1 WO2024103469 A1 WO 2024103469A1
Authority
WO
WIPO (PCT)
Prior art keywords
robot
walking
walking stick
user
shopping basket
Prior art date
Application number
PCT/CN2022/138188
Other languages
French (fr)
Chinese (zh)
Inventor
王通
罗朝晖
尚鹏
苏栋楠
吴继鹏
曾梓琳
王俊伟
Original Assignee
深圳先进技术研究院
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳先进技术研究院 filed Critical 深圳先进技术研究院
Publication of WO2024103469A1 publication Critical patent/WO2024103469A1/en

Links

Classifications

    • AHUMAN NECESSITIES
    • A45HAND OR TRAVELLING ARTICLES
    • A45BWALKING STICKS; UMBRELLAS; LADIES' OR LIKE FANS
    • A45B1/00Sticks with supporting, hanging or carrying means
    • A45B1/02Walking sticks with rollers for carrying parcels or the like
    • AHUMAN NECESSITIES
    • A45HAND OR TRAVELLING ARTICLES
    • A45BWALKING STICKS; UMBRELLAS; LADIES' OR LIKE FANS
    • A45B9/00Details
    • AHUMAN NECESSITIES
    • A45HAND OR TRAVELLING ARTICLES
    • A45BWALKING STICKS; UMBRELLAS; LADIES' OR LIKE FANS
    • A45B9/00Details
    • A45B9/02Handles or heads

Definitions

  • the invention relates to an intelligent crutch-type walking-assisting and life-carrying navigation robot.
  • the elderly group has gradually become a group that cannot be ignored.
  • the elderly's guardianship, companionship, walking assistance, grocery shopping, medical treatment, medicine purchase and some daily life difficulties have become increasingly hot topics.
  • the body's functions weaken, and walking often requires the support of a cane, otherwise the elderly are likely to fall.
  • the elderly go out to buy groceries and shopping, their physical strength is limited, and now there are fewer and fewer salespeople working in shopping malls.
  • the present invention proposes an intelligent crutch-type walking-assisting and life-carrying navigation robot, which can guide the elderly to directly reach the destination for shopping, seeing a doctor, taking medicine, etc., and has a powered accompanying system carrying a shopping basket and an active guiding function.
  • an intelligent crutch-type walking-assisting and life-carrying navigation robot which is special in that:
  • It includes a retractable walking stick, a shopping basket and a motion chassis; the motion chassis is fixed to the lower part of the retractable walking stick, the shopping basket is arranged on the motion chassis, an openable cover is arranged above the shopping basket, a binocular depth camera is installed in front of the shopping basket to determine whether the destination has been reached; a laser radar is installed below the shopping basket camera to determine surrounding obstacles;
  • the upper part of the handle of the retractable cane is provided with a health monitoring module and an infrared temperature sensor, the lower part of the handle is provided with a bell button, and the handle is provided with a joystick and a display screen in front of the health monitoring module.
  • the joystick is used to manually operate the robot, and the display screen is used to display the health parameter data monitored by the health monitoring module and the infrared temperature sensor; a platform is provided on the upper part of the cane, on which an emergency stop button and a storage box are provided, and a blood oxygen sensor is installed under the storage box for collecting heart rate and blood oxygen data; a voice microphone is installed at the bottom of the platform; a speaker is provided on the upper part of the cane, and the speaker is used for ringing and voice broadcasting;
  • a control cabinet and multiple motors are provided on the motion chassis, the motor shafts are connected to rollers, and a control system is integrated in the control cabinet; the control system obtains data collected by the binocular depth camera, laser radar, health monitoring module, infrared temperature sensor, and blood oxygen sensor respectively, and the joystick controls the operation of the motor through the control system; the control system controls the robot according to the instructions obtained by the voice microphone.
  • control system includes modules such as stm32 data acquisition board, stm32 terminal control board, Raspberry Pi, 5G NBIOT, UWB wireless positioning, GPS module and drive control board; the motor is a power motor with a 500-line encoder.
  • the robot downloads offline maps through the Raspberry Pi's WIFI, relies on the GPS module for navigation, and relies on the point cloud data collected by the camera and radar for analysis on the Raspberry Pi. It can avoid obstacles in real time and adjust the planned route when encountering puddles or road breaks.
  • the robot When the robot arrives at a shopping mall or hospital, it can use the Raspberry Pi's WiFi to access the local LAN, obtain the approximate range of obstacles and destinations through the fingerprint method, and calculate the path using the Dijkstra algorithm. During operation, it continuously obtains point cloud information on the path through radar and cameras, and continuously provides feedback and revisions to the previous path. At the same time, it will determine the detailed information of the item through a network search based on the objects recognized by the camera on the path, mark the path, and save the latest path data as an offline map.
  • the robot obtains health parameters such as pulse, body temperature, heart rate, and blood oxygen measured by the health monitoring module (JFH11), infrared temperature sensor, and blood oxygen sensor through the stm32 data acquisition board, and then transmits them back to the server through the 5G NBIOT module.
  • the guardian and attending physician of the elderly can view the health status of the elderly in real time through the mobile phone APP.
  • the real-time images transmitted back by the camera can allow the guardian to clearly understand the environmental geographical information of the elderly in real time. If the health parameters exceed the normal value, an early warning will be issued, and the guardian and the elderly will be prompted and alarmed.
  • the speaker placed in the middle of the cane will be used to remind the elderly.
  • the elderly can use the bell button on the cane to send a signal to the STM32 terminal control board, so that the speaker will ring and remind people around.
  • the stm32 terminal control board of the robot is based on the MCU with CONTEXM4 as the core processor.
  • the onboard MPU6050 integrates a 6-axis motion processing component to obtain the three-axis speed and gyroscope information of the walker to obtain the walker posture information, and feedback the robot controller through TCP/IP communication to monitor the safety of the car posture, and then transmit it to the cloud server through the 5G NB ⁇ IOT communication module so that remote users can view the real-time situation.
  • the odometer information is sent to obtain the motion control instructions of the Raspberry Pi through the closed-loop position PID according to the real-time road conditions.
  • the stm32 terminal control board obtains the odometer information of the four drive motors through the PWM capture function, uses PI control to perform speed closed-loop control of the four servo motors, and outputs PWM waves to the drive control board through the MCU STM32F407 to control the motors.
  • the robot maintains the distance between the robot and the patient through ultra-wideband wireless communication technology (UWB).
  • UWB positioning system can update the location information in real time.
  • the elderly carry wireless tags to achieve real-time and accurate positioning of the elderly.
  • a dual closed-loop control method with angle and position separation is designed to ensure that the robot system follows the user's movement trend without causing obstacles to the user's movement.
  • ⁇ and ⁇ are designed to adjust the sensitivity of angle and distance control to prevent the steering and distance control from changing too quickly.
  • the height of the upper part and the lower part of the walking stick is adjusted by a spring button.
  • the shopping basket is provided with a partition in the middle, which divides the shopping basket into several spaces, so that items can be stored in a classified manner.
  • a cushion is provided on the upper surface of the cover plate above the shopping basket, and the elderly can sit on the cushion to rest; a hook is provided on the upper part of the retractable walking stick, and the shopping basket can be hung on the hook on the walking stick if there is not enough space in the shopping basket.
  • a concave structure with a depth of 10 cm is designed on the motion chassis and the shopping basket close to the human body.
  • the present invention proposes an intelligent crutch-type walking aid and life-carrying navigation robot, which combines the designs of a cane, a walking aid and a powered shopping basket, so that the robot can adapt to more complex application scenarios.
  • the present invention can adaptively follow the movement speeds of different elderly people, as well as the movements of elderly people with different levels of mental fatigue.
  • the present invention determines the health status of the elderly through health signals and provides a platform for the elderly to take a short rest.
  • the present invention can have both indoor and outdoor navigation modes.
  • the present invention analyzes real-time road conditions through cameras and radars, effectively avoiding obstacles in advance.
  • FIG. 1 is an overall structural diagram of an intelligent cane-type walking-assisting and life-carrying navigation robot according to an embodiment of the present invention
  • Fig. 2 is a coordination diagram of the control system
  • FIG3 is a diagram showing the relationship between the modules within the control system
  • FIG. 4 is a logic diagram of a UWB positioning system.
  • Some existing walkers or shopping carts for the elderly have a single function setting, and most of them rely on the elderly to give an active signal as a control signal to control the robot to move, while the robot itself does not have an active guidance function.
  • the elderly often get lost in complex environments such as shopping malls and hospitals, and cannot reach the shelves or departments they want to reach, wasting a lot of time and putting the elderly in a dangerous state.
  • the walking stick with health monitoring lacks power and stability.
  • the present invention combines health monitoring, walking assistance and automatic navigation shopping cart guidance, and reasonably coordinates the relationship between the various systems, so that the robot of the present invention can adapt to more complex application scenarios.
  • the present invention provides an intelligent crutch-type walking-aiding and life-carrying navigation robot, comprising a retractable cane, a shopping basket 1 and a motion chassis 2; the motion chassis 2 is fixed to the lower part of the retractable cane, the shopping basket 1 is arranged on the motion chassis 2, an openable and closable cover 3 is provided above the shopping basket 1, a camera 4 is installed in front of the shopping basket 1 to determine whether the destination has been reached; a radar 5 is installed below the camera 4 of the shopping basket 1 to determine surrounding obstacles.
  • a health monitoring module 6 JFH11
  • an infrared temperature sensor 7 are provided on the upper part of the handle of the retractable walking stick
  • a bell button 10 is provided on the lower part of the handle
  • a joystick 11 and a display screen 12 are provided on the handle in front of the health monitoring module 6.
  • the joystick 11 is used to manually operate the robot
  • the display screen 12 is used to display the health parameter data monitored by the health monitoring module 6 and the infrared temperature sensor 7.
  • a platform 13 is provided on the upper part 8 of the walking stick, and an emergency stop button 14 and a storage box 15 are provided on the platform 13.
  • the small object box can hold some small things, such as first aid medicine bottles, etc.
  • the emergency stop button 14 is used for emergency braking in emergency situations.
  • a blood oxygen sensor 16 is installed under the storage box 15 for collecting heart rate and blood oxygen data; a voice microphone 17 is installed at the bottom of the platform 13; a speaker 18 is provided on the upper part 8 of the cane, and the speaker 18 is used for ringing and voice broadcasting; a control cabinet 19 and multiple motors 20 are provided on the motion chassis 2, and the motor shafts are connected to rollers.
  • a control system is integrated in the control cabinet 19; the control system obtains data collected by the camera 4, radar 5, health monitoring module 6, infrared temperature sensor 7, and blood oxygen sensor 16 respectively, and the joystick 11 controls the operation of the motor 20 through the control system; the control system controls the robot according to the instructions obtained by the voice microphone 17.
  • the camera 4 is a binocular depth camera
  • the radar 5 is a laser radar, which integrates radar and visual point cloud data for obstacle avoidance control.
  • the laser radar and binocular depth camera complement each other to obtain a better obstacle avoidance effect.
  • the control system includes an stm32 data acquisition board, an stm32 terminal control board, a Raspberry Pi, a 5G NBIOT, a UWB wireless positioning, a GPS module and a drive control board, and four power motors with 500-line encoders are installed on the motion chassis.
  • the robot downloads offline maps through the WIFI interface of the Raspberry Pi, relies on the GPS module for navigation, and relies on the point cloud data collected by the camera 4 and the radar 5 for analysis on the Raspberry Pi.
  • it needs to obtain the user's consent before making the execution action, so that the motion command can be executed.
  • the real-time obstacle avoidance encounters puddles or road breaks, etc., and the planned route can be adjusted.
  • the robot When the robot comes to a shopping mall or hospital, it can use the WiFi of the Raspberry Pi to access the local LAN and obtain the indoor layout. If the elderly need to shop, they only need to say the goods they need to buy through the microphone. The robot can take the elderly to the destination through the indoor information of the shopping mall, and avoid obstacles through the binocular camera and laser radar installed on the shopping basket. Finally, the camera is used to identify whether the goods arriving at the destination are what the elderly need to buy. The robot obtains the approximate range of obstacles and the destination through the fingerprint method, and calculates the path using the Dijkstra algorithm. During the operation, the robot continuously obtains the point cloud information on the path through the radar 5 and the camera 4, and continuously feedbacks and revises the previous path.
  • the robot will determine the detailed information of the item through the network search based on the objects identified by the camera 4 on the path, and mark the path, and save the latest path data as an offline map. Relying on the fingerprint method to arrive near the destination, the robot still cannot obtain accurate destination information at this time.
  • the robot first relies on its own radar and camera to automatically search the path through RRT and move slowly in the area. This process is also a learning process for the robot.
  • the image information of the camera is matched with the received purpose instruction until the match is successful.
  • the elderly can be accurately taken to the department where the elderly are going to see a doctor. After the purchase, the robot will remind the elderly to put the items into the shopping cart.
  • the pressure detection module placed at the bottom of the shopping cart collects pressure data through the IO port of the Raspberry Pi.
  • it When leaving the mall to go to the next destination or go home, it will calculate the distance from the mall to home based on the weight of the items in the basket and the robot itself and the distance from the mall to home obtained by the GPS module. Then, according to the power supply voltage collected by the voltage acquisition module, the remaining power is calculated and an early warning is given to remind that charging is required. Generally, if the voltage is lower than 10v, the elderly will be reminded to charge.
  • the GPS sensor obtains the user's current latitude and longitude location information
  • the STM32 data acquisition board obtains the module information through the serial port and transmits it to the cloud server through the 5G NB ⁇ IOT communication module, effectively preventing users from getting lost and not being rescued when traveling alone. If there is someone in front of you during exercise, you can use the bell button on the cane to send a signal to the STM32 terminal control board, so that the speaker rings and reminds people around you.
  • the robot obtains the pulse, body temperature, heart rate, and blood oxygen health parameters measured by the health monitoring module 6, the infrared temperature sensor 7, and the blood oxygen sensor 16 through the stm32 data acquisition board, and then transmits them back to the server through the 5G NBIOT module.
  • the user's guardian and attending physician can view the user's health status in real time through the mobile phone APP.
  • the real-time picture transmitted back by the camera 4 allows the guardian to clearly understand the user's environmental geographical information in real time; if the health parameters exceed the normal value, an early warning will be issued, and the guardian and the user will be prompted and alarmed.
  • the user will be prompted by the speaker 18 placed in the middle of the cane.
  • the user can send a signal to the STM32 terminal control board through the ring button 10 on the cane, so that the speaker 18 rings to alert people around.
  • the health data acquisition board is equipped with stm32f103 as MCU for data collection and conversion.
  • the health detection module uses serial port transmission to obtain pulse signals, the infrared temperature measurement module obtains user temperature data through the I2C bus, the GPS location information is transmitted to the data acquisition board through the serial port, and then transmitted to the Raspberry Pi for navigation control.
  • the blood oxygen heart rate module is an integrated sensor that can simultaneously obtain heart rate, pulse oxygen saturation, blood perfusion index and other data through the serial port.
  • the data is packaged and transmitted to the cloud server through the 5G NB-IOT communication module, so that family members and attending doctors can understand the physical condition of the elderly in real time.
  • suggestions can be made to the elderly remotely, and the suggestions can be played to the elderly through the voice module.
  • a sudden change in physiological conditions is detected (heart rate rises, body temperature rises, etc.)
  • the robot starts the braking function, and the stm32 terminal control board reminds the elderly to rest through the voice module.
  • the stm32 terminal control board of the robot is a core processor of the MCU with CONTEXM4 as the core, and the onboard MPU6050 integrates a 6-axis motion processing component to obtain the three-axis speed and gyroscope information of the walker to obtain the walker posture information, and feedback the robot controller through TCP/IP communication to monitor the safety of the car posture, and then transmit it to the cloud server through the 5G NB ⁇ IOT communication module so that remote users can view the real-time situation; through the TCP/IP communication port, send the odometer information to obtain the motion control instructions of the Raspberry Pi through the closed-loop position PID according to the real-time road conditions; the stm32 terminal control board obtains the odometer information of the four drive motors 20 through the PWM capture function, uses PI control to perform speed closed-loop control on the four servo motors 20, and outputs PWM waves to the drive control board through the MCU STM32F407
  • the driver adopts the WSDC2412D high-current 12A/24V dual-channel DC brushed motor driver, which can output power up to 290W, providing power guarantee for driving servo control.
  • the four servo motors are M60 motors, with a 1:47 reducer added, and the output rated torque reaches 145.4 kg.cm, ensuring the mechanical power of the walking aid system.
  • PI closed-loop control effectively avoids the stability of the walking aid, preventing the walker from flying and slipping.
  • the user can control the forward, backward, left and right turns of the walking aid system through the joystick.
  • the control board collects the joystick control data through the AD channel to determine the user's movement intention and send out a PWM drive signal.
  • a voice control function is set on the terminal control board. When the user speaks the corresponding command (forward, backward, left turn, right turn, stop, etc.), the walking aid system will also generate PWM waves to drive the servo motor to move.
  • the distance and angle between the robot and the elderly are determined by the UWB wireless positioning module, the position and angle between the robot and the elderly are set, and the PID control is used to maintain a stable distance and angle during the robot's movement, and to perform stable following and navigation control.
  • the robot uses the ultra-wideband wireless communication technology UWB to maintain the distance between the robot and the patient.
  • the UWB positioning system can update the location information in real time.
  • the elderly carry a wireless tag to achieve real-time and accurate positioning of the elderly.
  • a dual closed-loop control method with angle and position separation is designed to ensure that the robot system follows the movement trend of the elderly, and at the same time, it will not cause obstacles to the user's movement.
  • ⁇ and ⁇ are designed to adjust the sensitivity of angle and distance control to prevent steering and distance control from changing too quickly.
  • the upper part 8 of the cane is sleeved with the lower part 9 of the cane.
  • the upper part 8 of the cane is sleeved into the lower part 9 of the cane, and through holes 24 are provided at corresponding positions of the two.
  • the spring button 21 is provided in the through hole 24 of the lower part 9 of the cane. After adjusting to a suitable height, the through holes 24 of the two overlap, and the front end of the spring button 21 extends out of the through hole of the upper part 8 of the cane to complete the height adjustment.
  • the shopping basket 1 is provided with a partition 22 in the middle to divide the shopping basket 1 into several spaces, so that items can be stored in a classified manner.
  • a cushion is provided on the upper surface of the cover plate 3 above the shopping basket 1, and the user can sit on the cushion to rest;
  • a hook 23 is provided on the upper part of the retractable walking stick, and if there is not enough space in the shopping basket 1, the walking stick can be hung on the hook 23 on the walking stick.
  • a concave structure with a depth of 10 cm is designed near the human body of the motion chassis 2 and the shopping basket 1, and the two sides of the concave structure are chamfered at 45 degrees.

Landscapes

  • Rehabilitation Tools (AREA)

Abstract

An intelligent walking stick navigation robot having a walking aid function and a daily carrying function, comprising a telescopic walking stick, a basket (1), and a moving chassis (2). The moving chassis (2) is fixed to the lower portion of the telescopic walking stick; the basket (1) is arranged on the moving chassis (2); a camera (4) and a radar (5) are mounted on the basket (1); a control cabinet (19) and a plurality of motors (20) are arranged on the moving chassis (2); motor shafts are connected to rollers; and a control system is integrated in the control cabinet (19). The control system acquires data collected by the camera (4), the radar (5), a health monitoring module (6), an infrared temperature sensor (7), and a blood oxygen sensor (16), respectively. A rocker (11) controls the operations of the motors (20) by means of the control system. The control system controls the robot according to an instruction acquired by a voice microphone (17). For scenes where the elderly go shopping, see a doctor, pick up medicine, etc., the intelligent walking stick navigation robot having a walking aid function and a daily carrying function can guide the elderly directly to a destination, and thus has an active guiding function.

Description

一种智能拐杖式助行、生活载物导航机器人An intelligent walking-assisting and life-carrying navigation robot with a cane 技术领域Technical Field
本发明涉及一种智能拐杖式助行、生活载物导航机器人。The invention relates to an intelligent crutch-type walking-assisting and life-carrying navigation robot.
背景技术Background technique
老人群体逐渐成为一个不可忽视的群体,老人的监护、陪伴、助行、买菜、看病、买药与在日常生活的一些日常生活所遇到的困难日益成为了热点。首先人体在衰老后,机体功能减弱,行走常常需要手杖支撑,否则老人很容易跌倒。其次老人外出买菜、购物时,体力有限,并且现在商场工作售货员日益减少,面对偌大的商场、菜市场、医院等,老人购物、看病、买菜等如何准确地到达目的地,引导老人到达心中的目的地(或商场超市货架、医院科室),减少体力支出,也俨然成为了一个问题;当购买了商场生活用品、食物、药瓶等,老人用手提取比较耗费体力,并且较为危险;同时老人视力会明显下降,行走避开障碍物也尤为重要。The elderly group has gradually become a group that cannot be ignored. The elderly's guardianship, companionship, walking assistance, grocery shopping, medical treatment, medicine purchase and some daily life difficulties have become increasingly hot topics. First of all, after aging, the body's functions weaken, and walking often requires the support of a cane, otherwise the elderly are likely to fall. Secondly, when the elderly go out to buy groceries and shopping, their physical strength is limited, and now there are fewer and fewer salespeople working in shopping malls. Faced with large shopping malls, vegetable markets, hospitals, etc., how to accurately reach the destination for shopping, medical treatment, and buying groceries for the elderly, and guide the elderly to the destination in their hearts (or shopping mall supermarket shelves, hospital departments), and reduce physical expenditure, has also become a problem; when buying daily necessities, food, medicine bottles, etc. in the mall, the elderly use their hands to extract them, which is more physically demanding and dangerous; at the same time, the elderly's eyesight will be significantly reduced, and it is also particularly important to avoid obstacles when walking.
技术问题technical problem
本发明提出一种智能拐杖式助行、生活载物导航机器人,针对老人购物、看病、取药等场景,可以引导老人直接到达目的地,并携带购物篮的具有动力伴行系统,具有主动引导功能。The present invention proposes an intelligent crutch-type walking-assisting and life-carrying navigation robot, which can guide the elderly to directly reach the destination for shopping, seeing a doctor, taking medicine, etc., and has a powered accompanying system carrying a shopping basket and an active guiding function.
技术解决方案Technical Solutions
本发明解决上述问题的技术方案是:一种智能拐杖式助行、生活载物导航机器人,其特殊之处在于:The technical solution of the present invention to solve the above problems is: an intelligent crutch-type walking-assisting and life-carrying navigation robot, which is special in that:
包括可伸缩手杖、购物篮和运动底盘;运动底盘与可伸缩手杖的下部固定,购物篮设置在运动底盘上,购物篮上方设有可以开合的盖板,在购物篮的前方安装有双目深度摄像头,用来实现判断是否到达了目的地;在购物篮摄像头下方安装有激光雷达,用来判断周围的障碍物;It includes a retractable walking stick, a shopping basket and a motion chassis; the motion chassis is fixed to the lower part of the retractable walking stick, the shopping basket is arranged on the motion chassis, an openable cover is arranged above the shopping basket, a binocular depth camera is installed in front of the shopping basket to determine whether the destination has been reached; a laser radar is installed below the shopping basket camera to determine surrounding obstacles;
可伸缩手杖的手柄上部设有健康监测模块与红外温度传感器,手柄下部设有响铃按钮,手柄上位于健康监测模块的前方设有摇杆与显示屏,摇杆用于手动操作机器人运行,显示屏用于显示健康监测模块与红外温度传感器监测是健康参数数据;在手杖上部设置一个平台,该平台上设置急停按钮与收纳盒,在收纳盒下面安装有血氧传感器,用于采集心率与血氧数据;平台底部安装有语音麦克风;手杖上部设有喇叭,喇叭用于响铃与语音播报;The upper part of the handle of the retractable cane is provided with a health monitoring module and an infrared temperature sensor, the lower part of the handle is provided with a bell button, and the handle is provided with a joystick and a display screen in front of the health monitoring module. The joystick is used to manually operate the robot, and the display screen is used to display the health parameter data monitored by the health monitoring module and the infrared temperature sensor; a platform is provided on the upper part of the cane, on which an emergency stop button and a storage box are provided, and a blood oxygen sensor is installed under the storage box for collecting heart rate and blood oxygen data; a voice microphone is installed at the bottom of the platform; a speaker is provided on the upper part of the cane, and the speaker is used for ringing and voice broadcasting;
所述运动底盘上设有控制柜和多个电机,电机轴连接滚轮,控制柜中集成了控制系统;控制系统分别获取双目深度摄像头、激光雷达、健康监测模块、红外温度传感器、血氧传感器采集的数据,摇杆通过控制系统来控制电机的运行;控制系统根据语音麦克风获取的指令对机器人进行控制。A control cabinet and multiple motors are provided on the motion chassis, the motor shafts are connected to rollers, and a control system is integrated in the control cabinet; the control system obtains data collected by the binocular depth camera, laser radar, health monitoring module, infrared temperature sensor, and blood oxygen sensor respectively, and the joystick controls the operation of the motor through the control system; the control system controls the robot according to the instructions obtained by the voice microphone.
进一步地,上述控制系统包括stm32数据采集板、stm32末端控制板、树莓派、5G NBIOT、UWB无线定位、GPS模块与驱动控制板等模块;电机为带有500线编码器的动力电机。Furthermore, the above-mentioned control system includes modules such as stm32 data acquisition board, stm32 terminal control board, Raspberry Pi, 5G NBIOT, UWB wireless positioning, GPS module and drive control board; the motor is a power motor with a 500-line encoder.
进一步地,上述机器人通过树莓派的WIFI下载离线地图,依靠GPS模块进行导航,同时依靠摄像头与雷达采集回来的点云数据,在树莓派上面进行分析,实时避障遇到水坑或则断路等情况,即可调整规划路线。Furthermore, the robot downloads offline maps through the Raspberry Pi's WIFI, relies on the GPS module for navigation, and relies on the point cloud data collected by the camera and radar for analysis on the Raspberry Pi. It can avoid obstacles in real time and adjust the planned route when encountering puddles or road breaks.
当机器人来到商场或者医院等地,机器人可利用树莓派的WiFi接入当地得局域网内,通过指纹法,获得障碍物以及目的地的大致范围,利用dijkstra算法计出路径,在运行过程中不断的通过雷达与摄像头获取路径上的点云信息,不断对之前的路径进行反馈修订,同时会根据摄像头在路径上识别的事物通过网络搜索确定该物品的详细信息,并且在该路径上打标记,并将最新路径数据存为离线地图。When the robot arrives at a shopping mall or hospital, it can use the Raspberry Pi's WiFi to access the local LAN, obtain the approximate range of obstacles and destinations through the fingerprint method, and calculate the path using the Dijkstra algorithm. During operation, it continuously obtains point cloud information on the path through radar and cameras, and continuously provides feedback and revisions to the previous path. At the same time, it will determine the detailed information of the item through a network search based on the objects recognized by the camera on the path, mark the path, and save the latest path data as an offline map.
进一步地,上述机器人通过stm32数据采集板获取健康监测模块(JFH11)、红外温度传感器与血氧传感器测得的脉搏、体温、心率、血氧等健康参数,再通过5G NBIOT模块传回服务器,老人的监护人与主治医生就可通过手机端APP实时查看老人的健康状况,同时通过摄像头传回的实时画面可让监护人实时清楚老人所处的环境地理信息。如果健康参数超出正常值就会进行预警,并对监护人与老人进行提示报警,通过放置手杖中部的喇叭向老人提示,老人可通过手杖上的响铃按钮进行对STM32末端控制板发出信号,使喇叭发出铃声,提示周围的人。Furthermore, the robot obtains health parameters such as pulse, body temperature, heart rate, and blood oxygen measured by the health monitoring module (JFH11), infrared temperature sensor, and blood oxygen sensor through the stm32 data acquisition board, and then transmits them back to the server through the 5G NBIOT module. The guardian and attending physician of the elderly can view the health status of the elderly in real time through the mobile phone APP. At the same time, the real-time images transmitted back by the camera can allow the guardian to clearly understand the environmental geographical information of the elderly in real time. If the health parameters exceed the normal value, an early warning will be issued, and the guardian and the elderly will be prompted and alarmed. The speaker placed in the middle of the cane will be used to remind the elderly. The elderly can use the bell button on the cane to send a signal to the STM32 terminal control board, so that the speaker will ring and remind people around.
进一步地,上述机器人的stm32末端控制板是由CONTEXM4为内核的MCU为核心处理器,板载MPU6050整合6轴运动处理组件,获取助行器的三轴速度与陀螺仪信息,以获得助行器姿态信息,通过TCP/IP通信反馈机器人控制器进行小车姿态安全监测,进而通过5G NB‑IOT通信模块传递到云端服务器,以便远程端用户查看实时情况。通过TCP/IP通信端口,发送里程计信息,获取由树莓派根据实时路况经过闭环位置PID的运动控制指令。stm32末端控制板是通过PWM捕获功能获得四个驱动电机的里程计信息,利用PI控制对四个伺服电机进行速度闭环控制,通过MCU STM32F407输出PWM波到驱动控制板上,进而控制电机。Furthermore, the stm32 terminal control board of the robot is based on the MCU with CONTEXM4 as the core processor. The onboard MPU6050 integrates a 6-axis motion processing component to obtain the three-axis speed and gyroscope information of the walker to obtain the walker posture information, and feedback the robot controller through TCP/IP communication to monitor the safety of the car posture, and then transmit it to the cloud server through the 5G NB‑IOT communication module so that remote users can view the real-time situation. Through the TCP/IP communication port, the odometer information is sent to obtain the motion control instructions of the Raspberry Pi through the closed-loop position PID according to the real-time road conditions. The stm32 terminal control board obtains the odometer information of the four drive motors through the PWM capture function, uses PI control to perform speed closed-loop control of the four servo motors, and outputs PWM waves to the drive control board through the MCU STM32F407 to control the motors.
进一步地,上述机器人通过超宽带无线通信技术(UWB)使机器人与患者的间距保持,UWB定位系统可实时更新位置信息,老人携带无线标签,实现老人的实时精确定位。获得数据后,设计了角度与位置分离双闭环控制方式,以确保机器人系统跟随用户的运动趋势,同时也不会对用户的运动造成障碍,同时设计了α、β对角度与距离控制灵敏度进行调节,防止转向以及距离控制过快变化。Furthermore, the robot maintains the distance between the robot and the patient through ultra-wideband wireless communication technology (UWB). The UWB positioning system can update the location information in real time. The elderly carry wireless tags to achieve real-time and accurate positioning of the elderly. After obtaining the data, a dual closed-loop control method with angle and position separation is designed to ensure that the robot system follows the user's movement trend without causing obstacles to the user's movement. At the same time, α and β are designed to adjust the sensitivity of angle and distance control to prevent the steering and distance control from changing too quickly.
进一步地,上述手杖上部与手杖下部通过弹簧按钮的形式进行调整高度。Furthermore, the height of the upper part and the lower part of the walking stick is adjusted by a spring button.
进一步地,上述购物篮中间带有隔板,将购物篮分为若干空间,可以实现物品分类存放。Furthermore, the shopping basket is provided with a partition in the middle, which divides the shopping basket into several spaces, so that items can be stored in a classified manner.
进一步地,上述购物篮上方的盖板上表面设有软垫,老人可以坐在软垫上休息;可伸缩手杖的上部设有挂钩,购物篮中空间不够还可挂在手杖的上的挂钩上。Furthermore, a cushion is provided on the upper surface of the cover plate above the shopping basket, and the elderly can sit on the cushion to rest; a hook is provided on the upper part of the retractable walking stick, and the shopping basket can be hung on the hook on the walking stick if there is not enough space in the shopping basket.
进一步地,为了避免机器人作为一个手杖功能不对老人行走形成障碍,在运动底盘和购物篮靠近人体部分设计深度10cm的凹形结构。Furthermore, in order to prevent the robot from acting as a walking stick and causing obstacles to the elderly's walking, a concave structure with a depth of 10 cm is designed on the motion chassis and the shopping basket close to the human body.
有益效果Beneficial Effects
本发明的优点:Advantages of the present invention:
1、本发明提出一种智能拐杖式助行、生活载物导航机器人,结合了手杖、助行与动力购物篮的设计,使该机器人可以适应更为复杂的应用场景。1. The present invention proposes an intelligent crutch-type walking aid and life-carrying navigation robot, which combines the designs of a cane, a walking aid and a powered shopping basket, so that the robot can adapt to more complex application scenarios.
2、本发明可自适应跟随不同老人的运动速度,以及老人在不同疲脑程度的运动。2. The present invention can adaptively follow the movement speeds of different elderly people, as well as the movements of elderly people with different levels of mental fatigue.
3、本发明通过健康信号进行判定老人的健康状态,提供了老人短暂休息的平台。3. The present invention determines the health status of the elderly through health signals and provides a platform for the elderly to take a short rest.
4、本发明可同时拥有室内与室外导航两种方式。4. The present invention can have both indoor and outdoor navigation modes.
5、本发明通过摄像头、雷达对实时路况进行分析,有效提前规避了障碍物。5. The present invention analyzes real-time road conditions through cameras and radars, effectively avoiding obstacles in advance.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1是本发明实施例中智能拐杖式助行、生活载物导航机器人的整体结构图;1 is an overall structural diagram of an intelligent cane-type walking-assisting and life-carrying navigation robot according to an embodiment of the present invention;
图2是控制系统的配合图;Fig. 2 is a coordination diagram of the control system;
图3是控制系统内部各模块的关系图;FIG3 is a diagram showing the relationship between the modules within the control system;
图4是UWB定位系统的逻辑图。FIG. 4 is a logic diagram of a UWB positioning system.
图中所示:As shown in the figure:
1-购物篮;2-运动底盘;3-盖板;4-摄像头;5-雷达;6-健康监测模块;7-红外温度传感器;8-手杖上部;9-手杖下部;10-响铃按钮;11-摇杆;12-显示屏;13-平台;14-急停按钮;15-收纳盒;16-血氧传感器;17-语音麦克风;18-喇叭;19-控制柜;20-电机;21-弹簧按钮;22-隔板;23-挂钩;24-通孔。1-shopping basket; 2-sports chassis; 3-cover; 4-camera; 5-radar; 6-health monitoring module; 7-infrared temperature sensor; 8-upper part of the cane; 9-lower part of the cane; 10-ring button; 11-joystick; 12-display screen; 13-platform; 14-emergency stop button; 15-storage box; 16-blood oxygen sensor; 17-voice microphone; 18-speaker; 19-control cabinet; 20-motor; 21-spring button; 22-partition; 23-hook; 24-through hole.
本发明的实施方式Embodiments of the present invention
为使本发明实施方式的目的、技术方案和优点更加清楚,下面将结合本发明实施方式中的附图,对本发明实施方式中的技术方案进行清楚、完整地描述,显然,所描述的实施方式是本发明一部分实施方式,而不是全部的实施方式。基于本发明中的实施方式,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施方式,都属于本发明保护的范围。因此,以下对在附图中提供的本发明的实施方式的详细描述并非旨在限制要求保护的本发明的范围,而是仅仅表示本发明的选定实施方式。In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention. Therefore, the following detailed description of the embodiments of the present invention provided in the drawings is not intended to limit the scope of the invention claimed for protection, but merely represents selected embodiments of the present invention.
现有一些助行器或者老人购物车功能设置单一,大多依靠老人给一个主动的信号,作为控制信号来控制机器人进行运动,而机器人本身不具有主动引导功能。导致老人常常在商场、医院等复杂环境内迷路,无法到达想要到达的货架或科室,浪费很多时间并且让老人处于一种危险的状态。为防止老人在这种情况下和日常生活中不清楚自身的身体状况,且设有健康监护的手杖缺乏动力与稳定性。本发明结合健康监测、助行与自动导航购物车引导,合理协调了各个系统的关系,使得本发明的机器人可以适应更为复杂的应用场景。Some existing walkers or shopping carts for the elderly have a single function setting, and most of them rely on the elderly to give an active signal as a control signal to control the robot to move, while the robot itself does not have an active guidance function. As a result, the elderly often get lost in complex environments such as shopping malls and hospitals, and cannot reach the shelves or departments they want to reach, wasting a lot of time and putting the elderly in a dangerous state. In order to prevent the elderly from being unclear about their own physical conditions in this situation and in daily life, and the walking stick with health monitoring lacks power and stability. The present invention combines health monitoring, walking assistance and automatic navigation shopping cart guidance, and reasonably coordinates the relationship between the various systems, so that the robot of the present invention can adapt to more complex application scenarios.
参见图1,本发明提出一种智能拐杖式助行、生活载物导航机器人,包括可伸缩手杖、购物篮1和运动底盘2;运动底盘2与可伸缩手杖的下部固定,购物篮1设置在运动底盘2上,购物篮1上方设有可以开合的盖板3,在购物篮1的前方安装有摄像头4,用来实现判断是否到达了目的地;在购物篮1摄像头4下方安装有雷达5,用来判断周围的障碍物。可伸缩手杖的手柄上部设有健康监测模块6(JFH11)与红外温度传感器7,手柄下部设有响铃按钮10,手柄上位于健康监测模块6的前方设有摇杆11与显示屏12,摇杆11用于手动操作机器人运行,显示屏12用于显示健康监测模块6与红外温度传感器7监测是健康参数数据;在手杖上部8设置一个平台13,该平台13上设置急停按钮14与收纳盒15,小物件盒子可放一些小东西,如急救药瓶等,急停按钮14用紧急情况,紧急制动。在收纳盒15下面安装有血氧传感器16,用于采集心率与血氧数据;平台13底部安装有语音麦克风17;手杖上部8设有喇叭18,喇叭18用于响铃与语音播报;所述运动底盘2上设有控制柜19和多个电机20,电机轴连接滚轮,控制柜19中集成了控制系统;控制系统分别获取摄像头4、雷达5、健康监测模块6、红外温度传感器7、血氧传感器16采集的数据,摇杆11通过控制系统来控制电机20的运行;控制系统根据语音麦克风17获取的指令对机器人进行控制。Referring to Fig. 1, the present invention provides an intelligent crutch-type walking-aiding and life-carrying navigation robot, comprising a retractable cane, a shopping basket 1 and a motion chassis 2; the motion chassis 2 is fixed to the lower part of the retractable cane, the shopping basket 1 is arranged on the motion chassis 2, an openable and closable cover 3 is provided above the shopping basket 1, a camera 4 is installed in front of the shopping basket 1 to determine whether the destination has been reached; a radar 5 is installed below the camera 4 of the shopping basket 1 to determine surrounding obstacles. A health monitoring module 6 (JFH11) and an infrared temperature sensor 7 are provided on the upper part of the handle of the retractable walking stick, a bell button 10 is provided on the lower part of the handle, and a joystick 11 and a display screen 12 are provided on the handle in front of the health monitoring module 6. The joystick 11 is used to manually operate the robot, and the display screen 12 is used to display the health parameter data monitored by the health monitoring module 6 and the infrared temperature sensor 7. A platform 13 is provided on the upper part 8 of the walking stick, and an emergency stop button 14 and a storage box 15 are provided on the platform 13. The small object box can hold some small things, such as first aid medicine bottles, etc. The emergency stop button 14 is used for emergency braking in emergency situations. A blood oxygen sensor 16 is installed under the storage box 15 for collecting heart rate and blood oxygen data; a voice microphone 17 is installed at the bottom of the platform 13; a speaker 18 is provided on the upper part 8 of the cane, and the speaker 18 is used for ringing and voice broadcasting; a control cabinet 19 and multiple motors 20 are provided on the motion chassis 2, and the motor shafts are connected to rollers. A control system is integrated in the control cabinet 19; the control system obtains data collected by the camera 4, radar 5, health monitoring module 6, infrared temperature sensor 7, and blood oxygen sensor 16 respectively, and the joystick 11 controls the operation of the motor 20 through the control system; the control system controls the robot according to the instructions obtained by the voice microphone 17.
作为本发明的一个优选实施例,摄像头4为双目深度摄像头,雷达5为激光雷达,融合了雷达与视觉点云数据进行避障控制。激光雷达与双目深度摄像头优势互补,以获得更加的避障效果。As a preferred embodiment of the present invention, the camera 4 is a binocular depth camera, and the radar 5 is a laser radar, which integrates radar and visual point cloud data for obstacle avoidance control. The laser radar and binocular depth camera complement each other to obtain a better obstacle avoidance effect.
作为本发明的一个优选实施例,参见图3,所述控制系统包括stm32数据采集板、stm32末端控制板、树莓派、5G NBIOT、UWB无线定位、GPS模块与驱动控制板,在运动底盘上安装了四个带有500线编码器的动力电机。As a preferred embodiment of the present invention, referring to FIG3 , the control system includes an stm32 data acquisition board, an stm32 terminal control board, a Raspberry Pi, a 5G NBIOT, a UWB wireless positioning, a GPS module and a drive control board, and four power motors with 500-line encoders are installed on the motion chassis.
具体地,参见图3,所述机器人通过树莓派的WIFI接口下载离线地图,依靠GPS模块进行导航,同时依靠摄像头4与雷达5采集回来的点云数据,在树莓派上面进行分析,考虑到机器人的第一性原则,在做出执行动作前需要争得使用者得同意,才能够执行运动命令。为避免地图上面路标信息未能及时得更新,实时避障遇到水坑或则断路等情况,即可调整规划路线。Specifically, referring to FIG3 , the robot downloads offline maps through the WIFI interface of the Raspberry Pi, relies on the GPS module for navigation, and relies on the point cloud data collected by the camera 4 and the radar 5 for analysis on the Raspberry Pi. Considering the first principle of the robot, it needs to obtain the user's consent before making the execution action, so that the motion command can be executed. In order to avoid the failure to update the road sign information on the map in time, the real-time obstacle avoidance encounters puddles or road breaks, etc., and the planned route can be adjusted.
当机器人来到商场或者医院,机器人可利用树莓派的WiFi接入当地得局域网,获取室内布局,如老人需要购物,只要通过麦克风说出自己所需要购买的商品,机器人就可通过商场室内信息将老人带到目的地,同时通过安装在购物篮上的双目摄像头与激光雷达进行避障。最后,通过摄像头进行识别到达目的地的商品是不是老人需要购买的。机器人通过指纹法,获得障碍物以及目的地的大致范围,利用dijkstra算法计出路径,在运行过程中不断的通过雷达5与摄像头4获取路径上的点云信息,不断对之前的路径进行反馈修订,同时会根据摄像头4在路径上识别的事物通过网络搜索确定该物品的详细信息,并且在该路径上打标记,并将最新路径数据存为离线地图。依靠指纹法来到目的地附近,此时依然不能获取准确的目的地信息,机器人首先依靠自身雷达与摄像头通过RRT自动搜索路径,在该区域内缓慢移动,在此过程中也属于机器人的学习过程。利用摄像头的图像信息与接受的目的指令进行匹配直至匹配成功。在医院内,则能够将老人准确的带到老人要去的科室看病。购买完了还会提醒老人将物品放进购物篮内。购物篮底部放置的压力检测模块,通过树莓派的IO口采集压力数据,当离开商场前往下一目的地或者回家,将会根据篮子内物品与机器人本身的重量与GPS模块获取的商场回家的距离进行计算,然后根据电压采集模块采集回来的电源电压,计算剩余电量进行计算预警,提示需要充电。一般情况下电压低于10v就会提醒老人进行充电。GPS传感器获取用户当前的经纬度位置信息,由STM32数据采集板通过串口获取模块的信息,并通过5G NB‑IOT通信模块传递到云端服务器,有效防止用户独自出行出现迷路而得不到救援情况的发生。在运动过程中遇到前方有人,可通过手杖上的响铃按钮进行对STM32末端控制板发出信号,使喇叭发出铃声,提示周围的人。When the robot comes to a shopping mall or hospital, it can use the WiFi of the Raspberry Pi to access the local LAN and obtain the indoor layout. If the elderly need to shop, they only need to say the goods they need to buy through the microphone. The robot can take the elderly to the destination through the indoor information of the shopping mall, and avoid obstacles through the binocular camera and laser radar installed on the shopping basket. Finally, the camera is used to identify whether the goods arriving at the destination are what the elderly need to buy. The robot obtains the approximate range of obstacles and the destination through the fingerprint method, and calculates the path using the Dijkstra algorithm. During the operation, the robot continuously obtains the point cloud information on the path through the radar 5 and the camera 4, and continuously feedbacks and revises the previous path. At the same time, it will determine the detailed information of the item through the network search based on the objects identified by the camera 4 on the path, and mark the path, and save the latest path data as an offline map. Relying on the fingerprint method to arrive near the destination, the robot still cannot obtain accurate destination information at this time. The robot first relies on its own radar and camera to automatically search the path through RRT and move slowly in the area. This process is also a learning process for the robot. The image information of the camera is matched with the received purpose instruction until the match is successful. In the hospital, the elderly can be accurately taken to the department where the elderly are going to see a doctor. After the purchase, the robot will remind the elderly to put the items into the shopping cart. The pressure detection module placed at the bottom of the shopping cart collects pressure data through the IO port of the Raspberry Pi. When leaving the mall to go to the next destination or go home, it will calculate the distance from the mall to home based on the weight of the items in the basket and the robot itself and the distance from the mall to home obtained by the GPS module. Then, according to the power supply voltage collected by the voltage acquisition module, the remaining power is calculated and an early warning is given to remind that charging is required. Generally, if the voltage is lower than 10v, the elderly will be reminded to charge. The GPS sensor obtains the user's current latitude and longitude location information, and the STM32 data acquisition board obtains the module information through the serial port and transmits it to the cloud server through the 5G NB‑IOT communication module, effectively preventing users from getting lost and not being rescued when traveling alone. If there is someone in front of you during exercise, you can use the bell button on the cane to send a signal to the STM32 terminal control board, so that the speaker rings and reminds people around you.
具体地,参见图3,所述机器人通过stm32数据采集板获取健康监测模块6、红外温度传感器7与血氧传感器16测得的脉搏、体温、心率、血氧健康参数,再通过5G NBIOT模块传回服务器,用户的监护人与主治医生就可通过手机端APP实时查看用户的健康状况,同时通过摄像头4传回的实时画面可让监护人实时清楚用户所处的环境地理信息;如果健康参数超出正常值就会进行预警,并对监护人与用户进行提示报警,通过放置手杖中部的喇叭18向用户提示,用户可通过手杖上的响铃按钮10进行对STM32末端控制板发出信号,使喇叭18发出铃声,提示周围的人。Specifically, referring to Figure 3, the robot obtains the pulse, body temperature, heart rate, and blood oxygen health parameters measured by the health monitoring module 6, the infrared temperature sensor 7, and the blood oxygen sensor 16 through the stm32 data acquisition board, and then transmits them back to the server through the 5G NBIOT module. The user's guardian and attending physician can view the user's health status in real time through the mobile phone APP. At the same time, the real-time picture transmitted back by the camera 4 allows the guardian to clearly understand the user's environmental geographical information in real time; if the health parameters exceed the normal value, an early warning will be issued, and the guardian and the user will be prompted and alarmed. The user will be prompted by the speaker 18 placed in the middle of the cane. The user can send a signal to the STM32 terminal control board through the ring button 10 on the cane, so that the speaker 18 rings to alert people around.
该部分完成用户生理健康数据的采集与上传,实现健康信号监测并进行预警。健康数据采集板搭载stm32f103为MCU进行数据采集以及转换。具有健康检测模块使用串口传输,获取脉搏信号,红外测温模块通过I2C总线获取用户体温数据,GPS位置信息通过串口传递到数据采集板,传递到树莓派上进而进行导航控制,血氧心率模块是一个集成的传感器可通过串口同时获得心率、脉搏血氧饱和度、血流灌注指数等数据。将数据打包通过5G NB‑IOT通信模块传递到云端服务器,以家人与主治医生实时了解老人的身体情况。同时可向老人远程提出建议,通过语音模块进行播放建议给老人。当检测到生理状况出现陡变(心率上升高、体温上升等),机器人启动制动功能,stm32末端控制板通过语音模块提醒老人休息。This part completes the collection and upload of the user's physiological health data, realizes health signal monitoring and early warning. The health data acquisition board is equipped with stm32f103 as MCU for data collection and conversion. The health detection module uses serial port transmission to obtain pulse signals, the infrared temperature measurement module obtains user temperature data through the I2C bus, the GPS location information is transmitted to the data acquisition board through the serial port, and then transmitted to the Raspberry Pi for navigation control. The blood oxygen heart rate module is an integrated sensor that can simultaneously obtain heart rate, pulse oxygen saturation, blood perfusion index and other data through the serial port. The data is packaged and transmitted to the cloud server through the 5G NB-IOT communication module, so that family members and attending doctors can understand the physical condition of the elderly in real time. At the same time, suggestions can be made to the elderly remotely, and the suggestions can be played to the elderly through the voice module. When a sudden change in physiological conditions is detected (heart rate rises, body temperature rises, etc.), the robot starts the braking function, and the stm32 terminal control board reminds the elderly to rest through the voice module.
具体地,参见图3,所述机器人的stm32末端控制板是由CONTEXM4为内核的MCU为核心处理器,板载MPU6050整合6轴运动处理组件,获取助行器的三轴速度与陀螺仪信息,以获得助行器姿态信息,通过TCP/IP通信反馈机器人控制器进行小车姿态安全监测,进而通过5G NB‑IOT通信模块传递到云端服务器,以便远程端用户查看实时情况;通过TCP/IP通信端口,发送里程计信息,获取由树莓派根据实时路况经过闭环位置PID的运动控制指令;stm32末端控制板是通过PWM捕获功能获得四个驱动电机20的里程计信息,利用PI控制对四个伺服电机20进行速度闭环控制,通过MCU STM32F407输出PWM波到驱动控制板上,进而控制电机20。驱动器采用WSDC2412D的大电流12A/24V 双通道直流有刷电机驱动器,可输出功率达到290W,为驱动伺服控制提供了动力的保障。四个伺服电机选用M60电机,添加1:47的减速器,输出额定扭矩达到145.4 kg.cm, 保证了助行系统的机械动力。PI闭环控制有效避免了助行的稳定性,防止助行器飞车的同时防止了溜车的现象发生。用户可通过摇杆进行控制助行系统的前进、后退、左转和右转等操作,控制板通过AD通道采集摇杆控制数据,以判断用户的运动意图,发出PWM驱动信号。同时在末端控制板上设置了语音控制功能,当用户说出相应的指令(前进、后退、左转、右转、停止等),助行系统也会产生PWM波进而驱动伺服电机运动。Specifically, referring to FIG3 , the stm32 terminal control board of the robot is a core processor of the MCU with CONTEXM4 as the core, and the onboard MPU6050 integrates a 6-axis motion processing component to obtain the three-axis speed and gyroscope information of the walker to obtain the walker posture information, and feedback the robot controller through TCP/IP communication to monitor the safety of the car posture, and then transmit it to the cloud server through the 5G NB‑IOT communication module so that remote users can view the real-time situation; through the TCP/IP communication port, send the odometer information to obtain the motion control instructions of the Raspberry Pi through the closed-loop position PID according to the real-time road conditions; the stm32 terminal control board obtains the odometer information of the four drive motors 20 through the PWM capture function, uses PI control to perform speed closed-loop control on the four servo motors 20, and outputs PWM waves to the drive control board through the MCU STM32F407 to control the motor 20. The driver adopts the WSDC2412D high-current 12A/24V dual-channel DC brushed motor driver, which can output power up to 290W, providing power guarantee for driving servo control. The four servo motors are M60 motors, with a 1:47 reducer added, and the output rated torque reaches 145.4 kg.cm, ensuring the mechanical power of the walking aid system. PI closed-loop control effectively avoids the stability of the walking aid, preventing the walker from flying and slipping. The user can control the forward, backward, left and right turns of the walking aid system through the joystick. The control board collects the joystick control data through the AD channel to determine the user's movement intention and send out a PWM drive signal. At the same time, a voice control function is set on the terminal control board. When the user speaks the corresponding command (forward, backward, left turn, right turn, stop, etc.), the walking aid system will also generate PWM waves to drive the servo motor to move.
具体地,参见图3和图4,在导航、伴行过程中通过UWB无线定位模块确定机器人与老人的距离与角度问题,设置机器人与老人的位置与角度,通过PID控制在机器人运动过程中保持平稳的距离与角度,进行平稳跟随与导航控制。所述机器人通过超宽带无线通信技术UWB使机器人与患者的间距保持,UWB定位系统可实时更新位置信息,老人携带无线标签,实现老人的实时精确定位;获得数据后,设计了角度与位置分离双闭环控制方式,以确保机器人系统跟随老人的运动趋势,同时也不会对用户的运动造成障碍,同时设计了α、β对角度与距离控制灵敏度进行调节,防止转向以及距离控制过快变化。Specifically, referring to Figures 3 and 4, during the navigation and accompanying process, the distance and angle between the robot and the elderly are determined by the UWB wireless positioning module, the position and angle between the robot and the elderly are set, and the PID control is used to maintain a stable distance and angle during the robot's movement, and to perform stable following and navigation control. The robot uses the ultra-wideband wireless communication technology UWB to maintain the distance between the robot and the patient. The UWB positioning system can update the location information in real time. The elderly carry a wireless tag to achieve real-time and accurate positioning of the elderly. After obtaining the data, a dual closed-loop control method with angle and position separation is designed to ensure that the robot system follows the movement trend of the elderly, and at the same time, it will not cause obstacles to the user's movement. At the same time, α and β are designed to adjust the sensitivity of angle and distance control to prevent steering and distance control from changing too quickly.
作为本发明的一个优选实施例,所述手杖上部8与手杖下部9之间为套接连接。参见图1和图2,手杖上部8套入手杖下部9,二者相对应位置设有通孔24,弹簧按钮21设置在手杖下部9的通孔24,调节到合适的高度后,二者的通孔24重合,弹簧按钮21前端部分从手杖上部8的通孔伸出,完成高度的调整。As a preferred embodiment of the present invention, the upper part 8 of the cane is sleeved with the lower part 9 of the cane. Referring to Figures 1 and 2, the upper part 8 of the cane is sleeved into the lower part 9 of the cane, and through holes 24 are provided at corresponding positions of the two. The spring button 21 is provided in the through hole 24 of the lower part 9 of the cane. After adjusting to a suitable height, the through holes 24 of the two overlap, and the front end of the spring button 21 extends out of the through hole of the upper part 8 of the cane to complete the height adjustment.
作为本发明的一个优选实施例,参见图1,所述购物篮1中间带有隔板22将购物篮1分为若干空间,可以实现物品分类存放。As a preferred embodiment of the present invention, referring to FIG. 1 , the shopping basket 1 is provided with a partition 22 in the middle to divide the shopping basket 1 into several spaces, so that items can be stored in a classified manner.
作为本发明的一个优选实施例,参见图1,所述购物篮1上方的盖板3上表面设有软垫,用户可以坐在软垫上休息;可伸缩手杖的上部设有挂钩23,购物篮1中空间不够还可挂在手杖的上的挂钩23上。As a preferred embodiment of the present invention, referring to FIG1 , a cushion is provided on the upper surface of the cover plate 3 above the shopping basket 1, and the user can sit on the cushion to rest; a hook 23 is provided on the upper part of the retractable walking stick, and if there is not enough space in the shopping basket 1, the walking stick can be hung on the hook 23 on the walking stick.
作为本发明的一个优选实施例,参见图1,为了避免机器人作为一个手杖功不对老人行走形成障碍,在运动底盘2和购物篮1靠近人体部分设计深度10cm的凹形结构,凹形结构内的两侧呈45度的倒角。As a preferred embodiment of the present invention, referring to FIG. 1 , in order to prevent the robot from acting as a walking stick and causing obstacles to the elderly walking, a concave structure with a depth of 10 cm is designed near the human body of the motion chassis 2 and the shopping basket 1, and the two sides of the concave structure are chamfered at 45 degrees.
以上所述仅为本发明的实施例,并非以此限制本发明的保护范围,凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的系统领域,均同理包括在本发明的保护范围内。The above descriptions are merely embodiments of the present invention and are not intended to limit the protection scope of the present invention. Any equivalent structure or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related system fields, are also included in the protection scope of the present invention.

Claims (10)

  1. 一种智能拐杖式助行、生活载物导航机器人,其特征在于:An intelligent walking-assisting and life-carrying navigation robot with a cane, characterized in that:
    包括可伸缩手杖、购物篮(1)和运动底盘(2);运动底盘(2)与可伸缩手杖的下部固定,购物篮(1)设置在运动底盘(2)上,购物篮(1)上方设有可以开合的盖板(3),在购物篮(1)的前方安装有摄像头(4),用来实现判断是否到达了目的地;在购物篮(1)摄像头(4)下方安装有雷达(5),用来判断周围的障碍物;The invention comprises a retractable walking stick, a shopping basket (1) and a moving chassis (2); the moving chassis (2) is fixed to the lower part of the retractable walking stick, the shopping basket (1) is arranged on the moving chassis (2), an openable and closable cover (3) is arranged above the shopping basket (1), a camera (4) is installed in front of the shopping basket (1) for determining whether the destination has been reached; a radar (5) is installed below the camera (4) of the shopping basket (1) for determining surrounding obstacles;
    可伸缩手杖的手柄上部设有健康监测模块(6)与红外温度传感器(7),手柄下部设有响铃按钮(10),手柄上位于健康监测模块(6)的前方设有摇杆(11)与显示屏(12),摇杆(11)用于手动操作机器人运行,显示屏(12)用于显示健康监测模块(6)与红外温度传感器(7)监测是健康参数数据;在手杖上部(8)设置一个平台(13),该平台(13)上设置急停按钮(14)与收纳盒(15),在收纳盒(15)下面安装有血氧传感器(16),用于采集心率与血氧数据;平台(13)底部安装有语音麦克风(17);手杖上部(8)设有喇叭(18),喇叭(18)用于响铃与语音播报;The upper part of the handle of the retractable walking stick is provided with a health monitoring module (6) and an infrared temperature sensor (7), the lower part of the handle is provided with a ringing button (10), and the handle is provided with a joystick (11) and a display screen (12) in front of the health monitoring module (6), the joystick (11) is used to manually operate the robot, and the display screen (12) is used to display the health parameter data monitored by the health monitoring module (6) and the infrared temperature sensor (7); a platform (13) is provided on the upper part (8) of the walking stick, an emergency stop button (14) and a storage box (15) are provided on the platform (13), and a blood oxygen sensor (16) is installed under the storage box (15) for collecting heart rate and blood oxygen data; a voice microphone (17) is installed at the bottom of the platform (13); a speaker (18) is provided on the upper part (8) of the walking stick, and the speaker (18) is used for ringing and voice broadcasting;
    所述运动底盘(2)上设有控制柜(19)和多个电机(20),电机轴连接滚轮,控制柜(19)中集成了控制系统;控制系统分别获取摄像头(4)、雷达(5)、健康监测模块(6)、红外温度传感器(7)、血氧传感器(16)采集的数据,摇杆(11)通过控制系统来控制电机(20)的运行;控制系统根据语音麦克风(17)获取的指令对机器人进行控制。The motion chassis (2) is provided with a control cabinet (19) and a plurality of motors (20), the motor shafts being connected to rollers, and a control system being integrated in the control cabinet (19); the control system respectively acquires data collected by the camera (4), the radar (5), the health monitoring module (6), the infrared temperature sensor (7), and the blood oxygen sensor (16); the joystick (11) controls the operation of the motor (20) through the control system; and the control system controls the robot according to instructions acquired by the voice microphone (17).
  2. 根据权利要求1所述的一种智能拐杖式助行、生活载物导航机器人,其特征在于:The intelligent crutch-type walking-assisting and life-carrying navigation robot according to claim 1 is characterized in that:
    所述控制系统包括stm32数据采集板、stm32末端控制板、树莓派、5G NBIOT、UWB无线定位、GPS模块与驱动控制板。The control system includes an stm32 data acquisition board, an stm32 terminal control board, a Raspberry Pi, a 5G NBIOT, UWB wireless positioning, a GPS module and a drive control board.
  3. 根据权利要求2所述的一种智能拐杖式助行、生活载物导航机器人,其特征在于:The intelligent crutch-type walking-assisting and life-carrying navigation robot according to claim 2 is characterized in that:
    所述机器人通过树莓派的WIFI下载离线地图,依靠GPS模块进行导航,同时依靠摄像头(4)与雷达(5)采集回来的点云数据,在树莓派上面进行分析,实时避障遇到水坑或则断路情况,即可调整规划路线;The robot downloads offline maps through the Raspberry Pi's WIFI, relies on the GPS module for navigation, and relies on the point cloud data collected by the camera (4) and the radar (5) to analyze on the Raspberry Pi, and avoids obstacles in real time. If it encounters a puddle or a broken road, it can adjust the planned route;
    当机器人来到商场或者医院,机器人可利用树莓派的WiFi接入当地得局域网内,通过指纹法,获得障碍物以及目的地的大致范围,利用dijkstra算法计出路径,在运行过程中不断的通过雷达(5)与摄像头(4)获取路径上的点云信息,不断对之前的路径进行反馈修订,同时会根据摄像头(4)在路径上识别的事物通过网络搜索确定该物品的详细信息,并且在该路径上打标记,并将最新路径数据存为离线地图。When the robot arrives at a shopping mall or hospital, it can use the Raspberry Pi's WiFi to access the local LAN, obtain the approximate range of obstacles and the destination through the fingerprint method, and calculate the path using the Dijkstra algorithm. During operation, the robot continuously obtains point cloud information on the path through the radar (5) and the camera (4), and continuously provides feedback and revisions to the previous path. At the same time, it can determine the detailed information of the object through the network search based on the object recognized by the camera (4) on the path, mark the path, and save the latest path data as an offline map.
  4. 根据权利要求3所述的一种智能拐杖式助行、生活载物导航机器人,其特征在于:The intelligent crutch-type walking-assisting and life-carrying navigation robot according to claim 3 is characterized in that:
    所述机器人通过stm32数据采集板获取健康监测模块(6)、红外温度传感器(7)与血氧传感器(16)测得的脉搏、体温、心率、血氧健康参数,再通过5G NBIOT模块传回服务器,用户的监护人与主治医生就可通过手机端APP实时查看用户的健康状况,同时通过摄像头(4)传回的实时画面可让监护人实时清楚用户所处的环境地理信息;如果健康参数超出正常值就会进行预警,并对监护人与用户进行提示报警,通过放置手杖中部的喇叭(18)向用户提示,用户可通过手杖上的响铃按钮(10)进行对STM32末端控制板发出信号,使喇叭(18)发出铃声,提示周围的人。The robot obtains the pulse, body temperature, heart rate and blood oxygen health parameters measured by the health monitoring module (6), the infrared temperature sensor (7) and the blood oxygen sensor (16) through the STM32 data acquisition board, and transmits them back to the server through the 5G NBIOT module. The user's guardian and attending physician can view the user's health status in real time through the mobile phone APP. At the same time, the real-time picture transmitted back by the camera (4) allows the guardian to clearly understand the user's environmental geographical information in real time. If the health parameters exceed the normal value, an early warning will be issued, and the guardian and the user will be prompted and alarmed. The user will be prompted through the speaker (18) placed in the middle of the walking stick. The user can send a signal to the STM32 terminal control board through the ring button (10) on the walking stick, so that the speaker (18) will ring to alert people around.
  5. 根据权利要求4所述的一种智能拐杖式助行、生活载物导航机器人,其特征在于:The intelligent crutch-type walking-assisting and life-carrying navigation robot according to claim 4 is characterized in that:
    所述机器人的stm32末端控制板是由CONTEXM4为内核的MCU为核心处理器,板载MPU6050整合6轴运动处理组件,获取助行器的三轴速度与陀螺仪信息,以获得助行器姿态信息,通过TCP/IP通信反馈机器人控制器进行小车姿态安全监测,进而通过5G NB‑IOT通信模块传递到云端服务器,以便远程端用户查看实时情况;通过TCP/IP通信端口,发送里程计信息,获取由树莓派根据实时路况经过闭环位置PID的运动控制指令;stm32末端控制板是通过PWM捕获功能获得四个驱动电机(20)的里程计信息,利用PI控制对四个伺服电机(20)进行速度闭环控制,通过MCU STM32F407输出PWM波到驱动控制板上,进而控制电机(20)。The stm32 terminal control board of the robot is based on an MCU with a CONTEXM4 core as the core processor, and the onboard MPU6050 integrates a 6-axis motion processing component to obtain the three-axis speed and gyroscope information of the walker to obtain the walker posture information, and feed back the robot controller through TCP/IP communication to perform safety monitoring of the vehicle posture, and then transmit it to the cloud server through the 5G NB-IOT communication module so that remote users can view the real-time situation; through the TCP/IP communication port, the odometer information is sent to obtain the motion control instructions of the Raspberry Pi through the closed-loop position PID according to the real-time road conditions; the stm32 terminal control board obtains the odometer information of the four drive motors (20) through the PWM capture function, uses PI control to perform speed closed-loop control on the four servo motors (20), and outputs PWM waves to the drive control board through the MCU STM32F407, thereby controlling the motors (20).
  6. 根据权利要求5所述的一种智能拐杖式助行、生活载物导航机器人,其特征在于:The intelligent crutch-type walking-assisting and life-carrying navigation robot according to claim 5 is characterized in that:
    所述机器人通过超宽带无线通信技术(UWB)使机器人与患者的间距保持,UWB定位系统可实时更新位置信息,用户携带无线标签,实现用户的实时精确定位;获得数据后,设计了角度与位置分离双闭环控制方式,以确保机器人系统跟随用户的运动趋势,同时也不会对用户的运动造成障碍,同时设计了α、β对角度与距离控制灵敏度进行调节,防止转向以及距离控制过快变化。The robot maintains the distance between the robot and the patient through ultra-wideband wireless communication technology (UWB). The UWB positioning system can update the location information in real time. The user carries a wireless tag to achieve real-time and accurate positioning of the user. After obtaining the data, a dual closed-loop control method with angle and position separation is designed to ensure that the robot system follows the user's movement trend without causing obstacles to the user's movement. At the same time, α and β are designed to adjust the angle and distance control sensitivity to prevent steering and distance control from changing too quickly.
  7. 根据权利要求6所述的一种智能拐杖式助行、生活载物导航机器人,其特征在于:The intelligent crutch-type walking-assisting and life-carrying navigation robot according to claim 6 is characterized in that:
    所述手杖上部(8)与手杖下部(9)通过弹簧按钮(21)的形式进行调整高度。The height of the upper part (8) of the walking stick and the lower part (9) of the walking stick are adjusted by means of a spring button (21).
  8. 根据权利要求7所述的一种智能拐杖式助行、生活载物导航机器人,其特征在于:The intelligent crutch-type walking-assisting and life-carrying navigation robot according to claim 7 is characterized in that:
    所述购物篮(1)中间带有隔板(22),将购物篮(1)分为若干空间,可以实现物品分类存放。The shopping basket (1) is provided with a partition (22) in the middle, dividing the shopping basket (1) into a plurality of spaces, so that items can be stored in a classified manner.
  9. 根据权利要求8所述的一种智能拐杖式助行、生活载物导航机器人,其特征在于:The intelligent crutch-type walking-assisting and life-carrying navigation robot according to claim 8 is characterized in that:
    所述购物篮(1)上方的盖板(3)上表面设有软垫,用户可以坐在软垫上休息;可伸缩手杖的上部设有挂钩(23),购物篮(1)中空间不够还可挂在手杖的上的挂钩(23)上。The upper surface of the cover plate (3) above the shopping basket (1) is provided with a cushion, on which the user can sit and rest; the upper part of the retractable walking stick is provided with a hook (23), and if there is insufficient space in the shopping basket (1), the walking stick can be hung on the hook (23).
  10. 根据权利要求9所述的一种智能拐杖式助行、生活载物导航机器人,其特征在于:The intelligent crutch-type walking-assisting and life-carrying navigation robot according to claim 9 is characterized in that:
    在运动底盘(2)和购物篮(1)靠近人体部分设计凹形结构。A concave structure is designed on the sports chassis (2) and the shopping basket (1) at the part close to the human body.
PCT/CN2022/138188 2022-11-15 2022-12-09 Intelligent walking stick navigation robot having walking aid function and daily carrying function WO2024103469A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202211422925.6A CN115755902A (en) 2022-11-15 2022-11-15 Intelligent walking stick type walking-aid life object-carrying navigation robot
CN202211422925.6 2022-11-15

Publications (1)

Publication Number Publication Date
WO2024103469A1 true WO2024103469A1 (en) 2024-05-23

Family

ID=85370601

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/138188 WO2024103469A1 (en) 2022-11-15 2022-12-09 Intelligent walking stick navigation robot having walking aid function and daily carrying function

Country Status (2)

Country Link
CN (1) CN115755902A (en)
WO (1) WO2024103469A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI823813B (en) * 2023-04-28 2023-11-21 國立臺北科技大學 Correction device for blind guide stick and correction method thereof
CN117084872B (en) * 2023-09-07 2024-05-03 中国科学院苏州生物医学工程技术研究所 Walking aid control method, system and medium based on neck myoelectricity and walking aid
CN118042418B (en) * 2024-04-10 2024-08-02 北京移数通电讯有限公司 Intelligent supervision processing system for safe travel of old people based on mobile terminal

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE202016100156U1 (en) * 2016-01-14 2016-02-10 Shih-Wang Lin navigation walking stick
CN206699599U (en) * 2017-05-12 2017-12-05 南京工业职业技术学院 A kind of portable telescopic type intelligent crutch
CN207373179U (en) * 2017-10-26 2018-05-18 常熟理工学院 A kind of robot control system for being used for SLAM and navigation
CN109431018A (en) * 2018-12-21 2019-03-08 杭州师范大学 One kind being based on Embedded multi-function walking stick
CN109823441A (en) * 2019-03-15 2019-05-31 绍兴文理学院 A kind of smart supermarket shopping cart
CN110538051A (en) * 2019-08-27 2019-12-06 华南理工大学 intelligent blind person auxiliary device capable of automatically finding way and method thereof
CN113011351A (en) * 2021-03-24 2021-06-22 华南理工大学 Working method of intelligent shopping cart and intelligent shopping cart
CN113180349A (en) * 2021-04-22 2021-07-30 哈尔滨理工大学 Intelligence stick based on it is multi-functional
CN215455900U (en) * 2021-04-28 2022-01-11 河北工业大学 Intelligent navigation walking stick device with warning and monitoring functions
CN114093510A (en) * 2021-07-06 2022-02-25 李文龙 Intelligent walking stick system and walking stick thereof
CN114104059A (en) * 2021-12-31 2022-03-01 大连工业大学 Intelligent interactive shopping cart and management platform

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE202016100156U1 (en) * 2016-01-14 2016-02-10 Shih-Wang Lin navigation walking stick
CN206699599U (en) * 2017-05-12 2017-12-05 南京工业职业技术学院 A kind of portable telescopic type intelligent crutch
CN207373179U (en) * 2017-10-26 2018-05-18 常熟理工学院 A kind of robot control system for being used for SLAM and navigation
CN109431018A (en) * 2018-12-21 2019-03-08 杭州师范大学 One kind being based on Embedded multi-function walking stick
CN109823441A (en) * 2019-03-15 2019-05-31 绍兴文理学院 A kind of smart supermarket shopping cart
CN110538051A (en) * 2019-08-27 2019-12-06 华南理工大学 intelligent blind person auxiliary device capable of automatically finding way and method thereof
CN113011351A (en) * 2021-03-24 2021-06-22 华南理工大学 Working method of intelligent shopping cart and intelligent shopping cart
CN113180349A (en) * 2021-04-22 2021-07-30 哈尔滨理工大学 Intelligence stick based on it is multi-functional
CN215455900U (en) * 2021-04-28 2022-01-11 河北工业大学 Intelligent navigation walking stick device with warning and monitoring functions
CN114093510A (en) * 2021-07-06 2022-02-25 李文龙 Intelligent walking stick system and walking stick thereof
CN114104059A (en) * 2021-12-31 2022-03-01 大连工业大学 Intelligent interactive shopping cart and management platform

Also Published As

Publication number Publication date
CN115755902A (en) 2023-03-07

Similar Documents

Publication Publication Date Title
WO2024103469A1 (en) Intelligent walking stick navigation robot having walking aid function and daily carrying function
CN106890067B (en) Indoor blind man navigation robot
WO2018227987A1 (en) Automatic moving suitcase, smart device and system
US20170368691A1 (en) Mobile Robot Navigation
US10265227B2 (en) Mobile human-friendly assistive robot
Martins et al. A review of the functionalities of smart walkers
Morris et al. A robotic walker that provides guidance
CN109966064B (en) Wheelchair with detection device and integrated with brain control and automatic driving and control method
JP2019107767A (en) Computer-based method and system of providing active and automatic personal assistance using robotic device/platform
Krishnan et al. Mobility assistive devices and self-transfer robotic systems for elderly, a review
US20170354564A1 (en) Mobile walker, monitoring and information system with a mobile walker and method for operating a mobile walker
JP6815891B2 (en) Walking support robot and walking support system
US20180256422A1 (en) Intelligent power wheelchair and related methods
Lu et al. Assistive navigation using deep reinforcement learning guiding robot with UWB/voice beacons and semantic feedbacks for blind and visually impaired people
CN109129502A (en) A kind of intelligent robot applied to clinical medical and nursing
CN110161938A (en) A kind of multifunctional intellectual wheelchair system
Zavyalov et al. Robotic and smart service for people with disabilities
CN116270047A (en) Electric wheelchair for realizing intelligent movement and remote health monitoring and control system
CN116061204A (en) Intelligent pension robot, robot system and control method thereof
Merlet ANG, a family of multi-mode, low cost walking aid
CN212527751U (en) Novel nursing robot
Takahashi et al. Development of the assistive mobile robot system: AMOS—to aid in the daily life of the physically handicapped
CN111136670A (en) Novel nursing robot
Sut et al. Design and analysis of smart assistive humanoid robot for isolated patients
Leaman et al. Embodied-ai wheelchair framework with hands-free interface and manipulation