WO2023024399A1 - 一种医疗用机器人装置、系统及方法 - Google Patents

一种医疗用机器人装置、系统及方法 Download PDF

Info

Publication number
WO2023024399A1
WO2023024399A1 PCT/CN2022/000120 CN2022000120W WO2023024399A1 WO 2023024399 A1 WO2023024399 A1 WO 2023024399A1 CN 2022000120 W CN2022000120 W CN 2022000120W WO 2023024399 A1 WO2023024399 A1 WO 2023024399A1
Authority
WO
WIPO (PCT)
Prior art keywords
robot
medical
information
module
scanning
Prior art date
Application number
PCT/CN2022/000120
Other languages
English (en)
French (fr)
Inventor
谈斯聪
于皓
于梦非
Original Assignee
谈斯聪
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 谈斯聪 filed Critical 谈斯聪
Priority to AU2022333762A priority Critical patent/AU2022333762A1/en
Priority to CN202280056991.8A priority patent/CN118338997A/zh
Publication of WO2023024399A1 publication Critical patent/WO2023024399A1/zh

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J11/00Manipulators not otherwise provided for
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B25HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25JMANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J13/00Controls for manipulators
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K17/00Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations
    • G06K17/0022Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisions for transferring data to distant stations, e.g. from a sensing device

Definitions

  • the invention belongs to the technical field of artificial intelligence robot health medical equipment, and relates to the technical field of robots, an image intelligent recognition method, intelligent equipment and a system.
  • vision device Using the robot arm, vision device, depth vision device and various neural network methods and their improvement methods to assist in the collection of medical images and videos, remote collection, autonomous collection, infection detection, intelligent analysis of data, and effective prevention Infectious diseases, plague and other major diseases spread.
  • the purpose of the present invention is to overcome the shortcomings and deficiencies of the above-mentioned prior art, and to provide a medical robot device, which utilizes a remote, autonomous robot to collect medical image devices, and solves artificial scanning, inspection, collection, diagnosis and treatment errors, and a single The limitations of the diagnosis and treatment department and the singleness of the diagnosis plan.
  • the radar and the mobile base realize autonomous movement, map positioning and navigation, and solve the problem of mobile collection.
  • Plane vision device depth vision device, intelligent recognition of plane information, depth information such as bones.
  • the remote control of the robot and autonomous acquisition can be realized, and the problems of high operating pressure and various acquisition tasks for medical staff can be solved.
  • a robotic device for medical use comprising:
  • the robot main system module is used to connect and control the robot device module, including: voice device and voice module, visual acquisition device and visual recognition module, radar mobile autonomous mapping positioning and navigation device and module, machine scanning Inspection arm and information verification robot arm, ultrasonic diagnosis and treatment device and medical image video acquisition sharing module, ultrasonic scanning device, pressure device, information acquisition and reading device, lying position, posture, angle adjustment device.
  • voice device and voice module including: voice device and voice module, visual acquisition device and visual recognition module, radar mobile autonomous mapping positioning and navigation device and module, machine scanning Inspection arm and information verification robot arm, ultrasonic diagnosis and treatment device and medical image video acquisition sharing module, ultrasonic scanning device, pressure device, information acquisition and reading device, lying position, posture, angle adjustment device.
  • the visual collection device and the visual recognition module are used for collecting images and videos, and recognizing images and videos.
  • the vision collection device includes: a plane vision device and a depth vision device.
  • the voice device and voice module are used to collect and recognize voices, voice interaction between users and administrators, and voice consultation.
  • the radar moves autonomously, and the map building positioning navigation device and module, the device includes: a mobile base and a radar, which are used for self-built map autonomous positioning navigation movement.
  • the robotic arm includes a robotic scanning arm and an information verification robotic arm
  • the robotic scanning arm is used to collect medical images and videos
  • the information verification robotic arm is used to collect, scan, identify, Read QR code, digital code, text, logo, biological information, RFID information, patient user information.
  • Ultrasonic diagnosis and treatment devices and medical image video acquisition and sharing modules are used to acquire medical images, videos, share medical images, videos, remote consultation, multi-department joint consultation, and image sharing.
  • Ultrasonic scanning device used for scanning, collecting images and videos.
  • Pressure device for applying pressure and scanning.
  • the information acquisition and reading device is used for scanning, identifying, and reading two-dimensional codes, digital codes, characters, signs, biological information, RFID information, patient, and user information.
  • the reclining position, posture, and angle adjustment device adjusts the position, angle, and direction of each scanning task according to the standard scanning requirements.
  • a communication module the communication module is connected with the main robot system and the remote client respectively, and is used for the communication between the remote client and the main robot system.
  • the communication module includes wireless communication module, bluetooth communication module, wired Internet communication module, radio frequency communication, one or more communication methods in radio communication.
  • the communication module communicates between the remote client and the main robot system to control each device.
  • Remote control and autonomous control of the action of the dual robot arms the robot scanning arm is connected to the ultrasonic scanning device, the information verification robot arm is connected to the information collection and reading device, the parameters are set through the administrator's mediation, and the learning plan of the robot is trained through the neural network improvement method Action and adaptive mediation Set action planning parameters for action planning to realize the acquisition of medical images, videos, reading and identification of two-dimensional codes, digital codes, text, signs, biological information, RFID information, patient, user information.
  • the voice device and the voice module are connected to the main system of the robot and used for collecting and recognizing voices, voice interaction between users and administrators, and consultation.
  • the voice device includes: a voice collection device, a voice input device, and a voice output device;
  • the voice module includes: voice recognition, voice-to-text conversion, voice synthesis, voiceprint recognition, voice command, and voice guidance.
  • the visual acquisition device and the visual recognition module, the robot main system is connected with the visual acquisition device for collecting images, videos, and identifying images and videos;
  • the vision acquisition device includes: a plane vision device and a depth vision device;
  • Visual identity modules include:
  • Plane image recognition includes: face image and position recognition, facial features image and position recognition, human body feature point and position recognition, medical scene recognition;
  • In-depth image recognition includes: bone image and position recognition, joint image and position recognition, key joints and position recognition, human body feature points and position recognition, special features and their position recognition;
  • Medical images collected by ultrasound devices, video recognition includes: blood vessels, organs, organ shapes, structures, contours, and color feature point recognition scanned by ultrasound devices, feature recognition of diseases, images collected by ultrasound, and video recognition.
  • the radar autonomous mobile medical scene recognition and mapping module is to connect the radar and the vision device with the robot main system
  • Medical scenes include: letters, numbers, text, bed numbers and radar real-time map fusion of addresses, departments, and wards, autonomous positioning, navigation, and movement to corresponding departments and wards , beds, and user locations.
  • the dual robotic arms include a robotic scanning arm and an information verification robotic arm,
  • the scanning arm of the machine is connected with the scanning device and the pressure device for collecting medical images and videos;
  • the information verification robot arm is connected with the information collection device, the information scanning device and the reading device, and is connected with the robot main system and the vision device, and is used for collecting, scanning and reading digital codes, two-dimensional codes, RFID, biometrics , Intelligent recognition to read QR codes, digital codes, text, logos, biological information, RFID information, patient user information. It is connected with the reclining position, posture and angle adjustment device, actuates the reclining position, posture and angle adjustment device, so that the medical object can adjust the position, angle and direction of each scanning task according to the standard scanning requirements.
  • the ultrasonic diagnosis and treatment device and the medical image video acquisition sharing module, the ultrasonic diagnosis and treatment device and the medical image video acquisition sharing module are connected to the main robot system for remote control and autonomous acquisition of medical images, videos, and shared medical images, Video, remote consultation, multi-department joint consultation.
  • the ultrasonic probe scanning device and the pressure device is connected with the machine scanning arm and the pressure device, the main system of the robot and the remote client control the ultrasonic probe scanning device and the robot arm to move, scan Check, collect images, videos.
  • a pressure device the pressure device is connected with the ultrasonic probe scanning device and the machine scanning arm, the main system of the robot and the remote client control the pressure device to apply pressure, and the probe scans.
  • the information verification robot arm is connected with the information collection device, the information scanning device and the reading device, and is connected with the robot main system and the vision device, and is used for collecting, scanning and reading digital codes, two-dimensional codes, RFID, biometrics , Intelligent recognition to read QR codes, digital codes, text, logos, biological information, RFID information, patient user information.
  • the information verification robot arm is connected with the robot main system, lying position, posture, and angle adjustment device, actuates the lying position, posture, and angle adjustment device, so that the medical object can adjust each scan according to the standard scanning requirements.
  • the position, angle, direction of the task is connected with the robot main system, lying position, posture, and angle adjustment device, actuates the lying position, posture, and angle adjustment device, so that the medical object can adjust each scan according to the standard scanning requirements.
  • the position, angle, direction of the task is connected with the robot main system, lying position, posture, and angle adjustment device, actuates the lying position, posture, and angle adjustment device, so that the medical object can adjust each scan according to the standard scanning requirements.
  • the position, angle, direction of the task is connected with the robot main system, lying position, posture, and angle adjustment device, actuates the lying position, posture, and angle adjustment device, so that the medical object can adjust each scan according to the standard scanning requirements.
  • the position, angle, direction of the task is connected with the robot main system, lying position, posture,
  • An optimized task configuration management system characterized in that it includes: a medical robot device, medical task subsystems of multiple departments and a call subsystem, the medical robot device is the medical With the robot device, all the medical and nursing task subsystems of multiple departments and a call system subsystem are connected with the main control system of the robot, and built on the optimized task management system platform.
  • a remote control and autonomous positioning navigation movement, optimal task configuration method which includes the following steps:
  • the administrator and the doctor communication module publish collection tasks, collected time information, location information, doctor's order messages, and services.
  • a dynamic task allocation method a dynamic optimal task configuration, a path planning method, using an optimal method to plan tasks, and the goal is to complete all tasks in the shortest time.
  • Optimization methods include: genetic calculation method and its improved method, tabu search calculation method and its improved method, simulated annealing calculation method and its improved method, ant colony calculation method and its improved method, particle beam optimization calculation method and its An improved method, a neural network computing method and its improved method, an evolutionary method and its improved method, and one or more combined methods.
  • the robot uses the communication module to publish patient location information, including: patient wards, outpatient clinics, departments, and bed location information.
  • the radar positioning and navigation module subscribes to patient location information and moves autonomously to the collection area.
  • the robot uses the vision module, recognizes the communication module to release information services, and the radar positioning and navigation module subscribes to the location information service, and moves to the collection area autonomously.
  • the robot uses the communication module to publish the collection location, task information, and time information.
  • the robot arm subscribes to the fixed device to collect location information, and the action planning module subscribes to the location information.
  • step S6 the robot collects ultrasound data and moves on the ultrasound image according to the action planning module.
  • Figure 1 is a schematic diagram of a medical robot device module in the specification of this application.
  • 101-robot main system 101-robot main system; 102-acquisition action planning module; 103-visual module;
  • Figure 2 is a schematic diagram of the composition and structure of the medical robot device in the specification of this application;
  • 201 Vision acquisition device 202-Robot main system; 203-Ultrasonic diagnostic device; 204-Pressure device;
  • 209-machine scanning arm 210-information scanning device; 211-lying position, posture, angle adjustment device;
  • the purpose of the present invention is to design a remote-controllable robot that replaces human work, realize remote control of robotic arm acquisition, and effectively solve autonomous image and video acquisition.
  • Artificial intelligence robot technology autonomous collection in the field of automation, robot arm motion planning, and depth cameras to collect images of faces, facial features, arms, external features of the human body, bones, and joints.
  • a medical robot device is provided, and the robot autonomously collects medical images by using a remote end.
  • plane vision devices and depth vision devices Provides the use of plane vision devices and depth vision devices to intelligently identify plane information, skeleton and depth information.
  • the robot main system 101, the robot main system 101 module is used to connect and control the robot device module, including: voice device 212 and voice module 105, visual acquisition device 201 and visual recognition module 103, radar mobile autonomous mapping positioning navigation device And module 108, machine scanning arm 209 and information verification robot arm 208, ultrasonic diagnosis and treatment device 203 and medical image video acquisition sharing module 104, ultrasonic scanning device 205, pressure device 106, information acquisition and reading device 109, lying position, position Posture, angle adjustment device 107.
  • voice device 212 and voice module 105 including: voice device 212 and voice module 105, visual acquisition device 201 and visual recognition module 103, radar mobile autonomous mapping positioning navigation device And module 108, machine scanning arm 209 and information verification robot arm 208, ultrasonic diagnosis and treatment device 203 and medical image video acquisition sharing module 104, ultrasonic scanning device 205, pressure device 106, information acquisition and reading device 109, lying position, position Posture, angle adjustment device 107.
  • the visual collection device 201 and the visual recognition module 103 are used to collect images, videos, and identify images and videos.
  • the vision acquisition device 201 includes: a plane vision device and a depth vision device.
  • the voice device 212 and the voice module 105 are used for collecting and recognizing voices, voice interaction between users and administrators, and voice consultation.
  • the radar moves autonomously, and the map building positioning and navigation device and module 108, the device includes: a mobile base 207 and a radar 206, which are used for autonomous positioning and navigation of self-built maps.
  • the robotic arm includes a mechanical scanning arm 209 and an information verification robotic arm 208
  • the mechanical scanning arm 209 is used to collect medical images and videos
  • the information verification robotic arm 208 is used to collect, Scan, identify, read QR code, digital code, text, logo, biological information, RFID information, patient user information.
  • the ultrasonic diagnosis and treatment device 203 and the medical image video collection and sharing module 104 are used for collecting medical images, videos, sharing medical images, videos, remote consultation, multi-department joint consultation, and image sharing.
  • the ultrasonic scanning device 205 is used for scanning, collecting images and videos.
  • the pressure device 106 is used for applying pressure and scanning.
  • the information collection and reading device 109 is used for scanning, identifying, and reading two-dimensional codes, digital codes, characters, signs, biological information, RFID information, patient information, and user information.
  • the reclining position, posture, and angle adjustment device 107 adjusts the position, angle, and direction of each scanning task according to the standard scanning requirements.
  • a communication module the communication module is connected with the main robot system 101 and the remote client 213 respectively, and is used for communication between the remote client and the main robot system 101 .
  • the communication module includes wireless communication module, bluetooth communication module, wired Internet communication module, radio frequency communication, one or more communication methods in radio communication.
  • the optimization task management system of the present invention and a kind of medical robot device implementation method are as follows:
  • the medical administrator arranges time for patients in multiple departments and wards - and the tasks corresponding to each time period, and adds all tasks to the optimized task management system, and the medical robot device is arranged according to the date , time, corresponding departments, wards, received tasks assigned by the administrator of the optimization task management system.
  • Administrator users and expert users log in to the optimization task management department, remotely control robots, manage robots under the jurisdiction of their respective departments and wards, add, modify, delete, query, dynamically schedule various tasks of robots in real time, and call with medical areas System connection, remote consultation, joint consultation and treatment of patients in the jurisdiction, sending doctor's order information, accepting and replying to patients' messages.
  • the radar module 108 and the vision module 103 are used for path planning for the tasks in each time period. And use the acquisition action planning module 102, the voice module 105, and the medical image and video acquisition module 104 to process different tasks respectively.
  • the robot When processing acquisition tasks, the robot utilizes the acquisition motion planning module 102 for motion planning.
  • the collection steps are as follows:
  • the administrator releases medical orders and arranges tasks.
  • the robot uses the voice device 215 voice module 105, speech synthesis technology, voice recording, and voice-to-text recognition of medical orders.
  • the robot uses patient location information, patient wards, departments, and bed location information. Radar 207 navigates autonomously to the hospital bed.
  • the robot uses the camera 201 and the vision module 103 to recognize human faces, facial features, features, and positions thereof. Identify fingers, toe ends, arm joints, and joint positions.
  • the robot collects images and video shoots actions. Return task completion message to administrator. If not complete, move the task to the next time slot.

Landscapes

  • Engineering & Computer Science (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)
  • Manipulator (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Abstract

一种医疗用机器人装置包括机器人主系统(101),机器人主系统连接并控制机器人装置模块,包括:语音装置(212)及语音模块(105),视觉采集装置及视觉识别模块(103),雷达移动自主建图定位导航装置及模块(108),机器扫查臂(209)与信息验证机器臂(208),超声诊疗装置(203)及医疗图像视频采集共享模块(104),超声扫查装置(205),压力装置(106),信息采集读取装置(109)和卧位,位姿,角度调解装置(107)。还公开了一种最优化任务配置管理系统,通过机器人搭载的医疗图像采集装置,实现机器人远端控制及自主控制机器臂的超声图像采集装置,解决医护人员作业压力大,采集任务繁多等问题。提高医生远端实时问诊,查房,多科室联合会诊的灵活性实时性,应用于门诊,病房,海外医疗机构,高效率多治疗方案多专家共同意见解决临床案例。

Description

一种医疗用机器人装置、系统及方法 技术领域
本发明属于人工智能机器人健康医疗设备技术领域,涉及机器人技术领域,图像智能识别方法,智能化设备及系统。
背景技术
目前应用于医疗领域,在检查过程,由于各种人为因素分析,医疗图像,视频采集质量差,标准化程度低,识别病情精准度差。各专科医生领域及医疗专业受限,多科室多专家联合会诊,在门诊,病房与患者一起讨论病情很难实现。管理员远端控制,远端联合会诊,病房专家联合查房,联合治疗的机器人装置,机器人平台涉及机器人理论,实践技术。
因疫情等感染性高,效率低下,人工采集不精准,瘟疫传播等问题严重,利用机器臂远端及自主采集医疗图像,视频。
利用机器人搭载的机器臂,视觉装置,深度视觉装置及各种神经网络方法及其改进方法,辅助采集医疗图像,视频,实现远端采集,自主采集,感染性检测,智能化分析数据,有效防止传染病,瘟疫等重大疾病蔓延。
技术问题
本发明的目的就在于克服上述现有技术的缺点和不足,提供一种医疗用机器人装置,利用远端,自主机器人采集医疗图像装置,解决了人为的扫查,检查采集诊断治疗失误,以及单一诊疗科的局限性及诊断方案的单一性等问题。
雷达,移动底座实现自主移动,建图定位导航,解决移动采集问题。
平面视觉装置,深度视觉装置,智能识别平面信息,骨骼等深度信息。
通过机器人搭载的医疗图像采集装置,实现机器人远端控制,自主采集,解决医护人员作业压力大,采集任务繁多等问题。提高专家,医生远端实时问诊,查房,多科室联合会诊的灵活性实时性,高效率多治疗方案多专家共同意见解决临床案例。
本发明的采用的技术方案
一种医疗用机器人装置包括:
机器入主系统,所述机器人主系统模块,用于连接并控制机器人装置模块,包括:语音 装置及语音模块,视觉采集装置及视觉识别模块,雷达移动自主建图定位导航装置及模块,机器扫查臂与信息验证机器臂,超声诊疗装置及医疗图像视频采集共享模块,超声扫查装置,压力装置,信息采集读取装置,卧位,位姿,角度调解装置。
视觉采集装置及视觉识别模块,用于采集图像,视频,识别图像,视频。所述的视觉采集装置包括:平面视觉装置,深度视觉装置。
语音装置及语音模块,用于采集并识别声音,用户间管理员间的语音交互,语音问诊。
雷达自主移动,建图定位导航装置及模块,所述装置包括:移动底座及雷达,用于自建地图自主定位导航移动。
机器臂,所述的机器臂,包括机器扫查臂与信息验证机器臂,所述的机器扫查臂用于采集医疗图像,视频;所述的信息验证机器臂用于采集,扫描,识别,读取二维码,数字码,文字,标识,生物信息,RFID信息,患者用户信息。
超声诊疗装置及医疗图像视频采集共享模块用于采集医疗图像,视频,共享医疗图像,视频,远端会诊,多科室联合会诊,图像共享。
超声扫查装置,用于扫查,采集图像,视频。
压力装置,用于施压,扫查。
信息采集读取装置,用于扫描,识别,读取二维码,数字码,文字,标识,生物信息,RFID信息,患者,用户信息。
卧位,位姿,角度调解装置,按标准的扫查要求,调解各扫查任务的位置,角度,方向。
通信模块,所述的通信模块分别与机器人主系统,远端客户端连接,用于远端客户端与机器人主系统间的通信。通信模块包括,无线通信模块,蓝牙通信模块,有线互联网通信模块,射频通信,无线电通信中的一种及多种通信方式。
远端控制及自主控制,双模式控制医疗用机器人内各装置,各模块,各节点。远端客户端与机器人主系统间利用通信模块通信,控制各装置。远端控制及自主控制双机器臂动作,机器扫查臂与超声扫查装置连接,信息验证机器臂与信息采集读取装置连接,通过管理员调解设置参数及通过神经网络改进方法训练机器人学习规划动作及自适应调解设置动作规划参数,用于动作规划,实现所述的采集医疗图像,视频,读取识别二维码,数字码,文字,标识,生物信息,RFID信息,患者,用户信息。
所述的语音装置及语音模块,机器人主系统与语音装置连接,用于采集并识别声音,用户间管理员间的语音交互,问诊。
语音装置包括:声音采集装置,语音输入装置,语音输出装置;
语音模块包括:语音识别,语音文字互转,语音合成,声纹识别,语音指令,语音引导功能。
所述的视觉采集装置及视觉识别模块,机器人主系统与视觉采集装置连接,用于采集图像,视频,识别图像,视频;
所述的视觉采集装置包括:平面视觉装置,深度视觉装置;
视觉识别模块包括:
平面图像识别包括:人脸图像及位置识别,五官图像及位置识别,人体特征点及位置识别,医疗场景识别;
深度图像识别包括:骨骼图像及位置识别,关节图像及位置识别,关键关节及位置识别,人体的特征点及位置识别,特殊特征以及其位置的识别;
超声装置采集的医疗图像,视频识别包括:超声装置扫查的血管,器官,器官形状,结构,轮廓,颜色的特征点识别,病症的特征识别,超声采集的图像,视频识别。
所述雷达自主移动医疗场景识别建图模块是将雷达,视觉装置与机器人主系统连接,
雷达自主定位、导航、实时建图,
视觉装置及智能识别方法识别人脸及医疗场景,医疗场景包括:地址、科室、病房门牌的字母、数字、文字、床位号与雷达实时建图融合,自主定位、导航、移动至对应科室、病房、床位、用户位置。
所述的双机器臂,所述的机器臂包括机器扫查臂与信息验证机器臂,
所述的机器扫查臂,与扫查装置,压力装置连接,用于采集医疗图像,视频;
所述的信息验证机器臂,与信息采集装置,信息扫描装置,读取装置连接,与机器人主系统,视觉装置连接,用于采集,扫描,读取数字码,二维码,RFID,生物特征,智能识别读取二维码,数字码,文字,标识,生物信息,RFID信息,患者用户信息。与卧位,位姿,角度调解装置连接,致动卧位,位姿,角度调解装置,使医疗对象按标准的扫查要求,调解各扫查任务的位置,角度,方向。
所述的超声诊疗装置及医疗图像视频采集共享模块,所述的超声诊疗装置及医疗图像视频采集共享模块与机器人主系统连接,用于远端控制及自主采集医疗图像,视频,共享医疗图像,视频,远端会诊,多科室联合会诊。
所述的超声探头扫查装置及压力装置,所述的超声探头扫查装置与机器扫查臂,压力装置连接,机器人主系统及远端客户端控制超声探头扫查装置与机器臂移动,扫查,采集图像,视频。
压力装置,所述的压力装置与超声探头扫查装置,机器扫查臂连接,机器人主系统及远端客户端控制压力装置施压,探头扫查。
所述的信息验证机器臂,与信息采集装置,信息扫描装置,读取装置连接,与机器人主系统,视觉装置连接,用于采集,扫描,读取数字码,二维码,RFID,生物特征,智能识别读取二维码,数字码,文字,标识,生物信息,RFID信息,患者用户信息。
所述的信息验证机器臂,与机器人主系统,卧位,位姿,角度调解装置连接,致动卧位,位姿,角度调解装置,使医疗对象按标准的扫查要求,调解各扫查任务的位置,角度,方向。
一种最优化任务配置管理系统,其特征在于,包括:一种医疗用机器人装置、多个科室的医护任务子系统和1个呼叫子系统,所述医疗用机器人装置为上述任一方案中医疗用机器人装置,所有多个科室的医护任务子系统和1个呼叫系子统与机器人主控制系统连接,搭建在最优化任务管理系统平台上。
进一步,一种远端控制及自主定位导航移动,最优化任务配置方法,其包括以下步骤:
S1、管理员,医生通信模块,发布采集任务,采集的时间信息,位置信息,医嘱消息,服务。
S2、利用最优化任务配置方法,动态分配任务至机器人装置。
进一步,动态的任务分配方法:一种动态最优化的任务配置,路径规划方法,采用最优化的方法规划任务,目标为最短的时间完成所有任务。最优化的方法包括:遗传计算方法及其改进方法,禁忌搜索计算方法及其改进方法,模拟退火计算方法及其改进方法,蚁群计算方法及其改进方法,粒子束最优化的计算方法及其改进方法,神经网络计算方法及其改进方法,进化方法及其改进方法中的一种及多种联合方法。
S3、机器人利用通信模块,发布病患位置信息包括:病患病房,门诊,科室,床位位置信息,雷达定位导航模块订阅病患位置信息,自主移动到采集区。
S4、机器人利用视觉模块,识别通信模块发布信息服务,雷达定位导航模块订阅位置信息服务,自主移动到采集区。
S5、机器人利用通信模块发布采集位置,任务信息,时间信息,机器臂订阅固定装置,采集位置信息,动作规划模块订阅位置信息。
S6、机器人依照步骤S6的位置信息,按照动作规划模块,采集超声数据,超声图像动作。
S7、返回任务完成信息至管理员。如果未完成,将任务移入下一时间段。
附图说明:
图1是本申请说明书中医疗用机器人装置模块示意图;
附图1标记:
101-机器人主系统;102-采集动作规划模块;103-视觉模块;
104-医疗图像视频采集模块;105-语音模块;106-压力装置及传感器模块;
107-卧位位姿角度调解装置;108-雷达建图定位导航移动模块;
109-信息读取动作规划模块;110-通信模块;
图2是本申请说明书中医疗用机器人装置组成结构示意图;
附图2标记:
201视觉采集装置;202-机器人主系统;203-超声诊断装置;204-压力装置;
205-超声扫查探头;206-雷达;207-移动装置;208-信息验证机器臂;
209-机器扫查臂;210-信息扫描装置;211-卧位,位姿,角度调解装置;
212-语音装置;213远端客户端;
具体实施方式
本发明的目的是设计取代人类工作的可远端控制机器人,实现远端控制机器臂采集,同时有效解决自主采集图像,视频。利用人工智能机器人技术,自动化领域的自主采集,机器臂动作规划,深度摄像头采集人脸,五官,手臂,人体外部特征,骨骼,关节图像。
实现远端控制机器人及自主采集医疗图像,视频,远端控制医疗图像,视频采集装置及共享图像,解决了人为的诊断治疗失误,提高了智能采集的精准度和医疗数据异常识别的准确度。为了更好的理解上述技术方案,下面结合实施例及附图,对本发明作进一步地的详细说明,但本发明的实施方式不限于此。
本申请实施中的技术方案为解决上述技术问题的总体思路如下:
提供一种医疗用机器人装置,利用远端,机器人自主采集医疗图像装置。
提供利用雷达,移动底座实现自主移动,建图定位导航,解决移动采集问题。
提供利用平面视觉装置,深度视觉装置,智能识别平面信息,骨骼及深度信息。
通过医疗装置,医疗图像,视频采集装置,实现机器人远端控制,自主采集,解决医护人员作业压力大,采集任务繁多等问题。
实施例1:
下面结合实施例及附图1,附图2,对本发明作进一步地的详细说明,但本发明的实施方式不限于此。
机器人主系统101,所述机器人主系统101模块,用于连接并控制机器人装置模块,包括:语音装置212及语音模块105,视觉采集装置201及视觉识别模块103,雷达移动自主建图定位导航装置及模块108,机器扫查臂209与信息验证机器臂208,超声诊疗装置203及医疗图像视频采集共享模块104,超声扫查装置205,压力装置106,信息采集读取装置109,卧位,位姿,角度调解装置107。
视觉采集装置201及视觉识别模块103,用于采集图像,视频,识别图像,视频。所述的视觉采集装置201包括:平面视觉装置,深度视觉装置。
语音装置212及语音模块105,用于采集并识别声音,用户间管理员间的语音交互,语音问诊。
雷达自主移动,建图定位导航装置及模块108,所述装置包括:移动底座207及雷达206,用于自建地图自主定位导航移动。
机器臂,所述的机器臂,包括机器扫查臂209与信息验证机器臂208,所述的机器扫查臂209用于采集医疗图像,视频;所述的信息验证机器臂208用于采集,扫描,识别,读取二维码,数字码,文字,标识,生物信息,RFID信息,患者用户信息。
超声诊疗装置203及医疗图像视频采集共享模块104用于采集医疗图像,视频,共享医疗图像,视频,远端会诊,多科室联合会诊,图像共享。
超声扫查装置205,用于扫查,采集图像,视频。
压力装置106,用于施压,扫查。
信息采集读取装置109,用于扫描,识别,读取二维码,数字码,文字,标识,生物信息,RFID信息,患者,用户信息。
卧位,位姿,角度调解装置107,按标准的扫查要求,调解各扫查任务的位置,角度,方向。
通信模块,所述的通信模块分别与机器人主系统101,远端客户端213连接,用于远端客户端与机器人主系统101间的通信。通信模块包括,无线通信模块,蓝牙通信模块,有线互联网通信模块,射频通信,无线电通信中的一种及多种通信方式。
实施例2:
本发明的最优化任务管理系统及一种医疗用机器人装置实施方法如下:
利用最优化任务管理系统,医护管理员为多个科室,病房的的患者排配时间-及其各时间段对应的任务,将所有的任务添加到最优化任务管理系统,医疗用机器人装置按照日期,时间、对应科室,病房,收到最优化任务管理系统管理员分配的任务。
管理员用户,专家用户登录最优化任务管理系,远端控制机器人,管理各自科室,病房管辖区下的机器人,添加,修改,删除,查询,动态实时排班机器人各种任务,与医疗区呼叫系统连接,远端问诊,联合会诊治疗管辖区患者,发送医嘱信息,接受患者留言,回复患者留言。
按照时间段及对应时间段的机器人任务,各时间段的对任务用雷达模块108及视觉模块103进行路径规划。并应用采集动作规划模块102,语音模块105,医疗图像视频采集模块104分别处理不同任务。
当处理采集任务时,机器人利用动作规划的采集动作规划模块102。采集步骤如下:
管理员通发布医嘱,排配任务.机器人利用语音装置215语音模块105,语音合成技术,语音记录,语音转文字识别医嘱。
机器人利用病患位置信息,病患病房,科室,床位位置信息。雷达207导航自主移动到病床。机器人利用摄像头201及视觉模块103,识别人脸,五官,特征,及其位置。识别手指,趾末端,手臂各关节,各关节位置。机器人按照动作规划模块102,109,采集图像,视频射动作。返回任务完成信息至管理员。如果未完成,将任务移入下一时间段。

Claims (10)

  1. 一种医疗用机器人装置、系统及方法,其特征在于,一种医疗用机器人装置包括:
    机器人主系统,所述机器人主系统模块,用于连接并控制机器人装置模块,包括:语音装置及语音模块,视觉采集装置及视觉识别模块,雷达移动自主建图定位导航装置及模块,机器扫查臂与信息验证机器臂,超声诊疗装置及医疗图像视频采集共享模块,超声扫查装置,压力装置,信息采集读取装置,卧位,位姿,角度调解装置。
    视觉采集装置及视觉识别模块,用于采集图像,视频,识别图像,视频。所述的视觉采集装置包括:平面视觉装置,深度视觉装置。
    语音装置及语音模块,用于采集并识别声音,用户间管理员间的语音交互,语音问诊。
    雷达自主移动,建图定位导航装置及模块,所述装置包括:移动底座及雷达,用于自建地图自主定位导航移动。
    机器臂,所述的机器臂,包括机器扫查臂与信息验证机器臂,所述的机器扫查臂用于采集医疗图像,视频;所述的信息验证机器臂用于采集,扫描,识别,读取二维码,数字码,文字,标识,生物信息,RFID信息,患者用户信息。
    超声诊疗装置及医疗图像视频采集共享模块用于采集医疗图像,视频,共享医疗图像,视频,远端会诊,多科室联合会诊,图像共享。
    超声扫查装置,用于扫查,采集图像,视频。
    压力装置,用于施压,扫查。
    信息采集读取装置,用于扫描,识别,读取二维码,数字码,文字,标识,生物信息,RFID信息,患者,用户信息。
    卧位,位姿,角度调解装置,按标准的扫查要求,调解各扫查任务的位置,角度,方向。
    通信模块,所述的通信模块分别与机器人主系统,远端客户端连接,用于远端客户端与机器人主系统间的通信。通信模块包括,无线通信模块,蓝牙通信模块,有线互联网通信模块,射频通信,无线电通信中的一种及多种通信方式。
  2. 根据权利要求1所述的一种医疗用机器人装置,其特征在于,远端控制及自主控制,双模式控制医疗用机器人内各装置,各模块,各节点。远端客户端与机器人主系统间利用通信模块通信,控制各装置。远端控制及自主控制双机器臂动作,机器扫查臂与超声扫查装置连接,信息验证机器臂与信息采集读取装置连接,通过管理员调解设置参数及通过神经网络改进方法训练机器人学习规划动作及自适应调解设置动作规划参数,用于动作规划,实现所述的采集医疗图像,视频,读取识别二维码,数字码,文字,标识,生物信息,RFID信息,患者,用户信息。
  3. 根据权利要求1所述的一种医疗用机器人装置,其特征在于,语音装置及语音模块,机器人主系统与语音装置连接,用于采集并识别声音,用户间管理员间的语音交互,问诊。
    语音装置包括:声音采集装置,语音输入装置,语音输出装置;
    语音模块包括:语音识别,语音文字互转,语音合成,声纹识别,语音指令,语音引导功能。
  4. 根据权利要求1所述的一种医疗用机器人装置,其特征在于,视觉采集装置及视觉识别模块,机器人主系统与视觉采集装置连接,用于采集图像,视频,识别图像,视频;
    所述的视觉采集装置包括:平面视觉装置,深度视觉装置,超声装置;
    视觉识别模块包括:
    平面图像识别包括:人脸图像及位置识别,五官图像及位置识别,人体特征点及位置识别,医疗场景识别;
    深度图像识别包括:骨骼图像及位置识别,关节图像及位置识别,关键关节及位置识别,人体的特征点及位置识别,特殊特征以及其位置的识别;
    超声装置采集的医疗图像,视频识别包括:超声装置扫查的血管,器官,器官形状,结构,轮廓,颜色的特征点识别,病症的特征识别,超声采集的图像,视频识别。
  5. 根据权利要求1所述的一种医疗用机器人装置,其特征在于,雷达自主移动医疗场景识别建图模块,
    所述雷达自主移动医疗场景识别建图模块是将雷达,视觉装置与机器人主系统连接,
    雷达自主定位、导航、实时建图,
    视觉装置及智能识别方法识别人脸及医疗场景,医疗场景包括:地址、科室、病房门牌的字母、数字、文字、床位号与雷达实时建图融合,自主定位、导航、移动至对应科室、病房、床位、用户位置。
  6. 根据权利要求1所述的一种医疗用机器人装置,其特征在于,双机器臂,所述的机器臂包括机器扫查臂与信息验证机器臂,
    所述的机器扫查臂,与扫查装置,压力装置连接,用于采集医疗图像,视频;
    所述的信息验证机器臂,与信息采集装置,信息扫描装置,读取装置连接,与机器人主系统,视觉装置连接,用于采集,扫描,读取数字码,二维码,RFID,生物特征,智能识别读取二维码,数字码,文字,标识,生物信息,RFID信息,患者用户信息。
    与卧位,位姿,角度调解装置连接,致动卧位,位姿,角度调解装置,使医疗对象按标准的扫查要求,调解各扫查任务的位置,角度,方向。
  7. 根据权利要求1所述的一种医疗用机器人装置,其特征在于,超声诊疗装置及医疗图像视频采集共享模块,所述的超声诊疗装置及医疗图像视频采集共享模块与机器人主系统连接,用于远端控制及自主采集医疗图像,视频,共享医疗图像,视频,远端会诊,多科室联合会诊。
  8. 根据权利要求1所述的一种医疗用机器人装置,其特征在于,超声探头扫查装置及压力装置,所述的超声探头扫查装置与机器扫查臂,压力装置连接,机器人主系统及远端客户端控制超声探头扫查装置与机器臂移动,扫查,采集图像,视频。
    压力装置,所述的压力装置与超声探头扫查装置,机器扫查臂连接,机器人主系统及远端客户端控制压力装置施压,探头扫查。
  9. 根据权利要求1所述的一种医疗用机器人装置,其特征在于,所述的信息验证机器臂,与信息采集装置,信息扫描装置,读取装置连接,与机器人主系统,视觉装置连接,用于采集,扫描,读取数字码,二维码,RFID,生物特征,智能识别读取二维码,数字码,文字,标识,生物信息,RFID信息,患者用户信息。
    所述的信息验证机器臂,与机器人主系统,卧位,位姿,角度调解装置连接,致动卧位,位姿,角度调解装置,使医疗对象按标准的扫查要求,调解各扫查任务的位置,角度,方向。
  10. 一种医疗用机器人装置、系统及方法,其特征在于,一种最优化任务配置管理系统,其特征在于,包括:一种医疗用机器人装置、多个科室的医护任务子系统和1个呼叫子系统,所述医疗用机器人装置为上述任一方案中医疗用机器人装置,所有多个科室的医护任务子系统和1个呼叫系子统与机器人主控制系统连接,搭建在最优化任务管理系统平台上。
    进一步,一种远端控制及自主定位导航移动,最优化任务配置方法,其包括以下步骤:
    S1、管理员,医生通信模块,发布采集任务,采集的时间信息,位置信息,医嘱消息,服务。
    S2、利用最优化任务配置方法,动态分配任务至机器人装置。
    进一步,动态的任务分配方法:一种动态最优化的任务配置,路径规划方法,采用最优化的方法规划任务,目标为最短的时间完成所有任务。最优化的方法包括:遗传计算方法及其改进方法,禁忌搜索计算方法及其改进方法,模拟退火计算方法及其改进方法,蚁群计算方法及其改进方法,粒子束最优化的计算方法及其改进方法,神经网络计算方法及其改进方法,进化方法及其改进方法中的一种及多种联合方法。
    S3、机器人利用通信模块,发布病患位置信息包括:病患病房,门诊,科室,床位位置信息,雷达定位导航模块订阅病患位置信息,自主移动到采集区。
    S4、机器人利用视觉模块,识别通信模块发布信息服务,雷达定位导航模块订阅位置信息服务,自主移动到采集区。
    S5、机器人利用通信模块发布采集位置,任务信息,时间信息,机器臂订阅固定装置,采集位置信息,动作规划模块订阅位置信息。
    S6、机器人依照步骤S6的位置信息,按照动作规划模块,采集超声数据,超声图像动作。
    S7、返回任务完成信息至管理员。如果未完成,将任务移入下一时间段。
PCT/CN2022/000120 2021-08-23 2022-08-18 一种医疗用机器人装置、系统及方法 WO2023024399A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
AU2022333762A AU2022333762A1 (en) 2021-08-23 2022-08-18 Medical robot apparatus, system and method
CN202280056991.8A CN118338997A (zh) 2021-08-23 2022-08-18 一种医疗用机器人装置,系统及方法

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110978141.0A CN113858219A (zh) 2021-08-23 2021-08-23 一种医疗用机器人装置、系统及方法
CN202110978141.0 2021-08-23

Publications (1)

Publication Number Publication Date
WO2023024399A1 true WO2023024399A1 (zh) 2023-03-02

Family

ID=78988251

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/000120 WO2023024399A1 (zh) 2021-08-23 2022-08-18 一种医疗用机器人装置、系统及方法

Country Status (3)

Country Link
CN (2) CN113858219A (zh)
AU (1) AU2022333762A1 (zh)
WO (1) WO2023024399A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113858219A (zh) * 2021-08-23 2021-12-31 谈斯聪 一种医疗用机器人装置、系统及方法
WO2023167830A1 (en) * 2022-03-01 2023-09-07 The Johns Hopkins University Autonomous robotic point of care ultrasound imaging
CN115881288B (zh) * 2023-03-03 2023-05-12 四川省肿瘤医院 静脉置管管理系统

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005334578A (ja) * 2004-05-24 2005-12-08 Hiromi Kumon 知能化ロボットによる無侵襲排尿障害診断システム
CN102323817A (zh) * 2011-06-07 2012-01-18 上海大学 一种服务机器人控制平台系统及其多模式智能交互与智能行为的实现方法
CN110405789A (zh) * 2019-08-01 2019-11-05 昆山市工研院智能制造技术有限公司 一种查房陪护机器人、机器人查房陪护系统及方法
CN110477956A (zh) * 2019-09-27 2019-11-22 哈尔滨工业大学 一种基于超声图像引导的机器人诊断系统的智能扫查方法
CN111687852A (zh) * 2020-06-07 2020-09-22 厦门波耐模型设计有限责任公司 医疗急救机器人装置、方法及系统
CN111906785A (zh) * 2020-07-23 2020-11-10 谈斯聪 多模式综合信息识别移动式双臂机器人装置系统及方法
CN111916195A (zh) * 2020-08-05 2020-11-10 谈斯聪 一种医疗用机器人装置,系统及方法
CN113858219A (zh) * 2021-08-23 2021-12-31 谈斯聪 一种医疗用机器人装置、系统及方法

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109129502A (zh) * 2018-08-28 2019-01-04 苏州德品医疗科技股份有限公司 一种应用于临床医护的智能机器人
CN111973228A (zh) * 2020-06-17 2020-11-24 谈斯聪 B超数据采集分析诊断一体化机器人,平台

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005334578A (ja) * 2004-05-24 2005-12-08 Hiromi Kumon 知能化ロボットによる無侵襲排尿障害診断システム
CN102323817A (zh) * 2011-06-07 2012-01-18 上海大学 一种服务机器人控制平台系统及其多模式智能交互与智能行为的实现方法
CN110405789A (zh) * 2019-08-01 2019-11-05 昆山市工研院智能制造技术有限公司 一种查房陪护机器人、机器人查房陪护系统及方法
CN110477956A (zh) * 2019-09-27 2019-11-22 哈尔滨工业大学 一种基于超声图像引导的机器人诊断系统的智能扫查方法
CN111687852A (zh) * 2020-06-07 2020-09-22 厦门波耐模型设计有限责任公司 医疗急救机器人装置、方法及系统
CN111906785A (zh) * 2020-07-23 2020-11-10 谈斯聪 多模式综合信息识别移动式双臂机器人装置系统及方法
CN111916195A (zh) * 2020-08-05 2020-11-10 谈斯聪 一种医疗用机器人装置,系统及方法
CN113858219A (zh) * 2021-08-23 2021-12-31 谈斯聪 一种医疗用机器人装置、系统及方法

Also Published As

Publication number Publication date
CN118338997A (zh) 2024-07-12
CN113858219A (zh) 2021-12-31
AU2022333762A1 (en) 2024-04-11

Similar Documents

Publication Publication Date Title
WO2023024399A1 (zh) 一种医疗用机器人装置、系统及方法
WO2022027921A1 (zh) 一种医疗用机器人装置、系统及方法
US20220331028A1 (en) System for Capturing Movement Patterns and/or Vital Signs of a Person
CA2827523C (en) System and method for performing an automatic and self-guided medical examination
CN108942952A (zh) 一种医疗机器人
US20120130739A1 (en) Unsupervised Telemedical Office for Remote &/or Autonomous & Automated Medical Care of Patients
WO2023024396A1 (zh) 视觉图像与医疗图像融合识别、自主定位扫查方法
CN112002392A (zh) 一种基于数字三维人体模型的精准分诊、预约诊疗的方法及系统
CN104881572A (zh) 基于网络医院的远程辅助诊疗系统及远程辅助诊疗方法
CN112785278A (zh) 一种基于边云协同的5g智能移动查房方法及系统
CN202206423U (zh) 一种远程医疗系统及智能家居医疗系统
WO2023024398A1 (zh) 智能识别胸部器官、自主定位扫查胸部器官的方法
CN113012823A (zh) 一种用于心电图机的云平台系统
CN111613293A (zh) 一种用于脑卒中偏瘫患者的下肢动作捕捉和远程康复指导系统
WO2023024397A1 (zh) 一种医疗用机器人装置、系统及方法
CN111563932B (zh) 一种交叠共轴外科手术控制方法、系统及可读存储介质
CN116725487A (zh) 激光美容诊疗区域识别系统
CN104856650A (zh) 患者端远程辅助诊疗设备及远程辅助诊疗方法
CN115589420A (zh) 一种基于云计算的医疗物联网远程服务系统
CN113889251A (zh) 一种医院用的绿色通道患者就诊分类就医服务管理平台
Jamjoum et al. Smart Portable Patient Monitoring System
CN116825390A (zh) 无接触式多功能医疗巡诊系统
Deng et al. Robotic aids for ecg monitoring and diagnosis in assisted living environments
CN117690541B (zh) 一种护理记录系统
KR102256156B1 (ko) 소독 스테이션을 구비하는 원격 진단 시스템

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22859761

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 202280056991.8

Country of ref document: CN

WWE Wipo information: entry into national phase

Ref document number: 2022333762

Country of ref document: AU

Ref document number: AU2022333762

Country of ref document: AU

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2022333762

Country of ref document: AU

Date of ref document: 20220818

Kind code of ref document: A

122 Ep: pct application non-entry in european phase

Ref document number: 22859761

Country of ref document: EP

Kind code of ref document: A1