WO2023024397A1 - Medical robot apparatus, system and method - Google Patents

Medical robot apparatus, system and method Download PDF

Info

Publication number
WO2023024397A1
WO2023024397A1 PCT/CN2022/000118 CN2022000118W WO2023024397A1 WO 2023024397 A1 WO2023024397 A1 WO 2023024397A1 CN 2022000118 W CN2022000118 W CN 2022000118W WO 2023024397 A1 WO2023024397 A1 WO 2023024397A1
Authority
WO
WIPO (PCT)
Prior art keywords
robot
scanning
medical
module
joints
Prior art date
Application number
PCT/CN2022/000118
Other languages
French (fr)
Chinese (zh)
Inventor
谈斯聪
于皓
于梦非
Original Assignee
谈斯聪
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 谈斯聪 filed Critical 谈斯聪
Priority to AU2022332824A priority Critical patent/AU2022332824A1/en
Priority to CN202280056989.0A priority patent/CN118265498A/en
Publication of WO2023024397A1 publication Critical patent/WO2023024397A1/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30Surgical robots
    • A61B34/35Surgical robots for telesurgery
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/05Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves 
    • A61B5/055Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves  involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/02Arrangements for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
    • A61B6/03Computed tomography [CT]
    • A61B6/032Transmission computed tomography [CT]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/02Arrangements for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
    • A61B6/03Computed tomography [CT]
    • A61B6/037Emission tomography

Definitions

  • the invention belongs to the application of artificial intelligence robot technology to the medical field, and relates to robot technology, an artificial intelligence image intelligent recognition method, intelligent equipment and a system.
  • the purpose of the present invention is to overcome the shortcomings and deficiencies of the above-mentioned prior art, and to provide a medical robot device, which utilizes a remote, autonomous robot to collect medical image devices, and solves artificial scanning, inspection, collection, diagnosis and treatment errors, and a single The limitations of the diagnosis and treatment department and the singleness of the diagnosis plan.
  • the radar and the mobile base realize autonomous movement, map positioning and navigation, and solve the problem of mobile collection.
  • Plane vision device intelligently identify plane information, depth information such as bones, intelligently identify human organs, and scan and collect positions.
  • X-ray imaging device direct digital imaging DR device, computerized tomography imaging CT device, magnetic resonance MR device, PET positron emission computed tomography imaging device, intelligent identification, autonomous positioning, scanning task organs.
  • the remote control of the robot and autonomous acquisition can be realized, and the problems of high operating pressure and various acquisition tasks for medical staff can be solved.
  • a robotic device for medical use comprising:
  • the robot main system is used to connect and control the robot device module, including: voice module, vision module and visual recognition module, radar autonomous positioning navigation mobile module, medical device and module, robot arm and action planning module .
  • Voice device and voice module the main system of the robot is connected with the voice device for collecting and recognizing voice, voice interaction between users and administrators, and voice commands;
  • the radar autonomous positioning and navigation mobile module includes:
  • Mobile base connected to the radar, connected to the main system of the robot, for movement;
  • Radar connected with the main system of the robot, connected with the mobile base, used for autonomous mapping, positioning, and navigation;
  • Medical devices and modules including: medical imaging devices, scanning devices, scanning radiation mediation devices, radiation protection devices, the medical devices are one or more of the following devices,
  • X-ray imaging device direct digital imaging DR device, computerized tomography imaging CT device, magnetic resonance MR device, PET positron emission computed tomography imaging device,
  • direct digital imaging DR device includes:
  • the X-ray emitting device is an X-ray generator for generating X-rays.
  • X-ray irradiation scanning device connected with the main system of the robot, integrated with the robot arm, as a scanning device for the scanning robot arm, emits x-rays, and the scanning robot arm is used to collect medical images
  • the robot arm is a U-shaped arm, a C-shaped arm ;
  • X-ray imaging devices are used to examine the brain, cervical spine, lumbar spine, thoracic spine, and bone joints;
  • the flat-panel detection device is used to receive X-rays and assist in the collection of X-ray images.
  • the flat-panel detection device is detachable and connected to the information verification robot arm to receive X-rays and assist in the collection of X-ray images.
  • the flat-panel detection device is connected to the information verification robot arm and is detachable.
  • the robot main system and the remote client control the robot arm and the flat-panel detection device to separate, combine and move.
  • CT device computerized tomography imaging device, the computerized tomography imaging device, connected with the scanning device and the main robot system, is used to check the cranium, cervical cone, lumbar spine, thoracic spine, abdomen, bone joints,
  • the heart, the scanning device is a circular robotic arm;
  • MRI device magnetic resonance device, the magnetic resonance device, connected with the scanning device, connected with the robot main system, is used to examine the cranium, cervical cone, lumbar spine, thoracic spine, bone, cartilage, soft tissue, muscle, chest, blood vessel,
  • the abdomen, bone joints, heart, and the scanning device are ring-shaped robotic arms;
  • PET device positron emission computed tomography imaging device
  • said positron emission tomography imaging device connected with scanning device, with robot main system, is used for examining cranium, cervical cone, lumbar spine, thoracic spine, bone, cartilage , soft tissue, muscle, chest, blood vessel, abdomen, bone joint, heart
  • the scanning device is a circular robotic arm;
  • Scanning and irradiation mediation device used for scanning, irradiating parts, mediating the position, height, angle, direction and various scanning irradiation parameters of bones and joints;
  • Radiation protection device for radiation protection for radiation protection
  • the visual collection device and the visual recognition module are used for collecting images and videos, and recognizing images and videos.
  • Robotic arms including scanning robotic arms and information verification robotic arms, are used to collect medical images and scan and read information.
  • Voice device and voice module the main robot system is connected with the voice device for collecting and recognizing voice, voice interaction between users and administrators, voice command, voice consultation and voice guidance.
  • Communication module remote control and autonomous control image acquisition module, the communication module is connected with the robot main system and remote client, the communication module includes wireless communication module, bluetooth communication module, wired Internet communication module, radio frequency communication, radio One or more communication methods in communication.
  • Medical devices include: medical imaging devices, scanning devices, scanning irradiation mediation devices, radiation protection devices,
  • the medical device is one or more of the following devices,
  • X-ray imaging device direct digital imaging DR device, computerized tomography imaging CT device, magnetic resonance MR device, PET positron emission computed tomography imaging device;
  • the robotic arm can be remotely controlled and autonomously controlled
  • the robotic arm includes a scanning robotic arm, an information verification robotic arm, a scanning robotic arm and a scanning device to collect medical images
  • the remote control is through management
  • the user remotely controls and mediates setting parameters
  • the self-controlled scanning device collects medical images, trains actions and adaptively mediates parameters of the scanning device through the neural network and its improved method, and sets action planning parameters for action planning.
  • the collection of medical images and videos, the collection module includes: medical images and video collection modules.
  • the scanning robot arm is connected with the main system of the robot and integrated with the robot arm.
  • the robot arm is a U-shaped arm, a C-shaped arm, and a ring-shaped robot arm.
  • the scanning and irradiation mediation device is integrated with the scanning robot arm and connected with the main robot system, so that the medical object can move, lift and rotate the scanning robot arm according to the standard scanning requirements, and mediate the irradiation position of the scanning task. Bones, joint positions, heights, angles, directions.
  • An information collection and reading device includes: an information collection device, an information scanning device, the reading device is connected to an information verification robot arm, and is used as an information reading robot arm for scanning digital codes, two-dimensional codes , RFID, biometrics, intelligent identification to read two-dimensional codes, digital codes, text, logos, biological information, RFID information, patients, user information.
  • a visual acquisition device and a visual recognition module the main robot system is connected with the visual acquisition device for collecting images, videos, identifying images, and videos.
  • the visual acquisition device includes: a plane vision device and a depth vision device;
  • Visual recognition module including: planar vision device and planar image recognition, depth vision device and depth image recognition, used for image and video recognition,
  • Planar vision devices and planar image recognition include: face image recognition, facial features image recognition, human body feature recognition, and medical scene recognition.
  • Depth vision device and depth image recognition include: bone image, joint image, feature position recognition, key joint position and other special feature recognition of the human body, combined with positioning, to scan human organs.
  • the fusion of radar and vision devices is used for autonomous mapping, positioning, and navigation.
  • the radar is connected to the mobile base for movement.
  • the mobile base, radar, and vision devices are connected to the main robot system for autonomous positioning and navigation.
  • the fusion of plane image and depth vision image intelligently recognizes the intelligent recognition method of human facial features, bones, joints, organs, tissues, human body features and their positions. Bones, joints, human body feature points and their positions are autonomously positioned, scanned and inspected for organ tissues, and the method includes the following steps:
  • bone model including: head bones, facial bones, skull, neck bones, vertebrae, scapula, shoulder joints, shoulder bones, sternum, ribs, thoracic spine, waist bones, Spine, sacrum, coccyx, left and right upper limb bones, elbow joints, wrist joints, hand joints, waist joints, knee joints, ankle joints, foot joints and their positions are used as feature items, using neural network algorithms and their improved methods to intelligently identify bones and For its position, the depth information and the position information of the human body where the skeleton is located and the information of the adjacent characteristic organs identified by the general image model described in S1 are combined as the feature items of the bone intelligent recognition model as input items;
  • S5. Delineate the part to be scanned, scan area, return to scan range, position area, collect position coordinates, autonomous positioning, and move the device;
  • the medical imaging device and the scanning device are positioned independently, and moved to the position of the tissue and organ, the corresponding organ and bone;
  • Extracting the appearance features of the disease and the graphic features of the organ image including: the outline, color, texture, grayscale contrast, shape, position, color, structure and graphical feature items of the disease of the organ;
  • Figure 1 is a schematic diagram of a medical robot device module in the specification of this application.
  • 101-Robot main system module 101-Robot main system module; 102-Robot arm scanning acquisition action planning module; 103-Vision module;
  • 106-Robot arm grasping and scanning code movement planning module 107-Information collection and reading device and module;
  • Figure 2 is a schematic diagram of the composition and structure of the medical robot device in the specification of this application;
  • 201 Vision acquisition device 202-Robot main system; 203-Medical device; 204-Scanning irradiation mediation device;
  • 209-mobile device 210-information scanning device; 211-radar; 212-voice device; 213-radiation protection device;
  • the purpose of the present invention is to design a remote control robot that can replace human work, realize remote control of robot arm acquisition, and effectively solve autonomous scanning, acquisition of medical images and videos.
  • artificial intelligence robot technology autonomous collection in the field of automation, robot arm motion planning technology, plane vision device to collect human face, facial features, external features of human body, depth vision device to collect bone and joint images.
  • the medical robot device uses the remote end, and the robot autonomously collects medical image devices.
  • the mobile base realizes autonomous movement, constructs maps, locates and navigates, and solves the problem of mobile collection.
  • Use plane vision device and depth vision device to intelligently identify plane information, skeleton and depth information.
  • a robotic device for medical use comprising:
  • Robot main system 101 the robot main system module is used to connect and control the robot device module, including: voice module 105, vision module and visual recognition module 103, radar autonomous positioning navigation mobile module 108, medical device and module 104, machine Arm and motion planning module.
  • voice module 105 voice module 105
  • vision module and visual recognition module 103 radar autonomous positioning navigation mobile module 108
  • medical device and module 104 machine Arm and motion planning module.
  • Voice device 212 and voice module 105 robot main system 101 is connected with voice device 212, is used for collecting and recognizing sound, voice interaction between administrators between users, voice command;
  • the radar autonomous positioning and navigation mobile module includes:
  • the mobile base 209 is connected with the radar 211 and connected with the main robot system 101 for moving;
  • the radar 211 is connected with the main robot system 101 and the mobile base 209 for autonomous mapping, positioning and navigation;
  • Medical device and module 104 including: medical imaging device, scanning device, scanning irradiation mediation device, radiation protection device, the medical device described is one or more of the following devices,
  • X-ray imaging device 203 direct digital imaging DR device, computerized tomography imaging CT device, magnetic resonance MR device, PET positron emission computed tomography imaging device,
  • direct digital imaging DR device includes:
  • the X-ray emitting device 204 is an X-ray generator for generating X-rays.
  • X-ray irradiation scanning device connected with the main system of the robot, integrated with the robot arm, as a scanning device for the scanning robot arm, emits x-rays, and the scanning robot arm is used to collect medical images
  • the robot arm is a U-shaped arm, a C-shaped arm ;
  • X-ray imaging devices are used to examine the brain, cervical spine, lumbar spine, thoracic spine, and bone joints;
  • the flat-panel detection device 207 is used to receive X-rays and assist in the acquisition of X-ray images.
  • the flat-panel detection device is detachable and connected to the information verification robot arm to receive X-rays and assist in the acquisition of X-ray images.
  • the flat-panel detection device is connected to the information verification robot arm and is detachable.
  • the robot main system and the remote client control the robot arm and the flat-panel detection device to separate, combine and move.
  • CT device computerized tomography imaging device, the computerized tomography imaging device, connected with the scanning device and the main robot system, is used to check the cranium, cervical cone, lumbar spine, thoracic spine, abdomen, bone joints,
  • the heart, the scanning device is a circular robotic arm;
  • MRI device magnetic resonance device
  • the magnetic resonance device is connected with the scanning device and the robot main system 101, and is used to examine the cranium, cervical cone, lumbar spine, thoracic spine, bone, cartilage, soft tissue, muscle, chest, blood vessel , abdomen, bone joints, heart, the scanning device is a ring-shaped robotic arm;
  • PET device positron emission computed tomography imaging device, described positron emission computed tomography imaging device, is connected with the scanning device and the main robot system 101, and is used to examine the cranium, cervical cone, lumbar spine, thoracic spine, bone, cartilage.
  • the visual collection device and the visual recognition module 103 are used for collecting images and videos, and recognizing images and videos.
  • the robot arm including the robot scanning arm 206 and the information verification robot arm 208, is used to collect medical images and scan and read information.
  • the voice device 212 and the voice module 105, the main robot system 101 is connected with the voice device 212, and is used for collecting and recognizing sounds, voice interaction between users and administrators, voice commands, voice consultation and voice guidance.
  • Communication module 110 remote control and autonomous control image acquisition module, the communication module is connected with the robot main system and the remote client, the communication module includes a wireless communication module, a bluetooth communication module, a wired Internet communication module, radio frequency communication, One or more communication methods in radio communication.
  • the scanning task read the organs and tissues that need to be scanned and inspect, extract the face, facial features, neck, nipples, breasts, navel, characteristic genitals, characteristic parts and their positions from the plane image of the human body and input them into the neural network algorithm as feature items
  • intelligent recognition marking human body feature points and their positions, extracting head bones, neck spine bones, clavicle, shoulder bones, shoulder joints, left and right upper limb bones, elbow joints, wrist joints, Hand joints, lungs, ribs, spine, waist joints, knee joints, ankle joints, and foot joints are input into the neural network algorithm and its improvement method as feature items, intelligently identify bones and their positions, and intelligently identify the characteristic parts and positions of human organs.
  • the medical imaging device and the scanning device are positioned independently , move to the location of tissues and organs, corresponding organs and bones, scan corresponding organs and bones, obtain images of organs and bones, create disease models corresponding to organs, tissues, and parts, establish mathematical models for image recognition, and extract the appearance of diseases
  • graphic features of organ images including: organ outline, color, texture, grayscale contrast, shape, position, color, structure, and graphic feature items of diseases, using improved deep neural network to adjust weight parameters to obtain output values According to the range of the output value to identify the normal signs of the corresponding organ or the disease, intelligently identify the organ and its disease, intelligently circle the disease mask of the disease on the image, and the position of the suspected disease mask.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Medical Informatics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Surgery (AREA)
  • Public Health (AREA)
  • Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Veterinary Medicine (AREA)
  • High Energy & Nuclear Physics (AREA)
  • Radiology & Medical Imaging (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Optics & Photonics (AREA)
  • Robotics (AREA)
  • Pulmonology (AREA)
  • Theoretical Computer Science (AREA)
  • Magnetic Resonance Imaging Apparatus (AREA)
  • Apparatus For Radiation Diagnosis (AREA)

Abstract

A medical robot apparatus, system and method. The medical robot apparatus is a medical remote robot apparatus for autonomous diagnosis and adjuvant therapy using artificial intelligence robot technology. The apparatus comprises: a robot main system (202), which is connected to an imaging apparatus, such as an MRI apparatus and a CT apparatus, and performs remote control and autonomous control to collect a medical image. By means of a radar (211), a movable base (209) realizes autonomous mapping, positioning, navigation and movement, so as to solve the problem of moving collection. The medical robot apparatus is connected to a plane vision apparatus and a deep vision apparatus, and intelligently identifies plane information, and depth information such as of a skeleton. By means of the medical robot apparatus, remote control over image collection, and autonomous collection can be realized, thereby reducing a burden of a caregiver, and improving the flexibility of remote image sharing and remote inquiry by an expert and a doctor.

Description

一种医疗用机器人装置、系统及方法A medical robot device, system and method 技术领域technical field
本发明属于人工智能机器人技术应用于医疗领域,涉及机器人技术,人工智能图像智能识别方法,智能化设备及系统。The invention belongs to the application of artificial intelligence robot technology to the medical field, and relates to robot technology, an artificial intelligence image intelligent recognition method, intelligent equipment and a system.
背景技术Background technique
目前应用于医疗领域,在检查过程,由于各种人为因素分析,医疗图像,视频采集质量差,标准化程度低,识别病情精准度差。在目前检查过程中移动采集,床旁采集,智能识别扫查器官位置自主采集,管理员远端控制,自主控制,远端联合会诊,病房专家联合查房,联合治疗的机器人装置,机器人平台涉及机器人理论,实践技术。Currently used in the medical field, during the inspection process, due to the analysis of various human factors, the quality of medical image and video acquisition is poor, the degree of standardization is low, and the accuracy of identifying the disease is poor. In the current inspection process, mobile collection, bedside collection, intelligent recognition of scanning organ location autonomous collection, remote control by administrators, autonomous control, remote joint consultation, joint ward rounds with ward experts, robot devices for joint treatment, and robot platforms involving robots Theory, practical techniques.
因疫情,肺部感染,新冠传染性高,X光,DR,CT,MRI,PET,电子计算机断层扫描显像装置,与扫描装置,与机器人主系统连接,自主建图,定位,导航,移动。利用机器人搭载的机器臂,视觉装置,深度视觉装置及各种神经网络方法及其改进方法,智能识别器官及位置,用于检查颅脑,颈锥,腰椎,胸椎,腹部,骨关节,心脏,采集传染性高,效率低下,人工采集不精准,瘟疫传播问题严重,利用机器臂远端及自主采集医疗图像,视频。采集医疗图像,视频,实现远端采集,自主采集,有效防止传染病,瘟疫等重大疾病蔓延。Due to the epidemic, lung infection, high infectivity of the new crown, X-ray, DR, CT, MRI, PET, computerized tomography imaging device, connected with the scanning device, connected with the main robot system, autonomous mapping, positioning, navigation, movement . Using the robot arm, vision device, depth vision device and various neural network methods and their improvement methods, intelligently identify organs and their positions, and use them to check the cranium, cervical spine, lumbar spine, thoracic spine, abdomen, bone joints, heart, Collection is highly contagious, inefficient, manual collection is inaccurate, and the problem of plague transmission is serious. Use the remote end of the robotic arm to collect medical images and videos autonomously. Collect medical images and videos, realize remote collection, autonomous collection, and effectively prevent the spread of infectious diseases, plague and other major diseases.
技术问题technical problem
本发明的目的就在于克服上述现有技术的缺点和不足,提供一种医疗用机器人装置,利用远端,自主机器人采集医疗图像装置,解决了人为的扫查,检查采集诊断治疗失误,以及单一诊疗科的局限性及诊断方案的单一性等问题。The purpose of the present invention is to overcome the shortcomings and deficiencies of the above-mentioned prior art, and to provide a medical robot device, which utilizes a remote, autonomous robot to collect medical image devices, and solves artificial scanning, inspection, collection, diagnosis and treatment errors, and a single The limitations of the diagnosis and treatment department and the singleness of the diagnosis plan.
雷达,移动底座实现自主移动,建图定位导航,解决移动采集问题。The radar and the mobile base realize autonomous movement, map positioning and navigation, and solve the problem of mobile collection.
平面视觉装置,深度视觉装置,智能识别平面信息,骨骼等深度信息,智能识别人体器官,扫查采集位置。Plane vision device, depth vision device, intelligently identify plane information, depth information such as bones, intelligently identify human organs, and scan and collect positions.
X射线成像装置,直接数字成像DR装置,电子计算机断层扫描显像CT装置,磁共振MR装置,PET正电子发射计算机断层扫描成像装置,智能识别,自主定位,扫查任务器官。X-ray imaging device, direct digital imaging DR device, computerized tomography imaging CT device, magnetic resonance MR device, PET positron emission computed tomography imaging device, intelligent identification, autonomous positioning, scanning task organs.
通过机器人搭载的医疗图像采集装置,实现机器人远端控制,自主采集,解决医护人员作业压力大,采集任务繁多等问题。提高专家,医生远端实时问诊,查房,多科室联合会诊的灵活性实时性,高效率多治疗方案多专家共同意见解决临床案例。Through the medical image acquisition device carried by the robot, the remote control of the robot and autonomous acquisition can be realized, and the problems of high operating pressure and various acquisition tasks for medical staff can be solved. Improve the flexibility and real-time performance of experts and doctors' remote real-time consultation, ward rounds, and multi-department joint consultation, and solve clinical cases with high-efficiency multi-treatment plans and multi-expert joint opinions.
本发明的采用的技术方案The technical scheme adopted in the present invention
一种医疗用机器人装置包括:A robotic device for medical use comprising:
机器人主系统,所述机器人主系统模块,用于连接并控制机器人装置模块,包括:语音模块,视觉模块及视觉识别模块,雷达自主定位导航移动模块,医疗装置及模块,机器臂及动作规划模块。The robot main system, the robot main system module, is used to connect and control the robot device module, including: voice module, vision module and visual recognition module, radar autonomous positioning navigation mobile module, medical device and module, robot arm and action planning module .
语音装置及语音模块,机器人主系统与语音装置连接,用于采集并识别声音,用户间管理员间的语音交互,语音命令;Voice device and voice module, the main system of the robot is connected with the voice device for collecting and recognizing voice, voice interaction between users and administrators, and voice commands;
雷达自主定位导航移动模块包括:The radar autonomous positioning and navigation mobile module includes:
移动底座,与雷达连接,与机器人主系统连接,用于移动;Mobile base, connected to the radar, connected to the main system of the robot, for movement;
雷达,与机器人主系统连接,与移动底座连接,用于自主建图,定位,导航;Radar, connected with the main system of the robot, connected with the mobile base, used for autonomous mapping, positioning, and navigation;
医疗装置及模块,包括:医疗成像装置,扫描装置,扫描照射调解装置,防辐射装置,所述的医疗装置为以下装置中的一种及多种,Medical devices and modules, including: medical imaging devices, scanning devices, scanning radiation mediation devices, radiation protection devices, the medical devices are one or more of the following devices,
X射线成像装置,直接数字成像DR装置,电子计算机断层扫描显像CT装置,磁共振MR装置,PET正电子发射计算机断层扫描成像装置,X-ray imaging device, direct digital imaging DR device, computerized tomography imaging CT device, magnetic resonance MR device, PET positron emission computed tomography imaging device,
X射线成像装置,直接数字成像DR装置包括:X-ray imaging device, direct digital imaging DR device includes:
X射线发射装置,为X射线发生器,用于产生X射线。The X-ray emitting device is an X-ray generator for generating X-rays.
X射线照射扫描装置,与机器人主系统连接,与机器臂一体化,作为扫描机器臂的扫查装置,发射X射线,扫描机器臂用于采集医疗图像,机器臂为U型臂,C型臂;X-ray irradiation scanning device, connected with the main system of the robot, integrated with the robot arm, as a scanning device for the scanning robot arm, emits x-rays, and the scanning robot arm is used to collect medical images, the robot arm is a U-shaped arm, a C-shaped arm ;
X射线成像装置用于检查颅脑,颈锥,腰椎,胸椎,骨关节;X-ray imaging devices are used to examine the brain, cervical spine, lumbar spine, thoracic spine, and bone joints;
平板探测装置,用于接收X射线,辅助采集X射线图像,所述的平板探测装置,可分离式,与信息验证机器臂连接,用于接收X光,辅助采集X光图像。所述的平板探测装置,与信息验证机器臂连接,可分离式,机器人主系统及远端客户端控制机器臂与平板探测装置拆分,结合,移动。The flat-panel detection device is used to receive X-rays and assist in the collection of X-ray images. The flat-panel detection device is detachable and connected to the information verification robot arm to receive X-rays and assist in the collection of X-ray images. The flat-panel detection device is connected to the information verification robot arm and is detachable. The robot main system and the remote client control the robot arm and the flat-panel detection device to separate, combine and move.
CT装置,电子计算机断层扫描显像装置,所述的电子计算机断层扫描显像装置,与扫描装置,与机器人主系统连接,用于检查颅脑,颈锥,腰椎,胸椎,腹部,骨关节,心脏,所述的扫描装置,为环状机器臂;CT device, computerized tomography imaging device, the computerized tomography imaging device, connected with the scanning device and the main robot system, is used to check the cranium, cervical cone, lumbar spine, thoracic spine, abdomen, bone joints, The heart, the scanning device, is a circular robotic arm;
MRI装置,磁共振装置,所述的磁共振装置,与扫描装置连接,与机器人主系统连接,用于检查颅脑,颈锥,腰椎,胸椎,骨,软骨,软组织,肌肉,胸部,血管,腹部,骨关节,心脏,所述的扫描装置,为环状机器臂;MRI device, magnetic resonance device, the magnetic resonance device, connected with the scanning device, connected with the robot main system, is used to examine the cranium, cervical cone, lumbar spine, thoracic spine, bone, cartilage, soft tissue, muscle, chest, blood vessel, The abdomen, bone joints, heart, and the scanning device are ring-shaped robotic arms;
PET装置,正电子发射计算机断层扫描成像装置,所述的正电子发射计算机断层扫描成像装置,与扫描装置,与机器人主系统连接,用于检查颅脑,颈锥,腰椎,胸椎,骨,软骨,软组织,肌肉,胸部,血管,腹部,骨关节,心脏,所述的扫描装置,为环状机器臂;PET device, positron emission computed tomography imaging device, said positron emission tomography imaging device, connected with scanning device, with robot main system, is used for examining cranium, cervical cone, lumbar spine, thoracic spine, bone, cartilage , soft tissue, muscle, chest, blood vessel, abdomen, bone joint, heart, the scanning device is a circular robotic arm;
扫描照射调解装置,用于扫描,照射部位,调解骨骼关节的位置,高度,角度,方向及 各项扫描照射参数;Scanning and irradiation mediation device, used for scanning, irradiating parts, mediating the position, height, angle, direction and various scanning irradiation parameters of bones and joints;
防辐射装置,用于防辐射;Radiation protection device for radiation protection;
视觉采集装置及视觉识别模块,用于采集图像,视频,识别图像,视频。The visual collection device and the visual recognition module are used for collecting images and videos, and recognizing images and videos.
机器臂,包括扫描机器臂及信息验证机器臂,用于采集医疗图像,扫描读取信息。Robotic arms, including scanning robotic arms and information verification robotic arms, are used to collect medical images and scan and read information.
语音装置及语音模块,机器人主系统与语音装置连接,用于采集并识别声音,用户间管理员间的语音交互,语音命令,语音问诊和语音引导。Voice device and voice module, the main robot system is connected with the voice device for collecting and recognizing voice, voice interaction between users and administrators, voice command, voice consultation and voice guidance.
通信模块,远端控制及自主控制采集图像模块,所述的通信模块与机器人主系统,远端客户端连接,通信模块包括,无线通信模块,蓝牙通信模块,有线互联网通信模块,射频通信,无线电通信中的一种及多种通信方式。Communication module, remote control and autonomous control image acquisition module, the communication module is connected with the robot main system and remote client, the communication module includes wireless communication module, bluetooth communication module, wired Internet communication module, radio frequency communication, radio One or more communication methods in communication.
医疗装置,所述的医疗装置,包括:医疗成像装置,扫描装置,扫描照射调解装置,防辐射装置,Medical devices, the medical devices include: medical imaging devices, scanning devices, scanning irradiation mediation devices, radiation protection devices,
所述的医疗装置为以下装置中的一种及多种,The medical device is one or more of the following devices,
X射线成像装置,直接数字成像DR装置,电子计算机断层扫描显像CT装置,磁共振MR装置,PET正电子发射计算机断层扫描成像装置;X-ray imaging device, direct digital imaging DR device, computerized tomography imaging CT device, magnetic resonance MR device, PET positron emission computed tomography imaging device;
机器臂,所述的机器臂可远端控制及自主控制,所述的机器臂包括扫描机器臂,信息验证机器臂,扫描机器臂及扫描装置采集医疗图像,所述的远端控制是通过管理员,用户远端控制调解设置参数,所述的自主控制扫描装置采集医疗图像,通过神经网络及其改进方法训练动作及自适应调解扫查装置参数,设置动作规划参数,用于动作规划,实现所述的采集医疗图像,视频,所述的采集模块包括:医疗图像,视频采集模块。The robotic arm, the robotic arm can be remotely controlled and autonomously controlled, the robotic arm includes a scanning robotic arm, an information verification robotic arm, a scanning robotic arm and a scanning device to collect medical images, and the remote control is through management The user remotely controls and mediates setting parameters, the self-controlled scanning device collects medical images, trains actions and adaptively mediates parameters of the scanning device through the neural network and its improved method, and sets action planning parameters for action planning. The collection of medical images and videos, the collection module includes: medical images and video collection modules.
所述的扫描机器臂与机器人主系统连接,与机器臂一体化,机器臂为U型臂,C型臂,环状机器臂The scanning robot arm is connected with the main system of the robot and integrated with the robot arm. The robot arm is a U-shaped arm, a C-shaped arm, and a ring-shaped robot arm.
扫描照射调解装置,所述的扫描照射调解装置,与扫描机器臂一体化,与机器人主系统连接,使医疗对象按标准的扫查要求,移动升降旋转扫描机器臂,调解扫查任务照射部位的骨骼,关节的位置,高度,角度,方向。Scanning and irradiation mediation device. The scanning and irradiation mediation device is integrated with the scanning robot arm and connected with the main robot system, so that the medical object can move, lift and rotate the scanning robot arm according to the standard scanning requirements, and mediate the irradiation position of the scanning task. Bones, joint positions, heights, angles, directions.
信息采集读取装置,所述的信息采集读取装置包括:信息采集装置,信息扫描装置,读取装置与信息验证机器臂连接,作为信息读取机器臂,用于扫描数字码,二维码,RFID,生物特征,智能识别读取二维码,数字码,文字,标识,生物信息,RFID信息,患者,用户信息。An information collection and reading device, the information collection and reading device includes: an information collection device, an information scanning device, the reading device is connected to an information verification robot arm, and is used as an information reading robot arm for scanning digital codes, two-dimensional codes , RFID, biometrics, intelligent identification to read two-dimensional codes, digital codes, text, logos, biological information, RFID information, patients, user information.
视觉采集装置及视觉识别模块,机器人主系统与视觉采集装置连接,用于采集图像,视频,识别图像,视频,所述的视觉采集装置包括:平面视觉装置,深度视觉装置;A visual acquisition device and a visual recognition module, the main robot system is connected with the visual acquisition device for collecting images, videos, identifying images, and videos. The visual acquisition device includes: a plane vision device and a depth vision device;
视觉识别模块,包括:平面视觉装置及平面图像识别,深度视觉装置及深度图像识别,用于图像视频识别,Visual recognition module, including: planar vision device and planar image recognition, depth vision device and depth image recognition, used for image and video recognition,
平面视觉装置及平面图像识别包括:人脸图像识别,五官图像识别,人体特征识别,医 疗场景识别。Planar vision devices and planar image recognition include: face image recognition, facial features image recognition, human body feature recognition, and medical scene recognition.
深度视觉装置及深度图像识别包括:骨骼图像,关节图像,特征位置识别,关键关节位置以及人体的其他特殊特征识别,结合定位,扫查人体器官。Depth vision device and depth image recognition include: bone image, joint image, feature position recognition, key joint position and other special feature recognition of the human body, combined with positioning, to scan human organs.
雷达与视觉装置融合用于自主建图,定位,导航,雷达与移动底座连接,用于移动,移动底座,雷达,视觉装置,与机器人主系统连接,用于自主定位导航,移动。The fusion of radar and vision devices is used for autonomous mapping, positioning, and navigation. The radar is connected to the mobile base for movement. The mobile base, radar, and vision devices are connected to the main robot system for autonomous positioning and navigation.
平面图像与深度视觉图像融合智能识别人体五官,骨骼,关节,器官,组织,人体特征及其位置的智能识别方法,所述方法是将平面视觉图像,深度图像融合,智能识别人体五官,器官,骨骼,关节,人体特征点及其位置自主定位扫描检查器官组织的方法,所述方法包括以下步骤:The fusion of plane image and depth vision image intelligently recognizes the intelligent recognition method of human facial features, bones, joints, organs, tissues, human body features and their positions. Bones, joints, human body feature points and their positions are autonomously positioned, scanned and inspected for organ tissues, and the method includes the following steps:
S1、依据扫查任务,读取需要扫描检查的器官,组织;S1. According to the scanning task, read the organs and tissues that need to be scanned;
S2、建立平面图像模型,特征模型,人体器官模型及平面图像的模型包括:人脸,五官,颈部,乳头,乳房,肚脐,特征生殖器,特征部位及其位置作为特征项,用神经网络算法及其改进方法,智能识别人体特征点及其位置;S2. Establishing a plane image model, a feature model, a human organ model and a plane image model including: face, facial features, neck, nipples, breasts, navel, characteristic genitals, characteristic parts and their positions as characteristic items, using neural network algorithm And its improved method, intelligent recognition of human body feature points and their positions;
S3、建立深度视觉装置及深度视觉图像模型,骨骼模型,包括:头部骨骼,面部骨骼,颅骨,颈部骨骼,椎骨,肩胛骨,肩关节,肩部骨骼,胸骨,肋骨,胸椎,腰部骨骼,脊柱,骶骨,尾骨,左右上肢骨骼,肘关节,腕关节,手关节,腰关节,膝关节,踝关节,足关节及其位置作为特征项,用神经网络算法及其改进方法,智能识别骨骼及其位置,将深度信息及骨骼所在人体的位置信息以及S1所述的一般图像模型识别的近邻特征器官信息作为骨骼智能识别模型的特征项结合,作为输入项;S3. Establish depth vision device and depth vision image model, bone model, including: head bones, facial bones, skull, neck bones, vertebrae, scapula, shoulder joints, shoulder bones, sternum, ribs, thoracic spine, waist bones, Spine, sacrum, coccyx, left and right upper limb bones, elbow joints, wrist joints, hand joints, waist joints, knee joints, ankle joints, foot joints and their positions are used as feature items, using neural network algorithms and their improved methods to intelligently identify bones and For its position, the depth information and the position information of the human body where the skeleton is located and the information of the adjacent characteristic organs identified by the general image model described in S1 are combined as the feature items of the bone intelligent recognition model as input items;
S4、智能识别人体器官特征部位及其位置,智能识别需要扫描检查的器官,组织附近的骨骼及其位置辅助定位器官;S4. Intelligently identify the characteristic parts and positions of human organs, intelligently identify the organs that need to be scanned and inspected, and the bones near the tissue and their positions to assist in the positioning of organs;
S5、划定需要扫描的部位,扫描区域,返回扫描的范围,位置区域,采集位置坐标,自主定位,移动装置;S5. Delineate the part to be scanned, scan area, return to scan range, position area, collect position coordinates, autonomous positioning, and move the device;
S6、按照返回的坐标,依据扫查任务,医疗成像装置,扫描装置自主定位,移动至组织器官位置,对应的器官及骨骼;S6. According to the returned coordinates, according to the scanning task, the medical imaging device and the scanning device are positioned independently, and moved to the position of the tissue and organ, the corresponding organ and bone;
S7、扫描对应的器官及骨骼,获取器官及骨骼的图像;S7. Scanning the corresponding organs and bones to obtain images of the organs and bones;
S8、创建各器官,组织,部位对应的疾病模型,建立图像识别的数学模型;S8. Create disease models corresponding to various organs, tissues, and parts, and establish a mathematical model for image recognition;
S9、抽取疾病的表象特征,器官图像的图形特征,包括:器官的轮廓,颜色,纹理,灰度对比,形状,位置,颜色,结构以及病症的图形化特征项;S9. Extracting the appearance features of the disease and the graphic features of the organ image, including: the outline, color, texture, grayscale contrast, shape, position, color, structure and graphical feature items of the disease of the organ;
S10、利用改进深度神经网络调整权值参数,得到输出值,依据输出值的范围来识别对应器官正常体征或疾病智能识别器官及其疾病;S10. Use the improved deep neural network to adjust the weight parameters to obtain the output value, and identify the normal signs or diseases of the corresponding organ according to the range of the output value, and intelligently identify the organ and its disease;
S11、智能圈注图像上的疾病的病罩,疑似病罩位置。S11. Intelligently circle the disease mask of the disease on the image, and the position of the suspected disease mask.
附图说明:Description of drawings:
图1是本申请说明书中医疗用机器人装置模块示意图;Figure 1 is a schematic diagram of a medical robot device module in the specification of this application;
附图1标记:Attachment 1 marks:
101-机器人主系统模块;102-机器臂扫查采集动作规划模块;103-视觉模块;101-Robot main system module; 102-Robot arm scanning acquisition action planning module; 103-Vision module;
104-医疗装置及图像视频采集模块;105-语音模块;104-medical device and image and video acquisition module; 105-voice module;
106-机器臂抓取扫码动作规划模块;107-信息采集读取装置及模块;106-Robot arm grasping and scanning code movement planning module; 107-Information collection and reading device and module;
108-雷达建图定位导航移动模块;109-防辐射装置;110-通信模块;108-radar mapping positioning navigation mobile module; 109-radiation protection device; 110-communication module;
图2是本申请说明书中医疗用机器人装置组成结构示意图;Figure 2 is a schematic diagram of the composition and structure of the medical robot device in the specification of this application;
附图2标记:Attachment 2 marks:
201视觉采集装置;202-机器人主系统;203-医疗装置;204-扫描照射调解装置;201 Vision acquisition device; 202-Robot main system; 203-Medical device; 204-Scanning irradiation mediation device;
205-扫描照射装置;206-扫描机器臂;207-平板探测装置;208-信息验证机器臂;205-scanning irradiation device; 206-scanning robot arm; 207-flat panel detection device; 208-information verification robot arm;
209-移动装置;210-信息扫描装置;211-雷达;212-语音装置;213-防辐射装置;209-mobile device; 210-information scanning device; 211-radar; 212-voice device; 213-radiation protection device;
具体实施方式Detailed ways
本发明的目的是设计取代人类工作的可远端控制机器人,实现远端控制机器臂采集,同时有效解决自主扫描,采集医疗图像,视频。利用人工智能机器人技术,自动化领域的自主采集,机器臂动作规划技术,平面视觉装置采集人脸,五官,人体外部特征,深度视觉装置采集骨骼,关节图像。The purpose of the present invention is to design a remote control robot that can replace human work, realize remote control of robot arm acquisition, and effectively solve autonomous scanning, acquisition of medical images and videos. Using artificial intelligence robot technology, autonomous collection in the field of automation, robot arm motion planning technology, plane vision device to collect human face, facial features, external features of human body, depth vision device to collect bone and joint images.
实现远端控制机器人及自主采集医疗图像,视频,平面图像与深度视觉图像融合智能识别人体五官,骨骼,关节,器官,组织,人体特征及其位置的智能识别方法,将平面视觉图像,深度图像融合,智能识别人体五官,器官,骨骼,关节,人体特征点及其位置自主定位扫描检查器官组织的方法,提高了智能采集的精准度和医疗数据异常识别的准确度。为了更好的理解上述技术方案,下面结合实施例及附图,对本发明作进一步地的详细说明,但本发明的实施方式不限于此。Realize remote control of robots and autonomous collection of medical images, videos, plane images and depth vision images to intelligently identify human facial features, bones, joints, organs, tissues, human body features and their positions. Fusion, intelligent recognition of human facial features, organs, bones, joints, human body feature points and their positions, the method of autonomous positioning, scanning and inspection of organ tissues, improves the accuracy of intelligent collection and the accuracy of abnormal identification of medical data. In order to better understand the above technical solutions, the present invention will be further described in detail below in conjunction with the examples and accompanying drawings, but the embodiments of the present invention are not limited thereto.
本申请实施中的技术方案为解决上述技术问题的总体思路如下:The technical scheme in the implementation of this application is as follows for the overall idea of solving the above-mentioned technical problems:
医疗用机器人装置,利用远端,机器人自主采集医疗图像装置。利用雷达,移动底座实现自主移动,建图定位导航,解决移动采集问题。利用平面视觉装置,深度视觉装置,智能识别平面信息,骨骼及深度信息。通过医疗装置,医疗图像,视频采集装置,实现机器人远端控制,自主采集,解决医护人员作业压力大,采集任务繁多等问题。The medical robot device uses the remote end, and the robot autonomously collects medical image devices. Using radar, the mobile base realizes autonomous movement, constructs maps, locates and navigates, and solves the problem of mobile collection. Use plane vision device and depth vision device to intelligently identify plane information, skeleton and depth information. Through medical devices, medical images, and video acquisition devices, remote control and autonomous acquisition of robots can be realized, and the problems of high operating pressure and numerous acquisition tasks for medical staff can be solved.
实施例1:Example 1:
下面结合实施例及附图1,附图2,对本发明作进一步地的详细说明,但本发明的实施方式不限于此。Below, the present invention will be further described in detail in conjunction with the embodiments and accompanying drawings 1 and 2, but the embodiments of the present invention are not limited thereto.
一种医疗用机器人装置包括:A robotic device for medical use comprising:
机器人主系统101,所述机器人主系统模块,用于连接并控制机器人装置模块,包括:语音模块105,视觉模块及视觉识别模块103,雷达自主定位导航移动模块108,医疗装置及模块104,机器臂及动作规划模块。Robot main system 101, the robot main system module is used to connect and control the robot device module, including: voice module 105, vision module and visual recognition module 103, radar autonomous positioning navigation mobile module 108, medical device and module 104, machine Arm and motion planning module.
语音装置212及语音模块105,机器人主系统101与语音装置212连接,用于采集并识别声音,用户间管理员间的语音交互,语音命令;Voice device 212 and voice module 105, robot main system 101 is connected with voice device 212, is used for collecting and recognizing sound, voice interaction between administrators between users, voice command;
雷达自主定位导航移动模块包括:The radar autonomous positioning and navigation mobile module includes:
移动底座209,与雷达211连接,与机器人主系统101连接,用于移动;The mobile base 209 is connected with the radar 211 and connected with the main robot system 101 for moving;
雷达211,与机器人主系统101连接,与移动底座209连接,用于自主建图,定位,导航;The radar 211 is connected with the main robot system 101 and the mobile base 209 for autonomous mapping, positioning and navigation;
医疗装置及模块104,包括:医疗成像装置,扫描装置,扫描照射调解装置,防辐射装置,所述的医疗装置为以下装置中的一种及多种,Medical device and module 104, including: medical imaging device, scanning device, scanning irradiation mediation device, radiation protection device, the medical device described is one or more of the following devices,
X射线成像装置203,直接数字成像DR装置,电子计算机断层扫描显像CT装置,磁共振MR装置,PET正电子发射计算机断层扫描成像装置,X-ray imaging device 203, direct digital imaging DR device, computerized tomography imaging CT device, magnetic resonance MR device, PET positron emission computed tomography imaging device,
X射线成像装置203,直接数字成像DR装置包括:X-ray imaging device 203, direct digital imaging DR device includes:
X射线发射装置204,为X射线发生器,用于产生X射线。The X-ray emitting device 204 is an X-ray generator for generating X-rays.
X射线照射扫描装置,与机器人主系统连接,与机器臂一体化,作为扫描机器臂的扫查装置,发射X射线,扫描机器臂用于采集医疗图像,机器臂为U型臂,C型臂;X-ray irradiation scanning device, connected with the main system of the robot, integrated with the robot arm, as a scanning device for the scanning robot arm, emits x-rays, and the scanning robot arm is used to collect medical images, the robot arm is a U-shaped arm, a C-shaped arm ;
X射线成像装置用于检查颅脑,颈锥,腰椎,胸椎,骨关节;X-ray imaging devices are used to examine the brain, cervical spine, lumbar spine, thoracic spine, and bone joints;
平板探测装置207,用于接收X射线,辅助采集X射线图像,所述的平板探测装置,可分离式,与信息验证机器臂连接,用于接收X光,辅助采集X光图像。所述的平板探测装置,与信息验证机器臂连接,可分离式,机器人主系统及远端客户端控制机器臂与平板探测装置拆分,结合,移动。The flat-panel detection device 207 is used to receive X-rays and assist in the acquisition of X-ray images. The flat-panel detection device is detachable and connected to the information verification robot arm to receive X-rays and assist in the acquisition of X-ray images. The flat-panel detection device is connected to the information verification robot arm and is detachable. The robot main system and the remote client control the robot arm and the flat-panel detection device to separate, combine and move.
CT装置,电子计算机断层扫描显像装置,所述的电子计算机断层扫描显像装置,与扫描装置,与机器人主系统连接,用于检查颅脑,颈锥,腰椎,胸椎,腹部,骨关节,心脏,所述的扫描装置,为环状机器臂;CT device, computerized tomography imaging device, the computerized tomography imaging device, connected with the scanning device and the main robot system, is used to check the cranium, cervical cone, lumbar spine, thoracic spine, abdomen, bone joints, The heart, the scanning device, is a circular robotic arm;
MRI装置,磁共振装置,所述的磁共振装置,与扫描装置连接,与机器人主系统101连 接,用于检查颅脑,颈锥,腰椎,胸椎,骨,软骨,软组织,肌肉,胸部,血管,腹部,骨关节,心脏,所述的扫描装置,为环状机器臂;MRI device, magnetic resonance device, the magnetic resonance device is connected with the scanning device and the robot main system 101, and is used to examine the cranium, cervical cone, lumbar spine, thoracic spine, bone, cartilage, soft tissue, muscle, chest, blood vessel , abdomen, bone joints, heart, the scanning device is a ring-shaped robotic arm;
PET装置,正电子发射计算机断层扫描成像装置,所述的正电子发射计算机断层扫描成像装置,与扫描装置,与机器人主系统101连接,用于检查颅脑,颈锥,腰椎,胸椎,骨,软骨。PET device, positron emission computed tomography imaging device, described positron emission computed tomography imaging device, is connected with the scanning device and the main robot system 101, and is used to examine the cranium, cervical cone, lumbar spine, thoracic spine, bone, cartilage.
视觉采集装置及视觉识别模块103,用于采集图像,视频,识别图像,视频。The visual collection device and the visual recognition module 103 are used for collecting images and videos, and recognizing images and videos.
机器臂,包括机器扫查臂206及信息验证机器臂208用于采集医疗图像,扫描读取信息。The robot arm, including the robot scanning arm 206 and the information verification robot arm 208, is used to collect medical images and scan and read information.
语音装置212及语音模块105,机器人主系统101与语音装置212连接,用于采集并识别声音,用户间管理员间的语音交互,语音命令,语音问诊和语音引导。The voice device 212 and the voice module 105, the main robot system 101 is connected with the voice device 212, and is used for collecting and recognizing sounds, voice interaction between users and administrators, voice commands, voice consultation and voice guidance.
通信模块110,远端控制及自主控制采集图像模块,所述的通信模块与机器人主系统,远端客户端连接,通信模块包括,无线通信模块,蓝牙通信模块,有线互联网通信模块,射频通信,无线电通信中的一种及多种通信方式。 Communication module 110, remote control and autonomous control image acquisition module, the communication module is connected with the robot main system and the remote client, the communication module includes a wireless communication module, a bluetooth communication module, a wired Internet communication module, radio frequency communication, One or more communication methods in radio communication.
实施例2:Example 2:
下面结合实施例及附图1,附图2,对本发明作进一步地的详细说明,但本发明的实施方式不限于此,平面视觉图像,深度图像融合,智能识别人体五官,器官,骨骼,关节,人体特征点及其位置自主定位扫描检查器官组织的方法,所述方法包括以下步骤:Below in conjunction with embodiment and accompanying drawing 1, accompanying drawing 2, the present invention will be described in further detail, but the embodiment of the present invention is not limited to this, plane visual image, depth image fusion, intelligent recognition of human body features, organs, bones, joints A method for autonomously positioning human body feature points and their positions to scan and inspect organ tissues, the method comprising the following steps:
依据扫查任务,读取需要扫描检查的器官,组织,将人体平面图像,提取人脸,五官,颈部,乳头,乳房,肚脐,特征生殖器,特征部位及其位置作为特征项输入神经网络算法及其改进方法,智能识别,标注人体特征点及其位置,将深度视觉图像,提取头部骨骼,颈部脊椎骨骼,锁骨,肩部骨骼,肩关节,左右上肢骨骼,肘关节,腕关节,手关节,肺部肋骨,脊骨,腰关节,膝关节,踝关节,足关节作为特征项输入神经网络算法及其改进方法,智能识别骨骼及其位置,智能识别人体器官特征部位及其位置,智能识别需要扫描检查的器官,组织附近的骨骼及其位置辅助定位器官;划定需要扫描的部位,位置区域,位置坐标;按照返回的坐标,依据扫查任务,医疗成像装置,扫描装置自主定位,移动至组织器官位置,对应的器官及骨骼,扫描对应的器官及骨骼,获取器官及骨骼的图像,创建各器官,组织,部位对应的疾病模型,建立图像识别的数学模型,抽取疾病的表象特征,器官图像的图形特征,包括:器官的轮廓,颜色,纹理,灰度对比,形状,位置,颜色,结构以及病症的图形化特征项,利用改进深度神经网络调整权值参数,得到输出值,依据输出值的范围来识别对应器官正常体征或疾病智能识别器官及其疾病,智能圈注图像上的疾病的病罩,疑似病罩位置。According to the scanning task, read the organs and tissues that need to be scanned and inspect, extract the face, facial features, neck, nipples, breasts, navel, characteristic genitals, characteristic parts and their positions from the plane image of the human body and input them into the neural network algorithm as feature items And its improved method, intelligent recognition, marking human body feature points and their positions, extracting head bones, neck spine bones, clavicle, shoulder bones, shoulder joints, left and right upper limb bones, elbow joints, wrist joints, Hand joints, lungs, ribs, spine, waist joints, knee joints, ankle joints, and foot joints are input into the neural network algorithm and its improvement method as feature items, intelligently identify bones and their positions, and intelligently identify the characteristic parts and positions of human organs. Intelligently identify the organs that need to be scanned, the bones near the tissue and their positions to assist in the positioning of the organs; delineate the parts that need to be scanned, the location area, and the location coordinates; according to the returned coordinates, according to the scanning task, the medical imaging device and the scanning device are positioned independently , move to the location of tissues and organs, corresponding organs and bones, scan corresponding organs and bones, obtain images of organs and bones, create disease models corresponding to organs, tissues, and parts, establish mathematical models for image recognition, and extract the appearance of diseases Features, graphic features of organ images, including: organ outline, color, texture, grayscale contrast, shape, position, color, structure, and graphic feature items of diseases, using improved deep neural network to adjust weight parameters to obtain output values According to the range of the output value to identify the normal signs of the corresponding organ or the disease, intelligently identify the organ and its disease, intelligently circle the disease mask of the disease on the image, and the position of the suspected disease mask.

Claims (10)

  1. 一种医疗用机器人装置,系统及方法,其特征在于,一种医疗用机器人装置包括:A medical robot device, system and method, characterized in that a medical robot device includes:
    机器人主系统,所述机器人主系统模块,用于连接并控制机器人装置模块,包括:语音模块,视觉模块及视觉识别模块,雷达自主定位导航移动模块,医疗装置及模块,机器臂及动作规划模块;The robot main system, the robot main system module, is used to connect and control the robot device module, including: voice module, vision module and visual recognition module, radar autonomous positioning navigation mobile module, medical device and module, robot arm and action planning module ;
    语音装置及语音模块,机器人主系统与语音装置连接,用于采集并识别声音,用户间管理员间的语音交互,语音命令;Voice device and voice module, the main system of the robot is connected with the voice device for collecting and recognizing voice, voice interaction between users and administrators, and voice commands;
    雷达自主定位导航移动模块包括:The radar autonomous positioning and navigation mobile module includes:
    移动底座,与雷达连接,与机器人主系统连接,用于移动;Mobile base, connected to the radar, connected to the main system of the robot, for movement;
    雷达,与机器人主系统连接,与移动底座连接,用于自主建图,定位,导航;Radar, connected with the main system of the robot, connected with the mobile base, used for autonomous mapping, positioning, and navigation;
    医疗装置及模块,包括:医疗成像装置,扫描装置,扫描照射调解装置,防辐射装置,所述的医疗装置为以下装置中的一种及多种,Medical devices and modules, including: medical imaging devices, scanning devices, scanning radiation mediation devices, radiation protection devices, the medical devices are one or more of the following devices,
    X射线成像装置,直接数字成像DR装置,电子计算机断层扫描显像CT装置,磁共振MR装置,PET正电子发射计算机断层扫描成像装置,X-ray imaging device, direct digital imaging DR device, computerized tomography imaging CT device, magnetic resonance MR device, PET positron emission computed tomography imaging device,
    X射线成像装置,直接数字成像DR装置包括:X-ray imaging device, direct digital imaging DR device includes:
    X射线发射装置,为X射线发生器,用于产生X射线。The X-ray emitting device is an X-ray generator for generating X-rays.
    X射线照射扫描装置,与机器人主系统连接,与机器臂一体化,作为扫描机器臂的扫查装置,发射X射线,扫描机器臂用于采集医疗图像;The X-ray irradiation scanning device is connected with the main system of the robot and integrated with the robot arm, as a scanning device for scanning the robot arm, emitting X-rays, and the scanning robot arm is used to collect medical images;
    X射线成像装置用于检查颅脑,颈锥,腰椎,胸椎,骨关节;X-ray imaging devices are used to examine the brain, cervical spine, lumbar spine, thoracic spine, and bone joints;
    平板探测装置,用于接收X射线,辅助采集X射线图像,所述的平板探测装置,可分离式,与信息验证机器臂连接,用于接收X光,辅助采集X光图像。所述的平板探测装置,与信息验证机器臂连接,可分离式,机器人主系统及远端客户端控制机器臂与平板探测装置拆分,结合,移动;The flat-panel detection device is used to receive X-rays and assist in the collection of X-ray images. The flat-panel detection device is detachable and connected to the information verification robot arm to receive X-rays and assist in the collection of X-ray images. The flat-panel detection device is connected to the information verification robot arm and is detachable. The robot main system and the remote client control the robot arm and the flat-panel detection device to split, combine, and move;
    CT装置,电子计算机断层扫描显像装置,所述的电子计算机断层扫描显像装置,与扫描装置,与机器人主系统连接,用于检查颅脑,颈锥,腰椎,胸椎,腹部,骨关节,心脏;CT device, computerized tomography imaging device, the computerized tomography imaging device, connected with the scanning device and the main robot system, is used to check the cranium, cervical cone, lumbar spine, thoracic spine, abdomen, bone joints, heart;
    MRI装置,磁共振装置,所述的磁共振装置,与扫描装置连接,与机器人主系统连接,用于检查颅脑,颈锥,腰椎,胸椎,骨,软骨,软组织,肌肉,胸部,血管,腹部,骨关节,心脏;MRI device, magnetic resonance device, the magnetic resonance device, connected with the scanning device, connected with the robot main system, is used to examine the cranium, cervical cone, lumbar spine, thoracic spine, bone, cartilage, soft tissue, muscle, chest, blood vessel, abdomen, bones and joints, heart;
    PET装置,正电子发射计算机断层扫描成像装置,所述的正电子发射计算机断层扫描成像装置,与扫描装置,与机器人主系统连接,用于检查颅脑,颈锥,腰椎,胸椎,骨,软骨,软组织,肌肉,胸部,血管,腹部,骨关节,心脏;PET device, positron emission computed tomography imaging device, said positron emission tomography imaging device, connected with scanning device, with robot main system, is used for examining cranium, cervical cone, lumbar spine, thoracic spine, bone, cartilage , soft tissue, muscle, chest, blood vessels, abdomen, bone joints, heart;
    扫描照射调解装置,用于扫描,照射部位,调解骨骼关节的位置,高度,角度,方向及各项扫描照射参数;Scanning and irradiation mediation device, used for scanning, irradiating parts, mediating the position, height, angle, direction and various scanning irradiation parameters of bones and joints;
    防辐射装置,用于防辐射;Radiation protection device for radiation protection;
    视觉采集装置及视觉识别模块,用于采集图像,视频,识别图像,视频;A visual collection device and a visual recognition module, used for collecting images, videos, and identifying images and videos;
    机器臂,包括扫描机器臂及信息验证机器臂,用于采集医疗图像,扫描读取信息;Robotic arms, including scanning robotic arms and information verification robotic arms, are used to collect medical images, scan and read information;
  2. 一种医疗用机器人装置,系统及方法,其特征在于,语音装置及语音模块,机器人主系统与语音装置连接,用于采集并识别声音,用户间管理员间的语音交互,语音命令,语音问诊和语音引导;A medical robot device, system and method, characterized in that the voice device and the voice module, the main system of the robot is connected with the voice device for collecting and recognizing sounds, voice interaction between users and administrators, voice commands, voice queries diagnosis and voice guidance;
  3. 一种医疗用机器人装置,系统及方法,其特征在于,通信模块,远端控制及自主控制采集图像模块,所述的通信模块与机器人主系统,远端客户端连接,通信模块包括,无线通信模块,蓝牙通信模块,有线互联网通信模块,射频通信,无线电通信中的一种及多种通信方式;A medical robot device, system and method, characterized in that, a communication module, a remote control and autonomous control image acquisition module, the communication module is connected with the robot main system and a remote client, and the communication module includes, wireless communication Module, Bluetooth communication module, wired Internet communication module, radio frequency communication, one or more communication methods in radio communication;
  4. 一种医疗用机器人装置,系统及方法,其特征在于,医疗装置,所述的医疗装置,包括:医疗成像装置,扫描装置,扫描照射调解装置,防辐射装置,A medical robot device, system and method, characterized in that the medical device includes: a medical imaging device, a scanning device, a scanning irradiation mediation device, a radiation protection device,
    所述的医疗装置为以下装置中的一种及多种,The medical device is one or more of the following devices,
    X射线成像装置,直接数字成像DR装置,电子计算机断层扫描显像CT装置,磁共振MR装置,PET正电子发射计算机断层扫描成像装置;X-ray imaging device, direct digital imaging DR device, computerized tomography imaging CT device, magnetic resonance MR device, PET positron emission computed tomography imaging device;
  5. 一种医疗用机器人装置,系统及方法,其特征在于,机器臂,所述的机器臂可远端控制及自主控制,所述的机器臂包括扫描机器臂,信息验证机器臂,扫描机器臂及扫描装置采集医疗图像,所述的远端控制是通过管理员,用户远端控制调解设置参数,所述的自主控制扫描装置采集医疗图像,通过神经网络及其改进方法训练动作及自适应调解扫查装置参数,设置动作规划参数,用于动作规划,实现所述的采集医疗图像,视频,所述的采集模块包括:医疗图像,视频采集模块;A medical robot device, system and method, characterized in that the robotic arm can be controlled remotely and autonomously, and the robotic arm includes a scanning robotic arm, an information verification robotic arm, a scanning robotic arm and The scanning device collects medical images, the remote control is through the administrator, the user remotely controls and mediates the setting parameters, the self-control scanning device collects medical images, and the neural network and its improved method are used to train actions and self-adaptive mediation scanning Check the device parameters, set the action planning parameters for action planning, and realize the acquisition of medical images and videos. The acquisition modules include: medical images and video acquisition modules;
    所述的扫描机器臂与机器人主系统连接,与机器臂一体化;The scanning robot arm is connected with the robot main system and integrated with the robot arm;
    所述的信息验证机器臂,可自主伸缩,与机器人主系统连接;The information verification robot arm can be stretched and retracted autonomously, and is connected with the robot main system;
  6. 一种医疗用机器人装置,系统及方法,其特征在于,扫描照射调解装置,所述的扫描照射调解装置,与扫描机器臂一体化,与机器人主系统连接,使医疗对象按标准的扫查要求,移动升降旋转扫描机器臂,调解扫查任务照射部位的骨骼,关节的位置,高度,角度,方向;A medical robot device, system and method, characterized in that the scanning and irradiation mediation device, the scanning and irradiation mediation device is integrated with the scanning robot arm and connected with the main system of the robot, so that the medical object can be scanned according to the standard scanning requirements , move up and down and rotate the scanning robot arm to mediate the position, height, angle and direction of bones and joints in the irradiation part of the scanning task;
  7. 一种医疗用机器人装置,系统及方法,其特征在于,信息采集读取装置,所述的信息采集读取装置包括:信息采集装置,信息扫描装置,读取装置与信息验证机器臂连接,作为信息读取机器臂,用于扫描数字码,二维码,RFID,生物特征,智能识别读取二维码,数字码,文 字,标识,生物信息,RFID信息,患者,用户信息;A medical robot device, system and method, characterized in that it is an information collection and reading device, and the information collection and reading device includes: an information collection device, an information scanning device, and the reading device is connected with an information verification robot arm, as Information reading robot arm, used to scan digital codes, two-dimensional codes, RFID, biometrics, intelligent identification to read two-dimensional codes, digital codes, text, logos, biological information, RFID information, patients, user information;
  8. 一种医疗用机器人装置,系统及方法,其特征在于,视觉采集装置及视觉识别模块,机器人主系统与视觉采集装置连接,用于采集图像,视频,识别图像,视频,所述的视觉采集装置包括:平面视觉装置,深度视觉装置;A medical robot device, system and method, characterized in that, a visual acquisition device and a visual recognition module, the robot main system is connected to the visual acquisition device for collecting images, videos, identifying images, and videos. The visual acquisition device Including: plane vision device, depth vision device;
    视觉识别模块,包括:平面视觉装置及平面图像识别,深度视觉装置及深度图像识别,用于图像视频识别,Visual recognition module, including: planar vision device and planar image recognition, depth vision device and depth image recognition, used for image and video recognition,
    平面视觉装置及平面图像识别包括:人脸图像识别,五官图像识别,人体特征识别,医疗场景识别,Planar vision devices and planar image recognition include: face image recognition, facial features image recognition, human body feature recognition, medical scene recognition,
    深度视觉装置及深度图像识别包括:骨骼图像,关节图像,特征位置识别,关键关节位置以及人体的其他特殊特征识别,结合定位,扫查人体器官;Depth vision device and depth image recognition include: bone image, joint image, feature position recognition, key joint position and other special feature recognition of the human body, combined with positioning, scanning of human organs;
  9. 一种医疗用机器人装置,系统及方法,其特征在于,雷达与视觉装置融合用于自主建图,定位,导航,雷达与移动底座连接,用于移动,移动底座,雷达,视觉装置,与机器人主系统连接,用于自主定位导航,移动;A medical robot device, system and method, characterized in that the fusion of radar and vision device is used for autonomous mapping, positioning, navigation, and the connection between radar and mobile base is used for moving, mobile base, radar, vision device, and robot Main system connection for autonomous positioning, navigation and movement;
  10. 一种医疗用机器人装置,系统及方法,其特征在于,平面图像与深度视觉图像融合智能识别人体五官,骨骼,关节,器官,组织,人体特征及其位置的智能识别方法,所述方法是将平面视觉图像,深度图像融合,智能识别人体五官,器官,骨骼,关节,人体特征点及其位置自主定位扫描检查器官组织的方法,以及智能识别对应器官病症,病罩的方法所述方法包括以下步骤:A medical robot device, system and method, characterized in that the fusion of plane images and depth vision images intelligently recognizes human facial features, bones, joints, organs, tissues, human body features and their positions, and the method is to Plane visual image, deep image fusion, intelligent recognition of human body features, organs, bones, joints, human body feature points and their positions, a method for autonomous positioning, scanning and inspection of organ tissues, and a method for intelligently identifying corresponding organ diseases and disease masks. The method includes the following step:
    S1、依据扫查任务,读取需要扫描检查的器官,组织;S1. According to the scanning task, read the organs and tissues that need to be scanned;
    S2、建立平面图像模型,特征模型,人体器官模型及平面图像的模型包括:人脸,五官,颈部,乳头,乳房,肚脐,特征生殖器,特征部位及其位置作为特征项,用神经网络算法及其改进方法,智能识别人体特征点及其位置;S2. Establishing a plane image model, a feature model, a human organ model and a plane image model including: face, facial features, neck, nipples, breasts, navel, characteristic genitalia, characteristic parts and their positions as feature items, using neural network algorithm And its improved method, intelligent recognition of human body feature points and their positions;
    S3、建立深度视觉装置及深度视觉图像模型,骨骼模型,包括:头部骨骼,面部骨骼,颅骨,颈部骨骼,椎骨,肩胛骨,肩关节,肩部骨骼,胸骨,肋骨,胸椎,腰部骨骼,脊柱,骶骨,尾骨,左右上肢骨骼,肘关节,腕关节,手关节,腰关节,膝关节,踝关节,足关节及其位置作为特征项,用神经网络算法及其改进方法,智能识别骨骼及其位置,将深度信息及骨骼所在人体的位置信息以及S1所述的一般图像模型识别的近邻特征器官信息作为骨骼智能识别模型的特征项结合,作为输入项;S3. Establish depth vision device and depth vision image model, bone model, including: head bones, facial bones, skull, neck bones, vertebrae, scapula, shoulder joints, shoulder bones, sternum, ribs, thoracic spine, waist bones, Spine, sacrum, coccyx, left and right upper limb bones, elbow joints, wrist joints, hand joints, waist joints, knee joints, ankle joints, foot joints and their positions are used as feature items, using neural network algorithms and their improved methods to intelligently identify bones and For its position, the depth information and the position information of the human body where the skeleton is located and the information of the adjacent characteristic organs identified by the general image model described in S1 are combined as the feature items of the bone intelligent recognition model as input items;
    S4、智能识别人体器官特征部位及其位置,智能识别需要扫描检查的器官,组织附近的骨骼及其位置辅助定位器官;S4. Intelligently identify the characteristic parts and positions of human organs, intelligently identify the organs that need to be scanned and inspected, and the bones near the tissue and their positions to assist in the positioning of organs;
    S5、划定需要扫描的部位,扫描区域,返回扫描的范围,位置区域,采集位置坐标,自主定位,移动装置;S5. Delineate the part to be scanned, scan area, return to scan range, position area, collect position coordinates, autonomous positioning, and move the device;
    S6、按照返回的坐标,依据扫查任务,医疗成像装置,扫描装置自主定位,移动至组织器官位置,对应的器官及骨骼;S6. According to the returned coordinates, according to the scanning task, the medical imaging device and the scanning device are positioned independently, and moved to the position of the tissue and organ, the corresponding organ and bone;
    S7、自主扫描对应的器官及骨骼,获取器官及骨骼的图像;S7. Scanning the corresponding organs and bones autonomously to obtain images of the organs and bones;
    S8、创建各器官,组织,部位对应的疾病模型,建立图像识别的数学模型;S8. Create disease models corresponding to various organs, tissues, and parts, and establish a mathematical model for image recognition;
    S9、抽取疾病的表象特征,器官图像的图形特征,包括:器官的轮廓,颜色,纹理,灰度对比,形状,位置,颜色,结构以及病症的图形化特征项;S9. Extracting the appearance features of the disease and the graphic features of the organ image, including: the outline, color, texture, grayscale contrast, shape, position, color, structure and graphical feature items of the disease of the organ;
    S10、利用改进深度神经网络调整权值参数,得到输出值,依据输出值的范围来识别对应器官正常体征或疾病智能识别器官及其疾病;S10. Use the improved deep neural network to adjust the weight parameters to obtain the output value, and identify the normal signs or diseases of the corresponding organ according to the range of the output value, and intelligently identify the organ and its disease;
    S11、智能标注图像上的疾病的病罩,疑似病罩位置;S11. Intelligently mark the disease mask of the disease on the image, and the position of the suspected disease mask;
PCT/CN2022/000118 2021-08-27 2022-08-18 Medical robot apparatus, system and method WO2023024397A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
AU2022332824A AU2022332824A1 (en) 2021-08-27 2022-08-18 Medical robot apparatus, system and method
CN202280056989.0A CN118265498A (en) 2021-08-27 2022-08-18 Medical robot device, system and method

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111008052.X 2021-08-27
CN202111008052.XA CN113855250A (en) 2021-08-27 2021-08-27 Medical robot device, system and method

Publications (1)

Publication Number Publication Date
WO2023024397A1 true WO2023024397A1 (en) 2023-03-02

Family

ID=78988759

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/000118 WO2023024397A1 (en) 2021-08-27 2022-08-18 Medical robot apparatus, system and method

Country Status (3)

Country Link
CN (2) CN113855250A (en)
AU (1) AU2022332824A1 (en)
WO (1) WO2023024397A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113855250A (en) * 2021-08-27 2021-12-31 谈斯聪 Medical robot device, system and method

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150273697A1 (en) * 2014-03-27 2015-10-01 Fatemah A.J.A. Abdullah Robot for medical assistance
CN107030714A (en) * 2017-05-26 2017-08-11 深圳市天益智网科技有限公司 A kind of medical nurse robot
CN107322602A (en) * 2017-06-15 2017-11-07 重庆柚瓣家科技有限公司 Home-services robot for tele-medicine
CN107788958A (en) * 2017-10-20 2018-03-13 深圳市前海安测信息技术有限公司 medical monitoring robot and medical monitoring method
CN109758233A (en) * 2019-01-21 2019-05-17 上海益超医疗器械有限公司 A kind of diagnosis and treatment integrated operation robot system and its navigation locating method
WO2019175675A2 (en) * 2019-07-01 2019-09-19 Wasfi Alshdaifat Dr robot medical artificial intelligence robotic arrangement
CN110477956A (en) * 2019-09-27 2019-11-22 哈尔滨工业大学 A kind of intelligent checking method of the robotic diagnostic system based on ultrasound image guidance
US20190358820A1 (en) * 2018-05-23 2019-11-28 Aeolus Robotics, Inc. Robotic Interactions for Observable Signs of Intent
CN111481227A (en) * 2020-05-18 2020-08-04 国登刚 Medical examination bed intelligent positioning system based on computer vision technology
CN111916195A (en) * 2020-08-05 2020-11-10 谈斯聪 Medical robot device, system and method
CN111906785A (en) * 2020-07-23 2020-11-10 谈斯聪 Multi-mode comprehensive information identification mobile double-arm robot device system and method
CN111973152A (en) * 2020-06-17 2020-11-24 谈斯聪 Five sense organs and surgical medical data acquisition analysis diagnosis robot and platform
CN111973228A (en) * 2020-06-17 2020-11-24 谈斯聪 B-ultrasonic data acquisition, analysis and diagnosis integrated robot and platform
CN112155729A (en) * 2020-10-15 2021-01-01 中国科学院合肥物质科学研究院 Intelligent automatic planning method and system for surgical puncture path and medical system
CN113855250A (en) * 2021-08-27 2021-12-31 谈斯聪 Medical robot device, system and method

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111407414A (en) * 2020-04-07 2020-07-14 上海市第一人民医院 Multifunctional remote robot for clinical diagnosis and treatment
CN111658154B (en) * 2020-05-11 2021-10-26 首都医科大学附属北京天坛医院 Automatic remote radiography surgical robot system

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150273697A1 (en) * 2014-03-27 2015-10-01 Fatemah A.J.A. Abdullah Robot for medical assistance
CN107030714A (en) * 2017-05-26 2017-08-11 深圳市天益智网科技有限公司 A kind of medical nurse robot
CN107322602A (en) * 2017-06-15 2017-11-07 重庆柚瓣家科技有限公司 Home-services robot for tele-medicine
CN107788958A (en) * 2017-10-20 2018-03-13 深圳市前海安测信息技术有限公司 medical monitoring robot and medical monitoring method
US20190358820A1 (en) * 2018-05-23 2019-11-28 Aeolus Robotics, Inc. Robotic Interactions for Observable Signs of Intent
CN109758233A (en) * 2019-01-21 2019-05-17 上海益超医疗器械有限公司 A kind of diagnosis and treatment integrated operation robot system and its navigation locating method
WO2019175675A2 (en) * 2019-07-01 2019-09-19 Wasfi Alshdaifat Dr robot medical artificial intelligence robotic arrangement
CN110477956A (en) * 2019-09-27 2019-11-22 哈尔滨工业大学 A kind of intelligent checking method of the robotic diagnostic system based on ultrasound image guidance
CN111481227A (en) * 2020-05-18 2020-08-04 国登刚 Medical examination bed intelligent positioning system based on computer vision technology
CN111973152A (en) * 2020-06-17 2020-11-24 谈斯聪 Five sense organs and surgical medical data acquisition analysis diagnosis robot and platform
CN111973228A (en) * 2020-06-17 2020-11-24 谈斯聪 B-ultrasonic data acquisition, analysis and diagnosis integrated robot and platform
CN111906785A (en) * 2020-07-23 2020-11-10 谈斯聪 Multi-mode comprehensive information identification mobile double-arm robot device system and method
CN111916195A (en) * 2020-08-05 2020-11-10 谈斯聪 Medical robot device, system and method
CN112155729A (en) * 2020-10-15 2021-01-01 中国科学院合肥物质科学研究院 Intelligent automatic planning method and system for surgical puncture path and medical system
CN113855250A (en) * 2021-08-27 2021-12-31 谈斯聪 Medical robot device, system and method

Also Published As

Publication number Publication date
CN118265498A (en) 2024-06-28
AU2022332824A1 (en) 2024-04-11
CN113855250A (en) 2021-12-31

Similar Documents

Publication Publication Date Title
Li et al. An overview of systems and techniques for autonomous robotic ultrasound acquisitions
CN112641511B (en) Joint replacement surgery navigation system and method
CN101474075B (en) Navigation system of minimal invasive surgery
WO2022027921A1 (en) Medical robotic device, system, and method
CN110533763B (en) Intelligent orthopedic external fixation system based on cloud platform
CN109820695A (en) A kind of horizontal bilateral brain paralysis lower limb rehabilitation robot in the ward ICU with communication and independent navigation locomotive function
JP7240519B2 (en) Smart monitoring system for pelvic fracture reduction
US11779423B2 (en) Real-time adjustment of haptic feedback in surgical robots
CN112641512A (en) Spatial registration method applied to surgical robot front planning
WO2023024396A1 (en) Recognition, autonomous positioning and scanning method for visual image and medical image fusion
US11672614B1 (en) Robotic surgical systems with multi-modality imaging for performing surgical steps
US11464650B1 (en) Synchronized placement of surgical implant hardware
US11801104B2 (en) Robotic system and method for performing latency managed telesurgery
US11478314B1 (en) System and method for implanting smart implants using robotic telesurgery
WO2023024399A1 (en) Medical robot apparatus, system and method
WO2023024397A1 (en) Medical robot apparatus, system and method
WO2023024398A1 (en) Method for intelligently identifying thoracic organ, autonomously locating and scanning thoracic organ
CN107736897A (en) A kind of ultrasound registration and resetting long bone device and method based on Six Degree-of-Freedom Parallel Platform
CN107595406B (en) Electromagnetic guiding system for fracture closed reduction treatment
CN118213040A (en) Structured acupoint knowledge graph construction system and method based on human body three-dimensional model
Lavallée et al. Computer integrated surgery and therapy: State of the art
US11844575B1 (en) Digital image analysis for robotic installation of surgical implants
CN106214272A (en) A kind of operation of opening cranium visualizes brain function structure localization method
US11571266B1 (en) Robotic surgical system for insertion of surgical implants
CN115602287A (en) Acupuncture point positioning method and acupuncture auxiliary system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22859759

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 202280056989.0

Country of ref document: CN

WWE Wipo information: entry into national phase

Ref document number: 2022332824

Country of ref document: AU

Ref document number: AU2022332824

Country of ref document: AU

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2022332824

Country of ref document: AU

Date of ref document: 20220818

Kind code of ref document: A

122 Ep: pct application non-entry in european phase

Ref document number: 22859759

Country of ref document: EP

Kind code of ref document: A1