WO2023024397A1 - Medical robot apparatus, system and method - Google Patents
Medical robot apparatus, system and method Download PDFInfo
- Publication number
- WO2023024397A1 WO2023024397A1 PCT/CN2022/000118 CN2022000118W WO2023024397A1 WO 2023024397 A1 WO2023024397 A1 WO 2023024397A1 CN 2022000118 W CN2022000118 W CN 2022000118W WO 2023024397 A1 WO2023024397 A1 WO 2023024397A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- robot
- scanning
- medical
- module
- joints
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 238000003384 imaging method Methods 0.000 claims abstract description 37
- 230000033001 locomotion Effects 0.000 claims abstract description 11
- 238000013507 mapping Methods 0.000 claims abstract description 8
- 238000003745 diagnosis Methods 0.000 claims abstract description 5
- 210000000988 bone and bone Anatomy 0.000 claims description 64
- 210000000056 organ Anatomy 0.000 claims description 60
- 238000004891 communication Methods 0.000 claims description 28
- 201000010099 disease Diseases 0.000 claims description 28
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 claims description 28
- 210000001503 joint Anatomy 0.000 claims description 24
- 230000000007 visual effect Effects 0.000 claims description 21
- 210000001519 tissue Anatomy 0.000 claims description 19
- 210000000115 thoracic cavity Anatomy 0.000 claims description 15
- 238000012795 verification Methods 0.000 claims description 15
- 238000001514 detection method Methods 0.000 claims description 13
- 210000004705 lumbosacral region Anatomy 0.000 claims description 13
- 238000003325 tomography Methods 0.000 claims description 13
- 238000013528 artificial neural network Methods 0.000 claims description 12
- 230000005855 radiation Effects 0.000 claims description 11
- 238000013170 computed tomography imaging Methods 0.000 claims description 10
- 230000001815 facial effect Effects 0.000 claims description 10
- 210000001015 abdomen Anatomy 0.000 claims description 9
- 210000002216 heart Anatomy 0.000 claims description 9
- 238000002059 diagnostic imaging Methods 0.000 claims description 8
- 230000010391 action planning Effects 0.000 claims description 7
- 230000004927 fusion Effects 0.000 claims description 7
- 210000000845 cartilage Anatomy 0.000 claims description 6
- 230000003993 interaction Effects 0.000 claims description 6
- 210000004204 blood vessel Anatomy 0.000 claims description 5
- 210000000038 chest Anatomy 0.000 claims description 5
- 238000007689 inspection Methods 0.000 claims description 5
- 210000003205 muscle Anatomy 0.000 claims description 5
- 210000003739 neck Anatomy 0.000 claims description 5
- 210000004872 soft tissue Anatomy 0.000 claims description 5
- 210000000544 articulatio talocruralis Anatomy 0.000 claims description 3
- 210000004556 brain Anatomy 0.000 claims description 3
- 210000000481 breast Anatomy 0.000 claims description 3
- 210000002310 elbow joint Anatomy 0.000 claims description 3
- 210000004392 genitalia Anatomy 0.000 claims description 3
- 210000002478 hand joint Anatomy 0.000 claims description 3
- 210000000629 knee joint Anatomy 0.000 claims description 3
- 238000013178 mathematical model Methods 0.000 claims description 3
- 210000002445 nipple Anatomy 0.000 claims description 3
- 210000000614 rib Anatomy 0.000 claims description 3
- 210000002832 shoulder Anatomy 0.000 claims description 3
- 210000000323 shoulder joint Anatomy 0.000 claims description 3
- 210000001364 upper extremity Anatomy 0.000 claims description 3
- 210000003857 wrist joint Anatomy 0.000 claims description 3
- 210000003054 facial bone Anatomy 0.000 claims description 2
- 210000001624 hip Anatomy 0.000 claims description 2
- 230000001678 irradiating effect Effects 0.000 claims description 2
- 238000002600 positron emission tomography Methods 0.000 claims description 2
- 210000001991 scapula Anatomy 0.000 claims description 2
- 210000003625 skull Anatomy 0.000 claims description 2
- 210000001562 sternum Anatomy 0.000 claims description 2
- 238000005516 engineering process Methods 0.000 abstract description 5
- 238000013473 artificial intelligence Methods 0.000 abstract description 4
- 238000009098 adjuvant therapy Methods 0.000 abstract 1
- 206010035148 Plague Diseases 0.000 description 2
- 241000607479 Yersinia pestis Species 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 208000035473 Communicable disease Diseases 0.000 description 1
- 208000032376 Lung infection Diseases 0.000 description 1
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 210000003109 clavicle Anatomy 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 210000003108 foot joint Anatomy 0.000 description 1
- 210000004072 lung Anatomy 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/30—Surgical robots
- A61B34/35—Surgical robots for telesurgery
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/05—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves
- A61B5/055—Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/02—Arrangements for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
- A61B6/03—Computed tomography [CT]
- A61B6/032—Transmission computed tomography [CT]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/02—Arrangements for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
- A61B6/03—Computed tomography [CT]
- A61B6/037—Emission tomography
Definitions
- the invention belongs to the application of artificial intelligence robot technology to the medical field, and relates to robot technology, an artificial intelligence image intelligent recognition method, intelligent equipment and a system.
- the purpose of the present invention is to overcome the shortcomings and deficiencies of the above-mentioned prior art, and to provide a medical robot device, which utilizes a remote, autonomous robot to collect medical image devices, and solves artificial scanning, inspection, collection, diagnosis and treatment errors, and a single The limitations of the diagnosis and treatment department and the singleness of the diagnosis plan.
- the radar and the mobile base realize autonomous movement, map positioning and navigation, and solve the problem of mobile collection.
- Plane vision device intelligently identify plane information, depth information such as bones, intelligently identify human organs, and scan and collect positions.
- X-ray imaging device direct digital imaging DR device, computerized tomography imaging CT device, magnetic resonance MR device, PET positron emission computed tomography imaging device, intelligent identification, autonomous positioning, scanning task organs.
- the remote control of the robot and autonomous acquisition can be realized, and the problems of high operating pressure and various acquisition tasks for medical staff can be solved.
- a robotic device for medical use comprising:
- the robot main system is used to connect and control the robot device module, including: voice module, vision module and visual recognition module, radar autonomous positioning navigation mobile module, medical device and module, robot arm and action planning module .
- Voice device and voice module the main system of the robot is connected with the voice device for collecting and recognizing voice, voice interaction between users and administrators, and voice commands;
- the radar autonomous positioning and navigation mobile module includes:
- Mobile base connected to the radar, connected to the main system of the robot, for movement;
- Radar connected with the main system of the robot, connected with the mobile base, used for autonomous mapping, positioning, and navigation;
- Medical devices and modules including: medical imaging devices, scanning devices, scanning radiation mediation devices, radiation protection devices, the medical devices are one or more of the following devices,
- X-ray imaging device direct digital imaging DR device, computerized tomography imaging CT device, magnetic resonance MR device, PET positron emission computed tomography imaging device,
- direct digital imaging DR device includes:
- the X-ray emitting device is an X-ray generator for generating X-rays.
- X-ray irradiation scanning device connected with the main system of the robot, integrated with the robot arm, as a scanning device for the scanning robot arm, emits x-rays, and the scanning robot arm is used to collect medical images
- the robot arm is a U-shaped arm, a C-shaped arm ;
- X-ray imaging devices are used to examine the brain, cervical spine, lumbar spine, thoracic spine, and bone joints;
- the flat-panel detection device is used to receive X-rays and assist in the collection of X-ray images.
- the flat-panel detection device is detachable and connected to the information verification robot arm to receive X-rays and assist in the collection of X-ray images.
- the flat-panel detection device is connected to the information verification robot arm and is detachable.
- the robot main system and the remote client control the robot arm and the flat-panel detection device to separate, combine and move.
- CT device computerized tomography imaging device, the computerized tomography imaging device, connected with the scanning device and the main robot system, is used to check the cranium, cervical cone, lumbar spine, thoracic spine, abdomen, bone joints,
- the heart, the scanning device is a circular robotic arm;
- MRI device magnetic resonance device, the magnetic resonance device, connected with the scanning device, connected with the robot main system, is used to examine the cranium, cervical cone, lumbar spine, thoracic spine, bone, cartilage, soft tissue, muscle, chest, blood vessel,
- the abdomen, bone joints, heart, and the scanning device are ring-shaped robotic arms;
- PET device positron emission computed tomography imaging device
- said positron emission tomography imaging device connected with scanning device, with robot main system, is used for examining cranium, cervical cone, lumbar spine, thoracic spine, bone, cartilage , soft tissue, muscle, chest, blood vessel, abdomen, bone joint, heart
- the scanning device is a circular robotic arm;
- Scanning and irradiation mediation device used for scanning, irradiating parts, mediating the position, height, angle, direction and various scanning irradiation parameters of bones and joints;
- Radiation protection device for radiation protection for radiation protection
- the visual collection device and the visual recognition module are used for collecting images and videos, and recognizing images and videos.
- Robotic arms including scanning robotic arms and information verification robotic arms, are used to collect medical images and scan and read information.
- Voice device and voice module the main robot system is connected with the voice device for collecting and recognizing voice, voice interaction between users and administrators, voice command, voice consultation and voice guidance.
- Communication module remote control and autonomous control image acquisition module, the communication module is connected with the robot main system and remote client, the communication module includes wireless communication module, bluetooth communication module, wired Internet communication module, radio frequency communication, radio One or more communication methods in communication.
- Medical devices include: medical imaging devices, scanning devices, scanning irradiation mediation devices, radiation protection devices,
- the medical device is one or more of the following devices,
- X-ray imaging device direct digital imaging DR device, computerized tomography imaging CT device, magnetic resonance MR device, PET positron emission computed tomography imaging device;
- the robotic arm can be remotely controlled and autonomously controlled
- the robotic arm includes a scanning robotic arm, an information verification robotic arm, a scanning robotic arm and a scanning device to collect medical images
- the remote control is through management
- the user remotely controls and mediates setting parameters
- the self-controlled scanning device collects medical images, trains actions and adaptively mediates parameters of the scanning device through the neural network and its improved method, and sets action planning parameters for action planning.
- the collection of medical images and videos, the collection module includes: medical images and video collection modules.
- the scanning robot arm is connected with the main system of the robot and integrated with the robot arm.
- the robot arm is a U-shaped arm, a C-shaped arm, and a ring-shaped robot arm.
- the scanning and irradiation mediation device is integrated with the scanning robot arm and connected with the main robot system, so that the medical object can move, lift and rotate the scanning robot arm according to the standard scanning requirements, and mediate the irradiation position of the scanning task. Bones, joint positions, heights, angles, directions.
- An information collection and reading device includes: an information collection device, an information scanning device, the reading device is connected to an information verification robot arm, and is used as an information reading robot arm for scanning digital codes, two-dimensional codes , RFID, biometrics, intelligent identification to read two-dimensional codes, digital codes, text, logos, biological information, RFID information, patients, user information.
- a visual acquisition device and a visual recognition module the main robot system is connected with the visual acquisition device for collecting images, videos, identifying images, and videos.
- the visual acquisition device includes: a plane vision device and a depth vision device;
- Visual recognition module including: planar vision device and planar image recognition, depth vision device and depth image recognition, used for image and video recognition,
- Planar vision devices and planar image recognition include: face image recognition, facial features image recognition, human body feature recognition, and medical scene recognition.
- Depth vision device and depth image recognition include: bone image, joint image, feature position recognition, key joint position and other special feature recognition of the human body, combined with positioning, to scan human organs.
- the fusion of radar and vision devices is used for autonomous mapping, positioning, and navigation.
- the radar is connected to the mobile base for movement.
- the mobile base, radar, and vision devices are connected to the main robot system for autonomous positioning and navigation.
- the fusion of plane image and depth vision image intelligently recognizes the intelligent recognition method of human facial features, bones, joints, organs, tissues, human body features and their positions. Bones, joints, human body feature points and their positions are autonomously positioned, scanned and inspected for organ tissues, and the method includes the following steps:
- bone model including: head bones, facial bones, skull, neck bones, vertebrae, scapula, shoulder joints, shoulder bones, sternum, ribs, thoracic spine, waist bones, Spine, sacrum, coccyx, left and right upper limb bones, elbow joints, wrist joints, hand joints, waist joints, knee joints, ankle joints, foot joints and their positions are used as feature items, using neural network algorithms and their improved methods to intelligently identify bones and For its position, the depth information and the position information of the human body where the skeleton is located and the information of the adjacent characteristic organs identified by the general image model described in S1 are combined as the feature items of the bone intelligent recognition model as input items;
- S5. Delineate the part to be scanned, scan area, return to scan range, position area, collect position coordinates, autonomous positioning, and move the device;
- the medical imaging device and the scanning device are positioned independently, and moved to the position of the tissue and organ, the corresponding organ and bone;
- Extracting the appearance features of the disease and the graphic features of the organ image including: the outline, color, texture, grayscale contrast, shape, position, color, structure and graphical feature items of the disease of the organ;
- Figure 1 is a schematic diagram of a medical robot device module in the specification of this application.
- 101-Robot main system module 101-Robot main system module; 102-Robot arm scanning acquisition action planning module; 103-Vision module;
- 106-Robot arm grasping and scanning code movement planning module 107-Information collection and reading device and module;
- Figure 2 is a schematic diagram of the composition and structure of the medical robot device in the specification of this application;
- 201 Vision acquisition device 202-Robot main system; 203-Medical device; 204-Scanning irradiation mediation device;
- 209-mobile device 210-information scanning device; 211-radar; 212-voice device; 213-radiation protection device;
- the purpose of the present invention is to design a remote control robot that can replace human work, realize remote control of robot arm acquisition, and effectively solve autonomous scanning, acquisition of medical images and videos.
- artificial intelligence robot technology autonomous collection in the field of automation, robot arm motion planning technology, plane vision device to collect human face, facial features, external features of human body, depth vision device to collect bone and joint images.
- the medical robot device uses the remote end, and the robot autonomously collects medical image devices.
- the mobile base realizes autonomous movement, constructs maps, locates and navigates, and solves the problem of mobile collection.
- Use plane vision device and depth vision device to intelligently identify plane information, skeleton and depth information.
- a robotic device for medical use comprising:
- Robot main system 101 the robot main system module is used to connect and control the robot device module, including: voice module 105, vision module and visual recognition module 103, radar autonomous positioning navigation mobile module 108, medical device and module 104, machine Arm and motion planning module.
- voice module 105 voice module 105
- vision module and visual recognition module 103 radar autonomous positioning navigation mobile module 108
- medical device and module 104 machine Arm and motion planning module.
- Voice device 212 and voice module 105 robot main system 101 is connected with voice device 212, is used for collecting and recognizing sound, voice interaction between administrators between users, voice command;
- the radar autonomous positioning and navigation mobile module includes:
- the mobile base 209 is connected with the radar 211 and connected with the main robot system 101 for moving;
- the radar 211 is connected with the main robot system 101 and the mobile base 209 for autonomous mapping, positioning and navigation;
- Medical device and module 104 including: medical imaging device, scanning device, scanning irradiation mediation device, radiation protection device, the medical device described is one or more of the following devices,
- X-ray imaging device 203 direct digital imaging DR device, computerized tomography imaging CT device, magnetic resonance MR device, PET positron emission computed tomography imaging device,
- direct digital imaging DR device includes:
- the X-ray emitting device 204 is an X-ray generator for generating X-rays.
- X-ray irradiation scanning device connected with the main system of the robot, integrated with the robot arm, as a scanning device for the scanning robot arm, emits x-rays, and the scanning robot arm is used to collect medical images
- the robot arm is a U-shaped arm, a C-shaped arm ;
- X-ray imaging devices are used to examine the brain, cervical spine, lumbar spine, thoracic spine, and bone joints;
- the flat-panel detection device 207 is used to receive X-rays and assist in the acquisition of X-ray images.
- the flat-panel detection device is detachable and connected to the information verification robot arm to receive X-rays and assist in the acquisition of X-ray images.
- the flat-panel detection device is connected to the information verification robot arm and is detachable.
- the robot main system and the remote client control the robot arm and the flat-panel detection device to separate, combine and move.
- CT device computerized tomography imaging device, the computerized tomography imaging device, connected with the scanning device and the main robot system, is used to check the cranium, cervical cone, lumbar spine, thoracic spine, abdomen, bone joints,
- the heart, the scanning device is a circular robotic arm;
- MRI device magnetic resonance device
- the magnetic resonance device is connected with the scanning device and the robot main system 101, and is used to examine the cranium, cervical cone, lumbar spine, thoracic spine, bone, cartilage, soft tissue, muscle, chest, blood vessel , abdomen, bone joints, heart, the scanning device is a ring-shaped robotic arm;
- PET device positron emission computed tomography imaging device, described positron emission computed tomography imaging device, is connected with the scanning device and the main robot system 101, and is used to examine the cranium, cervical cone, lumbar spine, thoracic spine, bone, cartilage.
- the visual collection device and the visual recognition module 103 are used for collecting images and videos, and recognizing images and videos.
- the robot arm including the robot scanning arm 206 and the information verification robot arm 208, is used to collect medical images and scan and read information.
- the voice device 212 and the voice module 105, the main robot system 101 is connected with the voice device 212, and is used for collecting and recognizing sounds, voice interaction between users and administrators, voice commands, voice consultation and voice guidance.
- Communication module 110 remote control and autonomous control image acquisition module, the communication module is connected with the robot main system and the remote client, the communication module includes a wireless communication module, a bluetooth communication module, a wired Internet communication module, radio frequency communication, One or more communication methods in radio communication.
- the scanning task read the organs and tissues that need to be scanned and inspect, extract the face, facial features, neck, nipples, breasts, navel, characteristic genitals, characteristic parts and their positions from the plane image of the human body and input them into the neural network algorithm as feature items
- intelligent recognition marking human body feature points and their positions, extracting head bones, neck spine bones, clavicle, shoulder bones, shoulder joints, left and right upper limb bones, elbow joints, wrist joints, Hand joints, lungs, ribs, spine, waist joints, knee joints, ankle joints, and foot joints are input into the neural network algorithm and its improvement method as feature items, intelligently identify bones and their positions, and intelligently identify the characteristic parts and positions of human organs.
- the medical imaging device and the scanning device are positioned independently , move to the location of tissues and organs, corresponding organs and bones, scan corresponding organs and bones, obtain images of organs and bones, create disease models corresponding to organs, tissues, and parts, establish mathematical models for image recognition, and extract the appearance of diseases
- graphic features of organ images including: organ outline, color, texture, grayscale contrast, shape, position, color, structure, and graphic feature items of diseases, using improved deep neural network to adjust weight parameters to obtain output values According to the range of the output value to identify the normal signs of the corresponding organ or the disease, intelligently identify the organ and its disease, intelligently circle the disease mask of the disease on the image, and the position of the suspected disease mask.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Medical Informatics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Surgery (AREA)
- Public Health (AREA)
- Physics & Mathematics (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Heart & Thoracic Surgery (AREA)
- Veterinary Medicine (AREA)
- High Energy & Nuclear Physics (AREA)
- Radiology & Medical Imaging (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Optics & Photonics (AREA)
- Robotics (AREA)
- Pulmonology (AREA)
- Theoretical Computer Science (AREA)
- Magnetic Resonance Imaging Apparatus (AREA)
- Apparatus For Radiation Diagnosis (AREA)
Abstract
Description
Claims (10)
- 一种医疗用机器人装置,系统及方法,其特征在于,一种医疗用机器人装置包括:A medical robot device, system and method, characterized in that a medical robot device includes:机器人主系统,所述机器人主系统模块,用于连接并控制机器人装置模块,包括:语音模块,视觉模块及视觉识别模块,雷达自主定位导航移动模块,医疗装置及模块,机器臂及动作规划模块;The robot main system, the robot main system module, is used to connect and control the robot device module, including: voice module, vision module and visual recognition module, radar autonomous positioning navigation mobile module, medical device and module, robot arm and action planning module ;语音装置及语音模块,机器人主系统与语音装置连接,用于采集并识别声音,用户间管理员间的语音交互,语音命令;Voice device and voice module, the main system of the robot is connected with the voice device for collecting and recognizing voice, voice interaction between users and administrators, and voice commands;雷达自主定位导航移动模块包括:The radar autonomous positioning and navigation mobile module includes:移动底座,与雷达连接,与机器人主系统连接,用于移动;Mobile base, connected to the radar, connected to the main system of the robot, for movement;雷达,与机器人主系统连接,与移动底座连接,用于自主建图,定位,导航;Radar, connected with the main system of the robot, connected with the mobile base, used for autonomous mapping, positioning, and navigation;医疗装置及模块,包括:医疗成像装置,扫描装置,扫描照射调解装置,防辐射装置,所述的医疗装置为以下装置中的一种及多种,Medical devices and modules, including: medical imaging devices, scanning devices, scanning radiation mediation devices, radiation protection devices, the medical devices are one or more of the following devices,X射线成像装置,直接数字成像DR装置,电子计算机断层扫描显像CT装置,磁共振MR装置,PET正电子发射计算机断层扫描成像装置,X-ray imaging device, direct digital imaging DR device, computerized tomography imaging CT device, magnetic resonance MR device, PET positron emission computed tomography imaging device,X射线成像装置,直接数字成像DR装置包括:X-ray imaging device, direct digital imaging DR device includes:X射线发射装置,为X射线发生器,用于产生X射线。The X-ray emitting device is an X-ray generator for generating X-rays.X射线照射扫描装置,与机器人主系统连接,与机器臂一体化,作为扫描机器臂的扫查装置,发射X射线,扫描机器臂用于采集医疗图像;The X-ray irradiation scanning device is connected with the main system of the robot and integrated with the robot arm, as a scanning device for scanning the robot arm, emitting X-rays, and the scanning robot arm is used to collect medical images;X射线成像装置用于检查颅脑,颈锥,腰椎,胸椎,骨关节;X-ray imaging devices are used to examine the brain, cervical spine, lumbar spine, thoracic spine, and bone joints;平板探测装置,用于接收X射线,辅助采集X射线图像,所述的平板探测装置,可分离式,与信息验证机器臂连接,用于接收X光,辅助采集X光图像。所述的平板探测装置,与信息验证机器臂连接,可分离式,机器人主系统及远端客户端控制机器臂与平板探测装置拆分,结合,移动;The flat-panel detection device is used to receive X-rays and assist in the collection of X-ray images. The flat-panel detection device is detachable and connected to the information verification robot arm to receive X-rays and assist in the collection of X-ray images. The flat-panel detection device is connected to the information verification robot arm and is detachable. The robot main system and the remote client control the robot arm and the flat-panel detection device to split, combine, and move;CT装置,电子计算机断层扫描显像装置,所述的电子计算机断层扫描显像装置,与扫描装置,与机器人主系统连接,用于检查颅脑,颈锥,腰椎,胸椎,腹部,骨关节,心脏;CT device, computerized tomography imaging device, the computerized tomography imaging device, connected with the scanning device and the main robot system, is used to check the cranium, cervical cone, lumbar spine, thoracic spine, abdomen, bone joints, heart;MRI装置,磁共振装置,所述的磁共振装置,与扫描装置连接,与机器人主系统连接,用于检查颅脑,颈锥,腰椎,胸椎,骨,软骨,软组织,肌肉,胸部,血管,腹部,骨关节,心脏;MRI device, magnetic resonance device, the magnetic resonance device, connected with the scanning device, connected with the robot main system, is used to examine the cranium, cervical cone, lumbar spine, thoracic spine, bone, cartilage, soft tissue, muscle, chest, blood vessel, abdomen, bones and joints, heart;PET装置,正电子发射计算机断层扫描成像装置,所述的正电子发射计算机断层扫描成像装置,与扫描装置,与机器人主系统连接,用于检查颅脑,颈锥,腰椎,胸椎,骨,软骨,软组织,肌肉,胸部,血管,腹部,骨关节,心脏;PET device, positron emission computed tomography imaging device, said positron emission tomography imaging device, connected with scanning device, with robot main system, is used for examining cranium, cervical cone, lumbar spine, thoracic spine, bone, cartilage , soft tissue, muscle, chest, blood vessels, abdomen, bone joints, heart;扫描照射调解装置,用于扫描,照射部位,调解骨骼关节的位置,高度,角度,方向及各项扫描照射参数;Scanning and irradiation mediation device, used for scanning, irradiating parts, mediating the position, height, angle, direction and various scanning irradiation parameters of bones and joints;防辐射装置,用于防辐射;Radiation protection device for radiation protection;视觉采集装置及视觉识别模块,用于采集图像,视频,识别图像,视频;A visual collection device and a visual recognition module, used for collecting images, videos, and identifying images and videos;机器臂,包括扫描机器臂及信息验证机器臂,用于采集医疗图像,扫描读取信息;Robotic arms, including scanning robotic arms and information verification robotic arms, are used to collect medical images, scan and read information;
- 一种医疗用机器人装置,系统及方法,其特征在于,语音装置及语音模块,机器人主系统与语音装置连接,用于采集并识别声音,用户间管理员间的语音交互,语音命令,语音问诊和语音引导;A medical robot device, system and method, characterized in that the voice device and the voice module, the main system of the robot is connected with the voice device for collecting and recognizing sounds, voice interaction between users and administrators, voice commands, voice queries diagnosis and voice guidance;
- 一种医疗用机器人装置,系统及方法,其特征在于,通信模块,远端控制及自主控制采集图像模块,所述的通信模块与机器人主系统,远端客户端连接,通信模块包括,无线通信模块,蓝牙通信模块,有线互联网通信模块,射频通信,无线电通信中的一种及多种通信方式;A medical robot device, system and method, characterized in that, a communication module, a remote control and autonomous control image acquisition module, the communication module is connected with the robot main system and a remote client, and the communication module includes, wireless communication Module, Bluetooth communication module, wired Internet communication module, radio frequency communication, one or more communication methods in radio communication;
- 一种医疗用机器人装置,系统及方法,其特征在于,医疗装置,所述的医疗装置,包括:医疗成像装置,扫描装置,扫描照射调解装置,防辐射装置,A medical robot device, system and method, characterized in that the medical device includes: a medical imaging device, a scanning device, a scanning irradiation mediation device, a radiation protection device,所述的医疗装置为以下装置中的一种及多种,The medical device is one or more of the following devices,X射线成像装置,直接数字成像DR装置,电子计算机断层扫描显像CT装置,磁共振MR装置,PET正电子发射计算机断层扫描成像装置;X-ray imaging device, direct digital imaging DR device, computerized tomography imaging CT device, magnetic resonance MR device, PET positron emission computed tomography imaging device;
- 一种医疗用机器人装置,系统及方法,其特征在于,机器臂,所述的机器臂可远端控制及自主控制,所述的机器臂包括扫描机器臂,信息验证机器臂,扫描机器臂及扫描装置采集医疗图像,所述的远端控制是通过管理员,用户远端控制调解设置参数,所述的自主控制扫描装置采集医疗图像,通过神经网络及其改进方法训练动作及自适应调解扫查装置参数,设置动作规划参数,用于动作规划,实现所述的采集医疗图像,视频,所述的采集模块包括:医疗图像,视频采集模块;A medical robot device, system and method, characterized in that the robotic arm can be controlled remotely and autonomously, and the robotic arm includes a scanning robotic arm, an information verification robotic arm, a scanning robotic arm and The scanning device collects medical images, the remote control is through the administrator, the user remotely controls and mediates the setting parameters, the self-control scanning device collects medical images, and the neural network and its improved method are used to train actions and self-adaptive mediation scanning Check the device parameters, set the action planning parameters for action planning, and realize the acquisition of medical images and videos. The acquisition modules include: medical images and video acquisition modules;所述的扫描机器臂与机器人主系统连接,与机器臂一体化;The scanning robot arm is connected with the robot main system and integrated with the robot arm;所述的信息验证机器臂,可自主伸缩,与机器人主系统连接;The information verification robot arm can be stretched and retracted autonomously, and is connected with the robot main system;
- 一种医疗用机器人装置,系统及方法,其特征在于,扫描照射调解装置,所述的扫描照射调解装置,与扫描机器臂一体化,与机器人主系统连接,使医疗对象按标准的扫查要求,移动升降旋转扫描机器臂,调解扫查任务照射部位的骨骼,关节的位置,高度,角度,方向;A medical robot device, system and method, characterized in that the scanning and irradiation mediation device, the scanning and irradiation mediation device is integrated with the scanning robot arm and connected with the main system of the robot, so that the medical object can be scanned according to the standard scanning requirements , move up and down and rotate the scanning robot arm to mediate the position, height, angle and direction of bones and joints in the irradiation part of the scanning task;
- 一种医疗用机器人装置,系统及方法,其特征在于,信息采集读取装置,所述的信息采集读取装置包括:信息采集装置,信息扫描装置,读取装置与信息验证机器臂连接,作为信息读取机器臂,用于扫描数字码,二维码,RFID,生物特征,智能识别读取二维码,数字码,文 字,标识,生物信息,RFID信息,患者,用户信息;A medical robot device, system and method, characterized in that it is an information collection and reading device, and the information collection and reading device includes: an information collection device, an information scanning device, and the reading device is connected with an information verification robot arm, as Information reading robot arm, used to scan digital codes, two-dimensional codes, RFID, biometrics, intelligent identification to read two-dimensional codes, digital codes, text, logos, biological information, RFID information, patients, user information;
- 一种医疗用机器人装置,系统及方法,其特征在于,视觉采集装置及视觉识别模块,机器人主系统与视觉采集装置连接,用于采集图像,视频,识别图像,视频,所述的视觉采集装置包括:平面视觉装置,深度视觉装置;A medical robot device, system and method, characterized in that, a visual acquisition device and a visual recognition module, the robot main system is connected to the visual acquisition device for collecting images, videos, identifying images, and videos. The visual acquisition device Including: plane vision device, depth vision device;视觉识别模块,包括:平面视觉装置及平面图像识别,深度视觉装置及深度图像识别,用于图像视频识别,Visual recognition module, including: planar vision device and planar image recognition, depth vision device and depth image recognition, used for image and video recognition,平面视觉装置及平面图像识别包括:人脸图像识别,五官图像识别,人体特征识别,医疗场景识别,Planar vision devices and planar image recognition include: face image recognition, facial features image recognition, human body feature recognition, medical scene recognition,深度视觉装置及深度图像识别包括:骨骼图像,关节图像,特征位置识别,关键关节位置以及人体的其他特殊特征识别,结合定位,扫查人体器官;Depth vision device and depth image recognition include: bone image, joint image, feature position recognition, key joint position and other special feature recognition of the human body, combined with positioning, scanning of human organs;
- 一种医疗用机器人装置,系统及方法,其特征在于,雷达与视觉装置融合用于自主建图,定位,导航,雷达与移动底座连接,用于移动,移动底座,雷达,视觉装置,与机器人主系统连接,用于自主定位导航,移动;A medical robot device, system and method, characterized in that the fusion of radar and vision device is used for autonomous mapping, positioning, navigation, and the connection between radar and mobile base is used for moving, mobile base, radar, vision device, and robot Main system connection for autonomous positioning, navigation and movement;
- 一种医疗用机器人装置,系统及方法,其特征在于,平面图像与深度视觉图像融合智能识别人体五官,骨骼,关节,器官,组织,人体特征及其位置的智能识别方法,所述方法是将平面视觉图像,深度图像融合,智能识别人体五官,器官,骨骼,关节,人体特征点及其位置自主定位扫描检查器官组织的方法,以及智能识别对应器官病症,病罩的方法所述方法包括以下步骤:A medical robot device, system and method, characterized in that the fusion of plane images and depth vision images intelligently recognizes human facial features, bones, joints, organs, tissues, human body features and their positions, and the method is to Plane visual image, deep image fusion, intelligent recognition of human body features, organs, bones, joints, human body feature points and their positions, a method for autonomous positioning, scanning and inspection of organ tissues, and a method for intelligently identifying corresponding organ diseases and disease masks. The method includes the following step:S1、依据扫查任务,读取需要扫描检查的器官,组织;S1. According to the scanning task, read the organs and tissues that need to be scanned;S2、建立平面图像模型,特征模型,人体器官模型及平面图像的模型包括:人脸,五官,颈部,乳头,乳房,肚脐,特征生殖器,特征部位及其位置作为特征项,用神经网络算法及其改进方法,智能识别人体特征点及其位置;S2. Establishing a plane image model, a feature model, a human organ model and a plane image model including: face, facial features, neck, nipples, breasts, navel, characteristic genitalia, characteristic parts and their positions as feature items, using neural network algorithm And its improved method, intelligent recognition of human body feature points and their positions;S3、建立深度视觉装置及深度视觉图像模型,骨骼模型,包括:头部骨骼,面部骨骼,颅骨,颈部骨骼,椎骨,肩胛骨,肩关节,肩部骨骼,胸骨,肋骨,胸椎,腰部骨骼,脊柱,骶骨,尾骨,左右上肢骨骼,肘关节,腕关节,手关节,腰关节,膝关节,踝关节,足关节及其位置作为特征项,用神经网络算法及其改进方法,智能识别骨骼及其位置,将深度信息及骨骼所在人体的位置信息以及S1所述的一般图像模型识别的近邻特征器官信息作为骨骼智能识别模型的特征项结合,作为输入项;S3. Establish depth vision device and depth vision image model, bone model, including: head bones, facial bones, skull, neck bones, vertebrae, scapula, shoulder joints, shoulder bones, sternum, ribs, thoracic spine, waist bones, Spine, sacrum, coccyx, left and right upper limb bones, elbow joints, wrist joints, hand joints, waist joints, knee joints, ankle joints, foot joints and their positions are used as feature items, using neural network algorithms and their improved methods to intelligently identify bones and For its position, the depth information and the position information of the human body where the skeleton is located and the information of the adjacent characteristic organs identified by the general image model described in S1 are combined as the feature items of the bone intelligent recognition model as input items;S4、智能识别人体器官特征部位及其位置,智能识别需要扫描检查的器官,组织附近的骨骼及其位置辅助定位器官;S4. Intelligently identify the characteristic parts and positions of human organs, intelligently identify the organs that need to be scanned and inspected, and the bones near the tissue and their positions to assist in the positioning of organs;S5、划定需要扫描的部位,扫描区域,返回扫描的范围,位置区域,采集位置坐标,自主定位,移动装置;S5. Delineate the part to be scanned, scan area, return to scan range, position area, collect position coordinates, autonomous positioning, and move the device;S6、按照返回的坐标,依据扫查任务,医疗成像装置,扫描装置自主定位,移动至组织器官位置,对应的器官及骨骼;S6. According to the returned coordinates, according to the scanning task, the medical imaging device and the scanning device are positioned independently, and moved to the position of the tissue and organ, the corresponding organ and bone;S7、自主扫描对应的器官及骨骼,获取器官及骨骼的图像;S7. Scanning the corresponding organs and bones autonomously to obtain images of the organs and bones;S8、创建各器官,组织,部位对应的疾病模型,建立图像识别的数学模型;S8. Create disease models corresponding to various organs, tissues, and parts, and establish a mathematical model for image recognition;S9、抽取疾病的表象特征,器官图像的图形特征,包括:器官的轮廓,颜色,纹理,灰度对比,形状,位置,颜色,结构以及病症的图形化特征项;S9. Extracting the appearance features of the disease and the graphic features of the organ image, including: the outline, color, texture, grayscale contrast, shape, position, color, structure and graphical feature items of the disease of the organ;S10、利用改进深度神经网络调整权值参数,得到输出值,依据输出值的范围来识别对应器官正常体征或疾病智能识别器官及其疾病;S10. Use the improved deep neural network to adjust the weight parameters to obtain the output value, and identify the normal signs or diseases of the corresponding organ according to the range of the output value, and intelligently identify the organ and its disease;S11、智能标注图像上的疾病的病罩,疑似病罩位置;S11. Intelligently mark the disease mask of the disease on the image, and the position of the suspected disease mask;
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU2022332824A AU2022332824A1 (en) | 2021-08-27 | 2022-08-18 | Medical robot apparatus, system and method |
CN202280056989.0A CN118265498A (en) | 2021-08-27 | 2022-08-18 | Medical robot device, system and method |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111008052.X | 2021-08-27 | ||
CN202111008052.XA CN113855250A (en) | 2021-08-27 | 2021-08-27 | Medical robot device, system and method |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023024397A1 true WO2023024397A1 (en) | 2023-03-02 |
Family
ID=78988759
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2022/000118 WO2023024397A1 (en) | 2021-08-27 | 2022-08-18 | Medical robot apparatus, system and method |
Country Status (3)
Country | Link |
---|---|
CN (2) | CN113855250A (en) |
AU (1) | AU2022332824A1 (en) |
WO (1) | WO2023024397A1 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113855250A (en) * | 2021-08-27 | 2021-12-31 | 谈斯聪 | Medical robot device, system and method |
Citations (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150273697A1 (en) * | 2014-03-27 | 2015-10-01 | Fatemah A.J.A. Abdullah | Robot for medical assistance |
CN107030714A (en) * | 2017-05-26 | 2017-08-11 | 深圳市天益智网科技有限公司 | A kind of medical nurse robot |
CN107322602A (en) * | 2017-06-15 | 2017-11-07 | 重庆柚瓣家科技有限公司 | Home-services robot for tele-medicine |
CN107788958A (en) * | 2017-10-20 | 2018-03-13 | 深圳市前海安测信息技术有限公司 | medical monitoring robot and medical monitoring method |
CN109758233A (en) * | 2019-01-21 | 2019-05-17 | 上海益超医疗器械有限公司 | A kind of diagnosis and treatment integrated operation robot system and its navigation locating method |
WO2019175675A2 (en) * | 2019-07-01 | 2019-09-19 | Wasfi Alshdaifat | Dr robot medical artificial intelligence robotic arrangement |
CN110477956A (en) * | 2019-09-27 | 2019-11-22 | 哈尔滨工业大学 | A kind of intelligent checking method of the robotic diagnostic system based on ultrasound image guidance |
US20190358820A1 (en) * | 2018-05-23 | 2019-11-28 | Aeolus Robotics, Inc. | Robotic Interactions for Observable Signs of Intent |
CN111481227A (en) * | 2020-05-18 | 2020-08-04 | 国登刚 | Medical examination bed intelligent positioning system based on computer vision technology |
CN111916195A (en) * | 2020-08-05 | 2020-11-10 | 谈斯聪 | Medical robot device, system and method |
CN111906785A (en) * | 2020-07-23 | 2020-11-10 | 谈斯聪 | Multi-mode comprehensive information identification mobile double-arm robot device system and method |
CN111973152A (en) * | 2020-06-17 | 2020-11-24 | 谈斯聪 | Five sense organs and surgical medical data acquisition analysis diagnosis robot and platform |
CN111973228A (en) * | 2020-06-17 | 2020-11-24 | 谈斯聪 | B-ultrasonic data acquisition, analysis and diagnosis integrated robot and platform |
CN112155729A (en) * | 2020-10-15 | 2021-01-01 | 中国科学院合肥物质科学研究院 | Intelligent automatic planning method and system for surgical puncture path and medical system |
CN113855250A (en) * | 2021-08-27 | 2021-12-31 | 谈斯聪 | Medical robot device, system and method |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111407414A (en) * | 2020-04-07 | 2020-07-14 | 上海市第一人民医院 | Multifunctional remote robot for clinical diagnosis and treatment |
CN111658154B (en) * | 2020-05-11 | 2021-10-26 | 首都医科大学附属北京天坛医院 | Automatic remote radiography surgical robot system |
-
2021
- 2021-08-27 CN CN202111008052.XA patent/CN113855250A/en active Pending
-
2022
- 2022-08-18 AU AU2022332824A patent/AU2022332824A1/en active Pending
- 2022-08-18 WO PCT/CN2022/000118 patent/WO2023024397A1/en active Application Filing
- 2022-08-18 CN CN202280056989.0A patent/CN118265498A/en active Pending
Patent Citations (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150273697A1 (en) * | 2014-03-27 | 2015-10-01 | Fatemah A.J.A. Abdullah | Robot for medical assistance |
CN107030714A (en) * | 2017-05-26 | 2017-08-11 | 深圳市天益智网科技有限公司 | A kind of medical nurse robot |
CN107322602A (en) * | 2017-06-15 | 2017-11-07 | 重庆柚瓣家科技有限公司 | Home-services robot for tele-medicine |
CN107788958A (en) * | 2017-10-20 | 2018-03-13 | 深圳市前海安测信息技术有限公司 | medical monitoring robot and medical monitoring method |
US20190358820A1 (en) * | 2018-05-23 | 2019-11-28 | Aeolus Robotics, Inc. | Robotic Interactions for Observable Signs of Intent |
CN109758233A (en) * | 2019-01-21 | 2019-05-17 | 上海益超医疗器械有限公司 | A kind of diagnosis and treatment integrated operation robot system and its navigation locating method |
WO2019175675A2 (en) * | 2019-07-01 | 2019-09-19 | Wasfi Alshdaifat | Dr robot medical artificial intelligence robotic arrangement |
CN110477956A (en) * | 2019-09-27 | 2019-11-22 | 哈尔滨工业大学 | A kind of intelligent checking method of the robotic diagnostic system based on ultrasound image guidance |
CN111481227A (en) * | 2020-05-18 | 2020-08-04 | 国登刚 | Medical examination bed intelligent positioning system based on computer vision technology |
CN111973152A (en) * | 2020-06-17 | 2020-11-24 | 谈斯聪 | Five sense organs and surgical medical data acquisition analysis diagnosis robot and platform |
CN111973228A (en) * | 2020-06-17 | 2020-11-24 | 谈斯聪 | B-ultrasonic data acquisition, analysis and diagnosis integrated robot and platform |
CN111906785A (en) * | 2020-07-23 | 2020-11-10 | 谈斯聪 | Multi-mode comprehensive information identification mobile double-arm robot device system and method |
CN111916195A (en) * | 2020-08-05 | 2020-11-10 | 谈斯聪 | Medical robot device, system and method |
CN112155729A (en) * | 2020-10-15 | 2021-01-01 | 中国科学院合肥物质科学研究院 | Intelligent automatic planning method and system for surgical puncture path and medical system |
CN113855250A (en) * | 2021-08-27 | 2021-12-31 | 谈斯聪 | Medical robot device, system and method |
Also Published As
Publication number | Publication date |
---|---|
CN118265498A (en) | 2024-06-28 |
AU2022332824A1 (en) | 2024-04-11 |
CN113855250A (en) | 2021-12-31 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Li et al. | An overview of systems and techniques for autonomous robotic ultrasound acquisitions | |
CN112641511B (en) | Joint replacement surgery navigation system and method | |
CN101474075B (en) | Navigation system of minimal invasive surgery | |
WO2022027921A1 (en) | Medical robotic device, system, and method | |
CN110533763B (en) | Intelligent orthopedic external fixation system based on cloud platform | |
CN109820695A (en) | A kind of horizontal bilateral brain paralysis lower limb rehabilitation robot in the ward ICU with communication and independent navigation locomotive function | |
JP7240519B2 (en) | Smart monitoring system for pelvic fracture reduction | |
US11779423B2 (en) | Real-time adjustment of haptic feedback in surgical robots | |
CN112641512A (en) | Spatial registration method applied to surgical robot front planning | |
WO2023024396A1 (en) | Recognition, autonomous positioning and scanning method for visual image and medical image fusion | |
US11672614B1 (en) | Robotic surgical systems with multi-modality imaging for performing surgical steps | |
US11464650B1 (en) | Synchronized placement of surgical implant hardware | |
US11801104B2 (en) | Robotic system and method for performing latency managed telesurgery | |
US11478314B1 (en) | System and method for implanting smart implants using robotic telesurgery | |
WO2023024399A1 (en) | Medical robot apparatus, system and method | |
WO2023024397A1 (en) | Medical robot apparatus, system and method | |
WO2023024398A1 (en) | Method for intelligently identifying thoracic organ, autonomously locating and scanning thoracic organ | |
CN107736897A (en) | A kind of ultrasound registration and resetting long bone device and method based on Six Degree-of-Freedom Parallel Platform | |
CN107595406B (en) | Electromagnetic guiding system for fracture closed reduction treatment | |
CN118213040A (en) | Structured acupoint knowledge graph construction system and method based on human body three-dimensional model | |
Lavallée et al. | Computer integrated surgery and therapy: State of the art | |
US11844575B1 (en) | Digital image analysis for robotic installation of surgical implants | |
CN106214272A (en) | A kind of operation of opening cranium visualizes brain function structure localization method | |
US11571266B1 (en) | Robotic surgical system for insertion of surgical implants | |
CN115602287A (en) | Acupuncture point positioning method and acupuncture auxiliary system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22859759 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 202280056989.0 Country of ref document: CN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2022332824 Country of ref document: AU Ref document number: AU2022332824 Country of ref document: AU |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2022332824 Country of ref document: AU Date of ref document: 20220818 Kind code of ref document: A |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 22859759 Country of ref document: EP Kind code of ref document: A1 |