WO2021000288A2 - Method for implementing automatic suture-less primary corneal incision - Google Patents
Method for implementing automatic suture-less primary corneal incision Download PDFInfo
- Publication number
- WO2021000288A2 WO2021000288A2 PCT/CN2019/094556 CN2019094556W WO2021000288A2 WO 2021000288 A2 WO2021000288 A2 WO 2021000288A2 CN 2019094556 W CN2019094556 W CN 2019094556W WO 2021000288 A2 WO2021000288 A2 WO 2021000288A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- point
- scalpel
- points
- linear motor
- matching
- Prior art date
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/30—Surgical robots
- A61B34/32—Surgical robots operating autonomously
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods
- A61B2017/00367—Details of actuation of instruments, e.g. relations between pushing buttons, or the like, and activation of the tool, working tip, or the like
- A61B2017/00398—Details of actuation of instruments, e.g. relations between pushing buttons, or the like, and activation of the tool, working tip, or the like using powered actuators, e.g. stepper motors, solenoids
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/30—Surgical robots
- A61B2034/302—Surgical robots specifically adapted for manipulations within body cavities, e.g. within abdominal or thoracic cavities
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
- A61B2090/373—Surgical systems with images on a monitor during operation using light, e.g. by using optical scanners
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61F—FILTERS IMPLANTABLE INTO BLOOD VESSELS; PROSTHESES; DEVICES PROVIDING PATENCY TO, OR PREVENTING COLLAPSING OF, TUBULAR STRUCTURES OF THE BODY, e.g. STENTS; ORTHOPAEDIC, NURSING OR CONTRACEPTIVE DEVICES; FOMENTATION; TREATMENT OR PROTECTION OF EYES OR EARS; BANDAGES, DRESSINGS OR ABSORBENT PADS; FIRST-AID KITS
- A61F9/00—Methods or devices for treatment of the eyes; Devices for putting in contact-lenses; Devices to correct squinting; Apparatus to guide the blind; Protective devices for the eyes, carried on the body or in the hand
- A61F9/007—Methods or devices for eye surgery
- A61F9/013—Instruments for compensation of ocular refraction ; Instruments for use in cornea removal, for reshaping or performing incisions in the cornea
Definitions
- the present invention relates to the field of automated surgery, and more specifically, to a method for realizing automatic seamless closure of a main corneal incision.
- the initial step of cataract surgery is to make a main corneal incision in the corneal layer of the patient’s eye.
- the existing method is mainly manual operation by doctors through instruments, but different doctors will make different operations for different patients.
- the quality of the incision depends on the technique and status of the surgeon.
- the required accuracy is high, and manual operation is likely to cause damage to the incision.
- CN102639088B discloses a laser system and method for suturing corneal incisions and corneal incisions. Lasers are used to perform automated operations on the incisions, but lasers are also likely to cause other damage to the corneal layer.
- the present invention aims to solve the above-mentioned technical problems at least to a certain extent, and provide a method for realizing automatic seamless fusion of the main corneal incision, so as to avoid additional damage during the imported corneal incision surgery.
- the technical solution adopted by the present invention is: a method for automating the seamless joint of the main corneal incision, including a machine operating arm and a scalpel mounted on the machine operating arm, the machine operating arm including a clamp A clamping device holding the scalpel and a driving arm that drives the clamping device to swing; the driving arm is provided with a first linear motor and a second linear motor, and the clamping device is equipped with a third linear motor, It includes the following steps:
- Step 1 Use the microscope camera system to take two images with a millimeter vertical displacement
- Step 2 Perform preprocessing on each image, convert it into an image with gray value, and perform corner detection on the first image to obtain a number of candidate corner points, and obtain the coordinates of the corner points;
- Step 3 With several corner points as the center and R j as the radius, find the black point and white point relative to the corner point, and the black point is located in the white pixel area of the corner point and the white point is located in the black area of the corner point.
- the pixel gray scale of the queen is ⁇ 0.5 and the pixel gray scale of the white queen is> 0.5, then the corner point is the scalpel point P′ i , and the calculation formulas for the positions of the black and white points are as follows:
- X blacki and Y blacki are the coordinates of the black points
- X whitei and Y whitei are the coordinates of the white points
- X j and Y j are the corner points as the center
- R j is the radius of all pixels in the range each coordinate point of the gradation values for I, range maximum selected radius
- X i, Y i respectively scalpel point P 'coordinate value of i.
- Step 4 Match the first image P′ i to the second image to obtain the pixel distance between the matching points P” i , P′ i and P” i ;
- Step 5 The formula for calculating the depth of the scalpel point is as follows:
- r is the distance between the scalpel point P′ and the magnification center of the microscope, and ⁇ r is the pixel distance between P′ i and P′′ i , called parallax;
- Step 6 Obtain the position and relative depth of the scalpel according to the calculation, and obtain the position of the iris, and locate the incision on the edge of the iris that is closest to the center of the pupil;
- Step 7 The standard seamless corneal main incision is defined as a loose "Z" shape, and the machine operating arm controls the scalpel to move along the set incision path.
- step four the process of matching the P 'i establish a P' i point as the center square area basis, than the defined point P 'i is adjacent to the point, each of the adjacent points is defined with respect
- the depth of P′ i is the same; when matching all the basic points in the square area, the matching points corresponding to the second image are calculated respectively.
- the matching points and the corresponding disparity are calculated by selecting the disparity that minimizes the value of the cost function. Among them, the cost function formula is:
- P′ ij is the pixel position corresponding to the base point
- P′′ ij is the pixel position corresponding to the matching point
- I z is the gray value of each pixel in the first image
- I za is each pixel in the second image.
- grayscale images I z (P 'ij) is P' ij gradation values
- I za (P "ij) is P" ij gray value.
- the step between four and five step is provided with checking step, the matching points in the image corresponding to P "ij of relative P" position i with respect to the adjacent point coincides with the position P 'i, and (wherein, P′ ij is the domain point, P′′ ij is the matching point of the domain point, P′ i is the center point, and P′ i is the matching point of the center point) then the verification is successful.
- the center P′ i Add one point to the center P′ i , the total number of votes 8 votes (8 domain points), 4 votes or more (including 4 votes) are matched successfully; otherwise, the basic point square area is established with each neighboring point as the center, and the calculation formula in step 4 is re-executed to calculate the matching points again Run the voting with the corresponding parallax, and the first person with more than 4 votes wins. More than half of the matching points are in the same position as the near point, which avoids the situation where P′ i is a noise point and improves the accuracy of the scalpel point .
- the first adjacent point successfully checked is defined as the new P′ i point, and other close points and unsuccessful points are discarded, and then the remaining matching points P′′ ik in the second image are taken as The base point is matched with the first image, and the check point is obtained. The check point is consistent with the base point, the matching is successful. If not, perform the check step again. Flip the matching direction and check the correctness of the match again to improve The accuracy of the scalpel point.
- the interpolation optimization calculation is performed on the depth calculation formula of the scalpel point in the fifth step. Optimize the calculation by interpolation to make the depth calculation more accurate.
- Each P′′ ik sets two interpolation points along the epipolar line L ik , namely the left interpolation point P′′ ikl and the right interpolation point P′′ ikr , and the cost function of the square area matching is used to calculate the cost C(P′ i , ⁇ r ikr ), C(P′ i , ⁇ r ikl ) and C(P′ i , ⁇ r ik ), remove the minimum cost interpolation point or origin, delete the other two points, and get the final depth formula as follows:
- Lik is the epipolar line
- Z kj is the depth corresponding to P′′ ik and P′ ij ;
- n o is the number of Z kj.
- the calculation formulas of the interpolation points are:
- P "ik + Li to P” move pixel value Li of the distance along the epipolar forward ik
- P "ik-Li to P” move pixel value Li of the distance along the epipolar ik negative.
- the incision path is defined as follows:
- S1 The scalpel enters the corneal layer
- S5 The scalpel continues to advance at the angle of S4 until it penetrates the cornea.
- the scalpel performs RCM movement
- the position of the RCM point is fixed
- the control strategy formula of the RCM point is as follows:
- x R is the X-axis coordinate position of the RCM point
- y R is the Y-axis coordinate position of the RCM point
- L 1 is the linear displacement of the first linear motor
- L 2 is the linear displacement of the second linear motor
- L tool is the clamp The distance between the holding device and the tip of the scalpel
- L 3 is the linear displacement of the third linear motor
- Is the angle between the scalpel blade face and the connecting end of the clamping device Is the angle between the blade surface of the scalpel and the horizontal plane
- L o is the length of the blade surface
- dm is the vertical distance from the third linear motor to the horizontal axis of the first linear motor or the second linear motor.
- the scalpel rotates around the RCM point, and
- the angle change trajectory is The trajectory formulas of the first linear motor, the second linear motor and the third linear motor are as follows:
- h is the linear distance between the first linear motor and the second linear motor.
- the trajectories of the first linear motor, the second linear motor and the third linear motor are calculated according to the coordinate control strategy of the RCM point.
- the trajectories of the first linear motor, the second linear motor and the third linear motor are also calculated according to the formula to achieve the effect of controlling the movement of the scalpel.
- control method of the parallel-series-joint machine operating arm is that the first linear motor, the second linear motor and the third linear motor define from the previous target position to the third linear motor by using linear interpolation. The position between the next target position and the step length between the two target positions.
- the target position of each step is obtained by calculating the incision path to obtain the position of each millisecond.
- the microscope system and the machine operating arm are initialized.
- the X-axis and Y-axis coordinates of the machine operating arm and the microscope camera system are consistent.
- the coordinates of the machine operating arm and the microscope system are consistent, and the coordinates of the machine operating arm's execution movement are consistent with the calculated coordinates to ensure the accuracy of the machine operating arm's movement.
- the width of the incision is not greater than the width of the blade surface of the scalpel.
- the machine operating arm controls the scalpel to move only along the incision path and does not perform displacement in other directions, ensuring that the width of the incision is not greater than the width of the scalpel blade surface, and avoiding the expansion of the incision.
- this method is based on a machine operating arm and a scalpel, realizes a method of fully automatic corneal incision with a scalpel, avoids the inaccuracy of manual operation and the damage of wound enlargement. Avoid laser damage to the corneal layer.
- Figure 1 is a flow chart of the method of the present invention
- Figure 2 is a schematic diagram of the structure of the machine operating arm
- Figure 3 is a schematic view of the incision path of the present invention.
- a method for realizing automatic seamless joint corneal main incision including a machine operating arm and a scalpel 1 mounted on the machine operating arm.
- a parallel tandem joint machine operating arm includes a clamping device 2 for clamping the scalpel 1 and a drive The swing driving arm of the clamping device 2; the driving arm is provided with a first linear motor 3 and a second linear motor 4, and the clamping device is equipped with a third linear motor 5, including the following steps:
- Step 1 Use the microscope camera system to take two images with a vertical displacement of 6 mm;
- Step 2 Perform preprocessing on each image, convert it into an image with gray value, and perform corner detection on the first image to obtain several candidate corner points, and obtain the corner point coordinates;
- Step 3 With several corner points as the center and R j as the radius, find the black point and white point relative to the corner point, and the black point is located in the white pixel area of the corner point and the white point is located in the black area of the corner point.
- the pixel gray scale of the queen is ⁇ 0.5 and the pixel gray scale of the white queen is> 0.5, then the corner point is the scalpel point P′ i , and the calculation formulas for the positions of the black and white points are as follows:
- X blacki and Y blacki are the coordinates of the black points
- X whitei and Y whitei are the coordinates of the white points
- X j and Y j are the corner points as the center
- R j is the radius of all pixels in the range
- I is the gray value of the point
- range is the maximum value of the selected radius
- X i and Y i are the coordinate values of the scalpel point P′ i respectively;
- Step 4 Match the first image P′ i to the second image to obtain the pixel distance between the matching points P” i , P′ i and P” i ;
- Step 5 The formula for calculating the depth of the scalpel point is as follows:
- r is the distance between the scalpel point P′ and the magnification center of the microscope, and ⁇ r is the pixel distance between P′ i and P′′ i , called parallax;
- Step 6 Obtain the position and relative depth of the scalpel according to the calculation, and obtain the position of the iris, and locate the incision position on the edge of the iris which is closest to the center of the pupil;
- Step 7 The standard seamless corneal main incision is defined as a loose "Z" shape.
- the incision path of the machine operating arm to control the movement of the scalpel is defined as follows:
- S5 The scalpel 1 continues to advance 2mm through the corneal layer 6 at the angle of S4.
- the scalpel point is the position of the scalpel
- the position of the scalpel and the depth relative to the microscope system are obtained by calculation, and the three-dimensional coordinates of the scalpel are obtained.
- the position information of the cornea and iris of the eye is also obtained, the scalpel is placed in the initial position, and the scalpel is controlled to move along the set incision path through the machine operating arm to automatically complete the incision.
- This method is based on a machine operating arm and a scalpel, and realizes a fully automatic corneal incision method with a scalpel, which avoids the inaccuracy of manual operation and the damage caused by the expansion of the wound, and also avoids other damages to the corneal layer caused by laser .
- this embodiment provides a specific matching method, a matching result verification method, and a depth calculation optimization method, specifically:
- Matching method as P 'i establish a P' i is the basis of the center point of a block region, defined point P 'adjacent point other than i, is defined with respect to each of the adjacent point P' i uniform depth; in the area of the block All the basic points are matched, and the matching points corresponding to the second image are calculated.
- the matching points and the corresponding disparity are calculated by selecting the disparity that minimizes the value of the cost function.
- the cost function formula is:
- P′ ij is the pixel position corresponding to the base point
- P′′ ij is the pixel position corresponding to the matching point
- I z is the gray value of each pixel in the first image
- I za is each pixel in the second image.
- the gray value of the image, I z (P′ ij ) is the gray value of P′ ij
- I za (P′′ ij ) is the gray value of P′′ ij
- ⁇ r is the value between P′ i and P′′ i
- the pixel distance is called parallax.
- interpolation formula for calculating depth optimized for the particular process in each P "ik source lines disposed along the outer two interpolation points L ik, respectively, to the left of the interpolation point P" ikl and a right interpolation point P ” Ikr use the cost function of the block area matching to calculate the cost C(P′ i , ⁇ r ikr ), C(P′ i , ⁇ r ikl ) and C(P′ i , ⁇ r ik ), and remove the minimum cost interpolation point or Origin point, delete the remaining two points, get the interpolation point and the final depth formula as follows:
- L ik is the epipolar, Z kj corresponding P “ij and ik depth P ';P" ik + Li to P "ik moved forward along the epipolar pixel distance values Li, P" ik -Li is the value of P′′ ik moving Li pixels along the negative direction of the epipolar line.
- n o is the number of Z kj.
- the beneficial effects of the present invention by establishing the matching and checking of the square area, the position of the operation can be found more accurately, and the depth calculation can be made more accurate through the interpolation optimization.
- this embodiment provides a motion trajectory control algorithm formula and method of a machine operating arm with parallel series joints, specifically
- Scalpel 1 performs RCM movement, the position of the RCM point is fixed, and the control strategy formula of the RCM point is as follows:
- x R is the X-axis coordinate position of the RCM point
- y R is the Y-axis coordinate position of the RCM point
- L 1 is the linear displacement of the first linear motor
- L 2 is the linear displacement of the second linear motor
- L tool is the clamp The distance between the holding device and the tip of the scalpel
- L 3 is the linear displacement of the third linear motor
- Is the angle between the scalpel blade face and the connecting end of the clamping device Is the angle between the blade surface of the scalpel and the horizontal plane
- L o is the length of the blade surface
- dm is the vertical distance from the third linear motor to the horizontal axis of the first linear motor or the second linear motor.
- the angle change trajectory is The trajectory formulas of the first linear motor, the second linear motor and the third linear motor are as follows:
- h is the linear distance between the first linear motor and the second linear motor.
- the movement trajectories of the first linear motor, the second linear motor and the third linear motor are calculated according to the coordinate control strategy of the RCM point.
- the movement trajectories of the first linear motor 3, the second linear motor 4, and the third linear motor 5 are also calculated according to the formula to achieve the effect of controlling the movement of the scalpel 1.
- first linear motor 3, the second linear motor 4, and the third linear motor 5 define the position from the previous target position to the next target position by using a linear interpolation method, and set one of the two target positions The step length between.
- the target position of each step is obtained by calculating the incision path to obtain the position of each millisecond.
- step 1 initialize the microscope system and the machine operating arm.
- the X-axis and Y-axis coordinates of the machine operating arm and the microscope camera system are consistent.
- the coordinates of the machine operating arm and the microscope system are consistent, and the coordinates of the machine operating arm's execution movement are consistent with the calculated coordinates to ensure the accuracy of the machine operating arm's movement.
- the width of the incision is not greater than the width of the blade surface of the scalpel.
- the machine operating arm controls the scalpel 1 to move only along the incision path and does not perform displacement in other directions, ensuring that the width of the incision is not greater than the width of the scalpel blade surface, and avoiding the expansion of the incision.
Landscapes
- Health & Medical Sciences (AREA)
- Surgery (AREA)
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Medical Informatics (AREA)
- Robotics (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Molecular Biology (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Laser Surgery Devices (AREA)
- Prostheses (AREA)
- Eye Examination Apparatus (AREA)
Description
本发明涉及自动化手术领域,更具体地,涉及一种实现自动化无缝合角膜主切口的方法。The present invention relates to the field of automated surgery, and more specifically, to a method for realizing automatic seamless closure of a main corneal incision.
白内障手术的初始步骤就是在患者眼部的角膜层做出一个角膜主切口,现有的方法主要是医生通过器械进行手动操作,但是不同的医生对不同患者,每次操作都会有所不同,主切口的好坏取决于主刀医生的技术和状态,而在做无缝合主切口的时候,需求的精度高,人手操作容易造成切口的损伤。The initial step of cataract surgery is to make a main corneal incision in the corneal layer of the patient’s eye. The existing method is mainly manual operation by doctors through instruments, but different doctors will make different operations for different patients. The quality of the incision depends on the technique and status of the surgeon. When making a seamless main incision, the required accuracy is high, and manual operation is likely to cause damage to the incision.
公开号为“CN102639088B”公开了一种眼睛角膜切口及角膜切口缝合的激光系统与方法,采用激光的方式对切口进行自动化的手术,但是激光的方式也容易造成角膜层的其他损伤。The publication number "CN102639088B" discloses a laser system and method for suturing corneal incisions and corneal incisions. Lasers are used to perform automated operations on the incisions, but lasers are also likely to cause other damage to the corneal layer.
发明内容Summary of the invention
本发明旨在至少在一定程度上解决上述技术问题,提供一种实现自动化无缝合角膜主切口的方法,避免在进口角膜切口手术中,造成额外的损伤。The present invention aims to solve the above-mentioned technical problems at least to a certain extent, and provide a method for realizing automatic seamless fusion of the main corneal incision, so as to avoid additional damage during the imported corneal incision surgery.
为解决上述技术问题,本发明采用的技术方案是:一种实现自动化无缝合角膜主切口的方法,包括机器操作臂和安装于所述机器操作臂上的手术刀,所述机器操作臂包括夹持所述手术刀的夹持装置和驱动所述夹持装置摆动的驱动臂;所述驱动臂上设置有第一线性马达和第二线性马达,所述夹持装置装有第三线性马达,包括以下步骤:In order to solve the above-mentioned technical problems, the technical solution adopted by the present invention is: a method for automating the seamless joint of the main corneal incision, including a machine operating arm and a scalpel mounted on the machine operating arm, the machine operating arm including a clamp A clamping device holding the scalpel and a driving arm that drives the clamping device to swing; the driving arm is provided with a first linear motor and a second linear motor, and the clamping device is equipped with a third linear motor, It includes the following steps:
步骤一:使用显微镜摄像系统以a毫米垂直位移拍摄两幅图像;Step 1: Use the microscope camera system to take two images with a millimeter vertical displacement;
步骤二:对每幅图像进行预处理,转换为具有灰度值的图像,并对第一幅图像进行角点检测,得到若干候选角点,并且得到所述角点的坐标;Step 2: Perform preprocessing on each image, convert it into an image with gray value, and perform corner detection on the first image to obtain a number of candidate corner points, and obtain the coordinates of the corner points;
步骤三:若干角点以各自为中心,R j为半径,求出相对于角点的黑点和白点,并且黑点位于角点白色像素区域和白点位于角点的黑色区域,且黑皇后的像素灰度<0.5且白皇后的像素灰度>0.5,则该角点为手术刀点P′ i,黑点和白点 位置的计算公式如下: Step 3: With several corner points as the center and R j as the radius, find the black point and white point relative to the corner point, and the black point is located in the white pixel area of the corner point and the white point is located in the black area of the corner point. The pixel gray scale of the queen is <0.5 and the pixel gray scale of the white queen is> 0.5, then the corner point is the scalpel point P′ i , and the calculation formulas for the positions of the black and white points are as follows:
其中,X blacki和Y blacki分别为黑点的坐标值,X whitei和Y whitei分别白点的坐标值,X j和Y j是以角点为中心,R j为半径的范围内所有像素点的各自坐标,I为该点的灰度值,range为选取的半径最大值;X i、Y i分别为手术刀点P′ i的坐标值。 Among them, X blacki and Y blacki are the coordinates of the black points, X whitei and Y whitei are the coordinates of the white points, X j and Y j are the corner points as the center, and R j is the radius of all pixels in the range each coordinate point of the gradation values for I, range maximum selected radius; X i, Y i respectively scalpel point P 'coordinate value of i.
步骤四:对第一幅图像P′ i向第二幅图像进行匹配,得到匹配点P″ i,P′ i和P″ i之间的像素距离; Step 4: Match the first image P′ i to the second image to obtain the pixel distance between the matching points P” i , P′ i and P” i ;
步骤五:手术刀点的深度计算公式如下:Step 5: The formula for calculating the depth of the scalpel point is as follows:
其中,r为手术刀点P′与显微镜放大中心之间的距离,Δr为P′ i和P″ i之间的像素距离,称为视差; Among them, r is the distance between the scalpel point P′ and the magnification center of the microscope, and Δr is the pixel distance between P′ i and P″ i , called parallax;
步骤六:根据计算得到手术刀的位置和相对深度,并获取虹膜的位置,将切口位置定位在虹膜边缘上距离瞳孔中心最近的一个;Step 6: Obtain the position and relative depth of the scalpel according to the calculation, and obtain the position of the iris, and locate the incision on the edge of the iris that is closest to the center of the pupil;
步骤七:标准的无缝合角膜主切口定义为一个松散的“Z”字形,将所述机器操作臂控制手术刀沿设定的切口路径运动。Step 7: The standard seamless corneal main incision is defined as a loose "Z" shape, and the machine operating arm controls the scalpel to move along the set incision path.
优选的,在所述步骤四中,匹配的方法为在P′ i建立一个以P′ i为中心的基础点方块区域,定义P′ i以外的点为邻近点,定义每个邻近点相对于P′ i的深度一致;在对方块区域所有的基础点进行匹配,计算分别在第二幅图像对应的匹配点,匹配点和对应的视差通过选择使得代价函数数值最小的视差来计算得出, 其中,代价函数公式为: Preferably, in step four, the process of matching the P 'i establish a P' i point as the center square area basis, than the defined point P 'i is adjacent to the point, each of the adjacent points is defined with respect The depth of P′ i is the same; when matching all the basic points in the square area, the matching points corresponding to the second image are calculated respectively. The matching points and the corresponding disparity are calculated by selecting the disparity that minimizes the value of the cost function. Among them, the cost function formula is:
C(P′ ij,Δr)=min{d(P′ ij,P′ ij-Δr,I Z,I z-a),d(P′ ij-Δr,P′ ij,I Z-a,I z} C(P′ ij ,Δr)=min{d(P′ ij ,P′ ij -Δr,I Z ,I za ),d(P′ ij -Δr,P′ ij ,I Za ,I z }
d(P′ ij,P′ ij-Δr,I z,I z-a)=minP′ ij-Δr-0.5 d(P′ ij ,P′ ij -Δr,I z ,I za )=minP′ ij -Δr-0.5
≤P′ ij-Δr+0.5{|I z(P′ ij)-I z-a(P″ ij)|} ≤P′ ij -Δr+0.5{|I z (P′ ij )-I za (P″ ij )|}
其中,P′ ij为对应基础点的像素位置,P″ ij为对应匹配点的像素位置,I z为第一幅图像中每个像素的灰度值,I z-a为第二幅图像中每个图像的灰度值,I z(P′ ij)为P′ ij的灰度值,I z-a(P″ ij)为P″ ij的灰度值。 Where P′ ij is the pixel position corresponding to the base point, P″ ij is the pixel position corresponding to the matching point, I z is the gray value of each pixel in the first image, and I za is each pixel in the second image. grayscale images, I z (P 'ij) is P' ij gradation values, I za (P "ij) is P" ij gray value.
优选的,在所述步骤四和步骤五之间设置有校核步骤,图像中对应的匹配点P″
ij相对于P″
i的位置与邻近点相对于P′
i的位置一致,(其中,P′
ij为领域点,P″
ij为领域点的匹配点,P′
i为中心点,P′
i为中心点的匹配点)则校核成功,对于中心P′
i加一分,总票数8票(8个领域点),达到4票以上(包括4票)匹配成功;否则,则以每个邻近点为中心建立基础点方块区域,重新执行步骤四中的计算公式,再次计算匹配点和对应的视差,并运行投票,第一个超过4票者胜出。超过半数以上的匹配点和领近点相对的位置一致,避免了P′
i是噪点的情况,提高手术刀点的正确性。
Preferably, the step between four and five step is provided with checking step, the matching points in the image corresponding to P "ij of relative P" position i with respect to the adjacent point coincides with the position P 'i, and (wherein, P′ ij is the domain point, P″ ij is the matching point of the domain point, P′ i is the center point, and P′ i is the matching point of the center point) then the verification is successful. Add one point to the center P′ i , the total number of
优选的,第一个校核成功的邻近点定义为新的P′ i点,并舍弃其他领近点和校核不成功的点,再以第二幅图像中剩余的匹配点P″ ik为基点与第一幅图像进行匹配,得到校核点,校核点与基础点的位置一致,则匹配成功。否侧,再次执行校核步骤。翻转匹配方向,再次校核匹配的正确性,提高手术刀点的准确性。 Preferably, the first adjacent point successfully checked is defined as the new P′ i point, and other close points and unsuccessful points are discarded, and then the remaining matching points P″ ik in the second image are taken as The base point is matched with the first image, and the check point is obtained. The check point is consistent with the base point, the matching is successful. If not, perform the check step again. Flip the matching direction and check the correctness of the match again to improve The accuracy of the scalpel point.
优选的,对所述步骤五中的手术刀点的深度计算公式进行插值优化计算。通过插值优化计算,使得深度的计算更加准确。每个P″ ik设置两个沿着外极线L ik插值点,分别为左插值点P″ ikl和右插值点P″ ikr,利用方块区域匹配的代价函数来计算代价C(P′ i,Δr ikr),C(P′ i,Δr ikl)和C(P′ i,Δr ik),去最小代价的插值点或原点,删除其余两个点,得到最终深度公式如下: Preferably, the interpolation optimization calculation is performed on the depth calculation formula of the scalpel point in the fifth step. Optimize the calculation by interpolation to make the depth calculation more accurate. Each P″ ik sets two interpolation points along the epipolar line L ik , namely the left interpolation point P″ ikl and the right interpolation point P″ ikr , and the cost function of the square area matching is used to calculate the cost C(P′ i , Δr ikr ), C(P′ i ,Δr ikl ) and C(P′ i ,Δr ik ), remove the minimum cost interpolation point or origin, delete the other two points, and get the final depth formula as follows:
其中,L ik为外极线,Z kj为对应P″ ik和P′ ij的深度; Among them, Lik is the epipolar line, and Z kj is the depth corresponding to P″ ik and P′ ij ;
最终深度计算公式:The final depth calculation formula:
其中,n o是Z kj的个数。 Wherein, n o is the number of Z kj.
优选的,插值点的计算公式分别为:Preferably, the calculation formulas of the interpolation points are:
P″ ikl=(P″ ik+Li+P″ ik)/2 P″ ikl =(P″ ik+Li +P″ ik )/2
P″ ikr=(P″ ik-Li+P″ ik)/2 P″ ikr =(P″ ik-Li +P″ ik )/2
其中,P″ ik+Li为P″ ik沿着外极线正向移动Li个像素距离的值,P″ ik-Li为P″ ik沿着外极线负向移动Li个像素距离的值。 Wherein, P "ik + Li to P" move pixel value Li of the distance along the epipolar forward ik, P "ik-Li to P" move pixel value Li of the distance along the epipolar ik negative.
优选的,切口路径定义如下:Preferably, the incision path is defined as follows:
S1:手术刀进入角膜层;S1: The scalpel enters the corneal layer;
S2:手术刀抬起40-50度,在第一个远程中心点执行RCM运动;S2: Raise the scalpel 40-50 degrees and perform RCM movement at the first remote center point;
S3:手术刀按照S2中的角度前进直到抵达第二个远程中心点;S3: The scalpel advances according to the angle in S2 until it reaches the second remote center point;
S4:执行RCM运动,手术刀下降40-50度;S4: Perform RCM movement, the scalpel is lowered 40-50 degrees;
S5:手术刀按照S4的角度继续前进直至穿过角膜。S5: The scalpel continues to advance at the angle of S4 until it penetrates the cornea.
优选的,在所述步骤七中,手术刀执行RCM运动,RCM点的位置固定,RCM点的控制策略公式如下:Preferably, in the seventh step, the scalpel performs RCM movement, the position of the RCM point is fixed, and the control strategy formula of the RCM point is as follows:
其中,x R为RCM点的X轴坐标位置;y R为RCM点的Y轴坐标位置;L 1为第一线性马达的线性位移;L 2为第二线性马达的线性位移;L tool为夹持装置与手术刀刀尖的距离;L 3为第三线性马达的线性位移; 为手术刀刀面与夹持装置连接端的夹角; 为手术刀刀面与水平面的夹角;L o为刀面长度;dm为第三线性马达到第一线性马达或第二线性马达的水平轴的垂直距离。 Among them, x R is the X-axis coordinate position of the RCM point; y R is the Y-axis coordinate position of the RCM point; L 1 is the linear displacement of the first linear motor; L 2 is the linear displacement of the second linear motor; L tool is the clamp The distance between the holding device and the tip of the scalpel; L 3 is the linear displacement of the third linear motor; Is the angle between the scalpel blade face and the connecting end of the clamping device Is the angle between the blade surface of the scalpel and the horizontal plane; L o is the length of the blade surface; dm is the vertical distance from the third linear motor to the horizontal axis of the first linear motor or the second linear motor.
优选的,手术刀围绕RCM点旋转,且 的角度变化轨迹为 第一线性马达、第二线性马达和第三线性马达的设定轨迹公 式如下: Preferably, the scalpel rotates around the RCM point, and The angle change trajectory is The trajectory formulas of the first linear motor, the second linear motor and the third linear motor are as follows:
其中,h为第一线性马达和第二线性马达的直线距离。Among them, h is the linear distance between the first linear motor and the second linear motor.
手术刀在移动和旋转的时候,根据RCM点的坐标控制策略计算第一线性马达、第二线性马达和第三线性马达的移动轨迹。同时在移动的时候,也是根据公式计算第一线性马达、第二线性马达和第三线性马达的移动轨迹,达到控制手术刀运动的效果。When the scalpel is moving and rotating, the trajectories of the first linear motor, the second linear motor and the third linear motor are calculated according to the coordinate control strategy of the RCM point. At the same time, when moving, the trajectories of the first linear motor, the second linear motor and the third linear motor are also calculated according to the formula to achieve the effect of controlling the movement of the scalpel.
优选的,所述一种并行串联关节的机器操作臂的控制方法为,所述第一线性马达、所述第二线性马达和第三线性马达通过使用线性插值的方法定义从上一个目标位置到下一个目标位置之间的位置,并设定两个目标位置之间的步长。Preferably, the control method of the parallel-series-joint machine operating arm is that the first linear motor, the second linear motor and the third linear motor define from the previous target position to the third linear motor by using linear interpolation. The position between the next target position and the step length between the two target positions.
优选的,每一步目标位置通过计算所述切口路径来获得每一毫秒的位置。Preferably, the target position of each step is obtained by calculating the incision path to obtain the position of each millisecond.
优选的,在进行步骤一前,对显微镜系统和机器操作臂进行初始化,在初始化过程中,机器操作臂和显微镜摄像系统的X轴和Y轴坐标保持一致。机器操作臂和显微镜系统的坐标保持一致,机器操作臂的执行运动的坐标和计算的坐标保持一致,保证机器操作臂运动的准确性。Preferably, before performing step 1, the microscope system and the machine operating arm are initialized. During the initialization process, the X-axis and Y-axis coordinates of the machine operating arm and the microscope camera system are consistent. The coordinates of the machine operating arm and the microscope system are consistent, and the coordinates of the machine operating arm's execution movement are consistent with the calculated coordinates to ensure the accuracy of the machine operating arm's movement.
优选的,所述切口的宽度不大于所述手术刀刀面的宽度。机器操作臂控制手术刀只沿着切口路径运动,不进行其他方向的位移,保证切口的宽度不大于所述手术刀刀面的宽度,避免切口的扩大。Preferably, the width of the incision is not greater than the width of the blade surface of the scalpel. The machine operating arm controls the scalpel to move only along the incision path and does not perform displacement in other directions, ensuring that the width of the incision is not greater than the width of the scalpel blade surface, and avoiding the expansion of the incision.
与现有技术相比,有益效果是:本方法基于机器操作臂和手术刀,实现了用手术刀进行全自动进行角膜切口的方法,避免了人手操作的不精准而造成伤口扩大的损伤,同时避免了激光对角膜层带来的其他损伤。Compared with the prior art, the beneficial effect is: this method is based on a machine operating arm and a scalpel, realizes a method of fully automatic corneal incision with a scalpel, avoids the inaccuracy of manual operation and the damage of wound enlargement. Avoid laser damage to the corneal layer.
图1为本发明的方法流程图;Figure 1 is a flow chart of the method of the present invention;
图2是机器操作臂的结构示意图;Figure 2 is a schematic diagram of the structure of the machine operating arm;
图3是本发明的切口路径示意图。Figure 3 is a schematic view of the incision path of the present invention.
其中,1、手术刀;2、夹持装置;3、第一线性马达;4、第二线性马达;5、第三线性马达;6、角膜层;7、第一个远程中心点;8、第二个远程中心点。Among them, 1. scalpel; 2. clamping device; 3. first linear motor; 4. second linear motor; 5. third linear motor; 6. corneal layer; 7. first remote center point; 8. The second remote center point.
附图仅用于示例性说明,不能理解为对本专利的限制;为了更好说明本实施例,附图某些部件会有省略、放大或缩小,并不代表实际产品的尺寸;对于本领域技术人员来说,附图中某些公知结构及其说明可能省略是可以理解的。附图中描述位置关系仅用于示例性说明,不能理解为对本专利的限制。The attached drawings are only for illustrative purposes and cannot be understood as a limitation of this patent; in order to better illustrate this embodiment, some parts of the attached drawings may be omitted, enlarged or reduced, and do not represent the size of the actual product; It is understandable for the personnel that some well-known structures in the drawings and their descriptions may be omitted. The positional relationship described in the drawings is only for illustrative purposes and cannot be understood as a limitation of the patent.
本发明实施例的附图中相同或相似的标号对应相同或相似的部件;在本发明的描述中,需要理解的是,若有术语“上”、“下”、“左”、“右”“长”“短”等指示的方位或位置关系为基于附图所示的方位或位置关系,仅是为了便于描述本发明和简化描述,而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作,因此附图中描述位置关系的用语仅用于示例性说明,不能理解为对本专利的限制,对于本领域的普通技术人员而言,可以根据具体情况理解上述术语的具体含义。The same or similar reference numerals in the drawings of the embodiments of the present invention correspond to the same or similar components; in the description of the present invention, it should be understood that if there are the terms "upper", "lower", "left" and "right" The orientation or positional relationship indicated by "long", "short", etc. is based on the orientation or positional relationship shown in the drawings, which is only for the convenience of describing the present invention and simplifying the description, and does not indicate or imply that the device or element referred to must have a specific The position, the structure and operation in a specific position, so the terms describing the positional relationship in the drawings are only used for exemplary description, and cannot be understood as a limitation of the patent. For those of ordinary skill in the art, it can be understood according to the specific situation The specific meaning of the above terms.
下面通过具体实施例,并结合附图,对本发明的技术方案作进一步的具体描述:The technical solutions of the present invention will be further described in detail through specific embodiments in conjunction with the accompanying drawings:
实施例1Example 1
一种实现自动化无缝合角膜主切口的方法,包括机器操作臂和安装于机器操作臂上的手术刀1,一种并行串联关节的机器操作臂包括夹持手术刀1的夹持装置2和驱动夹持装置2摆动的驱动臂;驱动臂上设置有第一线性马达3和第二线性马达4,夹持装置装有第三线性马达5,包括以下步骤:A method for realizing automatic seamless joint corneal main incision, including a machine operating arm and a scalpel 1 mounted on the machine operating arm. A parallel tandem joint machine operating arm includes a clamping device 2 for clamping the scalpel 1 and a drive The swing driving arm of the clamping device 2; the driving arm is provided with a first linear motor 3 and a second linear motor 4, and the clamping device is equipped with a third linear motor 5, including the following steps:
步骤一:使用显微镜摄像系统以6毫米垂直位移拍摄两幅图像;Step 1: Use the microscope camera system to take two images with a vertical displacement of 6 mm;
步骤二:对每幅图像进行预处理,转换为具有灰度值的图像,并对第一幅图像进行角点检测,得到若干候选角点,并且得到角点的坐标;Step 2: Perform preprocessing on each image, convert it into an image with gray value, and perform corner detection on the first image to obtain several candidate corner points, and obtain the corner point coordinates;
步骤三:若干角点以各自为中心,R j为半径,求出相对于角点的黑点和白点,并且黑点位于角点白色像素区域和白点位于角点的黑色区域,且黑皇后的像素灰度<0.5且白皇后的像素灰度>0.5,则该角点为手术刀点P′ i,黑点和白点位置的计算公式如下: Step 3: With several corner points as the center and R j as the radius, find the black point and white point relative to the corner point, and the black point is located in the white pixel area of the corner point and the white point is located in the black area of the corner point. The pixel gray scale of the queen is <0.5 and the pixel gray scale of the white queen is> 0.5, then the corner point is the scalpel point P′ i , and the calculation formulas for the positions of the black and white points are as follows:
其中,X blacki和Y blacki分别为黑点的坐标值,X whitei和Y whitei分别白点的坐标值,X j和Y j是以角点为中心,R j为半径的范围内所有像素点的各自坐标,I为该点的灰度值,range为选取的半径最大值;X i、Y i分别为手术刀点P′ i的坐标值; Among them, X blacki and Y blacki are the coordinates of the black points, X whitei and Y whitei are the coordinates of the white points, X j and Y j are the corner points as the center, and R j is the radius of all pixels in the range Respective coordinates, I is the gray value of the point, range is the maximum value of the selected radius; X i and Y i are the coordinate values of the scalpel point P′ i respectively;
步骤四:对第一幅图像P′ i向第二幅图像进行匹配,得到匹配点P″ i,P′ i和P″ i之间的像素距离; Step 4: Match the first image P′ i to the second image to obtain the pixel distance between the matching points P” i , P′ i and P” i ;
步骤五:手术刀点的深度计算公式如下:Step 5: The formula for calculating the depth of the scalpel point is as follows:
其中,r为手术刀点P′与显微镜放大中心之间的距离,Δr为P′ i和P″ i之间的像素距离,称为视差; Among them, r is the distance between the scalpel point P′ and the magnification center of the microscope, and Δr is the pixel distance between P′ i and P″ i , called parallax;
步骤六:根据计算得到手术刀的位置和相对深度,并获取虹膜的位置,将切口位置定位在虹膜边缘上距离瞳孔中心最近的一个点;Step 6: Obtain the position and relative depth of the scalpel according to the calculation, and obtain the position of the iris, and locate the incision position on the edge of the iris which is closest to the center of the pupil;
步骤七:标准的无缝合角膜主切口定义为一个松散的“Z”字形,将机器操 作臂控制手术刀运动的切口路径定义如下:Step 7: The standard seamless corneal main incision is defined as a loose "Z" shape. The incision path of the machine operating arm to control the movement of the scalpel is defined as follows:
S1:手术刀1前进5mm进入角膜层6;S1: The scalpel 1 advances 5mm into the
S2:手术刀1抬起45度,在第一个远程中心点7执行RCM运动;S2: The scalpel 1 is raised 45 degrees, and the RCM movement is performed at the first
S3:手术刀1按照S2中的角度前进1.5-2mm直到抵达第二个远程中心点8;S3: The scalpel 1 advances 1.5-2mm according to the angle in S2 until it reaches the second
S4:执行RCM运动,手术刀1下降45度;S4: Perform RCM movement, scalpel 1 is lowered 45 degrees;
S5:手术刀1按照S4的角度继续前进2mm穿过角膜层6。S5: The scalpel 1 continues to advance 2mm through the
本实施例的工作原理:手术刀点就是手术刀的位置,通过计算获得手术刀的位置和相对于显微镜系统的深度,得到了手术刀的三维坐标。同时也获得的眼部角膜和虹膜等位置信息,将手术刀置于初始位置上,通过机器操作臂控制手术刀沿着设定的切口路径运动,自动完成切口。The working principle of this embodiment: the scalpel point is the position of the scalpel, the position of the scalpel and the depth relative to the microscope system are obtained by calculation, and the three-dimensional coordinates of the scalpel are obtained. At the same time, the position information of the cornea and iris of the eye is also obtained, the scalpel is placed in the initial position, and the scalpel is controlled to move along the set incision path through the machine operating arm to automatically complete the incision.
本方法基于机器操作臂和手术刀,实现了用手术刀进行全自动进行角膜切口的方法,避免了人手操作的不精准而造成伤口扩大的损伤,同时避免了激光对角膜层带来的其他损伤。This method is based on a machine operating arm and a scalpel, and realizes a fully automatic corneal incision method with a scalpel, which avoids the inaccuracy of manual operation and the damage caused by the expansion of the wound, and also avoids other damages to the corneal layer caused by laser .
实施例2Example 2
本实施例在实施例1的基础上,提供了具体的匹配方法、匹配结果校核方法和深度计算优化方法,具体为:On the basis of Example 1, this embodiment provides a specific matching method, a matching result verification method, and a depth calculation optimization method, specifically:
匹配方法为在P′ i建立一个以P′ i为中心的基础点方块区域,定义P′ i以外的点为邻近点,定义每个邻近点相对于P′ i的深度一致;在对方块区域所有的基础点进行匹配,计算分别在第二幅图像对应的匹配点,匹配点和对应的视差通过选择使得代价函数数值最小的视差来计算得出,其中,代价函数公式为: Matching method as P 'i establish a P' i is the basis of the center point of a block region, defined point P 'adjacent point other than i, is defined with respect to each of the adjacent point P' i uniform depth; in the area of the block All the basic points are matched, and the matching points corresponding to the second image are calculated. The matching points and the corresponding disparity are calculated by selecting the disparity that minimizes the value of the cost function. The cost function formula is:
C(P′ ij,Δr)=min{d(P′ ij,P′ ij-Δr,I Z,I z-a),d(P′ ij-Δr,P′ ij,I Z-a,I z} C(P′ ij ,Δr)=min{d(P′ ij ,P′ ij -Δr,I Z ,I za ),d(P′ ij -Δr,P′ ij ,I Za ,I z }
d(P′ ij,P′ ij-Δr,I z,I z-a)=minP′ ij-Δr-0.5 d(P′ ij ,P′ ij -Δr,I z ,I za )=minP′ ij -Δr-0.5
≤P′ ij-Δr+0.5{|I z(P′ ij)-I z-a(P″ ij)|} ≤P′ ij -Δr+0.5{|I z (P′ ij )-I za (P″ ij )|}
其中,P′ ij为对应基础点的像素位置,P″ ij为对应匹配点的像素位置,I z为第一幅图像中每个像素的灰度值,I z-a为第二幅图像中每个图像的灰度值,I z(P′ ij)为P′ ij的灰度值,I z-a(P″ ij)为P″ ij的灰度值,Δr为P′ i和P″ i之间的像素距离,称为视差。 Where P′ ij is the pixel position corresponding to the base point, P″ ij is the pixel position corresponding to the matching point, I z is the gray value of each pixel in the first image, and I za is each pixel in the second image. The gray value of the image, I z (P′ ij ) is the gray value of P′ ij , I za (P″ ij ) is the gray value of P″ ij , and Δr is the value between P′ i and P″ i The pixel distance is called parallax.
校核步骤:图像中对应的匹配点P″
ij相对于P″
i的位置与邻近点相对于P′
i的位置一致,(其中,P′
ij为领域点,P″
ij为领域点的匹配点,P′
i为中心点,P′
i为 中心点的匹配点)则校核成功,对于中心P′
i加一分,总票数8票(8个领域点),达到4票以上(包括4票)匹配成功;否则,则以每个邻近点为中心建立基础点方块区域,重新执行步骤四中的计算公式,再次计算匹配点和对应的视差。超过半数以上的匹配点和领近点相对的位置一致,避免了P′
i是噪点的情况,提高手术刀点的正确性。
Checking steps: image corresponding matching point P "ij of relative P" position i with respect to adjacent points 'consistent position i, (where, P' P ij is the field point, P "ij of the field matching point Point, P′ i is the center point, and P′ i is the matching point of the center point) then the verification is successful. Add one point to the center P′ i . The total number of votes is 8 (8 domain points), reaching 4 votes or more (including 4 votes) The matching is successful; otherwise, the basic point square area is established with each neighboring point as the center, and the calculation formula in
再次计算匹配点和对应的视差后,进行校核,即运行投票,第一个超过4票者胜出,胜出的邻近点定义为新的P′ i点,并舍弃其他领近点和校核不成功的点,再以第二幅图像中剩余的匹配点P″ ik为基点与第一幅图像进行匹配,得到校核点,校核点与基础点的位置一致,则匹配成功。否侧,再次执行校核步骤。翻转匹配方向,再次校核匹配的正确性,提高手术刀点的准确性。 After calculating the matching point and the corresponding parallax again, check it, that is, run voting. The first person with more than 4 votes wins. The winning neighboring point is defined as the new P′ i point, and other near points and check points are discarded. For successful points, use the remaining matching points P″ ik in the second image as the base point to match the first image to obtain a check point. If the check point is consistent with the base point, the matching is successful. No side, Perform the verification step again. Flip the matching direction, check the correctness of the matching again, and improve the accuracy of the scalpel point.
深度计算优化具体为,对深度计算公式进行插值优化,具体的方法为在每个P″ ik设置两个沿着外极线L ik插值点,分别为左插值点P″ ikl和右插值点P″ ikr,利用方块区域匹配的代价函数来计算代价C(P′ i,Δr ikr),C(P′ i,Δr ikl)和C(P′ i,Δr ik),去最小代价的插值点或原点,删除其余两个点,得到插值点和最终深度公式如下: Specifically optimized depth calculation, interpolation formula for calculating depth optimized for the particular process in each P "ik source lines disposed along the outer two interpolation points L ik, respectively, to the left of the interpolation point P" ikl and a right interpolation point P ” Ikr , use the cost function of the block area matching to calculate the cost C(P′ i ,Δr ikr ), C(P′ i ,Δr ikl ) and C(P′ i ,Δr ik ), and remove the minimum cost interpolation point or Origin point, delete the remaining two points, get the interpolation point and the final depth formula as follows:
P″ ikl=(P″ ik+Li+P″ ik)/2 P″ ikl =(P″ ik+Li +P″ ik )/2
P″ ikr=(P″ ik-Li+P″ ik)/2 P″ ikr =(P″ ik-Li +P″ ik )/2
其中,L ik为外极线,Z kj为对应P″ ik和P′ ij的深度;P″ ik+Li为P″ ik沿着外极线正向移动Li个像素距离的值,P″ ik-Li为P″ ik沿着外极线负向移动Li个像素距离的值。 Wherein, L ik is the epipolar, Z kj corresponding P "ij and ik depth P ';P" ik + Li to P "ik moved forward along the epipolar pixel distance values Li, P" ik -Li is the value of P″ ik moving Li pixels along the negative direction of the epipolar line.
最后,深度计算公式为:Finally, the depth calculation formula is:
其中,n o是Z kj的个数。 Wherein, n o is the number of Z kj.
本发明的有益效果:通过建立方块区域的匹配以及校核,能够更加准确找到手术到的位置,通过插值优化,使得深度的计算更加准确。The beneficial effects of the present invention: by establishing the matching and checking of the square area, the position of the operation can be found more accurately, and the depth calculation can be made more accurate through the interpolation optimization.
实施例3Example 3
本实施例在实施例1或实施例2的基础上,提供了一种并行串联关节的机器操作臂的运动轨迹控制算法公式和方法,具体为On the basis of Embodiment 1 or
手术刀1执行RCM运动,RCM点的位置固定,RCM点的控制策略公式如下:Scalpel 1 performs RCM movement, the position of the RCM point is fixed, and the control strategy formula of the RCM point is as follows:
其中,x R为RCM点的X轴坐标位置;y R为RCM点的Y轴坐标位置;L 1为第一线性马达的线性位移;L 2为第二线性马达的线性位移;L tool为夹持装置与手术刀刀尖的距离;L 3为第三线性马达的线性位移; 为手术刀刀面与夹持装置连接端的夹角; 为手术刀刀面与水平面的夹角;L o为刀面长度;dm为第三线性马达到第一线性马达或第二线性马达的水平轴的垂直距离。 Among them, x R is the X-axis coordinate position of the RCM point; y R is the Y-axis coordinate position of the RCM point; L 1 is the linear displacement of the first linear motor; L 2 is the linear displacement of the second linear motor; L tool is the clamp The distance between the holding device and the tip of the scalpel; L 3 is the linear displacement of the third linear motor; Is the angle between the scalpel blade face and the connecting end of the clamping device Is the angle between the blade surface of the scalpel and the horizontal plane; L o is the length of the blade surface; dm is the vertical distance from the third linear motor to the horizontal axis of the first linear motor or the second linear motor.
当手术刀1围绕RCM点旋转,且 的角度变化轨迹为 第一线性马达、第二线性马达和第三线性马达的设定轨迹公式如下: When the scalpel 1 rotates around the RCM point, and The angle change trajectory is The trajectory formulas of the first linear motor, the second linear motor and the third linear motor are as follows:
其中,h为第一线性马达和第二线性马达的直线距离。Among them, h is the linear distance between the first linear motor and the second linear motor.
手术刀1在移动和旋转的时候,根据RCM点的坐标控制策略计算第一线性马达、第二线性马达和第三线性马达的移动轨迹。同时在移动的时候,也是根据公式计算第一线性马达3、第二线性马达4和第三线性马达5的移动轨迹,达到控制手术刀1运动的效果。When the scalpel 1 is moving and rotating, the movement trajectories of the first linear motor, the second linear motor and the third linear motor are calculated according to the coordinate control strategy of the RCM point. At the same time, when moving, the movement trajectories of the first
另外的,第一线性马达3、第二线性马达4和第三线性马达5通过使用线性插值的方法定义从上一个目标位置到下一个目标位置之间的位置,并设定两个目标位置之间的步长。In addition, the first
具体的,每一步目标位置通过计算切口路径来获得每一毫秒的位置。Specifically, the target position of each step is obtained by calculating the incision path to obtain the position of each millisecond.
另外的,在进行步骤一前,对显微镜系统和机器操作臂进行初始化,在初始化过程中,机器操作臂和显微镜摄像系统的X轴和Y轴坐标保持一致。机器操作臂和显微镜系统的坐标保持一致,机器操作臂的执行运动的坐标和计算的坐标保持一致,保证机器操作臂运动的准确性。In addition, before proceeding to step 1, initialize the microscope system and the machine operating arm. During the initialization process, the X-axis and Y-axis coordinates of the machine operating arm and the microscope camera system are consistent. The coordinates of the machine operating arm and the microscope system are consistent, and the coordinates of the machine operating arm's execution movement are consistent with the calculated coordinates to ensure the accuracy of the machine operating arm's movement.
另外的,切口的宽度不大于手术刀1刀面的宽度。机器操作臂控制手术刀1只沿着切口路径运动,不进行其他方向的位移,保证切口的宽度不大于所述手术刀刀面的宽度,避免切口的扩大。In addition, the width of the incision is not greater than the width of the blade surface of the scalpel. The machine operating arm controls the scalpel 1 to move only along the incision path and does not perform displacement in other directions, ensuring that the width of the incision is not greater than the width of the scalpel blade surface, and avoiding the expansion of the incision.
本实施例的有益效果:设定机器操作臂每一步的步长,一直获取切口路径并计算机器操作臂沿着切口路径运动,线性马达所需要做出的对应运动轨迹,使得机器操作臂带动手术刀能够沿着设定的切口路径运动。The beneficial effects of this embodiment: set the step length of each step of the machine operating arm, always obtain the incision path and calculate the machine operating arm to move along the incision path, the corresponding movement trajectory required by the linear motor, so that the machine operating arm drives the operation The knife can move along the set incision path.
显然,本发明的上述实施例仅仅是为清楚地说明本发明所作的举例,而并非是对本发明的实施方式的限定。对于所属领域的普通技术人员来说,在上述说明的基础上还可以做出其它不同形式的变化或变动。这里无需也无法对所有的实施方式予以穷举。凡在本发明的精神和原则之内所作的任何修改、等同替换和改进等,均应包含在本发明权利要求的保护范围之内。Obviously, the above-mentioned embodiments of the present invention are merely examples to clearly illustrate the present invention, and are not intended to limit the embodiments of the present invention. For those of ordinary skill in the art, other changes or changes in different forms can be made on the basis of the above description. It is unnecessary and impossible to list all the implementation methods here. Any modification, equivalent replacement and improvement made within the spirit and principle of the present invention shall be included in the protection scope of the claims of the present invention.
Claims (10)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2019/094556 WO2021000288A2 (en) | 2019-07-03 | 2019-07-03 | Method for implementing automatic suture-less primary corneal incision |
DE112019006884.9T DE112019006884B4 (en) | 2019-07-03 | 2019-07-03 | Device for performing an automated seamless corneal incision |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2019/094556 WO2021000288A2 (en) | 2019-07-03 | 2019-07-03 | Method for implementing automatic suture-less primary corneal incision |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021000288A2 true WO2021000288A2 (en) | 2021-01-07 |
Family
ID=74101379
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2019/094556 WO2021000288A2 (en) | 2019-07-03 | 2019-07-03 | Method for implementing automatic suture-less primary corneal incision |
Country Status (2)
Country | Link |
---|---|
DE (1) | DE112019006884B4 (en) |
WO (1) | WO2021000288A2 (en) |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8758332B2 (en) | 2009-07-24 | 2014-06-24 | Lensar, Inc. | Laser system and method for performing and sealing corneal incisions in the eye |
US10073515B2 (en) * | 2013-09-18 | 2018-09-11 | Nanophthalmos, Llc | Surgical navigation system and method |
US10369045B2 (en) * | 2014-07-29 | 2019-08-06 | The Johns Hopkins University | Micromanipulation systems and methods |
US11083625B2 (en) * | 2015-07-01 | 2021-08-10 | Amo Development, Llc | Sub-nanosecond laser surgery system utilizing multiple pulsed laser beams |
-
2019
- 2019-07-03 WO PCT/CN2019/094556 patent/WO2021000288A2/en active IP Right Grant
- 2019-07-03 DE DE112019006884.9T patent/DE112019006884B4/en active Active
Also Published As
Publication number | Publication date |
---|---|
DE112019006884T5 (en) | 2021-11-11 |
DE112019006884B4 (en) | 2025-06-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20220125302A1 (en) | Procedural Optical Coherence Tomography (OCT) for Surgery and Related Methods | |
AU780951B2 (en) | Eye registration and astigmatism alignment control systems and method | |
EP2025305B1 (en) | Toric lenses alignment using pre-operative images | |
US12396810B2 (en) | System and method for automated image-guided robotic intraocular surgery | |
AU2012301512C1 (en) | Imaging-based guidance system for ophthalmic docking using a location-orientation analysis | |
JP2002219106A (en) | Pupil measuring device, refraction correcting device, and pupil measuring method | |
US20160338875A9 (en) | Toric lenses alignment using pre-operative images | |
TW201247274A (en) | Imaging-controlled laser surgical system | |
KR20140027071A (en) | Method and apparatus for multi-level eye registration | |
US11439535B2 (en) | Ophthalmic device for treating an eye | |
Zhou et al. | Needle localization for robot-assisted subretinal injection based on deep learning | |
CN110215339A (en) | A method of realize automation without the main notch of sewing angle film | |
US20130294668A1 (en) | System and method for creating a customized anatomical model of an eye | |
CN101862177A (en) | Method and device for three-dimensionally positioning retinal hole | |
CN111588469B (en) | Ophthalmic Robot End Effector Guidance and Positioning System | |
WO2021000288A2 (en) | Method for implementing automatic suture-less primary corneal incision | |
CN113349734B (en) | Fundus camera and its working distance calibration method | |
CN110227008A (en) | A kind of cataract is without sewing angle film kerf control strategy and path setting method | |
CN116983140B (en) | A system and method for correcting eyeball rotation based on iris texture feature markers | |
WO2024228062A1 (en) | Ophthalmologic surgical system | |
CN117506924A (en) | A method for controlling the movement of a robotic arm along a set path and a robotic arm control system | |
CN110349197A (en) | Monocular depth estimation method under a kind of cataract surgery microscopy | |
CN120182360A (en) | A method and system for casing posture recognition based on binocular vision | |
CN120420084A (en) | Surgical position positioning method and positioning device | |
HK1125020B (en) | Toric lenses alignment using pre-operative images |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19936297 Country of ref document: EP Kind code of ref document: A2 |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19936297 Country of ref document: EP Kind code of ref document: A2 |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19936297 Country of ref document: EP Kind code of ref document: A2 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 02.09.2022) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19936297 Country of ref document: EP Kind code of ref document: A2 |
|
WWG | Wipo information: grant in national office |
Ref document number: 112019006884 Country of ref document: DE |