WO2018059036A1 - Laparoscopic surgery system - Google Patents

Laparoscopic surgery system Download PDF

Info

Publication number
WO2018059036A1
WO2018059036A1 PCT/CN2017/091012 CN2017091012W WO2018059036A1 WO 2018059036 A1 WO2018059036 A1 WO 2018059036A1 CN 2017091012 W CN2017091012 W CN 2017091012W WO 2018059036 A1 WO2018059036 A1 WO 2018059036A1
Authority
WO
WIPO (PCT)
Prior art keywords
laparoscope
display
laparoscopic
posture
coordinate system
Prior art date
Application number
PCT/CN2017/091012
Other languages
French (fr)
Chinese (zh)
Inventor
师云雷
何超
邵辉
朱祥
王家寅
Original Assignee
微创(上海)医疗机器人有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 微创(上海)医疗机器人有限公司 filed Critical 微创(上海)医疗机器人有限公司
Publication of WO2018059036A1 publication Critical patent/WO2018059036A1/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B17/00Surgical instruments, devices or methods, e.g. tourniquets
    • A61B17/00234Surgical instruments, devices or methods, e.g. tourniquets for minimally invasive surgery
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/103Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/11Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
    • A61B5/1116Determining posture transitions

Definitions

  • the present invention relates generally to medical devices, and more particularly to a laparoscopic surgical system.
  • Microtrauma surgery uses modern medical equipment such as laparoscopy and thoracoscopic surgery and related equipment. It has the characteristics of small trauma, light pain and quick recovery.
  • Figure 1 is a schematic view of the line of sight of a conventional microtrauma abdominal surgeon.
  • the actual operation direction of the doctor is the lesion position S at the abdominal cavity 11 of the human body, however, the direction of the line of sight is the display 12.
  • the doctor's line of sight has a large angular deviation from the position of the lesion to be operated, and this deviation causes the doctor's hand and eye to be inconsistent, which is the biggest reason for increasing the difficulty of the operation.
  • DaVinci surgical robotic system which has three core features: 1) high-definition 3D stereo vision; 2) consistent movement of human hands and multi-degree-of-freedom instruments; 3) scaling of motion range.
  • the Da Vinci surgical robot system is expensive and consumes a large amount of surgical equipment consumables and maintenance costs every year, making it difficult to spread, especially in developing countries such as China.
  • the technical problem to be solved by the present invention is to provide a laparoscopic surgical system which can reduce the technical and learning time requirements for doctors, and at the same time have lower costs.
  • a laparoscopic surgical system comprises a control unit, a doctor-side display and an attitude sensor, a patient-side laparoscopic mirror holder, a mirror arm fixing mechanism, a mirror-holding arm disposed on the mirror-arm fixing mechanism, and an adjustment mechanism.
  • the attitude sensor is disposed on the display and used to acquire the display
  • the posture information of the device the holding arm is connected to the laparoscope
  • the adjusting mechanism is connected with the holding arm and/or the laparoscope
  • the adjusting mechanism is used for adjusting the posture of the laparoscope
  • the control unit is connected to the posture sensor
  • the control unit obtains an adjustment amount required by the adjustment mechanism according to the current state information of the laparoscope and the desired state information, and controls the adjustment mechanism to adjust the posture of the laparoscope based on the adjustment amount to make the abdominal cavity
  • the mirror corresponds to the posture of the display, wherein the current state information of the laparoscope includes laparoscopic current posture information, and the desired state information of the laparoscope includes posture information of the display.
  • the laparoscope is a 0 degree mirror, or a 30 degree mirror or a 75 degree mirror.
  • the laparoscope is a serpentine laparoscope having three degrees of freedom at the end.
  • the mirror arm is a fixed point mechanism including a plurality of joints
  • the adjustment mechanism includes a first group of adjustment mechanisms and a second group of adjustment mechanisms, the first group of adjustment mechanisms including a first servo a motor, at least one first servo motor is disposed on each joint of the mirror arm for adjusting a corresponding joint rotation
  • the second group adjustment mechanism includes at least one second servo motor for adjusting the laparoscopic axis Turn to the direction.
  • the current state information of the laparoscope further includes laparoscopic current position information
  • the desired state information of the laparoscope further includes laparoscopic desired position information
  • the adjustment amount of the adjustment mechanism is according to a current laparoscopic
  • the state information and the expected state information are obtained by inverse solution of the kinematics equation.
  • the laparoscopic desired position information is obtained according to a preset constraint.
  • the constraint is positional information of the fixed point and the length of the laparoscopic body in the patient.
  • the adjustment mechanism includes a second set of adjustment mechanisms including at least three third servo motors to control the attitude of the serpentine laparoscope.
  • the mirror arm includes a plurality of joints, and each joint is provided with a joint sensor to measure the rotation angle of each joint, and the three degrees of freedom of the serpentine laparoscope include two swing freedoms. Degree and a degree of freedom of rotation, the serpentine laparoscope is provided with three angle sensors, respectively measuring the two swing angles and the rotation angle of the serpentine laparoscope to obtain the current posture information of the serpentine laparoscope.
  • control unit controls the adjustment mechanism to adjust the posture of the laparoscope based on the adjustment amount so that the laparoscope conforms to the posture of the display.
  • the present invention uses a display having a posture measuring function in combination with a laparoscope. According to the attitude sensor attached to the display, the position of the laparoscope is adjusted so that the doctor can always maintain the orientation of the display coordinate system and the direction of the laparoscope coordinate system to form a set of micro-traumatic surgery operating system with good performance. Therefore, the doctor has a good learning curve when learning to use.
  • Figure 1 is a schematic view of the line of sight of a conventional microtrauma abdominal surgeon.
  • FIG. 2 is a schematic view of a laparoscopic surgical system of a first embodiment of the present invention.
  • FIG 3 is a schematic view of a laparoscopic surgical system of a second embodiment of the present invention.
  • Fig. 4 is a schematic view showing a modification of the laparoscopic surgical system of the second embodiment of the present invention.
  • Figure 5 is a schematic illustration of a laparoscopic surgical system in accordance with a third embodiment of the present invention.
  • Fig. 6 is a schematic view showing the comparison between the direction of the line of sight of the doctor and the direction of the actual lesion in the embodiment of the present invention.
  • Fig. 7 is a perspective view showing the tolerance angle of the deviation between the line of sight direction of the doctor and the actual direction of the lesion in the embodiment of the present invention.
  • Embodiments of the present invention describe a laparoscopic surgical system that can reduce the technical and learning time requirements for a physician while having lower costs.
  • the laparoscopic surgical system proposed by the present invention can adapt to the doctor's perspective and enable the doctor to perform a surgical operation in a state where the line of sight is more natural.
  • the attitude sensor described herein is not limited to a device for measuring a change in posture, and the attitude sensor described herein may also be a device including a plurality of measurement functions such as a measurement attitude and a position change. For example, a pose sensor.
  • the laparoscopic surgical system of the present embodiment includes a control unit 270, a doctor-side display 210, an attitude sensor 240, a patient-side laparoscope 220, a mirror arm fixing mechanism 232, a mirror arm 231, and an adjustment mechanism 260.
  • the mirror arm 231 is coupled to the laparoscope 220.
  • the attitude sensor 240 is disposed on the display 210 for acquiring the first posture information of the display 210 as part of the desired state information of the laparoscope.
  • the second pose information of the laparoscope 220 may be based on the joint rotation angle obtained by the joint sensor provided by the mirror arm 231 and the laparoscope rotation obtained by the angle sensor provided by the laparoscope 220. Angle, calculated by kinematic equations.
  • the adjustment mechanism 260 includes a first group of adjustment mechanisms and a second group of adjustment mechanisms. The first group of adjustment mechanisms are coupled to the mirror arm 231 to adjust the rotation angle of each joint on the mirror arm 231. The second group of adjustment mechanisms are coupled to the laparoscope 220. The angle of rotation of the laparoscope 220 is adjusted.
  • the control unit 270 connects the attitude sensor 240, the sensor on each joint of the mirror arm 231, the angle sensor of the laparoscope 220, and the adjustment mechanism 260.
  • the desired state information of the laparoscope 220 includes desired posture information and desired position information.
  • the desired posture information is obtained based on the first posture information of the display 210. That is, the desired posture of the laparoscope 220 is the first posture of the display 210.
  • the desired position information in the desired state information of the laparoscope 220 is based on the preset fixed point coordinates (ie, the position information of the stamped card in the coordinate system of the mirror arm fixing mechanism 232), the length of the laparoscope entering the body, and the like. Condition is obtained.
  • the control unit 270 obtains the second pose information (ie, current state information) of the laparoscope 220 acquired by the sensor on the joints of the mirror arm 231 and the angle sensor of the laparoscope according to the desired state information of the laparoscope 220, and obtains the inverse kinematics equation.
  • the adjustment amount required by the mechanism 260 is adjusted, and the adjustment mechanism 260 is controlled to match the posture of the laparoscope 220 with the posture of the display 210.
  • the result of this design is that the doctor's line of sight is consistent with the actual lesion direction.
  • constraint condition for obtaining the desired position information of the present invention is not limited to the description of the embodiment, and those skilled in the art can formulate corresponding constraints according to the actual operation requirements of the doctor to obtain the desired posture information of the laparoscope 220.
  • FIG. 6 is a schematic view showing the comparison between the line of sight direction of the doctor and the direction of the actual lesion in the embodiment of the present invention.
  • the line of sight of the doctor is consistent with the direction of the actual lesion.
  • the difference between the posture of the laparoscope 220 and the posture of the display 210 can be allowed to be within a range such that the doctor can always maintain the posture of the display 210 corresponding to the posture of the laparoscope 220 during operation.
  • Fig. 7 is a view showing the deviation of the angle between the line of sight of the doctor and the direction of the actual lesion in the embodiment of the invention. In general, the illustrated angle ⁇ should be within 20 degrees.
  • the angular deviation within 20 degrees is the deviation angle between the XYZ axis of the display coordinate system and each axis of the laparoscopic end coordinate system XYZ axis, and is generally defined as a rotation angle, a pitch angle, and a deflection angle according to the XYZ order.
  • the deviations mentioned below are the deviations of the above angles.
  • the method for solving the three angles is briefly described below.
  • R M is a description of the laparoscopic end coordinate system in the display coordinate system, then the three deviation angles are respectively the rotation R X ( ⁇ ) around the X coordinate of the display coordinate system, that is, the difference from the X coordinate of the display coordinate system.
  • the rotation R Y ( ⁇ ) around the Y coordinate of the display coordinate system that is, the difference from the Y coordinate of the display coordinate system
  • the rotation R Z ( ⁇ ) around the Z coordinate of the display coordinate system that is, the difference from the Z coordinate of the display coordinate system. Therefore, in the present embodiment, "the laparoscope corresponds to the posture of the display", it should be considered that the attitude of the laparoscope and the posture angle of the display are less than a certain angle, generally 20 degrees.
  • the mirror arm 231 is disposed on the mirror arm securing mechanism 232.
  • the coordinate system of the display display 210 is the coordinate system 1
  • the coordinate system of the mirror arm fixing mechanism 232 is the coordinate system 3
  • the coordinate system of the end of the laparoscope 220 is the coordinate system. 2.
  • the coordinate system 1 of the display 210, the coordinate system 3 of the mirror arm fixing mechanism 232, and the coordinate system 2 at the end of the laparoscope 220 are right-handed coordinate systems.
  • the display 210 in this embodiment is, for example, video glasses.
  • Laparoscope 220 is, for example, an electronic laparoscope.
  • the present invention is not particularly limited to the laparoscope 220, and may be a two-lens 3D electronic laparoscope or a 2D laparoscope.
  • the laparoscope 220 is a 0° endoscope.
  • the XYZ axes in the initial coordinate system 1 for setting the video glasses are the same as the XYZ axis directions of the coordinate system 3 of the arm holding mechanism 232, respectively. After the doctor wears the video glasses to turn on the synchronization, the coordinate system 1 also moves as the doctor's head swings.
  • the attitude sensor 240 on the video glasses is capable of measuring the angle at which the three axes of the XYZ of the video glasses coordinate system 1 are respectively deflected with respect to the three axes of the XYZ of the initial coordinate system of the video glasses. Since the XYZ axes in the initial coordinate system 1 are respectively the same as the XYZ axis directions of the coordinate system 3 of the mirror arm fixing mechanism 232, the deflection angle is also the XYZ axis of the current coordinate system 1 of the video glasses with respect to the mirror arm fixing mechanism 232. The angle of the XYZ axis of the coordinate system 3 is deflected.
  • the laparoscope 220 is provided with an angle sensor, and the angle sensors of the joint sensors and the laparoscope 220 have been calibrated at the time of assembly, so that the laparoscope can be made.
  • 220 front end The coordinate system 2 coincides with the coordinate system 3 of the holding arm fixing mechanism 232, or determines the mapping relationship between the coordinate system 2 of the front end portion of the laparoscope 220 and the coordinate system 3 of the holding arm fixing mechanism 232, so any time after the power is turned on
  • the positional relationship between the coordinate system 3 of the holding arm fixing mechanism 232 and the coordinate system 2 of the front end portion of the laparoscope 220 can be obtained. Therefore, the postures of the laparoscope 220 and the display 210 can be made to correspond to the coordinate system 3 of the arm holding mechanism 232.
  • the mirror arm 231 can be attached to the hospital bed, that is, the bed is used as the mirror arm fixing mechanism 232.
  • a mirror arm fixing mechanism 232 that is matched with the mirror arm 231 can be additionally provided.
  • This mirror arm fixing mechanism 232 can be fixed in the vicinity of the hospital bed.
  • the mirror arm 231 is a fixed point mechanism having at least five degrees of freedom such that the laparoscope 220 articulated with its end can be moved about a fixed point (i.e., stamped) position.
  • the mirror arm 231 achieves a plurality of degrees of freedom by providing a plurality of movable joints. Joints of the arms 231 are provided with joint sensors for measuring the joint angle.
  • the laparoscope 220 only needs to have one degree of freedom, that is, axial rotation.
  • the laparoscope 220 is provided with an angle sensor for measuring the angle of rotation of the laparoscope.
  • the adjustment mechanism 260 includes a first set of adjustment mechanisms.
  • the first set of adjustment mechanisms includes a first servo motor.
  • Each of the joints of the mirror arms 231 is provided with at least one first servo motor, and each joint can be actively moved by the first servo motor.
  • the laparoscope 220 is attached to the end of the mirror arm 231 and moves with the mirror arm 231.
  • the attitude adjustment mechanism further includes a second set of adjustment mechanisms, the second set of adjustment mechanisms including at least one second servo motor coupled to the laparoscope 220 to control the rotation of the laparoscope 220.
  • the end of the laparoscopic 220 220a has the ability to swing in two directions, and the rotation function, which can be turned to any desired direction in the joint corner space, and meets the doctor's need for observation of the lesion.
  • the control unit 270 calculates the adjustment amount of each of the first servo motor and the second servo motor in the adjustment mechanism 260 according to the expected state information of the laparoscope 220 and the current state information, according to the inverse kinematics equation, and realizes the posture of the laparoscope and the display. Consistent.
  • the laparoscope 220 used in this embodiment is a 0 degree mirror, and other laparoscopes will be exemplified below.
  • the laparoscopic surgical system of the present embodiment includes a control unit 370, a doctor-side display 310 and an attitude sensor 340, a patient-side laparoscopic 320, a laparoscopic fixation mechanism 332, a mirror arm 331, and an adjustment mechanism 360.
  • the mirror arm 331 is coupled to the laparoscope 320.
  • the belly used in this embodiment The cavity mirror 320 is a 30 degree mirror.
  • the attitude sensor 340 is disposed on the display 310 for acquiring the first posture information of the display 310.
  • the second pose information of the laparoscope 320 may be obtained from the joint rotation angle obtained by the joint sensor provided by the mirror arm 331 and the angle of rotation of the laparoscope obtained by the angle sensor provided by the laparoscope 220, through kinematics.
  • the equation is calculated.
  • the adjustment mechanism 360 includes a first group of adjustment mechanisms and a second group of adjustment mechanisms.
  • the first group of adjustment mechanisms are coupled to the mirror arms 331 to adjust the angle of rotation of the joints on the mirror arms 331.
  • the second group of adjustment mechanisms are coupled to the laparoscope 320.
  • the angle of rotation of the laparoscope 320 is adjusted.
  • the control unit 370 connects the first attitude sensor 340, the sensor on each joint of the mirror arm 331, the angle sensor of the laparoscope 220, and the adjustment mechanism 360.
  • the desired state information of the laparoscope 320 includes desired posture information and desired position information.
  • the desired posture information is obtained based on the first posture information of the display 310. That is, the desired posture of the laparoscope 320 is the first posture of the display 310, and the desired position information in the desired state information of the laparoscope 320 is based on the preset fixed point coordinates (the stamp is stuck in the coordinate system of the holding arm fixing mechanism 332). The position), obtained into the body of the laparoscopic length and other constraints obtained.
  • the control unit 370 according to the desired state information of the laparoscope 320, the second pose information (ie, the current pose information) of the laparoscope 320 acquired by the sensor on each joint of the mirror arm 331 and the angle sensor of the laparoscope 220, through the inverse motion
  • the equations are adjusted to obtain the amount of adjustment required by the adjustment mechanism 360, and the adjustment mechanism 360 is controlled to conform the posture of the laparoscope to the posture of the display 310.
  • the result of this design is that the direction of the doctor's line of sight is basically the same as the actual direction of the lesion.
  • the constraint condition for obtaining the desired position information of the present invention is not limited to the description of the embodiment, and those skilled in the art can formulate corresponding constraints according to the actual operation requirements of the doctor to obtain the laparoscopic desired posture information.
  • FIG. 6 is a schematic view showing the comparison between the line of sight direction of the doctor and the direction of the actual lesion in the embodiment of the present invention.
  • the line of sight of the doctor is consistent with the direction of the actual lesion.
  • the difference between the posture of the laparoscope 320 and the posture of the display 310 can be allowed to be within a range such that the doctor can always maintain the posture of the display 310 corresponding to the posture of the laparoscope 320 during operation.
  • Fig. 7 is a schematic view showing the deviation of the angle between the doctor's line of sight and the actual lesion in the embodiment of the present invention.
  • the illustrated angle ⁇ should be within 20 degrees, and the angular deviation within 20 degrees is the deviation angle of the XYZ axis of the display coordinate system from each axis of the laparoscopic end coordinate system XYZ axis.
  • the yaw angle, the pitch angle, and the yaw angle are defined in the XYZ order.
  • the deviations mentioned below are the deviations of the above angles. The method of solving the three angles is briefly described below.
  • R M is a description of the laparoscopic end coordinate system in the display coordinate system, then the three deviation angles are respectively the rotation R X ( ⁇ ) around the X coordinate of the display coordinate system, that is, the difference from the X coordinate of the display coordinate system.
  • the rotation R Y ( ⁇ ) around the Y coordinate of the display coordinate system that is, the difference from the Y coordinate of the display coordinate system
  • the rotation R Z ( ⁇ ) around the Z coordinate of the display coordinate system that is, the difference from the Z coordinate of the display coordinate system
  • the mirror arm 331 is disposed on the mirror arm securing mechanism 332.
  • the coordinate system of the display display 310 is the coordinate system 1
  • the coordinate system of the mirror arm fixing mechanism 332 is the coordinate system 3
  • the coordinate system of the end of the laparoscope 320 (ie, the end with the lens) is the coordinate system. 2.
  • the coordinate system 1 of the display 310, the coordinate system 3 of the mirror arm fixing mechanism 332, and the coordinate system 2 at the end of the laparoscope 320 are right-handed coordinate systems.
  • the "laparoscopic corresponding to the posture of the display” should also be considered that the attitude of the laparoscope and the posture angle of the display are less than a certain angle, generally 20 degrees.
  • the display 310 in this embodiment is, for example, video glasses.
  • Laparoscope 320 is, for example, an electronic laparoscope.
  • the present invention is not particularly limited to the laparoscope 320, and may be a two-lens 3D electronic laparoscope or a 2D laparoscope.
  • the laparoscope 320 is a 30° endoscope.
  • the XYZ axes in the initial coordinate system 1 for setting the video glasses are the same as the XYZ axis directions of the coordinate system 3 of the arm holding mechanism 332, respectively. After the doctor wears the video glasses to turn on the synchronization, the coordinate system 1 also moves as the doctor's head swings.
  • the attitude sensor 340 on the video glasses can measure the angle at which the three axes of the XYZ of the video glasses coordinate system 1 are respectively deflected with respect to the three axes of the XYZ of the initial coordinate system of the video glasses. Since the XYZ axes in the initial coordinate system 1 are respectively the same as the XYZ axis directions of the coordinate system 3 of the mirror arm fixing mechanism 332, the deflection angle is also the XYZ axis of the current coordinate system 1 of the video glasses with respect to the mirror arm fixing mechanism 332. The angle of the XYZ axis of the coordinate system 3 is deflected.
  • the laparoscope 320 is provided with an angle sensor, and the angle sensors of the joint sensors and the laparoscope have been calibrated at the time of assembly, and the front end coordinate system 2 and the mirror arm fixing mechanism of the laparoscope 320 can be made.
  • the coordinate system 3 of the 332 is coincident, or the mapping relationship between the coordinate system 2 of the front end portion of the laparoscopic 320 and the coordinate system 3 of the holding arm fixing mechanism 332 is determined, so that the mirror arm fixing mechanism 332 can be obtained at any time after the power is turned on.
  • the pose relationship between the coordinate system 3 and the coordinate system 2 at the end of the laparoscope 320 Therefore, the posture of the laparoscope 320 and the display 310 can be made to correspond to the coordinate system 3 of the arm holding mechanism 332.
  • the mirror arm 331 can be attached to the hospital bed, that is, the bed is used as the mirror arm fixing mechanism 332.
  • a mirror arm fixing mechanism 332 that is matched with the mirror arm 331 can be additionally provided, and the mirror arm fixing mechanism 332 can be fixed in the vicinity of the hospital bed.
  • the mirror arm 331 is a fixed point mechanism of at least five degrees of freedom such that the laparoscope 320 articulated at its end can move around the fixed point (i.e., stamp) position.
  • Joints of the arms 331 are provided with joint sensors for measuring the joint angle.
  • the laparoscope 320 is provided with an angle sensor for measuring the angle of rotation of the laparoscope 320.
  • the adjustment mechanism 360 includes a first set of adjustment mechanisms.
  • the first set of adjustment mechanisms includes a first servo motor.
  • Each of the joints of the mirror arms 331 is provided with at least one first servo motor, and each joint can be actively moved by the first servo motor.
  • the laparoscope 320 is attached to the end of the mirror arm 331 and moves with the mirror arm 331.
  • the adjustment mechanism 360 further includes a second set of adjustment mechanisms including at least one second servo motor coupled to the laparoscope 320 to control the rotation of the laparoscope 320.
  • the end of the laparoscopic 320 320a has the ability to oscillate in two directions, and the autorotation function, which can be turned to any desired direction within the joint corner space to meet the doctor's need for observation of the lesion.
  • the control unit 370 calculates the adjustment amount of each of the first servo motor and the second servo motor in the adjustment mechanism 360 according to the expected state information and current state information of the laparoscope, and realizes the adjustment of the laparoscope 320 and the display 310 according to the inverse kinematics equation.
  • the posture is consistent.
  • Fig. 4 is a schematic view showing a modification of the laparoscopic surgical system of the second embodiment of the present invention.
  • the holding mirror arm 361 is different in type of the laparoscope 320 in this embodiment.
  • the 30 degree mirror can be used in this embodiment to make the mirror arm have more angles to make the laparoscope direction coincide with the doctor's line of sight.
  • the first embodiment 0-degree mirror in this embodiment, since the 30-degree mirror is used, it is necessary to consider the endoscope end angle factor in solving the kinematic equation, the inverse kinematics equation, and the desired position information of the laparoscope 320.
  • the laparoscope in this embodiment The current state information, the desired state information (including the desired posture information, and the desired position information) of 320 all refer to current state information and desired state information at the end of the laparoscope 320.
  • the laparoscopic lens can also be selected from a 75 degree mirror or other angle.
  • FIG. 5 is a schematic illustration of a laparoscopic surgical system in accordance with a third embodiment of the present invention.
  • the laparoscopic surgical system 400 of the present embodiment includes a control unit 470, a doctor-side display 410 and an attitude sensor 440, a patient-side laparoscope 420, a mirror arm fixing mechanism 432, a mirror arm 431, and an adjustment mechanism 460.
  • the mirror arm 431 is connected to the laparoscope 420.
  • the laparoscope 420 used in the present embodiment is a serpentine laparoscope as compared with the first embodiment.
  • the end of the serpentine laparoscope ie, the end near the lens
  • at least three angle sensors are provided in the system for measuring the angle of the serpentine laparoscope in the XYZ axis direction of the laparoscope coordinate system.
  • the attitude sensor 440 is disposed on the display 410 for acquiring the first posture information of the display 410.
  • the adjustment mechanism 460 includes a second set of adjustment mechanisms that are coupled to the laparoscope 420 to adjust the attitude of the end of the laparoscope 420.
  • the control unit 470 connects the attitude sensor 440, the angle sensor of the laparoscope, and the adjustment mechanism 460.
  • the desired posture information of the laparoscope 420 is obtained based on the first posture information of the display 410. That is, the desired posture of the laparoscope 420 is the first posture of the display 410.
  • the second posture information of the laparoscope 420 i.e., the current posture information
  • the serpentine laparoscopic end has three degrees of freedom, the swinging ability and the rotation function in two directions can be realized without coupling with the mirror arm 431.
  • the current state information may not include the current position information of the laparoscope 220
  • the desired state information may not include the desired position information of the laparoscope 220.
  • the control unit 470 obtains the second posture information (ie, current state information) of the laparoscope 420 obtained from the sensor on each joint of the mirror arm 431 and the angle sensor of the laparoscope 420 according to the desired posture information of the laparoscope 220, according to inverse kinematics.
  • the equation obtains the amount of adjustment required by the adjustment mechanism 460 and controls the attitude adjustment mechanism 460 to conform the posture of the laparoscope to the posture of the display 410.
  • the result of this design is that the direction of the doctor's line of sight is basically the same as the actual direction of the lesion.
  • Figure 6 is a schematic view showing the comparison between the direction of the line of sight of the doctor and the direction of the actual lesion in the embodiment of the present invention, in Figure 6 Ideally, the direction of the doctor's line of sight is consistent with the actual direction of the lesion.
  • the difference between the posture of the laparoscope 420 and the posture of the display 410 can be allowed to be within a range such that the doctor can always maintain the posture of the display 310 corresponding to the posture of the laparoscope 320 during operation.
  • Fig. 7 is a schematic view showing the deviation of the angle between the doctor's line of sight and the actual lesion in the embodiment of the present invention.
  • the illustrated angle ⁇ should be within 20 degrees, and the angular deviation within 20 degrees is the deviation angle of the XYZ axis of the display coordinate system from each axis of the laparoscopic end coordinate system XYZ axis. Therefore, in the present embodiment, "the laparoscope corresponds to the posture of the display", it should be considered that the attitude of the laparoscope and the posture angle of the display are less than a certain angle, generally 20 degrees.
  • the mirror arm 431 is disposed on the mirror arm fixing mechanism 432.
  • the coordinate system of the display display 410 is the coordinate system 1
  • the coordinate system of the mirror arm fixing mechanism 432 is the coordinate system 3
  • the coordinate system of the front end of the laparoscopic mirror 420 ie, the end at which the lens is placed
  • the coordinate system 1 of the display 410, the coordinate system 3 of the mirror arm fixing mechanism 432, and the coordinate system 2 at the end of the laparoscope 420 are right-handed coordinate systems.
  • the display 410 in this embodiment is, for example, video glasses.
  • Laparoscope 220 is, for example, an electronic laparoscope.
  • the present invention is not particularly limited to the laparoscope 220, and may be a two-lens 3D electronic laparoscope or a 2D laparoscope.
  • the laparoscope 420 is a serpentine laparoscope.
  • the XYZ axes in the initial coordinate system 1 for setting the video glasses are the same as the XYZ axis directions of the coordinate system 3 of the arm holding mechanism 432, respectively. After the doctor wears the video glasses to turn on the synchronization, the coordinate system 1 also moves as the doctor's head swings.
  • the first attitude sensor 440 on the video glasses is capable of measuring the angle at which the three axes of the XYZ of the video glasses coordinate system 1 are respectively deflected relative to the three axes of the XYZ of the initial coordinate system of the video glasses. Since the XYZ axes in the initial coordinate system 1 are respectively the same as the XYZ axis directions of the coordinate system 3 of the mirror arm fixing mechanism 432, the deflection angle is also the XYZ axis of the current coordinate system 1 of the video glasses with respect to the mirror arm fixing mechanism 432. The angle of the XYZ axis of the coordinate system 3 is deflected.
  • the laparoscope 420 is provided with an angle sensor, and the angle sensors of the joint sensors and the laparoscope 420 have been calibrated at the time of assembly, so that the laparoscope can be made.
  • the front end coordinate system 2 of the 420 coincides with the coordinate system 3 of the holding arm fixing mechanism 432, or the mapping relationship between the coordinate system 2 of the front end portion of the laparoscope 420 and the coordinate system 3 of the holding arm fixing mechanism 432 is determined, so any after the power on
  • the coordinate system 3 of the holding arm fixing mechanism 432 and the coordinate system of the front end of the laparoscope 420 can be obtained at all times.
  • the relationship between the gestures. Therefore, the posture of the laparoscope 320 and the display 310 can be made to correspond to the coordinate system 3 of the arm holding mechanism 332.
  • the mirror arm 431 can be attached to the hospital bed, that is, the bed is used as the mirror arm fixing mechanism 432.
  • a mirror arm fixing mechanism 432 matching the mirror arm 431 can be additionally provided, and the mirror arm fixing mechanism 432 can be fixed in the vicinity of the hospital bed.
  • the holding arm 431 is a fixed point mechanism such that the laparoscope 420 articulated with its distal end can move around the fixed point (i.e., the stamped card) position.
  • Joints of the arms 431 are provided with joint sensors for measuring the joint angle.
  • the laparoscope 420 is provided with at least three angle sensors for measuring the swinging and autoradiation angle of the laparoscope to obtain the second posture information of the serpentine laparoscope 420.
  • the adjustment mechanism 460 also includes a second set of adjustment mechanisms including at least three second servo motors coupled to the serpentine laparoscope 420 to control the attitude of the serpentine laparoscope 420. Specifically, at least two of the second set of adjustment mechanisms are used to adjust the swing of the serpentine laparoscope 420, and at least one second servo motor is used to adjust the rotation of the serpentine laparoscope 420.
  • the end of the laparoscopic mirror 420a has the ability to oscillate in two directions, as well as the autorotation function, which can be turned to any desired direction within the joint corner space to meet the doctor's need for observation of the lesion.
  • the control unit 470 calculates the adjustment amount of each second servo motor in the adjustment mechanism according to the current posture information and the desired posture information of the laparoscope 420, so as to achieve the posture of the laparoscope and the display.
  • the adjustment mechanism further needs to include a first set of adjustment mechanisms including the first servo motor.
  • At least one first servo motor is disposed on each joint of the mirror arm for adjusting a rotation angle of the joint; the mirror arm has at least three degrees of freedom, and each joint of the mirror arm is provided
  • the section sensor is used to measure the rotation angle of each joint; the control unit needs to obtain the current position information of the laparoscope, obtain the desired position information of the laparoscope through the constraint condition, and further obtain the adjustment amount of the adjustment mechanism by inversely solving the kinematic equation.
  • the control adjustment mechanism is adjusted to achieve the desired posture of the laparoscope.
  • the position of the arm holding mechanism 232 is fixed, and the coordinate system 3 of the arm holding mechanism 232 is determined.
  • the video glasses 210 and the mirror arm fixing mechanism 232 are fixed together according to a predetermined position, that is, the coordinate system 1 regarded as being initialized is completely coincident with the direction of the XYZ axis of the coordinate system 3, and the video glasses are initialized.
  • the attitude sensor 240 on 231. Thereafter, when the video glasses 210 are moved, the attitude sensor 240 of the video glasses 210 measures, and obtains a mapping relationship between the coordinate axes of the current coordinate system 1 and the initial coordinate system 1. This mapping relationship is also a mapping relationship with the coordinate system 3 of the holder arm fixing mechanism 232.
  • the laparoscope 220 is inserted into the interior of the body by a stamp, and the length of the laparoscope 220 in the body is determined.
  • the doctor removes the video glasses 210 that have been initialized and wears them on the head, stands in a position where the laparoscopic instrument is operated more comfortable, opens the mapping switch of the video glasses 210 and the laparoscope 220, and the control unit 270 receives the measurement according to the attitude sensor 230.
  • the second pose information obtained by the first posture information, the joint sensors, and the angle sensor of the laparoscope 220 calculates the angular deviation value of the video glasses coordinate system 1 and the laparoscopic coordinate system 2XYZ axis, and calculates the video glasses 210 relative to the abdominal cavity.
  • the posture change amount of the mirror 220 if the angular deviation value of any of the axes is greater than 20 degrees, the control unit 270 further calculates the desired position information according to the stamping coordinate value and the length of the laparoscope 220 in the body, and combines the first posture information ( That is, the desired attitude information is calculated according to the inverse kinematics formula, and the adjustment amounts of the respective servo motors on the first group of adjustment mechanisms and the second group of adjustment mechanisms are made such that the respective coordinate axis directions of the coordinate system 2 coincide with the coordinate system 1. At this point, the doctor can begin the surgical operation in a comfortable manner.
  • the control unit 270 will also be based on the video glasses 210.
  • the posture change is calculated, and the angular deviation value of the video glasses coordinate system 1 and the laparoscopic coordinate system 2XYZ axis is calculated to determine that the laparoscope corresponds to the posture of the video glasses 210. If the angular deviation value of any of the axes is greater than 20 degrees, It is considered that the posture of the laparoscopic lens does not correspond to the posture of the video glasses 210.
  • the procedure of use of the third embodiment is similar, except that the constraints are not pre-set to determine the desired positional information of the laparoscope.
  • the above embodiment of the present invention uses a display with attitude measurement function and a 3D stereo laparoscope or 2D laparoscopy is used in combination.
  • the laparoscopic machine is mechanically connected by the holding arm, and according to the current state information of the laparoscope and the desired state information, the adjustment amount required by the adjusting mechanism is obtained, and the adjusting mechanism is controlled to adjust the posture of the laparoscope, and the image displayed on the display is performed.
  • the conversion enables the doctor to keep the display coordinate system and the direction of the laparoscopic coordinate system substantially consistent during operation, and constitutes a set of micro-trauma operating system with good performance, so that the doctor has a good learning curve when learning to use.
  • the system of the embodiment of the present invention is superior to the current general micro-trauma laparoscopic system.
  • the invention has the characteristics of simple and reliable structure, convenient use and low cost, and is suitable for general promotion.
  • the system of the embodiment of the invention can also be used in the observation system on the micro-trauma surgery robot, and can well alleviate the current surgical robot sitting posture to cause the doctor's cervical spine occupational disease.

Abstract

A laparoscopic surgery system, comprising a control unit (270); a display (210) and a gesture sensor (240) at a doctor end; and a laparoscope (220), a laparoscope-holding arm fixing mechanism (232), a laparoscope holding arm (231) provided on the laparoscope-holding arm fixing mechanism (232), and an adjusting mechanism (260) at a patient end. The gesture sensor (240) is provided on the display (210) and used for obtaining gesture information of the display (210); the laparoscope holding arm (231) is connected to the laparoscope (220); the adjusting mechanism (260) is connected to the laparoscope holding arm (231) and/or the laparoscope (220); the adjusting mechanism (260) is used for adjusting the gesture of the laparoscope (220); the control unit (270) is connected to the gesture sensor (240) and the adjusting mechanism (260); the control unit (270) obtains an adjustment amount required for the adjusting mechanism (260) according to current state information and desired state information of the laparoscope (220), and controls the adjusting mechanism (260) to adjust the gesture of the laparoscope (220), so that the gesture of the laparoscope (220) is consistent with that of the display (210), wherein the current state information of the laparoscope (220) comprises current gesture information of the laparoscope (220), and the desired state information of the laparoscope (220) comprises gesture information of the display (210).

Description

腹腔镜手术系统Laparoscopic surgery system 技术领域Technical field
本发明主要涉及医疗器械,尤其涉及一种腹腔镜手术系统。The present invention relates generally to medical devices, and more particularly to a laparoscopic surgical system.
背景技术Background technique
手术操作技术一直伴随着人类的医疗技术发展而日新月异,近十几年来微创伤手术的概念正在逐渐普及。微创伤手术利用腹腔镜、胸腔镜等现代医疗器械及相关设备进行的手术,具有创伤小、疼痛轻、恢复快等特点。Surgical operation techniques have been advancing with the development of human medical technology. The concept of microtrauma surgery has been gradually popularized in the past decade. Microtrauma surgery uses modern medical equipment such as laparoscopy and thoracoscopic surgery and related equipment. It has the characteristics of small trauma, light pain and quick recovery.
传统的腹腔镜手术系统操作较复杂、外科培训时间长、对医生技术要求高。图1是传统的微创伤腹腔手术医生操作时的视线示意图。参考图1所示,医生的实际操作方向为人体腹腔11处的病灶位置S,然而其视线方向是显示器12。图1中可以看到医生的视线与需要操作的病灶位置具有较大的角度偏差,而这种偏差造成了医生手眼不一致,是增大手术操作难度的最大原因。The traditional laparoscopic surgery system is complicated to operate, has long surgical training time, and has high technical requirements for doctors. Figure 1 is a schematic view of the line of sight of a conventional microtrauma abdominal surgeon. Referring to Fig. 1, the actual operation direction of the doctor is the lesion position S at the abdominal cavity 11 of the human body, however, the direction of the line of sight is the display 12. In Fig. 1, it can be seen that the doctor's line of sight has a large angular deviation from the position of the lesion to be operated, and this deviation causes the doctor's hand and eye to be inconsistent, which is the biggest reason for increasing the difficulty of the operation.
由此出现了技术更为复杂的达芬奇手术机器人系统,其具有3种核心特点:1)高清3D立体视觉;2)人手与多自由度器械的一致运动;3)运动范围比例缩放。然而达芬奇手术机器人系统的售价昂贵,并且每年都要消耗大量的手术器械耗材及维护费用,导致其很难被普及,尤其是在中国这样的发展中国家普及。截至2014年末,90%以上的达芬奇手术机器人系统分布在发达国家,中国的达芬奇手术机器人系统数量仅为1%。This led to the more complex DaVinci surgical robotic system, which has three core features: 1) high-definition 3D stereo vision; 2) consistent movement of human hands and multi-degree-of-freedom instruments; 3) scaling of motion range. However, the Da Vinci surgical robot system is expensive and consumes a large amount of surgical equipment consumables and maintenance costs every year, making it difficult to spread, especially in developing countries such as China. As of the end of 2014, more than 90% of Da Vinci surgical robot systems are distributed in developed countries, and the number of Da Vinci surgical robot systems in China is only 1%.
因此,本领域期望提出一种使用简单、成本低廉的腹腔镜手术系统。Accordingly, it is desirable in the art to provide a laparoscopic surgical system that is simple to use and inexpensive.
发明内容Summary of the invention
本发明要解决的技术问题是提供一种腹腔镜手术系统,可以降低对医生的技术和学习时间要求,同时具有更低的成本。The technical problem to be solved by the present invention is to provide a laparoscopic surgical system which can reduce the technical and learning time requirements for doctors, and at the same time have lower costs.
本发明所提出的一种腹腔镜手术系统,包括控制单元,医生端的显示器和姿态传感器,患者端的腹腔镜、持镜臂固定机构、设置在持镜臂固定机构上的持镜臂以及调整机构,其中,该姿态传感器设于该显示器上且用于获取该显示 器的姿态信息,该持镜臂与该腹腔镜连接,该调整机构与该持镜臂和/或该腹腔镜连接,该调整机构用以调整该腹腔镜的姿态,该控制单元连接该姿态传感器和该调整机构,该控制单元根据腹腔镜当前的状态信息以及期望状态信息以获得该调整机构需要的调整量,并控制该调整机构基于所述调整量来调整该腹腔镜的姿态,使该腹腔镜与该显示器的姿态相对应,其中腹腔镜当前的状态信息包括腹腔镜当前姿态信息,该腹腔镜的期望状态信息包括显示器的姿态信息。A laparoscopic surgical system according to the present invention comprises a control unit, a doctor-side display and an attitude sensor, a patient-side laparoscopic mirror holder, a mirror arm fixing mechanism, a mirror-holding arm disposed on the mirror-arm fixing mechanism, and an adjustment mechanism. Wherein the attitude sensor is disposed on the display and used to acquire the display The posture information of the device, the holding arm is connected to the laparoscope, the adjusting mechanism is connected with the holding arm and/or the laparoscope, the adjusting mechanism is used for adjusting the posture of the laparoscope, and the control unit is connected to the posture sensor And the adjusting mechanism, the control unit obtains an adjustment amount required by the adjustment mechanism according to the current state information of the laparoscope and the desired state information, and controls the adjustment mechanism to adjust the posture of the laparoscope based on the adjustment amount to make the abdominal cavity The mirror corresponds to the posture of the display, wherein the current state information of the laparoscope includes laparoscopic current posture information, and the desired state information of the laparoscope includes posture information of the display.
在本发明的一实施例中,该腹腔镜为0度镜、或30度镜或75度镜。In an embodiment of the invention, the laparoscope is a 0 degree mirror, or a 30 degree mirror or a 75 degree mirror.
在本发明的一实施例中,该腹腔镜为末端具有三个自由度的蛇形腹腔镜。In an embodiment of the invention, the laparoscope is a serpentine laparoscope having three degrees of freedom at the end.
在本发明的一实施例中,该持镜臂为含有多个关节的不动点机构,该调整机构包括第一组调整机构和第二组调整机构,该第一组调整机构包括第一伺服电机,该持镜臂的每个关节上至少设有一个该第一伺服电机,用以调节对应的关节转动,该第二组调整机构包括至少一个第二伺服电机,用以调节该腹腔镜轴向转动。In an embodiment of the invention, the mirror arm is a fixed point mechanism including a plurality of joints, the adjustment mechanism includes a first group of adjustment mechanisms and a second group of adjustment mechanisms, the first group of adjustment mechanisms including a first servo a motor, at least one first servo motor is disposed on each joint of the mirror arm for adjusting a corresponding joint rotation, and the second group adjustment mechanism includes at least one second servo motor for adjusting the laparoscopic axis Turn to the direction.
在本发明的一实施例中,该腹腔镜当前的状态信息还包括腹腔镜当前位置信息,该腹腔镜的期望状态信息还包括腹腔镜期望位置信息,该调整机构的调整量根据腹腔镜当前的状态信息和期望状态信息通过运动学方程逆解获得。In an embodiment of the present invention, the current state information of the laparoscope further includes laparoscopic current position information, and the desired state information of the laparoscope further includes laparoscopic desired position information, and the adjustment amount of the adjustment mechanism is according to a current laparoscopic The state information and the expected state information are obtained by inverse solution of the kinematics equation.
在本发明的一实施例中,该腹腔镜期望位置信息根据预设的约束条件获得。In an embodiment of the invention, the laparoscopic desired position information is obtained according to a preset constraint.
在本发明的一实施例中,该约束条件为不动点的位置信息,及所述腹腔镜在病人体内的长度。In an embodiment of the invention, the constraint is positional information of the fixed point and the length of the laparoscopic body in the patient.
在本发明的一实施例中,该调整机构包括第二组调整机构,该第二组调整机构包括至少三个第三伺服电机,以控制该蛇形腹腔镜的姿态。In an embodiment of the invention, the adjustment mechanism includes a second set of adjustment mechanisms including at least three third servo motors to control the attitude of the serpentine laparoscope.
在本发明的一实施例中,该持镜臂包括多个关节,且各关节上设有关节传感器,以测量各关节的转动角度,该蛇形腹腔镜的三个自由度包括两个摆动自由度和一个自转自由度,该蛇形腹腔镜设有三个角度传感器,分别测量该蛇形腹腔镜的两个摆动角度和自转角度,以获得该蛇形腹腔镜的当前姿态信息。In an embodiment of the invention, the mirror arm includes a plurality of joints, and each joint is provided with a joint sensor to measure the rotation angle of each joint, and the three degrees of freedom of the serpentine laparoscope include two swing freedoms. Degree and a degree of freedom of rotation, the serpentine laparoscope is provided with three angle sensors, respectively measuring the two swing angles and the rotation angle of the serpentine laparoscope to obtain the current posture information of the serpentine laparoscope.
在本发明的一实施例中,该控制单元控制该调整机构基于所述调整量来调整该腹腔镜的姿态,使该腹腔镜与该显示器的姿态相一致。In an embodiment of the invention, the control unit controls the adjustment mechanism to adjust the posture of the laparoscope based on the adjustment amount so that the laparoscope conforms to the posture of the display.
与现有技术相比,本发明将具有姿态测量功能的显示器与腹腔镜结合使用。 根据显示器上附着的姿态传感器计算数据,调整腹腔镜的位姿使得医生在操作时始终能够保持显示器坐标系与腹腔镜坐标系的方向相对应,组成一套具有良好性能的微创伤手术操作系统,从而医生在学习使用时具有良好的学习曲线。Compared with the prior art, the present invention uses a display having a posture measuring function in combination with a laparoscope. According to the attitude sensor attached to the display, the position of the laparoscope is adjusted so that the doctor can always maintain the orientation of the display coordinate system and the direction of the laparoscope coordinate system to form a set of micro-traumatic surgery operating system with good performance. Therefore, the doctor has a good learning curve when learning to use.
附图说明DRAWINGS
图1是传统的微创伤腹腔手术医生操作时的视线示意图。Figure 1 is a schematic view of the line of sight of a conventional microtrauma abdominal surgeon.
图2是本发明的第一实施例的腹腔镜手术系统的示意图。2 is a schematic view of a laparoscopic surgical system of a first embodiment of the present invention.
图3是本发明的第二实施例的腹腔镜手术系统的示意图。3 is a schematic view of a laparoscopic surgical system of a second embodiment of the present invention.
图4是本发明的第二实施例的腹腔镜手术系统的变化例示意图。Fig. 4 is a schematic view showing a modification of the laparoscopic surgical system of the second embodiment of the present invention.
图5是本发明的第三实施例的腹腔镜手术系统的示意图。Figure 5 is a schematic illustration of a laparoscopic surgical system in accordance with a third embodiment of the present invention.
图6是本发明实施例中医生视线方向与实际病灶方向的比较示意图。Fig. 6 is a schematic view showing the comparison between the direction of the line of sight of the doctor and the direction of the actual lesion in the embodiment of the present invention.
图7是本发明实施例中医生视线方向与实际病灶方向的偏差的容忍角度示意图。Fig. 7 is a perspective view showing the tolerance angle of the deviation between the line of sight direction of the doctor and the actual direction of the lesion in the embodiment of the present invention.
具体实施方式detailed description
为让本发明的上述目的、特征和优点能更明显易懂,以下结合附图对本发明的具体实施方式作详细说明。The above described objects, features and advantages of the present invention will become more apparent from the aspects of the appended claims.
在下面的描述中阐述了很多具体细节以便于充分理解本发明,但是本发明还可以采用其它不同于在此描述的其它方式来实施,因此本发明不受下面公开的具体实施例的限制。In the following description, numerous specific details are set forth in the description of the invention, and the invention may be practiced otherwise.
本发明的实施例描述腹腔镜手术系统,可以降低对医生的技术和学习时间要求,同时具有更低的成本。通过已有腹腔镜手术系统的研究和医生的反馈意见,发现医生操作时的视觉是对微创伤手术影响最大的。为此,本发明所提出的腹腔镜手术系统,能够适应医生视角,使医生在视线更加自然的状态下进行手术操作。本领域技术人员应知道,本文中所述的姿态传感器,并不限定于只是测量姿态变化的装置,本文所述的姿态传感器,还可以为包括测量姿态、位置变化等多种测量功能的装置,例如位姿传感器。Embodiments of the present invention describe a laparoscopic surgical system that can reduce the technical and learning time requirements for a physician while having lower costs. Through the research of the existing laparoscopic surgery system and the feedback from doctors, it is found that the vision of the doctor during operation is the most influential to the micro-trauma surgery. To this end, the laparoscopic surgical system proposed by the present invention can adapt to the doctor's perspective and enable the doctor to perform a surgical operation in a state where the line of sight is more natural. It should be understood by those skilled in the art that the attitude sensor described herein is not limited to a device for measuring a change in posture, and the attitude sensor described herein may also be a device including a plurality of measurement functions such as a measurement attitude and a position change. For example, a pose sensor.
第一实施例 First embodiment
图2是本发明的第一实施例的腹腔镜手术系统的示意图。参考图2所示,本实施例的腹腔镜手术系统包括控制单元270,医生端的显示器210、姿态传感器240,患者端的腹腔镜220、持镜臂固定机构232、持镜臂231和调整机构260,持镜臂231与腹腔镜220相连。姿态传感器240设于显示器210上用于获取显示器210的第一姿态信息,以作为腹腔镜的期望状态信息的一部分。腹腔镜220的第二位姿信息(即腹腔镜220的当前状态信息)可以根据该持镜臂231设有的关节传感器获得的关节转动角度以及腹腔镜220设有的角度传感器获得的腹腔镜转动角度,通过运动学方程计算获得。调整机构260包括第一组调整机构和第二组调整机构,第一组调整机构与持镜臂231连接,调节持镜臂231上各个关节的转动角度,第二组调整机构与腹腔镜220连接,调节腹腔镜220的自转角度。控制单元270连接姿态传感器240、持镜臂231各关节上的传感器、腹腔镜220的角度传感器和调整机构260。2 is a schematic view of a laparoscopic surgical system of a first embodiment of the present invention. Referring to FIG. 2, the laparoscopic surgical system of the present embodiment includes a control unit 270, a doctor-side display 210, an attitude sensor 240, a patient-side laparoscope 220, a mirror arm fixing mechanism 232, a mirror arm 231, and an adjustment mechanism 260. The mirror arm 231 is coupled to the laparoscope 220. The attitude sensor 240 is disposed on the display 210 for acquiring the first posture information of the display 210 as part of the desired state information of the laparoscope. The second pose information of the laparoscope 220 (ie, the current state information of the laparoscope 220) may be based on the joint rotation angle obtained by the joint sensor provided by the mirror arm 231 and the laparoscope rotation obtained by the angle sensor provided by the laparoscope 220. Angle, calculated by kinematic equations. The adjustment mechanism 260 includes a first group of adjustment mechanisms and a second group of adjustment mechanisms. The first group of adjustment mechanisms are coupled to the mirror arm 231 to adjust the rotation angle of each joint on the mirror arm 231. The second group of adjustment mechanisms are coupled to the laparoscope 220. The angle of rotation of the laparoscope 220 is adjusted. The control unit 270 connects the attitude sensor 240, the sensor on each joint of the mirror arm 231, the angle sensor of the laparoscope 220, and the adjustment mechanism 260.
本实施例中,腹腔镜220的期望状态信息包括期望姿态信息和期望位置信息。其中期望姿态信息是根据显示器210的第一姿态信息获得。即,腹腔镜220的期望姿态为显示器210的第一姿态。腹腔镜220的期望状态信息中的期望位置信息则是根据预设的不动点坐标(即戳卡在持镜臂固定机构232的坐标系下的位置信息),进入体内的腹腔镜长度等约束条件获得。控制单元270根据腹腔镜220期望状态信息,持镜臂231各关节上的传感器、腹腔镜的角度传感器获取的腹腔镜220的第二位姿信息(即当前状态信息),通过逆运动学方程得到调整机构260需要的调整量,并控制调整机构260使腹腔镜220的姿态与显示器210的姿态相一致。这一设计的结果是,医生视线方向与实际病灶方向相一致。应知道,本发明获得期望位置信息的约束条件不限于本实施例的描述,本领域技术人员可以根据医生实际的操作要求来制定相应的约束条件以获得腹腔镜220的期望位姿信息。In the present embodiment, the desired state information of the laparoscope 220 includes desired posture information and desired position information. The desired posture information is obtained based on the first posture information of the display 210. That is, the desired posture of the laparoscope 220 is the first posture of the display 210. The desired position information in the desired state information of the laparoscope 220 is based on the preset fixed point coordinates (ie, the position information of the stamped card in the coordinate system of the mirror arm fixing mechanism 232), the length of the laparoscope entering the body, and the like. Condition is obtained. The control unit 270 obtains the second pose information (ie, current state information) of the laparoscope 220 acquired by the sensor on the joints of the mirror arm 231 and the angle sensor of the laparoscope according to the desired state information of the laparoscope 220, and obtains the inverse kinematics equation. The adjustment amount required by the mechanism 260 is adjusted, and the adjustment mechanism 260 is controlled to match the posture of the laparoscope 220 with the posture of the display 210. The result of this design is that the doctor's line of sight is consistent with the actual lesion direction. It should be understood that the constraint condition for obtaining the desired position information of the present invention is not limited to the description of the embodiment, and those skilled in the art can formulate corresponding constraints according to the actual operation requirements of the doctor to obtain the desired posture information of the laparoscope 220.
图6是本发明实施例中医生视线方向与实际病灶方向的比较示意图,在图6的理想情况下,医生视线方向与实际病灶方向一致。在实际实施时,可容许腹腔镜220的姿态与显示器210的姿态之间的差异在一个范围内,使得医生在操作时始终能够保持显示器210的姿态与腹腔镜220的姿态相对应。图7是本发 明实施例中医生视线方向与实际病灶方向之间存在角度为θ的偏差的示意图。通常来说,图示的角度θ应当在20度以内。具体而言,所述的20度以内的角度偏差为显示器坐标系的XYZ轴与腹腔镜末端坐标系XYZ轴每个轴的偏差角度,一般按照XYZ顺序定义为回转角、俯仰角和偏转角,如无特殊说明,下面提到的偏差均为上述角度的偏差,下面简单描述三个角的求解方法。RM为腹腔镜末端坐标系在显示器坐标系下的描述,那么所述的三个偏差角度分别为绕显示器坐标系X轴的旋转RX(γ)即与显示器坐标系X轴的差值,绕显示器坐标系Y轴的旋转RY(β)即与显示器坐标系Y轴的差值,绕显示器坐标系Z轴的旋转RZ(α)即与显示器坐标系Z轴的差值。因此,在本实施例中所述“腹腔镜与显示器的姿态相对应”,应认为腹腔镜的姿态与显示器的姿态角度偏差小于某个角度,一般为20度。6 is a schematic view showing the comparison between the line of sight direction of the doctor and the direction of the actual lesion in the embodiment of the present invention. In the ideal case of FIG. 6, the line of sight of the doctor is consistent with the direction of the actual lesion. In actual implementation, the difference between the posture of the laparoscope 220 and the posture of the display 210 can be allowed to be within a range such that the doctor can always maintain the posture of the display 210 corresponding to the posture of the laparoscope 220 during operation. Fig. 7 is a view showing the deviation of the angle between the line of sight of the doctor and the direction of the actual lesion in the embodiment of the invention. In general, the illustrated angle θ should be within 20 degrees. Specifically, the angular deviation within 20 degrees is the deviation angle between the XYZ axis of the display coordinate system and each axis of the laparoscopic end coordinate system XYZ axis, and is generally defined as a rotation angle, a pitch angle, and a deflection angle according to the XYZ order. Unless otherwise specified, the deviations mentioned below are the deviations of the above angles. The method for solving the three angles is briefly described below. R M is a description of the laparoscopic end coordinate system in the display coordinate system, then the three deviation angles are respectively the rotation R X (γ) around the X coordinate of the display coordinate system, that is, the difference from the X coordinate of the display coordinate system. The rotation R Y (β) around the Y coordinate of the display coordinate system, that is, the difference from the Y coordinate of the display coordinate system, the rotation R Z (α) around the Z coordinate of the display coordinate system, that is, the difference from the Z coordinate of the display coordinate system. Therefore, in the present embodiment, "the laparoscope corresponds to the posture of the display", it should be considered that the attitude of the laparoscope and the posture angle of the display are less than a certain angle, generally 20 degrees.
继续参考图2所示,持镜臂231设在持镜臂固定机构232上。在本实施例中,设定显示器210的坐标系为坐标系1,持镜臂固定机构232的坐标系为坐标系3,腹腔镜220末端(即置有镜头的一端)的坐标系为坐标系2。显示器210的坐标系1、持镜臂固定机构232的坐标系3、腹腔镜220末端的坐标系2为右手坐标系。With continued reference to FIG. 2, the mirror arm 231 is disposed on the mirror arm securing mechanism 232. In this embodiment, the coordinate system of the display display 210 is the coordinate system 1, the coordinate system of the mirror arm fixing mechanism 232 is the coordinate system 3, and the coordinate system of the end of the laparoscope 220 (ie, the end with the lens) is the coordinate system. 2. The coordinate system 1 of the display 210, the coordinate system 3 of the mirror arm fixing mechanism 232, and the coordinate system 2 at the end of the laparoscope 220 are right-handed coordinate systems.
本实施例中的显示器210例如为视频眼镜。腹腔镜220例如是电子腹腔镜。本发明对腹腔镜220没有特别的限制,可以是双镜头的3D电子腹腔镜也可以是2D腹腔镜。在本实施例中所述腹腔镜220为0°内窥镜。设定视频眼镜初始的坐标系1中的XYZ轴分别与持镜臂固定机构232的坐标系3的XYZ轴方向相同。医生头戴视频眼镜开启同步后,随着医生头部的摆动,坐标系1也发生运动。在视频眼镜上的姿态传感器240能够实时地测量出视频眼镜坐标系1的XYZ三个轴分别相对于视频眼镜初始坐标系的XYZ三个轴偏转的角度。由于初始的坐标系1中的XYZ轴分别与持镜臂固定机构232的坐标系3的XYZ轴方向相同,因此偏转角度也就是视频眼镜当前坐标系1的XYZ轴相对于持镜臂固定机构232的坐标系3的XYZ轴偏转的角度。另一方面,由于持镜臂231各个运动关节均安装关节传感器,腹腔镜220设有角度传感器,而且这些关节传感器、腹腔镜220的角度传感器在装配时已经对零位进行校准,可以使腹腔镜220前端 部坐标系2与持镜臂固定机构232坐标系3相一致,或者确定腹腔镜220前端部坐标系2与持镜臂固定机构232坐标系3之间存在的映射关系,所以在开机后任何时刻均可得到持镜臂固定机构232坐标系3和腹腔镜220前端部坐标系2之间的位姿关系。因此,可以使得腹腔镜220和显示器210的姿态在持镜臂固定机构232的坐标系3下相对应。The display 210 in this embodiment is, for example, video glasses. Laparoscope 220 is, for example, an electronic laparoscope. The present invention is not particularly limited to the laparoscope 220, and may be a two-lens 3D electronic laparoscope or a 2D laparoscope. In the present embodiment, the laparoscope 220 is a 0° endoscope. The XYZ axes in the initial coordinate system 1 for setting the video glasses are the same as the XYZ axis directions of the coordinate system 3 of the arm holding mechanism 232, respectively. After the doctor wears the video glasses to turn on the synchronization, the coordinate system 1 also moves as the doctor's head swings. The attitude sensor 240 on the video glasses is capable of measuring the angle at which the three axes of the XYZ of the video glasses coordinate system 1 are respectively deflected with respect to the three axes of the XYZ of the initial coordinate system of the video glasses. Since the XYZ axes in the initial coordinate system 1 are respectively the same as the XYZ axis directions of the coordinate system 3 of the mirror arm fixing mechanism 232, the deflection angle is also the XYZ axis of the current coordinate system 1 of the video glasses with respect to the mirror arm fixing mechanism 232. The angle of the XYZ axis of the coordinate system 3 is deflected. On the other hand, since the joint sensors are mounted on the respective joints of the mirror arm 231, the laparoscope 220 is provided with an angle sensor, and the angle sensors of the joint sensors and the laparoscope 220 have been calibrated at the time of assembly, so that the laparoscope can be made. 220 front end The coordinate system 2 coincides with the coordinate system 3 of the holding arm fixing mechanism 232, or determines the mapping relationship between the coordinate system 2 of the front end portion of the laparoscope 220 and the coordinate system 3 of the holding arm fixing mechanism 232, so any time after the power is turned on The positional relationship between the coordinate system 3 of the holding arm fixing mechanism 232 and the coordinate system 2 of the front end portion of the laparoscope 220 can be obtained. Therefore, the postures of the laparoscope 220 and the display 210 can be made to correspond to the coordinate system 3 of the arm holding mechanism 232.
持镜臂231可固连在病床上,即病床作为持镜臂固定机构232。或者另外设置与持镜臂231匹配的持镜臂固定机构232,这一持镜臂固定机构232能够固定在病床附近。在本发明中,持镜臂231为具有至少五个自由度的不动点机构,以使与其末端关节连接的腹腔镜220可以围绕着不动点(即戳卡)位置运动。持镜臂231通过设置多个活动关节来实现多个自由度。持镜臂231的各关节设有关节传感器,用以测量关节角度。这样,腹腔镜220只需有一个自由度,即轴向转动。腹腔镜220设有角度传感器,用于测量腹腔镜的自转角度。调整机构260包括第一组调整机构,第一组调整机构包括第一伺服电机,持镜臂231的每个关节上设有至少一个第一伺服电机,各关节能够通过第一伺服电机主动运动。腹腔镜220固连在持镜臂231的末端,并随着持镜臂231一起运动。姿态调整机构还包括第二组调整机构,第二组调整机构包括至少一个第二伺服电机,第二伺服电机与腹腔镜220连接,以控制腹腔镜220的自转。由此,腹腔镜220末端220a具有两个方向的摆动能力,以及自转功能,能够在关节转角空间内转向任意需要的方向,满足医生对于病灶的观察需要。控制单元270根据腹腔镜220的期望状态信息、当前状态信息,根据逆运动学方程,计算得到调整机构260中各第一伺服电机、第二伺服电机的调整量,实现腹腔镜与显示器的姿态相一致。The mirror arm 231 can be attached to the hospital bed, that is, the bed is used as the mirror arm fixing mechanism 232. Alternatively, a mirror arm fixing mechanism 232 that is matched with the mirror arm 231 can be additionally provided. This mirror arm fixing mechanism 232 can be fixed in the vicinity of the hospital bed. In the present invention, the mirror arm 231 is a fixed point mechanism having at least five degrees of freedom such that the laparoscope 220 articulated with its end can be moved about a fixed point (i.e., stamped) position. The mirror arm 231 achieves a plurality of degrees of freedom by providing a plurality of movable joints. Joints of the arms 231 are provided with joint sensors for measuring the joint angle. Thus, the laparoscope 220 only needs to have one degree of freedom, that is, axial rotation. The laparoscope 220 is provided with an angle sensor for measuring the angle of rotation of the laparoscope. The adjustment mechanism 260 includes a first set of adjustment mechanisms. The first set of adjustment mechanisms includes a first servo motor. Each of the joints of the mirror arms 231 is provided with at least one first servo motor, and each joint can be actively moved by the first servo motor. The laparoscope 220 is attached to the end of the mirror arm 231 and moves with the mirror arm 231. The attitude adjustment mechanism further includes a second set of adjustment mechanisms, the second set of adjustment mechanisms including at least one second servo motor coupled to the laparoscope 220 to control the rotation of the laparoscope 220. Thereby, the end of the laparoscopic 220 220a has the ability to swing in two directions, and the rotation function, which can be turned to any desired direction in the joint corner space, and meets the doctor's need for observation of the lesion. The control unit 270 calculates the adjustment amount of each of the first servo motor and the second servo motor in the adjustment mechanism 260 according to the expected state information of the laparoscope 220 and the current state information, according to the inverse kinematics equation, and realizes the posture of the laparoscope and the display. Consistent.
本实施例中使用的腹腔镜220是0度镜,下面将例举其它的腹腔镜。The laparoscope 220 used in this embodiment is a 0 degree mirror, and other laparoscopes will be exemplified below.
第二实施例Second embodiment
图3是本发明的第二实施例的腹腔镜手术系统的示意图。参考图3所示,本实施例的腹腔镜手术系统包括控制单元370,医生端的显示器310和姿态传感器340,患者端的腹腔镜320、腹腔镜固定机构332、持镜臂331以及调整机构360,持镜臂331与腹腔镜320相连。与第一实施例相比,本实施例中使用的腹 腔镜320是30度镜。姿态传感器340设于显示器310上用于获取显示器310的第一姿态信息。腹腔镜320的第二位姿信息(即当前状态信息)可以根据持镜臂331设有的关节传感器获得的关节转动角度以及腹腔镜220设有的角度传感器获得的腹腔镜转动角度,通过运动学方程计算获得。调整机构360包括第一组调整机构和第二组调整机构,第一组调整机构与持镜臂331连接,调节持镜臂331上各个关节转动角度,第二组调整机构与腹腔镜320连接,调节腹腔镜320的自转角度。控制单元370连接第一姿态传感器340、持镜臂331各关节上的传感器、腹腔镜220的角度传感器和调整机构360。3 is a schematic view of a laparoscopic surgical system of a second embodiment of the present invention. Referring to FIG. 3, the laparoscopic surgical system of the present embodiment includes a control unit 370, a doctor-side display 310 and an attitude sensor 340, a patient-side laparoscopic 320, a laparoscopic fixation mechanism 332, a mirror arm 331, and an adjustment mechanism 360. The mirror arm 331 is coupled to the laparoscope 320. Compared with the first embodiment, the belly used in this embodiment The cavity mirror 320 is a 30 degree mirror. The attitude sensor 340 is disposed on the display 310 for acquiring the first posture information of the display 310. The second pose information of the laparoscope 320 (ie, the current state information) may be obtained from the joint rotation angle obtained by the joint sensor provided by the mirror arm 331 and the angle of rotation of the laparoscope obtained by the angle sensor provided by the laparoscope 220, through kinematics. The equation is calculated. The adjustment mechanism 360 includes a first group of adjustment mechanisms and a second group of adjustment mechanisms. The first group of adjustment mechanisms are coupled to the mirror arms 331 to adjust the angle of rotation of the joints on the mirror arms 331. The second group of adjustment mechanisms are coupled to the laparoscope 320. The angle of rotation of the laparoscope 320 is adjusted. The control unit 370 connects the first attitude sensor 340, the sensor on each joint of the mirror arm 331, the angle sensor of the laparoscope 220, and the adjustment mechanism 360.
本实施例中,腹腔镜320的期望状态信息包括期望姿态信息和期望位置信息。其中期望姿态信息是根据显示器310的第一姿态信息获得。即,腹腔镜320的期望姿态为显示器310的第一姿态,腹腔镜320的期望状态信息中的期望位置信息根据预设的不动点坐标(戳卡在持镜臂固定机构332的坐标系下的位置),进入体内的腹腔镜长度等约束条件获得。控制单元370根据腹腔镜320的期望状态信息,持镜臂331各关节上的传感器、腹腔镜220的角度传感器获取的腹腔镜320的第二位姿信息(即当前位姿信息),通过逆运动学方程得到调整机构360需要的调整量,并控制调整机构360使腹腔镜的姿态与显示器310的姿态相一致。这一设计的结果是,医生视线方向与实际病灶方向基本一致。应知道,本发明获得期望位置信息的约束条件不限于本实施例的描述,本领域技术人员可以根据医生实际的操作要求来制定相应的约束条件以获得腹腔镜期望位姿信息。In the present embodiment, the desired state information of the laparoscope 320 includes desired posture information and desired position information. The desired posture information is obtained based on the first posture information of the display 310. That is, the desired posture of the laparoscope 320 is the first posture of the display 310, and the desired position information in the desired state information of the laparoscope 320 is based on the preset fixed point coordinates (the stamp is stuck in the coordinate system of the holding arm fixing mechanism 332). The position), obtained into the body of the laparoscopic length and other constraints obtained. The control unit 370 according to the desired state information of the laparoscope 320, the second pose information (ie, the current pose information) of the laparoscope 320 acquired by the sensor on each joint of the mirror arm 331 and the angle sensor of the laparoscope 220, through the inverse motion The equations are adjusted to obtain the amount of adjustment required by the adjustment mechanism 360, and the adjustment mechanism 360 is controlled to conform the posture of the laparoscope to the posture of the display 310. The result of this design is that the direction of the doctor's line of sight is basically the same as the actual direction of the lesion. It should be understood that the constraint condition for obtaining the desired position information of the present invention is not limited to the description of the embodiment, and those skilled in the art can formulate corresponding constraints according to the actual operation requirements of the doctor to obtain the laparoscopic desired posture information.
图6是本发明实施例中医生视线方向与实际病灶方向的比较示意图,在图6的理想情况下,医生视线方向与实际病灶方向一致。在实际实施时,可容许腹腔镜320的姿态与显示器310的姿态之间的差异在一个范围内,使得医生在操作时始终能够保持显示器310的姿态与腹腔镜320的姿态相对应。图7是本发明实施例中医生视线方向与实际病灶方向之间存在角度为θ的偏差的示意图。通常来说,图示的角度θ应当在20度以内,所述的20度以内的角度偏差为显示器坐标系的XYZ轴与腹腔镜末端坐标系XYZ轴每个轴的偏差角度。一般按照XYZ顺序定义为回转角、俯仰角和偏转角,如无特殊说明,下面提到的偏差 均为上述角度的偏差。下面简单描述三个角的求解方法。RM为腹腔镜末端坐标系在显示器坐标系下的描述,那么所述的三个偏差角度分别为绕显示器坐标系X轴的旋转RX(γ)即与显示器坐标系X轴的差值,绕显示器坐标系Y轴的旋转RY(β)即与显示器坐标系Y轴的差值,绕显示器坐标系Z轴的旋转RZ(α)即与显示器坐标系Z轴的差值。6 is a schematic view showing the comparison between the line of sight direction of the doctor and the direction of the actual lesion in the embodiment of the present invention. In the ideal case of FIG. 6, the line of sight of the doctor is consistent with the direction of the actual lesion. In actual implementation, the difference between the posture of the laparoscope 320 and the posture of the display 310 can be allowed to be within a range such that the doctor can always maintain the posture of the display 310 corresponding to the posture of the laparoscope 320 during operation. Fig. 7 is a schematic view showing the deviation of the angle between the doctor's line of sight and the actual lesion in the embodiment of the present invention. In general, the illustrated angle θ should be within 20 degrees, and the angular deviation within 20 degrees is the deviation angle of the XYZ axis of the display coordinate system from each axis of the laparoscopic end coordinate system XYZ axis. Generally, the yaw angle, the pitch angle, and the yaw angle are defined in the XYZ order. Unless otherwise specified, the deviations mentioned below are the deviations of the above angles. The method of solving the three angles is briefly described below. R M is a description of the laparoscopic end coordinate system in the display coordinate system, then the three deviation angles are respectively the rotation R X (γ) around the X coordinate of the display coordinate system, that is, the difference from the X coordinate of the display coordinate system. The rotation R Y (β) around the Y coordinate of the display coordinate system, that is, the difference from the Y coordinate of the display coordinate system, the rotation R Z (α) around the Z coordinate of the display coordinate system, that is, the difference from the Z coordinate of the display coordinate system.
Figure PCTCN2017091012-appb-000001
Figure PCTCN2017091012-appb-000001
那么根据RM可以得到三个偏差角度的求解:Then we can get three deviation angle solutions according to R M :
Figure PCTCN2017091012-appb-000002
Figure PCTCN2017091012-appb-000002
α=Atan2(r21/cβ,r11/cβ)α=Atan2(r 21 /cβ,r 11 /cβ)
γ=Atan2(r32/cβ,r33/cβ)γ=Atan2(r 32 /cβ, r 33 /cβ)
cβ=cosβCβ=cosβ
继续参考图3所示,持镜臂331设在持镜臂固定机构332上。在本实施例中,设定显示器310的坐标系为坐标系1,持镜臂固定机构332的坐标系为坐标系3,腹腔镜320末端(即置有镜头的一端)的坐标系为坐标系2。显示器310的坐标系1、持镜臂固定机构332的坐标系3、腹腔镜320末端的坐标系2为右手坐标系。在本实施例中所述“腹腔镜与显示器的姿态相对应”,同样应认为腹腔镜的姿态与显示器的姿态角度偏差小于某个角度,一般为20度。With continued reference to FIG. 3, the mirror arm 331 is disposed on the mirror arm securing mechanism 332. In this embodiment, the coordinate system of the display display 310 is the coordinate system 1, the coordinate system of the mirror arm fixing mechanism 332 is the coordinate system 3, and the coordinate system of the end of the laparoscope 320 (ie, the end with the lens) is the coordinate system. 2. The coordinate system 1 of the display 310, the coordinate system 3 of the mirror arm fixing mechanism 332, and the coordinate system 2 at the end of the laparoscope 320 are right-handed coordinate systems. In the embodiment, the "laparoscopic corresponding to the posture of the display" should also be considered that the attitude of the laparoscope and the posture angle of the display are less than a certain angle, generally 20 degrees.
本实施例中的显示器310例如为视频眼镜。腹腔镜320例如是电子腹腔镜。本发明对腹腔镜320没有特别的限制,可以是双镜头的3D电子腹腔镜也可以是2D腹腔镜。在本实施例中所述腹腔镜320为30°内窥镜。设定视频眼镜初始的坐标系1中的XYZ轴分别与持镜臂固定机构332的坐标系3的XYZ轴方向相同。医生头戴视频眼镜开启同步后,随着医生头部的摆动,坐标系1也发生运动。在视频眼镜上的姿态传感器340能够实时地测量出视频眼镜坐标系1的XYZ三个轴分别相对于视频眼镜初始坐标系的XYZ三个轴偏转的角度。由于初始的坐标系1中的XYZ轴分别与持镜臂固定机构332的坐标系3的XYZ轴方向相同,因此偏转角度也就是视频眼镜当前坐标系1的XYZ轴相对于持镜臂固定机构332的坐标系3的XYZ轴偏转的角度。另一方面,由于持镜臂331各个运动 关节均安装关节传感器,腹腔镜320设有角度传感器,而且这些关节传感器、腹腔镜的角度传感器在装配时已经对零位进行校准,可以使腹腔镜320前端部坐标系2与持镜臂固定机构332坐标系3相一致,或者确定腹腔镜320前端部坐标系2与持镜臂固定机构332坐标系3之间存在的映射关系,所以在开机后任何时刻均可得到持镜臂固定机构332的坐标系3和腹腔镜320末端的坐标系2之间的位姿关系。因此,可以使得腹腔镜320和显示器310的姿态在持镜臂固定机构332的坐标系3下相对应。The display 310 in this embodiment is, for example, video glasses. Laparoscope 320 is, for example, an electronic laparoscope. The present invention is not particularly limited to the laparoscope 320, and may be a two-lens 3D electronic laparoscope or a 2D laparoscope. In the present embodiment, the laparoscope 320 is a 30° endoscope. The XYZ axes in the initial coordinate system 1 for setting the video glasses are the same as the XYZ axis directions of the coordinate system 3 of the arm holding mechanism 332, respectively. After the doctor wears the video glasses to turn on the synchronization, the coordinate system 1 also moves as the doctor's head swings. The attitude sensor 340 on the video glasses can measure the angle at which the three axes of the XYZ of the video glasses coordinate system 1 are respectively deflected with respect to the three axes of the XYZ of the initial coordinate system of the video glasses. Since the XYZ axes in the initial coordinate system 1 are respectively the same as the XYZ axis directions of the coordinate system 3 of the mirror arm fixing mechanism 332, the deflection angle is also the XYZ axis of the current coordinate system 1 of the video glasses with respect to the mirror arm fixing mechanism 332. The angle of the XYZ axis of the coordinate system 3 is deflected. On the other hand, due to the movement of the mirror arm 331 The joints are equipped with joint sensors, the laparoscope 320 is provided with an angle sensor, and the angle sensors of the joint sensors and the laparoscope have been calibrated at the time of assembly, and the front end coordinate system 2 and the mirror arm fixing mechanism of the laparoscope 320 can be made. The coordinate system 3 of the 332 is coincident, or the mapping relationship between the coordinate system 2 of the front end portion of the laparoscopic 320 and the coordinate system 3 of the holding arm fixing mechanism 332 is determined, so that the mirror arm fixing mechanism 332 can be obtained at any time after the power is turned on. The pose relationship between the coordinate system 3 and the coordinate system 2 at the end of the laparoscope 320. Therefore, the posture of the laparoscope 320 and the display 310 can be made to correspond to the coordinate system 3 of the arm holding mechanism 332.
持镜臂331可固连在病床上,即病床作为持镜臂固定机构332。或者另外设置与持镜臂331匹配的持镜臂固定机构332,这一持镜臂固定机构332能够固定在病床附近。在本发明中,持镜臂331为至少五个自由度的不动点机构,以使与其末端关节连接的腹腔镜320可以围绕着不动点(即戳卡)位置运动。持镜臂331的各关节设有关节传感器,用以测量关节角度。腹腔镜320设有角度传感器,用于测量腹腔镜320的自转角度。调整机构360包括第一组调整机构,第一组调整机构包括第一伺服电机,持镜臂331的每个关节上设有至少一个第一伺服电机,各关节能够通过第一伺服电机主动运动。腹腔镜320固连在持镜臂331的末端,并随着持镜臂331一起运动。调整机构360还包括第二组调整机构,第二组调整机构包括至少一个第二伺服电机,第二伺服电机与腹腔镜320连接,以控制腹腔镜320的自转。由此,腹腔镜320末端320a具有两个方向的摆动能力,以及自转功能,能够在关节转角空间内转向任意需要的方向,满足医生对于病灶的观察需要。控制单元370根据上述腹腔镜的期望状态信息、当前状态信息,根据逆运动学方程,计算得到调整机构360中各第一伺服电机、第二伺服电机的调整量,实现腹腔镜320与显示器310的姿态相一致。The mirror arm 331 can be attached to the hospital bed, that is, the bed is used as the mirror arm fixing mechanism 332. Alternatively, a mirror arm fixing mechanism 332 that is matched with the mirror arm 331 can be additionally provided, and the mirror arm fixing mechanism 332 can be fixed in the vicinity of the hospital bed. In the present invention, the mirror arm 331 is a fixed point mechanism of at least five degrees of freedom such that the laparoscope 320 articulated at its end can move around the fixed point (i.e., stamp) position. Joints of the arms 331 are provided with joint sensors for measuring the joint angle. The laparoscope 320 is provided with an angle sensor for measuring the angle of rotation of the laparoscope 320. The adjustment mechanism 360 includes a first set of adjustment mechanisms. The first set of adjustment mechanisms includes a first servo motor. Each of the joints of the mirror arms 331 is provided with at least one first servo motor, and each joint can be actively moved by the first servo motor. The laparoscope 320 is attached to the end of the mirror arm 331 and moves with the mirror arm 331. The adjustment mechanism 360 further includes a second set of adjustment mechanisms including at least one second servo motor coupled to the laparoscope 320 to control the rotation of the laparoscope 320. Thus, the end of the laparoscopic 320 320a has the ability to oscillate in two directions, and the autorotation function, which can be turned to any desired direction within the joint corner space to meet the doctor's need for observation of the lesion. The control unit 370 calculates the adjustment amount of each of the first servo motor and the second servo motor in the adjustment mechanism 360 according to the expected state information and current state information of the laparoscope, and realizes the adjustment of the laparoscope 320 and the display 310 according to the inverse kinematics equation. The posture is consistent.
图4是本发明的第二实施例的腹腔镜手术系统的变化例示意图。参考图4所示,与图3所示的实施例相比,本实施例中持镜臂361夹持腹腔镜320种类不同。与0度腹腔镜相比,本实施例选用30度镜可以令持镜臂有更多种角度选择使得腹腔镜方向与医生视线方向重合。与第一实施例0度镜相比,本实施例中由于采用30度镜,因此在求解运动学方程、逆运动学方程以及腹腔镜320的期望位置信息时需要考虑内窥镜末端角度这个因素。同时,本实施例中腹腔镜 320的当前状态信息、期望状态信息(包括期望姿态信息、期望位置信息)均是指腹腔镜320末端的当前状态信息、期望状态信息。Fig. 4 is a schematic view showing a modification of the laparoscopic surgical system of the second embodiment of the present invention. Referring to FIG. 4, in comparison with the embodiment shown in FIG. 3, the holding mirror arm 361 is different in type of the laparoscope 320 in this embodiment. Compared with the 0 degree laparoscope, the 30 degree mirror can be used in this embodiment to make the mirror arm have more angles to make the laparoscope direction coincide with the doctor's line of sight. Compared with the first embodiment 0-degree mirror, in this embodiment, since the 30-degree mirror is used, it is necessary to consider the endoscope end angle factor in solving the kinematic equation, the inverse kinematics equation, and the desired position information of the laparoscope 320. . Meanwhile, the laparoscope in this embodiment The current state information, the desired state information (including the desired posture information, and the desired position information) of 320 all refer to current state information and desired state information at the end of the laparoscope 320.
在图未示的例子中,腹腔镜还可以选用75度镜或者其它角度的镜头。In the example not shown, the laparoscopic lens can also be selected from a 75 degree mirror or other angle.
第三实施例Third embodiment
图5是本发明的第三实施例的腹腔镜手术系统的示意图。参考图5所示,本实施例的腹腔镜手术系统400包括控制单元470,医生端的显示器410和姿态传感器440,患者端的腹腔镜420、持镜臂固定机构432、持镜臂431以及调整机构460,持镜臂431与腹腔镜420相连。与第一实施例相比,本实施例中使用的腹腔镜420是蛇形腹腔镜。相对于0度镜等腹腔镜,蛇形腹腔镜的末端(即靠近镜头的一端)增加两个自由度,可以实现自转的同时还可以实现两个方向的摆动。相应的,在系统中设有至少三个角度传感器,用于测量蛇形腹腔镜在腹腔镜的坐标系XYZ轴方向的角度。姿态传感器440设于显示器410上用于获取显示器410的第一姿态信息。调整机构460包括第二组调整机构,第二组调整机构与腹腔镜420连接,以调整腹腔镜420末端的姿态。控制单元470连接姿态传感器440、腹腔镜的角度传感器和调整机构460。Figure 5 is a schematic illustration of a laparoscopic surgical system in accordance with a third embodiment of the present invention. Referring to FIG. 5, the laparoscopic surgical system 400 of the present embodiment includes a control unit 470, a doctor-side display 410 and an attitude sensor 440, a patient-side laparoscope 420, a mirror arm fixing mechanism 432, a mirror arm 431, and an adjustment mechanism 460. The mirror arm 431 is connected to the laparoscope 420. The laparoscope 420 used in the present embodiment is a serpentine laparoscope as compared with the first embodiment. Compared with a laparoscope such as a 0 degree mirror, the end of the serpentine laparoscope (ie, the end near the lens) adds two degrees of freedom, which can achieve rotation while achieving swing in both directions. Correspondingly, at least three angle sensors are provided in the system for measuring the angle of the serpentine laparoscope in the XYZ axis direction of the laparoscope coordinate system. The attitude sensor 440 is disposed on the display 410 for acquiring the first posture information of the display 410. The adjustment mechanism 460 includes a second set of adjustment mechanisms that are coupled to the laparoscope 420 to adjust the attitude of the end of the laparoscope 420. The control unit 470 connects the attitude sensor 440, the angle sensor of the laparoscope, and the adjustment mechanism 460.
本实施例中,与第一实施例类似,腹腔镜420的期望姿态信息是根据显示器410的第一姿态信息获得。即,腹腔镜420的期望姿态即为显示器410的第一姿态。腹腔镜420的第二姿态信息(即当前姿态信息)根据持镜臂431设有的关节传感器获得关节转动角度以及腹腔镜420设有的角度传感器,通过运动学方程计算获得。与第一实施例区别的是,由于蛇形腹腔镜末端具有三个自由度,不需要与持镜臂431耦合即可实现两个方向的摆动能力与自转功能。因此,在本实施例中,当前状态信息可不包括腹腔镜220的当前位置信息,期望状态信息可不包括腹腔镜220的期望位置信息。控制单元470根据腹腔镜220的期望姿态信息,从持镜臂431各关节上的传感器、腹腔镜420的角度传感器获取的腹腔镜420的第二姿态信息(即当前状态信息),根据逆运动学方程,得到调整机构460需要的调整量,并控制姿态调整机构460使腹腔镜的姿态与显示器410的姿态相一致。这一设计的结果是,医生视线方向与实际病灶方向基本一致。In the present embodiment, similar to the first embodiment, the desired posture information of the laparoscope 420 is obtained based on the first posture information of the display 410. That is, the desired posture of the laparoscope 420 is the first posture of the display 410. The second posture information of the laparoscope 420 (i.e., the current posture information) is obtained by the kinematic equation calculation based on the joint sensor provided by the mirror arm 431 to obtain the joint rotation angle and the angle sensor provided by the laparoscope 420. Different from the first embodiment, since the serpentine laparoscopic end has three degrees of freedom, the swinging ability and the rotation function in two directions can be realized without coupling with the mirror arm 431. Therefore, in the present embodiment, the current state information may not include the current position information of the laparoscope 220, and the desired state information may not include the desired position information of the laparoscope 220. The control unit 470 obtains the second posture information (ie, current state information) of the laparoscope 420 obtained from the sensor on each joint of the mirror arm 431 and the angle sensor of the laparoscope 420 according to the desired posture information of the laparoscope 220, according to inverse kinematics. The equation obtains the amount of adjustment required by the adjustment mechanism 460 and controls the attitude adjustment mechanism 460 to conform the posture of the laparoscope to the posture of the display 410. The result of this design is that the direction of the doctor's line of sight is basically the same as the actual direction of the lesion.
图6是本发明实施例中医生视线方向与实际病灶方向的比较示意图,在图6 的理想情况下,医生视线方向与实际病灶方向一致。在实际实施时,可容许腹腔镜420的姿态与显示器410的姿态之间的差异在一个范围内,使得医生在操作时始终能够保持显示器310的姿态与腹腔镜320的姿态相对应。图7是本发明实施例中医生视线方向与实际病灶方向之间存在角度为θ的偏差的示意图。通常来说,图示的角度θ应当在20度以内,所述的20度以内的角度偏差为显示器坐标系的XYZ轴与腹腔镜末端坐标系XYZ轴每个轴的偏差角度。因此,在本实施例中“所述腹腔镜与显示器的姿态相对应”,应认为腹腔镜的姿态与显示器的姿态角度偏差小于某个角度,一般为20度。Figure 6 is a schematic view showing the comparison between the direction of the line of sight of the doctor and the direction of the actual lesion in the embodiment of the present invention, in Figure 6 Ideally, the direction of the doctor's line of sight is consistent with the actual direction of the lesion. In actual implementation, the difference between the posture of the laparoscope 420 and the posture of the display 410 can be allowed to be within a range such that the doctor can always maintain the posture of the display 310 corresponding to the posture of the laparoscope 320 during operation. Fig. 7 is a schematic view showing the deviation of the angle between the doctor's line of sight and the actual lesion in the embodiment of the present invention. In general, the illustrated angle θ should be within 20 degrees, and the angular deviation within 20 degrees is the deviation angle of the XYZ axis of the display coordinate system from each axis of the laparoscopic end coordinate system XYZ axis. Therefore, in the present embodiment, "the laparoscope corresponds to the posture of the display", it should be considered that the attitude of the laparoscope and the posture angle of the display are less than a certain angle, generally 20 degrees.
继续参考图5所示,持镜臂431设在持镜臂固定机构432上。在本实施例中,设定显示器410的坐标系为坐标系1,持镜臂固定机构432的坐标系为坐标系3,腹腔镜420前端(即置有镜头的一端)的坐标系为坐标系2。显示器410的坐标系1、持镜臂固定机构432的坐标系3、腹腔镜420末端的坐标系2为右手坐标系。With continued reference to FIG. 5, the mirror arm 431 is disposed on the mirror arm fixing mechanism 432. In this embodiment, the coordinate system of the display display 410 is the coordinate system 1, the coordinate system of the mirror arm fixing mechanism 432 is the coordinate system 3, and the coordinate system of the front end of the laparoscopic mirror 420 (ie, the end at which the lens is placed) is the coordinate system. 2. The coordinate system 1 of the display 410, the coordinate system 3 of the mirror arm fixing mechanism 432, and the coordinate system 2 at the end of the laparoscope 420 are right-handed coordinate systems.
本实施例中的显示器410例如为视频眼镜。腹腔镜220例如是电子腹腔镜。本发明对腹腔镜220没有特别的限制,可以是双镜头的3D电子腹腔镜也可以是2D腹腔镜。本实施例中,腹腔镜420为蛇形腹腔镜。设定视频眼镜初始的坐标系1中的XYZ轴分别与持镜臂固定机构432的坐标系3的XYZ轴方向相同。医生头戴视频眼镜开启同步后,随着医生头部的摆动,坐标系1也发生运动。在视频眼镜上的第一姿态传感器440能够实时地测量出视频眼镜坐标系1的XYZ三个轴分别相对于视频眼镜初始坐标系的XYZ三个轴偏转的角度。由于初始的坐标系1中的XYZ轴分别与持镜臂固定机构432的坐标系3的XYZ轴方向相同,因此偏转角度也就是视频眼镜当前坐标系1的XYZ轴相对于持镜臂固定机构432的坐标系3的XYZ轴偏转的角度。另一方面,由于持镜臂431各个运动关节均安装关节传感器,腹腔镜420设有角度传感器,而且这些关节传感器、腹腔镜420的角度传感器在装配时已经对零位进行校准,可以使腹腔镜420前端部坐标系2与持镜臂固定机构432坐标系3相一致,或者确定腹腔镜420前端部坐标系2与持镜臂固定机构432坐标系3之间的映射关系,所以在开机后任何时刻均可得到持镜臂固定机构432坐标系3和腹腔镜420前端部坐标系2 之间的姿态关系。因此,可以使得腹腔镜320和显示器310的姿态在持镜臂固定机构332的坐标系3下相对应。The display 410 in this embodiment is, for example, video glasses. Laparoscope 220 is, for example, an electronic laparoscope. The present invention is not particularly limited to the laparoscope 220, and may be a two-lens 3D electronic laparoscope or a 2D laparoscope. In this embodiment, the laparoscope 420 is a serpentine laparoscope. The XYZ axes in the initial coordinate system 1 for setting the video glasses are the same as the XYZ axis directions of the coordinate system 3 of the arm holding mechanism 432, respectively. After the doctor wears the video glasses to turn on the synchronization, the coordinate system 1 also moves as the doctor's head swings. The first attitude sensor 440 on the video glasses is capable of measuring the angle at which the three axes of the XYZ of the video glasses coordinate system 1 are respectively deflected relative to the three axes of the XYZ of the initial coordinate system of the video glasses. Since the XYZ axes in the initial coordinate system 1 are respectively the same as the XYZ axis directions of the coordinate system 3 of the mirror arm fixing mechanism 432, the deflection angle is also the XYZ axis of the current coordinate system 1 of the video glasses with respect to the mirror arm fixing mechanism 432. The angle of the XYZ axis of the coordinate system 3 is deflected. On the other hand, since the joints of the arms 431 are equipped with joint sensors, the laparoscope 420 is provided with an angle sensor, and the angle sensors of the joint sensors and the laparoscope 420 have been calibrated at the time of assembly, so that the laparoscope can be made. The front end coordinate system 2 of the 420 coincides with the coordinate system 3 of the holding arm fixing mechanism 432, or the mapping relationship between the coordinate system 2 of the front end portion of the laparoscope 420 and the coordinate system 3 of the holding arm fixing mechanism 432 is determined, so any after the power on The coordinate system 3 of the holding arm fixing mechanism 432 and the coordinate system of the front end of the laparoscope 420 can be obtained at all times. The relationship between the gestures. Therefore, the posture of the laparoscope 320 and the display 310 can be made to correspond to the coordinate system 3 of the arm holding mechanism 332.
持镜臂431可固连在病床上,即病床作为持镜臂固定机构432。或者另外设置与持镜臂431匹配的持镜臂固定机构432,这一持镜臂固定机构432能够固定在病床附近。在本发明中,持镜臂431为不动点机构,以使与其末端关节连接的腹腔镜420可以围绕着不动点(即戳卡)位置运动。持镜臂431的各关节设有关节传感器,用以测量关节角度。腹腔镜420设有至少三个角度传感器,用于测量腹腔镜的摆动和自传角度,进而获取蛇形腹腔镜420的第二姿态信息。调整机构460还包括第二组调整机构,第二组调整机构包括至少三个第二伺服电机,第二伺服电机与蛇形腹腔镜420连接,以控制蛇形腹腔镜420的姿态。具体而言,第二组调整机构中至少两个第二伺服电机用于调整蛇形腹腔镜420的摆动,至少一个第二伺服电机用于调整蛇形腹腔镜420的自转。由此,腹腔镜420末端420a具有两个方向的摆动能力,以及自转功能,能够在关节转角空间内转向任意需要的方向,满足医生对于病灶的观察需要。所述该控制单元470根据腹腔镜420的当前位姿信息、期望姿态信息,计算得到调整机构中各第二伺服电机的调整量,实现腹腔镜与显示器的姿态相一致。The mirror arm 431 can be attached to the hospital bed, that is, the bed is used as the mirror arm fixing mechanism 432. Alternatively, a mirror arm fixing mechanism 432 matching the mirror arm 431 can be additionally provided, and the mirror arm fixing mechanism 432 can be fixed in the vicinity of the hospital bed. In the present invention, the holding arm 431 is a fixed point mechanism such that the laparoscope 420 articulated with its distal end can move around the fixed point (i.e., the stamped card) position. Joints of the arms 431 are provided with joint sensors for measuring the joint angle. The laparoscope 420 is provided with at least three angle sensors for measuring the swinging and autoradiation angle of the laparoscope to obtain the second posture information of the serpentine laparoscope 420. The adjustment mechanism 460 also includes a second set of adjustment mechanisms including at least three second servo motors coupled to the serpentine laparoscope 420 to control the attitude of the serpentine laparoscope 420. Specifically, at least two of the second set of adjustment mechanisms are used to adjust the swing of the serpentine laparoscope 420, and at least one second servo motor is used to adjust the rotation of the serpentine laparoscope 420. Thus, the end of the laparoscopic mirror 420a has the ability to oscillate in two directions, as well as the autorotation function, which can be turned to any desired direction within the joint corner space to meet the doctor's need for observation of the lesion. The control unit 470 calculates the adjustment amount of each second servo motor in the adjustment mechanism according to the current posture information and the desired posture information of the laparoscope 420, so as to achieve the posture of the laparoscope and the display.
如果在控制腹腔镜期望姿态的同时,也需要控制腹腔镜的期望位置,那么与上述实施例类似,所述调整机构还需要包括第一组调整机构,该第一组调整机构包括第一伺服电机,该持镜臂的每个关节上至少设有一个该第一伺服电机,用以调节该关节的转动角度;该持镜臂具有至少三个自由度,且该持镜臂的各关节上设有关节传感器,以测量各关节的转动角度;该控制单元需要先获取腹腔镜当前的位置信息,通过约束条件获得腹腔镜的期望位置信息,进一步通过运动学方程逆解,获取调整机构的调整量,控制调整机构调整,使该腹腔镜达到期望的位姿。If it is necessary to control the desired position of the laparoscope while controlling the desired posture of the laparoscope, similarly to the above embodiment, the adjustment mechanism further needs to include a first set of adjustment mechanisms including the first servo motor. At least one first servo motor is disposed on each joint of the mirror arm for adjusting a rotation angle of the joint; the mirror arm has at least three degrees of freedom, and each joint of the mirror arm is provided The section sensor is used to measure the rotation angle of each joint; the control unit needs to obtain the current position information of the laparoscope, obtain the desired position information of the laparoscope through the constraint condition, and further obtain the adjustment amount of the adjustment mechanism by inversely solving the kinematic equation. The control adjustment mechanism is adjusted to achieve the desired posture of the laparoscope.
下面以图2所示的第一实施例描述本发明的示例性使用过程。An exemplary use process of the present invention is described below with reference to the first embodiment shown in FIG. 2.
首先固定持镜臂固定机构232的位置,确定持镜臂固定机构232的坐标系3。然后将视频眼镜210与持镜臂固定机构232按照预定的位置固定在一起,即视为初始化的坐标系1与坐标系3的XYZ轴的方向完全一致,并初始化视频眼镜 231上的姿态传感器240。之后,当视频眼镜210运动时,视频眼镜210的姿态传感器240测量,得到当前坐标系1的各坐标轴与初始坐标系1的映射关系。该映射关系也就是与持镜臂固定机构232座标系3的映射关系。First, the position of the arm holding mechanism 232 is fixed, and the coordinate system 3 of the arm holding mechanism 232 is determined. Then, the video glasses 210 and the mirror arm fixing mechanism 232 are fixed together according to a predetermined position, that is, the coordinate system 1 regarded as being initialized is completely coincident with the direction of the XYZ axis of the coordinate system 3, and the video glasses are initialized. The attitude sensor 240 on 231. Thereafter, when the video glasses 210 are moved, the attitude sensor 240 of the video glasses 210 measures, and obtains a mapping relationship between the coordinate axes of the current coordinate system 1 and the initial coordinate system 1. This mapping relationship is also a mapping relationship with the coordinate system 3 of the holder arm fixing mechanism 232.
然后确定戳卡的位置,并标定戳卡在持镜臂固定机构232座标系3下的坐标值。将腹腔镜220通过戳卡插入人体内部,并确定腹腔镜220在体内的长度。医生取下完成初始化的视频眼镜210并戴在头上,站立在操作腹腔镜器械较为舒适的位置,开启视频眼镜210与腹腔镜220的映射开关,控制单元270接收到根据姿态传感器230测量得到的第一姿态信息、各个关节传感器、腹腔镜220的角度传感器得到的第二位姿信息,计算出视频眼镜坐标系1与腹腔镜坐标系2XYZ轴的角度偏差值,计算出视频眼镜210相对于腹腔镜220的姿态变化量,如果任一轴的角度偏差值大于20度,则控制单元270进一步根据戳卡坐标值、腹腔镜220在体内的长度计算得到期望位置信息,并结合第一姿态信息(即期望姿态信息)根据逆运动学公式计算出第一组调整机构、第二组调整机构上各个伺服电机的调整量,使坐标系2的各个坐标轴方向与坐标系1的相一致。此时医生可以舒适方式的开始进行手术操作。Then, the position of the stamp card is determined, and the coordinate value of the stamped card under the coordinate system 3 of the mirror arm fixing mechanism 232 is marked. The laparoscope 220 is inserted into the interior of the body by a stamp, and the length of the laparoscope 220 in the body is determined. The doctor removes the video glasses 210 that have been initialized and wears them on the head, stands in a position where the laparoscopic instrument is operated more comfortable, opens the mapping switch of the video glasses 210 and the laparoscope 220, and the control unit 270 receives the measurement according to the attitude sensor 230. The second pose information obtained by the first posture information, the joint sensors, and the angle sensor of the laparoscope 220 calculates the angular deviation value of the video glasses coordinate system 1 and the laparoscopic coordinate system 2XYZ axis, and calculates the video glasses 210 relative to the abdominal cavity. The posture change amount of the mirror 220, if the angular deviation value of any of the axes is greater than 20 degrees, the control unit 270 further calculates the desired position information according to the stamping coordinate value and the length of the laparoscope 220 in the body, and combines the first posture information ( That is, the desired attitude information is calculated according to the inverse kinematics formula, and the adjustment amounts of the respective servo motors on the first group of adjustment mechanisms and the second group of adjustment mechanisms are made such that the respective coordinate axis directions of the coordinate system 2 coincide with the coordinate system 1. At this point, the doctor can begin the surgical operation in a comfortable manner.
同时,如果医生希望从不同方向观测病灶,那么医生只需要摆动自己的头部,或者移动自己的身体,使得自己的视线从不同的角度指向病灶位置,那么控制单元270也会根据视频眼镜210的位姿变化,计算得出视频眼镜坐标系1与腹腔镜坐标系2XYZ轴的角度偏差值,以判断腹腔镜与视频眼镜210的姿态相对应,如果任一轴的角度偏差值大于20度,则认为腹腔镜与视频眼镜210的姿态不相对应,需要重新计算该腹腔镜220的期望位置信息,通过运动学方程逆解,求出各个第一伺服电机、第二伺服电机需要转动的角度,使得腹腔镜末端坐标系2的指向始终与视频眼镜坐标系1的指向相一致。这样,在医生整个观察人体组织过程中始终能够保持视频眼镜210的姿态与腹腔镜220的姿态相对应。本功能还有利于医生方便的对病灶进行各个角度的观测。At the same time, if the doctor wants to observe the lesion from different directions, then the doctor only needs to swing his head or move his body so that his line of sight points from the different angles to the lesion position, then the control unit 270 will also be based on the video glasses 210. The posture change is calculated, and the angular deviation value of the video glasses coordinate system 1 and the laparoscopic coordinate system 2XYZ axis is calculated to determine that the laparoscope corresponds to the posture of the video glasses 210. If the angular deviation value of any of the axes is greater than 20 degrees, It is considered that the posture of the laparoscopic lens does not correspond to the posture of the video glasses 210. It is necessary to recalculate the desired position information of the laparoscope 220, and inversely solve the kinematic equation to obtain the angle at which each of the first servo motor and the second servo motor needs to be rotated, so that The orientation of the laparoscopic end coordinate system 2 is always consistent with the orientation of the video glasses coordinate system 1. In this way, the posture of the video glasses 210 can always be maintained in correspondence with the posture of the laparoscope 220 during the entire observation of the human tissue by the doctor. This function is also convenient for doctors to observe the lesions at various angles.
第三实施例的使用过程也与之类似,只是不需要事先预设置约束条件,以确定腹腔镜的期望位置信息。The procedure of use of the third embodiment is similar, except that the constraints are not pre-set to determine the desired positional information of the laparoscope.
本发明的上述实施例运用具有姿态测量功能的显示器与3D立体腹腔镜或 者2D腹腔镜相结合使用。腹腔镜被持镜臂机械连接,并根据腹腔镜当前的状态信息、以及期望状态信息以获得该调整机构需要的调整量,并控制该调整机构调整该腹腔镜的姿态,对显示器显示的图像进行转换,使得医生在操作时始终能够保持显示器坐标系与腹腔镜坐标系的方向基本吻合,组成一套具有良好性能的微创伤手术操作系统,从而医生在学习使用时具有良好的学习曲线。The above embodiment of the present invention uses a display with attitude measurement function and a 3D stereo laparoscope or 2D laparoscopy is used in combination. The laparoscopic machine is mechanically connected by the holding arm, and according to the current state information of the laparoscope and the desired state information, the adjustment amount required by the adjusting mechanism is obtained, and the adjusting mechanism is controlled to adjust the posture of the laparoscope, and the image displayed on the display is performed. The conversion enables the doctor to keep the display coordinate system and the direction of the laparoscopic coordinate system substantially consistent during operation, and constitutes a set of micro-trauma operating system with good performance, so that the doctor has a good learning curve when learning to use.
经过一定的对比试验与数量统计,得出了本发明实施例的系统优于目前普通微创伤腹腔镜系统。而与达芬奇机器人手术系统相比,本发明具有结构简单可靠,使用方便,成本低廉的特点,适合普遍推广。After a certain comparison test and quantity statistics, it is found that the system of the embodiment of the present invention is superior to the current general micro-trauma laparoscopic system. Compared with the Da Vinci robotic surgery system, the invention has the characteristics of simple and reliable structure, convenient use and low cost, and is suitable for general promotion.
本发明实施例的系统同样可以用在微创伤手术机器人上的观测系统,并能良好的缓解当前手术机器人坐姿造成医生颈椎职业病。The system of the embodiment of the invention can also be used in the observation system on the micro-trauma surgery robot, and can well alleviate the current surgical robot sitting posture to cause the doctor's cervical spine occupational disease.
虽然本发明已参照当前的具体实施例来描述,但是本技术领域中的普通技术人员应当认识到,以上的实施例仅是用来说明本发明,在没有脱离本发明精神的情况下还可作出各种等效的变化或替换,因此,只要在本发明的实质精神范围内对上述实施例的变化、变型都将落在本申请的权利要求书的范围内。 While the invention has been described with respect to the embodiments of the present invention, it will be understood by those skilled in the art Various changes and modifications may be made without departing from the spirit and scope of the invention.

Claims (11)

  1. 一种腹腔镜手术系统,包括控制单元,医生端的显示器和姿态传感器,患者端的腹腔镜、持镜臂固定机构、设置在持镜臂固定机构上的持镜臂以及调整机构,其中,该姿态传感器设于该显示器上且用于获取该显示器的姿态信息,该持镜臂与该腹腔镜连接,该调整机构与该持镜臂和/或该腹腔镜连接,该调整机构用以调整该腹腔镜的姿态,该控制单元连接该姿态传感器和该调整机构,该控制单元根据腹腔镜当前的状态信息以及期望状态信息以获得该调整机构需要的调整量,并控制该调整机构基于所述调整量来调整该腹腔镜的姿态,使该腹腔镜与该显示器的姿态相对应,其中腹腔镜当前的状态信息包括腹腔镜当前姿态信息,该腹腔镜的期望状态信息包括显示器的姿态信息。A laparoscopic surgical system includes a control unit, a doctor-side display and an attitude sensor, a patient-side laparoscopic, a mirror-arm fixing mechanism, a mirror-holding arm disposed on the mirror-arm fixing mechanism, and an adjustment mechanism, wherein the attitude sensor Positioned on the display and used to obtain posture information of the display, the holding arm is connected to the laparoscope, the adjusting mechanism is connected to the holding arm and/or the laparoscope, and the adjusting mechanism is used for adjusting the laparoscope The control unit is connected to the attitude sensor and the adjustment mechanism, and the control unit obtains an adjustment amount required by the adjustment mechanism according to the current state information of the laparoscope and the desired state information, and controls the adjustment mechanism to be based on the adjustment amount. The posture of the laparoscope is adjusted such that the laparoscope corresponds to the posture of the display, wherein the current state information of the laparoscope includes laparoscopic current posture information, and the desired state information of the laparoscope includes posture information of the display.
  2. 根据权利要求1所述的腹腔镜手术系统,其特征在于,该腹腔镜为0度镜或30度镜或75度镜。The laparoscopic surgical system of claim 1 wherein the laparoscope is a 0 degree mirror or a 30 degree mirror or a 75 degree mirror.
  3. 根据权利要求1所述的腹腔镜手术系统,其特征在于,该腹腔镜为末端具有三个自由度的蛇形腹腔镜。The laparoscopic surgical system of claim 1 wherein the laparoscope is a serpentine laparoscope having three degrees of freedom at the end.
  4. 根据权利要求2或3所述的腹腔镜手术系统,其特征在于,该持镜臂为含有多个关节的不动点机构,该调整机构包括第一组调整机构和第二组调整机构,该第一组调整机构包括第一伺服电机,该持镜臂的每个关节上至少设有一个该第一伺服电机,用以调节对应的关节转动,该第二组调整机构包括至少一个第二伺服电机,用以调节该腹腔镜轴向转动。The laparoscopic surgical system according to claim 2 or 3, wherein the holding arm is a fixed point mechanism including a plurality of joints, the adjusting mechanism comprising a first set of adjusting mechanisms and a second set of adjusting mechanisms, The first set of adjustment mechanisms includes a first servo motor, each of the joint arms having at least one first servo motor for adjusting a corresponding joint rotation, and the second set of adjustment mechanisms including at least one second servo a motor for adjusting the axial rotation of the laparoscope.
  5. 根据权利要求2或3所述的腹腔镜手术系统,其特征在于,该腹腔镜当前的状态信息还包括腹腔镜当前位置信息,该腹腔镜的期望状态信息还包括腹腔镜期望位置信息,该调整机构的调整量根据腹腔镜当前的状态信息和期望状态信息通过运动学方程逆解获得。 The laparoscopic surgical system according to claim 2 or 3, wherein the current state information of the laparoscope further includes laparoscopic current position information, and the desired state information of the laparoscope further includes laparoscopic desired position information, the adjustment The adjustment of the mechanism is obtained by inverse solution of the kinematic equation based on the current state information and desired state information of the laparoscope.
  6. 根据权利要求5所述的腹腔镜手术系统,其特征在于,该持镜臂为具有至少五个关节的不动点机构,该持镜臂的各关节上设有关节传感器,以测量各关节的转动角度,该腹腔镜设有角度传感器,以测量该腹腔镜的自转角度,该腹腔镜当前的状态信息根据各关节的转动角度、该腹腔镜的自转角度通过运动学方程获得。The laparoscopic surgical system according to claim 5, wherein the mirror arm is a fixed point mechanism having at least five joints, and joints of the arms are provided with joint sensors for measuring joints The angle of rotation is provided by the laparoscope to measure the rotation angle of the laparoscope. The current state information of the laparoscope is obtained by a kinematic equation according to the rotation angle of each joint and the rotation angle of the laparoscope.
  7. 根据权利要求6所述的腹腔镜手术系统,其特征在于,该腹腔镜期望位置信息根据预设的约束条件获得。The laparoscopic surgical system according to claim 6, wherein the laparoscopic desired position information is obtained according to a preset constraint.
  8. 根据权利要求7所述的腹腔镜手术系统,其特征在于,该约束条件为不动点的位置信息,及该腹腔镜在病人体内的长度。The laparoscopic surgical system of claim 7, wherein the constraint is positional information of the fixed point and the length of the laparoscopic body in the patient.
  9. 根据权利要求3所述的腹腔镜手术系统,其特征在于,该调整机构包括第二组调整机构,该第二组调整机构包括至少三个第二伺服电机,以调整该蛇形腹腔镜的姿态。The laparoscopic surgical system according to claim 3, wherein the adjustment mechanism comprises a second set of adjustment mechanisms, the second set of adjustment mechanisms comprising at least three second servo motors to adjust the attitude of the serpentine laparoscope .
  10. 根据权利要求3所述的腹腔镜手术系统,其特征在于,该持镜臂包括多个关节,且各关节上设有相应的关节传感器,以测量各关节的转动角度,该蛇形腹腔镜的三个自由度包括两个摆动自由度和一个自转自由度,该蛇形腹腔镜设有三个角度传感器,分别测量该蛇形腹腔镜的两个摆动角度和自转角度,以获得该蛇形腹腔镜的当前姿态信息。The laparoscopic surgical system according to claim 3, wherein the mirror arm comprises a plurality of joints, and each joint is provided with a corresponding joint sensor for measuring a rotation angle of each joint, the serpentine laparoscope The three degrees of freedom include two swing degrees of freedom and one degree of freedom of rotation. The serpentine laparoscope is provided with three angle sensors for measuring the two swing angles and the rotation angle of the serpentine laparoscope to obtain the serpentine laparoscope. Current pose information.
  11. 根据权利要求1所述的腹腔镜手术系统,其特征在于,该控制单元控制该调整机构基于所述调整量来调整该腹腔镜的姿态,使该腹腔镜与该显示器的姿态相一致。 The laparoscopic surgical system according to claim 1, wherein the control unit controls the adjustment mechanism to adjust the posture of the laparoscope based on the adjustment amount such that the laparoscope conforms to the posture of the display.
PCT/CN2017/091012 2016-09-27 2017-06-30 Laparoscopic surgery system WO2018059036A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610854114.1A CN106333715B (en) 2016-09-27 2016-09-27 Laparoscopic surgical system
CN201610854114.1 2016-09-27

Publications (1)

Publication Number Publication Date
WO2018059036A1 true WO2018059036A1 (en) 2018-04-05

Family

ID=57839486

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/091012 WO2018059036A1 (en) 2016-09-27 2017-06-30 Laparoscopic surgery system

Country Status (2)

Country Link
CN (1) CN106333715B (en)
WO (1) WO2018059036A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113974835A (en) * 2021-09-29 2022-01-28 李汉忠 Operation robot motion control method based on telecentric motionless point constraint
CN115607285A (en) * 2022-12-20 2023-01-17 长春理工大学 Single-port laparoscope positioning device and method

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106333715B (en) * 2016-09-27 2020-04-17 微创(上海)医疗机器人有限公司 Laparoscopic surgical system
CN106780706B (en) * 2017-02-06 2019-09-17 青岛海信医疗设备股份有限公司 Image display method and apparatus based on laparoscope
CN107233133B (en) * 2017-06-29 2019-12-10 华中科技大学鄂州工业技术研究院 Force feedback system for virtual laparoscopic surgery
CN109806002B (en) 2019-01-14 2021-02-23 微创(上海)医疗机器人有限公司 Surgical robot
CN111568558B (en) * 2020-04-13 2022-02-22 上海市胸科医院 Electronic device, surgical robot system, and control method thereof
CN114452004B (en) * 2020-11-10 2023-12-12 重庆金山医疗机器人有限公司 Control method for tail end position and posture of surgical robot
CN113925613B (en) * 2021-09-27 2023-07-07 中山大学 Laparoscopic surgery holds mirror robot system

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5876325A (en) * 1993-11-02 1999-03-02 Olympus Optical Co., Ltd. Surgical manipulation system
US20040034534A1 (en) * 2002-06-14 2004-02-19 Ulrich Sander Voice control system for surgical microscopes
CN102692701A (en) * 2012-06-01 2012-09-26 深圳市麟静科技有限公司 Lens control circuit of medical microscope system
CN102759798A (en) * 2012-07-03 2012-10-31 深圳市长江力伟股份有限公司 Wearable type display mechanism for microsurgery
CN102793583A (en) * 2012-08-31 2012-11-28 深圳市长江力伟股份有限公司 Wearable microscopic device for surgical operation and control circuit thereof
CN102930170A (en) * 2012-11-12 2013-02-13 声泰特(成都)科技有限公司 Novel interactive medical ultrasound display and input system
CN106333715A (en) * 2016-09-27 2017-01-18 微创(上海)医疗机器人有限公司 Laparoscopic surgery system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5876325A (en) * 1993-11-02 1999-03-02 Olympus Optical Co., Ltd. Surgical manipulation system
US20040034534A1 (en) * 2002-06-14 2004-02-19 Ulrich Sander Voice control system for surgical microscopes
CN102692701A (en) * 2012-06-01 2012-09-26 深圳市麟静科技有限公司 Lens control circuit of medical microscope system
CN102759798A (en) * 2012-07-03 2012-10-31 深圳市长江力伟股份有限公司 Wearable type display mechanism for microsurgery
CN102793583A (en) * 2012-08-31 2012-11-28 深圳市长江力伟股份有限公司 Wearable microscopic device for surgical operation and control circuit thereof
CN102930170A (en) * 2012-11-12 2013-02-13 声泰特(成都)科技有限公司 Novel interactive medical ultrasound display and input system
CN106333715A (en) * 2016-09-27 2017-01-18 微创(上海)医疗机器人有限公司 Laparoscopic surgery system

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113974835A (en) * 2021-09-29 2022-01-28 李汉忠 Operation robot motion control method based on telecentric motionless point constraint
CN113974835B (en) * 2021-09-29 2023-09-29 北京科鹏医疗器械有限公司 Telecentric motionless point constraint-based surgical robot motion control method
CN115607285A (en) * 2022-12-20 2023-01-17 长春理工大学 Single-port laparoscope positioning device and method
CN115607285B (en) * 2022-12-20 2023-02-24 长春理工大学 Single-port laparoscope positioning device and method

Also Published As

Publication number Publication date
CN106333715B (en) 2020-04-17
CN106333715A (en) 2017-01-18

Similar Documents

Publication Publication Date Title
WO2018059036A1 (en) Laparoscopic surgery system
US11963666B2 (en) Overall endoscopic control system
CN106714655B (en) Apparatus and system including a robotic arm
JP6421171B2 (en) System and method for following a path using zero space
CN109288591A (en) Surgical robot system
CN109806002B (en) Surgical robot
JP2022008972A (en) System and methods for positioning manipulator arm by clutching within null-perpendicular space concurrent with null-space movement
US20140354689A1 (en) Display apparatuses and control methods thereof
KR20140112207A (en) Augmented reality imaging display system and surgical robot system comprising the same
CN109330685B (en) Automatic navigation method for laparoscope of porous abdominal cavity surgical robot
JP2017516507A (en) System and method for controlling the orientation of an imaging instrument
Noonan et al. Gaze contingent articulated robot control for robot assisted minimally invasive surgery
WO2014073121A1 (en) Manipulation system for manipulable device and manipulation input device
EP3592276B1 (en) Systems for controlling tool with articulatable distal portion
CN114795495A (en) Master-slave operation minimally invasive surgery robot system
CN113558762A (en) Registering a surgical tool with a reference array tracked by a camera of an augmented reality headset for assisted navigation during surgery
KR101284087B1 (en) Surgical robot using visual sensor and system and method for analyzing of the surgical robot and system and method for controling of he surgical robot
US20220125537A1 (en) Method for controlling a mechanical arm of a surgical robot following the movement of a surgical bed and a device therefor
Mylonas et al. Gaze contingent depth recovery and motion stabilisation for minimally invasive robotic surgery
CN211460506U (en) Main operating platform for improving immersion feeling and surgical robot
CN211271131U (en) Main operating table and surgical robot
CN211460505U (en) Main operating table with eyepieces and surgical robot
CN109498163B (en) Main operation table and surgical robot
CN109498162B (en) Main operation table for improving immersion sense and surgical robot
CN109498164B (en) Main operation table with ocular lens and surgical robot

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17854490

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17854490

Country of ref document: EP

Kind code of ref document: A1