EP3028198A2 - Device for intermediate-free centralised control of remote medical apparatuses, with or without contact - Google Patents

Device for intermediate-free centralised control of remote medical apparatuses, with or without contact

Info

Publication number
EP3028198A2
EP3028198A2 EP14793200.8A EP14793200A EP3028198A2 EP 3028198 A2 EP3028198 A2 EP 3028198A2 EP 14793200 A EP14793200 A EP 14793200A EP 3028198 A2 EP3028198 A2 EP 3028198A2
Authority
EP
European Patent Office
Prior art keywords
medical
receiving surface
operating
control device
projection
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP14793200.8A
Other languages
German (de)
French (fr)
Inventor
Alain Sezeur
Jean-François OMHOVER
Vincent Meyrueis
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Universite Pierre et Marie Curie Paris 6
Original Assignee
Universite Pierre et Marie Curie Paris 6
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Universite Pierre et Marie Curie Paris 6 filed Critical Universite Pierre et Marie Curie Paris 6
Publication of EP3028198A2 publication Critical patent/EP3028198A2/en
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B15/00Systems controlled by a computer
    • G05B15/02Systems controlled by a computer electric
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction with lists of selectable items, e.g. menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842Selection of displayed objects or displayed text elements
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G3/00Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
    • G09G3/001Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background
    • G09G3/002Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/67ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for remote operation

Definitions

  • the present invention relates to a control device without physical contact of medical devices, usable by the practitioner.
  • Empowering the surgeon to control the setting or activation of the electronic devices in the operating room seems to be a real challenge in the course of an operation, so that the operator (surgeon or practitioner) is no longer tributary of a third person (dresser) for the control of medical devices.
  • Non-contact control devices are known by recognition of operating room gestures whose functions and uses are however more focused on the visualization of information on the patient and medical imagery via including access to the network Pictures Archiving and Communication Systems (PACS) during operation.
  • PACS Pictures Archiving and Communication Systems
  • the device mentioned above uses an optical measurement system to follow the surgical tools on which a tracker is fixed and which are used to interact with the projected virtual interface.
  • This system allows the surgeon to project the virtual interface in the flat sterile zone of his choice and thus to consult preoperative data or patient information.
  • This device does not allow the surgeon to control the equipment of the operating room. Its use therefore does not allow to give autonomy to the surgeon and the proposed functionalities require the establishment of trackers making complex its use in medical interventional environment.
  • the device mentioned above proposed by Graetzel et al 2004, allows the aid of a stereoscopic camera system, the recognition of the movement of the hands, so that a surgeon is able to make a more efficient use of computers in medical intervention.
  • This device offers the surgeon the ability to determine a capture space from which he can control the computer by the movement of his hands. To minimize the presence of screens, this device uses the endoscopy video monitor.
  • This device does not fully meet the constraints of a medical intervention. Indeed, the surgeon must move to the stereoscopic column to be able to view the information on the computer and this device is only used for a certain type of medical procedures requiring the presence of the column stereoscopic.
  • the patent application WO2012129669 proposes a device for controlling electronic equipment for the purpose of displaying medical information on a display system, for example of the LCD type.
  • This device uses a gesture recognition system such as Kinect® or Wavi Xtion® to control equipment for navigation within the PACS system.
  • Kinect® or Wavi Xtion® to control equipment for navigation within the PACS system.
  • This device therefore requires the use of an LCD monitor which is binding in an interventional medical environment often already congested.
  • This device also does not allow the control of the equipment of the medical interventional environment such as for example the operating table, the scalpel, or the operating light.
  • the patent application WO201 185815 proposes a control device, for example by detecting the movement of hands or an instrument, of a navigation system in a medical environment.
  • the user's gestures make it possible to execute a set of commands such as the manipulation of displayed images or to control the software functions of a medical navigation system.
  • This device offers to view the image on a monitor or to project it on a suitable background. At no time does this device respond to the problem of autonomy and sterility of the surgeon in terms of equipment settings of a medical interventional environment.
  • the present invention therefore aims to remedy these drawbacks, by providing a control device without physical contact between the practitioner and the control of his instruments, and without necessarily having recourse to a third party.
  • the present invention relates to a device for remote control with or without contact, of at least one medical device, comprising:
  • At least one device for projecting a graphic interface on at least one reception surface at least one device for projecting a graphic interface on at least one reception surface
  • At least one object locating device for detecting a movement of at least one object in at least one capture area
  • the at least one communication device with at least one medical device, for transmitting, on detection of said movement, a predefined command to said at least one medical device.
  • the device is further such that the at least one receiving surface is a physical surface separating a first operating space from a second operating space, the first operating space including at least one capture area.
  • medical device any electronic device suitable for use in a medical environment, both for effecting a modification of the physical state of a patient according to a predefined command of an operator, as for an exploration medical device made by a practitioner, such as an endoscope probe, or the access and display on the receiving surface of a patient's file to obtain information (antecedents, medical risks, allergies). .).
  • modifying the physical state of a patient is meant, in general, any modification of the functioning or the physical condition of a patient, in particular, and by way of non-limiting example, the use of a electrosurgical unit to open the patient's body, to cut or cauterize tissues, to destroy cells, in particular tumor cells, or to inject gas into the patient's abdomen to perform a laparoscopy, this list being of course in no way limiting and only given for information only.
  • the medical devices will be surgical medical devices.
  • projection device is meant a device capable of projecting existing information on a defined surface.
  • the device may in particular be equipped with means for enlarging the image to be projected.
  • the projection device will be a video projector.
  • it can be equipped with different optical systems, to adapt the projected information according to the distance between the projection device and the screen or to adapt the image to the color of the projection surface, to optimize contrast and visual rendering.
  • the projection device may be adapted to use in a sterile room, and in particular, said device may not include a fan.
  • the control device may be equipped with several projection devices.
  • the projection device may be equipped with sensors for adapting the device to the receiving surface. Said device may be secured to a fastening means secured to the receiving surface or completely offset to another surface such as the wall or ceiling of an operating room for example.
  • graphic interface is meant the interface allowing an easy man / machine dialogue, represented in graphic form, in which are represented in the form of icons or diagrams, all the commands of the instruments that the user can manipulate.
  • receiving surface is meant the surface on which the graphic interface is projected. This surface can in particular separate a first operating space from a second operating space for example to isolate the practitioner.
  • operating space is generally meant an area of the operating room in which the surgeon and / or his assistants may evolve and / or in which medical devices or objects may be arranged.
  • An operating space can be sterile or not and can be used during an operation or not in particular according to its location in the operating room.
  • the first operation space and the second operation space can in particular be distinct.
  • the second operation space may for example serve as space for the anesthetist, in the non-limiting case of a surgery operation.
  • the receiving surface is close to the practitioner, at a distance of less than 2 meters, and even more preferably at a distance of less than 1.50 meters.
  • the projection surface may be of any kind and advantageously, the receiving surface is a sterile field, used during surgical operations.
  • sterile field is meant a cloth that, once placed in the medical intervention area, especially during operations (for example in general surgery, visceral surgery, veterinary surgery, but also in interventional radiology in the broad sense, or during endoscopies ...), to define a sterile space in the area of medical intervention.
  • this field is non-woven, and typically it is hooked substantially perpendicular to a patient generally elongates and isolates the space of the surgeon from that of the anesthetist.
  • the sterile field may have sticky edges and may be transparent or semi-transparent.
  • the receiving surface defines two distinct spaces, generally, at least one of the two spaces is sterile.
  • object locator is meant the device capable of detecting the position and / or movement of objects in the space defined by the capture area and the receiving surface.
  • the detected object may be the instrument itself, but also the hand of the surgeon.
  • the technology used for the object-locating system could be a leap-motion technology, using optical sensors, a "Kinect” system, or any other system using the stereoscopic or localization principle. objects.
  • capture zone is meant the area of the space where the location of the objects takes place.
  • This capture zone defined as being the active zone in which to place the receiving surface will preferably be located near the practitioner and in particular at a distance of less than 2 meters, and preferably at a distance of less than 1.50 meters.
  • This capture zone will advantageously define the place where to place the receiving surface.
  • communication device means the device for interconnection of equipment, for example the operating room, but also their order.
  • the device may be wired, wireless, and advantageously said device will communicate by a carrier current link.
  • “Third person” means any person other than the person performing the medical act, whether surgical or not.
  • the third person may be the anesthesiologist during a surgery operation.
  • one or more of the following may also be used:
  • the receiving surface is a flexible surface, and in particular a sterile field; -
  • the receiving surface is disposed in the immediate vicinity of an operating area of an operating room, preferably at a distance of less than 2 meters, even more preferably at a distance of less than 1.5 meters;
  • the projection device is a video projector and more particularly a cold light video projector
  • the receiving surface and the projection device are not in contact
  • the capture zone is disposed in the immediate vicinity of an operating zone of an operating theater and has a maximum dimension of less than 2 meters, preferably a maximum dimension of less than 1.5 meters;
  • the communication device is able to communicate with the medical device by means of an in-line carrier link
  • the communication device is able to communicate with the surgical medical device by means of a wireless link; the communication device is able to communicate with at least two medical devices, the device for locating objects is able to detect at least two distinct movements of the at least one object in the capture zone, and the communication device is able to transmit, on respective detection of said at least two movements, at least two respective predefined commands, respectively to said at least two medical devices.
  • the invention also relates to a remote control method with or without contact, of at least one medical device, in which:
  • a graphic interface is remotely projected onto at least one reception surface by means of at least one projection device, the receiving surface being a physical surface separating a first operating space from a second operating space,
  • a movement of at least one object is detected in at least one zone included in the first operation space, by means of at least one object-locating device, and
  • a predefined command is transmitted to said at least one medical device by means of a communication device.
  • a communication device In preferred embodiments of the invention, one or more of the following may also be used:
  • a color of at least one point of the reception surface is detected, and at least one color correction coefficient of the graphic interface is defined according to said color;
  • the checklist comprises a plurality of verification points and in which, to validate each of said verification points, at least one movement of said at least one object in the capture zone is detected by means of the object locating device.
  • FIG. 1 illustrates a device for remote control with or without contact, of at least one medical device according to one embodiment of the invention.
  • FIG. 2 illustrates a detail of the control device of FIG. 1.
  • FIG. 3 illustrates a graphical interface in one embodiment of the control device of FIG. 1.
  • variants of the invention comprising only a selection of characteristics described, subsequently isolated from the other characteristics described (even if this selection is isolated within a sentence including these other features), if this selection of features is sufficient to confer a technical advantage or to differentiate the invention from the state of the prior art.
  • This selection comprises at least one characteristic, preferably functional without structural details, or with only a part of the structural details if this part alone is sufficient to confer a technical advantage or to differentiate the invention from the state of the prior art .
  • Figures 1 and 2 illustrate a remote control device 1 of a surgical surgical unit 2 of the operating theater according to the invention.
  • the device 1 is more particularly designed to remotely control a surgical medical device 2 adapted to perform a modification of the physical state of a patient 3.
  • the modification of the physical state of the patient 3 is in particular carried out by the device 2.
  • the operator 4 may in particular be a surgeon in charge of a surgical operation on the patient 3.
  • the control device 1 comprises a projection device 5, an object locating device 6, and a communication device 7. These can in particular be organized functionally as follows.
  • the projection device 5 remotely projects a graphic interface 8 on a reception surface 9.
  • the object locating device 6 detects a movement of an object 10 in a capture area 11.
  • the object 10 is further detailed below but may, by way of example, be a hand of a surgeon.
  • the movement of the object 10 is for example illustrated by the arrow 20 in the figures.
  • the communication device 7 transmits a predefined command to Surgical Operating Room Surgical Unit 2.
  • the projection device 5 makes it possible to project, through the capture area 1 1 defined by the device, a graphical interface 8 enabling the surgeon to interact on his instruments, c that is to say on the surgical medical device 2, in the non-limiting case of a surgical operation.
  • the receiving surface 9 is disposed in the immediate vicinity of an operating zone 18 of the operating theater, preferably at a distance of less than 2 meters, even more preferably at a distance of less than 1.5 meters. In this way, the operator 4, in particular the surgeon, can remain standing at the location of the operating field and observe without moving the graphic interface 8.
  • the projection surface 9 can in particular separate a first operating space 100 from a second operating space 200.
  • the operating spaces 100, 200 are particularly sterile areas or not in the operating room in which the surgeon and / or his assistants can evolve and / or in which medical devices or objects can be arranged.
  • An operating space may be used during an operation or not in particular according to its location within the operating room.
  • the first operation space 100 may in particular include the capture area 1 1.
  • the receiving surface 9 is a flexible surface.
  • the receiving surface 9 may in particular be a sterile field.
  • the receiving surface 9 may be a rigid tablet, for example a tablet disposed in the immediate vicinity of an operating area 18, including a sterile tablet.
  • the receiving surface 9 and the projection device 5 are not in contact. This makes it possible to guarantee, if necessary, the sterility of the reception surface 9 in an easy manner.
  • the projection device 5 will be a video projector, fixed for example on a bracket, as illustrated in FIG.
  • Part 12 constituting the objective of the video projector may be equipped with an optical system in the broad sense, allowing adaptation of the projection of the interface graph 8 on the receiving surface 9, in particular the sterile field.
  • This embodiment will enable, for example, in the case where the sterile field 9 is fixed on an arm or a mobile gantry 13, to equip the objective 12 with one or more lenses, or any optical system allowing the control of the focusing of the projected graphic interface 8, so as to adjust the focus of the projector 5 or to correct the deformation of the image, whether by optical, electronic or software means.
  • the objective 12 of the video projector 5 may include any optical system for making enlargements or narrowing of the display of the graphical interface 8.
  • the lens 12 may be equipped with color filters in the broad sense, to adapt the color of the graphic interface 8 to the color of the receiving surface 9, including the sterile field, on which the interface graph 8 is projected, with the aim of optimizing the visual contrast and improving the vision comfort of the operator, especially the surgeon.
  • the graphic interface 8 may be projected by a laser scanning device 5.
  • a laser scanning device 5 For example, Micro Vision's PicoP system can be used to project information.
  • a projection device 5 may in particular be afocal. In this way, the surgeon will not need to adjust the focus of the projector 5, especially in case of displacement of the receiving surface 9, including the sterile field The operator can thus remain focused on his act.
  • the objective 12 of the projection device 5 may be equipped with one or more filters, for example polarized or temporal type with shutters, for projecting 3D information in the capture area 1 1 .
  • the surgeon may in particular wear glasses to visualize this 3D information.
  • the projector 5 does not contain a fan and may include at least one cold light source such as a light-emitting diode (LED) improving the quality of a sterile interventional medium such as a surgical unit.
  • a cold light source such as a light-emitting diode (LED) improving the quality of a sterile interventional medium such as a surgical unit.
  • LED light-emitting diode
  • the projection device 5 is located on the opposed to the sterile medical interventional zone or operative field, with respect to the receiving surface 9, in particular the sterile field, and projects a graphical interface 8 at least partially inverted.
  • a user for example a surgeon, and another user, for example the anesthetist, can have their own graphical interface respectively.
  • the projection device 5 will be equipped with one or more sensors 14, allowing, for example, the positioning measurement of the reception surface 9, in particular of the sterile field, or the detection of the shape of the receiving surface 9, especially the sterile field.
  • the projection device 5 will be equipped with one or more sensors 14, allowing, for example, the positioning measurement of the reception surface 9, in particular of the sterile field, or the detection of the shape of the receiving surface 9, especially the sterile field.
  • This spatial position is for example detected with respect to the projection device 5.
  • the senor 14 may be on the projector side 5 with respect to the receiving surface 9, as the sterile side, in order to measure and control the light intensity on the field.
  • the user can adapt the power of the lamp of the projector according to the ambient lighting.
  • the system comprises two sensors 14 localized from and other of the receiving surface 9, in particular the sterile field.
  • the graphic interface 8 of this invention is defined as any system allowing, for example, a human / machine dialogue, in which objects to be manipulated are typically represented in the form of specific pictograms of each medical device, imitating the physical manipulation of these objects with a pointing system.
  • a graphic representation of the graphical interface is given in FIG.
  • the object locating device 6 makes it possible in particular to detect the position and / or the movement of the object 10 in the space.
  • This detection defines a capture area 1 1, in which the surgeon 4 can perform control gestures.
  • the receiving surface is a sterile field.
  • the user for example the surgeon, can use this reception surface to carry out a command, without any consequence for the rest of the course of the operation, unlike the use of an LCD screen, where a simple contact between the surgeon and the screen requires a temporary stop of the operation to change the gloves de-sterilized practitioner.
  • This device allows to determine the position of the surgeon's hands, and to define the movement. Thus, it may be attributed to a gesture, a specific action of a medical device and / or surgical realizing a modification of the physical state of a patient for example, while respecting the conditions of sterility applying to the surgeon in a medical interventional environment.
  • the capture area 1 1 is for example disposed in the immediate vicinity of the operative field of the operating room.
  • the capture zone 1 1 has, for example, a maximum dimension of less than 2 meters, preferably a maximum dimension of less than 1.5 meters, in order to allow the operator to travel entirely through the movements of the arms alone, in particular without requiring a moving the operator 4.
  • the object locating device 6 comprises at least one sensor 15 and is optionally completed with one or more transmitters 16.
  • these sensors 15 are based on optical sensors, for example at the visible wavelength or IR.
  • the sensors 15 are for example an optical or infrared camera.
  • the object locating device 6 will use the "Leap Motion" technology. This technology, consisting of a triplet of infrared lamps 16 and 2 optical sensors 15 allows lighting of the scene via an IR transmitter.
  • the sensors 15 capture the light intensity reflected by the objects 10.
  • the invention will not be limited to this type of technology for locating objects.
  • the "Kinect” system may be used, as may the “Wavi Xtion” (ASUS) system or any other system using the stereoscopic or object-localization principle.
  • the objects 10 include for example the hands, the fingers and / or the forearm of the surgeon or the instruments of medical interventions.
  • the position of the hands, fingers and / or the forearm of the surgeon can be detected, as well as medical intervention instruments without the need for a sensor to be worn by the surgeon.
  • the control system 1 may comprise at least one parameterizing means for calibrating the projection of the graphical interface 9 relative to the object locating device 6 and the position of the receiving surface 8, in particular the sterile field.
  • This parameterization means comprising mechanical elements or comprising processing elements by software or, comprising mechanical elements and software treatments, makes it possible, in particular, by modifying the angle of inclination of the device for locating objects 6. to modify, according to the needs of the user, the capture zone 1 1 by confining this limited volume space with respect to the capacity of the object locating device 6.
  • the setting device of the locating device 6 can also be automated using motor means.
  • the various possible commands of surgical medical devices are for example; -control of the power intensity of the electrocautery or any medical hemostasis device
  • tumor destruction system eg power echo, radiofrequency, .
  • the system may also allow the control of devices and other elements of the operating theater, in particular: - control of intraoperative imaging system (for example ultrasound ).
  • intraoperative imaging system for example ultrasound
  • a graphic interface 8 adapted in terms of ergonomics to the projection and interaction device (size of the buttons, colors, sequences, etc. .). Indeed, since the sterile fields are generally blue or green, the choice of interface colors should make it possible to optimize the color rendering of the latter on the sterile field, for example by using colors that are opposite to blue and green. green on the color wheel.
  • the sterile field is then a suitable background for the projection of the graphical interface 8 as detailed above.
  • the capture area 1 1 created by the projection device 5 can define the place where the GUI 8 is projected. Typically, this capture zone 11 will be delimited at at least one end by the passive receiving surface 9, in particular a sterile field.
  • sterile field is meant a cloth that, once placed in the medical intervention area, especially during operations (for example in general surgery, visceral surgery, veterinary surgery, but also in interventional radiology in the broad sense, or during endoscopies ...), to define a sterile space in the area of medical intervention.
  • this field is non-woven, and typically it is hung substantially perpendicular to an elongated patient and generally isolates the space of the surgeon from that of the anesthetist.
  • the sterile field may have sticky edges and may be transparent or semi-transparent. Generally, it is attached to at least a bracket with a hooked system.
  • the sterile field may be fixed on a horizontal or vertical bar, itself fixed on the operating table or directly on the ground.
  • this field may be held on a movable arm, allowing it to be easily moved.
  • the entire projection system / capture area can be secured to an arm fixed for example on the wall or on the ceiling.
  • this set could be located on both sides of the operating sterile field.
  • the receiving surface 9 on which the graphic interface 8 is projected will not necessarily be sterile.
  • the invention may be used for example, in a particular embodiment, for endoscopic examinations, or the sterility of the operating room or examination is not an obligation.
  • a data processing system 17 makes it possible to determine the positions of an object 10 and to define its movement. It can be embedded in at least one of the devices of the system 1 or deported thereof. It can also be embedded in an implanted computing unit and can notably be integrated in the device for locating objects 6 or projection 5. It can typically be a processor, a computer or a tablet .
  • a data processing system is any system that allows the model to be modeled by any means whatsoever. position and / or movement of an object in space relative to the projected graphical interface and to define a pointing system.
  • the communication device 7 and transfer commands allows interconnection with the equipment of the operating room and their order. Such a device can send a signal to the electronically controlled medical devices of the medical interventional medium for example to control the position of the operating table.
  • the term "communication device 7" and “transfer of commands” means any device that makes it possible, for example, to interact and control, in particular, the functionalities of the surgical medical devices of the medical interventional environment, of the databases, of the connected network.
  • the control system 1 thus makes it possible in particular to use, in a medical interventional environment, a virtual interface projected on a sterile field which generally separates the space of the (sterile) surgeon from that of the anesthetists and avoids in particular the doctor to have to take the risk of contaminating and therefore having to change his desilterized gloves for the control of medical equipment.
  • the sterile field typically positioned at the beginning of intervention and generally maintained by a fastening system such as a set of brackets.
  • the device can be equipped with a voice control system.
  • the voice control system may allow the surgeon to switch on and / or switch off and / or put the device in standby.
  • the device may include a sound reproduction system. The surgeon will be certain, without the need to check visually, that the command he has just passed has been taken into account by the device. He will be able to use his equipment safely.
  • the various systems of the device can communicate with each other and / or with the equipment of the medical interventional environment by a cabling system or by a wireless system, for example using Wifi or Bluetooth technology.
  • the various systems of the device can communicate with each other and / or with the equipment of the medical interventional medium by a cabling system CPL (carrier current).
  • CPL carrier current
  • the communication device 7 may be able to communicate with the operating theater surgical medical devices 2 by means of an in-line carrier link.
  • the various systems of the device will be able to communicate with each other and / or with the equipment of the medical interventional environment via wireless links.
  • the communication device 7 may be able to communicate with surgical medical equipment 2 operating room by means of a wireless link.
  • the device can receive a power supply by any means, in particular by sector or battery.
  • the interconnection cables would preferentially integrate with the sterile field fixing system, in order to minimize the passage of the cables in the middle of the operating chamber.
  • the system 1 may in particular be implemented in a method for remote control of a surgical medical device 2 operating theater as will now be described.
  • Such a method may in particular be especially intended for remotely controlling a surgical medical device 2 adapted to perform a modification of the physical state of a patient 3 according to a predefined command from an operator 4
  • a graphic interface 8 is remotely projected onto a reception surface 9 by means of a projection device 5,
  • a motion of at least one object 10 is detected in a capture zone 11 by means of an object locating device 6, and
  • a predefined command is transmitted to the operating theater surgical medical device 2 by means of a communication device 7.
  • the transmission of a predefined command to the operating theater surgical medical device 2 by means of the communication device 7 can be prevented until an operator 4 has validated a checklist.
  • the control system can only be active with the various medical devices after validation of a data checklist to secure the operating procedure
  • the checklist may for example be displayed on the reception surface 9, in particular by being displayed on the graphic interface 8 remotely projected by the projection device 4.
  • the checklist is for example a list comprising several checkpoints. .
  • verification points we mean elements that the operator 4, in particular the surgeon or assistant, must check to meet legal obligations or not (checklist kind of drivers) before conducting the operation.
  • at least one movement of the object 10 is detected in the capture zone 1 1 by means of the object locating device 6, for example a sign from the surgeon's hand indicating that a checkpoint on the checklist has been checked.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Biomedical Technology (AREA)
  • Medical Informatics (AREA)
  • General Business, Economics & Management (AREA)
  • Public Health (AREA)
  • Primary Health Care (AREA)
  • General Health & Medical Sciences (AREA)
  • Epidemiology (AREA)
  • Business, Economics & Management (AREA)
  • Computer Hardware Design (AREA)
  • Automation & Control Theory (AREA)
  • User Interface Of Digital Computer (AREA)
  • Apparatus For Radiation Diagnosis (AREA)

Abstract

A device (1) for remotely controlling at least one medical apparatus (2) with or without contact, comprising a device (5) for projecting a graphical interface (8) onto at least one receiving surface (9), a device for locating objects (6) in order to detect a movement of at least one object (10) in at least one capturing area (11), and a device (7) for communicating with at least one medical apparatus (2), in order to transmit a predefined command to said at least one medical apparatus on detection of said movement. The at least one receiving surface (9) is a physical surface separating a first operation space (100) from a second operation space (200), the first operation space (100) including at least one capturing area (11).

Description

DISPOSITIF DE COMMANDE CENTRALISE SANS INTERMEDIAIRE, AVEC OU SANS CONTACT, D'APPAREILS  CENTRALIZED CONTROL DEVICE WITHOUT INTERMEDIATE, WITH OR WITHOUT CONTACT, OF DEVICES
MEDICAUX DISTANTS  REMOTE MEDICAL
La présente invention concerne un dispositif de commande sans contact physique d'appareils médicaux, utilisables par le praticien. The present invention relates to a control device without physical contact of medical devices, usable by the practitioner.
La conduite d'une opération, impose au praticien, l'utilisation d'appareils médicaux, chirurgicaux ou non. The conduct of an operation, requires the practitioner, the use of medical devices, surgical or not.
De nombreux appareils tels que des bistouris électriques sont des instruments indispensables notamment à la conduite de nombreuses opérations chirurgicales. L'environnement d'une salle d'opération se doit de répondre à des exigences d'hygiène drastiques et à des conditions de stérilité strictes. Lors d'une opération, le chirurgien ne peut pas avoir de contact physique avec les commandes des instruments de chirurgie ou d'exploration. En outre, certains actes délicats tels que la destruction d'une cellule tumorale, sont tributaires de la communication entre le chirurgien et son assistant. Ainsi, pour régler les différents dispositifs médicaux au cours de l'opération, le chirurgien doit usuellement faire appel à un assistant pour effectuer les manipulations nécessaires. La communication entre le chirurgien et l'assistant est parfois ambiguë et difficile comme l'indique le document "A non-contact mouse for surgeon computer interaction" de C. Graetzel, T. Fong, S. Grange, and C. Baur, publié dans Technology and Health Care, 12(3):245-257, 2004. Many devices such as electrosurgical devices are indispensable instruments in particular to conduct many surgical operations. The environment of an operating room must meet stringent hygiene requirements and strict sterility conditions. During an operation, the surgeon can not have physical contact with the controls of the surgical or exploration instruments. In addition, certain delicate acts such as the destruction of a tumor cell are dependent on the communication between the surgeon and his assistant. Thus, to adjust the various medical devices during the operation, the surgeon must usually use an assistant to perform the necessary manipulations. The communication between the surgeon and the assistant is sometimes ambiguous and difficult as indicated by the document "A non-contact mouse for surgeon computer interaction" of C. Graetzel, T. Fong, S. Grange, and C. Baur, published in Technology and Health Care, 12 (3): 245-257, 2004.
Autonomiser le chirurgien pour qu'il puisse commander le réglage ou l'activation des appareils électroniques de la salle d'opération semble être un réel enjeu dans le déroulement d'une opération, afin que l'opérateur (chirurgien ou praticien) ne soit plus tributaire d'une tierce personne (panseuse) pour la commande des dispositifs médicaux. Empowering the surgeon to control the setting or activation of the electronic devices in the operating room seems to be a real challenge in the course of an operation, so that the operator (surgeon or practitioner) is no longer tributary of a third person (dresser) for the control of medical devices.
On connaît par ailleurs des dispositifs utilisant des écrans à dalle tactile comme cela est par exemple mentionné dans l'article "An Approach for Projector-based Surgeon- Computer Interaction using Tracked Instruments » de Bojan Kocev, Darko Ojdani'c, Heinz-Otto Peitgen, publié dans Fraunhofer MEVIS Universitat sallee 29, 28359 Bremen, Germany. Malheureusement, ceux-ci ne permettent pas d'assurer une stérilité à 100% (Kocev et al, 201 1 ). Ce genre de dispositif doit être complété d'une housse stérile afin de limiter le risque de contamination et demande au chirurgien de se déporter de la table d'opération pour effectuer les manipulations nécessaires comme cela est par exemple détaillé dans le document US4621735., pour ne pas être géné par l'interposition d'un aide ou d'un matériel Furthermore, devices using touchscreen screens are known, as for example mentioned in the article "An Approach for Projector-based Surgeon-Computer Interaction using Tracked Instruments" by Bojan Kocev, Darko Ojdani ' c, Heinz-Otto Peitgen, published in Fraunhofer MEVIS Universitat Room 29, 28359 Bremen, Germany. Unfortunately, these do not provide 100% sterility (Kocev et al, 201 1). This type of device must be completed with a sterile cover to limit the risk of contamination and requires the surgeon to move away from the operating table to perform the necessary manipulations as is detailed for example in US4621735., For not be spared by the intervention of a helper or material
On connaît encore d'autres dispositifs de commande sans contact par reconnaissance des gestes pour bloc opératoire dont les fonctionnalités et usages sont toutefois davantage portés sur la visualisation d'informations sur le patient et d'imageries médicales via notamment l'accès au réseau Pictures Archiving and Communication Systems (PACS) en cours d'opération. Other non-contact control devices are known by recognition of operating room gestures whose functions and uses are however more focused on the visualization of information on the patient and medical imagery via including access to the network Pictures Archiving and Communication Systems (PACS) during operation.
Ainsi, le dispositif mentionné ci-dessus, proposé par Kocev et al 201 1 , utilise un système de mesure optique pour suivre les outils chirurgicaux sur lesquels sont fixés un traqueur et qui sont utilisés pour interagir avec l'interface virtuelle projetée. Ce système permet au chirurgien de projeter dans la zone stérile plate de son choix l'interface virtuelle et ainsi de consulter des données préopératoires ou des informations patients. Ce dispositif ne permet pas au chirurgien de commander les équipements du bloc opératoire. Son utilisation ne permet donc pas de donner une autonomie au chirurgien et les fonctionnalités proposées nécessitent la mise en place de traqueurs rendant complexe son usage en milieu interventionnel médical. Thus, the device mentioned above, proposed by Kocev et al 201 1, uses an optical measurement system to follow the surgical tools on which a tracker is fixed and which are used to interact with the projected virtual interface. This system allows the surgeon to project the virtual interface in the flat sterile zone of his choice and thus to consult preoperative data or patient information. This device does not allow the surgeon to control the equipment of the operating room. Its use therefore does not allow to give autonomy to the surgeon and the proposed functionalities require the establishment of trackers making complex its use in medical interventional environment.
De même, le dispositif mentionné plus haut, proposé par Graetzel et al 2004, permet à l'aide d'un système de caméra stéréoscopique, la reconnaissance du mouvement des mains, de sorte à ce qu'un chirurgien soit en mesure de faire un usage plus efficace des ordinateurs présents en milieu interventionnel médical. Ce dispositif offre au chirurgien la possibilité de déterminer un espace de capture à partir duquel il peut contrôler l'ordinateur par le mouvement de ses mains. Pour minimiser la présence d'écrans, ce dispositif utilise le moniteur vidéo d'endoscopie. Ce dispositif ne répond pas entièrement aux contraintes d'une intervention médicale. En effet, le chirurgien doit se déporter vers la colonne stéréoscopique pour pouvoir visualiser les informations présentes sur l'ordinateur et ce dispositif n'est utilisable que pour un certain type d'interventions médicales nécessitant la présence de la colonne stéréoscopique. Similarly, the device mentioned above, proposed by Graetzel et al 2004, allows the aid of a stereoscopic camera system, the recognition of the movement of the hands, so that a surgeon is able to make a more efficient use of computers in medical intervention. This device offers the surgeon the ability to determine a capture space from which he can control the computer by the movement of his hands. To minimize the presence of screens, this device uses the endoscopy video monitor. This device does not fully meet the constraints of a medical intervention. Indeed, the surgeon must move to the stereoscopic column to be able to view the information on the computer and this device is only used for a certain type of medical procedures requiring the presence of the column stereoscopic.
La demande de brevet WO2012129669 propose un dispositif permettant le contrôle d'équipements électroniques dans le but d'afficher des informations médicales sur un système de visualisation par exemple de type LCD. Ce dispositif utilise un système de reconnaissance de gestes comme par exemple Kinect® ou Wavi Xtion® pour commander des équipements permettant la navigation au sein du système PACS. Ce dispositif nécessite donc l'utilisation d'un moniteur LCD ce qui est contraignant dans un environnement médical interventionnel souvent déjà encombré. Ce dispositif ne permet pas non plus la commande des équipements du milieu interventionnel médical tels que par exemple la table d'opération, le bistouri, ou le scialytique. The patent application WO2012129669 proposes a device for controlling electronic equipment for the purpose of displaying medical information on a display system, for example of the LCD type. This device uses a gesture recognition system such as Kinect® or Wavi Xtion® to control equipment for navigation within the PACS system. This device therefore requires the use of an LCD monitor which is binding in an interventional medical environment often already congested. This device also does not allow the control of the equipment of the medical interventional environment such as for example the operating table, the scalpel, or the operating light.
La demande de brevet WO201 185815 propose un dispositif de contrôle, en détectant par exemple le mouvement des mains ou d'un instrument, d'un système de navigation en milieu médical. Les gestes de l'utilisateur permettent d'exécuter un ensemble de commandes telles que la manipulation d'images affichées ou encore contrôler les fonctions logicielles d'un système de navigation médical. Ce dispositif propose de visualiser l'image sur un moniteur ou de la projeter sur un fond adapté. A aucun moment ce dispositif ne répond au problème d'autonomie et de stérilité du chirurgien en ce qui concerne réglages des équipements d'un milieu interventionnel médical. Il existe donc un besoin pour un dispositif permettant au chirurgien de commander lui-même, directement et sans personne intermédiaire, tout ou partie des équipements commandés électroniquement au bloc opératoire ou en salle d'intervention, sans avoir le risque de contact physique non stérile avec quelque élément que ce soit, résolvant ainsi les problèmes des dispositifs évoqués ci-dessus. The patent application WO201 185815 proposes a control device, for example by detecting the movement of hands or an instrument, of a navigation system in a medical environment. The user's gestures make it possible to execute a set of commands such as the manipulation of displayed images or to control the software functions of a medical navigation system. This device offers to view the image on a monitor or to project it on a suitable background. At no time does this device respond to the problem of autonomy and sterility of the surgeon in terms of equipment settings of a medical interventional environment. There is therefore a need for a device allowing the surgeon to order himself, directly and without any intermediate person, all or part of the equipment ordered electronically in the operating room or in the intervention room, without the risk of non-sterile physical contact with any element whatsoever, thus solving the problems of the devices mentioned above.
La présente invention vise donc à remédier à ces inconvénients, en proposant un dispositif de commande sans contacts physiques entre le praticien et la commande de ses instruments, et sans avoir forcément recours à une tierce personne. The present invention therefore aims to remedy these drawbacks, by providing a control device without physical contact between the practitioner and the control of his instruments, and without necessarily having recourse to a third party.
A cet effet, la présente invention concerne un dispositif de commande à distance avec ou sans contact, d'au moins un appareil médical, comportant : For this purpose, the present invention relates to a device for remote control with or without contact, of at least one medical device, comprising:
- au moins un dispositif de projection d'une interface graphique sur au moins une surface de réception, at least one device for projecting a graphic interface on at least one reception surface,
- au moins un dispositif de localisation d'objets pour détecter un mouvement d'au moins un objet dans au moins une zone de capture, et at least one object locating device for detecting a movement of at least one object in at least one capture area, and
- au moins un dispositif de communication avec au moins un appareil médical, pour transmettre, sur détection dudit mouvement, une commande prédéfinie audit au moins un appareil médical. Le dispositif est en outre tel que l'au moins une surface de réception est une surface physique séparant un premier espace d'opération d'un deuxième espace d'opération, le premier espace d'opération incluant au moins une zone de capture. at least one communication device with at least one medical device, for transmitting, on detection of said movement, a predefined command to said at least one medical device. The device is further such that the at least one receiving surface is a physical surface separating a first operating space from a second operating space, the first operating space including at least one capture area.
Par « appareil médical », on entend tout appareil électronique apte à être utilisé en milieu médical, aussi bien pour réaliser une modification de l'état physique d'un patient en fonction d'une commande prédéfinie d'un opérateur, que pour une exploration médicale réalisée par un praticien, comme par exemple une sonde d'endoscope, ou encore l'accès et l'affichage sur la surface de réception du dossier d'un patient pour d'obtenir des informations (antécédents, risques médicaux, allergies...). Par « modifier l'état physique d'un patient, on entend, de manière générale, toute modification du fonctionnement ou de la condition physique d'un patient, notamment, et à titre d'exemple non limitatif, l'utilisation d'un bistouri électrique pour ouvrir le corps du patient, découper ou cautériser des tissus, détruire des cellules, en particulier des cellules tumorales, ou encore insuffler du gaz dans l'abdomen du patient pour réaliser une cœlioscopie, cette liste étant bien évidemment nullement limitative et uniquement donnée à titre indicatif. Avantageusement, les appareils médicaux seront des appareils médicaux chirurgicaux. By "medical device" is meant any electronic device suitable for use in a medical environment, both for effecting a modification of the physical state of a patient according to a predefined command of an operator, as for an exploration medical device made by a practitioner, such as an endoscope probe, or the access and display on the receiving surface of a patient's file to obtain information (antecedents, medical risks, allergies). .). By "modifying the physical state of a patient, is meant, in general, any modification of the functioning or the physical condition of a patient, in particular, and by way of non-limiting example, the use of a electrosurgical unit to open the patient's body, to cut or cauterize tissues, to destroy cells, in particular tumor cells, or to inject gas into the patient's abdomen to perform a laparoscopy, this list being of course in no way limiting and only given for information only. Advantageously, the medical devices will be surgical medical devices.
Par « dispositif de projection », on entend un dispositif capable de projeter une information existante sur une surface définie. Le dispositif pourra notamment être équipé de moyens pour agrandir l'image à projeter. Ainsi, préférentiellement, le dispositif de projection sera un vidéoprojecteur. Equipé généralement d'une partie objectif, il pourra être équipé de différents systèmes optiques, permettant d'adapter l'information projetée en fonction de la distance entre le dispositif de projection et l'écran ou encore d'adapter l'image à la couleur de la surface de projection, afin d'optimiser le contraste et le rendu visuel. En outre, le dispositif de projection pourra être adapté à une utilisation en pièce stérile, et notamment, ledit dispositif pourra ne pas comporter de ventilateur. Le dispositif de commande pourra être équipé de plusieurs dispositifs de projection. Le dispositif de projection pourra être équipé de capteurs permettant d'adapter le dispositif à la surface de réception. Ledit dispositif pourra être solidaire d'un moyen de fixation, solidaire de la surface de réception ou complètement déporté sur une autre surface tel que le mur ou le plafond d'une salle d'opération par exemple. By "projection device" is meant a device capable of projecting existing information on a defined surface. The device may in particular be equipped with means for enlarging the image to be projected. Thus, preferentially, the projection device will be a video projector. Usually equipped with an objective part, it can be equipped with different optical systems, to adapt the projected information according to the distance between the projection device and the screen or to adapt the image to the color of the projection surface, to optimize contrast and visual rendering. In addition, the projection device may be adapted to use in a sterile room, and in particular, said device may not include a fan. The control device may be equipped with several projection devices. The projection device may be equipped with sensors for adapting the device to the receiving surface. Said device may be secured to a fastening means secured to the receiving surface or completely offset to another surface such as the wall or ceiling of an operating room for example.
Par « interface graphique », on entend l'interface permettant un dialogue homme/machine aisé, représentée sous forme graphique, dans laquelle sont représentées sous forme d'icônes ou de schémas, toutes les commandes des instruments que l'utilisateur pourra manipuler. Par « surface de réception », on entend la surface sur laquelle est projetée l'interface graphique. Cette surface peut notamment séparer un premier espace d'opération d'un deuxième espace d'opération par exemple afin d'isoler le praticien. By "graphic interface" is meant the interface allowing an easy man / machine dialogue, represented in graphic form, in which are represented in the form of icons or diagrams, all the commands of the instruments that the user can manipulate. By "receiving surface" is meant the surface on which the graphic interface is projected. This surface can in particular separate a first operating space from a second operating space for example to isolate the practitioner.
Par « espace d'opération », on entend de manière générale une zone de la salle d'opération dans laquelle le chirurgien et/ou ses assistants peuvent évoluer et/ou dans laquelle des appareils médicaux ou des objets peuvent être disposés. Un espace d'opération peut être stérile ou non et peut être utilisé au cours d'une opération ou non notamment selon son emplacement au sein de la salle d'opération. By "operating space" is generally meant an area of the operating room in which the surgeon and / or his assistants may evolve and / or in which medical devices or objects may be arranged. An operating space can be sterile or not and can be used during an operation or not in particular according to its location in the operating room.
Le premier espace d'opération et le deuxième espace d'opération peuvent notamment être distincts. Le deuxième espace d'opération pourra par exemple servir d'espace à l'anesthésiste, dans le cas non limitatif d'une opération de chirurgie. Avantageusement, la surface de réception est à proximité du praticien, à une distance inférieur à 2 mètres, et encore plus préférentiellement à une distance inférieure à 1 ,50 mètre. Dans le cas où le dispositif de commande serait équipé de plusieurs systèmes de projection, il pourra y avoir plusieurs surfaces de réception. La surface de projection pourra être de toute nature et avantageusement, la surface de réception est un champ stérile, utilisé pendant les opérations chirurgicales. Par champ stérile on entend un linge qui permet, une fois placé dans la zone d'intervention médicale, notamment lors d'opérations (par exemple en chirurgie générale, chirurgie viscérale, chirurgie vétérinaire, mais aussi en radiologie interventionnelle au sens large, ou lors d'endoscopies...), de définir un espace stérile au niveau de la zone d'intervention médicale. Par exemple, ce champ est non tissé, et typiquement il est accroché de façon sensiblement perpendiculaire à un patient allongé et isole généralement l'espace du chirurgien de celui de l'anesthésiste. Le champ stérile peut avoir les bords collant et pourra être transparent ou semi- transparent. La surface de réception défini deux espaces distincts, généralement, au moins l'un des deux espaces est stérile. Par « dispositif de localisation d'objets », on entend le dispositif capable de détecter la position et/ou le mouvement d'objets dans l'espace défini par la zone de capture et la surface de réception. L'objet détecté pourra être l'instrument en lui-même, mais aussi la main du chirurgien. La technologie utilisée pour le système de localisation d'objets pourra être une technologie de type « leap-motion », utilisant des capteurs optiques, un système « Kinect », ou tout autre système utilisant le principe de la stéréoscopie ou de la localisation d'objets. The first operation space and the second operation space can in particular be distinct. The second operation space may for example serve as space for the anesthetist, in the non-limiting case of a surgery operation. Advantageously, the receiving surface is close to the practitioner, at a distance of less than 2 meters, and even more preferably at a distance of less than 1.50 meters. In the case where the control device is equipped with several projection systems, there may be several reception surfaces. The projection surface may be of any kind and advantageously, the receiving surface is a sterile field, used during surgical operations. By sterile field is meant a cloth that, once placed in the medical intervention area, especially during operations (for example in general surgery, visceral surgery, veterinary surgery, but also in interventional radiology in the broad sense, or during endoscopies ...), to define a sterile space in the area of medical intervention. For example, this field is non-woven, and typically it is hooked substantially perpendicular to a patient generally elongates and isolates the space of the surgeon from that of the anesthetist. The sterile field may have sticky edges and may be transparent or semi-transparent. The receiving surface defines two distinct spaces, generally, at least one of the two spaces is sterile. By "object locator" is meant the device capable of detecting the position and / or movement of objects in the space defined by the capture area and the receiving surface. The detected object may be the instrument itself, but also the hand of the surgeon. The technology used for the object-locating system could be a leap-motion technology, using optical sensors, a "Kinect" system, or any other system using the stereoscopic or localization principle. objects.
Par « zone de capture », on entend la zone de l'espace où la localisation des objets a lieu. Cette zone de capture, définie comme étant la zone active dans laquelle placer la surface de réception sera située préférentiellement à proximité du praticien et notamment à une distance inférieur à 2 mètres, et préférentiellement à une distance inférieure à 1 ,50 mètre. Cette zone de capture définira avantageusement l'endroit où placer la surface de réception. By "capture zone" is meant the area of the space where the location of the objects takes place. This capture zone, defined as being the active zone in which to place the receiving surface will preferably be located near the practitioner and in particular at a distance of less than 2 meters, and preferably at a distance of less than 1.50 meters. This capture zone will advantageously define the place where to place the receiving surface.
Par « dispositif de communication », on entend le dispositif permettant l'interconnexion des équipements, par exemple du bloc opératoire, mais aussi leur commande. Le dispositif pourra être filaire, sans fil, et avantageusement ledit dispositif communiquera par une liaison par courants porteurs. By "communication device" means the device for interconnection of equipment, for example the operating room, but also their order. The device may be wired, wireless, and advantageously said device will communicate by a carrier current link.
Par « tierce personne », on entend toute personne différente de la personne qui réalise l'acte médical, qu'il soit chirurgical ou non. Par exemple, la tierce personne pourra être l'anesthésiste, lors d'une opération de chirurgie. Dans des modes de réalisation préférés de l'invention, on peut éventuellement avoir recours en outre à l'une et/ou à l'autre des dispositions suivantes : "Third person" means any person other than the person performing the medical act, whether surgical or not. For example, the third person may be the anesthesiologist during a surgery operation. In preferred embodiments of the invention, one or more of the following may also be used:
- la surface de réception est une surface souple, et en particulier un champ stérile ; - la surface de réception est disposée à proximité immédiate d'une zone opératoire d'une salle d'opération, préférentiellement à une distance inférieure à 2 mètres, encore plus préférentiellement à une distance inférieure à 1 ,5 mètre; the receiving surface is a flexible surface, and in particular a sterile field; - The receiving surface is disposed in the immediate vicinity of an operating area of an operating room, preferably at a distance of less than 2 meters, even more preferably at a distance of less than 1.5 meters;
- le dispositif de projection est un projecteur vidéo et plus particulièrement un projecteur vidéo à lumière froide; the projection device is a video projector and more particularly a cold light video projector;
- la surface de réception et le dispositif de projection ne sont pas en contact; the receiving surface and the projection device are not in contact;
- la zone de capture est disposée à proximité immédiate d'une zone opératoire d'un bloc opératoire et présente une dimension maximale inférieure à 2 mètres, préférentiellement une dimension maximale inférieure à 1 ,5 mètre; the capture zone is disposed in the immediate vicinity of an operating zone of an operating theater and has a maximum dimension of less than 2 meters, preferably a maximum dimension of less than 1.5 meters;
- le dispositif de communication est apte à communiquer avec l'appareil médical au moyen d'une liaison par courants porteurs en ligne; the communication device is able to communicate with the medical device by means of an in-line carrier link;
- le dispositif de communication est apte à communiquer avec l'appareil médical chirurgical au moyen d'une liaison sans fil; - le dispositif de communication est apte à communiquer avec au moins deux appareils médicaux, le dispositif de localisation d'objets est apte à détecter au moins deux mouvements, distincts, dudit au moins un objet dans la zone de capture, et le dispositif de communication est apte à transmettre, sur détection respective desdits au moins deux mouvements, au moins deux commandes prédéfinies respectives, respectivement auxdits au moins deux appareils médicaux. the communication device is able to communicate with the surgical medical device by means of a wireless link; the communication device is able to communicate with at least two medical devices, the device for locating objects is able to detect at least two distinct movements of the at least one object in the capture zone, and the communication device is able to transmit, on respective detection of said at least two movements, at least two respective predefined commands, respectively to said at least two medical devices.
L'invention a également pour objet un procédé de commande à distance avec ou sans contact, d'au moins un appareil médical, dans lequel : The invention also relates to a remote control method with or without contact, of at least one medical device, in which:
- on projette à distance une interface graphique sur au moins une surface de réception au moyen d'au moins un dispositif de projection, la surface de réception étant une surface physique séparant un premier espace d'opération d'un deuxième espace d'opération, a graphic interface is remotely projected onto at least one reception surface by means of at least one projection device, the receiving surface being a physical surface separating a first operating space from a second operating space,
- on détecte un mouvement d'au moins un objet dans au moins une zone de capture incluse dans le premier espace d'opération, au moyen d'au moins un dispositif de localisation d'objets, et a movement of at least one object is detected in at least one zone included in the first operation space, by means of at least one object-locating device, and
- sur détection dudit mouvement, on transmet une commande prédéfinie audit au moins un appareil médical au moyen d'un dispositif de communication. Dans des modes de réalisation préférés de l'invention, on peut éventuellement avoir recours en outre à l'une et/ou à l'autre des dispositions suivantes : - On detection of said movement, a predefined command is transmitted to said at least one medical device by means of a communication device. In preferred embodiments of the invention, one or more of the following may also be used:
- au cours d'une étape d'initialisation, on détecte une position spatiale d'au moins un point de la surface de réception, et on définit au moins un coefficient de correction géométrique de l'interface graphique et/ou de la zone de capture en fonction de ladite position spatiale ; during an initialization step, detecting a spatial position of at least one point of the reception surface, and defining at least one geometric correction coefficient of the graphic interface and / or the capture according to said spatial position;
- au cours d'une étape d'initialisation, on détecte une couleur d'au moins un point de la surface de réception, et on définit au moins un coefficient de correction de couleur de l'interface graphique en fonction de ladite couleur; during an initialization step, a color of at least one point of the reception surface is detected, and at least one color correction coefficient of the graphic interface is defined according to said color;
- la transmission d'une commande prédéfinie à l'appareil médical est empêchée tant qu'un opérateur n'a pas validé une liste de vérification; - The transmission of a predefined command to the medical device is prevented until an operator has validated a checklist;
- la liste de vérification est projetée à distance sur la surface de réception par le dispositif de projection; - The checklist is projected remotely on the receiving surface by the projection device;
- la liste de vérification comporte une pluralité de points de vérification et dans lequel, pour valider chacun desdits points de vérification, on détecte au moins un mouvement dudit au moins un objet dans la zone de capture au moyen du dispositif de localisation d'objets. the checklist comprises a plurality of verification points and in which, to validate each of said verification points, at least one movement of said at least one object in the capture zone is detected by means of the object locating device.
L'invention sera mieux comprise à l'aide de la description détaillée qui suit, en référence aux dessins schématiques annexés tels que : The invention will be better understood with the aid of the detailed description which follows, with reference to the appended schematic drawings such as:
La figure 1 illustre un dispositif de commande à distance avec ou sans contact, d'au moins un appareil médical selon un mode de réalisation de l'invention. FIG. 1 illustrates a device for remote control with or without contact, of at least one medical device according to one embodiment of the invention.
La figure 2 illustre un détail du dispositif de commande de la figure 1 . La figure 3 illustre une interface graphique dans un mode de réalisation du dispositif de commande de la figure 1. FIG. 2 illustrates a detail of the control device of FIG. 1. FIG. 3 illustrates a graphical interface in one embodiment of the control device of FIG. 1.
Les modes de réalisation décrits ci-après étant nullement limitatifs, on pourra notamment considérer des variantes de l'invention ne comprenant qu'une sélection de caractéristiques décrites, par la suite isolées des autres caractéristiques décrites (même si cette sélection est isolée au sein d'une phrase comprenant ces autres caractéristiques), si cette sélection de caractéristiques est suffisante pour conférer un avantage technique ou pour différencier l'invention par rapport à l'état de la technique antérieure. Cette sélection comprend au moins une caractéristique, de préférence fonctionnelle sans détails structurels, ou avec seulement une partie des détails structurels si cette partie uniquement est suffisante pour conférer un avantage technique ou pour différencier l'invention par rapport à l'état de la technique antérieure. The embodiments described hereinafter being in no way limiting, it will be possible to consider variants of the invention comprising only a selection of characteristics described, subsequently isolated from the other characteristics described (even if this selection is isolated within a sentence including these other features), if this selection of features is sufficient to confer a technical advantage or to differentiate the invention from the state of the prior art. This selection comprises at least one characteristic, preferably functional without structural details, or with only a part of the structural details if this part alone is sufficient to confer a technical advantage or to differentiate the invention from the state of the prior art .
Les figures 1 et 2 illustrent un dispositif de commande 1 à distance d'un appareil médical chirurgical 2 de bloc opératoire selon l'invention. Le dispositif 1 est plus particulièrement spécialement destiné à commander à distance un appareil médical chirurgical 2 apte à réaliser une modification de l'état physique d'un patient 3. La modification de l'état physique du patient 3 est notamment réalisée par l'appareil médical chirurgical 2 en fonction d'une commande prédéfinie d'un opérateur 4. L'opérateur 4 peut en particulier être un chirurgien en charge d'une opération chirurgicale sur le patient 3. Figures 1 and 2 illustrate a remote control device 1 of a surgical surgical unit 2 of the operating theater according to the invention. The device 1 is more particularly designed to remotely control a surgical medical device 2 adapted to perform a modification of the physical state of a patient 3. The modification of the physical state of the patient 3 is in particular carried out by the device 2. The operator 4 may in particular be a surgeon in charge of a surgical operation on the patient 3.
Comme illustré sur la figure 1 , le dispositif de commande 1 comporte un dispositif de projection 5, un dispositif de localisation d'objets 6, et un dispositif de communication 7. Ceux-ci peuvent notamment être organisés fonctionnellement comme suit. Le dispositif de projection 5 projette à distance une interface graphique 8 sur une surface de réception 9. As illustrated in FIG. 1, the control device 1 comprises a projection device 5, an object locating device 6, and a communication device 7. These can in particular be organized functionally as follows. The projection device 5 remotely projects a graphic interface 8 on a reception surface 9.
Le dispositif de localisation d'objets 6 détecte un mouvement d'un objet 10 dans une zone de capture 1 1 . L'objet 10 est détaillé davantage ci-après mais peut, à titre d'exemple, être une main d'un chirurgien. Le mouvement de l'objet 10 est par exemple illustré par la flèche 20 sur les figures. The object locating device 6 detects a movement of an object 10 in a capture area 11. The object 10 is further detailed below but may, by way of example, be a hand of a surgeon. The movement of the object 10 is for example illustrated by the arrow 20 in the figures.
Enfin, sur détection dudit mouvement, le dispositif de communication 7 transmet une commande prédéfinie à l'appareil médical chirurgical de bloc opératoire 2. Finally, on detection of said movement, the communication device 7 transmits a predefined command to Surgical Operating Room Surgical Unit 2.
Plus précisément, dans un mode de réalisation de l'invention, le dispositif de projection 5 permet de projeter, à travers la zone de capture 1 1 définie par le dispositif, une interface graphique 8 permettant au chirurgien d'interagir sur ses instruments, c'est-à-dire sur l'appareil médical chirurgical 2, dans le cas non limitatif d'une opération chirurgicale. Dans un mode de réalisation, la surface de réception 9 est disposée à proximité immédiate d'une zone opératoire 18 du bloc opératoire, préférentiellement à une distance inférieure à 2 mètres, encore plus préférentiellement à une distance inférieure à 1 ,5 mètre. De cette manière, l'opérateur 4, notamment le chirurgien, peut rester debout à l'endroit du champ opératoire et observer sans se déplacer l'interface graphique 8. More precisely, in one embodiment of the invention, the projection device 5 makes it possible to project, through the capture area 1 1 defined by the device, a graphical interface 8 enabling the surgeon to interact on his instruments, c that is to say on the surgical medical device 2, in the non-limiting case of a surgical operation. In one embodiment, the receiving surface 9 is disposed in the immediate vicinity of an operating zone 18 of the operating theater, preferably at a distance of less than 2 meters, even more preferably at a distance of less than 1.5 meters. In this way, the operator 4, in particular the surgeon, can remain standing at the location of the operating field and observe without moving the graphic interface 8.
La surface de projection 9 peut notamment séparer un premier espace d'opération 100 d'un deuxième espace d'opération 200. The projection surface 9 can in particular separate a first operating space 100 from a second operating space 200.
Les espaces d'opération 100, 200 sont notamment des zones stériles ou non de la salle d'opération dans lesquelles le chirurgien et/ou ses assistants peuvent évoluer et/ou dans lesquelles des appareils médicaux ou des objets peuvent être disposés. Un espace d'opération peut être utilisé au cours d'une opération ou non notamment selon son emplacement au sein de la salle d'opération. Le premier espace d'opération 100 peut en particulier inclure la zone de capture 1 1 . Dans un mode de réalisation, la surface de réception 9 est une surface souple. La surface de réception 9 peut en particulier être un champ stérile. Dans une variante, la surface de réception 9 peut être une tablette rigide, par exemple une tablette disposée à proximité immédiate d'une zone opératoire 18, notamment une tablette stérile. De manière générale, la surface de réception 9 et le dispositif de projection 5 ne sont pas en contact. Ceci permet de garantir si besoin la stérilité de la surface de réception 9 de façon aisée. The operating spaces 100, 200 are particularly sterile areas or not in the operating room in which the surgeon and / or his assistants can evolve and / or in which medical devices or objects can be arranged. An operating space may be used during an operation or not in particular according to its location within the operating room. The first operation space 100 may in particular include the capture area 1 1. In one embodiment, the receiving surface 9 is a flexible surface. The receiving surface 9 may in particular be a sterile field. Alternatively, the receiving surface 9 may be a rigid tablet, for example a tablet disposed in the immediate vicinity of an operating area 18, including a sterile tablet. In general, the receiving surface 9 and the projection device 5 are not in contact. This makes it possible to guarantee, if necessary, the sterility of the reception surface 9 in an easy manner.
Dans un mode particulier de l'invention, le dispositif de projection 5 sera un vidéoprojecteur, fixé par exemple sur une potence, comme illustré en figure 1 . La partie 12 constituant l'objectif du vidéoprojecteur pourra être équipée d'un système optique au sens large, permettant une adaptation de la projection de l'interface graphique 8 sur la surface de réception 9, notamment le champ stérile. Ce mode de réalisation permettra par exemple, dans le cas où le champ stérile 9 est fixé sur un bras ou un portique mobile 13, d'équiper l'objectif 12 d'une ou plusieurs lentilles, ou de tout système optique permettant le contrôle de la focalisation de l'interface graphique 8 projetée, de façon à régler la mise au point du vidéoprojecteur 5 ou de corriger la déformation de l'image, que ce soit par des moyens optiques, électroniques ou logiciels. Dans le même esprit, il sera évident de comprendre que l'objectif 12 du vidéoprojecteur 5 pourra comprendre tout système optique permettant de réaliser des agrandissements ou des rétrécissements de l'affichage de l'interface graphique 8. Dans un autre mode de réalisation de l'invention, l'objectif 12 pourra être équipé de filtres chromatiques au sens large, permettant de d'adapter la couleur de l'interface graphique 8 à la couleur de la surface de réception 9, notamment du champ stérile, sur lequel l'interface graphique 8 est projetée, dans le but d'optimiser le contraste visuel et améliorer le confort de vision de l'opérateur, notamment du chirurgien. In a particular embodiment of the invention, the projection device 5 will be a video projector, fixed for example on a bracket, as illustrated in FIG. Part 12 constituting the objective of the video projector may be equipped with an optical system in the broad sense, allowing adaptation of the projection of the interface graph 8 on the receiving surface 9, in particular the sterile field. This embodiment will enable, for example, in the case where the sterile field 9 is fixed on an arm or a mobile gantry 13, to equip the objective 12 with one or more lenses, or any optical system allowing the control of the focusing of the projected graphic interface 8, so as to adjust the focus of the projector 5 or to correct the deformation of the image, whether by optical, electronic or software means. In the same spirit, it will be obvious to understand that the objective 12 of the video projector 5 may include any optical system for making enlargements or narrowing of the display of the graphical interface 8. In another embodiment of the invention invention, the lens 12 may be equipped with color filters in the broad sense, to adapt the color of the graphic interface 8 to the color of the receiving surface 9, including the sterile field, on which the interface graph 8 is projected, with the aim of optimizing the visual contrast and improving the vision comfort of the operator, especially the surgeon.
Dans encore un autre mode de réalisation, l'interface graphique 8 pourra être projetée par un dispositif de projection 5 par balayage laser. Par exemple, le système PicoP de Micro Vision pourra être utilisé pour projeter l'information. Un tel dispositif de projection 5 pourra notamment être afocal. De cette façon, le chirurgien n'aura pas besoin de régler la mise au point du projecteur 5, notamment en cas de déplacement de la surface de réception 9, notamment du champ stérile L'opérateur pourra ainsi rester concentré sur son acte. In yet another embodiment, the graphic interface 8 may be projected by a laser scanning device 5. For example, Micro Vision's PicoP system can be used to project information. Such a projection device 5 may in particular be afocal. In this way, the surgeon will not need to adjust the focus of the projector 5, especially in case of displacement of the receiving surface 9, including the sterile field The operator can thus remain focused on his act.
Dans un autre mode de réalisation, l'objectif 12 du dispositif de projection 5 pourra être équipé d'un ou plusieurs filtres, par exemple de type polarisé ou temporel avec des obturateurs, permettant de projeter des informations 3D dans la zone de capture 1 1 . Le chirurgien pourra notamment porter des lunettes permettant de visualiser cette information 3D. In another embodiment, the objective 12 of the projection device 5 may be equipped with one or more filters, for example polarized or temporal type with shutters, for projecting 3D information in the capture area 1 1 . The surgeon may in particular wear glasses to visualize this 3D information.
Dans un mode préféré de l'invention, le projecteur 5 ne contient pas de ventilateur et peut comporter au moins une source de lumière froide telle qu'une diode électroluminescente (DEL) améliorant la qualité d'un milieu interventionnel stérile comme un bloc opératoire. In a preferred embodiment of the invention, the projector 5 does not contain a fan and may include at least one cold light source such as a light-emitting diode (LED) improving the quality of a sterile interventional medium such as a surgical unit.
Dans un mode préféré de l'invention, le dispositif de projection 5 est situé du côté opposé à la zone interventionnelle médicale stérile ou champ opératoire, par rapport à la surface de réception 9, notamment au champ stérile, et projette une interface graphique 8 au moins partiellement inversée. Un utilisateur, par exemple un chirurgien, et un autre utilisateur, par exemple l'anesthésiste, peuvent ainsi avoir respectivement leur propre interface graphique. In a preferred embodiment of the invention, the projection device 5 is located on the opposed to the sterile medical interventional zone or operative field, with respect to the receiving surface 9, in particular the sterile field, and projects a graphical interface 8 at least partially inverted. A user, for example a surgeon, and another user, for example the anesthetist, can have their own graphical interface respectively.
Dans un mode particulier de l'invention, le dispositif de projection 5 sera équipé de un ou plusieurs capteurs 14, permettant par exemple la mesure de positionnement de la surface de réception 9, notamment du champ stérile, ou encore de détecter la forme de la surface de réception 9, notamment du champ stérile. De cette façon il est possible de garantir une visualisation optimale de l'interface 8 et des informations projetées en adaptant le dispositif de projection 5 de l'image à la déformation de la zone de projection. Par exemple, on pourra utiliser un programme d'ordinateur qui permettra de corriger et/ou adapter le dispositif de projection 5 comme la technique de Projection Mapping. Ainsi par exemple, au cours d'une étape d'initialisation du système et du procédé de commande, on peut détecter la position spatiale d'un ou de plusieurs points de la surface de réception 9, notamment à l'aide du capteur 14. Cette position spatiale est par exemple détectée par rapport au dispositif de projection 5. Puis, on peut définir au moins un modèle géométrique coefficient de correction géométrique de l'interface graphique 9 en fonction de ladite ou desdites positions spatiales. Ainsi, on pourra calibrer par exemple la position des doigts ou encore l'emplacement de la zone de projection. In a particular embodiment of the invention, the projection device 5 will be equipped with one or more sensors 14, allowing, for example, the positioning measurement of the reception surface 9, in particular of the sterile field, or the detection of the shape of the receiving surface 9, especially the sterile field. In this way it is possible to guarantee an optimal visualization of the interface 8 and the projected information by adapting the projection device 5 of the image to the deformation of the projection zone. For example, we can use a computer program that will correct and / or adapt the projection device 5 as the Projection Mapping technique. Thus, for example, during a step of initializing the system and the control method, it is possible to detect the spatial position of one or more points of the reception surface 9, in particular using the sensor 14. This spatial position is for example detected with respect to the projection device 5. Then, it is possible to define at least one geometrical model geometric correction coefficient of the graphical interface 9 as a function of said one or more spatial positions. Thus, it will be possible to calibrate for example the position of the fingers or the location of the projection zone.
Par ailleurs, au cours de ladite étape d'initialisation, on peut également détecter la couleur d'un ou de plusieurs points de la surface de réception 9, notamment à l'aide du capteur 14. On peut alors définir au moins un coefficient de correction de couleur de l'interface graphique 9 en fonction de ladite couleur. Moreover, during said initialization step, it is also possible to detect the color of one or more points of the reception surface 9, in particular by means of the sensor 14. It is then possible to define at least one coefficient of color correction of the graphical interface 9 according to said color.
Dans un mode particulier de réalisation, le capteur 14 pourra se trouver côté projecteur 5 par rapport à la surface de réception 9, comme côté stérile, afin de mesurer et contrôler l'intensité lumineuse sur le champ. L'utilisateur pourra adapter la puissance de la lampe du vidéoprojecteur en fonction de l'éclairage ambiant. In a particular embodiment, the sensor 14 may be on the projector side 5 with respect to the receiving surface 9, as the sterile side, in order to measure and control the light intensity on the field. The user can adapt the power of the lamp of the projector according to the ambient lighting.
De manière avantageuse, le système comprend deux capteurs 14 localisés de part et d'autre de la surface de réception 9, notamment du champ stérile. Advantageously, the system comprises two sensors 14 localized from and other of the receiving surface 9, in particular the sterile field.
L'interface graphique 8 de cette invention est définie comme étant tout système permettant par exemple un dialogue homme/machine, dans lequel des objets à manipuler sont représentés typiquement sous forme de pictogrammes spécifiques de chaque dispositif médical, imitant la manipulation physique de ces objets avec un système de pointage. Par exemple, une représentation graphique de l'interface graphique est donnée en figure 3. The graphic interface 8 of this invention is defined as any system allowing, for example, a human / machine dialogue, in which objects to be manipulated are typically represented in the form of specific pictograms of each medical device, imitating the physical manipulation of these objects with a pointing system. For example, a graphic representation of the graphical interface is given in FIG.
Le dispositif de localisation d'objets 6 permet notamment de détecter la position et/ou le mouvement d'objet 10 dans l'espace. Cette détection défini une zone de capture 1 1 , dans laquelle le chirurgien 4 peut effectuer des gestes de commandes. Dans un mode particulier de l'invention, la surface de réception est un champ stérile. Ainsi, l'utilisateur, par exemple le chirurgien, peut utiliser cette surface de réception pour effectuer une commande, sans conséquence pour la suite du déroulement de l'opération, contrairement à l'utilisation d'un écran LCD, où un simple contact entre le chirurgien et l'écran oblige un arrêt temporaire de l'opération pour changer les gants destérilisés du praticien. Ce dispositif permet de déterminer la position des mains du chirurgien, et d'en définir le mouvement. Ainsi, il pourra être attribué à un geste, une action spécifique d'un dispositif médical et/ou chirurgical réalisant une modification de l'état physique d'un patient par exemple, tout en respectant les conditions de stérilité s'appliquant au chirurgien dans un milieu interventionnel médical. The object locating device 6 makes it possible in particular to detect the position and / or the movement of the object 10 in the space. This detection defines a capture area 1 1, in which the surgeon 4 can perform control gestures. In a particular embodiment of the invention, the receiving surface is a sterile field. Thus, the user, for example the surgeon, can use this reception surface to carry out a command, without any consequence for the rest of the course of the operation, unlike the use of an LCD screen, where a simple contact between the surgeon and the screen requires a temporary stop of the operation to change the gloves de-sterilized practitioner. This device allows to determine the position of the surgeon's hands, and to define the movement. Thus, it may be attributed to a gesture, a specific action of a medical device and / or surgical realizing a modification of the physical state of a patient for example, while respecting the conditions of sterility applying to the surgeon in a medical interventional environment.
La zone de capture 1 1 est par exemple disposée à proximité immédiate du champ opératoire de la salle d'opération. La zone de capture 1 1 présente par exemple une dimension maximale inférieure à 2 mètres, préférentiellement une dimension maximale inférieure à 1 ,5 mètre, afin de permettre à l'opérateur de la parcourir entièrement par les seuls mouvements des bras, notamment sans nécessiter un déplacement de l'opérateur 4. The capture area 1 1 is for example disposed in the immediate vicinity of the operative field of the operating room. The capture zone 1 1 has, for example, a maximum dimension of less than 2 meters, preferably a maximum dimension of less than 1.5 meters, in order to allow the operator to travel entirely through the movements of the arms alone, in particular without requiring a moving the operator 4.
Typiquement, le dispositif de localisation d'objets 6 comprend au moins un capteur 15 et est éventuellement complété de un ou plusieurs émetteurs 16. Typically, the object locating device 6 comprises at least one sensor 15 and is optionally completed with one or more transmitters 16.
Dans un mode particulier de l'invention, ces capteurs 15 sont basés sur des capteurs optiques, par exemple à la longueur d'onde visible ou IR. Les capteurs 15 sont par exemple une caméra optique ou infrarouge. Dans un mode particulier de l'invention, le dispositif de localisation d'objets 6 utilisera la technologie « Leap Motion ». Cette technologie, composée d'un triplet de lampes infrarouges 16 et 2 capteurs 15 optiques permet un éclairage de la scène via un émetteur IR. Les capteurs 15 captent l'intensité lumineuse réfléchie par les objets 10. In a particular embodiment of the invention, these sensors 15 are based on optical sensors, for example at the visible wavelength or IR. The sensors 15 are for example an optical or infrared camera. In a particular embodiment of the invention, the object locating device 6 will use the "Leap Motion" technology. This technology, consisting of a triplet of infrared lamps 16 and 2 optical sensors 15 allows lighting of the scene via an IR transmitter. The sensors 15 capture the light intensity reflected by the objects 10.
Il est bien évident et facilement compréhensible par l'homme du métier que l'invention ne sera pas limitée à ce type de technologies pour la localisation d'objets. Dans un mode particulier de réalisation, le système « Kinect » pourra être utilisé, tout comme le système « Wavi Xtion » (ASUS) ou tout autre système utilisant le principe de stéréoscopie ou de localisation d'objet. It is quite obvious and easily understood by those skilled in the art that the invention will not be limited to this type of technology for locating objects. In a particular embodiment, the "Kinect" system may be used, as may the "Wavi Xtion" (ASUS) system or any other system using the stereoscopic or object-localization principle.
Les objets 10 comprennent par exemple les mains, les doigts et/ou l'avant-bras du chirurgien ou encore les instruments d'interventions médicales. The objects 10 include for example the hands, the fingers and / or the forearm of the surgeon or the instruments of medical interventions.
La position des mains, des doigts et/ou de l'avant-bras du chirurgien pourra donc être détectée, au même titre que les instruments d'interventions médicales sans qu'il soit nécessaire qu'un capteur soit porté par le chirurgien. The position of the hands, fingers and / or the forearm of the surgeon can be detected, as well as medical intervention instruments without the need for a sensor to be worn by the surgeon.
Le système de commande 1 pourra comporter au moins un moyen de paramétrage permettant de calibrer la projection de l'interface graphique 9 par rapport au dispositif de localisation d'objets 6 et de la position de la surface de réception 8, notamment du champ stérile. Ce moyen de paramétrage, comportant des éléments mécaniques ou, comportant des éléments de traitements par logiciel ou, comportant des éléments mécaniques et de traitements par logiciel, permet notamment, en modifiant l'angle d'inclinaison du dispositif de localisation d'objets 6 de modifier, selon les besoins de l'utilisateur, la zone de capture 1 1 en confinant cet espace à volume limité par rapport à la capacité du dispositif de localisation d'objets 6. Le moyen de paramétrage du dispositif de localisation 6 peut également être automatisé à l'aide de moyens moteurs. The control system 1 may comprise at least one parameterizing means for calibrating the projection of the graphical interface 9 relative to the object locating device 6 and the position of the receiving surface 8, in particular the sterile field. This parameterization means, comprising mechanical elements or comprising processing elements by software or, comprising mechanical elements and software treatments, makes it possible, in particular, by modifying the angle of inclination of the device for locating objects 6. to modify, according to the needs of the user, the capture zone 1 1 by confining this limited volume space with respect to the capacity of the object locating device 6. The setting device of the locating device 6 can also be automated using motor means.
Ainsi, de manière similaire à ce qui a été décrit ci-dessus concernant le dispositif de projection 5, au cours d'une étape d'initialisation, on peut détecter une position spatiale d'au moins un point de la surface de réception 9. Par exemple la position spatiale par rapport au dispositif de projection 5 ou au dispositif de localisation d'objets 6. On peut alors définir au moins un coefficient de correction géométrique de la zone de capture 1 1 en fonction de ladite position spatiale d'au moins un point de la surface de réception 9. Thus, similarly to what has been described above concerning the projection device 5, during an initialization step, it is possible to detect a spatial position of at least one point of the reception surface 9. For example, the spatial position with respect to the projection device 5 or to the device for locating objects 6. It is then possible to define at least one geometric correction coefficient of the capture area 1 1 according to said spatial position of at least one point of the receiving surface 9.
De manière non limitative, les différentes commandes possibles d'appareils médicaux chirurgicaux sont par exemple ; -commande de l'intensité de puissance du bistouri électrique ou de tout appareil médical d'hémostase In a nonlimiting manner, the various possible commands of surgical medical devices are for example; -control of the power intensity of the electrocautery or any medical hemostasis device
-commande des modes d'électrocoagulation (bipolaire, monopolaire...) -control electrocoagulation modes (bipolar, monopolar ...)
-commande du positionnement de la table d'opération -control of the positioning of the operating table
-commande de système de destruction tumorale (par exemple écho de puissance, radiofréquence, ...) -control of tumor destruction system (eg power echo, radiofrequency, ...)
-commande des différents matériels situés sur une colonne de cœlioscopie (insufflateur, caméra, lumière froide...) -control of different materials located on a laparoscopic column (insufflator, camera, cold light ...)
Dans des modes particuliers de réalisation, le système peut en outre permettre la commande de dispositifs et éléments autres du bloc opératoire, notamment : -commande de système d'imagerie peropératoire (par exemple échographie...) In particular embodiments, the system may also allow the control of devices and other elements of the operating theater, in particular: - control of intraoperative imaging system (for example ultrasound ...)
-déclenchement de la capture et de la lecture de vidéos, de dossiers patients (radiologie, antécédents...) - triggering the capture and reading of videos, patient files (radiology, antecedents ...)
-commande du positionnement ou de l'intensité de l'éclairage opératoire Ces commandes sont intégrées au sein d'une interface graphique 8 adaptée en termes d'ergonomie au dispositif de projection et d'interaction (taille des boutons, couleurs, séquences, etc.). En effet, les champs stériles étant généralement de couleur bleue ou verte, le choix des teintes de l'interface doit permettre d'optimiser le rendu des couleurs de cette dernière sur le champ stérile, par exemple en utilisant des couleurs opposées au bleu et au vert sur le cercle chromatique. Le champ stérile est alors un fond adapté pour la projection de l'interface graphique 8 comme détaillé ci-avant. -control of the positioning or the intensity of the operating light These commands are integrated within a graphic interface 8 adapted in terms of ergonomics to the projection and interaction device (size of the buttons, colors, sequences, etc. .). Indeed, since the sterile fields are generally blue or green, the choice of interface colors should make it possible to optimize the color rendering of the latter on the sterile field, for example by using colors that are opposite to blue and green. green on the color wheel. The sterile field is then a suitable background for the projection of the graphical interface 8 as detailed above.
La zone de capture 1 1 créé par le dispositif de projection 5 peut définir l'endroit où va être projeté l'interface graphique 8. Typiquement cette zone de capture 1 1 sera délimitée à au moins une extrémité par la surface passive de réception 9, notamment un champ stérile. The capture area 1 1 created by the projection device 5 can define the place where the GUI 8 is projected. Typically, this capture zone 11 will be delimited at at least one end by the passive receiving surface 9, in particular a sterile field.
Par champ stérile on entend un linge qui permet, une fois placé dans la zone d'intervention médicale, notamment lors d'opérations (par exemple en chirurgie générale, chirurgie viscérale, chirurgie vétérinaire, mais aussi en radiologie interventionnelle au sens large, ou lors d'endoscopies...), de définir un espace stérile au niveau de la zone d'intervention médicale. Par exemple, ce champ est non tissé, et typiquement il est accroché de façon sensiblement perpendiculaire à un patient allongé et isole généralement l'espace du chirurgien de celui de l'anesthésiste. Le champ stérile peut avoir les bords collant et pourra être transparent ou semi- transparent. Généralement, il est fixé à au moins une potence à l'aide d'un système d'accroché. Dans un mode particulier de l'invention, le champ stérile pourra être fixé sur une barre horizontale ou verticale, elle-même fixé sur la table d'opération ou directement sur le sol. By sterile field is meant a cloth that, once placed in the medical intervention area, especially during operations (for example in general surgery, visceral surgery, veterinary surgery, but also in interventional radiology in the broad sense, or during endoscopies ...), to define a sterile space in the area of medical intervention. For example, this field is non-woven, and typically it is hung substantially perpendicular to an elongated patient and generally isolates the space of the surgeon from that of the anesthetist. The sterile field may have sticky edges and may be transparent or semi-transparent. Generally, it is attached to at least a bracket with a hooked system. In a particular embodiment of the invention, the sterile field may be fixed on a horizontal or vertical bar, itself fixed on the operating table or directly on the ground.
Dans un mode particulier de l'invention, ce champ pourra être tenu sur un bras mobile, permettant de le déplacer facilement. En outre, l'ensemble système de projection/zone de capture peut être solidarisé sur un bras fixé par exemple sur le mur ou sur le plafond. Ainsi, cet ensemble pourrait être situé de part et d'autre du champ stérile opératoire. In a particular embodiment of the invention, this field may be held on a movable arm, allowing it to be easily moved. In addition, the entire projection system / capture area can be secured to an arm fixed for example on the wall or on the ceiling. Thus, this set could be located on both sides of the operating sterile field.
Bien entendu, il sera facile à comprendre que la surface de réception 9 sur laquelle on vient projeter l'interface graphique 8 ne sera pas nécessairement stérile. L'invention pourra être utilisée par exemple, dans un mode de réalisation particulier, pour des examens endoscopiques, ou la stérilité de la salle d'opération ou d'examen n'est pas une obligation. Of course, it will be easy to understand that the receiving surface 9 on which the graphic interface 8 is projected will not necessarily be sterile. The invention may be used for example, in a particular embodiment, for endoscopic examinations, or the sterility of the operating room or examination is not an obligation.
Un système de traitement de données 17, permet de déterminer les positions d'un objet 10 et d'en définir son mouvement. Il peut être embarqué dans au moins un des dispositifs du système 1 ou déporté de ceux-ci. Il peut aussi être embarqué dans une unité de calcul implantée et peut notamment être intégré dans le dispositif de localisation d'objets 6 ou de projection 5. Il peut typiquement s'agir d'un processeur, d'un ordinateur ou d'une tablette. Par système de traitement des données, on entend tout système permettant notamment de modéliser par quelque moyen que ce soit, la position et/ou le mouvement d'un objet dans l'espace par rapport à l'interface graphique projetée et de définir un système de pointage. A data processing system 17 makes it possible to determine the positions of an object 10 and to define its movement. It can be embedded in at least one of the devices of the system 1 or deported thereof. It can also be embedded in an implanted computing unit and can notably be integrated in the device for locating objects 6 or projection 5. It can typically be a processor, a computer or a tablet . A data processing system is any system that allows the model to be modeled by any means whatsoever. position and / or movement of an object in space relative to the projected graphical interface and to define a pointing system.
Le dispositif de communication 7 et de transfert des commandes permet l'interconnexion avec les équipements de la salle d'opération ainsi que leur commande. Un tel dispositif peut émettre un signal vers les dispositifs médicaux à commande électronique du milieu interventionnel médical pour par exemple commander la position de la table d'opération. On entend par dispositif de communication 7 et de transfert des commandes, tout dispositif permettant par exemple d'interagir et de commander notamment les fonctionnalités des appareils médicaux chirurgicaux du milieu interventionnel médical, de bases de données, du réseau connecté. The communication device 7 and transfer commands allows interconnection with the equipment of the operating room and their order. Such a device can send a signal to the electronically controlled medical devices of the medical interventional medium for example to control the position of the operating table. The term "communication device 7" and "transfer of commands" means any device that makes it possible, for example, to interact and control, in particular, the functionalities of the surgical medical devices of the medical interventional environment, of the databases, of the connected network.
Le système de commande 1 selon l'invention permet ainsi en particulier d'utiliser dans un milieu interventionnel médical une interface virtuelle projetée sur un champ stérile qui sépare en général l'espace du chirurgien (stérile) de celui des anesthésistes et évite en particulier au médecin d'avoir à prendre le risque de contaminer et donc d'avoir à changer ses gants destérilisés pour la commande des équipements médicaux. Le champ stérile positionné typiquement en début d'intervention et maintenu généralement par un système de fixation comme par exemple un ensemble de potences. Par ailleurs, le dispositif peut être équipé d'un système de commande vocale. Dans ce mode particulier de l'invention, le système de commande vocale pourra permettre au chirurgien d'allumer et/ou éteindre et/ou mettre en veille le dispositif. En addition de ce mode particulier, le dispositif peut comporter un système de restitution sonore. Le chirurgien aura donc la certitude, sans avoir besoin de vérifier visuellement, que la commande qu'il vient de passer a bien été prise en compte par le dispositif. Il pourra ainsi utiliser son équipement en toute sécurité. The control system 1 according to the invention thus makes it possible in particular to use, in a medical interventional environment, a virtual interface projected on a sterile field which generally separates the space of the (sterile) surgeon from that of the anesthetists and avoids in particular the doctor to have to take the risk of contaminating and therefore having to change his desilterized gloves for the control of medical equipment. The sterile field typically positioned at the beginning of intervention and generally maintained by a fastening system such as a set of brackets. Moreover, the device can be equipped with a voice control system. In this particular embodiment of the invention, the voice control system may allow the surgeon to switch on and / or switch off and / or put the device in standby. In addition to this particular mode, the device may include a sound reproduction system. The surgeon will be certain, without the need to check visually, that the command he has just passed has been taken into account by the device. He will be able to use his equipment safely.
De plus, les différents systèmes du dispositif peuvent communiquer entre eux et/ou avec les équipements du milieu interventionnel médical par un système de câblage ou par un système sans fil, par exemple en utilisant la technologie Wifi ou Bluetooth. Dans un mode préféré de réalisation de l'invention, les différents systèmes du dispositif peuvent communiquer entre eux et/ou avec les équipements du milieu interventionnel médical par un système de câblage CPL (courant porteur). Ainsi en particulier le dispositif de communication 7 peut être apte à communiquer avec les appareils médicaux chirurgicaux 2 de bloc opératoire au moyen d'une liaison par courants porteurs en ligne. In addition, the various systems of the device can communicate with each other and / or with the equipment of the medical interventional environment by a cabling system or by a wireless system, for example using Wifi or Bluetooth technology. In a preferred embodiment of the invention, the various systems of the device can communicate with each other and / or with the equipment of the medical interventional medium by a cabling system CPL (carrier current). Thus, in particular, the communication device 7 may be able to communicate with the operating theater surgical medical devices 2 by means of an in-line carrier link.
Cette technique ici mise en avant consistant à construire un réseau informatique, peu coûteuse, fiable et sobre en consommation de ressources est idéale pour la gestion intégrée et en grande partie automatisée de tous les instruments entre eux. This technique, highlighted by the construction of an inexpensive, reliable and resource-efficient computer network, is ideal for the integrated and largely automated management of all instruments.
En variante, les différents systèmes du dispositif pourront communiquer entre eux et/ou avec les équipements du milieu interventionnel médical par des liaisons sans fils. Ainsi le dispositif de communication 7 pourra être apte à communiquer avec les appareils médicaux chirurgicaux 2 de bloc opératoire au moyen d'une liaison sans fil. As a variant, the various systems of the device will be able to communicate with each other and / or with the equipment of the medical interventional environment via wireless links. Thus the communication device 7 may be able to communicate with surgical medical equipment 2 operating room by means of a wireless link.
Enfin, le dispositif peut recevoir une alimentation électrique par tout moyen, notamment par secteur ou par batterie. Dans un mode particulier de réalisation où il a présence d'un système de câblage, les câbles d'interconnexions seraient préférentiellement intégrer au système de fixation du champ stérile, afin de minimiser le passage des câbles au milieu de la chambre d'opération. Finally, the device can receive a power supply by any means, in particular by sector or battery. In a particular embodiment where it has the presence of a wiring system, the interconnection cables would preferentially integrate with the sterile field fixing system, in order to minimize the passage of the cables in the middle of the operating chamber.
Le système 1 selon l'invention peut notamment être mis en œuvre dans une procédé de commande à distance d'un appareil médical chirurgical 2 de bloc opératoire tel qu'il va maintenant être décrit. Un tel procédé peut en particulier être spécialement destiné à commander à distance un appareil médical chirurgical 2 apte à réaliser une modification de l'état physique d'un patient 3 en fonction d'une commande prédéfinie d'un opérateur 4 The system 1 according to the invention may in particular be implemented in a method for remote control of a surgical medical device 2 operating theater as will now be described. Such a method may in particular be especially intended for remotely controlling a surgical medical device 2 adapted to perform a modification of the physical state of a patient 3 according to a predefined command from an operator 4
Dans un tel procédé selon l'invention, mise en œuvre au moyen d'un dispositif de commande 1 selon l'invention : In such a method according to the invention, implemented by means of a control device 1 according to the invention:
- on projette à distance une interface graphique 8 sur une surface de réception 9 au moyen d'un dispositif de projection 5, a graphic interface 8 is remotely projected onto a reception surface 9 by means of a projection device 5,
- on détecte un mouvement d'au moins un objet 10 dans une zone de capture 1 1 au moyen d'un dispositif de localisation d'objets 6, et a motion of at least one object 10 is detected in a capture zone 11 by means of an object locating device 6, and
- sur détection dudit mouvement, on transmet une commande prédéfinie à l'appareil médical chirurgical 2 de bloc opératoire au moyen d'un dispositif de communication 7. Dans un mode de réalisation particulier, la transmission d'une commande prédéfinie à l'appareil médical chirurgical 2 de bloc opératoire au moyen du dispositif de communication 7 peut être empêchée tant qu'un opérateur 4 n'a pas validé une liste de vérification. Le système de commande ne pourra être actif auprès des différents dispositifs médicaux qu'après validation d'une liste de vérification de données visant à sécuriser l'acte opératoire - Upon detection of said movement, a predefined command is transmitted to the operating theater surgical medical device 2 by means of a communication device 7. In a particular embodiment, the transmission of a predefined command to the operating theater surgical medical device 2 by means of the communication device 7 can be prevented until an operator 4 has validated a checklist. The control system can only be active with the various medical devices after validation of a data checklist to secure the operating procedure
La liste de vérification peut par exemple être affichée sur la surface de réception 9, notamment en étant affichée sur l'interface graphique 8 projetée à distance par le dispositif de projection 4. La liste de vérification est par exemple une liste comportant plusieurs points de vérification. Par « points de vérification » on entend des éléments que l'opérateur 4, notamment le chirurgien ou un assistant, doit vérifier pour répondre à des obligations légales ou non (sorte check-list des pilotes) avant de conduire l'opération. Dans un mode de réalisation particulier de l'invention, pour valider chacun desdits points de vérification, on détecte au moins un mouvement de l'objet 10 dans la zone de capture 1 1 au moyen du dispositif de localisation d'objets 6, par exemple un signe de la main du chirurgien indiquant qu'un point de vérification de la liste de vérification a été contrôlé. The checklist may for example be displayed on the reception surface 9, in particular by being displayed on the graphic interface 8 remotely projected by the projection device 4. The checklist is for example a list comprising several checkpoints. . By "verification points" we mean elements that the operator 4, in particular the surgeon or assistant, must check to meet legal obligations or not (checklist kind of drivers) before conducting the operation. In a particular embodiment of the invention, to validate each of said verification points, at least one movement of the object 10 is detected in the capture zone 1 1 by means of the object locating device 6, for example a sign from the surgeon's hand indicating that a checkpoint on the checklist has been checked.

Claims

R E V E N D I C A T I O N S
1 . Dispositif de commande (1 ) à distance avec ou sans contact, d'au moins un appareil médical (2), comportant : 1. Remote control device (1) with or without contact, of at least one medical device (2), comprising:
- au moins un dispositif de projection (5) d'une interface graphique (8) sur au moins une surface de réception (9), at least one projection device (5) for a graphic interface (8) on at least one reception surface (9),
- au moins un dispositif de localisation d'objets (6) pour détecter un mouvement d'au moins un objet (10) dans au moins une zone de capture (1 1 ), et at least one object locating device (6) for detecting a movement of at least one object (10) in at least one capture area (1 1), and
- au moins un dispositif de communication (7) avec au moins un appareil médical (2), pour transmettre, sur détection dudit mouvement, une commande prédéfinie audit au moins un appareil médical, caractérisé en ce que l'au moins une surface de réception (9) est une surface physique séparant un premier espace d'opération (100) d'un deuxième espace d'opération (200), le premier espace d'opération (100) incluant au moins une zone de capture (1 1 ). - At least one communication device (7) with at least one medical device (2), for transmitting, upon detection of said movement, a predefined command to said at least one medical device, characterized in that the at least one receiving surface (9) is a physical surface separating a first operation space (100) from a second operation space (200), the first operation space (100) including at least one capture area (1 1).
2. Dispositif de commande selon la revendication 1 , dans lequel ia surface de réception (9) est une surface souple, et en particulier un champ stérile. 2. Control device according to claim 1, wherein the receiving surface (9) is a flexible surface, and in particular a sterile field.
3. Dispositif de commande selon la revendication 1 , dans lequel la surface de réception (9) est disposée à proximité immédiate d'une zone opératoire (18) d'une salle d'opération, préférentiellement à une distance inférieure à 2 mètres, encore plus préférentiellement à une distance inférieure à 1 ,5 mètre. 3. Control device according to claim 1, wherein the receiving surface (9) is disposed in the immediate vicinity of an operating area (18) of an operating room, preferably at a distance of less than 2 meters, more preferably at a distance of less than 1.5 meters.
4. Dispositif de commande selon l'une quelconque des revendications 1 à 3, dans lequel le dispositif de projection (5) est un projecteur vidéo et plus particulièrement un projecteur vidéo à lumière froide. 4. Control device according to any one of claims 1 to 3, wherein the projection device (5) is a video projector and more particularly a video projector cold light.
5. Dispositif de commande selon l'une quelconque des revendications 1 à 4, dans lequel la surface de réception (9) et le dispositif de projection (5) ne sont pas en contact. 5. Control device according to any one of claims 1 to 4, wherein the receiving surface (9) and the projection device (5) are not in contact.
6. Dispositif de commande selon l'une quelconque des revendications 1 à 5, dans lequel la zone de capture (1 1 ) est disposée à proximité immédiate d'une zone opératoire (18) d'un bloc opératoire et présente une dimension maximale inférieure à 2 mètres, préférentiellement une dimension maximale inférieure à 1 ,5 mètre. 6. Control device according to any one of claims 1 to 5, wherein the capture zone (1 1) is disposed in the immediate vicinity of an operating zone (18) of an operating theater and has a lower maximum dimension at 2 meters, preferably a maximum dimension of less than 1.5 meters.
7. Dispositif de commande selon l'une quelconque des revendications 1 à 6, dans lequel le dispositif de communication (7) est apte à communiquer avec l'appareil médical (2) au moyen d'une liaison par courants porteurs en ligne. 7. Control device according to any one of claims 1 to 6, wherein the communication device (7) is adapted to communicate with the medical device (2) by means of an in-line carrier link.
8. Dispositif de commande selon l'une quelconque des revendications 1 à 7, dans lequel le dispositif de communication (7) est apte à communiquer avec l'appareil médical chirurgical (2) au moyen d'une liaison sans fil. 8. Control device according to any one of claims 1 to 7, wherein the communication device (7) is adapted to communicate with the surgical medical device (2) by means of a wireless link.
9. Dispositif de commande selon l'une quelconque des revendications 1 à 8, dans lequel 9. Control device according to any one of claims 1 to 8, wherein
- le dispositif de communication (7) est apte à communiquer avec au moins deux appareils médicaux (2), - le dispositif de localisation d'objets (6) est apte à détecter au moins deux mouvements, distincts, dudit au moins un objet (10) dans la zone de capture (1 1 ), et - the communication device (7) is able to communicate with at least two medical devices (2), - the object-locating device (6) is able to detect at least two distinct movements of the at least one object ( 10) in the capture zone (1 1), and
- le dispositif de communication (7) est apte à transmettre, sur détection respective desdits au moins deux mouvements, au moins deux commandes prédéfinies respectives, respectivement auxdits au moins deux appareils médicaux (2). - The communication device (7) is capable of transmitting, on respective detection of said at least two movements, at least two respective predefined commands, respectively to said at least two medical devices (2).
10. Procédé de commande (1 ) à distance avec ou sans contact, d'au moins un appareil médical (2), dans lequel : 10. A remote control method (1) with or without contact, of at least one medical device (2), in which:
- on projette à distance une interface graphique (8) sur au moins une surface de réception (9) au moyen d'au moins un dispositif de projection (5), la surface de réception (9) étant une surface physique séparant un premier espace d'opération (100) d'un deuxième espace d'opération (200), - a graphic interface (8) is remotely projected onto at least one receiving surface (9) by means of at least one projection device (5), the reception surface (9) being a physical surface separating a first space operating (100) a second operating space (200),
- on détecte un mouvement d'au moins un objet (10) dans au moins une zone de capture (1 1 ) incluse dans le premier espace d'opération (100), au moyen d'au moins un dispositif de localisation d'objets (6), et at least one object (10) is detected in at least one capture area (1 1) included in the first operating space (100) by means of at least one object locator (6), and
- sur détection dudit mouvement, on transmet une commande prédéfinie audit au moins un appareil médical (2) au moyen d'un dispositif de communication (7). - On detection of said movement, a predefined command is transmitted to said at least one medical device (2) by means of a communication device (7).
1 1 . Procédé selon la revendication 10, dans lequel, au cours d'une étape d'initialisation, on détecte une position spatiale d'au moins un point de la surface de réception (9), et on définit au moins un coefficient de correction géométrique de l'interface graphique (8) et/ou de la zone de capture (1 1 ) en fonction de ladite position spatiale. 1 1. A method according to claim 10, wherein, during an initialization step, detecting a spatial position of at least one point of the receiving surface (9), and defining at least one geometric correction coefficient of the graphical interface (8) and / or the capture zone (1 1) as a function of said spatial position.
12. Procédé selon l'une quelconque des revendications 10 et 1 1 , dans lequel, au cours d'une étape d'initialisation, on détecte une couleur d'au moins un point de la surface de réception (9), et on définit au moins un coefficient de correction de couleur de l'interface graphique (8) en fonction de ladite couleur. The method according to any one of claims 10 and 11, wherein, during an initialization step, a color of at least one point of the receiving surface (9) is detected, and defined at least one color correction coefficient of the graphic interface (8) according to said color.
13. Procédé selon l'une quelconque des revendications 10 à 12, dans lequel, la transmission d'une commande prédéfinie à l'appareil médical (2) est empêchée tant qu'un opérateur n'a pas validé une liste de vérification. Method according to any one of claims 10 to 12, wherein the transmission of a predefined command to the medical device (2) is prevented until an operator has validated a checklist.
14. Procédé selon la revendication 13, dans lequel, la liste de vérification est projetée à distance sur la surface de réception (9) par le dispositif de projection (5). 14. The method of claim 13, wherein the checklist is projected remotely on the receiving surface (9) by the projection device (5).
15. Procédé selon l'une quelconque des revendications 13 et 14, dans lequel, la liste de vérification comporte une pluralité de points de vérification et dans lequel, pour valider chacun desdits points de vérification, on détecte au moins un mouvement dudit au moins un objet ( 0) dans la zone de capture (1 1 ) au moyen du dispositif de localisation d'objets (6). 15. The method as claimed in claim 13, wherein the checklist comprises a plurality of checkpoints and wherein, to validate each of said checkpoints, at least one movement of said at least one checkpoint is detected. object (0) in the capture area (1 1) by means of the object locating device (6).
EP14793200.8A 2013-08-01 2014-08-01 Device for intermediate-free centralised control of remote medical apparatuses, with or without contact Withdrawn EP3028198A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR1357677 2013-08-01
PCT/FR2014/052018 WO2015015135A2 (en) 2013-08-01 2014-08-01 Device for intermediate-free centralised control of remote medical apparatuses, with or without contact

Publications (1)

Publication Number Publication Date
EP3028198A2 true EP3028198A2 (en) 2016-06-08

Family

ID=51846702

Family Applications (1)

Application Number Title Priority Date Filing Date
EP14793200.8A Withdrawn EP3028198A2 (en) 2013-08-01 2014-08-01 Device for intermediate-free centralised control of remote medical apparatuses, with or without contact

Country Status (3)

Country Link
US (1) US20160180046A1 (en)
EP (1) EP3028198A2 (en)
WO (1) WO2015015135A2 (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10028325B2 (en) * 2014-02-20 2018-07-17 Fresenius Vial Sas Medical communication system and commuication method
WO2016141469A1 (en) * 2015-03-07 2016-09-15 Dental Wings Inc. Medical device user interface with sterile and non-sterile operation
EP3285107B2 (en) * 2016-08-16 2024-02-28 Leica Instruments (Singapore) Pte. Ltd. Surgical microscope with gesture control and method for a gesture control of a surgical microscope
JP7267209B2 (en) 2017-06-08 2023-05-01 メドス・インターナショナル・エスエイアールエル User interface system for sterile fields and other work environments
US11121583B2 (en) * 2018-01-23 2021-09-14 Stryker Corporation Operating room wireless power transfer
DE102018206406B3 (en) * 2018-04-25 2019-09-12 Carl Zeiss Meditec Ag Microscopy system and method for operating a microscopy system
FI130350B (en) * 2019-03-12 2023-07-05 Planmeca Oy Operating light for dental care

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4621735A (en) 1985-02-27 1986-11-11 American Sterilizer Company Cover for surgical light handle and touch panel
US6175610B1 (en) * 1998-02-11 2001-01-16 Siemens Aktiengesellschaft Medical technical system controlled by vision-detected operator activity
US7317955B2 (en) * 2003-12-12 2008-01-08 Conmed Corporation Virtual operating room integration
US8560972B2 (en) * 2004-08-10 2013-10-15 Microsoft Corporation Surface UI for gesture-based interaction
US20070073133A1 (en) * 2005-09-15 2007-03-29 Schoenefeld Ryan J Virtual mouse for use in surgical navigation
US8166421B2 (en) * 2008-01-14 2012-04-24 Primesense Ltd. Three-dimensional user interface
WO2011085815A1 (en) 2010-01-14 2011-07-21 Brainlab Ag Controlling a surgical navigation system
CA2831618A1 (en) 2011-03-28 2012-10-04 Gestsure Technologies Inc. Gesture operated control for medical information systems
EP2755591B1 (en) * 2011-09-16 2020-11-18 Auris Health, Inc. System for displaying an image of a patient anatomy on a movable display
DE102012210821A1 (en) * 2012-06-26 2014-01-02 Siemens Aktiengesellschaft Method for a communication between a control unit and a patient and / or an operator as well as a medical imaging device for this purpose

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2015015135A2 *

Also Published As

Publication number Publication date
WO2015015135A2 (en) 2015-02-05
WO2015015135A3 (en) 2015-04-09
US20160180046A1 (en) 2016-06-23

Similar Documents

Publication Publication Date Title
WO2015015135A2 (en) Device for intermediate-free centralised control of remote medical apparatuses, with or without contact
JP7071434B2 (en) Portable surgical methods, systems and equipment
US11336804B2 (en) Stereoscopic visualization camera and integrated robotics platform
US10724853B2 (en) Generation of one or more edges of luminosity to form three-dimensional models of objects
JP7379373B2 (en) 3D visualization camera and integrated robot platform
EP3129849B1 (en) Systems and methods of eye tracking calibration
RU2645004C2 (en) Information processing device, information processing method and information processing system
US11553974B2 (en) Systems and methods for detection of objects within a field of view of an image capture device
US20210290046A1 (en) Portable surgical methods, systems, and apparatus
US20200170718A1 (en) Systems and methods for detection of objects within a field of view of an image capture device
US10492873B2 (en) Medical spatial orientation system
JP6950707B2 (en) Information processing equipment and methods, and programs
EP3110306B1 (en) Ophthalmic device, method and system
KR20080051664A (en) System and method for tracking gaze
EP2773995B1 (en) Device for viewing a digital image
JP6269377B2 (en) Diagnosis support apparatus and diagnosis support method
JP2021100607A (en) Control of scan image during vitreous body retina surgery
FR3006034A1 (en) MEDICAL LIGHTING SYSTEM, IN PARTICULAR OPERATIVE LIGHTING, AND METHOD FOR CONTROLLING SUCH A LIGHTING SYSTEM
WO2017113018A1 (en) System and apparatus for gaze tracking
Shin et al. Lamellar keratoplasty using position-guided surgical needle and M-mode optical coherence tomography
EP4339681A1 (en) Device for an imaging system, ocular, display apparatus, imaging system, method and computer program
US20240090742A1 (en) Portable surgical methods, systems, and apparatus
EP4160613A1 (en) Medical viewing system
FR3058037A1 (en) METHOD OF DETERMINING AN OPHTHALMIC DATA

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20160201

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20190301