EP4106597A1 - Rotational user interface for a medical visualisation system - Google Patents

Rotational user interface for a medical visualisation system

Info

Publication number
EP4106597A1
EP4106597A1 EP21706902.0A EP21706902A EP4106597A1 EP 4106597 A1 EP4106597 A1 EP 4106597A1 EP 21706902 A EP21706902 A EP 21706902A EP 4106597 A1 EP4106597 A1 EP 4106597A1
Authority
EP
European Patent Office
Prior art keywords
monitor device
mode
orientation
image
button
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP21706902.0A
Other languages
German (de)
French (fr)
Inventor
Line Sandahl UBBESEN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ambu AS
Original Assignee
Ambu AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ambu AS filed Critical Ambu AS
Publication of EP4106597A1 publication Critical patent/EP4106597A1/en
Pending legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002Operational features of endoscopes
    • A61B1/00043Operational features of endoscopes provided with output arrangements
    • A61B1/00045Display arrangement
    • A61B1/00048Constructional features of the display
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002Operational features of endoscopes
    • A61B1/00039Operational features of endoscopes provided with input arrangements for the user
    • A61B1/0004Operational features of endoscopes provided with input arrangements for the user for electronic operation
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002Operational features of endoscopes
    • A61B1/00043Operational features of endoscopes provided with output arrangements
    • A61B1/00045Display arrangement
    • A61B1/0005Display arrangement combining images e.g. side-by-side, superimposed or tiled
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00064Constructional details of the endoscope body
    • A61B1/00105Constructional details of the endoscope body characterised by modular construction
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00064Constructional details of the endoscope body
    • A61B1/00108Constructional details of the endoscope body characterised by self-sufficient functionality for stand-alone use
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04845Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Definitions

  • the present disclosure relates to a visualisation device, such as an endoscope and a medical visualisation system, such as an endoscope system, comprising a visualisation device. More specifically the present disclosure relates to a graphical user interface and a monitor device having such graphical user interface for interacting with the medical visualisation system.
  • a visualisation device may be utilized to visually examine certain areas of the body of a person, such as inside a body cavity of the person.
  • a visualisation device may be used to inspect the airways, the digestive tract, or the intestines.
  • a visualisation device may be provided with a camera and be attached to a monitor device, such as a monitor with a display screen, a video output from the camera of the visualisation device may be received and displayed at the monitor device, thereby allowing an operator to control the visualisation device to inspect an area of interest.
  • a monitor device such as a monitor with a display screen
  • a visualisation device may be an endoscope, such as a disposable endoscope.
  • An endoscope comprises an operating handle at the proximal end and an insertion tube extending from the handle towards the distal end.
  • the handle is configured to be held by an operator and inter alia comprises externally protruding operating members connected to internal control means allowing the operator to control the movement of a bending section at the distal end of the insertion tube, while advancing the distal end of the insertion tube to a desired location e.g. within a body cavity of a person.
  • an attached monitor device such as a monitor with a display screen, the location to which the distal end has been advanced may be inspected using the endoscope.
  • the monitor device of a medical visualisation system may be provided with some functionality, such as ability to save still images and/or video sequences of the view from the attached visualisation device. Furthermore, the monitor device may comprise some image processing capabilities, and may be configured to output a video or image output, e.g. to an external display.
  • the present disclosure relates to a visualisation device, such as an endoscope, and a visualisation system, such as an endoscope system.
  • the visualisation device may be a disposable camera endoscope.
  • the visualisation device may be a video laryngoscope, an endotracheal tube and/or a laryngeal mask.
  • the visualisation system may further comprise a monitor device for being connected to the visualisation device, e.g. the monitor device may be configured to receive image data from the visualisation device.
  • the present disclosure further relates to a graphical user interface for such monitor device of a medical visualisation system.
  • a medical visualisation system and a method performed at a monitor device of the medical visualisation system are disclosed.
  • the medical visualisation system comprises a visualisation device, such as an endoscope, such as a disposable endoscope.
  • the visualisation device may be a video laryngoscope, an endotracheal tube and/or a laryngeal mask.
  • the visualisation device has an image sensor configured to generate image data indicative of a view from the visualisation device.
  • the medical visualisation system may comprise a plurality of visualisation devices each having an image sensor configured to generate image data indicative of a view from the visualisation device.
  • the plurality of visualisation devices may include a first visualisation device and/or a second visualisation device.
  • the first visualisation device may comprise a first image sensor configured to generate image data indicative of a view from the first visualisation device.
  • the second visualisation device may comprise a second image sensor configured to generate image data indicative of a view from the second visualisation device.
  • the image sensor(s) may be any sensor capable of detecting and conveying information used to make an image.
  • the image sensor(s) may comprise a CCD or CMOS sensor, or similar.
  • the image sensor(s) may generate image data corresponding to a square image, i.e. having equal height and width.
  • the image data generated by the image sensors may correspond to a 300x300 pixel image, or a 400x400 pixel image, or a 600x600 pixel image, or a 800x800 pixel image.
  • the image sensor may generate image data corresponding to a non-square image, which is cropped to form a square image, such as a square image having 300x300 pixels, 400x400 pixels, 600x600 pixels, or 800x800 pixels.
  • the medical visualisation system further comprises a monitor device receiving and/or being operable to receive the image data generated by the image sensor.
  • the monitor device may receive and/or be operable to receive the image data, e.g. as the image data is being generated, e.g. within limitation of the hardware.
  • the monitor device comprises a first housing extending in a first direction from a first housing side to a second housing side and in a second direction perpendicular to the first direction from a third housing side to a fourth housing side.
  • the monitor device comprises a display, e.g. a touch sensitive display.
  • the display may be accommodated in the first housing.
  • the display may have a first length in the first direction and a second length in the second direction.
  • the second length may be longer than the first length, e.g. the display may be a 16:9 or 16:10 display.
  • the first length may be longer than the second length, or the first length and the second length may be substantially the same.
  • the touch sensitive display may be any suitable type of touch display, e.g. capacitive touch display or resistive touch display.
  • the monitor device may comprise one or more connection ports configured to receive a connector of the visualisation device.
  • the connection ports and the corresponding connector of the visualisation device may be a proprietary plug and socket connectors, or any standard connector capable of transmitting therethrough at least the image data from the image sensor.
  • the connector and connection ports may be configured to supply power to the components of the visualisation device.
  • the one or more connection ports may be arranged on the first housing.
  • the one or more connection ports may be provided on the third housing side, and/or on the fourth housing side.
  • the monitor device may comprise an on/off button.
  • the on/off button may be arranged on the first housing.
  • the on/off button may be provided on the third housing side or on the fourth housing side.
  • the one or more connection ports may be provided on the third housing side and the on/off button may be provided on the fourth housing side.
  • the monitor device may establish connection to a visualisation device, such as the first visualisation device and/or the second visualisation device.
  • Establishing connection to the visualisation device may include receiving a device connector of the respective visualisation device in a connection port of the one or more connection ports of the monitor device.
  • Establishing connection to a visualisation device may include obtaining device identifier information from a device identifier (e.g. EPROM, QR-code, NFC, RFID or similar) of the visualisation device.
  • establishing connection to the first visualisation device may include obtaining first device identifier information from a first device identifier of the first visualisation device and/or establishing connection to the second visualisation device may include obtaining second device identifier information from a second device identifier of the second visualisation device.
  • the monitor device may comprise a processing unit and memory.
  • the processing unit and/or the memory may be accommodated in the first housing.
  • the monitor device may comprise a second housing, and the processing unit and/or the memory may be accommodated in the second housing.
  • the monitor device may comprise an orientation sensor, e.g. for determining the orientation of the monitor device, such as of the first housing, relative to gravity.
  • the orientation sensor may comprise one or more accelerometers and/or a gyroscope.
  • the orientation sensor may be accommodated in the first housing.
  • the processing unit may be connected to the touch sensitive display to control display of information with the touch sensitive display, and the processing unit may be adapted to receive a signal from the touch sensitive display indicative of touch inputs on the touch sensitive display.
  • the monitor device may detect user inputs, e.g. in the form of touch inputs, with the touch sensitive display.
  • Touch inputs may, for example, comprise single tap(s), double tap(s), or swipe(s) on the touch sensitive display.
  • the processing unit may be connected to the orientation sensor to receive an orientation signal indicative of the orientation of the monitor device, such as of the first housing of the monitor device.
  • the processing unit may be connected to the memory and be adapted to read and write data from and to the memory.
  • the monitor device may comprise a power unit for powering the monitor device.
  • the power unit may comprise a rechargeable battery and/or a power connection for connecting the power unit to an external power supply, such as a conventional AC power socket.
  • the power unit may be accommodated in the first housing. Alternatively, the power unit may be accommodated in the second housing.
  • the monitor device may comprise a graphical user interface.
  • the monitor device and/or the processing unit of the monitor device may display with the touch sensitive display the graphical user interface.
  • the graphical user interface may comprise one or more portions, such as a plurality of portions.
  • the portions may be non-overlapping portions, such as a plurality of non-overlapping portions.
  • the portions may include a first portion and/or a second portion.
  • the portions may further include a third portion and/or a fourth portion.
  • the second portion and/or the fourth portion may be designated as background portions, e.g. the second portion may be a first background portion and/or the fourth portion may be a second background portion.
  • Each of the plurality of portions may extend substantially throughout the first length in the first direction.
  • the first portion may be arranged between the fourth portion and the second portion along the second direction.
  • the fourth portion may be arranged between the third portion and the first portion along the second direction.
  • the third portion may be arranged between a side of the first housing, e.g. the third housing side, and the fourth portion along the second direction.
  • the second portion may be arranged between another side of the first housing, e.g. the fourth housing side, and the first portion along the second direction.
  • the first portion and the fourth portion may be arranged between the second portion and the third portion along the second direction.
  • the first portion of the graphical user interface may be square.
  • the first portion of the graphical user interface may occupy the centre of the touch sensitive display.
  • the first portion of the graphical user interface may be larger along the second direction than the second portion, the third portion and/or the fourth portion, individually and/or collectively.
  • the first portion of the graphical user interface may extend throughout more than 40% of the second length in the second direction, such as more than 50% of the second length in the second direction, such as more than 60% of the second length in the second direction.
  • the monitor device may display a live representation of the image data, e.g. within the first portion of the graphical user interface.
  • the live representation of the image data may be displayed, e.g. by the processing unit, with the touch sensitive display, e.g. within the first portion of the graphical user interface.
  • the visualisation device e.g. an endoscope
  • the visualisation device may comprise a handle and an elongated flexible member extending from the handle to a distal end.
  • the image sensor may be arranged at the distal end of the elongated flexible member.
  • the image data may be indicative of a view from the distal end of the elongated flexible member.
  • the handle may comprise a control button adapted to receive an input in a first input direction and/or in a second input direction.
  • the first input direction and the second input direction may be opposite.
  • the touch input in the first input direction may cause a distal portion of the elongated flexible member to bend in a first bending direction and/or may cause movement of the image sensor in a first image sensor direction.
  • the touch input in the second input direction may cause the distal portion of the elongated flexible member to bend in a second bending direction and/or may cause movement of the image sensor in a second image sensor direction.
  • the live representation of the image data may have directions corresponding to directions of the image sensor generating the image data.
  • the first bending direction may correspond to a first image direction of a representation of the image data, such as the live representation of the image data.
  • the second bending direction may correspond to a second image direction of the representation of the image data, such as the live representation of the image data.
  • the first image direction and/or the second image direction may be parallel to the first direction of the first housing.
  • the monitor device may provide one or more actionable items. One or more actionable items may be displayed, e.g.
  • One or more actionable menu items may be displayed, e.g. by the processing unit, with the touch sensitive display, e.g. within the third portion of the graphical user interface.
  • a battery indicator may be displayed, e.g. by the processing unit, with the touch sensitive display, e.g. within the third portion of the graphical user interface.
  • a time indicator may be displayed, e.g. by the processing unit, with the touch sensitive display, e.g. within the third portion of the graphical user interface.
  • the one or more actionable items may comprise an image capture button and/or a video capture button.
  • an image capture button e.g. by a user providing a touch input, e.g. a single tap, at the respective location of the touch sensitive display
  • an image data file corresponding to the image data received when the image capture button was activated may be stored, e.g. in memory of the monitor device.
  • the video capture button e.g. by a user providing a touch input, e.g.
  • a video sequence of image data corresponding to the image data received when the video capture button was activated may be stored, e.g. in memory of the monitor device.
  • a first activation of the video capture button may start collection of image data for the video sequence, and a second activation of the video capture button (subsequent to the first activation of the video capture button) may stop the collection of image data for the video sequence.
  • the stored video sequence may correspond to the image data received between the first activation and the second activation of the video capture button.
  • the video capture button may be displayed in a first appearance prior to the first activation and after the second activation.
  • the video capture button may be displayed in a second appearance after the first activation and before the second activation.
  • the monitor device may have a first interface orientation mode and a second interface orientation mode.
  • the first interface orientation mode the second portion is arranged between the fourth housing side and the first portion, e.g. along the second direction.
  • the second interface orientation mode the second portion is arranged between the third housing side and the first portion, e.g. along the second direction.
  • the method may comprise receiving the image data generated by the image sensor, e.g. as the image data is being generated; displaying one or more actionable items within the second portion of the graphical user interface; and determining an interface orientation mode of the monitor device.
  • the method may further comprise, in accordance with the determined interface orientation mode being a first interface orientation mode, arranging the second portion between the fourth housing side and the first portion; and in accordance with the determined interface orientation mode being a second interface orientation mode, arranging the second portion between the third housing side and the first portion.
  • the method may further comprise displaying a live representation of the image data within the first portion of the graphical user interface.
  • a monitor device for a medical visualisation system which may be oriented in a plurality of orientations and that the graphical user interface may be adapted to such orientation.
  • the present disclosure allows the monitor device and/or the first housing to be oriented such that, e.g. connection ports, are located on the side most convenient according to the circumstances.
  • the monitor device may comprise one or more connection ports for receiving a connector of the visualisation device.
  • the connection ports may be arranged on the first housing.
  • the one or more connection ports may be provided on the third housing side. Alternatively or additionally, one or more connection ports may be provided on the fourth housing side.
  • the first housing may be oriented in a first orientation wherein the first direction is upwards and in a second orientation wherein the first direction is downwards.
  • the monitor device and/or the first housing may comprise a stand to support the first housing in either of the first orientation and the second orientation.
  • the first housing side In the first orientation the first housing side may be facing downwards.
  • the second orientation In the second orientation the first housing side may be facing upwards.
  • the second housing side In the second orientation the second housing side may be facing downwards.
  • An invert interface button may be provided.
  • the invert interface button may be displayed with the touch sensitive display, e.g. by the processing unit.
  • the invert interface button may be provided as a hardware button on the monitor device and/or on the first housing. The monitor device may change between operating the first interface orientation mode and operating the second interface orientation mode in response to activation of the invert interface button.
  • the monitor device may comprise an orientation sensor, such as a gyroscope and/or one or more accelerometers.
  • the orientation sensor may be configured to detect the orientation of the first housing relative to gravity.
  • the orientation sensor may be accommodated in the first housing.
  • the orientation sensor may provide an orientation signal indicative of the orientation of the first housing, e.g. relative to gravity.
  • the monitor device e.g. by the processing unit, may, based on the orientation sensor and/or the orientation sensor signal, determine whether the first housing is oriented in the first orientation.
  • the monitor device e.g. by the processing unit, may, based on the orientation sensor and/or the orientation sensor signal, determine whether the first housing is oriented in the second orientation.
  • Determining the interface orientation mode may comprise determining an orientation of the first housing by the orientation sensor, such as by the orientation sensor signal and/or by the processing unit.
  • the monitor device may operate in the first interface orientation mode in the first orientation, e.g. based on the orientation sensor signal of the orientation sensor.
  • the monitor device may operate in the second interface orientation mode in the second orientation, e.g. based on the orientation sensor signal of the orientation sensor.
  • the monitor device may operate in the first interface orientation mode when a signal of the orientation sensor is indicative of the first housing being oriented in the first orientation.
  • the monitor device may be operating in the second interface orientation mode when the signal of the orientation sensor is not indicative of the first housing being in the first orientation and/or when the signal of the orientation sensor is indicative of the first housing being in the second orientation.
  • the first direction may be upwards.
  • the second interface orientation mode the first direction may be downwards.
  • the one or more actionable items, displayed within the second portion of the graphical user interface may comprise an image capture button and/or a video capture button, as explained above.
  • the second portion is between the first portion and the fourth housing side in the first interface orientation mode and between the first portion and the third housing side in the second interface orientation mode.
  • the assistant may be usually located to the right of the monitor device and/or the first housing.
  • the graphical user interface may be configured to arrange the actionable items in a position which reduces the necessity for an operator to partly obstruct the visibility of live representation when performing certain operations needed during a procedure. Furthermore, it may be advantageous to be able to orient the monitor device and/or the first housing differently to arrange physical features, such as connection ports on/off button etc. to accommodate for the environment wherein the monitor device and/or the first housing is to be used.
  • the first image direction of the live representation of the image data and the first direction of the first housing may be the same in the first interface orientation mode.
  • the first image direction and the first direction may be opposite in the second interface orientation mode.
  • the second image direction and the first direction may be opposite in the first interface orientation mode.
  • the second image direction and the first direction may be the same in the second interface orientation mode.
  • a touch input in the first input direction on the control button of the visualisation device may cause a movement of the distal end of the elongated flexible member corresponding to the first image direction
  • a touch input in the second input direction on the control button of the visualisation device may cause a movement of the distal end of the elongated flexible member corresponding to the second image direction. Accordingly, the operator is able to navigate the visualisation device based on the live representation displayed with the touch sensitive display of the monitor device.
  • the monitor device may have a default view mode and in an inverted view mode.
  • the first image direction and the first direction may be the same, and in the inverted view mode, the first image direction and the first direction may be opposite.
  • the live representation may be displayed such that a first image direction of the live representation and the first direction are the same.
  • the live representation may be displayed such that the first image direction and the first direction are opposite.
  • the relationship between the image directions and the direction of the first housing may be subjective to both whether the monitor device operates the default view mode or the inverted view mode and whether the monitor device operates the first interface orientation mode or the second interface orientation mode.
  • the first image direction and the first direction may be the same in the first interface orientation mode; and the first image direction and the first direction may be opposite in the second interface orientation mode.
  • the inverted view mode the first image direction and the first direction may be opposite in the first interface orientation mode, and the first image direction and the first direction may be the same in the second interface orientation mode.
  • the live representation may be displayed such that a first image direction of the live representation and the first direction are the same.
  • the live representation may be displayed such that the first image direction and the first direction are opposite.
  • the live representation may be displayed such that the first image direction and the first direction are opposite.
  • the live representation may be displayed such that the first image direction and the first direction are opposite.
  • the live representation may be displayed such that the first image direction and the first direction are the same.
  • Changing between the default view mode and the inverted view mode may cause the live representation to be rotated, e.g. by 180 degrees.
  • an inverted view mode indicator may be displayed, e.g. by the monitor device with the touch sensitive display, in the first portion overlaying a portion of the live representation.
  • the ability to change between default view mode and inverted view mode may be advantageous in certain procedures depending on the location of the operator relative to the patient, and/or depending on how the operator is holding the handle of the visualisation device.
  • a stored image data file e.g. stored in response to receipt of activation of an image capture button of the one or more actionable items, may comprise information indicative of the monitor device having been operated in the inverted view mode when the image capture button was activated.
  • the monitor device may store with the image data file being stored information indicative of the monitor device operating in the inverted view mode when the image capture button was activated.
  • metadata indicative of the inverted view mode being active may be embedded in the stored image data file.
  • a visible mark e.g. the inverted view mode indicator, may be provided on the stored image data file.
  • a stored video sequence of image data e.g.
  • stored in response to receipt of activation of a video capture button of the one or more actionable items may comprise information indicative of the monitor device having been operated in the inverted view mode when the video capture button was activated.
  • the monitor device may store with the video sequence being stored, information indicative of the monitor device operating in the inverted view mode when the video capture button was activated.
  • metadata indicative of the inverted view mode being active may be embedded in the stored video sequence of image data.
  • a visible mark e.g. the inverted view mode indicator, may be provided on the images of the stored video sequence.
  • An invert view button may be displayed with the touch sensitive display.
  • the monitor device may display, e.g. with the touch sensitive display, the invert view button.
  • the invert view button may be displayed within the second portion of the graphical user interface.
  • the monitor device may change between the default view mode and the inverted view mode in response to activation of the invert view button.
  • the user may change between the default view mode and the inverted view mode by activating the invert view button.
  • the invert view button may be accessible from a settings menu.
  • the invert view button In the default view mode the invert view button may be displayed in a first orientation, and in the inverted view mode the invert view button may be displayed in a second orientation.
  • the second orientation of the invert view button may be rotated compared to the first orientation of the invert view button, e.g. by 180 degrees.
  • the appearance of the invert view button may thereby be used to indicate the state of the monitor device, i.e. whether the monitor device operates the default view mode or the inverted view mode.
  • a user input corresponding to activation of the invert view button may be detected, e.g. by the touch sensitive display, and in response to detecting the user input corresponding to activation of the invert view button, in accordance with the monitor device being in the default view mode changing to the inverted view mode; and in accordance with the monitor device being in the inverted view mode changing to the default view mode.
  • the monitor device may comprise a settings menu.
  • the settings menu may comprise an option for enabling the inverted view mode.
  • the invert view button may be displayed with the touch sensitive display, e.g. the monitor device may display the invert view button with the touch sensitive display, and in accordance with the inverted view mode not being enabled in the settings menu, the invert view button may not be displayed with the touch sensitive display.
  • Fig. 1 schematically illustrates an exemplary medical visualisation system
  • Fig. 2 schematically illustrates an exemplary monitor device
  • Fig. 3 schematically illustrates an exemplary monitor device
  • Fig 4 is a block diagram of an exemplary monitor device
  • Fig. 5 illustrates an exemplary monitor device
  • Figs. 6a and 6b schematically illustrates a monitor device
  • Fig. 7 is a block diagram of an exemplary method
  • Fig. 8 is a block diagram of an exemplary method.
  • Fig. 1 schematically illustrates an exemplary medical visualisation system 2 comprising a visualisation device 4 and a monitor device 20.
  • the visualisation device 4 has an image sensor 12, e.g. a CCD or a CMOS, configured to generate image data indicative of a view from the visualisation device 4.
  • the visualisation device 4 is an endoscope comprising a handle 6 and an elongated flexible member 8, e.g. an insertion tube, extending from the handle 6 to a distal end 10.
  • the image sensor 12 may be configured to generate image data indicative of a view from the distal end 10 of the elongated flexible member 8.
  • the visualisation device 4 may be connected to the monitor device 20.
  • a device cable 14 extending from the handle 6 terminates in a device connector 16 connected to a connection port 40 of the monitor device 20.
  • the monitor device 20 is operable to receive image data generated by the image sensor 12 of the visualisation device 4.
  • the monitor device 20 may receive image data generated by the image sensor 12 via the device cable 14, the connector 16 and connection port 40.
  • the handle 6 comprises a control button 7 adapted to receive an input in a first input direction and/or in a second input direction.
  • the touch input in the first input direction on the control button 7 causes a distal portion 9 of the elongated flexible member 8 to bend in a first bending direction, e.g. via wires extending from the handle, through the elongated flexible member 8 to the distal portion 9.
  • the touch input in the second input direction on the control button 7 causes the distal portion 9 of the elongated flexible member 8 to bend in a second bending direction.
  • the first input direction and the second input direction may be opposite.
  • the first bending direction and the second bending direction may be opposite.
  • Bending the distal portion 9 of the elongated flexible member 8 may cause a movement of the distal end 10 and the image sensor 12 in a direction relative to the image sensor 12. Thereby, seeing an image generated by the image sensor 12, a direction, e.g. up or down, in the image may correspond to a respective input on the control button 7.
  • Fig. 2 schematically illustrates an exemplary monitor device 20, such as the monitor device 20 as illustrated in Fig. 1.
  • the monitor device 20 comprises a first housing 25.
  • the first housing 25 extends in a first direction xl from a first housing side 21 to a second housing side 22 and in a second direction x2 perpendicular to the first direction xl from a third housing side 23 to a fourth housing side 24.
  • the monitor device comprises a touch sensitive display 26 accommodated in the first housing 25.
  • the touch sensitive display 26 has a first length LI in the first direction xl and a second length L2 in the second direction x2.
  • the second length L2 may be longer than the first length LI as illustrated.
  • the monitor device may comprise one or more connection port(s) 40, such as three connection ports 40, as illustrated.
  • the connection ports 40 may allow visualisation devices to be connected.
  • the connection port(s) 40 may be arranged at the third housing side 23, as illustrated. Alternatively or additionally, connection port(s) 40 may be
  • the monitor device may comprise an on/off button 41, which may be provided on the fourth housing side 24, as illustrated.
  • FIG. 3 schematically illustrates an exemplary monitor device 20, such as the monitor device 20 as illustrated in Figs. 1-2.
  • a device connector 16 may be connected to a connection port 40.
  • the monitor device 20 may be provided with a graphical user interface 27.
  • the graphical user interface 27 may be displayed with the touch sensitive display 26, and the user may interact with the graphical user interface 27, e.g. by means of providing touch inputs on the touch sensitive display 26.
  • the graphical user interface 27 is displayed with the touch sensitive display 26.
  • the graphical user interface 27 comprises a plurality of non-overlapping portions 31, 32, 33, 34.
  • Each of the portions 31, 32, 33, 34 extends substantially throughout the first length LI in the first direction xl.
  • the non-overlapping portions includes a first portion 31, a second portion 32, a third portion 33 and a fourth portion 34.
  • the first portion 31 is arranged between the fourth portion 34 and the second portion 32 along the second direction x2.
  • the fourth portion 34 is arranged between the third portion 33 and the first portion 31 along the second direction x2.
  • the third portion 33 is arranged between a side of the first housing, e.g. the third housing side 23, and the fourth portion 34 along the second direction x2.
  • the second portion 32 is arranged between another side of the first housing 25, e.g. the fourth housing side 24, and the first portion 31 along the second direction x2.
  • the first portion 31 and the fourth portion 34 are arranged between the second portion 32 and the third portion 33 along the second direction.
  • the monitor device 20 displays a live representation 70 of the image data within the first portion 31 of the touch sensitive display 26.
  • the first bending direction and the second bending direction of the distal portion 9 of the elongated flexible member 8, as described with respect to Fig. 1, may corresponds to a first image direction 37 and a second image direction 38 of the live representation 70, respectively.
  • the first image direction 37 and the second image direction 38 may be parallel to the first direction xl, as illustrated.
  • the first image direction 37 and the second image direction 38 may be opposite, as illustrated.
  • a user operating the control button 7 of visualisation device 2 may cause movement of the distal portion 9 of the elongated flexible member 8 to bend in a direction corresponding to the first image direction 37 or the second image direction 38 of the live representation 70.
  • the monitor device 20 displays with the touch sensitive display 26 one or more actionable items 36 within the second portion 32 of the graphical user interface 27.
  • the actionable items 36 may comprise an image capture button 36a, e.g. for storing an image data file corresponding to the image data received when the image capture button 36a was activated.
  • the actionable items 36 may comprise a video capture button 36b, e.g. for storing a video sequence of image data corresponding to the image data received when the video capture button 36b was activated.
  • the monitor device 20 displays with the touch sensitive display 26 one or more actionable menu items 42 within the third portion 33 of the graphical user interface 27.
  • the actionable menu items 42 may, for example, comprise a login menu item for initiating a login procedure, a settings menu item for accessing a settings menu, an archive menu item for browsing an archive, and a default menu item for returning to a default view. Also a battery indicator 50 is displayed in the third portion 33.
  • Fig. 4 is a block diagram of an exemplary monitor device 20, such as the monitor device 20 of the previous figures.
  • the monitor device 20 comprises a processing unit 60 and memory 62.
  • the memory 62 may comprise both volatile and non-volatile memory.
  • the monitor device 20 also comprise an orientation sensor 64 for determining the orientation of the first housing 25 relative to gravity.
  • the orientation sensor 64 may comprise one or more accelerometers and/or a gyroscope.
  • the monitor device 20 comprises input/output module 66, such as for receiving image data from the image sensor 12 via connectors of visualisation device 4.
  • the input/output module 66 may also comprise ethernet connector, WiFi transceiver, Bluetooth transceiver, video connectors, USB ports etc., and respective controllers.
  • the monitor device 20 also comprises the touch sensitive display 26 as described earlier.
  • the monitor device 20 may display information, graphical user interface objects, images, buttons etc, with the touch sensitive display 27.
  • the monitor device 20 also comprises a microphone 68.
  • the monitor device 20 comprises a power unit 61 for powering the monitor device 20.
  • the power unit 61 may comprise a rechargeable battery 61a.
  • the power unit 61 may comprise a power connection 61b for connecting the power unit 61 to an external power supply, such as a conventional AC power socket.
  • the components of the monitor device 20 may be interconnected by buses or signal lines. Some or all of the components of the monitor device may be accommodated in the first housing 25 as illustrated. Flowever, alternatively some of the components, e.g. the processing unit 60, the memory 62, input/output module 66 and/or the power unit 61 may be accommodated in a second housing of the monitor device 20.
  • the power unit 61 may comprise components for, e.g. indirectly measuring, capacity of the rechargeable battery 61a.
  • the power unit 61 may comprise a voltage gauge to measure the voltage of the rechargeable battery 61a. Based on the measured voltage, the remaining capacity of the rechargeable battery 61a may be estimated, e.g. by the processing unit 60.
  • the power unit 61 may also comprise components for measuring power consumption of the monitor device 20.
  • the power unit 61 may comprise a power meter to measure the rate at which the monitor device 20 consumes power from the rechargeable battery 61a.
  • the voltage gauge may be a low current consumption integrated circuit or a resistor coupled in parallel with the battery.
  • a current sensor may be provided and the power may be computed as the product of the voltage and current.
  • an integrated circuit may be provided that includes a voltage gauge and a current sensor, and which outputs a power value in digital form.
  • the monitor device 20 may display content with the touch sensitive display 26.
  • the monitor device 20 may display content by the processing device 60 transmitting instructions to the touch sensitive display 26 indicative of the content to be displayed.
  • the monitor device 20 may receive user input with the touch sensitive display 26.
  • the monitor device 20 may detect user inputs with the touch sensitive display 26.
  • a user providing a touch input on the touch sensitive display 26 causes a change in one or more electrical parameters of the touch sensitive display 26 indicative of at least the location of the touch input.
  • Information of the touch input is transmitted from the touch sensitive display 26 to the processing unit 60, and the processing unit 60 may determine whether the touch input corresponds to an action to perform, e.g. whether the location of the touch input corresponds to the location of a soft-button displayed at the touch sensitive display.
  • the user may interact with the monitor device 20 via the graphical user interface 27 by providing user inputs, e.g. by means of providing touch inputs on the touch sensitive display 26, and the monitor device 20 may detect such user inputs with the touch sensitive display 26.
  • a touch input e.g. a single tap, double tap, swipe or similar, and the location of the touch input on the touch sensitive display 26 is registered by the touch sensitive display 26, which transmits information of the touch input (e.g. including type of touch (double tap, single tap, swipe, etc.) and/or location of the touch) to the processing unit 60 of the monitor device 20.
  • the processing unit 60 interprets the information received and determines whether the touch input corresponds to activation of an action, e.g. whether the touch input correspond to activation of a button displayed with the touch sensitive display 27 at the location of the touch input. In response to a determination that the touch input corresponds to activation of an action, the processing unit 60 performs the respective action.
  • the user may tap the image capture button 36a.
  • the tap and the location of the tap is registered by the touch sensitive display 26, which transmits the information of the tap to the processing unit 60 of the monitor device 20.
  • the processing unit 60 interprets the information received and determines that the user tapped the location corresponding to the image capture button 36a.
  • the processing unit 60 stores, in memory 62 an image data file corresponding to the image data received.
  • the user may tap the video capture button 36b.
  • the tap and the location of the tap is registered by the touch sensitive display 26, which transmits the information of the tap to a processing unit 60 (see Fig. 4) of the monitor device 20.
  • the processing unit 60 interprets the information received and determines that the user tapped the location corresponding to the video capture button 36b.
  • the processing unit 60 starts collection of image data received from the image sensor 12 and temporarily stores the data in memory 62. To stop the recording, the user may tap the video capture button 36b again.
  • the processing unit 60 determines, based on the signal received from the touch sensitive display 26, that that the user tapped the video capture button 36b and stops collecting image data received from the image sensor 12.
  • the processing unit 60 read the temporarily stored data from the memory 62 and create a complete video sequence based thereon, which the processing unit 60 stores in the memory 62.
  • Fig. 5 illustrates an exemplary monitor device 20, such as the monitor device 20 of the previous figures, wherein the monitor device 20, such as the first housing 25 of the monitor device 20, has been rotated 180 degrees relative to the monitor device 20 of Figs. 2-3, such that the second housing side 22 is now downwards and the first housing side 21 is upwards.
  • the monitor device 20 and/or the first housing 25 180 degrees the second direction x2 of the first housing 25 is in Fig. 5 from right to left whereas in the Figs. 2-3, the second direction x2 was from left to right.
  • the first housing 25 the first direction xl of the first housing 25 is in Fig. 5 downwards whereas in the Figs. 2-3, the first direction xl was upwards.
  • the monitor device 20 may operate a first interface orientation mode, as illustrated in Fig. 3, and a second interface orientation mode, as illustrated in Fig. 5.
  • a first interface orientation mode as illustrated in Fig. 3
  • a second interface orientation mode as illustrated in Fig. 5.
  • the second portion 32 in the first interface orientation mode, is between the fourth housing side 24 and the first portion 31, and the third portion 33 is between the third housing side 23 and the first portion 31.
  • the second portion 32 in the second interface orientation mode, is between the third housing side 23 and the first portion 31, and the third portion 33 is between the fourth housing side 24 and the first portion 31.
  • the monitor device 20 may change between the first interface orientation mode and the second interface orientation mode based on a value of a manual setting. For example, the user may press an invert interface button 100, e.g. displayed with the touch sensitive display 26, e.g. in a settings menu, or being a hardware button. The monitor device 20 may change between the first interface orientation mode and the second interface orientation mode upon activation of the invert interface button 100. The processing unit 60 of the monitor device 20 may determine that the user has tapped the touch sensitive display 26 at the position corresponding to the invert interface button 100 and in response change between the first interface orientation mode and the second interface orientation mode.
  • an invert interface button 100 e.g. displayed with the touch sensitive display 26, e.g. in a settings menu, or being a hardware button.
  • the monitor device 20 may change between the first interface orientation mode and the second interface orientation mode upon activation of the invert interface button 100.
  • the processing unit 60 of the monitor device 20 may determine that the user has tapped the touch sensitive display 26 at the position corresponding to the
  • the monitor device 20 may comprise an orientation sensor 64 (see Fig. 4), e.g. accommodated in the first housing 25, and the monitor device 20 may change between the first interface orientation mode and the second interface orientation mode based on input from the orientation sensor 64.
  • the first housing 25 may be oriented in a first orientation, e.g. as illustrated in Fig. 3, wherein the first direction is upwards.
  • the monitor device 20 may operate in the first interface orientation mode, as illustrated in Fig. 3, when being oriented in the first orientation, e.g. based on an orientation signal received from the orientation sensor.
  • the processing unit 60 may determine the orientation of the first housing 25 and change between the first interface orientation mode and the second interface orientation mode, accordingly.
  • the first housing 25 may be oriented in a second orientation, e.g. as illustrated in Fig. 5, wherein the first direction is downwards.
  • the monitor device 20 may operate in the second interface orientation mode, as illustrated in Fig. 5, when being oriented in the second orientation.
  • the connection ports 40 may be on the left side of first housing 25.
  • the connection ports 40 may be on the right side of the first housing 25.
  • the visualisation device 2 may comprise a control button 7 configured to cause a movement of the image sensor 12 corresponding to a first image direction 37 and/or a second image direction 38 of the live representation.
  • the first image direction 37 and the first direction xl may be the same in the first interface orientation mode (cf. Fig. 3).
  • the first image direction 37 and the first direction xl may be opposite in the second interface orientation mode (cf. Fig. 5).
  • Figs. 6a and 6b schematically illustrates a monitor device 20, such as the monitor device 20 of any of the previous figures.
  • the first housing 25 of the monitor device 20 is in Figs. 6a and 6b shown in the first orientation, as described above.
  • the monitor device 20 may operate a default view mode, e.g. as illustrated in Fig. 6a, and an inverted view mode, e.g. as illustrated in Fig. 6b.
  • the orientation of the live representation within the first portion 31 is rotated 180 degrees when changing between the default view mode and the inverted view mode.
  • the first image direction 37 and the first direction xl are the same, e.g. when the monitor device 20 operates the first interface orientation mode, e.g. when the first housing 25 is in the first orientation; as illustrated.
  • the inverted view mode Fig. 6b
  • the first image direction 37 and the first direction xl are opposite, e.g. when the monitor device 20 operates the first interface orientation mode, e.g. when the first housing 25 is in the first orientation; as illustrated.
  • the monitor device 20 in contrast to the examples of Figs. 6a and 6b, operates the second interface orientation mode, e.g. as illustrated in Fig. 5, the first image direction 37 and the first direction xl are the same, in the inverted view mode; and the first image direction 37 and the first direction xl are opposite, in the default view mode.
  • an inverted view mode indicator 46 may be displayed in the first portion 31, e.g. overlaying a portion of the live representation.
  • the inverted view mode indicator 46 may be partly transparent to reduce obstruction of the live representation.
  • a stored image data file e.g. stored in response to the user activating the image capture button 36a of the actionable items 36, and/or a stored video sequence of image data, e.g. stored in response to the user activating the video capture button 36b of the actionable items 36, may be saved with information, e.g. metadata or a watermark, indicative of the monitor device 20 having operated in the inverted view mode when the respective actionable item 36, image capture button or video capture button, was activated.
  • the user may change between the default view mode and the inverted view mode by activating an invert view button 44.
  • the invert view button 44 may be accessible from a settings menu.
  • the monitor device 20 may display, with the touch sensitive display 26, the invert view button 44, e.g. in the second portion of the graphical user interface, as illustrated.
  • the monitor device 20 may change between the default view mode (Fig. 6a) and the inverted view mode (Fig. 6b) in response to activation of the invert view button 44.
  • the invert view button 44 In the default view mode (Fig. 6a) the invert view button 44 may be displayed in a first orientation, and in the inverted view mode (Fig. 6b) the invert view button 44 may be displayed in a second orientation, e.g. rotated compared to the first orientation, e.g. by 180 degrees.
  • Fig. 7 is a block diagram of an exemplary method 200 performed at a monitor device, such as a monitor device as disclosed in relation to previous figures, such as a monitor device of a medical visualisation system comprising a visualisation device having an image sensor configured to generate image data indicative of a view from the visualisation device.
  • the monitor device may comprise a first housing extending in a first direction from a first housing side to a second housing side and in a second direction perpendicular to the first direction from a third housing side to a fourth housing side.
  • the monitor device may comprise a touch sensitive display, e.g. being accommodated in the first housing.
  • the touch sensitive display may have a first length in the first direction and a second length in the second direction, and a graphical user interface comprising a plurality of non-overlapping portions including a first portion and a second portion, and optionally a third portion and/or a fourth portion.
  • the method 200 comprises receiving 202 the image data generated, as the image data is being generated by the image sensor; displaying 204 one or more actionable items within the second portion of the graphical user interface; determining 206 an interface orientation mode of the monitor device; and displaying 210 a live representation of the image data within the first portion of the graphical user interface.
  • the monitor device may comprise an orientation sensor and determining 206 the interface orientation mode may comprise determining an orientation of the first housing by the orientation sensor.
  • the interface orientation mode may be determined 206 to be the first interface orientation mode when the first housing is oriented in a first orientation wherein the first direction is upwards.
  • the interface orientation mode may be determined 206 to be the second interface orientation mode when the first housing is not oriented in the first orientation.
  • the interface orientation mode may be determined 206 to be the second interface orientation mode when the first housing is oriented in the second orientation.
  • the method 200 further comprises arranging 208 the second portion.
  • the method 200 comprise, in accordance with the determined interface orientation mode being a first interface orientation mode, arranging 208a the second portion between the fourth housing side and the first portion; and in accordance with the determined interface orientation mode being a second interface orientation mode, arranging 208b the second portion between the third housing side and the first portion.
  • Displaying 210 the live representation may comprise in accordance with the monitor device being in a default view mode and in accordance with the determined 206 interface orientation mode being the first interface orientation mode, the live representation may be displayed 210a such that a first image direction of the live representation and the first direction are the same.
  • Displaying 210 the live representation may comprise in accordance with the monitor device being in an inverted view mode and in accordance with the determined 206 interface orientation mode being the first interface orientation mode, the live representation may be displayed 210b such that the first image direction of the live representation and the first direction are opposite.
  • Displaying 210 the live representation may comprise in accordance with the monitor device being in the default view mode and in accordance with the determined 206 interface orientation mode being the second interface orientation mode, the live representation may be displayed 210c such that the first image direction of the live representation and the first direction are opposite.
  • Displaying 210 the live representation may comprise in accordance with the monitor device being in an inverted view mode and in accordance with the determined 206 interface orientation mode being the second interface orientation mode, the live representation may be displayed 210d such that the first image direction of the live representation and the first direction are the same.
  • the method 200 may comprise, e.g. in accordance with the monitor device being in the inverted view mode, displaying 214 an inverted view mode indicator in the first portion, e.g. overlaying a portion of the live representation.
  • the method 200 may comprise displaying 212 an invert view button with the touch sensitive display.
  • the method 200 may further comprise receiving 216 a user input corresponding to activation of the invert view button.
  • the method 200 may comprise changing 218 the view mode.
  • the method 200 may comprise in response to receiving 216 the user input corresponding to activation of the invert view button, in accordance with the monitor device being in the default view mode, changing 218a to the inverted view mode; and in accordance with the monitor device being in the inverted view mode changing 218b to the default view mode.
  • Fig. 8 is a block diagram of an exemplary method 300 performed at a monitor device, such as a monitor device as disclosed in relation to previous figures, such as a monitor device of a medical visualisation system comprising a visualisation device having an image sensor configured to generate image data indicative of a view from the visualisation device.
  • the monitor device may comprise a first housing extending in a first direction from a first housing side to a second housing side and in a second direction perpendicular to the first direction from a third housing side to a fourth housing side.
  • the monitor device comprising a touch sensitive display.
  • the touch sensitive display may be accommodated in the first housing.
  • the method 300 comprising receiving 302 the image data generated by the image sensor; and displaying 304 a live representation of the image data within a first portion of the graphical user interface, including in accordance with the monitor device being in a default view mode, displaying 304a the live representation such that a first image direction of the live representation and the first direction are the same; and in accordance with the monitor device being in an inverted view mode, displaying 304b the live representation such that the first image direction and the first direction are opposite.
  • the method 300 may comprise, e.g. in accordance with the monitor device being in the inverted view mode, displaying 306 an inverted view mode indicator, e.g. in the first portion overlaying a portion of the live representation.
  • the method 300 may comprise displaying 308 an invert view button with the touch sensitive display.
  • the method 300 may further comprise receiving 310 a user input corresponding to activation of the invert view button.
  • the method 300 may comprise changing 312 the view mode.
  • the method 300 may comprise in response to receiving 310 the user input corresponding to activation of the invert view button, in accordance with the monitor device being in the default view mode, changing 312a to the inverted view mode; and in accordance with the monitor device being in the inverted view mode changing 312b to the default view mode.
  • a medical visualisation system comprising a visualisation device having an image sensor configured to generate image data indicative of a view from the visualisation device, the medical visualisation system further comprising a monitor device operable to receive the image data as the image data is being generated by the image sensor, the monitor device comprising a first housing extending in a first direction from a first housing side to a second housing side and in a second direction perpendicular to the first direction from a third housing side to a fourth housing side, the monitor device comprising a touch sensitive display accommodated in the first housing and having a first length in the first direction and a second length in the second direction, and the monitor device comprising a graphical user interface comprising a plurality of non -overlapping portions including a first portion and a second portion, the monitor device displays the graphical user interface with the touch sensitive display, wherein the monitor device displays with the touch sensitive display one or more actionable items within the second portion of the graphical user interface and displays a live representation of the image data within the first portion of the graphical user interface, the monitor
  • the monitor device comprises an orientation sensor, and wherein the monitor device operates the first interface orientation mode when a signal of the orientation sensor is indicative of the first housing being oriented in a first orientation wherein the first direction is upwards, and wherein the monitor device operates the second interface orientation mode when the signal of the orientation sensor is not indicative of the first housing being in the first orientation .
  • the monitor device comprises one or more connection ports configured to receive a connector of the visualisation device, and wherein the one or more connection ports are provided on the third housing side.
  • the one or more actionable items comprise an image capture button, and wherein the monitor device stores an image data file corresponding to the image data received when the image capture button is activated.
  • the one or more actionable items comprises a video capture button
  • the monitor device stores a video sequence of image data corresponding to the image data received when the video capture button is activated.
  • the plurality of non-overlapping portions includes a third portion
  • the monitor device displays with the touch sensitive display one or more actionable menu items within the third portion
  • the third portion is arranged between the third housing side and the first portion in the first interface orientation mode
  • the third portion is arranged between the fourth housing side and the first portion in the second interface orientation mode.
  • the visualisation device comprises a handle and an elongated flexible member extending from the handle to a distal end, the image data being indicative of a view from the distal end of the elongated flexible member
  • the handle comprises a control button adapted to receive an input in a first input direction, and wherein the touch input in the first input direction causes a distal portion of the elongated flexible member to bend in a first bending direction, and wherein the first bending direction corresponds to a first image direction of the live representation, and wherein the first image direction is parallel to the first direction.
  • Medical visualisation system according to item 10, wherein the first image direction and the first direction are the same in the first interface orientation mode, and wherein the first image direction and the first direction are opposite in the second interface orientation mode.
  • Medical visualisation system according to any of items 10-11, wherein the monitor device has a default view mode and an inverted view mode, wherein in the default view mode: the first image direction and the first direction are the same in the first interface orientation mode; and the first image direction and the first direction are opposite in the second interface orientation mode, and wherein in the inverted view mode: the first image direction and the first direction are opposite in the first interface orientation mode; and the first image direction and the first direction are the same in the second interface orientation mode.
  • the monitor device stores with the image data file being stored information indicative of the monitor device operating in the inverted view mode when the image capture button was activated.
  • the monitor device stores with the video sequence of image data being stored information indicative of the monitor device operating in the inverted view mode when the video capture button was activated.
  • Medical visualisation system wherein in the default view mode the invert view button is displayed in a first orientation, and in the inverted view mode the invert view button is displayed in a second orientation, wherein the second orientation of the invert view button is rotated compared to the first orientation of the invert view button, e.g. by 180 degrees.
  • the monitor device comprises a settings menu comprising an option for enabling the inverted view mode, and wherein in accordance with the inverted view mode being enabled in the settings menu, the monitor device displays with the touch sensitive display the invert view button, and in accordance with the inverted view mode not being enabled in the settings menu, the monitor device does not display the invert view button.
  • a method performed at a monitor device of a medical visualisation system comprising a visualisation device having an image sensor configured to generate image data indicative of a view from the visualisation device, the monitor device comprising a first housing extending in a first direction from a first housing side to a second housing side and in a second direction perpendicular to the first direction from a third housing side to a fourth housing side, the monitor device comprising a touch sensitive display accommodated in the first housing and having a first length in the first direction and a second length in the second direction, and the monitor device comprising a graphical user interface comprising a plurality of non-overlapping portions including a first portion and a second portion, the method comprising:
  • the determined interface orientation mode being a first interface orientation mode, arranging the second portion between the fourth housing side and the first portion;
  • the determined interface orientation mode being a second interface orientation mode, arranging the second portion between the third housing side and the first portion;
  • determining the interface orientation mode comprise determining an orientation of the first housing by the orientation sensor, wherein the interface orientation mode is determined to be the first interface orientation mode when the first housing is oriented in a first orientation wherein the first direction is upwards, and wherein the interface orientation mode is determined to be the second interface orientation mode when the first housing is not oriented in the first orientation.
  • Method according to any of items 19-20 wherein displaying the live representation comprises: in accordance with the monitor device being in a default view mode:
  • the determined interface orientation mode being the first interface orientation mode displaying the live representation such that a first image direction of the live representation and the first direction are the same;
  • the determined interface orientation mode being the second interface orientation mode displaying the live representation such that the first image direction and the first direction are opposite
  • the determined interface orientation mode being the first interface orientation mode displaying the live representation such that the first image direction and the first direction are opposite;
  • Method according to any of items 21-22 comprising displaying an invert view button with the touch sensitive display, receiving a user input corresponding to activation of the invert view button, and in response to receiving the user input corresponding to activation of the invert view button:
  • a medical visualisation system comprising a visualisation device having an image sensor configured to generate image data indicative of a view from the visualisation device, the visualisation device comprising a handle and an elongated flexible member extending from the handle to a distal end, the image data being indicative of a view from the distal end of the elongated flexible member, the handle comprises a control button adapted to receive an input in a first input direction, and wherein the touch input in the first input direction causes a distal portion of the elongated flexible member to bend in a first bending direction, the medical visualisation system further comprising a monitor device operable to receive the image data as the image data is being generated by the image sensor, the monitor device comprising a first housing extending in a first direction from a first housing side to a second housing side and in a second direction perpendicular to the first direction from a third housing side to a fourth housing side, the monitor device comprising a touch sensitive display accommodated in the first housing and having a first length in the first direction and
  • Medical visualisation system according to any of items 24-26, wherein the monitor device displays with the touch sensitive display a video capture button, and wherein the monitor device stores a video sequence of image data corresponding to the image data received when the video capture button is activated, and wherein in the inverted view mode the monitor device stores with the video sequence of image data being stored information indicative of the monitor device operating in the inverted view mode when the video capture button was activated.
  • Medical visualisation system wherein in the default view mode the invert view button is displayed in a first orientation, and in the inverted view mode the invert view button is displayed in a second orientation, wherein the second orientation of the invert view button is rotated compared to the first orientation of the invert view button, e.g. by 180 degrees.
  • the monitor device comprises a settings menu comprising an option for enabling the inverted view mode, and wherein in accordance with the inverted view mode being enabled in the settings menu, the monitor device displays with the touch sensitive display the invert view button, and in accordance with the inverted view mode not being enabled in the settings menu, the monitor device does not display the invert view button.
  • a method performed at a monitor device of a medical visualisation system comprising a visualisation device having an image sensor configured to generate image data indicative of a view from the visualisation device, the monitor device comprising a first housing extending in a first direction from a first housing side to a second housing side and in a second direction perpendicular to the first direction from a third housing side to a fourth housing side, the monitor device comprising a touch sensitive display accommodated in the first housing, and a graphical user interface, the method comprising:
  • - displaying a live representation of the image data within a first portion of the graphical user interface including:
  • Method according to item 31 comprising, in accordance with the monitor device being in the inverted view mode, displaying an inverted view mode indicator in the first portion overlaying a portion of the live representation.
  • Method according to any of items 31-32 comprising displaying an invert view button with the touch sensitive display, receiving a user input corresponding to activation of the invert view button, and in response to receiving the user input corresponding to activation of the invert view button: - in accordance with the monitor device being in the default view mode changing to the inverted view mode; and in accordance with the monitor device being in the inverted view mode changing to the default view mode.
  • connection port(s) 38 second image direction 40 connection port(s) 42 actionable menu item(s) 44 invert view button 46 inverted view mode indicator 50 battery indicator 60 processing unit 61 power supply 61a battery 61b power connection 62 memory

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Surgery (AREA)
  • Physics & Mathematics (AREA)
  • Biomedical Technology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Optics & Photonics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Biophysics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Disclosed is a method and a medical visualisation system comprising a visualisation device having an image sensor configured to generate image data indicative of a view from the visualisation device, wherein the monitor device is configured to operate in a first interface orientation mode and a second interface orientation mode, wherein in the first interface orientation mode, a second portion is between a fourth housing side and a first portion, and wherein in the second interface orientation mode, the second portion is between a third housing side and the first portion.

Description

ROTATIONAL USER INTERFACE FOR A MEDICAL VISUALISATION SYSTEM
The present disclosure relates to a visualisation device, such as an endoscope and a medical visualisation system, such as an endoscope system, comprising a visualisation device. More specifically the present disclosure relates to a graphical user interface and a monitor device having such graphical user interface for interacting with the medical visualisation system.
BACKGROUND
A visualisation device may be utilized to visually examine certain areas of the body of a person, such as inside a body cavity of the person. For example, a visualisation device may be used to inspect the airways, the digestive tract, or the intestines.
A visualisation device may be provided with a camera and be attached to a monitor device, such as a monitor with a display screen, a video output from the camera of the visualisation device may be received and displayed at the monitor device, thereby allowing an operator to control the visualisation device to inspect an area of interest.
For example, a visualisation device may be an endoscope, such as a disposable endoscope. An endoscope comprises an operating handle at the proximal end and an insertion tube extending from the handle towards the distal end. The handle is configured to be held by an operator and inter alia comprises externally protruding operating members connected to internal control means allowing the operator to control the movement of a bending section at the distal end of the insertion tube, while advancing the distal end of the insertion tube to a desired location e.g. within a body cavity of a person. By means of an attached monitor device, such as a monitor with a display screen, the location to which the distal end has been advanced may be inspected using the endoscope.
The monitor device of a medical visualisation system may be provided with some functionality, such as ability to save still images and/or video sequences of the view from the attached visualisation device. Furthermore, the monitor device may comprise some image processing capabilities, and may be configured to output a video or image output, e.g. to an external display.
SUMMARY
The present disclosure relates to a visualisation device, such as an endoscope, and a visualisation system, such as an endoscope system. Particularly, but not exclusively the visualisation device may be a disposable camera endoscope. Alternatively, the visualisation device may be a video laryngoscope, an endotracheal tube and/or a laryngeal mask. The visualisation system may further comprise a monitor device for being connected to the visualisation device, e.g. the monitor device may be configured to receive image data from the visualisation device. The present disclosure further relates to a graphical user interface for such monitor device of a medical visualisation system.
It is an object of the present disclosure to provide a solution which at least improve the solutions of the prior art. Particularly, it is an object of the present disclosure to provide a graphical user interface for a medical visualisation system which facilitates and enhances human interaction with the system.
It is a further object of the present disclosure to provide a system and method facilitating enhanced control and usability of a medical visualisation system.
Accordingly, a medical visualisation system and a method performed at a monitor device of the medical visualisation system are disclosed.
The medical visualisation system comprises a visualisation device, such as an endoscope, such as a disposable endoscope. Alternatively, the visualisation device may be a video laryngoscope, an endotracheal tube and/or a laryngeal mask. The visualisation device has an image sensor configured to generate image data indicative of a view from the visualisation device. The medical visualisation system may comprise a plurality of visualisation devices each having an image sensor configured to generate image data indicative of a view from the visualisation device. The plurality of visualisation devices may include a first visualisation device and/or a second visualisation device. The first visualisation device may comprise a first image sensor configured to generate image data indicative of a view from the first visualisation device. The second visualisation device may comprise a second image sensor configured to generate image data indicative of a view from the second visualisation device. The image sensor(s) may be any sensor capable of detecting and conveying information used to make an image. For example, the image sensor(s) may comprise a CCD or CMOS sensor, or similar. The image sensor(s) may generate image data corresponding to a square image, i.e. having equal height and width. For example, the image data generated by the image sensors may correspond to a 300x300 pixel image, or a 400x400 pixel image, or a 600x600 pixel image, or a 800x800 pixel image. Alternatively or additionally, the image sensor may generate image data corresponding to a non-square image, which is cropped to form a square image, such as a square image having 300x300 pixels, 400x400 pixels, 600x600 pixels, or 800x800 pixels. The medical visualisation system further comprises a monitor device receiving and/or being operable to receive the image data generated by the image sensor. The monitor device may receive and/or be operable to receive the image data, e.g. as the image data is being generated, e.g. within limitation of the hardware. The monitor device comprises a first housing extending in a first direction from a first housing side to a second housing side and in a second direction perpendicular to the first direction from a third housing side to a fourth housing side. The monitor device comprises a display, e.g. a touch sensitive display. The display may be accommodated in the first housing. The display may have a first length in the first direction and a second length in the second direction. The second length may be longer than the first length, e.g. the display may be a 16:9 or 16:10 display. Alternatively, the first length may be longer than the second length, or the first length and the second length may be substantially the same. The touch sensitive display may be any suitable type of touch display, e.g. capacitive touch display or resistive touch display.
The monitor device may comprise one or more connection ports configured to receive a connector of the visualisation device. The connection ports and the corresponding connector of the visualisation device may be a proprietary plug and socket connectors, or any standard connector capable of transmitting therethrough at least the image data from the image sensor. Furthermore, the connector and connection ports may be configured to supply power to the components of the visualisation device.
The one or more connection ports may be arranged on the first housing. The one or more connection ports may be provided on the third housing side, and/or on the fourth housing side.
The monitor device may comprise an on/off button. The on/off button may be arranged on the first housing. The on/off button may be provided on the third housing side or on the fourth housing side. The one or more connection ports may be provided on the third housing side and the on/off button may be provided on the fourth housing side.
The monitor device may establish connection to a visualisation device, such as the first visualisation device and/or the second visualisation device. Establishing connection to the visualisation device may include receiving a device connector of the respective visualisation device in a connection port of the one or more connection ports of the monitor device. Establishing connection to a visualisation device may include obtaining device identifier information from a device identifier (e.g. EPROM, QR-code, NFC, RFID or similar) of the visualisation device. For example, establishing connection to the first visualisation device may include obtaining first device identifier information from a first device identifier of the first visualisation device and/or establishing connection to the second visualisation device may include obtaining second device identifier information from a second device identifier of the second visualisation device.
The monitor device may comprise a processing unit and memory. The processing unit and/or the memory may be accommodated in the first housing. Alternatively, the monitor device may comprise a second housing, and the processing unit and/or the memory may be accommodated in the second housing. The monitor device may comprise an orientation sensor, e.g. for determining the orientation of the monitor device, such as of the first housing, relative to gravity. The orientation sensor may comprise one or more accelerometers and/or a gyroscope. The orientation sensor may be accommodated in the first housing. The processing unit may be connected to the touch sensitive display to control display of information with the touch sensitive display, and the processing unit may be adapted to receive a signal from the touch sensitive display indicative of touch inputs on the touch sensitive display. Thereby, the monitor device may detect user inputs, e.g. in the form of touch inputs, with the touch sensitive display. Touch inputs may, for example, comprise single tap(s), double tap(s), or swipe(s) on the touch sensitive display. The processing unit may be connected to the orientation sensor to receive an orientation signal indicative of the orientation of the monitor device, such as of the first housing of the monitor device. The processing unit may be connected to the memory and be adapted to read and write data from and to the memory.
The monitor device may comprise a power unit for powering the monitor device. The power unit may comprise a rechargeable battery and/or a power connection for connecting the power unit to an external power supply, such as a conventional AC power socket. The power unit may be accommodated in the first housing. Alternatively, the power unit may be accommodated in the second housing.
The monitor device may comprise a graphical user interface. The monitor device and/or the processing unit of the monitor device may display with the touch sensitive display the graphical user interface. The graphical user interface may comprise one or more portions, such as a plurality of portions. The portions may be non-overlapping portions, such as a plurality of non-overlapping portions. The portions may include a first portion and/or a second portion. The portions may further include a third portion and/or a fourth portion. The second portion and/or the fourth portion may be designated as background portions, e.g. the second portion may be a first background portion and/or the fourth portion may be a second background portion. Each of the plurality of portions may extend substantially throughout the first length in the first direction. The first portion may be arranged between the fourth portion and the second portion along the second direction. The fourth portion may be arranged between the third portion and the first portion along the second direction. The third portion may be arranged between a side of the first housing, e.g. the third housing side, and the fourth portion along the second direction. The second portion may be arranged between another side of the first housing, e.g. the fourth housing side, and the first portion along the second direction. The first portion and the fourth portion may be arranged between the second portion and the third portion along the second direction. The first portion of the graphical user interface may be square. The first portion of the graphical user interface may occupy the centre of the touch sensitive display. The first portion of the graphical user interface may be larger along the second direction than the second portion, the third portion and/or the fourth portion, individually and/or collectively. The first portion of the graphical user interface may extend throughout more than 40% of the second length in the second direction, such as more than 50% of the second length in the second direction, such as more than 60% of the second length in the second direction.
The monitor device may display a live representation of the image data, e.g. within the first portion of the graphical user interface. The live representation of the image data may be displayed, e.g. by the processing unit, with the touch sensitive display, e.g. within the first portion of the graphical user interface.
The visualisation device, e.g. an endoscope, may comprise a handle and an elongated flexible member extending from the handle to a distal end. The image sensor may be arranged at the distal end of the elongated flexible member. The image data may be indicative of a view from the distal end of the elongated flexible member. The handle may comprise a control button adapted to receive an input in a first input direction and/or in a second input direction. The first input direction and the second input direction may be opposite. The touch input in the first input direction may cause a distal portion of the elongated flexible member to bend in a first bending direction and/or may cause movement of the image sensor in a first image sensor direction. The touch input in the second input direction may cause the distal portion of the elongated flexible member to bend in a second bending direction and/or may cause movement of the image sensor in a second image sensor direction. The live representation of the image data may have directions corresponding to directions of the image sensor generating the image data. The first bending direction may correspond to a first image direction of a representation of the image data, such as the live representation of the image data. The second bending direction may correspond to a second image direction of the representation of the image data, such as the live representation of the image data. The first image direction and/or the second image direction may be parallel to the first direction of the first housing. The monitor device may provide one or more actionable items. One or more actionable items may be displayed, e.g. by the processing unit, with the touch sensitive display, e.g. within the second portion of the graphical user interface. One or more actionable menu items may be displayed, e.g. by the processing unit, with the touch sensitive display, e.g. within the third portion of the graphical user interface. A battery indicator may be displayed, e.g. by the processing unit, with the touch sensitive display, e.g. within the third portion of the graphical user interface. A time indicator may be displayed, e.g. by the processing unit, with the touch sensitive display, e.g. within the third portion of the graphical user interface.
The one or more actionable items, e.g. displayed within the second portion of the graphical user interface of the monitor device, may comprise an image capture button and/or a video capture button. In response to activation of the image capture button, e.g. by a user providing a touch input, e.g. a single tap, at the respective location of the touch sensitive display, an image data file corresponding to the image data received when the image capture button was activated may be stored, e.g. in memory of the monitor device. In response to activation of the video capture button, e.g. by a user providing a touch input, e.g. a single tap, at the respective location of the touch sensitive display, a video sequence of image data corresponding to the image data received when the video capture button was activated may be stored, e.g. in memory of the monitor device. A first activation of the video capture button may start collection of image data for the video sequence, and a second activation of the video capture button (subsequent to the first activation of the video capture button) may stop the collection of image data for the video sequence. The stored video sequence may correspond to the image data received between the first activation and the second activation of the video capture button. The video capture button may be displayed in a first appearance prior to the first activation and after the second activation. The video capture button may be displayed in a second appearance after the first activation and before the second activation.
The monitor device may have a first interface orientation mode and a second interface orientation mode. In the first interface orientation mode, the second portion is arranged between the fourth housing side and the first portion, e.g. along the second direction. In the second interface orientation mode, the second portion is arranged between the third housing side and the first portion, e.g. along the second direction.
Also disclosed is a method performed at a monitor device of a medical visualisation system, such as the monitor device and medical visualisation system as described herein. The method may comprise receiving the image data generated by the image sensor, e.g. as the image data is being generated; displaying one or more actionable items within the second portion of the graphical user interface; and determining an interface orientation mode of the monitor device.
The method may further comprise, in accordance with the determined interface orientation mode being a first interface orientation mode, arranging the second portion between the fourth housing side and the first portion; and in accordance with the determined interface orientation mode being a second interface orientation mode, arranging the second portion between the third housing side and the first portion.
The method may further comprise displaying a live representation of the image data within the first portion of the graphical user interface.
It is an advantage of the present disclosure that a monitor device for a medical visualisation system is provided, which may be oriented in a plurality of orientations and that the graphical user interface may be adapted to such orientation. For example, it may be advantageous to orientate the monitor device and/or a first housing of the monitor device according to physical features. For example, the present disclosure allows the monitor device and/or the first housing to be oriented such that, e.g. connection ports, are located on the side most convenient according to the circumstances.
The monitor device may comprise one or more connection ports for receiving a connector of the visualisation device. The connection ports may be arranged on the first housing. The one or more connection ports may be provided on the third housing side. Alternatively or additionally, one or more connection ports may be provided on the fourth housing side.
The first housing may be oriented in a first orientation wherein the first direction is upwards and in a second orientation wherein the first direction is downwards. For example, the monitor device and/or the first housing may comprise a stand to support the first housing in either of the first orientation and the second orientation. In the first orientation the first housing side may be facing downwards. In the second orientation the first housing side may be facing upwards. In the first orientation the second housing side may be facing upwards. In the second orientation the second housing side may be facing downwards.
An invert interface button may be provided. For example, the invert interface button may be displayed with the touch sensitive display, e.g. by the processing unit. Alternatively, the invert interface button may be provided as a hardware button on the monitor device and/or on the first housing. The monitor device may change between operating the first interface orientation mode and operating the second interface orientation mode in response to activation of the invert interface button.
The monitor device may comprise an orientation sensor, such as a gyroscope and/or one or more accelerometers. The orientation sensor may be configured to detect the orientation of the first housing relative to gravity. The orientation sensor may be accommodated in the first housing. The orientation sensor may provide an orientation signal indicative of the orientation of the first housing, e.g. relative to gravity. The monitor device, e.g. by the processing unit, may, based on the orientation sensor and/or the orientation sensor signal, determine whether the first housing is oriented in the first orientation. Alternatively or additionally, the monitor device, e.g. by the processing unit, may, based on the orientation sensor and/or the orientation sensor signal, determine whether the first housing is oriented in the second orientation. Determining the interface orientation mode may comprise determining an orientation of the first housing by the orientation sensor, such as by the orientation sensor signal and/or by the processing unit. The monitor device may operate in the first interface orientation mode in the first orientation, e.g. based on the orientation sensor signal of the orientation sensor. The monitor device may operate in the second interface orientation mode in the second orientation, e.g. based on the orientation sensor signal of the orientation sensor. The monitor device may operate in the first interface orientation mode when a signal of the orientation sensor is indicative of the first housing being oriented in the first orientation. The monitor device may be operating in the second interface orientation mode when the signal of the orientation sensor is not indicative of the first housing being in the first orientation and/or when the signal of the orientation sensor is indicative of the first housing being in the second orientation. In the first interface orientation mode the first direction may be upwards. In the second interface orientation mode the first direction may be downwards.
The one or more actionable items, displayed within the second portion of the graphical user interface, may comprise an image capture button and/or a video capture button, as explained above. The second portion is between the first portion and the fourth housing side in the first interface orientation mode and between the first portion and the third housing side in the second interface orientation mode. The inventors have found that this provides an advantageous solution because an assistant entrusted with operating the actionable items during the procedure is usually located on the side corresponding to the third housing side in the second orientation of the first housing and corresponding to the fourth housing side in the first orientation of the first housing. For example, the assistant may be usually located to the right of the monitor device and/or the first housing. Thus, with the present disclosure, the graphical user interface may be configured to arrange the actionable items in a position which reduces the necessity for an operator to partly obstruct the visibility of live representation when performing certain operations needed during a procedure. Furthermore, it may be advantageous to be able to orient the monitor device and/or the first housing differently to arrange physical features, such as connection ports on/off button etc. to accommodate for the environment wherein the monitor device and/or the first housing is to be used.
The first image direction of the live representation of the image data and the first direction of the first housing may be the same in the first interface orientation mode. The first image direction and the first direction may be opposite in the second interface orientation mode. The second image direction and the first direction may be opposite in the first interface orientation mode. The second image direction and the first direction may be the same in the second interface orientation mode.
Effectively, a touch input in the first input direction on the control button of the visualisation device may cause a movement of the distal end of the elongated flexible member corresponding to the first image direction, and/or a touch input in the second input direction on the control button of the visualisation device may cause a movement of the distal end of the elongated flexible member corresponding to the second image direction. Accordingly, the operator is able to navigate the visualisation device based on the live representation displayed with the touch sensitive display of the monitor device.
The monitor device may have a default view mode and in an inverted view mode. In the default view mode, the first image direction and the first direction may be the same, and in the inverted view mode, the first image direction and the first direction may be opposite. In accordance with the monitor device being in the default view mode the live representation may be displayed such that a first image direction of the live representation and the first direction are the same. In accordance with the monitor device being in the inverted view mode the live representation may be displayed such that the first image direction and the first direction are opposite.
The relationship between the image directions and the direction of the first housing may be subjective to both whether the monitor device operates the default view mode or the inverted view mode and whether the monitor device operates the first interface orientation mode or the second interface orientation mode. In the default view mode, the first image direction and the first direction may be the same in the first interface orientation mode; and the first image direction and the first direction may be opposite in the second interface orientation mode. In the inverted view mode, the first image direction and the first direction may be opposite in the first interface orientation mode, and the first image direction and the first direction may be the same in the second interface orientation mode. In accordance with the monitor device being in the default view mode and in accordance with the determined interface orientation mode being the first interface orientation mode, the live representation may be displayed such that a first image direction of the live representation and the first direction are the same. In accordance with the monitor device being in the default view mode and in accordance with the determined interface orientation mode being the second interface orientation mode, the live representation may be displayed such that the first image direction and the first direction are opposite. In accordance with the monitor device being in the inverted view mode and in accordance with the determined interface orientation mode being the first interface orientation mode, the live representation may be displayed such that the first image direction and the first direction are opposite. In accordance with the monitor device being in the inverted view mode and in accordance with the determined interface orientation mode being the second interface orientation mode, the live representation may be displayed such that the first image direction and the first direction are the same.
Changing between the default view mode and the inverted view mode may cause the live representation to be rotated, e.g. by 180 degrees. In the inverted view mode an inverted view mode indicator may be displayed, e.g. by the monitor device with the touch sensitive display, in the first portion overlaying a portion of the live representation.
The ability to change between default view mode and inverted view mode may be advantageous in certain procedures depending on the location of the operator relative to the patient, and/or depending on how the operator is holding the handle of the visualisation device.
In the inverted view mode a stored image data file, e.g. stored in response to receipt of activation of an image capture button of the one or more actionable items, may comprise information indicative of the monitor device having been operated in the inverted view mode when the image capture button was activated. The monitor device may store with the image data file being stored information indicative of the monitor device operating in the inverted view mode when the image capture button was activated. For example, metadata indicative of the inverted view mode being active may be embedded in the stored image data file. Alternatively, a visible mark, e.g. the inverted view mode indicator, may be provided on the stored image data file. In the inverted view mode a stored video sequence of image data, e.g. stored in response to receipt of activation of a video capture button of the one or more actionable items, may comprise information indicative of the monitor device having been operated in the inverted view mode when the video capture button was activated. The monitor device may store with the video sequence being stored, information indicative of the monitor device operating in the inverted view mode when the video capture button was activated. For example, metadata indicative of the inverted view mode being active may be embedded in the stored video sequence of image data. Alternatively, a visible mark, e.g. the inverted view mode indicator, may be provided on the images of the stored video sequence.
An invert view button may be displayed with the touch sensitive display. The monitor device may display, e.g. with the touch sensitive display, the invert view button. The invert view button may be displayed within the second portion of the graphical user interface. The monitor device may change between the default view mode and the inverted view mode in response to activation of the invert view button. The user may change between the default view mode and the inverted view mode by activating the invert view button. The invert view button may be accessible from a settings menu.
In the default view mode the invert view button may be displayed in a first orientation, and in the inverted view mode the invert view button may be displayed in a second orientation. The second orientation of the invert view button may be rotated compared to the first orientation of the invert view button, e.g. by 180 degrees. The appearance of the invert view button may thereby be used to indicate the state of the monitor device, i.e. whether the monitor device operates the default view mode or the inverted view mode.
A user input corresponding to activation of the invert view button may be detected, e.g. by the touch sensitive display, and in response to detecting the user input corresponding to activation of the invert view button, in accordance with the monitor device being in the default view mode changing to the inverted view mode; and in accordance with the monitor device being in the inverted view mode changing to the default view mode.
The monitor device may comprise a settings menu. The settings menu may comprise an option for enabling the inverted view mode. In accordance with the inverted view mode being enabled in the settings menu, the invert view button may be displayed with the touch sensitive display, e.g. the monitor device may display the invert view button with the touch sensitive display, and in accordance with the inverted view mode not being enabled in the settings menu, the invert view button may not be displayed with the touch sensitive display.
BRIEF DESCRIPTION OF THE FIGURES
Embodiments of the disclosure will be described in more detail in the following with regard to the accompanying figures. The figures show one way of implementing the present invention and are not to be construed as being limiting to other possible embodiments falling within the scope of the attached claim set.
Fig. 1 schematically illustrates an exemplary medical visualisation system,
Fig. 2 schematically illustrates an exemplary monitor device,
Fig. 3 schematically illustrates an exemplary monitor device,
Fig 4 is a block diagram of an exemplary monitor device,
Fig. 5 illustrates an exemplary monitor device,
Figs. 6a and 6b schematically illustrates a monitor device,
Fig. 7 is a block diagram of an exemplary method, and Fig. 8 is a block diagram of an exemplary method.
DETAILED DESCRIPTION
Various exemplary embodiments and details are described hereinafter, with reference to the figures when relevant. It should be noted that the figures may or may not be drawn to scale and that elements of similar structures or functions are represented by like reference numerals throughout the figures. It should also be noted that the figures are only intended to facilitate the description of the embodiments. They are not intended as an exhaustive description of the invention or as a limitation on the scope of the invention. In addition, an illustrated embodiment needs not have all the aspects or advantages shown. An aspect or an advantage described in conjunction with a particular embodiment is not necessarily limited to that embodiment and can be practiced in any other embodiments even if not so illustrated, or if not so explicitly described.
Fig. 1 schematically illustrates an exemplary medical visualisation system 2 comprising a visualisation device 4 and a monitor device 20. The visualisation device 4 has an image sensor 12, e.g. a CCD or a CMOS, configured to generate image data indicative of a view from the visualisation device 4. In the illustrated example, the visualisation device 4 is an endoscope comprising a handle 6 and an elongated flexible member 8, e.g. an insertion tube, extending from the handle 6 to a distal end 10. The image sensor 12 may be configured to generate image data indicative of a view from the distal end 10 of the elongated flexible member 8.
The visualisation device 4 may be connected to the monitor device 20. In the illustrated example, a device cable 14 extending from the handle 6 terminates in a device connector 16 connected to a connection port 40 of the monitor device 20. The monitor device 20 is operable to receive image data generated by the image sensor 12 of the visualisation device 4. For example, the monitor device 20 may receive image data generated by the image sensor 12 via the device cable 14, the connector 16 and connection port 40.
The handle 6 comprises a control button 7 adapted to receive an input in a first input direction and/or in a second input direction. The touch input in the first input direction on the control button 7 causes a distal portion 9 of the elongated flexible member 8 to bend in a first bending direction, e.g. via wires extending from the handle, through the elongated flexible member 8 to the distal portion 9. The touch input in the second input direction on the control button 7 causes the distal portion 9 of the elongated flexible member 8 to bend in a second bending direction. The first input direction and the second input direction may be opposite. The first bending direction and the second bending direction may be opposite. Bending the distal portion 9 of the elongated flexible member 8 may cause a movement of the distal end 10 and the image sensor 12 in a direction relative to the image sensor 12. Thereby, seeing an image generated by the image sensor 12, a direction, e.g. up or down, in the image may correspond to a respective input on the control button 7.
Fig. 2 schematically illustrates an exemplary monitor device 20, such as the monitor device 20 as illustrated in Fig. 1. The monitor device 20 comprises a first housing 25. The first housing 25 extends in a first direction xl from a first housing side 21 to a second housing side 22 and in a second direction x2 perpendicular to the first direction xl from a third housing side 23 to a fourth housing side 24. The monitor device comprises a touch sensitive display 26 accommodated in the first housing 25. The touch sensitive display 26 has a first length LI in the first direction xl and a second length L2 in the second direction x2. The second length L2 may be longer than the first length LI as illustrated. The monitor device may comprise one or more connection port(s) 40, such as three connection ports 40, as illustrated. The connection ports 40 may allow visualisation devices to be connected. The connection port(s) 40 may be arranged at the third housing side 23, as illustrated. Alternatively or additionally, connection port(s) 40 may be arranged at the fourth housing side 24.
The monitor device may comprise an on/off button 41, which may be provided on the fourth housing side 24, as illustrated.
Fig. 3 schematically illustrates an exemplary monitor device 20, such as the monitor device 20 as illustrated in Figs. 1-2. As illustrated a device connector 16 may be connected to a connection port 40.
The monitor device 20 may be provided with a graphical user interface 27. The graphical user interface 27 may be displayed with the touch sensitive display 26, and the user may interact with the graphical user interface 27, e.g. by means of providing touch inputs on the touch sensitive display 26.
The graphical user interface 27 is displayed with the touch sensitive display 26. The graphical user interface 27 comprises a plurality of non-overlapping portions 31, 32, 33, 34. Each of the portions 31, 32, 33, 34 extends substantially throughout the first length LI in the first direction xl. The non-overlapping portions includes a first portion 31, a second portion 32, a third portion 33 and a fourth portion 34. The first portion 31 is arranged between the fourth portion 34 and the second portion 32 along the second direction x2. The fourth portion 34 is arranged between the third portion 33 and the first portion 31 along the second direction x2. The third portion 33 is arranged between a side of the first housing, e.g. the third housing side 23, and the fourth portion 34 along the second direction x2. The second portion 32 is arranged between another side of the first housing 25, e.g. the fourth housing side 24, and the first portion 31 along the second direction x2. The first portion 31 and the fourth portion 34 are arranged between the second portion 32 and the third portion 33 along the second direction.
The monitor device 20 displays a live representation 70 of the image data within the first portion 31 of the touch sensitive display 26. The first bending direction and the second bending direction of the distal portion 9 of the elongated flexible member 8, as described with respect to Fig. 1, may corresponds to a first image direction 37 and a second image direction 38 of the live representation 70, respectively. The first image direction 37 and the second image direction 38 may be parallel to the first direction xl, as illustrated. The first image direction 37 and the second image direction 38 may be opposite, as illustrated. Thereby, a user operating the control button 7 of visualisation device 2 may cause movement of the distal portion 9 of the elongated flexible member 8 to bend in a direction corresponding to the first image direction 37 or the second image direction 38 of the live representation 70.
The monitor device 20 displays with the touch sensitive display 26 one or more actionable items 36 within the second portion 32 of the graphical user interface 27. The actionable items 36 may comprise an image capture button 36a, e.g. for storing an image data file corresponding to the image data received when the image capture button 36a was activated. Alternatively or additionally, the actionable items 36 may comprise a video capture button 36b, e.g. for storing a video sequence of image data corresponding to the image data received when the video capture button 36b was activated.
The monitor device 20 displays with the touch sensitive display 26 one or more actionable menu items 42 within the third portion 33 of the graphical user interface 27. The actionable menu items 42 may, for example, comprise a login menu item for initiating a login procedure, a settings menu item for accessing a settings menu, an archive menu item for browsing an archive, and a default menu item for returning to a default view. Also a battery indicator 50 is displayed in the third portion 33.
Fig. 4 is a block diagram of an exemplary monitor device 20, such as the monitor device 20 of the previous figures. The monitor device 20 comprises a processing unit 60 and memory 62. The memory 62 may comprise both volatile and non-volatile memory. The monitor device 20 also comprise an orientation sensor 64 for determining the orientation of the first housing 25 relative to gravity. The orientation sensor 64 may comprise one or more accelerometers and/or a gyroscope. The monitor device 20 comprises input/output module 66, such as for receiving image data from the image sensor 12 via connectors of visualisation device 4. The input/output module 66 may also comprise ethernet connector, WiFi transceiver, Bluetooth transceiver, video connectors, USB ports etc., and respective controllers. The monitor device 20 also comprises the touch sensitive display 26 as described earlier. The monitor device 20 may display information, graphical user interface objects, images, buttons etc, with the touch sensitive display 27. The monitor device 20 also comprises a microphone 68. The monitor device 20 comprises a power unit 61 for powering the monitor device 20. The power unit 61 may comprise a rechargeable battery 61a. The power unit 61 may comprise a power connection 61b for connecting the power unit 61 to an external power supply, such as a conventional AC power socket. The components of the monitor device 20 may be interconnected by buses or signal lines. Some or all of the components of the monitor device may be accommodated in the first housing 25 as illustrated. Flowever, alternatively some of the components, e.g. the processing unit 60, the memory 62, input/output module 66 and/or the power unit 61 may be accommodated in a second housing of the monitor device 20.
The power unit 61 may comprise components for, e.g. indirectly measuring, capacity of the rechargeable battery 61a. For example, the power unit 61 may comprise a voltage gauge to measure the voltage of the rechargeable battery 61a. Based on the measured voltage, the remaining capacity of the rechargeable battery 61a may be estimated, e.g. by the processing unit 60. The power unit 61 may also comprise components for measuring power consumption of the monitor device 20. For example, the power unit 61 may comprise a power meter to measure the rate at which the monitor device 20 consumes power from the rechargeable battery 61a. The voltage gauge may be a low current consumption integrated circuit or a resistor coupled in parallel with the battery. A current sensor may be provided and the power may be computed as the product of the voltage and current. Additionally, an integrated circuit may be provided that includes a voltage gauge and a current sensor, and which outputs a power value in digital form.
The monitor device 20 may display content with the touch sensitive display 26. For example, the monitor device 20 may display content by the processing device 60 transmitting instructions to the touch sensitive display 26 indicative of the content to be displayed. The monitor device 20 may receive user input with the touch sensitive display 26. Particularly, the monitor device 20 may detect user inputs with the touch sensitive display 26. For example, a user providing a touch input on the touch sensitive display 26 causes a change in one or more electrical parameters of the touch sensitive display 26 indicative of at least the location of the touch input. Information of the touch input is transmitted from the touch sensitive display 26 to the processing unit 60, and the processing unit 60 may determine whether the touch input corresponds to an action to perform, e.g. whether the location of the touch input corresponds to the location of a soft-button displayed at the touch sensitive display.
The user may interact with the monitor device 20 via the graphical user interface 27 by providing user inputs, e.g. by means of providing touch inputs on the touch sensitive display 26, and the monitor device 20 may detect such user inputs with the touch sensitive display 26. A touch input, e.g. a single tap, double tap, swipe or similar, and the location of the touch input on the touch sensitive display 26 is registered by the touch sensitive display 26, which transmits information of the touch input (e.g. including type of touch (double tap, single tap, swipe, etc.) and/or location of the touch) to the processing unit 60 of the monitor device 20. The processing unit 60 interprets the information received and determines whether the touch input corresponds to activation of an action, e.g. whether the touch input correspond to activation of a button displayed with the touch sensitive display 27 at the location of the touch input. In response to a determination that the touch input corresponds to activation of an action, the processing unit 60 performs the respective action.
For example, with reference to Figs. 3 and 4, to capture an image corresponding to the presently shown live representation 70, e.g. corresponding to the image data received from the image sensor, the user may tap the image capture button 36a. The tap and the location of the tap is registered by the touch sensitive display 26, which transmits the information of the tap to the processing unit 60 of the monitor device 20. The processing unit 60 interprets the information received and determines that the user tapped the location corresponding to the image capture button 36a. In response thereto, the processing unit 60 stores, in memory 62 an image data file corresponding to the image data received.
In further reference to Figs. 3 and 4, to capture a video sequence corresponding to the shown live representation 70 over a period of time, e.g. corresponding to the image data received from the image sensor over a period of time, the user may tap the video capture button 36b. The tap and the location of the tap is registered by the touch sensitive display 26, which transmits the information of the tap to a processing unit 60 (see Fig. 4) of the monitor device 20. The processing unit 60 interprets the information received and determines that the user tapped the location corresponding to the video capture button 36b. In response thereto, the processing unit 60 starts collection of image data received from the image sensor 12 and temporarily stores the data in memory 62. To stop the recording, the user may tap the video capture button 36b again. The processing unit 60 determines, based on the signal received from the touch sensitive display 26, that that the user tapped the video capture button 36b and stops collecting image data received from the image sensor 12. The processing unit 60 read the temporarily stored data from the memory 62 and create a complete video sequence based thereon, which the processing unit 60 stores in the memory 62.
Fig. 5 illustrates an exemplary monitor device 20, such as the monitor device 20 of the previous figures, wherein the monitor device 20, such as the first housing 25 of the monitor device 20, has been rotated 180 degrees relative to the monitor device 20 of Figs. 2-3, such that the second housing side 22 is now downwards and the first housing side 21 is upwards. By rotating the monitor device 20 and/or the first housing 25 180 degrees the second direction x2 of the first housing 25 is in Fig. 5 from right to left whereas in the Figs. 2-3, the second direction x2 was from left to right. Similarly, by rotating the first housing 25 the first direction xl of the first housing 25 is in Fig. 5 downwards whereas in the Figs. 2-3, the first direction xl was upwards. To enhance operability of the monitor device 20, the monitor device 20 may operate a first interface orientation mode, as illustrated in Fig. 3, and a second interface orientation mode, as illustrated in Fig. 5. As illustrated in Fig. 3, in the first interface orientation mode, the second portion 32 is between the fourth housing side 24 and the first portion 31, and the third portion 33 is between the third housing side 23 and the first portion 31. As illustrated in Fig. 5, in the second interface orientation mode, the second portion 32 is between the third housing side 23 and the first portion 31, and the third portion 33 is between the fourth housing side 24 and the first portion 31.
The monitor device 20 may change between the first interface orientation mode and the second interface orientation mode based on a value of a manual setting. For example, the user may press an invert interface button 100, e.g. displayed with the touch sensitive display 26, e.g. in a settings menu, or being a hardware button. The monitor device 20 may change between the first interface orientation mode and the second interface orientation mode upon activation of the invert interface button 100. The processing unit 60 of the monitor device 20 may determine that the user has tapped the touch sensitive display 26 at the position corresponding to the invert interface button 100 and in response change between the first interface orientation mode and the second interface orientation mode.
Alternatively or additionally, the monitor device 20 may comprise an orientation sensor 64 (see Fig. 4), e.g. accommodated in the first housing 25, and the monitor device 20 may change between the first interface orientation mode and the second interface orientation mode based on input from the orientation sensor 64. For example, the first housing 25 may be oriented in a first orientation, e.g. as illustrated in Fig. 3, wherein the first direction is upwards. The monitor device 20 may operate in the first interface orientation mode, as illustrated in Fig. 3, when being oriented in the first orientation, e.g. based on an orientation signal received from the orientation sensor. For example, the processing unit 60, based on the orientation signal received from the orientation signal, may determine the orientation of the first housing 25 and change between the first interface orientation mode and the second interface orientation mode, accordingly. Similarly, the first housing 25 may be oriented in a second orientation, e.g. as illustrated in Fig. 5, wherein the first direction is downwards. The monitor device 20 may operate in the second interface orientation mode, as illustrated in Fig. 5, when being oriented in the second orientation. In the first orientation, the connection ports 40 may be on the left side of first housing 25. In the second orientation, the connection ports 40 may be on the right side of the first housing 25. As explained above (see Fig. 1), the visualisation device 2 may comprise a control button 7 configured to cause a movement of the image sensor 12 corresponding to a first image direction 37 and/or a second image direction 38 of the live representation. The first image direction 37 and the first direction xl may be the same in the first interface orientation mode (cf. Fig. 3). The first image direction 37 and the first direction xl may be opposite in the second interface orientation mode (cf. Fig. 5).
Figs. 6a and 6b schematically illustrates a monitor device 20, such as the monitor device 20 of any of the previous figures. The first housing 25 of the monitor device 20 is in Figs. 6a and 6b shown in the first orientation, as described above.
The monitor device 20 may operate a default view mode, e.g. as illustrated in Fig. 6a, and an inverted view mode, e.g. as illustrated in Fig. 6b. The orientation of the live representation within the first portion 31 is rotated 180 degrees when changing between the default view mode and the inverted view mode. In the default view mode (Fig. 6a) the first image direction 37 and the first direction xl are the same, e.g. when the monitor device 20 operates the first interface orientation mode, e.g. when the first housing 25 is in the first orientation; as illustrated. In the inverted view mode (Fig. 6b) the first image direction 37 and the first direction xl are opposite, e.g. when the monitor device 20 operates the first interface orientation mode, e.g. when the first housing 25 is in the first orientation; as illustrated.
If the monitor device 20, in contrast to the examples of Figs. 6a and 6b, operates the second interface orientation mode, e.g. as illustrated in Fig. 5, the first image direction 37 and the first direction xl are the same, in the inverted view mode; and the first image direction 37 and the first direction xl are opposite, in the default view mode.
In the inverted view mode (Fig. 6b) an inverted view mode indicator 46 may be displayed in the first portion 31, e.g. overlaying a portion of the live representation. The inverted view mode indicator 46 may be partly transparent to reduce obstruction of the live representation.
In the inverted view mode (Fig. 6b) a stored image data file, e.g. stored in response to the user activating the image capture button 36a of the actionable items 36, and/or a stored video sequence of image data, e.g. stored in response to the user activating the video capture button 36b of the actionable items 36, may be saved with information, e.g. metadata or a watermark, indicative of the monitor device 20 having operated in the inverted view mode when the respective actionable item 36, image capture button or video capture button, was activated. The user may change between the default view mode and the inverted view mode by activating an invert view button 44. In some exemplary monitor devices, the invert view button 44 may be accessible from a settings menu. The monitor device 20 may display, with the touch sensitive display 26, the invert view button 44, e.g. in the second portion of the graphical user interface, as illustrated. The monitor device 20 may change between the default view mode (Fig. 6a) and the inverted view mode (Fig. 6b) in response to activation of the invert view button 44. In the default view mode (Fig. 6a) the invert view button 44 may be displayed in a first orientation, and in the inverted view mode (Fig. 6b) the invert view button 44 may be displayed in a second orientation, e.g. rotated compared to the first orientation, e.g. by 180 degrees.
Fig. 7 is a block diagram of an exemplary method 200 performed at a monitor device, such as a monitor device as disclosed in relation to previous figures, such as a monitor device of a medical visualisation system comprising a visualisation device having an image sensor configured to generate image data indicative of a view from the visualisation device. As explained above, the monitor device may comprise a first housing extending in a first direction from a first housing side to a second housing side and in a second direction perpendicular to the first direction from a third housing side to a fourth housing side. The monitor device may comprise a touch sensitive display, e.g. being accommodated in the first housing. The touch sensitive display may have a first length in the first direction and a second length in the second direction, and a graphical user interface comprising a plurality of non-overlapping portions including a first portion and a second portion, and optionally a third portion and/or a fourth portion.
The method 200 comprises receiving 202 the image data generated, as the image data is being generated by the image sensor; displaying 204 one or more actionable items within the second portion of the graphical user interface; determining 206 an interface orientation mode of the monitor device; and displaying 210 a live representation of the image data within the first portion of the graphical user interface. The monitor device may comprise an orientation sensor and determining 206 the interface orientation mode may comprise determining an orientation of the first housing by the orientation sensor. The interface orientation mode may be determined 206 to be the first interface orientation mode when the first housing is oriented in a first orientation wherein the first direction is upwards. The interface orientation mode may be determined 206 to be the second interface orientation mode when the first housing is not oriented in the first orientation. Alternatively, the interface orientation mode may be determined 206 to be the second interface orientation mode when the first housing is oriented in the second orientation. The method 200 further comprises arranging 208 the second portion. The method 200 comprise, in accordance with the determined interface orientation mode being a first interface orientation mode, arranging 208a the second portion between the fourth housing side and the first portion; and in accordance with the determined interface orientation mode being a second interface orientation mode, arranging 208b the second portion between the third housing side and the first portion.
Displaying 210 the live representation may comprise in accordance with the monitor device being in a default view mode and in accordance with the determined 206 interface orientation mode being the first interface orientation mode, the live representation may be displayed 210a such that a first image direction of the live representation and the first direction are the same.
Displaying 210 the live representation may comprise in accordance with the monitor device being in an inverted view mode and in accordance with the determined 206 interface orientation mode being the first interface orientation mode, the live representation may be displayed 210b such that the first image direction of the live representation and the first direction are opposite.
Displaying 210 the live representation may comprise in accordance with the monitor device being in the default view mode and in accordance with the determined 206 interface orientation mode being the second interface orientation mode, the live representation may be displayed 210c such that the first image direction of the live representation and the first direction are opposite.
Displaying 210 the live representation may comprise in accordance with the monitor device being in an inverted view mode and in accordance with the determined 206 interface orientation mode being the second interface orientation mode, the live representation may be displayed 210d such that the first image direction of the live representation and the first direction are the same.
The method 200 may comprise, e.g. in accordance with the monitor device being in the inverted view mode, displaying 214 an inverted view mode indicator in the first portion, e.g. overlaying a portion of the live representation.
The method 200 may comprise displaying 212 an invert view button with the touch sensitive display. The method 200 may further comprise receiving 216 a user input corresponding to activation of the invert view button. In response to receiving 216 the user input corresponding to activation of the invert view button, the method 200 may comprise changing 218 the view mode. For example, the method 200 may comprise in response to receiving 216 the user input corresponding to activation of the invert view button, in accordance with the monitor device being in the default view mode, changing 218a to the inverted view mode; and in accordance with the monitor device being in the inverted view mode changing 218b to the default view mode.
Fig. 8 is a block diagram of an exemplary method 300 performed at a monitor device, such as a monitor device as disclosed in relation to previous figures, such as a monitor device of a medical visualisation system comprising a visualisation device having an image sensor configured to generate image data indicative of a view from the visualisation device. The monitor device may comprise a first housing extending in a first direction from a first housing side to a second housing side and in a second direction perpendicular to the first direction from a third housing side to a fourth housing side. The monitor device comprising a touch sensitive display. The touch sensitive display may be accommodated in the first housing.
The method 300 comprising receiving 302 the image data generated by the image sensor; and displaying 304 a live representation of the image data within a first portion of the graphical user interface, including in accordance with the monitor device being in a default view mode, displaying 304a the live representation such that a first image direction of the live representation and the first direction are the same; and in accordance with the monitor device being in an inverted view mode, displaying 304b the live representation such that the first image direction and the first direction are opposite.
The method 300 may comprise, e.g. in accordance with the monitor device being in the inverted view mode, displaying 306 an inverted view mode indicator, e.g. in the first portion overlaying a portion of the live representation.
The method 300 may comprise displaying 308 an invert view button with the touch sensitive display. The method 300 may further comprise receiving 310 a user input corresponding to activation of the invert view button. In response to receiving 310 the user input corresponding to activation of the invert view button, the method 300 may comprise changing 312 the view mode. For example, the method 300 may comprise in response to receiving 310 the user input corresponding to activation of the invert view button, in accordance with the monitor device being in the default view mode, changing 312a to the inverted view mode; and in accordance with the monitor device being in the inverted view mode changing 312b to the default view mode.
Exemplary embodiments of the present disclosure are set out in the following exemplary items:
1. A medical visualisation system comprising a visualisation device having an image sensor configured to generate image data indicative of a view from the visualisation device, the medical visualisation system further comprising a monitor device operable to receive the image data as the image data is being generated by the image sensor, the monitor device comprising a first housing extending in a first direction from a first housing side to a second housing side and in a second direction perpendicular to the first direction from a third housing side to a fourth housing side, the monitor device comprising a touch sensitive display accommodated in the first housing and having a first length in the first direction and a second length in the second direction, and the monitor device comprising a graphical user interface comprising a plurality of non -overlapping portions including a first portion and a second portion, the monitor device displays the graphical user interface with the touch sensitive display, wherein the monitor device displays with the touch sensitive display one or more actionable items within the second portion of the graphical user interface and displays a live representation of the image data within the first portion of the graphical user interface, the monitor device having a first interface orientation mode and a second interface orientation mode, wherein in the first interface orientation mode, the second portion is arranged between the fourth housing side and the first portion, and wherein in the second interface orientation mode, the second portion is arranged between the third housing side and the first portion.
2. Medical visualisation system according to item 1, wherein the monitor device comprises an orientation sensor, and wherein the monitor device operates the first interface orientation mode when a signal of the orientation sensor is indicative of the first housing being oriented in a first orientation wherein the first direction is upwards, and wherein the monitor device operates the second interface orientation mode when the signal of the orientation sensor is not indicative of the first housing being in the first orientation .
3. Medical visualisation system according to any of the preceding items wherein the monitor device displays with the touch sensitive display an invert interface button, and wherein the monitor device changes between operating the first interface orientation mode and operating the second interface orientation mode in response to activation of the invert interface button.
4. Medical visualisation system according to any of the preceding items, wherein the monitor device comprises one or more connection ports configured to receive a connector of the visualisation device, and wherein the one or more connection ports are provided on the third housing side. 5. Medical visualisation system according to any of the preceding items, wherein the one or more actionable items comprise an image capture button, and wherein the monitor device stores an image data file corresponding to the image data received when the image capture button is activated.
6. Medical visualisation system according to any of the preceding items, wherein the one or more actionable items comprises a video capture button, and wherein the monitor device stores a video sequence of image data corresponding to the image data received when the video capture button is activated.
7. Medical visualisation system according to any of the preceding items, wherein the plurality of non-overlapping portions includes a third portion, and wherein the monitor device displays with the touch sensitive display one or more actionable menu items within the third portion, and wherein the third portion is arranged between the third housing side and the first portion in the first interface orientation mode, and the third portion is arranged between the fourth housing side and the first portion in the second interface orientation mode.
8. Medical visualisation system according to item 7, wherein the plurality of nonoverlapping portions includes a fourth portion, and wherein the fourth portion is arranged between the third portion and the first portion.
9. Medical visualisation system according to any of the preceding items, wherein each of the plurality of non-overlapping portions extends substantially throughout the first length in the first direction.
10. Medical visualisation system according to any of the preceding items, wherein the visualisation device comprises a handle and an elongated flexible member extending from the handle to a distal end, the image data being indicative of a view from the distal end of the elongated flexible member, the handle comprises a control button adapted to receive an input in a first input direction, and wherein the touch input in the first input direction causes a distal portion of the elongated flexible member to bend in a first bending direction, and wherein the first bending direction corresponds to a first image direction of the live representation, and wherein the first image direction is parallel to the first direction.
11. Medical visualisation system according to item 10, wherein the first image direction and the first direction are the same in the first interface orientation mode, and wherein the first image direction and the first direction are opposite in the second interface orientation mode. 12. Medical visualisation system according to any of items 10-11, wherein the monitor device has a default view mode and an inverted view mode, wherein in the default view mode: the first image direction and the first direction are the same in the first interface orientation mode; and the first image direction and the first direction are opposite in the second interface orientation mode, and wherein in the inverted view mode: the first image direction and the first direction are opposite in the first interface orientation mode; and the first image direction and the first direction are the same in the second interface orientation mode.
13. Medical visualisation system according to item 12, wherein in the inverted view mode the monitor device displays with the touch sensitive display an inverted view mode indicator in the first portion overlaying a portion of the live representation.
14. Medical visualisation system according to any of items 12-13 as dependent on item
5, wherein in the inverted view mode the monitor device stores with the image data file being stored information indicative of the monitor device operating in the inverted view mode when the image capture button was activated.
15. Medical visualisation system according to any of items 12-14 as dependent on item
6, wherein in the inverted view mode the monitor device stores with the video sequence of image data being stored information indicative of the monitor device operating in the inverted view mode when the video capture button was activated.
16. Medical visualisation system according to any of items 12-15, wherein the monitor device displays with the touch sensitive display an invert view button, and wherein the monitor device changes between the default view mode and the inverted view mode in response to activation of the invert view button.
17. Medical visualisation system according to item 16, wherein in the default view mode the invert view button is displayed in a first orientation, and in the inverted view mode the invert view button is displayed in a second orientation, wherein the second orientation of the invert view button is rotated compared to the first orientation of the invert view button, e.g. by 180 degrees.
18. Medical visualisation system according to any of items 16-17, wherein the monitor device comprises a settings menu comprising an option for enabling the inverted view mode, and wherein in accordance with the inverted view mode being enabled in the settings menu, the monitor device displays with the touch sensitive display the invert view button, and in accordance with the inverted view mode not being enabled in the settings menu, the monitor device does not display the invert view button.
19. A method performed at a monitor device of a medical visualisation system comprising a visualisation device having an image sensor configured to generate image data indicative of a view from the visualisation device, the monitor device comprising a first housing extending in a first direction from a first housing side to a second housing side and in a second direction perpendicular to the first direction from a third housing side to a fourth housing side, the monitor device comprising a touch sensitive display accommodated in the first housing and having a first length in the first direction and a second length in the second direction, and the monitor device comprising a graphical user interface comprising a plurality of non-overlapping portions including a first portion and a second portion, the method comprising:
- receiving the image data generated as the image data is being generated by the image sensor;
- displaying one or more actionable items within the second portion of the graphical user interface;
- determining an interface orientation mode of the monitor device;
- in accordance with the determined interface orientation mode being a first interface orientation mode, arranging the second portion between the fourth housing side and the first portion;
- in accordance with the determined interface orientation mode being a second interface orientation mode, arranging the second portion between the third housing side and the first portion;
- displaying a live representation of the image data within the first portion of the graphical user interface. 20. Method according to item 19, wherein the monitor device comprises an orientation sensor, and wherein determining the interface orientation mode comprise determining an orientation of the first housing by the orientation sensor, wherein the interface orientation mode is determined to be the first interface orientation mode when the first housing is oriented in a first orientation wherein the first direction is upwards, and wherein the interface orientation mode is determined to be the second interface orientation mode when the first housing is not oriented in the first orientation.
21. Method according to any of items 19-20 wherein displaying the live representation comprises: in accordance with the monitor device being in a default view mode:
- in accordance with the determined interface orientation mode being the first interface orientation mode displaying the live representation such that a first image direction of the live representation and the first direction are the same; and
- in accordance with the determined interface orientation mode being the second interface orientation mode displaying the live representation such that the first image direction and the first direction are opposite,
- in accordance with the monitor device being in an inverted view mode:
- in accordance with the determined interface orientation mode being the first interface orientation mode displaying the live representation such that the first image direction and the first direction are opposite; and
- in accordance with the determined interface orientation mode being the second interface orientation mode displaying the live representation such that the first image direction and the first direction are the same. 22. Method according to item 21, wherein in accordance with the monitor device being in the inverted view mode, displaying an inverted view mode indicator in the first portion overlaying a portion of the live representation.
23. Method according to any of items 21-22 comprising displaying an invert view button with the touch sensitive display, receiving a user input corresponding to activation of the invert view button, and in response to receiving the user input corresponding to activation of the invert view button:
- in accordance with the monitor device being in the default view mode changing to the inverted view mode; and
- in accordance with the monitor device being in the inverted view mode changing to the default view mode.
24. A medical visualisation system comprising a visualisation device having an image sensor configured to generate image data indicative of a view from the visualisation device, the visualisation device comprising a handle and an elongated flexible member extending from the handle to a distal end, the image data being indicative of a view from the distal end of the elongated flexible member, the handle comprises a control button adapted to receive an input in a first input direction, and wherein the touch input in the first input direction causes a distal portion of the elongated flexible member to bend in a first bending direction, the medical visualisation system further comprising a monitor device operable to receive the image data as the image data is being generated by the image sensor, the monitor device comprising a first housing extending in a first direction from a first housing side to a second housing side and in a second direction perpendicular to the first direction from a third housing side to a fourth housing side, the monitor device comprising a touch sensitive display accommodated in the first housing and having a first length in the first direction and a second length in the second direction, and the monitor device comprising a graphical user interface comprising a first portion, wherein the monitor device displays with the touch sensitive display a live representation of the image data within a first portion of the graphical user interface, and wherein the first bending direction of the distal portion of the elongated flexible member corresponds to a first image direction of the live representation, the first image direction being parallel to the first direction, the monitor device having a default view mode and an inverted view mode, wherein in the default view mode, the first image direction and the first direction are the same, and in the inverted view mode, the first image direction and the first direction are opposite.
25. Medical visualisation system according to item 24, wherein in the inverted view mode the monitor device displays with the touch sensitive display an inverted view mode indicator in the first portion overlaying a portion of the live representation.
26. Medical visualisation system according to item any of items 24-25, wherein the monitor device displays with the touch sensitive display an image capture button, and wherein the monitor device stores an image data file corresponding to the image data received when the image capture button is activated, and wherein in the inverted view mode the monitor device stores with the image data file being stored information indicative of the monitor device operating in the inverted view mode when the image capture button was activated.
27. Medical visualisation system according to any of items 24-26, wherein the monitor device displays with the touch sensitive display a video capture button, and wherein the monitor device stores a video sequence of image data corresponding to the image data received when the video capture button is activated, and wherein in the inverted view mode the monitor device stores with the video sequence of image data being stored information indicative of the monitor device operating in the inverted view mode when the video capture button was activated.
28. Medical visualisation system according to any of items 24-27, wherein the monitor device displays with the touch sensitive display an invert view button, and wherein the monitor device changes between the default view mode and the inverted view mode in response to activation of the invert view button.
29. Medical visualisation system according to item 28, wherein in the default view mode the invert view button is displayed in a first orientation, and in the inverted view mode the invert view button is displayed in a second orientation, wherein the second orientation of the invert view button is rotated compared to the first orientation of the invert view button, e.g. by 180 degrees.
30. Medical visualisation system according to any of items 28-29, wherein the monitor device comprises a settings menu comprising an option for enabling the inverted view mode, and wherein in accordance with the inverted view mode being enabled in the settings menu, the monitor device displays with the touch sensitive display the invert view button, and in accordance with the inverted view mode not being enabled in the settings menu, the monitor device does not display the invert view button.
31. A method performed at a monitor device of a medical visualisation system comprising a visualisation device having an image sensor configured to generate image data indicative of a view from the visualisation device, the monitor device comprising a first housing extending in a first direction from a first housing side to a second housing side and in a second direction perpendicular to the first direction from a third housing side to a fourth housing side, the monitor device comprising a touch sensitive display accommodated in the first housing, and a graphical user interface, the method comprising:
- receiving the image data generated by the image sensor as the image data is being generated by the image sensor;
- displaying a live representation of the image data within a first portion of the graphical user interface, including:
- in accordance with the monitor device being in a default view mode, displaying the live representation such that a first image direction of the live representation and the first direction are the same; and
- in accordance with the monitor device being in an inverted view mode: displaying the live representation such that the first image direction and the first direction are opposite.
32. Method according to item 31 comprising, in accordance with the monitor device being in the inverted view mode, displaying an inverted view mode indicator in the first portion overlaying a portion of the live representation.
33. Method according to any of items 31-32 comprising displaying an invert view button with the touch sensitive display, receiving a user input corresponding to activation of the invert view button, and in response to receiving the user input corresponding to activation of the invert view button: - in accordance with the monitor device being in the default view mode changing to the inverted view mode; and in accordance with the monitor device being in the inverted view mode changing to the default view mode.
The invention has been described with reference to preferred embodiments. However, the scope of the invention is not limited to the illustrated embodiments, and alterations and modifications can be carried out without deviating from the scope of the invention.
Throughout the description, the use of the terms "first", "second", "third", "fourth", "primary", "secondary", "tertiary" etc. does not imply any particular order of importance but are included to identify individual elements. Furthermore, the labelling of a first element does not imply the presence of a second element and vice versa.
LIST OF REFERENCES
2 medical visualisation system
4 visualisation device
6 handle
7 control button
8 elongated flexible member
9 distal part
10 distal end of elongated flexible member 12 image sensor 14 device cable 16 device connector 20 monitor device 21 first housing side 22 second housing side
23 third housing side
24 fourth housing side
25 first housing
26 touch sensitive display 27 graphical user interface
31 first portion
32 second portion
33 third portion
34 fourth portion
36 actionable item(s)
37 first image direction
38 second image direction 40 connection port(s) 42 actionable menu item(s) 44 invert view button 46 inverted view mode indicator 50 battery indicator 60 processing unit 61 power supply 61a battery 61b power connection 62 memory
64 orientation sensor
66 input/output
68 microphone 70 live representation of image data xl first direction x2 second direction LI first length L2 second length 100 invert interface button 200 method 202 receiving image data 204 displaying actionable items 206 determining interface orientation mode 208 arranging second portion
210 displaying live representation 212 displaying invert view button 214 displaying inverted view mode indicator 216 receiving user input 218 changing view mode 300 method 302 receiving image data 304 displaying live representation 306 displaying inverted view mode indicator 308 displaying invert view button
310 receiving a user input 312 changing view mode

Claims

1. A medical visualisation system comprising a visualisation device having an image sensor configured to generate image data indicative of a view from the visualisation device, the visualisation device comprises a handle and an elongated flexible member extending from the handle to a distal end, the image data being indicative of a view from the distal end of the elongated flexible member, the handle comprises a control button adapted to receive an input in a first input direction, and wherein the touch input in the first input direction causes a distal portion of the elongated flexible member to bend in a first bending direction, the medical visualisation system further comprising a monitor device operable to receive the image data as the image data is being generated by the image sensor, the monitor device comprising a first housing extending in a first direction from a first housing side to a second housing side and in a second direction perpendicular to the first direction from a third housing side to a fourth housing side, the monitor device comprising a touch sensitive display accommodated in the first housing and having a first length in the first direction and a second length in the second direction, and the monitor device comprising a graphical user interface comprising a plurality of non -overlapping portions including a first portion and a second portion, the monitor device displays the graphical user interface with the touch sensitive display, wherein the monitor device displays with the touch sensitive display one or more actionable items within the second portion of the graphical user interface and displays a live representation of the image data within the first portion of the graphical user interface, wherein the first bending direction corresponds to a first image direction of the live representation, and wherein the first image direction is parallel to the first direction, the monitor device having a first interface orientation mode and a second interface orientation mode, wherein in the first interface orientation mode, the second portion is arranged between the fourth housing side and the first portion and the first image direction and the first direction are the same, and wherein in the second interface orientation mode, the second portion is arranged between the third housing side and the first portion and the first image direction and the first direction are opposite.
2. Medical visualisation system according to claim 1, wherein the monitor device comprises an orientation sensor, and wherein the monitor device operates the first interface orientation mode when a signal of the orientation sensor is indicative of the first housing being oriented in a first orientation wherein the first direction is upwards, and wherein the monitor device operates the second interface orientation mode when the signal of the orientation sensor is not indicative of the first housing being in the first orientation .
3. Medical visualisation system according to any of the preceding claims wherein the monitor device displays with the touch sensitive display an invert interface button, and wherein the monitor device changes between operating the first interface orientation mode and operating the second interface orientation mode in response to activation of the invert interface button.
4. Medical visualisation system according to any of the preceding claims, wherein the monitor device comprises one or more connection ports configured to receive a connector of the visualisation device, and wherein the one or more connection ports are provided on the third housing side.
5. Medical visualisation system according to any of the preceding claims, wherein the one or more actionable items comprise an image capture button, and wherein the monitor device stores an image data file corresponding to the image data received when the image capture button is activated.
6. Medical visualisation system according to any of the preceding claims, wherein the one or more actionable items comprises a video capture button, and wherein the monitor device stores a video sequence of image data corresponding to the image data received when the video capture button is activated.
7. Medical visualisation system according to any of the preceding claims, wherein the plurality of non-overlapping portions includes a third portion, and wherein the monitor device displays with the touch sensitive display one or more actionable menu items within the third portion, and wherein the third portion is arranged between the third housing side and the first portion in the first interface orientation mode, and the third portion is arranged between the fourth housing side and the first portion in the second interface orientation mode.
8. Medical visualisation system according to claim 7, wherein the plurality of nonoverlapping portions includes a fourth portion, and wherein the fourth portion is arranged between the third portion and the first portion.
9. Medical visualisation system according to any of the preceding claims, wherein each of the plurality of non-overlapping portions extends substantially throughout the first length in the first direction.
10. Medical visualisation system according to any of the preceding claims, wherein the monitor device has a default view mode and an inverted view mode, wherein in the default view mode: the first image direction and the first direction are the same in the first interface orientation mode; and the first image direction and the first direction are opposite in the second interface orientation mode, and wherein in the inverted view mode: the first image direction and the first direction are opposite in the first interface orientation mode; and the first image direction and the first direction are the same in the second interface orientation mode.
11. Medical visualisation system according to claim 10, wherein in the inverted view mode the monitor device displays with the touch sensitive display an inverted view mode indicator in the first portion overlaying a portion of the live representation.
12. Medical visualisation system according to any of claims 10-11 as dependent on claim 5, wherein in the inverted view mode the monitor device stores with the image data file being stored information indicative of the monitor device operating in the inverted view mode when the image capture button was activated.
13. Medical visualisation system according to any of claims 10-12 as dependent on claim 6, wherein in the inverted view mode the monitor device stores with the video sequence of image data being stored information indicative of the monitor device operating in the inverted view mode when the video capture button was activated.
14. Medical visualisation system according to any of claims 10-13, wherein the monitor device displays with the touch sensitive display an invert view button, and wherein the monitor device changes between the default view mode and the inverted view mode in response to activation of the invert view button.
15. Medical visualisation system according to claim 14, wherein in the default view mode the invert view button is displayed in a first orientation, and in the inverted view mode the invert view button is displayed in a second orientation, wherein the second orientation of the invert view button is rotated compared to the first orientation of the invert view button, e.g. by 180 degrees.
16. Medical visualisation system according to any of claims 14-15, wherein the monitor device comprises a settings menu comprising an option for enabling the inverted view mode, and wherein in accordance with the inverted view mode being enabled in the settings menu, the monitor device displays with the touch sensitive display the invert view button, and in accordance with the inverted view mode not being enabled in the settings menu, the monitor device does not display the invert view button.
EP21706902.0A 2020-02-21 2021-02-18 Rotational user interface for a medical visualisation system Pending EP4106597A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DKPA202070108 2020-02-21
PCT/EP2021/053960 WO2021165357A1 (en) 2020-02-21 2021-02-18 Rotational user interface for a medical visualisation system

Publications (1)

Publication Number Publication Date
EP4106597A1 true EP4106597A1 (en) 2022-12-28

Family

ID=74672321

Family Applications (1)

Application Number Title Priority Date Filing Date
EP21706902.0A Pending EP4106597A1 (en) 2020-02-21 2021-02-18 Rotational user interface for a medical visualisation system

Country Status (2)

Country Link
EP (1) EP4106597A1 (en)
WO (1) WO2021165357A1 (en)

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060022953A1 (en) * 2004-07-30 2006-02-02 Nokia Corporation Left-hand originated user interface control for a device
US8274532B2 (en) * 2006-11-10 2012-09-25 Draeger Medical Systems, Inc. System for adaptively orienting a display image on a device
JP5977497B2 (en) * 2011-09-22 2016-08-24 オリンパス株式会社 Endoscope apparatus, operation method and program
US20160198093A1 (en) * 2013-10-07 2016-07-07 Sony Corporation Information processing apparatus, imaging apparatus, imaging system, control method of information processing apparatus, control method of imaging apparatus, and program

Also Published As

Publication number Publication date
WO2021165357A1 (en) 2021-08-26

Similar Documents

Publication Publication Date Title
EP2100552B1 (en) Capsule guiding system
KR101674011B1 (en) Method and apparatus for operating camera function in portable terminal
US20150031954A1 (en) Capsule endoscope apparatus and receiving apparatus
CN102939040B (en) Probe shape detection device and probe shape detection method
JP6526339B2 (en) Oral endoscopy system and inspection method using the same
US11910998B2 (en) Medical visualisation system including a monitor and a graphical user interface therefore
WO2006051949A1 (en) Endoscope profile detector
JP2001046318A (en) Endoscope shape detector
JP2018029964A (en) Electrocardiographic data transmission system
CN111710207B (en) Ultrasonic demonstration device and system
EP4106597A1 (en) Rotational user interface for a medical visualisation system
US20070038131A1 (en) Electronic blood pressure monitor
US20070252892A1 (en) Moving-State Detecting Apparatus and Moving-State Detecting System
US20110245731A1 (en) Medical apparatus system, capsule medical apparatus system, and method of displaying posture item of subject
JP7368074B2 (en) intubation device
KR101788818B1 (en) Wireless image diagnosis apparatus and system for medical treatment
KR100853516B1 (en) method for an intestine modeling and orientation tracking of an capsule endoscope and the system performing the same methode
WO2021165361A1 (en) Graphical user interface handling a plurality of visualisation devices
EP4106599A1 (en) Battery monitoring for a medical visualisation system
WO2022263376A1 (en) Medical visualisation device with programmable buttons
WO2022263377A1 (en) Medical visualisation system
EP3709887B1 (en) Ultrasonic probe and ultrasonic measurement system
WO2021165358A1 (en) User interface for a medical visualisation system
WO2021165360A1 (en) Capturing and browsing images in a medical visualisation system
KR100861072B1 (en) method for orientation measurement of an capsule endoscope and the system performing the same methode

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20220914

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)