EP4107609A1

EP4107609A1 - User interface for a medical visualisation system

Info

Publication number: EP4107609A1
Application number: EP21707908.6A
Authority: EP
Inventors: Line Sandahl UBBESEN
Original assignee: Ambu AS
Current assignee: Ambu AS
Priority date: 2020-02-21
Filing date: 2021-02-18
Publication date: 2022-12-28
Also published as: WO2021165358A1; CN115136110A

Abstract

Disclosed is a method and a medical visualisation system comprising a visualisation device having an image sensor configured to obtain image data indicative of a view from the visualisation device. The monitor device is configured to: display a live representation of the image data within a first portion of a touch sensitive display; and display one or more actionable menu items within a third portion of the graphical user interface. The monitor device is further configured to: receive a first user input corresponding to selection of a first actionable menu item of the one or more actionable menu items; and in response to receipt of the first user input, display a primary menu associated with the first actionable menu item within the fourth portion of the graphical user interface without obscuring part of the first portion of the graphical user interface.

Description

USER INTERFACE FOR A MEDICAL VISUALISATION SYSTEM

The present disclosure relates to a visualisation device, such as an endoscope and a medical visualisation system, such as an endoscope system, comprising a visualisation device. More specifically the present disclosure relates to a graphical user interface and a monitor device having such graphical user interface for interacting with the medical visualisation system.

BACKGROUND

A visualisation device may be utilized to visually examine certain areas of the body of a person, such as inside a body cavity of the person. For example, a visualisation device may be used to inspect the airways, the digestive tract, or the intestines.

A visualisation device may be provided with a camera and be attached to a monitor device, such as a monitor with a display screen, a video output from the camera of the visualisation device may be received and displayed at the monitor device, thereby allowing an operator to control the visualisation device to inspect an area of interest.

For example, a visualisation device may be an endoscope, such as a disposable endoscope. An endoscope comprises an operating handle at the proximal end and an insertion tube extending from the handle towards the distal end. The handle is configured to be held by an operator and inter alia comprises externally protruding operating members connected to internal control means allowing the operator to control the movement of a bending section at the distal end of the insertion tube, while advancing the distal end of the insertion tube to a desired location e.g. within a body cavity of a person. By means of an attached monitor device, such as a monitor with a display screen, the location to which the distal end has been advanced may be inspected using the endoscope.

The monitor device of a medical visualisation system may be provided with some functionality, such as ability to save still images and/or video sequences of the view from the attached visualisation device. Furthermore, the monitor device may comprise some image processing capabilities, and may be configured to output a video or image output, e.g. to an external display.

SUMMARY

The present disclosure relates to a visualisation device, such as an endoscope, and a visualisation system, such as an endoscope system. Particularly, but not exclusively the visualisation device may be a disposable camera endoscope. Alternatively, the visualisation device may be a video laryngoscope, an endotracheal tube and/or a laryngeal mask. The visualisation system may further comprise a monitor device for being connected to the visualisation device, e.g. the monitor device may be configured to receive image data from the visualisation device. The present disclosure further relates to a graphical user interface for such monitor device of a medical visualisation system.

It is an object of the present disclosure to provide a solution which at least improve the solutions of the prior art. Particularly, it is an object of the present disclosure to provide a graphical user interface for a medical visualisation system which facilitates and enhances human interaction with the system.

It is a further object of the present disclosure to provide a system and method facilitating enhanced control and usability of a medical visualisation system.

Accordingly, a medical visualisation system and a method performed at a monitor device of the medical visualisation system are disclosed.

The medical visualisation system comprises a visualisation device, such as an endoscope, such as a disposable endoscope Alternatively, the visualisation device may be a video laryngoscope, an endotracheal tube and/or a laryngeal mask. The visualisation device has an image sensor configured to generate image data indicative of a view from the visualisation device. The medical visualisation system may comprise a plurality of visualisation devices each having an image sensor configured to generate image data indicative of a view from the visualisation device. The plurality of visualisation devices may include a first visualisation device and/or a second visualisation device. The first visualisation device may comprise a first image sensor configured to generate image data indicative of a view from the first visualisation device. The second visualisation device may comprise a second image sensor configured to generate image data indicative of a view from the second visualisation device. The image sensor(s) may be any sensor capable of detecting and conveying information used to make an image. For example, the image sensor(s) may comprise a CCD or CMOS sensor, or similar. The image sensor(s) may generate image data corresponding to a square image, i.e. having equal height and width. For example, the image data generated by the image sensors may correspond to a 300x300 pixel image, or a 400x400 pixel image, or a 600x600 pixel image, or a 800x800 pixel image. Alternatively or additionally, the image sensor may generate image data corresponding to a non-square image, which is cropped to form a square image, such as a square image having 300x300 pixels, 400x400 pixels, 600x600 pixels, or 800x800 pixels. The medical visualisation system further comprises a monitor device receiving and/or being operable to receive the image data generated by the image sensor. The monitor device may receive and/or be operable to receive the image data, e.g. as the image data is being generated, e.g. within limitation of the hardware. The monitor device comprises a first housing extending in a first direction from a first housing side to a second housing side and in a second direction perpendicular to the first direction from a third housing side to a fourth housing side. The monitor device comprises a display, e.g. a touch sensitive display. The display may be accommodated in the first housing. The display may have a first length in the first direction and a second length in the second direction. The second length may be longer than the first length, e.g. the display may be a 16:9 or 16:10 display. Alternatively, the first length may be longer than the second length, or the first length and the second length may be substantially the same. The touch sensitive display may be any suitable type of touch display, e.g. capacitive touch display or resistive touch display.

The monitor device may comprise one or more connection ports configured to receive a connector of the visualisation device. The connection ports and the corresponding connector of the visualisation device may be a proprietary plug and socket connectors, or any standard connector capable of transmitting therethrough at least the image data from the image sensor. Furthermore, the connector and connection ports may be configured to supply power to the components of the visualisation device.

The one or more connection ports may be arranged on the first housing. The one or more connection ports may be provided on the third housing side, and/or on the fourth housing side.

The monitor device may comprise an on/off button. The on/off button may be arranged on the first housing. The on/off button may be provided on the third housing side or on the fourth housing side. The one or more connection ports may be provided on the third housing side and the on/off button may be provided on the fourth housing side.

The monitor device may establish connection to a visualisation device, such as the first visualisation device and/or the second visualisation device. Establishing connection to the visualisation device may include receiving a device connector of the respective visualisation device in a connection port of the one or more connection ports of the monitor device. Establishing connection to a visualisation device may include obtaining device identifier information from a device identifier (e.g. EPROM, QR-code, NFC, RFID or similar) of the visualisation device. For example, establishing connection to the first visualisation device may include obtaining first device identifier information from a first device identifier of the first visualisation device and/or establishing connection to the second visualisation device may include obtaining second device identifier information from a second device identifier of the second visualisation device.

The monitor device may comprise a processing unit and memory. The processing unit and/or the memory may be accommodated in the first housing. Alternatively, the monitor device may comprise a second housing, and the processing unit and/or the memory may be accommodated in the second housing. The monitor device may comprise an orientation sensor, e.g. for determining the orientation of the monitor device, such as of the first housing, relative to gravity. The orientation sensor may comprise one or more accelerometers and/or a gyroscope. The orientation sensor may be accommodated in the first housing. The processing unit may be connected to the touch sensitive display to control display of information with the touch sensitive display, and the processing unit may be adapted to receive a signal from the touch sensitive display indicative of touch inputs on the touch sensitive display. Thereby, the monitor device may detect user inputs, e.g. in the form of touch inputs, with the touch sensitive display. Touch inputs may, for example, comprise single tap(s), double tap(s), or swipe(s) on the touch sensitive display. The processing unit may be connected to the orientation sensor to receive an orientation signal indicative of the orientation of the monitor device, such as of the first housing of the monitor device. The processing unit may be connected to the memory and be adapted to read and write data from and to the memory.

The monitor device may comprise a power unit for powering the monitor device. The power unit may comprise a rechargeable battery and/or a power connection for connecting the power unit to an external power supply, such as a conventional AC power socket. The power unit may be accommodated in the first housing. Alternatively, the power unit may be accommodated in the second housing.

The monitor device may comprise a graphical user interface. The monitor device and/or the processing unit of the monitor device may display with the touch sensitive display the graphical user interface. The graphical user interface may comprise one or more portions, such as a plurality of portions. The portions may be non-overlapping portions, such as a plurality of non-overlapping portions. The portions may include a first portion and/or a second portion. The portions may further include a third portion and/or a fourth portion. The second portion and/or the fourth portion may be designated as background portions, e.g. the second portion may be a first background portion and/or the fourth portion may be a second background portion. Each of the plurality of portions may extend substantially throughout the first length in the first direction. The first portion may be arranged between the fourth portion and the second portion along the second direction. The fourth portion may be arranged between the third portion and the first portion along the second direction. The third portion may be arranged between a side of the first housing, e.g. the third housing side, and the fourth portion along the second direction. The second portion may be arranged between another side of the first housing, e.g. the fourth housing side, and the first portion along the second direction. The first portion and the fourth portion may be arranged between the second portion and the third portion along the second direction. The first portion of the graphical user interface may be square. The first portion of the graphical user interface may occupy the centre of the touch sensitive display. The first portion of the graphical user interface may be larger along the second direction than the second portion, the third portion and/or the fourth portion, individually and/or collectively. The first portion of the graphical user interface may extend throughout more than 40% of the second length in the second direction, such as more than 50% of the second length in the second direction, such as more than 60% of the second length in the second direction.

The monitor device may display a live representation of the image data, e.g. within the first portion of the graphical user interface. The live representation of the image data may be displayed, e.g. by the processing unit, with the touch sensitive display, e.g. within the first portion of the graphical user interface.

The visualisation device, e.g. an endoscope, may comprise a handle and an elongated flexible member extending from the handle to a distal end. The image sensor may be arranged at the distal end of the elongated flexible member. The image data may be indicative of a view from the distal end of the elongated flexible member. The handle may comprise a control button adapted to receive an input in a first input direction and/or in a second input direction. The first input direction and the second input direction may be opposite. The touch input in the first input direction may cause a distal portion of the elongated flexible member to bend in a first bending direction and/or may cause movement of the image sensor in a first image sensor direction. The touch input in the second input direction may cause the distal portion of the elongated flexible member to bend in a second bending direction and/or may cause movement of the image sensor in a second image sensor direction. The live representation of the image data may have directions corresponding to directions of the image sensor generating the image data. The first bending direction may correspond to a first image direction of a representation of the image data, such as the live representation of the image data. The second bending direction may correspond to a second image direction of the representation of the image data, such as the live representation of the image data. The first image direction and/or the second image direction may be parallel to the first direction of the first housing. The monitor device may provide one or more actionable items. One or more actionable items may be displayed, e.g. by the processing unit, with the touch sensitive display, e.g. within the second portion of the graphical user interface. One or more actionable menu items may be displayed, e.g. by the processing unit, with the touch sensitive display, e.g. within the third portion of the graphical user interface. A battery indicator may be displayed, e.g. by the processing unit, with the touch sensitive display, e.g. within the third portion of the graphical user interface. A time indicator may be displayed, e.g. by the processing unit, with the touch sensitive display, e.g. within the third portion of the graphical user interface.

The one or more actionable items, e.g. displayed within the second portion of the graphical user interface of the monitor device, may comprise an image capture button and/or a video capture button. In response to activation of the image capture button, e.g. by a user providing a touch input, e.g. a single tap, at the respective location of the touch sensitive display, an image data file corresponding to the image data received when the image capture button was activated may be stored, e.g. in memory of the monitor device. In response to activation of the video capture button, e.g. by a user providing a touch input, e.g. a single tap, at the respective location of the touch sensitive display, a video sequence of image data corresponding to the image data received when the video capture button was activated may be stored, e.g. in memory of the monitor device. A first activation of the video capture button may start collection of image data for the video sequence, and a second activation of the video capture button (subsequent to the first activation of the video capture button) may stop the collection of image data for the video sequence. The stored video sequence may correspond to the image data received between the first activation and the second activation of the video capture button. The video capture button may be displayed in a first appearance prior to the first activation and after the second activation. The video capture button may be displayed in a second appearance after the first activation and before the second activation.

A first user input corresponding to selection of a first actionable menu item of the one or more actionable menu items may be received, e.g. while displaying the live representation within the first portion and the one or more actionable menu items in the third portion. The monitor device, e.g. with the touch sensitive display, may be adapted to detect the first user input. In response to receipt of the first user input, a primary menu associated with the first actionable menu item may be displayed within the fourth portion of the graphical user interface without obscuring part of the first portion of the graphical user interface. For example, in response to detecting the first user input, the monitor device may display, e.g. with the touch sensitive display, the primary menu associated with the first actionable menu item may be displayed within the fourth portion of the graphical user interface without obscuring part of the first portion of the graphical user interface. The primary menu may comprise one or more primary actionable items including a first primary actionable item.

While displaying the primary menu associated with the first actionable menu item, a second user input corresponding to selection of the first primary actionable item may be received; and in response to receipt of the second user input, a secondary menu associated with the first primary actionable item may be displayed in the first portion, of the graphical user interface. For example, the monitor device may be adapted to detect the second user input, and in response to detecting the second user input, the monitor device may display, e.g. with the touch sensitive display, a secondary menu associated with the first primary actionable item in the first portion, of the graphical user interface. Optionally, the secondary menu may extend into the second portion and/or the fourth portion, of the graphical user interface.

It is an advantage of the present disclosure that the user needs to make two consecutive inputs to display a menu, which covers part of, or the entire live representation of the image data displayed in the first portion. Thereby, unintentional touch inputs on the screen is less likely to cause interference with the display of the live representation of the image data, which could potentially be life threatening, in case the operator is performing a critical procedure with the aid of the live representation of the image data.

The one or more actionable menu items may comprise a second actionable menu item. While the secondary menu is displayed, a third user input corresponding to selection of the second actionable menu item may be received. For example, the monitor device may be adapted to detect the third user input. In response to receipt of the third user input display of the secondary menu may be ceased and the live representation of the image data may be displayed within the first portion of the graphical user interface. For example, in response to detecting the third user input, the monitor device may cease display, e.g. with the touch sensitive display, of the secondary menu and displays the live representation of the image data within the first portion of the graphical user interface.

The one or more actionable items, e.g. displayed within the second portion of the graphical user interface, may comprise an image capture button and a video capture button. The image capture button may be a first colour and the video capture button may be a second colour. The first colour may be visually distinct from the second colour. For example, the first colour and the second colour may differ by a hue difference of at least 60 degrees, such as at least 120 degrees. The hue difference may be according to the HSL or HSV colour models, wherein hue ranges from 0-360 degrees. For example, the image capture button may be green, and the video capture button may be blue. Providing the image capture button and the video capture button in distinguishing colours allows for easy oral reference, e.g. allowing an operator to ask an assistant to take a picture by asking the assistant to push the, e.g., "green" button. Furthermore, the monitor device may support receiving spoken commands, e.g. by a microphone. In such situation it may also be advantageous that the operator can easily utter a command, which the monitor device has a high likelihood of interpreting as intended.

A fourth user input, e.g. a double tap within the first portion of the graphical user interface, may be received. For example, the monitor device may be adapted to detect a fourth user input. In response to receipt of the fourth user input, an enlarged view mode may be activated. For example, in response to detecting the fourth user input the monitor device may activate the enlarged view mode. In the enlarged view mode, a section of the live representation of the image data may be displayed in the first portion and the fourth portion of the graphical user interface. Thus, a section of the live representation of the image data may be extended to be displayed using a bigger part of the graphical user interface, and the section of the live representation of the image data may be magnified.

Furthermore, in response to detecting the fourth user input the monitor device may further display an enlarged view mode indicator. Optionally the enlarged view mode indicator is displayed in the second portion.

The live representation may comprise a first crop section and a second crop section. This may be due to the image sensor generating image data corresponding to a square image (or may be cropped to a square format), e.g. due to conventions or de-facto standards within the field of medical visualisation, and therefore enlarging the image results to the image attaining a height larger than the height of the display. The section of the live representation being displayed in the enlarged view mode may be between the first crop section and the second crop section. The first crop section and the second crop section are not displayed in the enlarged view mode. The section of the live representation being displayed in the enlarged view mode may be between 30-95 %, such as 40-90%, such as 50-80%, such as 60-70% of the live representation.

In the enlarged view mode the stored image data file may comprise information indicative of the monitor device having been operated in the enlarged view mode when the image capture button was activated. For example, the monitor device may store with the image data file being stored information indicative of the monitor device operating in the enlarged view mode when the image capture button was activated. For example, metadata indicative of the inverted view mode being active may be embedded in the stored image data file. Alternatively, a visible mark, e.g. the inverted view mode indicator, may be provided on the stored image data file. Thereby storing information of the view mode within the image data files.

Similarly, in the enlarged view mode the stored video sequence may comprise information indicative of the monitor device having been operated in the enlarged view mode when the video capture button was activated. The monitor device may store with the video sequence being stored, information indicative of the monitor device operating in the inverted view mode when the video capture button was activated. For example, metadata indicative of the inverted view mode being active may be embedded in the stored video sequence of image data. Alternatively, a visible mark, e.g. the inverted view mode indicator, may be provided on the images of the stored video sequence.

While in the enlarged view mode, a fifth user input corresponding to selection of the first actionable menu item of the one or more actionable menu items may be received. For example, the monitor device may be adapted to detect a fifth user input corresponding to selection of the first actionable menu item of the one or more actionable menu items. The fifth user input may correspond in location to the first user input but may be separate in time. In response to receipt of the fifth user input the primary menu associated with the first actionable menu item may be displayed within the fourth portion of the graphical user interface and may cause obscuring of a part of the section of the live representation of the image data. For example, in response to detecting the fifth user input the monitor device may display the primary menu associated with the first actionable menu item within the fourth portion of the graphical user interface, e.g. obscuring the part of the section of the live representation of the image data.

While displaying the primary menu associated with the first actionable menu item, e.g. while in the enlarged view mode, the monitor device may be adapted to detect a sixth user input corresponding to selection of a primary actionable item of the one or more primary actionable items of the primary menu. In accordance with not receiving the sixth user input within a threshold amount of time, e.g. 5 seconds, after receipt of the first user input, display of the primary menu associated with the first actionable menu item may be ceased, optionally the section of the live representation of the image data may be displayed in the first portion and the fourth portion of the graphical user interface. For example, in accordance with not receiving the sixth user input within a threshold amount of time after detecting the fifth user input, the monitor device may cease display of the primary menu associated with the first actionable menu item, optionally the monitor device may further display, e.g. with the touch sensitive display, the section of the live representation of the image data in the first portion and the fourth portion of the graphical user interface Automatically hiding the primary menu, if a second user input to an item of the primary menu is not received is particular advantageous in the enlarged view mode where the primary menu obscures a part of the live representation of the image data. However, the automatic hiding of the primary menu may also be advantageous in the normal view, wherein the live representation of the image data does not extend into the fourth portion of the graphical user interface, because automatically hiding the primary menu prevents an unintentional second input causing obscuring of the live representation of the image data.

While in the enlarged view mode, a seventh user input may be received. For example, the monitor device may be adapted to detect a seventh user input. The seventh user input may correspond to one or more of selection of the second actionable menu item, a touch input at a location of the enlarged view mode indicator, a touch input within the second portion of the graphical user interface. In response to receipt of the seventh user input the enlarged view mode may be deactivated and the live representation of the image data may be displayed within the first portion of the graphical user interface. For example, in response to detecting the seventh user input the monitor device may deactivate the enlarged view mode and display the live representation of the image data within the first portion of the graphical user interface.

The monitor device may display a second background colour within the second portion of the graphical user interface. The second background colour may be filling at least 80% of the second portion of the graphical user interface. The monitor device may display a third background colour within the third portion of the graphical user interface. The third background colour may be filling at least 80% of the third portion of the graphical user interface. The monitor device may display a fourth background colour within the fourth portion of the graphical user interface. The fourth background colour may be filling at least 80% of the fourth portion of the graphical user interface. The second background colour, the third background colour and/or the fourth background colour may have lightness values of less than 0.6, such as less than 0.4, such as less than 0.2, such as less than 0.1. The lightness value may be according to the HSL colour model, wherein lightness ranges from 0-1, 1 designating maximum light, i.e. white, and 0 designating minimum light, i.e. black.

Because visualisation devices, such as endoscopes, are often used in a dark environment, emitting less light by providing the background(s) in darker colours, means less strain on the eyes of the operators during the procedure. Furthermore, a dark background also interferes less with the shown live image. Even further, a darker background may also mean, at least for some screen technologies, that the device consumes less power. Hence, battery life may be increased.

The monitor device may comprise features, which should be restricted. Therefore, the monitor device may support authentication of a user allowing access to restricted features. It is a purpose of the present disclosure to balance between enabling quick and uncomplicated use, e.g. in case the monitor device is needed in an emergency situation, while protecting access to sensitive information and functionality, which should only be done by authorized users. At the same time, it is desired to have a simple and effective method to login to obtain access to full functionality.

The first actionable menu item may be associated with a login procedure. For example, the first actionable menu item may be a log in button. The primary menu associated with the first actionable menu item displayed in response to receipt and/or detection of the first user input may comprise an indication of a pre-selected user profile and a password type field.

While displaying the primary menu associated with the first actionable menu item, a second user input corresponding to selection of the password type field may be received. For example, the monitor device may be adapted to detect the second user input corresponding to selection of the password type field. In response to receipt of the second user input, a virtual keyboard may be displayed in the first portion of the graphical user interface and optionally in the second portion of the graphical user interface. For example, in response to detecting the second user input, the monitor device may display the virtual keyboard in the first portion of the graphical user interface and optionally in the second portion of the graphical user interface The virtual keyboard may obscure at least part of the live representation of the image data within the first portion of the graphical user interface. The virtual keyboard may be configured for entering a password in the password type field. A sequence of user inputs corresponding to input of a password may be received. For example, the monitor device may be adapted to detect the sequence of user inputs corresponding to input of a password. The monitor device may determine whether the input password match a stored password for the pre-selected user profile. In accordance with the input password matching the stored password for the pre-selected user profile, the monitor device may enter an authenticated mode corresponding to the pre-selected user profile. In accordance with the typed password not matching the stored password for the pre-selected user profile, an error message may be displayed indicative of the typed password being incorrect. The primary menu may comprise a first primary actionable item for selecting another user profile, e.g. a user profile different from the pre-selected user profile. While displaying the primary menu associated with the first actionable menu item a third user input corresponding to selection of the first primary actionable item may be received. For example, the monitor device may be adapted to detect the third user input. In response to receipt of the third user input, a list of selectable user profiles may be displayed in the first portion of the graphical user interface and optionally in the second portion of the graphical user interface. For example, in response to detecting the third user input, the monitor device may display the list of selectable user profiles in the first portion of the graphical user interface and optionally in the second portion of the graphical user interface.

While displaying the list of selectable user profiles a fourth user input corresponding to selection of a selectable user profile from the list of selectable user profiles may be received. For example, the monitor device may be adapted to detect the fourth user input. In response to receipt of the fourth user input, a virtual keyboard may be displayed in the first portion of the graphical user interface and optionally in the second portion of the graphical user interface. For example, in response to detecting the fourth user input, the monitor device may display the virtual keyboard in the first portion of the graphical user interface and optionally in the second portion of the graphical user interface. The virtual keyboard may be configured for entering a password in a password type field. A sequence of user inputs corresponding to input of a password may be received. The monitor device may determine whether the input password match a stored password for the selected user profile. In accordance with the input password matching the stored password for the selected user profile, the monitor device may enter an authenticated mode corresponding to the selected user profile. In accordance with the typed password not matching the stored password for the selected user profile, an error message may be displayed indicative of the typed password being incorrect.

While in the authenticated mode the monitor device may determine whether automatic logout criteria have been met. The automatic logout criteria may comprise that the visualisation device has not been connected to the monitor device for a logout time duration, e.g. between 300-800 seconds, such as between 400-700 seconds, such as 600 seconds. The automatic logout criteria may further comprise that during the logout time duration no user input has been received via the touch sensitive display. In accordance with the automatic logout criteria being met, the monitor device may enter a non-authenticated mode.

BRIEF DESCRIPTION OF THE FIGURES Embodiments of the disclosure will be described in more detail in the following with regard to the accompanying figures. The figures show one way of implementing the present invention and are not to be construed as being limiting to other possible embodiments falling within the scope of the attached claim set.

Fig. 1 schematically illustrates an exemplary medical visualisation system,

Fig. 2 schematically illustrates an exemplary monitor device,

Fig. 3 schematically illustrates an exemplary monitor device,

Fig. 4 is a block diagram of an exemplary monitor device,

Figs. 5A-5F schematically illustrates exemplary user interactions with a graphical user interface of an exemplary monitor device,

Figs. 6A-6J schematically illustrates exemplary user interactions with a graphical user interface of an exemplary monitor device, and

Figs. 7A-7J schematically illustrates exemplary user interactions with a graphical user interface of an exemplary monitor device.

DETAILED DESCRIPTION

Various exemplary embodiments and details are described hereinafter, with reference to the figures when relevant. It should be noted that the figures may or may not be drawn to scale and that elements of similar structures or functions are represented by like reference numerals throughout the figures. It should also be noted that the figures are only intended to facilitate the description of the embodiments. They are not intended as an exhaustive description of the invention or as a limitation on the scope of the invention. In addition, an illustrated embodiment needs not have all the aspects or advantages shown. An aspect or an advantage described in conjunction with a particular embodiment is not necessarily limited to that embodiment and can be practiced in any other embodiments even if not so illustrated, or if not so explicitly described.

Fig. 1 schematically illustrates an exemplary medical visualisation system 2 comprising a visualisation device 4 and a monitor device 20. The visualisation device 4 has an image sensor 12, e.g. a CCD or a CMOS, configured to generate image data indicative of a view from the visualisation device 4. In the illustrated example, the visualisation device 4 is an endoscope comprising a handle 6 and an elongated flexible member 8, e.g. an insertion tube, extending from the handle 6 to a distal end 10. The image sensor 12 may be configured to generate image data indicative of a view from the distal end 10 of the elongated flexible member 8.

The visualisation device 4 may be connected to the monitor device 20. In the illustrated example, a device cable 14 extending from the handle 6 terminates in a device connector 16 connected to a connection port 40 of the monitor device 20. The monitor device 20 is operable to receive image data generated by the image sensor 12 of the visualisation device 4. For example, the monitor device 20 may receive image data generated by the image sensor 12 via the device cable 14, the connector 16 and connection port 40.

The handle 6 comprises a control button 7 adapted to receive an input in a first input direction and/or in a second input direction. The touch input in the first input direction on the control button 7 causes a distal portion 9 of the elongated flexible member 8 to bend in a first bending direction, e.g. via wires extending from the handle, through the elongated flexible member 8 to the distal portion 9. The touch input in the second input direction on the control button 7 causes the distal portion 9 of the elongated flexible member 8 to bend in a second bending direction. The first input direction and the second input direction may be opposite. The first bending direction and the second bending direction may be opposite. Bending the distal portion 9 of the elongated flexible member 8 may cause a movement of the distal end 10 and the image sensor 12 in a direction relative to the image sensor 12. Thereby, seeing an image generated by the image sensor 12, a direction, e.g. up or down, in the image may correspond to a respective input on the control button 7.

Fig. 2 schematically illustrates an exemplary monitor device 20, such as the monitor device 20 as illustrated in Fig. 1. The monitor device 20 comprises a first housing 25. The first housing 25 extends in a first direction xl from a first housing side 21 to a second housing side 22 and in a second direction x2 perpendicular to the first direction xl from a third housing side 23 to a fourth housing side 24. The monitor device comprises a touch sensitive display 26 accommodated in the first housing 25. The touch sensitive display 26 has a first length LI in the first direction xl and a second length L2 in the second direction x2. The second length L2 may be longer than the first length LI as illustrated.

The monitor device may comprise one or more connection port(s) 40, such as three connection ports 40, as illustrated. The connection ports 40 may allow visualisation devices to be connected. The connection port(s) 40 may be arranged at the third housing side 23, as illustrated. Alternatively or additionally, connection port(s) 40 may be arranged at the fourth housing side 24. The monitor device may comprise an on/off button 41, which may be provided on the fourth housing side 24, as illustrated.

Fig. 3 schematically illustrates an exemplary monitor device 20, such as the monitor device 20 as illustrated in Figs. 1-2. As illustrated a device connector 16 may be connected to a connection port 40.

The monitor device 20 may be provided with a graphical user interface 27. The graphical user interface 27 may be displayed with the touch sensitive display 26, and the user may interact with the graphical user interface 27, e.g. by means of providing touch inputs on the touch sensitive display 26.

The graphical user interface 27 is displayed with the touch sensitive display 26. The graphical user interface 27 comprises a plurality of non-overlapping portions 31, 32, 33, 34. Each of the portions 31, 32, 33, 34 extends substantially throughout the first length LI in the first direction xl. The non-overlapping portions includes a first portion 31, a second portion 32, a third portion 33 and a fourth portion 34. The first portion 31 is arranged between the fourth portion 34 and the second portion 32 along the second direction x2. The fourth portion 34 is arranged between the third portion 33 and the first portion 31 along the second direction x2. The third portion 33 is arranged between a side of the first housing, e.g. the third housing side 23, and the fourth portion 34 along the second direction x2. The second portion 32 is arranged between another side of the first housing 25, e.g. the fourth housing side 24, and the first portion 31 along the second direction x2. The first portion 31 and the fourth portion 34 are arranged between the second portion 32 and the third portion 33 along the second direction.

The monitor device 20 displays a live representation 70 of the image data within the first portion 31 of the touch sensitive display 26. The first bending direction and the second bending direction of the distal portion 9 of the elongated flexible member 8, as described with respect to Fig. 1, may corresponds to a first image direction 37 and a second image direction 38 of the live representation 70, respectively. The first image direction 37 and the second image direction 38 may be parallel to the first direction xl, as illustrated. The first image direction 37 and the second image direction 38 may be opposite, as illustrated. Thereby, a user operating the control button 7 of visualisation device 2 may cause movement of the distal portion 9 of the elongated flexible member 8 to bend in a direction corresponding to the first image direction 37 or the second image direction 38 of the live representation 70. The monitor device 20 displays with the touch sensitive display 26 one or more actionable items 36 within the second portion 32 of the graphical user interface 27. The actionable items 36 may comprise an image capture button 36a, e.g. for storing an image data file corresponding to the image data received when the image capture button 36a was activated. Alternatively or additionally, the actionable items 36 may comprise a video capture button 36b, e.g. for storing a video sequence of image data corresponding to the image data received when the video capture button 36b was activated.

The monitor device 20 displays with the touch sensitive display 26 one or more actionable menu items 42 within the third portion 33 of the graphical user interface 27. The actionable menu items 42 may, for example, comprise a login menu item for initiating a login procedure, a settings menu item for accessing a settings menu, an archive menu item for browsing an archive, and a default menu item for returning to a default view. Also a battery indicator 50 is displayed in the third portion 33.

Fig. 4 is a block diagram of an exemplary monitor device 20, such as the monitor device 20 of the previous figures. The monitor device 20 comprises a processing unit 60 and memory 62. The memory 62 may comprise both volatile and non-volatile memory. The monitor device 20 also comprise an orientation sensor 64 for determining the orientation of the first housing 25 relative to gravity. The orientation sensor 64 may comprise one or more accelerometers and/or a gyroscope. The monitor device 20 comprises input/output module 66, such as for receiving image data from the image sensor 12 via connectors of visualisation device 4. The input/output module 66 may also comprise ethernet connector, WiFi transceiver, Bluetooth transceiver, video connectors, USB ports etc., and respective controllers. The monitor device 20 also comprises the touch sensitive display 26 as described earlier. The monitor device 20 may display information, graphical user interface objects, images, buttons etc, with the touch sensitive display 27. The monitor device 20 also comprises a microphone 68. The monitor device 20 comprises a power unit 61 for powering the monitor device 20. The power unit 61 may comprise a rechargeable battery 61a. The power unit 61 may comprise a power connection 61b for connecting the power unit 61 to an external power supply, such as a conventional AC power socket. The components of the monitor device 20 may be interconnected by buses or signal lines. Some or all of the components of the monitor device may be accommodated in the first housing 25 as illustrated. Flowever, alternatively some of the components, e.g. the processing unit 60, the memory 62, input/output module 66 and/or the power unit 61 may be accommodated in a second housing of the monitor device 20. The power unit 61 may comprise components for, e.g. indirectly measuring, capacity of the rechargeable battery 61a. For example, the power unit 61 may comprise a voltage gauge to measure the voltage of the rechargeable battery 61a. Based on the measured voltage, the remaining capacity of the rechargeable battery 61a may be estimated, e.g. by the processing unit 60. The power unit 61 may also comprise components for measuring power consumption of the monitor device 20. For example, the power unit 61 may comprise a power meter to measure the rate at which the monitor device 20 consumes power from the rechargeable battery 61a. The voltage gauge may be a low current consumption integrated circuit or a resistor coupled in parallel with the battery. A current sensor may be provided and the power may be computed as the product of the voltage and current. Additionally, an integrated circuit may be provided that includes a voltage gauge and a current sensor, and which outputs a power value in digital form.

The monitor device 20 may display content with the touch sensitive display 26. For example, the monitor device 20 may display content by the processing device 60 transmitting instructions to the touch sensitive display 26 indicative of the content to be displayed. The monitor device 20 may receive user input with the touch sensitive display 26. Particularly, the monitor device 20 may detect user inputs with the touch sensitive display 26. For example, a user providing a touch input on the touch sensitive display 26 causes a change in one or more electrical parameters of the touch sensitive display 26 indicative of at least the location of the touch input. Information of the touch input is transmitted from the touch sensitive display 26 to the processing unit 60, and the processing unit 60 may determine whether the touch input corresponds to an action to perform, e.g. whether the location of the touch input corresponds to the location of a soft-button displayed at the touch sensitive display.

The user may interact with the monitor device 20 via the graphical user interface 27 by providing user inputs, e.g. by means of providing touch inputs on the touch sensitive display 26, and the monitor device 20 may detect such user inputs with the touch sensitive display 26. A touch input, e.g. a single tap, double tap, swipe or similar, and the location of the touch input on the touch sensitive display 26 is registered by the touch sensitive display 26, which transmits information of the touch input (e.g. including type of touch (double tap, single tap, swipe, etc.) and/or location of the touch) to the processing unit 60 of the monitor device 20. The processing unit 60 interprets the information received and determines whether the touch input corresponds to activation of an action, e.g. whether the touch input correspond to activation of a button displayed with the touch sensitive display 27 at the location of the touch input. In response to a determination that the touch input corresponds to activation of an action, the processing unit 60 performs the respective action. For example, with reference to Figs. 3 and 4, to capture an image corresponding to the presently shown live representation 70, e.g. corresponding to the image data received from the image sensor, the user may tap the image capture button 36a. The tap and the location of the tap is registered by the touch sensitive display 26, which transmits the information of the tap to the processing unit 60 of the monitor device 20. The processing unit 60 interprets the information received and determines that the user tapped the location corresponding to the image capture button 36a. In response thereto, the processing unit 60 stores, in memory 62 an image data file corresponding to the image data received.

In further reference to Figs. 3 and 4, to capture a video sequence corresponding to the shown live representation 70 over a period of time, e.g. corresponding to the image data received from the image sensor over a period of time, the user may tap the video capture button 36b. The tap and the location of the tap is registered by the touch sensitive display 26, which transmits the information of the tap to a processing unit 60 (see Fig. 4) of the monitor device 20. The processing unit 60 interprets the information received and determines that the user tapped the location corresponding to the video capture button 36b. In response thereto, the processing unit 60 starts collection of image data received from the image sensor 12 and temporarily stores the data in memory 62. To stop the recording, the user may tap the video capture button 36b again. The processing unit 60 determines, based on the signal received from the touch sensitive display 26, that that the user tapped the video capture button 36b and stops collecting image data received from the image sensor 12. The processing unit 60 read the temporarily stored data from the memory 62 and create a complete video sequence based thereon, which the processing unit 60 stores in the memory 62.

Figs. 5A-5F schematically illustrates exemplary user interactions with a graphical user interface of a monitor device 20, such as the monitor device 20 of any of the previous figures.

As illustrated in Fig. 5A, the monitor device 20 may receive a first user input 500 corresponding to selection of a first actionable menu item 42a of the one or more actionable menu items 42 (cf. Fig. 3). In the illustrated example, the first user input 500 is a touch input, e.g. a tap, on an icon, i.e. the first actionable menu item, indicating access to an archive.

The monitor device 20 detects the user input 500 with the touch sensitive display 26, and in response to detecting the first user input 500, the monitor device 20 displays a primary menu 502, as illustrated in Fig. 5B. The primary menu 502 being associated with the first actionable menu item 42a. The primary menu 502 is displayed within the fourth portion 34 of the graphical user interface, and without obscuring part of the first portion 31 of the graphical user interface. The primary menu 502 comprises one or more primary actionable items including a first primary actionable item 503a. In the illustrated example, the primary menu 502 is an archive menu with a first primary actionable item 503a to retrieve recent (e.g. recently stored) images and videos, and a second primary actionable item 503b to search for stored images and videos.

While displaying the primary menu 502, the monitor device 20 may detect with the touch sensitive display 26 a second user input 504 corresponding to selection of the first primary actionable item 503a, as illustrated in Fig. 5C. In response to detecting the second user input 504, the monitor device displays a secondary menu 506 associated with the primary actionable item 503a in the first portion 31, and optionally the second portion 32, of the graphical user interface, as illustrated in Fig. 5D. Optionally, the secondary menu 506 extends into also the fourth portion 34 of the graphical user interface.

In the illustrated example, the user provides touch input 504 on the first primary actionable item 503a being a button for retrieving recent images and videos (Fig. 5C). In response to detecting the touch input 504 with the touch sensitive display, the monitor device 20 displays the secondary menu 506, in the illustrated example being a list of the recently stored procedures (Fig. 5D), wherefrom the user may navigate to retrieve images and videos stored therein. The list of stored procedures 506 are named according to the date for performing them, and the list 506 shows the timeframe of each procedure and any notes that the user may have added to the procedure.

As seen in Figs. 5A-5D, the user needs to make two consecutive inputs to display a menu, which covers part of, or the entire live representation of the image data displayed in the first portion 31 of the graphical user interface. Thereby, unintentional touch inputs on the screen is less likely to cause interference with the display of the live representation of the image data, which could potentially be life threatening, in case the operator is performing a critical procedure with the aid of the live representation of the image data. In some examples, the primary menu (e.g. 502 as illustrated in Fig. 5B) being displayed in response to the first user input (e.g. 500 as illustrated in Fig. 5A), is ceased to be displayed if a second user input (e.g. the second user input 504 in Fig.

5C) is not received within a predetermined time from receiving/detecting the first user input and/or from displaying the primary menu. Thereby, the likelihood of receiving two unintentional inputs causing the live representation of the image data to be obstructed may be decreased.

The one or more actionable menu items 42 may comprise a second actionable menu item 42b (see Fig. 5E). The second actionable menu item 42b may be indicative of a live view. As illustrated in Fig. 5E, the monitor device may, e.g. while the primary menu 502 and/or the secondary menu 506 is displayed, detect with the touch sensitive display a third user input 508 corresponding to selection of the second actionable menu item 42b. In response to detecting the third user input 508, the monitor device may cease display of the primary menu 502 and/or the secondary menu 506, and display the live representation of the image data within the first portion 31 of the graphical user interface, as illustrated in Fig. 5F. Thus, the second actionable menu item 42b may cause the monitor device 20 to return to the initial view, as illustrated in Fig. 5A. In case of, e.g. unintentional, obstruction of the live representation of the image data, the user may fast and easily remove any such obstruction and return to displaying the live representation of the image data.

Referring now to Figs. 6A-6J schematically illustrating exemplary user interactions with a graphical user interface of a monitor device 20, such as the monitor device 20 of any of the previous figures. Fig. 6A illustrates a situation, which may continue from the situation illustrated in, e.g., Fig. 5F or be prior to receiving the first touch input 500 in Fig. 5A.

As illustrated in Fig 6A, the monitor device 20 receives a fourth user input 600, e.g. a double tap, on the touch sensitive display 26, e.g. within the first portion 31 of the graphical user interface. The monitor device 20 detects the fourth user input 600 with the touch sensitive display 26, and in response to detecting the fourth user input 600, the monitor device 20 may activate an enlarged view mode, as illustrated in Fig. 6B, wherein a section 602 of the live representation of the image data is displayed in the first portion 31 and the fourth portion 34 of the graphical user interface.

As illustrated in Fig. 6B, a first crop section 604a and a second crop section 604b of the live representation may be omitted from being displayed in the enlarged view mode. In Fig. 6B, the first crop section 604a and the second crop section 604b are merely shown for illustrative purposes. As illustrated, the section 602 of the live representation being displayed in the enlarged view mode may be between the first crop section 604a and the second crop section 604b.

Furthermore, in the enlarged view mode, an enlarged view mode indicator 606 may be displayed, e.g. in the second portion 32, as illustrated. The enlarged view mode indicator 606 indicates to the user that the monitor device 20 is operating in the enlarged view mode and notifies the user that part of the image data (the first crop section 604a and the second crop section 604b) is not being displayed.

Referring now to Fig. 6C, wherein the monitor device is operating in the enlarged view mode, the monitor device receives a fifth user input 608, e.g. corresponding to the first user input of Fig. 5A, to a actionable menu item, such as to the first actionable menu item 42a. The monitor device 20 detects the user input 608 with the touch sensitive display, and in response to detecting the user input 608, the monitor device 20 displays, within the fourth portion 34 of the graphical user interface, the primary menu 610 associated with the actionable menu item receiving the user input 608. In the present example, the monitor device displays the first primary menu 610 within the fourth portion 34 of the graphical user interface. Because the monitor device is operating in the enlarged view mode, display of the first primary menu 610 within the fourth portion 34 of the graphical user interface causes a part of the section 602 of the live representation of the image data to be obscured.

In accordance with not receiving and/or detecting a sixth user input 612, e.g. corresponding to the second user input 504 of Fig. 5C, within a threshold amount of time, e.g. 5 seconds, after receipt/detection of the fifth user input 608, the monitor device may, as illustrated in Fig. 6E, cease display of the primary menu 610 and display the section 602 of the live representation of the image data in the first portion 31 and the fourth portion 34 of the graphical user interface. Thus, obscuring part of the section 602 of the live representation of the image data in the enlarged view mode, may be limited by a timeout. Furthermore, the likelihood of receiving two unintentional inputs causing the live representation of the image data to be completely obstructed may be decreased.

In accordance with receiving and/or detecting the sixth user input 612, e.g. corresponding to the second user input 504 of Fig. 5C, e.g. the user provides the sixth user input 612 on the first primary actionable item being a button for retrieving recent images and videos. In response, the monitor device 20 displays the secondary menu 614, in the illustrated example being a list of the recently stored procedures (Fig. 6G).

Similar to when operating in the normal view mode (Figs. 5A-5D), the monitor device 20, in the enlarged view mode (Figs. 6A-6G), needs to receive two consecutive inputs, e.g. within a time frame, to display a menu, which covers the entire live representation of the image data displayed in the first portion 31 of the graphical user interface.

Referring now to Fig. 6H, the monitor device 20, while in the enlarged view mode, may receive a seventh user input 616a; 616b; 616c. As illustrated, the seventh user input may be a user input 616a, e.g. a double tap, at a location of the touch sensitive display corresponding to the first portion 31 of the graphical user interface. Alternatively or additionally, the seventh user input may be a user input 616b, e.g. a single tap or a double tap, at a location of the touch sensitive display corresponding to the enlarged view mode indicator 606. Alternatively or additionally, the seventh user input may be a user input 616c, e.g. a single tap or a double tap, at a location of the touch sensitive display corresponding to the second actionable menu item 42b, e.g. for causing the monitor device to cease display of any menus and display the live representation of the image data within the first portion 31 of the graphical user interface, such as described in more detail with respect to Figs. 5E-5F.

In response to receipt of the seventh user input 616a; 616b; 616c, the monitor device deactivates the enlarged view mode and display the live representation of the image data, e.g. only, within the first portion 31 of the graphical user interface, as illustrated in Fig. 6J, e.g. such that the live representation of the image data does not extend into the second portion and/or the fourth portion of the graphical user interface.

Referring now to Figs. 7A-7J schematically illustrating exemplary user interactions with a graphical user interface of a monitor device 20, such as the monitor device 20 of any of the previous figures. Fig. 7A illustrates a situation, which could originate from any of Figs. 5A-6J.

As illustrated in Fig. 7A, the monitor device 20 may receive a first user input 700 corresponding to selection of an actionable menu item 42c of the one or more actionable menu items 42, wherein the actionable menu item 42c corresponds to a login procedure. In the present example, the actionable menu item 42c illustrates a padlock.

The monitor device 20 detects the first user input 700 with the touch sensitive display, and in response to detection of the first user input 700, the monitor device 20 displays a primary menu 702 associated with the actionable menu item within the fourth portion 31 of the graphical user interface, e.g. without obscuring part of the first portion 31 of the graphical user interface, such as to avoid obstruction of the live representation, as explained in more detail above. The primary menu 702 may comprise an indication of a pre-selected user profile and a password type field, as illustrated. The pre-selected user profile may, e.g. be the last used user profile. By having a user profile pre-selected, the login procedure is made faster and more convenient, especially in common situations where the same user profile is used in most use cases of a monitor device.

The primary menu 702 may comprise at least two primary actionable items for receiving a user input, namely a first primary actionable item 702a for selecting another user profile, and a second primary actionable item 702b being a password type field configured to receive inputs corresponding to a password for authenticating as the selected user. While displaying the primary menu 702, the monitor device may receive a second user input 704 corresponding to selection of the password type field 702b. The monitor device 20 detects the second user input 704 with the touch sensitive display, and in response to receipt of the second user input 704, the monitor device, with reference to Fig. 7C, displays a virtual keyboard 706 for entering a password in the password type field. The virtual keyboard 706 may be displayed in the first portion 31 of the graphical user interface and optionally in the second portion 32 of the graphical user interface. The virtual keyboard may obscure part of the live representation of the image data within the first portion 31 of the graphical user interface. The monitor device 20 is adapted to receive a sequence of user inputs, e.g. via the virtual keyboard, corresponding to input of a password. Thus, the user may type the password associated with the selected user, and the typed password will be written in the password type field 702b, and optionally in a designated area of the virtual keyboard 706, as illustrated. The typed password may be obscured by exchanging the characters with asterisks as the password is typed, thereby avoiding others to see the password, while still allowing the operator to identify having typed in a number of characters.

The monitor device 20 may determine whether the typed password matches a stored password for the pre-selected user, and in accordance with the typed password matching the stored password for the pre-selected user profile, the monitor device 20 may display a login message (e.g. 716 of Fig. 7G) indicative of the login attempt being successful. Following successful authentication, the monitor device 20 may further enter an authenticated mode corresponding to the selected user profile. The authenticated mode may be based on the user type (e.g. Admin, Advanced user, Regular user, Service provider, etc.) of the selected user profile. In accordance with the typed password not matching the stored password for the pre-selected user profile, the monitor device 20 may display an error message (e.g. 718 of Fig. 7H) indicative of the typed password being incorrect.

Instead of providing the second user input 704 to the password type field 702b, as illustrated in Fig. 7B, the user may want to select another user profile. To do this, while the monitor device displays the primary menu 702, the user may provide a third user input 710 corresponding to selection of the first primary actionable item 702b for selecting another user profile, see Fig. 7D. The monitor device 20 detects the third user input 710 with the touch sensitive display, and in response to detection of the third user input 710 the monitor device displays a list of selectable user profiles 712 in the first portion 31 of the graphical user interface and optionally in the second portion 32 of the graphical user interface, as illustrated in Fig. 7E. While displaying the list of selectable user profiles 712, the monitor device may receive a fourth user input 714 corresponding to selection of a selectable user profile. The monitor device 20 detects the fourth user input 714 with the touch sensitive display.

In response to detection of the fourth user input 714, i.e. in response to selection of a selectable user profile, the monitor device displays the virtual keyboard 706 for entering a password in the password type field. The virtual keyboard 706 may be displayed in the first portion 31 of the graphical user interface and optionally in the second portion 32 of the graphical user interface. The monitor device 20 is adapted to receive a sequence of user inputs, e.g. via the virtual keyboard 706, corresponding to input of a password. The user may type the password associated with the selected user, and the typed password will be written in a password type field. The typed password may be obscured by exchanging the characters with asterisks as the password is typed.

The monitor device 20 may determine whether the typed password matches a stored password for the selected user profile, and in accordance with the typed password matching the stored password for the selected user profile, the monitor device 20 may display a login message 716 indicative of the login attempt being successful, see Fig. 7G. Following successful authentication, the monitor device 20 further enter an authenticated mode corresponding to the selected user profile. The authenticated mode may be based on the user type (e.g. Admin, Advanced user, Regular user, Service provider, etc.) of the selected user profile.

In accordance with the typed password not matching the stored password for the selected user profile, the monitor device 20 may display an error message 718 indicative of the typed password being incorrect, see Fig. 7H.

After authenticating a user profile, receiving and/or detecting the first user input 700, as illustrated in Fig. 7A, corresponding to selection of the actionable menu item 42c associated with the login procedure, the monitor device 20 may display a modified version of the primary menu 702, see Fig. 71 The modified version of the primary menu 702 comprises a third primary actionable item 702c for logging out. Upon receipt of an input to the logout item 702c, the monitor device 20 may detect the input and in response to detecting the input enter a non-authenticated mode.

The monitor device 20 may further automatically enter the non-authenticated mode, e.g. if automatic logout criteria have been met. For example, the monitor device 20 may determine whether automatic logout criteria have been met. The automatic logout criteria may comprise that a visualisation device has not been connected to the monitor device for a logout time duration. Furthermore, the automatic logout criteria may comprise that during the logout time duration no user input has been received via the touch sensitive display 26. Exemplary embodiments of the present disclosure are set out in the following exemplary items:

1. A medical visualisation system comprising a visualisation device having an image sensor configured to generate image data indicative of a view from the visualisation device, the medical visualisation system further comprising a monitor device operable to receive the image data as the image data is being generated by the image sensor, the monitor device comprising a first housing extending in a first direction from a first housing side to a second housing side and in a second direction perpendicular to the first direction from a third housing side to a fourth housing side, the monitor device comprising a touch sensitive display accommodated in the first housing and having a first length in the first direction and a second length in the second direction, wherein the monitor device displays with the touch sensitive display a graphical user interface comprising a plurality of non-overlapping portions including a first portion, a second portion, a third portion and a fourth portion, wherein the first portion and the fourth portion are arranged between the second portion and the third portion along the second direction, and wherein the fourth portion is arranged between the first portion and the third portion along the second direction, wherein the monitor device displays a live representation of the image data within the first portion of the graphical user interface; and displays one or more actionable menu items within the third portion of the graphical user interface, and wherein the monitor device is adapted to detect a first user input with the touch sensitive display corresponding to selection of a first actionable menu item of the one or more actionable menu items, and in response to detecting the first user input the monitor device displays a primary menu associated with the first actionable menu item within the fourth portion of the graphical user interface without obscuring part of the first portion of the graphical user interface, wherein the primary menu comprises one or more primary actionable items including a first primary actionable item, and wherein while displaying the primary menu associated with the first actionable menu item, the monitor device is adapted to detect a second user input corresponding to selection of the first primary actionable item, and in response to detecting the second user input, the monitor device displays a secondary menu associated with the first primary actionable item in the first portion, and optionally the second portion and/or the fourth portion, of the graphical user interface.

2. Medical visualisation system according to item 1, wherein the one or more actionable menu items comprises a second actionable menu item, and wherein, while the secondary menu is displayed, the monitor device is adapted to detect a third user input corresponding to selection of the second actionable menu item, and in response to detecting the third user input, the monitor device ceases display of the secondary menu and displays the live representation of the image data within the first portion of the graphical user interface.

3. Medical visualisation system according to any of the preceding items, wherein the monitor device displays one or more actionable items within the second portion of the graphical user interface.

4. Medical visualisation system according to item 3, wherein the one or more actionable items comprise an image capture button, and wherein the monitor device stores an image data file corresponding to the image data received when the image capture button is activated.

5. Medical visualisation system according to any of items 3-4, wherein the one or more actionable items comprises a video capture button, and wherein the monitor device stores a video sequence of image data corresponding to the image data received when the video capture button is activated.

6. Medical visualisation system according to item 5 as dependent on item 4, wherein the image capture button is a first colour and the video capture button is a second colour, and wherein the first colour is visually distinct from the second colour.

7. Medical visualisation system according to item 6, wherein the first colour and the second colour differ by a hue difference of at least 60 degrees, such as at least 120 degrees.

8. Medical visualisation system according to any of the preceding items, wherein the monitor device is adapted to detect a fourth user input, and in response to detecting the fourth user input the monitor device activates an enlarged view mode wherein a section of the live representation of the image data is displayed in the first portion and the fourth portion of the graphical user interface. 9. Medical visualisation system according to item 8, wherein the fourth user input corresponds to a double tap on the touch sensitive display inside the first portion.

10. Medical visualisation system according to any of items 8-9, wherein the live representation comprises a first crop section and a second crop section, the section of the live representation being displayed in the enlarged view mode being between the first crop section and the second crop section, wherein the first crop section and the second crop section are not displayed in the enlarged view mode.

11. Medical visualisation system according to any of items 8-10, wherein in response to detecting the fourth user input the monitor device further displays an enlarged view mode indicator, optionally the enlarged view mode indicator is displayed in the second portion.

12. Medical visualisation system according to any of items 8-11 as dependent on item 4, wherein in the enlarged view mode the monitor device stores with the image data file being stored information indicative of the monitor device operating in the enlarged view mode when the image capture button was activated.

13. Medical visualisation system according to any of items 8-12 as dependent on item 5, wherein in the enlarged view mode the monitor device stores with the video sequence being stored information indicative of the monitor device operating in the enlarged view mode when the video capture button was activated.

14. Medical visualisation system according to any of items 8-13, wherein, while in the enlarged view mode, the monitor device is adapted to detect a fifth user input corresponding to selection of the first actionable menu item of the one or more actionable menu items, and in response to detecting the fifth user input the monitor device displays the primary menu associated with the first actionable menu item within the fourth portion of the graphical user interface obscuring a part of the section of the live representation of the image data.

15. Medical visualisation system according to any of items 8-14, wherein, while in the enlarged view mode, while displaying the primary menu associated with the first actionable menu item, the monitor device is adapted to detect a sixth user input corresponding to selection of a primary actionable item of the one or more primary actionable items of the primary menu, and in accordance with not receiving the sixth user input within a threshold amount of time after detecting the fifth user input, the monitor device ceases display of the primary menu associated with the first actionable menu item and displays the section of the live representation of the image data in the first portion and the fourth portion of the graphical user interface.

16. Medical visualisation system according to any of items 8-15, wherein, while in the enlarged view mode, the monitor device is adapted to detect a seventh user input, and in response to detecting the seventh user input the monitor device deactivates the enlarged view mode and displays the live representation of the image data within the first portion of the graphical user interface.

17. Medical visualisation system according to item 16, wherein the seventh user input corresponds to one or more of selection of the second actionable menu item, a touch input at a location of the enlarged view mode indicator, a touch input within the second portion of the graphical user interface.

18. Medical visualisation system according to any of the preceding items, wherein the monitor device comprises one or more connection ports configured to receive a connector of the visualisation device, and wherein the one or more connection ports are provided on the third housing side.

19. Medical visualisation system according to any of the preceding items, wherein the first portion of the graphical user interface is square.

20. Medical visualisation system according to any of the preceding items, wherein the first portion of the graphical user interface occupies the centre of the graphical user interface.

21. Medical visualisation system according to any of the preceding items, wherein a battery indicator and/or a time indicator is displayed within the third portion of the graphical user interface.

22. Medical visualisation system according to any of the preceding items, wherein the monitor device displays a second background colour within the second portion of the graphical user interface, the second background colour filling at least 80% of the second portion of the graphical user interface, and wherein the second background colour has a lightness value of less than 0.6, such as less than 0.4, such as less than 0.2, such as less than 0.1.

23. Medical visualisation system according to any of the preceding items, wherein the monitor device displays a fourth background colour within the fourth portion of the graphical user interface, the fourth background colour filling at least 80% of the fourth portion of the graphical user interface, and wherein the fourth background colour has a lightness value of less than 0.6, such as less than 0.4, such as less than 0.2, such as less than 0.1.

24. A medical visualisation system comprising a visualisation device having an image sensor configured to generate image data indicative of a view from the visualisation device, the medical visualisation system further comprising a monitor device operable to receive the image data as the image data is being generated by the image sensor, the monitor device comprising a first housing extending in a first direction from a first housing side to a second housing side and in a second direction perpendicular to the first direction from a third housing side to a fourth housing side, the monitor device comprising a touch sensitive display accommodated in the first housing and having a first length in the first direction and a second length in the second direction, wherein the monitor device displays with the touch sensitive display a graphical user interface, the graphical user interface comprising a plurality of non-overlapping portions including a first portion, a second portion, a third portion and a fourth portion, wherein the first portion and the fourth portion are arranged between the second portion and the third portion along the second direction, and wherein the second portion is arranged between the first portion and the fourth portion along the second direction, wherein the monitor device:

- displays a live representation of the image data within the first portion of the graphical user interface;

- displays a second background colour within the second portion of the graphical user interface, the second background colour filling at least 80% of the second portion of the graphical user interface, and wherein the second background colour has a lightness value of less than 0.6, such as less than 0.4, such as less than 0.2, such as less than 0.1;

- displays one or more actionable menu items within the third portion of the graphical user interface; and

- displays a fourth background colour within the fourth portion of the graphical user interface, the fourth background colour filling at least 80% of the fourth portion of the graphical user interface, and wherein the fourth background colour has a lightness value of less than 0.6, such as less than 0.4, such as less than 0.2, such as less than 0.1.

25. A medical visualisation system comprising a visualisation device having an image sensor configured to generate image data indicative of a view from the visualisation device, the medical visualisation system further comprising a monitor device operable to receive the image data as the image data is being generated by the image sensor, the monitor device comprising a first housing extending in a first direction from a first housing side to a second housing side and in a second direction perpendicular to the first direction from a third housing side to a fourth housing side, the monitor device comprising a touch sensitive display accommodated in the first housing and having a first length in the first direction and a second length in the second direction, wherein the monitor device displays with the touch sensitive display a graphical user interface comprising a plurality of non-overlapping portions including a first portion, a second portion, a third portion and a fourth portion, wherein the first portion and the fourth portion are arranged between the second portion and the third portion along the second direction, and wherein the second portion is arranged between the first portion and the fourth portion along the second direction, wherein the monitor device:

- displays a live representation of the image data within the first portion of the graphical user interface; and

- displays one or more actionable menu items within the third portion of the graphical user interface, the one or more actionable menu items including a first actionable menu item, wherein the first actionable menu item is associated with a login procedure, and wherein the monitor device is adapted to detect a first user input corresponding to selection of the first actionable menu item, and in response to detecting the first user input the monitor device displays a primary menu associated with the first actionable menu item within the fourth portion of the graphical user interface without obscuring part of the first portion of the graphical user interface, wherein the primary menu comprises an indication of a pre-selected user profile and a password type field; while displaying the primary menu associated with the first actionable menu item the monitor device is adapted to detect a second user input corresponding to selection of the password type field, and in response to detecting the second user input, the monitor device displays a virtual keyboard in the first portion of the graphical user interface and optionally in the second portion of the graphical user interface, wherein the virtual keyboard obscures at least part of the live representation of the image data within the first portion of the graphical user interface, the virtual keyboard being configured for entering a password in the password type field.

26. Medical visualisation system according to item 25, wherein the primary menu comprises a first primary actionable item for selecting another user profile, and wherein, while displaying the primary menu associated with the first actionable menu item, the monitor device is adapted to detect a third user input corresponding to selection of the first primary actionable item, and in response to detecting the third user input, the monitor device displays a list of selectable user profiles in the first portion of the graphical user interface and optionally in the second portion of the graphical user interface.

27. Medical visualisation system according to item 26, wherein while displaying the list of selectable user profiles, the monitor device is adapted to detect a fourth user input corresponding to selection of a selectable user profile from the list of selectable user profiles, and in response to detecting the fourth user input, the monitor device displays a virtual keyboard in the first portion of the graphical user interface and optionally in the second portion of the graphical user interface, wherein the virtual keyboard is configured for entering a password in a password type field.

28. A medical visualisation system comprising a visualisation device having an image sensor configured to generate image data indicative of a view from the visualisation device, the medical visualisation system further comprising a monitor device operable to receive the image data as the image data is being generated by the image sensor, the monitor device comprising a touch sensitive display, and wherein the monitor device displays a primary menu comprising an indication of a selected user profile, and is adapted to detect a sequence of user inputs corresponding to input of a password, and determine whether the input password match a stored password for the selected user profile, in accordance with the input password matching the stored password for the selected user profile, the monitor device enters an authenticated mode corresponding to the selected user profile; while the monitor device is in the authenticated mode, the monitor device determines whether automatic logout criteria have been met, wherein the automatic logout criteria comprise that the visualisation device has not been connected to the monitor device for a logout time duration, and in accordance with the automatic logout criteria being met, the monitor device enters a non- authenticated mode.

29. Medical visualisation system according to item 28, wherein the automatic logout criteria comprise that during the logout time duration no user input has been detected via the touch sensitive display.

30. Medical visualisation system according to any of items 28-29, wherein, in accordance with the typed password not matching the stored password for the selected user profile, the monitor device displays an error message indicative of the typed password being incorrect.

31. Medical visualisation system according to any of the preceding items, wherein each of the plurality of portions extend substantially throughout the first length in the first direction.

32. Medical visualisation system according to any of the preceding items, wherein the first portion is square.

33. Medical visualisation system according to any of the preceding items, wherein the first portion of the graphical user interface occupy the centre of the touch sensitive display.

34. Medical visualisation system according to any of the preceding items, wherein the first portion of the graphical user interface extends throughout more than 40% of the second length in the second direction.

The invention has been described with reference to preferred embodiments. However, the scope of the invention is not limited to the illustrated embodiments, and alterations and modifications can be carried out without deviating from the scope of the invention.

Throughout the description, the use of the terms "first", "second", "third", "fourth", "primary", "secondary", "tertiary" etc. does not imply any particular order of importance but are included to identify individual elements. Furthermore, the labelling of a first element does not imply the presence of a second element and vice versa. LIST OF REFERENCES

2 medical visualisation system

4 visualisation device

6 handle

7 control button

8 elongated flexible member

9 distal part

10 distal end of elongated flexible member 12 image sensor 14 device cable 16 device connector 20 monitor device 21 first housing side 22 second housing side

23 third housing side

24 fourth housing side

25 first housing

26 touch sensitive display 27 graphical user interface

31 first portion

32 second portion

33 third portion

34 fourth portion

36 actionable item(s)

37 first image direction

38 second image direction 40 connection port(s) 42 actionable menu item(s) 44 invert view button 46 inverted view mode indicator 50 battery indicator 60 processing unit 61 power supply 61a battery 61b power connection 62 memory

64 orientation sensor

66 input/output

68 microphone 70 live representation of image data xl first direction x2 second direction LI first length L2 second length

Claims

2. Medical visualisation system according to claim 1, wherein the one or more actionable menu items comprises a second actionable menu item, and wherein, while the secondary menu is displayed, the monitor device is adapted to detect a third user input corresponding to selection of the second actionable menu item, and in response to detecting the third user input, the monitor device ceases display of the secondary menu and displays the live representation of the image data within the first portion of the graphical user interface.

3. Medical visualisation system according to any of the preceding claims, wherein the monitor device displays one or more actionable items within the second portion of the graphical user interface.

4. Medical visualisation system according to claim 3, wherein the one or more actionable items comprise an image capture button, and wherein the monitor device stores an image data file corresponding to the image data received when the image capture button is activated.

5. Medical visualisation system according to any of claims 3-4, wherein the one or more actionable items comprises a video capture button, and wherein the monitor device stores a video sequence of image data corresponding to the image data received when the video capture button is activated.

6. Medical visualisation system according to claim 5 as dependent on claim 4, wherein the image capture button is a first colour and the video capture button is a second colour, and wherein the first colour and the second colour differ by a hue difference of at least 60 degrees, such as at least 120 degrees.

7. Medical visualisation system according to any of the preceding claims, wherein the monitor device is adapted to detect a fourth user input, and in response to detecting the fourth user input the monitor device activates an enlarged view mode wherein a section of the live representation of the image data is displayed in the first portion and the fourth portion of the graphical user interface.

8. Medical visualisation system according to claim 7, wherein the fourth user input corresponds to a double tap on the touch sensitive display inside the first portion.

9. Medical visualisation system according to any of claims 7-8, wherein the live representation comprises a first crop section and a second crop section, the section of the live representation being displayed in the enlarged view mode being between the first crop section and the second crop section, wherein the first crop section and the second crop section are not displayed in the enlarged view mode.

10. Medical visualisation system according to any of claims 7-9, wherein in response to detecting the fourth user input the monitor device further displays an enlarged view mode indicator, optionally the enlarged view mode indicator is displayed in the second portion.

11. Medical visualisation system according to any of claims 7-10 as dependent on claim

4, wherein in the enlarged view mode the monitor device stores with the image data file being stored information indicative of the monitor device operating in the enlarged view mode when the image capture button was activated.

12. Medical visualisation system according to any of claims 7-11 as dependent on claim

5, wherein in the enlarged view mode the monitor device stores with the video sequence being stored information indicative of the monitor device operating in the enlarged view mode when the video capture button was activated.

13. Medical visualisation system according to any of claims 7-12, wherein, while in the enlarged view mode, the monitor device is adapted to detect a fifth user input corresponding to selection of the first actionable menu item of the one or more actionable menu items, and in response to detecting the fifth user input the monitor device displays the primary menu associated with the first actionable menu item within the fourth portion of the graphical user interface obscuring a part of the section of the live representation of the image data.

14. Medical visualisation system according to claim 13, wherein, while in the enlarged view mode, while displaying the primary menu associated with the first actionable menu item, the monitor device is adapted to detect a sixth user input corresponding to selection of a primary actionable item of the one or more primary actionable items of the primary menu, and in accordance with not receiving the sixth user input within a threshold amount of time after detecting the fifth user input, the monitor device ceases display of the primary menu associated with the first actionable menu item and displays the section of the live representation of the image data in the first portion and the fourth portion of the graphical user interface.

15. Medical visualisation system according to any of claims 7-14, wherein, while in the enlarged view mode, the monitor device is adapted to detect a seventh user input, and in response to detecting the seventh user input the monitor device deactivates the enlarged view mode and displays the live representation of the image data within the first portion of the graphical user interface.

16. Medical visualisation system according to claim 15, wherein the seventh user input corresponds to one or more of selection of the second actionable menu item, a touch input at a location of the enlarged view mode indicator, a touch input within the second portion of the graphical user interface.

17. Medical visualisation system according to any of the preceding claims, wherein the monitor device comprises one or more connection ports configured to receive a connector of the visualisation device, and wherein the one or more connection ports are provided on the third housing side.

18. Medical visualisation system according to any of the preceding claims, wherein the monitor device displays a second background colour within the second portion of the graphical user interface, the second background colour filling at least 80% of the second portion of the graphical user interface, and wherein the second background colour has a lightness value of less than 0.6, such as less than 0.4, such as less than 0.2, such as less than 0.1, and wherein the monitor device displays a fourth background colour within the fourth portion of the graphical user interface, the fourth background colour filling at least 80% of the fourth portion of the graphical user interface, and wherein the fourth background colour has a lightness value of less than 0.6, such as less than 0.4, such as less than 0.2, such as less than 0.1.

19. Medical visualisation system according to any of the preceding claims, wherein each of the plurality of portions extend substantially throughout the first length in the first direction.

20. Medical visualisation system according to any of the preceding claims, wherein the first portion is square.

21. Medical visualisation system according to any of the preceding claims, wherein the first portion of the graphical user interface occupy the centre of the touch sensitive display.

22. Medical visualisation system according to any of the preceding claims, wherein the first portion of the graphical user interface extends throughout more than 40% of the second length in the second direction.