Classifications

• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
  • A61B1/00002—Operational features of endoscopes
  • A61B1/00039—Operational features of endoscopes provided with input arrangements for the user
  • A61B1/0004—Operational features of endoscopes provided with input arrangements for the user for electronic operation
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
  • A61B1/00002—Operational features of endoscopes
  • A61B1/00043—Operational features of endoscopes provided with output arrangements
  • A61B1/00045—Display arrangement
  • A61B1/0005—Display arrangement combining images e.g. side-by-side, superimposed or tiled
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B5/00—Measuring for diagnostic purposes; Identification of persons
  • A61B5/74—Details of notification to user or communication with user or patient ; user input means
  • A61B5/742—Details of notification to user or communication with user or patient ; user input means using visual displays
  • A61B5/7435—Displaying user selection data, e.g. icons in a graphical user interface
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
  • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
  • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
  • G06F3/0482—Interaction with lists of selectable items, e.g. menus
• • G—PHYSICS
  • G06—COMPUTING; CALCULATING OR COUNTING
  • G06F—ELECTRIC DIGITAL DATA PROCESSING
  • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
  • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
  • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
  • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
  • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Definitions

• the image sensor may generate image data corresponding to a non-square image, which is cropped to form a square image, such as a square image having 300x300 pixels, 400x400 pixels, 600x600 pixels, or 800x800 pixels.
• the medical visualisation system further comprises a monitor device receiving and/or being operable to receive the image data generated by the image sensor.
• the monitor device may receive and/or be operable to receive the image data, e.g. as the image data is being generated, e.g. within limitation of the hardware.
• the monitor device comprises a first housing extending in a first direction from a first housing side to a second housing side and in a second direction perpendicular to the first direction from a third housing side to a fourth housing side.
• the monitor device comprises a display, e.g. a touch sensitive display.
• the display may be accommodated in the first housing.
• the display may have a first length in the first direction and a second length in the second direction.
• the second length may be longer than the first length, e.g. the display may be a 16:9 or 16:10 display.
• the first length may be longer than the second length, or the first length and the second length may be substantially the same.
• the touch sensitive display may be any suitable type of touch display, e.g. capacitive touch display or resistive touch display.
• the monitor device may establish connection to a visualisation device, such as the first visualisation device and/or the second visualisation device.
• Establishing connection to the visualisation device may include receiving a device connector of the respective visualisation device in a connection port of the one or more connection ports of the monitor device.
• Establishing connection to a visualisation device may include obtaining device identifier information from a device identifier (e.g. EPROM, QR-code, NFC, RFID or similar) of the visualisation device.
• establishing connection to the first visualisation device may include obtaining first device identifier information from a first device identifier of the first visualisation device and/or establishing connection to the second visualisation device may include obtaining second device identifier information from a second device identifier of the second visualisation device.
• the monitor device may comprise a power unit for powering the monitor device.
• the power unit may comprise a rechargeable battery and/or a power connection for connecting the power unit to an external power supply, such as a conventional AC power socket.
• the power unit may be accommodated in the first housing. Alternatively, the power unit may be accommodated in the second housing.
• the monitor device may comprise a graphical user interface.
• the monitor device and/or the processing unit of the monitor device may display with the touch sensitive display the graphical user interface.
• the graphical user interface may comprise one or more portions, such as a plurality of portions.
• the portions may be non-overlapping portions, such as a plurality of non-overlapping portions.
• the portions may include a first portion and/or a second portion.
• the portions may further include a third portion and/or a fourth portion.
• the second portion and/or the fourth portion may be designated as background portions, e.g. the second portion may be a first background portion and/or the fourth portion may be a second background portion.
• Each of the plurality of portions may extend substantially throughout the first length in the first direction.
• the first portion of the graphical user interface may be larger along the second direction than the second portion, the third portion and/or the fourth portion, individually and/or collectively.
• the first portion of the graphical user interface may extend throughout more than 40% of the second length in the second direction, such as more than 50% of the second length in the second direction, such as more than 60% of the second length in the second direction.
• the monitor device may display a live representation of the image data, e.g. within the first portion of the graphical user interface.
• the live representation of the image data may be displayed, e.g. by the processing unit, with the touch sensitive display, e.g. within the first portion of the graphical user interface.
• the touch input in the second input direction may cause the distal portion of the elongated flexible member to bend in a second bending direction and/or may cause movement of the image sensor in a second image sensor direction.
• the live representation of the image data may have directions corresponding to directions of the image sensor generating the image data.
• the first bending direction may correspond to a first image direction of a representation of the image data, such as the live representation of the image data.
• the second bending direction may correspond to a second image direction of the representation of the image data, such as the live representation of the image data.
• the first image direction and/or the second image direction may be parallel to the first direction of the first housing.
• the monitor device may provide one or more actionable items. One or more actionable items may be displayed, e.g.
• the one or more actionable items may comprise an image capture button and/or a video capture button.
• an image capture button e.g. by a user providing a touch input, e.g. a single tap, at the respective location of the touch sensitive display
• an image data file corresponding to the image data received when the image capture button was activated may be stored, e.g. in memory of the monitor device.
• the video capture button e.g. by a user providing a touch input, e.g.
• a video sequence of image data corresponding to the image data received when the video capture button was activated may be stored, e.g. in memory of the monitor device.
• a first activation of the video capture button may start collection of image data for the video sequence, and a second activation of the video capture button (subsequent to the first activation of the video capture button) may stop the collection of image data for the video sequence.
• the stored video sequence may correspond to the image data received between the first activation and the second activation of the video capture button.
• the video capture button may be displayed in a first appearance prior to the first activation and after the second activation.
• the video capture button may be displayed in a second appearance after the first activation and before the second activation.
• the monitor device may be adapted to detect the second user input, and in response to detecting the second user input, the monitor device may display, e.g. with the touch sensitive display, a secondary menu associated with the first primary actionable item in the first portion, of the graphical user interface.
• the secondary menu may extend into the second portion and/or the fourth portion, of the graphical user interface.
• the one or more actionable items may comprise an image capture button and a video capture button.
• the image capture button may be a first colour and the video capture button may be a second colour.
• the first colour may be visually distinct from the second colour.
• the first colour and the second colour may differ by a hue difference of at least 60 degrees, such as at least 120 degrees.
• the hue difference may be according to the HSL or HSV colour models, wherein hue ranges from 0-360 degrees.
• the image capture button may be green, and the video capture button may be blue. Providing the image capture button and the video capture button in distinguishing colours allows for easy oral reference, e.g.
• the monitor device may support receiving spoken commands, e.g. by a microphone. In such situation it may also be advantageous that the operator can easily utter a command, which the monitor device has a high likelihood of interpreting as intended.
• a fourth user input e.g. a double tap within the first portion of the graphical user interface
• the monitor device may be adapted to detect a fourth user input.
• an enlarged view mode may be activated.
• the monitor device may activate the enlarged view mode.
• a section of the live representation of the image data may be displayed in the first portion and the fourth portion of the graphical user interface.
• a section of the live representation of the image data may be extended to be displayed using a bigger part of the graphical user interface, and the section of the live representation of the image data may be magnified.
• the monitor device may further display an enlarged view mode indicator.
• the enlarged view mode indicator is displayed in the second portion.
• the live representation may comprise a first crop section and a second crop section. This may be due to the image sensor generating image data corresponding to a square image (or may be cropped to a square format), e.g. due to conventions or de-facto standards within the field of medical visualisation, and therefore enlarging the image results to the image attaining a height larger than the height of the display.
• the section of the live representation being displayed in the enlarged view mode may be between the first crop section and the second crop section.
• the first crop section and the second crop section are not displayed in the enlarged view mode.
• the section of the live representation being displayed in the enlarged view mode may be between 30-95 %, such as 40-90%, such as 50-80%, such as 60-70% of the live representation.
• a seventh user input may be received.
• the monitor device may be adapted to detect a seventh user input.
• the seventh user input may correspond to one or more of selection of the second actionable menu item, a touch input at a location of the enlarged view mode indicator, a touch input within the second portion of the graphical user interface.
• the enlarged view mode may be deactivated and the live representation of the image data may be displayed within the first portion of the graphical user interface.
• the monitor device may deactivate the enlarged view mode and display the live representation of the image data within the first portion of the graphical user interface.
• the first actionable menu item may be associated with a login procedure.
• the first actionable menu item may be a log in button.
• the primary menu associated with the first actionable menu item displayed in response to receipt and/or detection of the first user input may comprise an indication of a pre-selected user profile and a password type field.
• Figs. 6A-6J schematically illustrates exemplary user interactions with a graphical user interface of an exemplary monitor device
• Figs. 7A-7J schematically illustrates exemplary user interactions with a graphical user interface of an exemplary monitor device.
• the visualisation device 4 may be connected to the monitor device 20.
• a device cable 14 extending from the handle 6 terminates in a device connector 16 connected to a connection port 40 of the monitor device 20.
• the monitor device 20 is operable to receive image data generated by the image sensor 12 of the visualisation device 4.
• the monitor device 20 may receive image data generated by the image sensor 12 via the device cable 14, the connector 16 and connection port 40.
• the handle 6 comprises a control button 7 adapted to receive an input in a first input direction and/or in a second input direction.
• the touch input in the first input direction on the control button 7 causes a distal portion 9 of the elongated flexible member 8 to bend in a first bending direction, e.g. via wires extending from the handle, through the elongated flexible member 8 to the distal portion 9.
• the touch input in the second input direction on the control button 7 causes the distal portion 9 of the elongated flexible member 8 to bend in a second bending direction.
• the first input direction and the second input direction may be opposite.
• the first bending direction and the second bending direction may be opposite.
• the monitor device 20 also comprises the touch sensitive display 26 as described earlier.
• the monitor device 20 may display information, graphical user interface objects, images, buttons etc, with the touch sensitive display 27.
• the monitor device 20 also comprises a microphone 68.
• the monitor device 20 comprises a power unit 61 for powering the monitor device 20.
• the power unit 61 may comprise a rechargeable battery 61a.
• the power unit 61 may comprise a power connection 61b for connecting the power unit 61 to an external power supply, such as a conventional AC power socket.
• the components of the monitor device 20 may be interconnected by buses or signal lines. Some or all of the components of the monitor device may be accommodated in the first housing 25 as illustrated. Flowever, alternatively some of the components, e.g.
• the power unit 61 may comprise components for, e.g. indirectly measuring, capacity of the rechargeable battery 61a.
• the power unit 61 may comprise a voltage gauge to measure the voltage of the rechargeable battery 61a. Based on the measured voltage, the remaining capacity of the rechargeable battery 61a may be estimated, e.g. by the processing unit 60.
• the power unit 61 may also comprise components for measuring power consumption of the monitor device 20.
• the power unit 61 may comprise a power meter to measure the rate at which the monitor device 20 consumes power from the rechargeable battery 61a.
• the processing unit 60 performs the respective action. For example, with reference to Figs. 3 and 4, to capture an image corresponding to the presently shown live representation 70, e.g. corresponding to the image data received from the image sensor, the user may tap the image capture button 36a. The tap and the location of the tap is registered by the touch sensitive display 26, which transmits the information of the tap to the processing unit 60 of the monitor device 20. The processing unit 60 interprets the information received and determines that the user tapped the location corresponding to the image capture button 36a. In response thereto, the processing unit 60 stores, in memory 62 an image data file corresponding to the image data received.
• the processing unit 60 determines, based on the signal received from the touch sensitive display 26, that that the user tapped the video capture button 36b and stops collecting image data received from the image sensor 12.
• the processing unit 60 read the temporarily stored data from the memory 62 and create a complete video sequence based thereon, which the processing unit 60 stores in the memory 62.
• the monitor device 20 receives a fourth user input 600, e.g. a double tap, on the touch sensitive display 26, e.g. within the first portion 31 of the graphical user interface.
• the monitor device 20 detects the fourth user input 600 with the touch sensitive display 26, and in response to detecting the fourth user input 600, the monitor device 20 may activate an enlarged view mode, as illustrated in Fig. 6B, wherein a section 602 of the live representation of the image data is displayed in the first portion 31 and the fourth portion 34 of the graphical user interface.
• the monitor device 20 displays the secondary menu 614, in the illustrated example being a list of the recently stored procedures (Fig. 6G).
• a single tap or a double tap at a location of the touch sensitive display corresponding to the second actionable menu item 42b, e.g. for causing the monitor device to cease display of any menus and display the live representation of the image data within the first portion 31 of the graphical user interface, such as described in more detail with respect to Figs. 5E-5F.
• the monitor device In response to detection of the fourth user input 714, i.e. in response to selection of a selectable user profile, the monitor device displays the virtual keyboard 706 for entering a password in the password type field.
• the virtual keyboard 706 may be displayed in the first portion 31 of the graphical user interface and optionally in the second portion 32 of the graphical user interface.
• the monitor device 20 is adapted to receive a sequence of user inputs, e.g. via the virtual keyboard 706, corresponding to input of a password.
• the user may type the password associated with the selected user, and the typed password will be written in a password type field.
• the typed password may be obscured by exchanging the characters with asterisks as the password is typed.
• the monitor device 20 may determine whether the typed password matches a stored password for the selected user profile, and in accordance with the typed password matching the stored password for the selected user profile, the monitor device 20 may display a login message 716 indicative of the login attempt being successful, see Fig. 7G. Following successful authentication, the monitor device 20 further enter an authenticated mode corresponding to the selected user profile.
• the authenticated mode may be based on the user type (e.g. Admin, Advanced user, Regular user, Service provider, etc.) of the selected user profile.
• the monitor device 20 may display a modified version of the primary menu 702, see Fig. 71
• the modified version of the primary menu 702 comprises a third primary actionable item 702c for logging out.
• the monitor device 20 may detect the input and in response to detecting the input enter a non-authenticated mode.
• the monitor device 20 may further automatically enter the non-authenticated mode, e.g. if automatic logout criteria have been met. For example, the monitor device 20 may determine whether automatic logout criteria have been met.
• the automatic logout criteria may comprise that a visualisation device has not been connected to the monitor device for a logout time duration. Furthermore, the automatic logout criteria may comprise that during the logout time duration no user input has been received via the touch sensitive display 26. Exemplary embodiments of the present disclosure are set out in the following exemplary items:
• the one or more actionable menu items comprises a second actionable menu item
• the monitor device is adapted to detect a third user input corresponding to selection of the second actionable menu item, and in response to detecting the third user input, the monitor device ceases display of the secondary menu and displays the live representation of the image data within the first portion of the graphical user interface.
• the monitor device is adapted to detect a fourth user input, and in response to detecting the fourth user input the monitor device activates an enlarged view mode wherein a section of the live representation of the image data is displayed in the first portion and the fourth portion of the graphical user interface.
• the fourth user input corresponds to a double tap on the touch sensitive display inside the first portion.
• the live representation comprises a first crop section and a second crop section, the section of the live representation being displayed in the enlarged view mode being between the first crop section and the second crop section, wherein the first crop section and the second crop section are not displayed in the enlarged view mode.
• the monitor device while in the enlarged view mode, is adapted to detect a fifth user input corresponding to selection of the first actionable menu item of the one or more actionable menu items, and in response to detecting the fifth user input the monitor device displays the primary menu associated with the first actionable menu item within the fourth portion of the graphical user interface obscuring a part of the section of the live representation of the image data.
• Medical visualisation system according to any of items 8-14, wherein, while in the enlarged view mode, while displaying the primary menu associated with the first actionable menu item, the monitor device is adapted to detect a sixth user input corresponding to selection of a primary actionable item of the one or more primary actionable items of the primary menu, and in accordance with not receiving the sixth user input within a threshold amount of time after detecting the fifth user input, the monitor device ceases display of the primary menu associated with the first actionable menu item and displays the section of the live representation of the image data in the first portion and the fourth portion of the graphical user interface.
• Medical visualisation system wherein the seventh user input corresponds to one or more of selection of the second actionable menu item, a touch input at a location of the enlarged view mode indicator, a touch input within the second portion of the graphical user interface.
• monitor device comprises one or more connection ports configured to receive a connector of the visualisation device, and wherein the one or more connection ports are provided on the third housing side.
• a medical visualisation system comprising a visualisation device having an image sensor configured to generate image data indicative of a view from the visualisation device, the medical visualisation system further comprising a monitor device operable to receive the image data as the image data is being generated by the image sensor, the monitor device comprising a first housing extending in a first direction from a first housing side to a second housing side and in a second direction perpendicular to the first direction from a third housing side to a fourth housing side, the monitor device comprising a touch sensitive display accommodated in the first housing and having a first length in the first direction and a second length in the second direction, wherein the monitor device displays with the touch sensitive display a graphical user interface comprising a plurality of non-overlapping portions including a first portion, a second portion, a third portion and a fourth portion, wherein the first portion and the fourth portion are arranged between the second portion and the third portion along the second direction, and wherein the second portion is arranged between the first portion and the fourth portion along the second direction, wherein the second
• connection port(s) 38 second image direction 40 connection port(s) 42 actionable menu item(s) 44 invert view button 46 inverted view mode indicator 50 battery indicator 60 processing unit 61 power supply 61a battery 61b power connection 62 memory

Landscapes

• Engineering & Computer Science (AREA)
• Health & Medical Sciences (AREA)
• Life Sciences & Earth Sciences (AREA)
• Surgery (AREA)
• Physics & Mathematics (AREA)
• Theoretical Computer Science (AREA)
• General Engineering & Computer Science (AREA)
• General Health & Medical Sciences (AREA)
• Animal Behavior & Ethology (AREA)
• Pathology (AREA)
• Biomedical Technology (AREA)
• Heart & Thoracic Surgery (AREA)
• Medical Informatics (AREA)
• Molecular Biology (AREA)
• Biophysics (AREA)
• Human Computer Interaction (AREA)
• Public Health (AREA)
• Veterinary Medicine (AREA)
• Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
• Optics & Photonics (AREA)
• General Physics & Mathematics (AREA)
• Radiology & Medical Imaging (AREA)
• User Interface Of Digital Computer (AREA)

Applications Claiming Priority (2)

Publications (1)

Family

ID=74732874

Family Applications (1)

Country Status (3)

Family Cites Families (3)

• 2021
  • 2021-02-18 WO PCT/EP2021/053961 patent/WO2021165358A1/en unknown
  • 2021-02-18 CN CN202180015560.2A patent/CN115136110A/zh active Pending
  • 2021-02-18 EP EP21707908.6A patent/EP4107609A1/en active Pending

Also Published As

Similar Documents

Legal Events