Classifications

• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
  • A61B1/233—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor for the nose, i.e. nasoscopes, e.g. testing of patency of Eustachian tubes
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
  • A61B1/00002—Operational features of endoscopes
  • A61B1/00039—Operational features of endoscopes provided with input arrangements for the user
  • A61B1/0004—Operational features of endoscopes provided with input arrangements for the user for electronic operation
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
  • A61B1/00002—Operational features of endoscopes
  • A61B1/00039—Operational features of endoscopes provided with input arrangements for the user
  • A61B1/00042—Operational features of endoscopes provided with input arrangements for the user for mechanical operation
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
  • A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
  • A61B1/042—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances characterised by a proximal camera, e.g. a CCD camera

Definitions

• This disclosure relates to data processing, and more particularly, to device and methodology for hands-free digital recording video and still image signals.
• the subject matter of the disclosure has applicability, but not limitations to systems for processing information captured during a medical examination.
• the present disclosure offers a novel system for conducting a medical examination including an examination tool having a viewing device for producing video and/or still image signals representing an area being examined, and an examination data processing device controllable by voice commands for storing the captured video and/or still image signals as digital data.
• the system of the present disclosure supports conducting an endoscopic procedure using an endoscope.
• the examination data processing device supports hands-free digital recording of data captured during examination to enable a user to perform the examination without an assistant.
• the examination data processing device enables a user to playback recorded video signals and preview the recorded images.
• the examination data processing device compresses the digital data on the fly, while the video and/or still image signal is being received.
• the examination data processing device is customized for a particular user and a particular use of the examination tool.
• it may operate in response to customized voice commands. Further, it may enable a user to select preferred system parameters including parameters of video and/or still images captured during the medical examination.
• the examination data processing device supports hands-free generation of a text document representing examination results.
• the text document may include images corresponding to captured images of the examined area.
• the examination data processing device may set a size of the images in the text documents in accordance with a size of the text document.
• the examination data processing device may support hands-free annotation of the text document.
• a medical system provides capturing data, such as image data, during a medical procedure.
• the medical system includes a data source, such as a camera, for supplying captured data, and a data processing device having a mechanism for saving the captured data in a memory, and a mechanism for incorporating the captured data into a text document presenting results of the medical procedure.
• the captured data may be temporarily stored in a temporary storage [12]
• the data processing device may enable a user to save the captured data in the memory, incorporate the captured data into the text document, and clear the captured data from the temporary storage using a single action, for example, a single click of a mouse button.
• the captured data may be represented by multiple files identified in accordance with identification information of a patient.
• the data processing device may enable the user to save some of the multiple files in the memory, incorporate some of them into the text document, and clear some of them from the temporary storage using a single action, such as a single click of a mouse button.
• the captured data may be automatically cleared from the temporary storage when a captured data saving procedure is complete. Also, a data supply from the data source may be automatically disconnected from the data processing device when the captured data saving procedure is complete.
• FIG. 1 is a general architecture of a medical media capture system of the present disclosure.
• FIG. 2 is a block diagram illustrating a command control procedure of the present disclosure.
• FIG. 3 is a block diagram illustrating voice command and audio recording mechanisms of the present disclosure.
• FIG. 4 is a block diagram illustrating a video capture mechanism of the present disclosure.
• FIG. 5 is a block diagram illustrating an image capture mechanism of the present disclosure.
• FIG. 6 is a diagram illustrating a graphical user interface (GUI) for customizing the medical media processing system of the present disclosure.
• GUI graphical user interface
• FIG. 7 shows an exemplary configuration setting GUI.
• FIGS. 8-13 illustrate various operations supported by the configuration setting GUI.
• FIG. 14 is a block diagram illustrating a video and image saving procedure of the present disclosure.
• FIG. 15 is a block diagram illustrating a media import procedure for generating a text document of the present disclosure.
• FIG. 16 illustrates an image save dialog window that enables a user to save multiple images captured during a medical procedure.
• FIG. 1 illustrates a general architecture of a medical media capture system 10.
• the system 10 includes a video capture and compressing utility (VCCU) workstation 12 that receives video signals and still images produced by a camera 14 used for examination of a patient.
• the camera may be incorporated in an endoscope that enables an Ear- Nose-Throat (ENT) practitioner to examine the head and neck of a patient.
• ENT Ear- Nose-Throat
• the VCCU workstation is controllable by voice commands to perform hands-free recording and compressing of video and/or still images representing the patient's areas being examined.
• the VCCU workstation 12 includes a processing unit 16 provided for processing video and/or still images supplied from the camera 14 to enable a user to store the video and/or still images in a digital form.
• the workstation 12 may be provided with an S-video input 18 and digital inputs 20, such as USB2 and Firewire connectors, for linking the processing unit 16 to the camera 14.
• a wireless connection may be used for connecting the camera 14 to the workstation 12.
• An internal PCI Analog/Digital Audio/Video card 22 is connected to the S-video input 18 for transforming the analog video and/or still image data produced by the camera 14 into a digital form.
• the CPU 16 includes a programmably controlled compression mechanism that compresses received video and still image data simultaneously with receiving this data from the camera 14. Also, the CPU 16 may include a mechanism for programmably controlling video and image capture size.
• the processing unit 16 supports processing of voice commands and audio signals supplied from microphones 24 and 26 that enable a user to enter voice commands for controlling operations of the workstation 12 and to capture audio signals during examination.
• the microphones may be connected to the workstation 12 via a microphone input 28 and the internal PCI Analog/Digital Audio/Video card 22.
• the microphone 24 may be used for receiving voice commands from a user, such as a doctor or medical assistant, to control operations of the VCCU workstation 12.
• the microphone 26 may be used for recording audio signals associated with a patient being examined.
• a command control software mechanism 30 is provided for controlling operations of the VCCU workstation 12. Via the microphone input 28, the command control mechanism 30 is linked to the microphone 24 responsive to voice commands.
• a USB/PS2 port 32 may be provided for linking the command control mechanism 30 to data input devices 34 such as a keyboard and/or mouse. Wireless connections may be used to connect the microphones and data input devices to the workstation 12.
• the processing unit 16 has a playback mechanism for playing back video and still image signals captured during examination or recorded previously.
• a video card 36 such as an Advanced Technology Attachment (ATA) video card
• the processing unit 16 may be connected to a display interface 38 for supporting connection to a video terminal, such as a VGA display.
• a connection to a second external video terminal 40 may be provided.
• the workstation 12 may be equipped with disk storages 42 and 44 for storing programs and media data captured during examination.
• the disk storage 42 may be utilized for storing an operating system, e.g. Microsoft Windows XP, and various application programs for supporting operations performed by the workstation 12.
• the application programs used by the workstation 12 may include a Speech Application Programming Interface (SAPI) for providing speech recognition, a Direct Show Application for previewing and playing video, a Video Card Application Programming Interface (API) for supporting graphics display in a programmable manner, Microsoft Active X for sharing information among several applications, Direct X that enables higher performance in graphics and sound, Media Player for playing media files, and object linking and embedding (OLE) that allows an editor to transfer a part of a document to another editor and then reimport it.
• SAPI Speech Application Programming Interface
• API Video Card Application Programming Interface
• Microsoft Active X for sharing information among several applications
• Direct X that enables higher performance in graphics and sound
• Media Player for playing media files
• OLE object linking and embedding
• the disk storage 44 may be used for temporarily storing media data captured during the examination.
• An external storage 46 coupled to the workstation 12 via an appropriate interface 48 such as an USB/CDRW interface may be used for local storage of data.
• an appropriate interface 48 such as an USB/CDRW interface
• the workstation Via a local area network (LAN) card 50 and an appropriate database layer 52, the workstation may have access to a network storage 54.
• LAN local area network
• a document generating unit 56 is connected to the processing unit 16 for generating documents that represent results of the examination.
• the document generating unit 56 generates a text document such as a memorandum that may include one or more images representing video and/or still images captured during examination.
• the document generating unit 56 may generate facsimile and/or E-mail documents representing results of an examination. These documents also may include images representing video and/or still images captured during examination.
• email documents may include files containing video, still images and/or audio data captured during the examination.
• the document generating unit may also include a voice dictation mechanism for generating a text document in response to dictation.
• the document generating unit 56 is connected to the LAN card 50 for sending generated documents, such as E-mail or facsimile documents, over a network 58, such as the Internet, to a remote destination.
• a security layer 60 may be provided for supporting secure network communication.
• documents generated by the document generating unit 56 may be transferred to the network storage 54.
• a printer 62 may be connected to the document generating unit 56 for printing out generated documents.
• a USB connector may be used for connecting the printer 62 to the workstation 12.
• the workstation 12 supports hands-free recording and processing of information captured during medical examination to enable a medical practitioner to perform examination without an assistant.
• FIG. 2 illustrates a command control procedure carried out by the command control mechanism 30 to support hands-free operations of the workstation 12.
• the command control procedure provides a user with an option to employ a voice or device control of the workstation 12. If a voice control option is chosen, a voice control mechanism 102 of the workstation 12 is activated. The voice control mechanism 102 activates the microphone 24 to enable the user to issue voice commands for controlling workstation operations.
• the voice communications using the voice control mechanism 102 are supported by the Speech Application Programming Interface (SAPI) that provides speech recognition. If a device control option is chosen, a device control- mechanism 104 may enable the user to utilize mouse 34a and/or keyboard 34b for controlling workstation operations.
• SAPI Speech Application Programming Interface
• the workstation 12 has a voice enable/disable mechanism 106 for enabling or disabling voice commands via the microphone 24 that may be used by a medical practitioner during examination.
• the voice enable/disable mechanism 106 may include a voice-controlled switch for enabling or disabling voice command control.
• a switch for enabling or disabling voice command control may be controlled programmably in response to certain conditions.
• the voice command control may be temporarily disabled during examination to avoid interference with audio recording made via the microphone 26 to record sounds associated with patient's conditions.
• the workstation 12 is provided with an audio recording mechanism 108 for recording voice commands issued via the microphone 24 and audio signals sensed by the microphone 26.
• An enable/disable mechanism 110 is provided for programmably enabl ing or disabling recording of voice commands and audio signals.
• the workstation 12 has an audio compression mechanism 112 for programmably configuring and controlling compression of audio signals being recorded.
• FIG. 4 illustrates capturing video signals during examination.
• the camera 14 supplies the workstation 12 with video signals via an S-video input 18 or digital input 20, such as a USB2 or Firewire connector.
• a camera that produces analog video signals is linked to the S-video input 18, whereas a camera for producing digital video signals is coupled to the digital input 20.
• Audio/Video card 22 connected to the S-video input 18 converts the analog video signal produced by the camera 14 into a digital form.
• the workstation 12 is provided with a video compression mechanism 114 for programmable control of video compression so as to compress video signals on the fly, while they are being supplied from the camera 14.
• a video capture size mechanism 1 16 provides programmable control of video capture size.
• the workstation 12 also supports capture of still images supplied from the camera 14.
• a camera that produces still images in an analog form is linked to the S-video input 18, whereas a camera for producing digital still images is coupled to the digital input 20.
• Audio/Video card 22 connected to the S-video input 18 converts the analog still image signal produced by the camera 14 into a digital form.
• An image compression mechanism 118 is provided in the workstation 12 for programmable control of image compression so as to compress still images on the fly, while they are being supplied from the camera 14.
• An image capture size mechanism 120 provides programmable control of image capture size.
• FIG. 6 illustrates a configuration setting graphical user interface (GUI) 130 displayed on the screen of the video terminal to enable a user to customize operations of the workstation 12 using a configuration setting mechanism 132 for defining configurations of media, voice and memo settings.
• GUI graphical user interface
• the configuration setting mechanism 132 enables multiple users to select their own unique media, voice and memo settings based on their preferences. Also, the configuration setting mechanism 132 supports unique media, voice and memo settings for each of multiple possible uses of the workstation 12. For example, different settings may be selected for different types of medical examinations.
• the configuration setting mechanism 132 provides users with an option 134 to create new settings, an option 136 to delete existing settings, or an option 138 to edit previously created settings.
• the configuration setting GUI 130 includes Source tab 140, Video tab 142, Audio tab 144, Still Image tab 146, Memo tab 148 and Voice tab 150.
• the Source tab 140 supports selection of a source of video signals and still images to be captured. A user is enabled to select desired sizes of video and/or still images, their desired quality.
• the Video tab 142 supports selection of a type of video compression, and various options relating to video compression.
• the Audio tab 144 allows a user to enable or disable recording of audio signals, and to select channels for supplying audio signals and parameters of audio compression.
• the Still Image tab 146 enables a user to set a compression amount for still images, and to manage image save folders for saving captured still images.
• the Memo tab 148 supports settings relating to generating text documents containing results of examination.
• the Voice tab 150 allows a user to enable or disable voice commands, and supports selective configuration of microphones and speech recognition procedures.
• a user is enabled to customize voice command settings using a voice command loading mechanism 152 and a voice command saving mechanism 154. These mechanisms support loading and saving of a unique set of voice commands for a particular user and for a particular use of the workstation 12.
• the voice commands may include commands relating to video and/or still image recording and storing, such as "Start Video Recording", “Stop Video Recording”, “Save Recorded Video”, “Snapshot”, “Image Save”, etc.
• the voice commands may include commands for controlling system operations, such as "Reset”, “Turn On Voice Command", Turn Off Voice Command", etc.
• the configuration setting GUI 130 involves a setting lock mechanism 154 to prevent a selected configuration from being accidentally modified, and a sequence lock mechanism 156 to lock settings relating to a sequence of captured images.
• FIG. 7 shows an exemplary configuration setting GUI 130 that enables a user to customize operations of the workstation 12.
• the user may select a source of video signals and still images, and various parameters relating to the source.
• the user may select a desired number of frames per second using a combo box 182, and a desired video size using a combo box 184.
• different medical procedures could mandate using different cameras.
• a video source selection button 186 enables the user to choose a proper camera for a particular procedure among multiple cameras that may be attached to the workstation 12 (block 188). For example, a still image camera may be attached for performing some of the medical procedures, and a video camera may be attached for performing other procedures.
• a video format selection button 190 enables the user to select a data format and compression parameters (block 192).
• the user may set a capture quality to select a required compression ratio for compressing a captured video or image signal.
• a slider 194 may be used for setting the capture quality.
• a text box 196 may provide the user with ability to enter a desired numerical value of the compression ratio.
• a format selection combo box 198 enables the user to select a desired format.
• the video format selection button 190 may allow the user to set capture dimensions (block 200).
• a combo box 202 enables the user to choose a capture size among a number of predefined sizes. Alternatively, the user may customize a capture size using a custom size text box 204.
• a text box 210 may present a default temporary video folder path for temporarily storing captured video data
• a text box 212 may present a default video folder path to identify a folder for storing saved video data.
• the user may select any folders for temporarily storing captured video data and for storing saved video data.
• Temporarily stored video may also be used as a system flag to enable playback, and video save controls, as well as a prompt warning for record video command to save unsaved video before recording/replacing unsaved video.
• a video compression combo box 214 enables the user to select a type of compression to be used for compressing video data to be saved in a compressed form.
• a button 218 and a dialog box 220 may be used for setting particular compression parameters.
• the user may enable or disable capturing audio signals. For example, a check box 222 may be checked to enable audio recording.
• a combo box 224 allows the user to select a type of audio compression among multiple available audio compression types.
• a bits combo box 226 enables the user to select various bit lengths for audio files, for example, 8, 16 or 24 bits.
• An audio frequency combo box 228 may be used to select a desired audio frequency, and an audio channel combo box 230 may enable the user to record audio data in a stereo or mono format.
• an image folder path text box 232 presents a default folder for saving a captured still image and allows the user to select any folder for storing the still image.
• An image quality slider 234 enables the user to set a compression amount for still images.
• a memo directory path text box 236 presents a default directory for storing a memo, and allows the user to change this directory.
• a memo template path text box 238 enables the user to select a memo template to be used when a memo is created.
• a check box 240 may be checked to enable voice commands and unchecked to disable voice commands.
• a disable voice command button 242 may be used to disable or enable specific voice commands (block 244). For examples, voice commands to be disabled or enabled may be presented in a list 246.
• a configure microphone button 248 allows the user to select a desired microphone configuration (block 250), and a train microphone button 252 may be used to select parameters relating to training a microphone for providing speech recognition (block 254).
• a load commands button 256 may be used to load a desired set of voice commands into an internal storage 258 of the workstation 12 (block 260).
• a unique set of voice commands may be created for a particular user and/or a particular medical procedure and loaded into the workstation 12.
• a save commands button 262 may be activated to save a customized set of voice commands selected using the configuration setting GUI 130.
• the workstation 12 may produce a document containing a list of loaded or saved voice commands and their status (block 266).
• FIG. 14 illustrates a mechanism for saving video and image information captured during examination.
• the workstation 12 may access a patient file relating to a patient undergoing examination (block 280).
• the file may be identified by a patient's name.
• the workstation 12 captures a video signal relating to that patient (block 282)
• the captured video is temporarily stored as a video file in the storage 44 (block 284) with the respective patient file name appended to the video file.
• the workstation 12 captures still images relating to the patient, they are temporarily stored as image files (block 286) with the respective patient file name appended to each image file.
• the processing unit 16 supports playback of the temporary stored video file (block 288) and/or preview of the temporary stored image files (block 290).
• a user is enabled to select whether to save the video file and/or the image files, or to delete them (block 292). Also, the workstation 12 allows the user to transfer captured images to the document generating unit 56 for preparing a text document or memo including the captured images. [60] If the user selects saving the video file and/or the image files, the files may be selectively renamed and/or annotated (block 294) before activating a saving procedure (block 296). Alternatively, a clearing procedure may be activated to delete the temporary stored files.
• FIG. 15 illustrates a media import procedure carried out to incorporate image data into a text document that may be produced based on results of medical examination.
• a user is enabled to transfer captured images into the document generating unit 56 for including the images in a text document.
• the video/image saving mechanism involves programmable launch of a text editor such as Microsoft Word, and loading a text document template having a predefined format (block 302).
• the text document may be a memo for presenting results of a medical examination.
• the template may be resaved under a new name, which may include a patient's name and a date of examination. Also, the patient's name and the date of examination may be incorporated into the memo.
• OLE object linking and embedding
• a user may modify the memo (block 306). Then, the user may save the document under a selected name in a selected directory (block 308). Temporarily stored image files corresponding to the images transferred into the text document may be programmably deleted (block 310). Simultaneously, the image files may be saved in the storage 44.
• FIG. 16 illustrates an image save dialog window 320 that enables a user to save multiple still images captured during a medical procedure.
• Each captured image is temporarily stored in the workstation as an image file that may be identified by default by a file name including a patient's identification information and a date of capturing the image.
• the user may select a save image command that initiates the image save dialog window 320 on the screen of the video terminal.
• the image save dialog window 320 contains a list of image files corresponding to the captured still images. Each image file may be renamed in a desired manner.
• the image save dialog window 320 allows the user to preview each captured image and save it on the disk and/or in the database.
• the image may be incorporated into a memo representing results of the respective medical procedure.
• the image files may be arranged in a table having columns corresponding to the database (D-Base), memo and disk.
• a separate column may be provided for clearing captured images temporarily stored in the workstation memory.
• a user can check one or more boxes in respective columns to define a manner in which the corresponding image file should be saved.
• FIG. 16 shows two image files in the dialog window 320 corresponding to two images captured during a medical procedure.
• the first image file is marked to request incorporating the respective image in the memo and saving the image file on the disk.
• the second image file shown in the dialog window 320 is marked for saving on the disk and clearing from the temporary storage.
• the image saved on the disk or incorporated in the memo may be automatically cleared from the temporary storage even if the clear box is not checked.
• a save button on the dialog window 320 a user may save the first and second images on the disk, incorporate the first image into the memo and clear the second image from the temporary storage.
• a single user's action for example, a single click of a mouse button enables a user to perform different saving operations with multiple captured images.
• each image by default is identified by patient's identification information, for example, by a patient's name. As a result, all images relating to a particular patient are identified with information identifying that patient. To prevent captured images from being associated with wrong patients, unsaved images temporarily stored in the workstation memory may be automatically deleted when an image saving procedure is completed.
• a video feed from a video source to the workstation 12 may be automatically disconnected.
• a user may be requested to enter a patient's name.
• the user is prevented from using a wrong patient's name or a wrong media source for a particular medical procedure.

Landscapes

• Health & Medical Sciences (AREA)
• Life Sciences & Earth Sciences (AREA)
• Surgery (AREA)
• Engineering & Computer Science (AREA)
• Heart & Thoracic Surgery (AREA)
• Medical Informatics (AREA)
• Optics & Photonics (AREA)
• Pathology (AREA)
• Radiology & Medical Imaging (AREA)
• Biophysics (AREA)
• Physics & Mathematics (AREA)
• Biomedical Technology (AREA)
• Veterinary Medicine (AREA)
• Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
• Molecular Biology (AREA)
• Animal Behavior & Ethology (AREA)
• General Health & Medical Sciences (AREA)
• Public Health (AREA)
• Otolaryngology (AREA)
• Mechanical Engineering (AREA)
• Medical Treatment And Welfare Office Work (AREA)
• Measuring And Recording Apparatus For Diagnosis (AREA)
• Closed-Circuit Television Systems (AREA)
• Apparatus For Radiation Diagnosis (AREA)

Applications Claiming Priority (2)

Publications (1)

Family

ID=35825315

Family Applications (1)

Country Status (5)

Families Citing this family (5)

Family Cites Families (4)

• 2005
  • 2005-11-14 WO PCT/US2005/041071 patent/WO2006057839A1/en active Application Filing
  • 2005-11-14 CA CA002588209A patent/CA2588209A1/en not_active Abandoned
  • 2005-11-14 EP EP05825738A patent/EP1830693A1/de not_active Withdrawn
  • 2005-11-14 BR BRPI0518293-0A patent/BRPI0518293A2/pt not_active IP Right Cessation
  • 2005-11-17 TW TW094140457A patent/TW200622805A/zh unknown

Non-Patent Citations (1)

Also Published As

Similar Documents

Legal Events