WO2005104656A2 - An apparatus for combining data from a stereoscopic digital source with additional digital imaging devices - Google Patents
An apparatus for combining data from a stereoscopic digital source with additional digital imaging devices Download PDFInfo
- Publication number
- WO2005104656A2 WO2005104656A2 PCT/IL2005/000449 IL2005000449W WO2005104656A2 WO 2005104656 A2 WO2005104656 A2 WO 2005104656A2 IL 2005000449 W IL2005000449 W IL 2005000449W WO 2005104656 A2 WO2005104656 A2 WO 2005104656A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- stream
- real
- time
- input stream
- decoded
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
- H04N9/74—Circuits for processing colour signals for obtaining special effects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
- H04N5/445—Receiver circuitry for the reception of television signals according to analogue transmission standards for displaying additional information
- H04N5/45—Picture in picture, e.g. displaying simultaneously another television channel in a region of the screen
Definitions
- the present invention relates to dynamic imaging during an observation and manipulation session in general, and to an apparatus that combines images from a surgery navigation system with images from an electronic imaging system, such as a stereoscopic digital microscope, in particular.
- a navigation system being aware of the area of the manipulated or observed objects to be displayed, and supplying images or streams of images of the relevant area.
- a navigation system typically tracks the location of a predetermined object, such as a wand, the digital microscope, an endoscope, fixed points on the body of the patient or the like, and presents pre-acquired volumetric information depicting the relevant area.
- the relevant area depends on the tracked equipment, be it the part of the objects captured by the digital microscope, which is determined by the location of the microscope and its current zoom and magnification parameters, the area of a marker attached to the object being manipulated upon and the like.
- the user can also be interested in viewing other areas, for example volumetric information depicting the substance underneath the surface exposed to the user.
- the navigation system extracts relevant volumetric information from pre-acquired data, such as MRI or CT scans, 2D images such as US, projection images such as digital X-ray, or the like and presents it on a screen visible to the user.
- the endoscope for another example, presents the real-time viewed image on the same screen as the navigation system or on yet another screen.
- Additional visual information can arrive directly from medical imaging devices such as CT or MRI, or from image archives, or the like and be presented on yet another screen.
- the outcome is that the user has lots of relevant visual information, some of the information is changing in real-time, while other parts are acquired prior to the operation and are therefore constant but the desired views and information vary during the operation. Therefore, the available information is rather distributed.
- the user In order to view, for example, the volumetric data depicting the substance underneath the surface viewed by the user, as retrieved by the navigation system, the user has to do the following: lift his or her head from the optical microscope, or alternatively, remove the head.
- HMD mounted display
- the user should also make sure he or she is not injuring the patient with held tools, most likely by lifting his or her hands and then lowering them back. All in all, looking at a source of information other than the HMD during an operation causes a substantial distraction from the course of the operation, and therefore implies sub-optimal use of these sources.
- the present invention relates to a method and apparatus for combining data from a stereoscopic digital source with additional digital imaging devices, and presenting the combined data.
- One aspect of the present invention regards a method for generating in real-time one or more combination streams and converting in real-time the one or more combination streams for presentation during an observation and manipulation session, said one or more combination streams combining one or more first real-time input stream of images taken by a digital source during an observation and manipulation session with one or more second stream of images, the method comprises the steps of: receiving the first real-time input stream from a digital source; decoding the first realtime input stream to generate a decoded first real-time input stream; digitizing the decoded first real-time input stream to generate a digitized first real-time input stream; receiving the one or more second input streams; decoding the one or more second input streams to generate one or more decoded second input streams; digitizing the one or more decoded second input streams to generate one or more second- digitized input
- the first one or more real-time input streams or the one or more combination streams can comprise stereoscopic images.
- the encoding of the output stream can generate an S-VGA format stream, or an S-Video format stream.
- the one or more first real-time input stream can be in S-Video format.
- the one or more control commands can be in USB format.
- the one or more first real-time input streams are can be in RGB format.
- the one or more second input streams are in S-Video format or in S-VGA format.
- the one or more first real-time input streams can be supplied by a left channel of the digital source or by a right channel of the digital source.
- the method can further comprise the steps of: routing the one or more one or more first input streams and the one or more second input streams to generate one or more output channels according to the one or more control commands; and executing the steps of decoding, digitizing, de-interlacing, combining and encoding separately for each output stream.
- the routing can be performed separately for S-Video signals and for RGB signals.
- the one or more output streams can be presented as the left channel or as a right channel of a main head mounted display or of a rotated head mounted display.
- the one or more output stream can be in S-Video format.
- the one or more output stream can be used for recording.
- the combining step can replace one or more parts of one or more images from the one or more decoded first real-time input streams with one or more parts of one or more images from the one or more decoded second input streams.
- the combining step can replace one or more parts of one or more images from the one or more decoded second input streams with one or more parts of one or more images from the one or more decoded first real-time -input streams.
- the combining step can create one or more combination images, said combination images comprise one or more first images from the one or more decoded first input streams, summed with a one or more second images from the one or more decoded second input streams, where the one or more first images and the one or more second images are presented with a positive degree of transparency.
- the method can further comprise the steps of: rotating the one or more first decoded real-time input streams to generate one or more rotated streams; encoding the one or more rotated streams into S-Video format; routing the one or more rotated streams and the one or more combination streams; and encoding the output of the routing step for generating a one or more main S-Video output stream.
- Another aspect of the disclosed invention relates to an apparatus for generating in real-time one or more combination streams and converting in real- time the one or more combination streams for presentation during an observation and manipulation session, said one or more combination streams combining one or more first real-time input streams of images taken by one or more digital sources during an observation and manipulation session with one or more second streams of images
- the apparatus comprises: a control component for routing the one or more first and the one or more second input streams and the one or more combination streams according to one or more user's commands; a local bus for transferring the one or more commands and data among components of the apparatus; and one or more channel handling components, the one or more channel handling components comprising: a first decoder for generating one or more first decoded input stream; a first analog to digital converter for converting the one or more first decoded input streams; a second decoder for generating one or more second decoded input streams; second analog to digital converter for converting the one or more second decoded input streams; de-interlacer component for de-interlac
- the one or more first real-time input streams or the one or more combination streams can comprise stereoscopic images.
- the one or more digital source can be a digital microscope or an add-on camera on an optical microscope.
- the one or more encoders can generate an S-VGA format stream or an S-Video format stream.
- the one or more first real-time input stream can be in S-Video format or in RGB format.
- the one or more second input stream can be in S-Video format or in S-VGA format.
- the one or more first real-time input stream can be supplied by a left channel or by a right channel of the one or more digital sources.
- the apparatus can further comprise one or more video matrices for routing the one or more first real-time input streams and the one or more second input streams to generate one or more output streams according to the one or more commands.
- the one or more video matrices can be a 16*8 cross point switch, or an RGB 8*8 cross point switch.
- the one or more output streams can be presented as a left channel or a s aright channel of a main head mounted display or of a rotated head mounted display.
- the one or more output streams can be in S- Video format.
- the one or more output streams can be used for recording.
- the combining step can replace one or more parts of one or more images from the one or more decoded first real-time input streams with one or more parts of one or more images from the one or more decoded second input streams.
- the combining step can replace one or more parts of one or more images from the one or more decoded second first real-time input streams with one or more parts of one or more images from the one or more decoded first real-time input streams.
- the combining component can outputs one or more combination images, the one or more combination images comprise one or more first images from the one or more decoded first input streams summed with one or more second images from the one or more decoded second input streams, where the one or more first images and the one or more second images are presented with a positive degree of transparency.
- the apparatus can further comprise: a rotating component for rotating the one or more first decoded real-time input stream to generate one or more-rotated stream;- an encoder for encoding ihe. one. or ore_ rotated stream into S-Video format; a router for routing the one or more rotated stream and the one or more combination stream; and an encoder for encoding the one or more rotated streams and the one or more combination streams for generating one or more main S-Video output stream.
- a rotating component for rotating the one or more first decoded real-time input stream to generate one or more-rotated stream
- an encoder for encoding ihe. one. or ore_ rotated stream into S-Video format
- a router for routing the one or more rotated stream and the one or more combination stream
- an encoder for encoding the one or more rotated streams and the one or more combination streams for generating one or more main S-Video output stream.
- Yet another aspect of the present invention regards an apparatus for capturing and presenting during an observation and manipulation session real-time and off-line visual information
- the apparatus comprises: one or more digital sources supplying one or more real-time streams of images; one or more additional sources supplying one or more streams of images; a video interface unit for generating one or more combination streams by combining in real-time the one or more real-time streams of images with the one or more streams of images supplied by the one or more additional sources; one or more first head mounted display devices; and a system management device for receiving user input and one or more commands and transferring said input and one or more commands to the video interface unit.
- the one or more digital sources can be a digital microscope or an add-on camera on an optical microscope.
- the apparatus can further comprise a display device for displaying streams in S-Video format or a recording device for recording streams in S-Video format.
- the apparatus can further comprise a second head mounted display device for displaying the one or more combination streams as the first head mounted display wherein each image is rotated in a predefined angle.
- the one or more additional sources of stream of images is a navigation and visualization system.
- the one or more additional source can be a CT scanner or an MRU scanner or a picture archive.
- Fig. 1 is a schematic illustration of an exemplary environment in which the proposed invention is used
- Fig. 2 is a schematic illustration of the video interface unit
- Figs. 3 and 4 show a block diagram of the first and the second channel boards.
- the apparatus presents real-time images taken by a digital source, such as a digital microscope or an add-on system added to a conventional microscope or any other source of stereoscopic video images, combined with visual presentations of volumetric data acquired prior to the operation by medical scanners and retrieved by a navigation system or with images retrieved from an archive.
- the presented images are complementary, i.e., depict the same area or related areas. For example, while the digital microscope show the surface exposed to the surgeon, the navigation system can show the substance under the surface, which the surgeon cannot see.
- the apparatus also constructs the updated model of the surface, as was changed by the surgeon removing substance, and retrieves the volumetric information matching the newly created surface.
- Another aspect pf the disclosed invention relates to changing the color-scheme of the presented image.
- the image captured-by the -optical mLcrosc_op.e_.or by digital, microscope is presented with the colors as captured.
- certain types of tumors are better distinguished from their environment if a tumor-type-specific color scheme is used. Once the surgeon recognizes the tumor type, the correct color scheme can be used and applied to the digital image, which will present the tumor in a fashion that will help the surgeon distinguish it form the surrounding tissues.
- Fig. 1 shows an exemplary environment in which the proposed apparatus and associated methods are implemented.
- the core of the system is a Video Interface Unit (VIU) 104.
- Unit 104 manipulates the images arriving from the various sources and sends them to the various presentation devices.
- VIU 104 receives the streams and images from the various sources, processes and combines them, and creates the output streams.
- the input for VIU 104 comes from one or more of the following components: a digital source 108, preferably a the camera module of a digital microscope or two add-on cameras added to a conventional microscope, for example 10 Systems manufactured by Surgivision, which sends the signals in a streaming format, such as S-Video or RGB, along communication line 112.
- the output of digital source 108 comprises a stream of real-time images of the objects captured by the digital microscope.
- the system further comprises real-time imaging tools 124 such as an endoscope, which send their signals in -Video format as well, along communication lime 128.
- Real time imaging tools 124 also supply real-time images of the objects undergoing the observation and manipulation session.
- Navigation or other visualization system 116 such as Treon manufactured by Medtronic sends the images in S-VGA format along communication line 120.
- the images supplied by navigation or visualization system 116 are generally taken prior to or during the session, and are typically a few days to a few seconds old.
- VIU 104 receives control signals and data from system computer 160, being the system management device. Additionally, system computer 160 transfers to VIU 104 image files from off-line imaging tools 133 such as CT or MRI scanners, and additional images from archive 132.
- the data is received by any appropriate protocol, sucb as. for a non-limiting example, a JJSB; format.
- the control signals include, for a non-limiting example, indication of which the sources of images the user would like to use, the way he or she would like to see the pictures of the various sources and other relevant parameters.
- the image files provided by pictures archives, and additional visual information, such as graphic elements related to the images are transferred in the appropriate ormat.
- VIU 104 outputs the images to one or more displays, of one or more types. One or multiple devices of each type can be used simultaneously.
- One type of display is a HMD device 136, for example Callisto manufactured by Surgivision This is the device worn by the head surgeon, displaying the images as captured by the digital microscope, possibly fused or blended with other images.
- HMD device 144 Another type of display is a rotated HMD device 144, possibly worn by another stuff member standing on the opposite side of the person being operated, relatively to the digital microscope.
- Head mounted displays 136 and 144 receive the stream of images in S -Video format.
- a recording/displaying device 152 such as DVD-R manufactured by Philips
- the recording/display device receives the stream in S-VGA format.
- System computer 160 takes input from the user as to which sources of images should be presented, which presentation devices should be used, and in what presentation mode. The user's commands are transferred to VIU 104 in appropriate format..
- VIU 104 receives two sets of streams and images, one from the left (first) channel of each input source and one from the right (second) channel of each input source. For some output devices, VIU 104 also generates two streams. In a non-limiting manner, they are referred to as the left (first) channel and the right (second) channel. It is not necessary that the images of the first output channel are the products of images and streams of the first input channel. Both output streams can contain the same or different visual data from one or more of the input channels. Referring now to Fig. 2, showing the internal structure of VIU 104.
- VIU 104 comprises a panel board 164, a first channel board 168 and a second channel board--l-72.
- Local bus 173. connects the three boards.
- Panel board 164 comprises an interface component such as a USB interface component, receiving the input in the appropriate format.
- the input includes control signals about the preferred settings for the environment, image files from archives and additional information related to the images.
- the images information is not related to a certain side or a certain board, therefore the apparatus comprises a single panel board.
- the first channel board produces the output for the first channel of the output devices and the second channel board produces he output for the second channel of the output devices. Referring now to Figs. 3 and 4, describing the internal structure of the first and second channel boards.
- a line 400 separates the components of the first channel board, which are shown above the line, from the components of the second channel board shown under the line.
- the first and the second channel boards are identical, so that their components are a replica of each other.
- This replication excludes video matrices 208 and 216 detailed below which are common to both channels, and therefore only one instance of each of them is used in the system.
- a Mainl first input 176 to the system is the real-time stream arriving from the first channel of the camera module of the digital microscope.
- Mainl first input 176 is in S-Video format.
- An auxl first input 180 optionally carries another real-time stream in S-Video format.
- this auxl is generated by real-time viewing tool 124 of Fig. 1, such as an endoscope. If the real-time viewing tool is stereoscopic, auxl first input 180 brings in the first stream, while auxl second 280 brings in the second stream, otherwise both auxl first 180 and auxl second 280 bring the same signal.
- An aux2 first input 184 introduces input signals in S-VGA format. This input comes, for example, from navigation or visualization system 112 of Fig.
- the .S-VGA signal undergoes conversion to S- Video format in the VGA to NTSC/Pal converter 200.
- a main2 first input 188 introduces the first channel from a digital microscope or from add-on cameras added to an optical microscope, in the case the digital microscope outputs an RGB signal.
- Mainl first input 176, auxl first input 180 and aux2 first input 184, together with the corresponding second inputs, namely main 1 second input 276, auxl second input 280 and aux2 second 284, together with signal 189 enters a first video matrix 208, which is preferably but not limited to a 16*8 cross point switch.
- First video matrix 208 routes the input channels to the output channels according to the instructions coming from system computer 160 .
- first video matrix 208 receives both the first channel and the second channel inputs, of all the images and stream sources in the apparatus, it can mix them in any way the user sees fit, for example, choose images of streams of the desired sources, and pass all first channel input to first channel output and all second channel input to second channel output. Another example is to pass the first channel input to both outputs, or any other combination. People skilled in the art will appreciate the possibilities of combining multiple sources and two or more sets of inputs.
- Main2 first input 188 and main2 second input 288, carrying signals in RGB format are routed by second video matrix 216, which is preferably but not limited to an RGB 8*8 cross point switch. The RGB signals are routed by second video matrix 216 rather than by first video matrix 208 due to the different formats.
- first video matrix 208 routes the first and the second RGB signals to the first and the second outputs according to the user's instructions, as received through signal 189. All inputs and all outputs of the switches are analog.
- first video matrix 208 outputs two signals.
- the first output is a first S-Video signal 213, containing the data from the digital microscope.
- Signal 213 undergoes NTSC PAL decoding, analog to digital (A/D) conversion, and compression into the YUV 4:2:2 format in the main NTSC/PAL decoder 220 and becomes main first S-Video signal 221.
- the second output of first video matrix 208 is the first s-video2 214, which undergoes NTSC/PAL decoding, A D conversion, and compression into the- YUV 4:2:2 format in the secondary NTSC/PAL decoder 224 and becomes the secondary first YUV 4:2:2 signal 235.
- the output of second video matrix 216 is an RGB first input 215, containing the signal of the alternative digital microscope.
- NTSC/PAL decoders 220 and 224 extract the audio, video and synchronization components of input signals 213 and 214, respectively, and the A/D converter converts the analog audio and video signals to digital.
- Main first RGB signal 234 enters a real-time de-interlacer rotator chip 232, such as Matisse, manufactured by OPLUS, Yokneam, Israel.
- De-interlacer rotator chip 232 converts the signal from interlaced format into progressive (i.e., line after line) format and rotates the image if instructed to do so by the USB signal.
- Chip 232 outputs a rotated first progressive RGB signal 248 at 50 Hz, which is the input to an encoder 264.
- the output of encoder 264 is the rotated S-VGA first signal, directed to the first channel of the rotated HMD.
- De- interlacer and rotator chip 232 outputs also a main first progressive RGB signal 240 at 50 Hz.
- Signal 240 is non-interlaced and non-rotated.
- Signal 240, together with a secondary first YUV 4:2:2 signal 235 are sent to a real-time Picture- in- Picture (PIP) or blending chip 244, such as Rembrandt manufactured by OPLUS, Yokneam, Israel.
- Chip 244 combines signals 240 and 235 according to the instructions transferred by the USB.
- the combination takes one of a number of forms: a PIP presentation, where the images of one signal are presented on a rectangle partial to the images of the other signal.
- Another possibility is the presentation of both streams on the same display real estate, where the images of each stream have a certain degree of transparency, so that both streams are viewed concurrently.
- Persons skilled in the art will appreciate the fact that other presentation modes combining images from both streams- can he. generated, as. well.
- the output of chip 244 is an out first progressive RGB signal 252 at 85 Hz.
- Main first progressive RGB signal 240 and out first progressive signal 252 are input into a switch 256, which routes the input signals to the outputs as instructed by the USB input commands.
- Output 260 that is directed to the display and recording device, needs to be in S-Video format, and therefore is directed into encoder 269 that converts the progressive signal to interlaced signal.
- Output 261 of switch 256 which needs to be directed to the main S-VGA display, is encoded in encoder 268 and directed to the first channel of the main HMD of the apparatus.
- any one of the outputs of the system namely rotated S-VGA first 275, main S-VGA first 277 and main S-video first 279 can be directed to multiple presentation devices, provided the devices can display the relevant format.
- the second channel board is identical to the first channel board. Referring now to the bottom parts of Figs. 3 and 4, describing the second channel board of the VIU.
- the Mainl second input 276 to the system is the real-time stream arriving from the second channel of the camera module of the digital microscope.
- Mainl second input 276 is in S-Video format.
- Auxl second input 180 optionally carries another real-time stream in S- Video format. For a non-limiting example, this input is generated by real-time imaging tool 124 of Fig.
- auxl first input 180 brings in the first stream
- auxl second input 280 brings in the second stream
- both auxl first 180 and auxl second 280 bring the same signal.
- Aux2 second input 184 introduces input signals in S-VGA format. This input comes, for example, from navigation or visualization system 116 of Fig. 1, or from off-line imaging tool 133 of Fig. 1.
- the S-VGA signal undergoes conversion to S-Video format in a VGA to NTSC/Pal converter 300.
- Main2 second input 288 introduces the second channel of the digital microscope, in the case the digital microscope outputs an RGB signal.
- first video matrix 208 and second video matrix 216 route the first and second channels of the multiple sources of images and streams.
- the first output is a second S-Video signal 313, containing the data from the digital microscope.
- Signal 313 undergoes NTSC/PAL decoding, analog to digital (A D) conversion, and compression into the YUV 4:2:2 format in main NTSC/PAL decoder 320 and becomes a main second S-Video signal 321.
- the second output of first video matrix 208 is a second s-video2 314, which undergoes NTSC/PAL decoding, A/D conversion, and compression into the YUV 4:2:2 format in secondary NTSC/PAL decoder 324 and becomes secondary second YUV 4:2:2 signal 335.
- the output of second video matrix 216 is RGB second input 315, containing the signal of the alternative digital microscope.
- NTSC/PAL decoders 320 and 324 extract the audio, video and synchronization components of input signals 313 and 314, respectively, and the A D conversion converts the analog audio and video signals to digital.
- Second RGB input 315 if present, undergoes the A/D conversion in RGB A/D converter 328, which outputs a second RGB signal 333.
- main second RGB signal 334 enters real-time de- interlacer rotator chip 332, such as Matisse, manufactured by OPLUS, Yokneam, Israel.
- De-interlacer rotator chip 332 converts the signal from interlaced format into progressive (i.e., line after line) format and rotates the image if instructed to do so by the USB signal.
- Chip 332 outputs a rotated second progressive RGB signal 348 at 50 Hz, which is the input to encoder 364.
- the output of encoder 364 is the rotated S-VGA second signal, directed to the second channel of the rotated HMD.
- De-interlacer and rotator chip 332 outputs a the main second progressive RGB signal 340 at 50 Hz.
- Signal 340 is non-interlaced and non-rotated.
- Signal 340, together with secondary first YUV 4:2:2 signal 335 are sent to a real-time Picture-in-Picture (PIP) or blending chip 344, such as Rembrandt manufactured by- OPLUS ? Yokneam, -Israel .
- the stream can take the same forms as discussed for the first channel, i.e.
- the output of chip 344 is an out second progressive RGB signal 352 at 85 Hz.
- Main second progressive RGB signal 340 and out second progressive signal 352 are input into a switch 356, which routes the input signals to the outputs as instructed by the USB input commands.
- Output 360 that is directed to the display and recording device needs to be in S-Video format, and therefore is directed into encoder 369 that converts the progressive signal to interlaced signal.
- Output 361 of switch 356 which needs to be directed to the main S-VGA display, is encoded in encoder 368 and directed to the second channel of the main HMD of the apparatus.
- the presented apparatus and method provides real-time display of the view field captured by a digital microscope.
- the available display devices are a stereoscopic HMD device able of presenting S-VGA streams, a stereoscopic rotated HMD device able of presenting S-VGA streams for the benefit of a person viewing the view field from another point of view, a computer or a recording device that supports s-video format.
- the captured stream is presented as is, or combined with images or streams of another source, such as a navigation and visualization system, a medical imaging device such as an MRI or a CT scanner, image archives and the like.
- the combined presentation options include picture- in-picture presentation, blending of images of different sources presented on the same display where each picture can be partially transparent, stereoscopic, non- stereoscopic, or the like.
- the sources of the presented streams and images, the desired displays and display modes are determined by the user, and presented to the system in the appropriate format.
- Persons skilled in the art will appreciate that the present invention can also be used with different formats of streams and images, and additional types of display. It will be appreciated by persons skilled in the art that the present - invention -is— not— limited - to -what-has- been -pa_rticula_dy-_.shown_and_ esjcriJ _ed. hereinabove. Rather the scope of the present invention is defined only by the claims which follow.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Microscoopes, Condenser (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Magnetic Resonance Imaging Apparatus (AREA)
- Processing Or Creating Images (AREA)
- Studio Devices (AREA)
Abstract
Description
Claims
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2007510236A JP2007536953A (en) | 2004-04-30 | 2005-05-01 | Apparatus for combining data from a stereoscopic video source with an additional digital imaging device |
CA002564867A CA2564867A1 (en) | 2004-04-30 | 2005-05-01 | An apparatus for combining data from a stereoscopic digital source with additional digital imaging devices |
AU2005237325A AU2005237325A1 (en) | 2004-04-30 | 2005-05-01 | An apparatus for combining data from a stereoscopic digital source with additional digital imaging devices |
EP05737670A EP1751989A2 (en) | 2004-04-30 | 2005-05-01 | An apparatus for combining data from a stereoscopic digital source with additional digital imaging devices |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US56641504P | 2004-04-30 | 2004-04-30 | |
US60/566,415 | 2004-04-30 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2005104656A2 true WO2005104656A2 (en) | 2005-11-10 |
WO2005104656A3 WO2005104656A3 (en) | 2006-04-27 |
Family
ID=35242094
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IL2005/000449 WO2005104656A2 (en) | 2004-04-30 | 2005-05-01 | An apparatus for combining data from a stereoscopic digital source with additional digital imaging devices |
Country Status (5)
Country | Link |
---|---|
EP (1) | EP1751989A2 (en) |
JP (1) | JP2007536953A (en) |
AU (1) | AU2005237325A1 (en) |
CA (1) | CA2564867A1 (en) |
WO (1) | WO2005104656A2 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2010114843A1 (en) * | 2009-03-31 | 2010-10-07 | Charles Luley Associates, Inc. Dba Cla Medical | Injection of secondary images into microscope viewing fields |
US9083958B2 (en) | 2009-08-06 | 2015-07-14 | Qualcomm Incorporated | Transforming video data in accordance with three dimensional input formats |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102013216409A1 (en) * | 2013-08-19 | 2015-02-19 | Carl Zeiss Microscopy Gmbh | microscope |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5510832A (en) * | 1993-12-01 | 1996-04-23 | Medi-Vision Technologies, Inc. | Synthesized stereoscopic imaging system and method |
US5524194A (en) * | 1990-09-17 | 1996-06-04 | Canon Kabushiki Kaisha | Data communication apparatus |
US6046712A (en) * | 1996-07-23 | 2000-04-04 | Telxon Corporation | Head mounted communication system for providing interactive visual communications with a remote system |
US6456340B1 (en) * | 1998-08-12 | 2002-09-24 | Pixonics, Llc | Apparatus and method for performing image transforms in a digital display system |
US20030156188A1 (en) * | 2002-01-28 | 2003-08-21 | Abrams Thomas Algie | Stereoscopic video |
-
2005
- 2005-05-01 JP JP2007510236A patent/JP2007536953A/en active Pending
- 2005-05-01 AU AU2005237325A patent/AU2005237325A1/en not_active Abandoned
- 2005-05-01 EP EP05737670A patent/EP1751989A2/en not_active Withdrawn
- 2005-05-01 CA CA002564867A patent/CA2564867A1/en not_active Abandoned
- 2005-05-01 WO PCT/IL2005/000449 patent/WO2005104656A2/en not_active Application Discontinuation
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5524194A (en) * | 1990-09-17 | 1996-06-04 | Canon Kabushiki Kaisha | Data communication apparatus |
US5510832A (en) * | 1993-12-01 | 1996-04-23 | Medi-Vision Technologies, Inc. | Synthesized stereoscopic imaging system and method |
US6046712A (en) * | 1996-07-23 | 2000-04-04 | Telxon Corporation | Head mounted communication system for providing interactive visual communications with a remote system |
US6456340B1 (en) * | 1998-08-12 | 2002-09-24 | Pixonics, Llc | Apparatus and method for performing image transforms in a digital display system |
US20030156188A1 (en) * | 2002-01-28 | 2003-08-21 | Abrams Thomas Algie | Stereoscopic video |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2010114843A1 (en) * | 2009-03-31 | 2010-10-07 | Charles Luley Associates, Inc. Dba Cla Medical | Injection of secondary images into microscope viewing fields |
US9083958B2 (en) | 2009-08-06 | 2015-07-14 | Qualcomm Incorporated | Transforming video data in accordance with three dimensional input formats |
Also Published As
Publication number | Publication date |
---|---|
CA2564867A1 (en) | 2005-11-10 |
JP2007536953A (en) | 2007-12-20 |
WO2005104656A3 (en) | 2006-04-27 |
AU2005237325A1 (en) | 2005-11-10 |
EP1751989A2 (en) | 2007-02-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20070146478A1 (en) | Stereoscopic 3D rig calibration and viewing device | |
AU683336B2 (en) | Synthesized stereoscopic imaging system and method | |
US7907166B2 (en) | Stereo telestration for robotic surgery | |
JP4890489B2 (en) | General-purpose camera control unit | |
US20130021438A1 (en) | 3d video processing unit | |
US20100245557A1 (en) | Injection of secondary images into microscope viewing fields | |
WO2012035768A1 (en) | Information display device | |
JPH11155142A (en) | Medical treatment support system | |
US8217981B2 (en) | Configuring videoconferencing systems to create video sessions with realistic presence | |
CN111480332B (en) | Controller and control method | |
EP1751989A2 (en) | An apparatus for combining data from a stereoscopic digital source with additional digital imaging devices | |
US8823877B2 (en) | Video signal processing apparatus and video signal processing method | |
JPH0670040A (en) | Display form changing system for multi-position video conference system | |
JP3483923B2 (en) | Image processing device | |
JP3177022B2 (en) | Video conference equipment | |
EP2085904A2 (en) | Medical support control system | |
JPH07184849A (en) | Image processing display system | |
EP4275645A1 (en) | Improved multimedia dental station | |
Aanestad et al. | From operating theatre to operating studio—visualizing surgery in the age of telemedicine | |
US20090189907A1 (en) | Medical support control system | |
JP2001053947A (en) | Image information transmitting device and system therefor | |
JP3189869B2 (en) | Multipoint video conference system | |
JPH08321992A (en) | Image processing unit | |
JP2012128223A (en) | Image display device | |
JPH0767035A (en) | Moving image synthesizing system for video conference |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A2 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A2 Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2564867 Country of ref document: CA |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2007510236 Country of ref document: JP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWW | Wipo information: withdrawn in national office |
Ref document number: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 4283/CHENP/2006 Country of ref document: IN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2005237325 Country of ref document: AU |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2005737670 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 200580017626.2 Country of ref document: CN |
|
ENP | Entry into the national phase |
Ref document number: 2005237325 Country of ref document: AU Date of ref document: 20050501 Kind code of ref document: A |
|
WWP | Wipo information: published in national office |
Ref document number: 2005237325 Country of ref document: AU |
|
WWP | Wipo information: published in national office |
Ref document number: 2005737670 Country of ref document: EP |
|
WWW | Wipo information: withdrawn in national office |
Ref document number: 2005737670 Country of ref document: EP |