CN101073097A - Multiple volume exploration system and method - Google Patents
Multiple volume exploration system and method Download PDFInfo
- Publication number
- CN101073097A CN101073097A CNA2005800114177A CN200580011417A CN101073097A CN 101073097 A CN101073097 A CN 101073097A CN A2005800114177 A CNA2005800114177 A CN A2005800114177A CN 200580011417 A CN200580011417 A CN 200580011417A CN 101073097 A CN101073097 A CN 101073097A
- Authority
- CN
- China
- Prior art keywords
- volume
- button
- control panel
- plane
- weight coefficient
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 64
- 230000000007 visual effect Effects 0.000 claims description 44
- 230000007246 mechanism Effects 0.000 claims description 33
- 230000004927 fusion Effects 0.000 claims description 32
- 230000014509 gene expression Effects 0.000 claims description 20
- 238000012545 processing Methods 0.000 claims description 13
- 230000008569 process Effects 0.000 claims description 10
- 238000005520 cutting process Methods 0.000 claims description 7
- 239000003086 colorant Substances 0.000 claims description 3
- 238000003825 pressing Methods 0.000 claims description 2
- 230000002596 correlated effect Effects 0.000 claims 2
- 230000000875 corresponding effect Effects 0.000 claims 2
- 238000005314 correlation function Methods 0.000 claims 1
- 230000008859 change Effects 0.000 description 13
- 230000001427 coherent effect Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 238000013519 translation Methods 0.000 description 4
- 230000004913 activation Effects 0.000 description 3
- 239000000203 mixture Substances 0.000 description 3
- 230000009466 transformation Effects 0.000 description 3
- 230000015572 biosynthetic process Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000003745 diagnosis Methods 0.000 description 2
- 239000012634 fragment Substances 0.000 description 2
- 230000010354 integration Effects 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 239000012190 activator Substances 0.000 description 1
- 230000003321 amplification Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000013079 data visualisation Methods 0.000 description 1
- 238000000280 densification Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000002059 diagnostic imaging Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 208000019423 liver disease Diseases 0.000 description 1
- 230000005976 liver dysfunction Effects 0.000 description 1
- 229940074869 marquis Drugs 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- VBUNOIXRZNJNAD-UHFFFAOYSA-N ponazuril Chemical compound CC1=CC(N2C(N(C)C(=O)NC2=O)=O)=CC=C1OC1=CC=C(S(=O)(=O)C(F)(F)F)C=C1 VBUNOIXRZNJNAD-UHFFFAOYSA-N 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000002271 resection Methods 0.000 description 1
- 238000005096 rolling process Methods 0.000 description 1
- 238000000638 solvent extraction Methods 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
- G06T2219/008—Cut plane or projection plane definition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
- G06T2219/20—Indexing scheme for editing of 3D models
- G06T2219/2016—Rotation, translation, scaling
Abstract
Method and system for multiple volume exploration is disclosed. A first 3D volume is rendered in a first region. One or representations are displayed in a second region, where each representation signifies a stack of 2D images. A first stack represents one or more 2D images of cross sections of a certain orientation from the first 3D volume. Each of the other stacks includes one or more 2D images of cross sections of the same orientation from a 3D volume related to the first 3D volume.
Description
[0001] to require the applying date be the right of priority of the temporary patent application number 60/562,262 on April 15th, 2004 in the present invention, and the content of this application form in full is incorporated into this paper.
Background technology
1. technical field
[0002] the present invention relates generally to the system and method that data detect and adopts system of the present invention.Specifically, the present invention relates to manifest and detect the method and system of 3D or 4D volume data and adopt system of the present invention.
2. description of Related Art
[0003] three-dimensional (3D) imaging data obtains with sliced form usually.Can check the 3D organization space of these sections with dimly visible densification.For example, in medical imaging, the user can observe the xsect of object by checking corresponding image slice.In addition, heterogeneous volume scan and/or sequential volume have become in research structure dynamics and have become more and more popular.The availability of mass data makes relevant litigant be difficult to like this, if not impossible, makes full use of these information.By checking that independent 2D section needs technical skill usually from the data extract useful information the higher dimensional space more.Developed the auxiliary instrument of 3D or 4D data of detecting already.Be significantly improved although modern volume presents technology, do not have instrument to provide directly perceived and the mode of being easy to helps user's detection 3D/4D data by the effective section in navigation 3D or 4D space.
[0004] medical science is 3D or the normally used field of high dimensional data more.Some modern medicine software packages can provide a plurality of forms and allow the user to cut into slices from arbitrarily angled observation for the 2D image.Other more advanced systems support the 3D form, can present the 3D object.But the user can only watch the 3D data and can not edit described 3D data at this 3D window.In addition, these systems do not provide the 2D section of demonstration and the mutual relationship between the 3D data.As a result, the user often need be switched between 3D object and 2D view back and forth, not only hinders user's notice, also causes the interruption of following flow process.In addition, when having many volumes, use traditional instrument to detect 4D data difficulty more in directly perceived and coherent mode.In addition, at medical domain, it is very important that fusion is included in the information in many volumes so that detect any unusual marquis sometimes.For example, the image of liver's dysfunction or the frequent time to time change of gray scale figure in the volume.In order to obtain correct diagnosis, it is vital can observing with related this grey scale change at different volumes.Fusion also is important from the evidence that the information of different volumes obtains to integrate to assist the diagnosis decision-making.Unfortunately, traditional system does not provide the instrument that the user is done like this.
Description of drawings
[0005] this paper invention claimed and/or that describe is further described by exemplary embodiment.These exemplary embodiments are described in detail in conjunction with the accompanying drawings.The determinate exemplary embodiment of these embodiment right and wrong, wherein identical Reference numeral is represented similar structures in a plurality of views of institute's drawings attached, wherein:
[0006] Fig. 1 has described according to one embodiment of present invention, the illustrative diagram of hierarchical layout expansion;
[0007] Fig. 2 illustrates according to one embodiment of present invention, has the exemplary 3d space on the plane that can be set to different observing patterns;
[0008] Fig. 3 illustrates according to one embodiment of present invention, with the relevant exemplary 3D control panel in 3D plane in the 3d space;
[0009] Fig. 4 illustrates according to one embodiment of present invention, has the view of the exemplary 3D control panel of a plurality of buttons distributions;
[0010] Fig. 5 illustrates according to one embodiment of present invention, the composition of exemplary visual fusion control widget;
[0011] Fig. 6 illustrates according to one embodiment of present invention, and the exemplary of visual fusion control widget presents;
[0012] Fig. 7 illustrates according to one embodiment of present invention, has a plurality of visual fusion control widget of weight allocation being given corresponding a plurality of data sets;
[0013] Fig. 8 illustrates exemplary 3D visual fusion control widget according to an embodiment of the invention;
[0014] Fig. 9 is the process flow diagram of exemplary process according to an embodiment of the invention, and wherein the 3D volume is manifested with coherent fashion by the 3D control panel and handles.
[0015] Figure 10 has described according to one embodiment of present invention, is convenient to the example system formation that the 3D volume manifests and handles by the 3D control panel.
Embodiment
[0016] the present invention relates to the method and system of 3D volume exploration.This paper has disclosed the method and system of multiple volume exploration (MVE), and coordination 3D data can be manifested and handle.Described graphic user interface, the hierarchical layout expansion ability is provided, had visual data arrangement, allowed the user to check a plurality of 3D volumes and corresponding 2D cross-section data in dynamic and coherent mode.Control data manifests and the 3D control panel handled directly embeds 3d space, and wherein the 3D data are visual.Information from a plurality of data sets can merge in the image mode by a plurality of visual fusion control widget.
[0017] Fig. 1 has described according to one embodiment of present invention, the illustrative diagram of hierarchical layout expansion.In this illustrative diagram, show four kinds of different expansion layout structures.2D viewing area 101 shows a kind of expansion structure.In this structure, the 3D volume 105 presents in the viewing area.In the viewing area 106 that separates, shown one or more icon representations, 106-a, 106-b ... 106-c.Each icon representation represents a 2D cross sectional images stacked.Cross section 2D image is meant the image that obtains from 3D volume cross section in specific 3D position with certain viewing angles.Be presented on 105 3D volume and may have other relevant corresponding 3D volumes, as time series or the 3D data that obtain in out of phase.Observe the cross sectional images that obtains each stacked comprising from one of these a plurality of 3D volumes with certain viewing angles.For example, stacked all horizontal sections that can comprise the 3D volume.The different stacked corresponding 2D horizontal sections that can comprise from other relevant 3D volume.The user can specify concrete visual angle, and it is stacked to be used for forming these 2D in viewing area 105, and described viewing area 105 presents a 3D volume in the body sequence.How to specify concrete visual angle to discuss below about the user in conjunction with Fig. 2.
[0018] Fig. 2 shows according to one embodiment of present invention, has the exemplary 3d space 201 on certain orientation plane that can be set to different observing patterns, so that manifest part 3D data.In exemplary 3d space 201, can there be one or more planes (each is with certain orientation), be used to cut the 3D volume, to obtain the 2D view in cross section.The quantity on plane can be decided as required, and each plane can be placed by any direction.In the embodiment shown, show three orthogonal plane 201-a, 201-b and 201-c.3d space 201 was cut from certain visual angle in each described 3D plane.For example, plane 201-a horizontal resection 3d space 201.Plane 201-b is with certain depth cutting 3d space 201.Plane 201-c is cut into left and right sides two parts with 3d space 201.
[0019] in certain embodiments, can provide the user to control the instrument of each plane placement location in 3d space 201.Can also provide the user to move the instrument on all three planes simultaneously.For example, the user can click the ad-hoc location on the 2D cross sectional images, so that three orthogonal plane automatic shifts are to the position as its new initial point.Can on the cross sectional view on one of plane or on the 2D cross sectional images in the folded 2D image, click.When having an above plane, the user can also select the focal plane by clicking required plane.This user can also move or rotate this plane to form required visual angle.
[0020] can also provide instrument, so that the user can set expression mode for the plane.In one embodiment, described expression mode can comprise opaque pattern, transparent mode and stealthy pattern.As shown in Figure 2, all three planes at 3d space 201 are opaque patterns.In another exemplary 3d space 202 of Fig. 2, plane 202-a is an opaque pattern, and plane 202-b is a transparent mode, and plane 202-c is stealthy pattern.When the plane was in opaque pattern, the cross section (for example, 205) that is produced by the section can gray scale intensities manifest.When the plane is in transparent mode (for example, plane 202-b), as seen it can allow transparent, produces transparent image.This transparent view can adopt a kind of tone or texture to realize, plane 202-b as shown in Figure 2.When the plane was in stealthy pattern, it was visible then not having image.
[0021] expression mode on plane can be set and change as required.In certain embodiments, each plane can be relevant with natural mode setting or transformation mechanism.In this case, the user can click this plane, and each click can represent a kind of different pattern, thereby when clicking required mode and be provided with, required pattern just can be set.Described natural mode transformation mechanism can also embed in the zone that shows 3D volume cross section.In this case, the user can click this zone Anywhere with pattern conversion, and when acting on cross section on the baseplane, transform effect is immediately as seen.This natural mode transformation mechanism also can embed the 3D control panel (as hereinafter described in) relevant with described baseplane.
[0022] different planes can independently be set at different patterns, so that suitable observed data.For example, when a plane is in opaque view and another plane when being in transparent mode, be positioned at that the partial image on the opaque plane is visible after the transparent flat.When opaque plane when 3d space moves, it cut the 3D volume from different perspectives, generated different cross sections.By suitably placing the plane and setting its pattern, the user can observe the different cross section of 3D volume neatly.
[0023] is included in when cross sectional images in stacked moves in the section and changes.In certain embodiments, the corresponding 3D volume that presents is the cross section that is generated by the section at stacked uppermost 2D image.Other stacked the top image from the 3D volume relevant with presenting 3D volume is to generate the cross sectional images that the cross section is in same position with the section.
[0024] in the structure shown in the viewing area 101, the data that are apparent in zone 105 and zone 106 are to be mutually related.When changing for one (for example, cut at diverse location on the plane in the zone 105), other (for example, stacked from the cross sectional images of different volumes) correspondingly change.When the volume in the sequence is counted more than 106 subregion, can be in the viewing area 101 provide scroll mechanism, so that as seen all volumes is stacked.
[0025] viewing area in Fig. 1 102 shows different exemplary hierarchy layout expansion structures, and wherein selected image in stacked can be in the viewing area 107 expands to full view.Viewing area 107 can with other viewing area, for example viewing area 105 and viewing area 106 are overlapping.Selected 2D image in stacked may be displayed on the different subregions in zone 107, for example, 107-a, 107-b ..., 107-c.It is in proper order passable to select manifesting of stacked 2D cross sectional images, for example comes in proper order to determine according to the cross section of basic 3D volume.The big I that manifests each subregion in single cross section is determined according to different standards.For example, can determine according to the number of cross sections that is included in the basic volume.Also can determine according to other standard.For example, comprise the subregion size of selecting stacked expression and can be used as default size.When the group number of regions is counted less than the laminated section of given particular sub-area size, can provide user's rolling (for example, direction from left to right) instrument that allows through all 2D images.
[0026] in certain embodiments, when selected 2D image in stacked is apparent in zone 107 with other viewing area overlapping areas, can allow the user between different appearance mode, to circulate.For example, when the overlapping 3D of the presenting volume of the subregion that manifests the 2D cross sectional images (zone 102) as shown regional, can provide the instrument that allows the user to switch front elevation and rear view back and forth at arbitrary data set (3D volume or cross sectional images).
[0027] viewing area among Fig. 1 103 shows according to one embodiment of present invention, another example hierarchical layout expansion structure.In this exemplary configurations, viewing area 105 is used to manifest from selected stacked a plurality of 2D cross sectional images, and the 3D volume is presented in the sub regions (for example, subregion 106-a) of viewing area 106 with shrink form.In this exemplary configurations, shown four selected cross sectional images, occupied four quadrants of viewing area 105.Also can adopt or choose other configuration according to user's selection.For example, can manifest 16 cross sectional images in same viewing area simultaneously.Similarly, can provide the instrument that allows the user to roll, so that observe different cross section.This scroll mechanism can allow scroll-up/down, about roll or its combination.A kind of special situation is that single cross sectional images is apparent in the whole viewing area 105, as shown in the viewing area 104 of Fig. 1.Can provide and allow the user to select a cross section to be presented at the instrument of viewing area 105 in the mode of full view.
[0028] other structure also can realize the 4D of this coordination, the manifesting and handle of 3D and 2D data.The user can pass through, and for example the control (not shown) on some screens switches between different expansion structures.According to visualization scheme as herein described, the user can be at 4D space navigation browsing data, directly at the 3D view rather than in the inside of the 2D space observation 3D volume that separates, and checks the coordination interior section of other 3D volumes.Spatial relationship between the different pieces of information is embedded in the image demonstration, makes the user can detect high dimensional data effectively, and need not rebuild the 3D view in brain.
[0029] data visualization scheme described herein is that 3D object (being different from the 3D volume) provides similar support.Partitioning algorithm often produces the 3D binary object, or pays close attention to volume (VOI).When this 3D binary object/VOI manifests with three orthogonal planes, the cross section profile of binary 3D object/VOI can the section with manifest during relevant 2D cross sectional images is stacked.
[0030] for further facilitating data processing, provide 3D control panel, the user can be by it directly in 3d space the manifesting and handle of control data voluntarily.In certain embodiments, 3D presents each section in 105, zone and can have embedded 3D control panel.Fig. 3 illustrates according to one embodiment of present invention, the exemplary 3D control panel 310 in 3d space 300.In this exemplary configuration, show three planes 301,302,303 of cutting 3d space 300.Show the 3D control panel 310 that embeds plane 301.
[0031] in certain embodiments, described 3D control panel 310 can be presented on around the planar boundary.This 3D control panel 310 can be a three-dimensional body, and its shape can change as required when it embeds the plane.For example, when the plane had four limits, the global shape of the 3D control panel of embedding also can have four limits.If the plane has circular boundary, then the global shape of this 3D control panel can be circular.The different piece of 3D control panel 310 can have different shapes.For example, when the global shape of 3D control panel was rectangle, different limits can have different shapes: one side of this 3D control panel can be rendered as the 3D cylinder with round section, and other is the rectangular tube with square-section.When 3D presents the zone and has more than a 3D control panel in 105 (embedding Different Plane), each can be by color and/or texture coding.Each control panel can embed the plane by this way, so that this panel from any viewing angle all as seen.
[0032] in certain embodiments, described 3D control panel 310 can move in the 3d space that it is presented.This moving comprises translation, rotation, convergent-divergent, or its combination in any.This 3D control panel 310 can be independent of its plane that centers on and move.In addition, this 3D control panel 310 can also such mode embed, so that together move on the plane that this 3D control panel centers on it (for example, the plane among Fig. 3 301).Can provide and allow the user to move the instrument on the plane that has embedded 3D control panel by the mobile 3 D control panel.In addition, can come the mobile 3 D control panel by moving the embedding plane.
[0033] for utilizing 3D control panel 310 to carry out data processing and control, in the 3D control panel/on one or more button/switch can be arranged.Fig. 4 shows according to one embodiment of present invention, and various control knobs are distributed in the exemplary configuration on the 3D control panel 310.This exemplary configuration comprises volume switching push button 404, volume Play Control button 405, convergent-divergent/proportional control button 406, visual fusion control widget activator button 408 and volume lock/unlock button 409.Described volume switching push button 404 makes the user can select in a plurality of 3D volumes one to manifest presenting in the zone (for example, the viewing area 105).The volume amount of these number of buttons in can corresponding specific 3D sequence.For example, if three volumes are arranged, can provide three volume switching push buttons in sequence, the corresponding volume of each button provides selection tool to select to allow the user.The volume switching push button can be realized by this way, makes click can finish selected relevant 3D volume.In addition, all volumes can be with single volume switching push button.Click this single volume switching push button and can activate another choice mechanism, for example eject (all volumes) selective listing, allow the user from this selective listing, to make one's options.
[0034] volume Play Control button 405 is used for controlling how to play volume.This class button may be similar with the Play Control button of VCR player.For example, volume Play Control button can be a broadcast button, forwarding button, fast forward button, fast backward button, or stop button.The instrument of CONTROL VOLUME broadcasting speed also is provided in certain embodiments.In addition, also can provide the user manually to browse the instrument of the parallel cut of 3D volume.This volume Play Control button helps the user with flexible way observed data as required.
[0035] having one or more convergent-divergent control knobs 406 is distributed in around the 3D control panel 310.Has the more convenient user of button such more than the most close, for example the position control convergent-divergent of mouse.When a plurality of zoom button, each can designatedly be used for specific viewing area.For example, zoom button can be used for convergent-divergent and is presented on 3D and presents zone () data for example, 105, and another zoom button can designatedly be used for specific stacked cross sectional images.Also can optimize the layout of zoom button, so that the zoom button of each appointment approaches its effective coverage most.
[0036] exemplary configurations of the 3D control panel 310 shown in having had, the user can click panel zone 407, so that the plane below moving.When moved on the plane, it cut the different cross section of 3D volume, and the motion in each cross section in the plane as seen.Like this, by the simple drag operation on the 3D control panel, the user can intuitively check all cross sections perpendicular to the 3D volume of in-plane.When the 3D control panel that embeds other plane was carried out similar operations, the user can check the cross section of 3D volume from different visual angles.
[0037] whether volume lock/unlock button 409 can be used for control and 3D volume and basic plane is locked to each other.This volume lock/unlock button 409 can be used as binary element, has two kinds of states that replace: lock-out state 411 and released state 412.When volume lock/unlock button is in the lock state 411, be presented on 3D volume and the locking of basic plane in the viewing area 105.Lock-out state 411 times, always move simultaneously on 3D volume and plane.For example, under lock-out state, if the user drags basic plane, the 3D volume is dragged therewith.Like this, the relative position on 3D volume and plane does not change before moving and after moving, and therefore the 2D cross sectional images in all are stacked remains unchanged.
[0038] released state 412 times, 3D volume and basic plane can move independently from one another.When appearance was independently mobile, the relative position on 3D volume and plane changed, thereby the cross section that manifests in the plane also can change.In certain embodiments, the cross section of plane cutting can be upgraded rapidly when any one moves.In other embodiments, the cross section on the plane (for example, is not weighed by moving in specific a period of time) after motion is finished and just can be upgraded.The cross section on the plane, when moved on 3D volume or plane, the 2D cross sectional images during each is stacked also can change.In certain embodiments, the 2D cross sectional images in stacked is just upgraded rapidly when old motion still.In other embodiments, the 2D cross sectional images in stacked just is updated after motion is finished.
[0039] described locking/unlocking state can influence by, for example other on the 3D control panel are pressed the operation of button activation.For example, it may influence zoom operations.Lock-out state 411 times, the 3D volume is entangled in plane or 3D chain of command sheet frame.In this case, may be to amplify whole frame for the amplifieroperation effect of part 3D volume, comprise 3D volume and plane/3D control panel.In other words, under lock-out state, the user can simply drag the border of 3D control panel, so that produce amplification effect on the 3D volume.This is with under released state the same section of 3D volume to be carried out the effect of same operation different, and under released state, although the 3D volume partly is exaggerated, plane/3D chain of command sheet frame still remains unchanged.Rotation or translation motion for the 3D volume also are similar relations.If 3D volume and 3D chain of command sheet frame lock together, when its rotation/translation, whole frame also can rotate/translation.
[0040] state of lock/unlock button also limited the user by its embedded 3D control panel (by dragging 407) plane of motion to browse or to watch the ability of the different cross section that produces by plane of movement.This ability only on 3D volume and plane/just possible when the 3D control panel can move independently from one another.In other words, the 3D control panel is set in released state.
[0041] button 408 of the one or more visual fusion control widget of available activation makes things convenient for the user to control how will to merge from the information of different pieces of information collection or integrate.The information of integrating can comprise data itself or its feature.In some situations, integration can be used for different volumes.In other situation, integrate the different cross section that can be used for from equal volume or different volumes.When button 408 was activated, one or more visual fusion control widget can be in position, and for example, 105 show in the viewing area.This appropriate location can be scheduled to, or can adjust definite when enough demonstrations place presents visual widget.
[0042] available visual fusion control widget assigns weight to data or its feature of each data centralization that will integrate.Integration can adopt the form of weighted sum of multidata collection to obtain fusion information.All weights of distributing to integrated data sets add up to one or certain value.Fig. 5 illustrates according to one embodiment of present invention, the composition of exemplary visual fusion control widget.The composition of described exemplary visual fusion control widget comprises weight coefficient controller 500, and it comprises bar section 501, handle 502 and slide bar 503.The weighted value that bar section 501 expression of described weight coefficient controller 500 and handle 502 are relevant.Slide bar 503 has two ends, and the lower limit of the corresponding weighted value of 504 and 505, one ends is for example zero, and one or certain value of the heavy summation of the other end corresponding expression entitlement.Can arrange an above weight coefficient controller along slide bar 503, each has the corresponding different weights value of bar section of oneself.
[0043] Fig. 6 illustrates according to one embodiment of present invention, and the exemplary of visual fusion control widget 600 presents.On this exemplary visual fusion control widget 600, has the handle that a plurality of relative slide bars are positioned at diverse location.One group of handle 650 is positioned at position P0, zero end that can corresponding slide bar.Handle 620 is positioned at position P1, and another handle 610 is positioned at position P2.Each handle can use different colours and/or texture to manifest, and can slide along slide bar.In certain embodiments, the total length of slide bar can a corresponding fixed value (for example, or certain fixed value).In this case, relevant with handle weight can be determined according to the distance between handle and its nearest handle.For example, suppose to constitute from position P1 to position P2 the total length of slide bar, the distance between P0 and the P1 is W1, and the distance between P1 and the P2 is W2.The weight relevant with handle 610 can be calculated as W2/ (W1+W2), and the weight relevant with handle 620 can be calculated as W1/ (W1+W2), and wherein W1+W2 is the fixed value relevant with slide bar.
[0044] in certain embodiments, the quantity that is presented on the weight coefficient controller on the slide bar is adjustable.For example, it can be determined according to the number of data sets that will integrate.For utilizing visual fusion control widget to produce the weight of each data set, some weight coefficient controllers can be positioned at the zero end of slide bar at first.The user can catch the handle of weight coefficient controller and it is slided along slide bar.In certain embodiments, described slip is from left to right.The weight coefficient controller slides to the right more, and weighted value is just big more.When the bar section of weight coefficient controller had non-zero length, it was not overlapping with other any weight coefficient controller.When the weight coefficient controller of a more than non-zero length is arranged on the slide bar, as long as the change in location of a weight coefficient controller, for example the bar segment length increases or weight increases, the position of other controller can change automatically, for example, the weight of other controller reduces, because the summation of all weights is fixed values, and for example 1.In another embodiment, slip can be from right to left.In certain embodiments, slip can be from the zero end of slide bar.In further embodiments, slip can be from the other end.In any situation, the suitable calculating of can respective design relevant weight with the weight coefficient controller.
[0045] when the weight coefficient controller when slide bar slides, can see the weighted value relevant with its sliding position.Fig. 7 shows according to one embodiment of present invention, sees the exemplary tool that obtains weight by visual fusion control widget.In first exemplary controls 710, the numerical value of representing the weight relevant with controller be presented on the bar section of controller (for example, the handle of controller and and its most contiguous handle between, towards the zero end of for example slide bar).For example, the weight relevant with weight coefficient controller 720 is presented at the bar fragment position 720-a place (between the zero end of controller 720 and slide bar) of controller 720 on the control 710.The weight relevant with controller 730 is presented at the bar fragment position 730-a place (between controller 730 and controller 720) of controller 730.
[0046] in another embodiment, relevant with weight coefficient controller weight may be displayed on the handle of this weight coefficient controller.For example, on exemplary controls 740, the weight relevant with controller 750 is presented on the handle 750-a of controller 750, and the weight relevant with another controller 760 is presented on the handle 760-a of controller 760.In another embodiment, the weight relevant with the weight coefficient controller can be shown as the mark from controller level.This illustrates at control 770, and wherein relevant with controller 780 weight is shown as the mark of the handle 780-a of self-controller 780, and the weight relevant with another controller 790 is shown as another mark of the handle 790-a of self-controller 790.
[0047] Fig. 8 shows according to one embodiment of present invention, the skeleton view of exemplary 3D visual fusion control widget 800.This exemplary 3D visual fusion control widget 800 comprises a plurality of 3D handles, 810,820 ..., 840 and 850, and 3D slide bar 830.Each handle can slide along 3D slide bar 830, begins and stops at certain position along the 3D slide bar from an end of 3D slide bar.Can determine and the demonstration weight relevant according to method as herein described is similar with controller.When handle slides or after slip stops, can showing weight rapidly.
[0048] Fig. 9 is the high-level process flow of exemplary process according to an embodiment of the invention, wherein manifests with coherent fashion by the 3D control panel and handles volume data.In this exemplary high-level flow process, 910, the 3D volume is present in the first area of viewing area.In this first area, can there be the plane of one or more different orientations to cut the 2D view that the 3D volume also allows to manifest with certain expression mode different cross section.In the second area of viewing area, for the plane of opaque pattern, extract 2D image cross section from different volumes, corresponding each volume is organized, and 920 with stacked demonstration, each corresponding volume.930, present the 3D control panel on the plane of first area, wherein this 3D control panel comprises one or more control knobs, position that it is presented on the 3D control panel and direction make the user visual field to see.The user can operate the button of 3D control panel to finish different data processing operations.Can send and receive the instruction of carrying out associative operation by the button of 3D control panel 940.According to the instruction that receives, carry out corresponding data processing operation 950.
[0049] Figure 10 has described according to one embodiment of present invention, is convenient to the exemplary formation of the system 1000 of data processing by the 3D control panel.System 1000 comprises display 1010, graphic user interface (GUI) controller 1015, database 1020, data retrieval mechanism 1025, a plurality of present mechanism (the 3D data present mechanism 1030, the stacked mechanism 1035 that presents of 2D image, the 2D cross sectional images presents mechanism 1040, and the 3D control panel presents mechanism 1045 and control presents mechanism 1055), 3D control panel manager 1050 and data processing mechanism 1060.User 1005 can be mutual by the user interface and the system 1000 that are presented on the display 1010.Mutual between GUI controller 1015 may command systems 1000 and the user 1005.When user 1005 wished to watch some data, GUI controller 1015 was receiving this request back activation data search mechanism 1025, to fetch needed data from database 1020.According to data characteristic of being fetched and/or user's selection, can call one or more data present mechanism be presented on the display 1010 with the data of will fetch.Can dynamically carry out data and present, and the data that present also can change.For example, when user's 1005 rotation 3D volumes, need to upgrade the initial data variation that causes owing to rotation with reflection that presents.Correspondingly, because rotation, the 2D cross section that present also can change.
[0050] described data present mechanism (1030,1035 and 1040) and not only can carry out data and present, and can also determine needs visit, processing and data presented rapidly according to the information from GUI controller 1015.In some cases, when data being carried out some processing, for example, by data processing mechanism 1060, processed data may also need to present once more, with the reflection data processed result.In other cases, an operation to the 3D control panel may cause presenting data once more.For example, when user 1015 clicks zoom button with amplifier section 3D volume, need present that part of 3D volume once more.
[0051] the 3D control panel presents mechanism 1045 and be used for presenting the 3D control panel on display 1010.It can be called in different situations.For example, when the 3D control panel rotates with plane of motion, may need to present once more.In addition, the 3D control panel presents mechanism 1045 buttons that can determine how to present on the 3D control panel, so that no matter the directional user 1005 of 3D control panel can both see these buttons.
[0052] 3D control panel manager 1050 is used to finish the different operating request that user 1005 sends by the different buttons on the 3D control panel.When receiving this request from GUI controller 1015, which part of 3D control panel manager 1050 definite systems 1000 can be finished this request, and calls this part subsequently.For example, when pressing when being used to activate the button of visual fusion control widget, after 3D control panel manager 1050 receives this information from GUI controller 1015, but the respective calls control presents mechanism 1055, to present visual fusion control widget and mutual, to obtain weight and it is assigned to different data sets with user 1005.In certain situation, user 1005 also can carry out certain data processing to data by the request of 3D control panel.When receiving this request, 3D control panel manager can call data processing mechanism to finish required processing.
[0053] although invention has been described in conjunction with some illustrated embodiment, the employed literal of this paper is illustrative literal, but not determinate literal.Within the scope of the appended claims, under the prerequisite that does not deviate from scope of the present invention and design, can change it.Although in conjunction with specific structure, invention has been described for process and material, the present invention is not limited to disclosed details, but can embody in a variety of forms, wherein some form may be very big with disclosed embodiment difference, and extend to all equivalent structures, process and material in the appended claims scope.
Claims (78)
1, a kind of method of handling the 3D data comprises:
Present a 3D volume in the first area;
Show one or more expressions at second area, each expression represents a 2D image stacked, wherein,
First cascade comprise from one or more 2D image cross sections of certain orientation of a described 3D volume and
Each other stacked one or more 2D images cross section that comprises from certain orientation of the 3D volume relevant with a described 3D volume.
2, according to the process of claim 1 wherein:
In the cross section of corresponding described first volume of the uppermost 2D image of described first cascade on certain position and certain orientation; With
In the corresponding relevant cross section of 3D volume on certain position and certain orientation of described each other stacked uppermost 2D image with a described 3D volume.
3,, wherein had the plane cutting of certain orientation, the cross section that produces described first volume at a described 3D volume of 3d space according to the method for claim 2.
4,, wherein there are three planes and them orthogonal at described 3d space according to the method for claim 3.
5, according to the method for claim 3, wherein the section is opaque expression mode, one of transparent expression mode and stealthy expression mode.
6, according to the method for claim 5, the plane that wherein is in transparent expression mode manifests by using tone.
7, according to the process of claim 1 wherein that stacked each expression of 2D image is can right and wrong stacked, so that show with full view from described stacked one or more 2D images.
8, according to the method for claim 7, wherein said non-stacked 2D image shows in the first area.
9, according to the method for claim 7, wherein when described non-stacked 2D image was presented at the first area, described 3D volume was presented on second area.
10, according to the method for claim 3, also comprise the first area that the 3D control panel is embedded described plane, wherein said 3D control panel is used to handle a described 3D volume and relative 3D volume.
11, according to the method for claim 10, wherein the 3D control panel of Qian Ruing disposes along described planar boundary.
12, according to the method for claim 11, the 3D control panel that wherein embeds first area, described plane presents with three-dimensional right cylinder.
13, according to the method for claim 10, wherein said 3D control panel comprises one or more buttons, each button and function and/or operative association, and can be pressed to activate its relevant function and/or operation.
14, according to the method for claim 11, the plane of wherein said embedding 3D control panel can be moved by moving described 3D control panel.
15, according to the method for claim 13, wherein when moved on the described plane that embeds described 3D control panel, the one or more button position on the described 3D control panel can dynamically be adjusted, so that as seen described one or more button keeps.
16, according to the method for claim 13, wherein said one or more buttons comprise one of the following at least:
At least one button is used to activate the convergent-divergent/proportional control of described 3D volume;
At least one button is used to select the 3D volume that will manifest;
Button is used for locking/unlocking 3D volume, has the described 3D volume of described embedding plane cutting;
At least one button is used for CONTROL VOLUME and plays; With
Button is used to activate visual fusion control widget.
17, according to the method for claim 16, the button that wherein is used for the CONTROL VOLUME broadcast comprises broadcast button, one of fast forward button and fast backward button.
18, according to the method for claim 16, wherein visual fusion control widget shows with the 2D planar object.
19, according to the method for claim 16, wherein visual fusion control widget shows with the 3D object.
20, according to the method for claim 16, wherein said visual fusion control widget comprises:
A plurality of weight coefficient controllers, each is relevant with following data set, and is used to obtain weight distributing to the data set below described, so that merge with the data set of other weight coefficient controller; With
Slide bar, each weight coefficient controller slides thereon, so that determine weight according to the relative position to slide bar.
21, according to the method for claim 20, wherein relevant with weight coefficient controller data set is the 3D volume.
22, according to the method for claim 20, wherein relevant with weight coefficient controller data set is the 2D image.
23, according to the method for claim 21, wherein relevant with weight coefficient controller data set comprises one or more features.
24, according to the method for claim 22, wherein relevant with weight coefficient controller data set is the 2D image cross section of described 3D volume.
25, according to the method for claim 16, wherein each weight coefficient controller shows with different colours and/or texture.
26, according to the method for claim 16, wherein each weight coefficient controller comprises handle and bar section, and described handle is used for sliding on described slide bar, and the length of described bar section is used for determining described weight.
27, according to the method for claim 26, wherein the numerical value of the weight that expression is relevant with described weight coefficient controller is presented on the bar section of described weight coefficient controller.
28, according to the method for claim 27, wherein the numerical value of the weight that expression is relevant with described weight coefficient controller is presented on the handle of described weight coefficient controller.
29,, represent that wherein the numerical value that is assigned weight is presented near the handle of described weight coefficient controller according to the method for claim 27.
30, a kind of method that the 3D control panel is provided comprises:
Generate the 3D structure;
Described 3D structure is embedded the 3D plane that is presented on the 2D viewing area, wherein,
Described 3D structure has one or more buttons and is presented on described 2D viewing area by this way, make described one or more button all as seen and
Described 3D structure with one or more buttons is used to handle at least one 3D volume.
31, according to the method for claim 30, wherein:
At least a portion of described 3D structure is three-dimensional right cylinder; With
Each button of described one or more buttons and function and/or operative association, and can be pressed to activate its associated function and/or operation.
32, according to the method for claim 30, wherein when moved on described plane, the position of one or more buttons of described 3D structure can dynamically be adjusted, so that as seen described one or more button keeps.
33, according to the method for claim 30, wherein said plane can be moved by moving described 3D structure.
34, a kind of method of handling the 3D data comprises:
Present a 3D volume at presentation space, described presentation space has a 3D plane at least, and each plane has certain orientation and transversal described 3D volume;
The 3D control panel is embedded the presentation space with 3D plane, wherein
Described 3D control panel comprises one or more buttons, each button is correlated with function handling a described 3D volume and one or more 3D volumes relevant with described first volume and/or operation, and can be pressed to activate its associated function and/or operation.
35, according to the method for claim 34, wherein embed described plane to small part 3D control panel be three-dimensional right cylinder.
36, according to the method for claim 34, wherein said embedding plane and described 3D control panel can move simultaneously.
37, according to the method for claim 34, wherein when moved on described embedding plane, the position of one or more buttons of described 3D control panel can dynamically be adjusted, so that as seen described button keeps.
38, according to the method for claim 34, wherein said one or more buttons comprise one of the following at least:
At least one button is used to activate the convergent-divergent/proportional control to described 3D volume;
At least one button is used to select the 3D volume that will manifest;
Button is used for locking/unlocking 3D volume, has the described 3D volume of described embedding plane cutting;
At least one button is used for CONTROL VOLUME and plays; With
Button is used to activate visual fusion control widget.
39, according to the method for claim 38, wherein volume Play Control button comprises broadcast button, one of fast forward button and fast backward button.
40, according to the method for claim 38, wherein said visual fusion control widget is shown as one of 2D planar object and 3D object.
41, according to the method for claim 38, wherein said visual fusion control widget comprises:
A plurality of weight coefficient controllers, each is relevant with following data set, is used to obtain weight allocation and gives following data set, so that merge with the data set of other weight coefficient controller; With
Slide bar, each weight coefficient controller slides thereon, so that determine weight according to the relative position to slide bar.
One of 42, according to the method for claim 41, wherein relevant with each weight coefficient controller data set is the 3D volume, the 2D image, and its one or more features.
43, according to the method for claim 38, wherein each weight coefficient controller is used for weight allocation to its relevant data set.
44, according to the method for claim 38, wherein each weight coefficient controller shows with different colours and/or texture.
45, according to the method for claim 38, wherein each weight coefficient controller comprises handle and bar section, and described handle is used for sliding on described slide bar, and the length of described bar section is used for determining described weight.
46, according to the method for claim 45, wherein the numerical value of the weight that expression is relevant with described weight coefficient controller is presented on the bar section of described weight coefficient controller.
47, according to the method for claim 45, wherein the numerical value of the weight that expression is relevant with described weight coefficient controller is presented on the handle of described weight coefficient controller.
48,, represent that wherein the numerical value that is assigned weight is presented near the handle of described weight coefficient controller according to the method for claim 45.
49, a kind of 3D control panel comprises:
The 3D structure is arranged to embed the 3D plane in the 2D presentation space; With
Be distributed in the structural one or more buttons of described 3D, wherein
The position of the described relatively 3D structure of described one or more button makes no matter how described 3D structure is orientated, and these buttons all are visible.
50, according to the 3D control panel of claim 49, at least a portion of wherein said 3D structure is three-dimensional right cylinder.
51, according to the 3D control panel of claim 49, wherein each button is associated with being used for handling the function and/or the operation that are presented on described 2D presentation space data, and can be pressed to activate its correlation function and/or operation.
52, according to the 3D control panel of claim 49, wherein said 3D plane can be moved by moving described 3D structure.
53, according to the 3D control panel of claim 52, wherein when moved on described 3D plane, the position of one or more buttons of described 3D structure can dynamically be adjusted, so that as seen described one or more button keeps.
54, a kind of system that is used for deal with data comprises:
The 3D data present mechanism, are used to present a 3D volume; With
The stacked mechanism that presents of 2D image is used to show one or more expressions, and each expression represents a 2D image stacked, wherein
Each is stacked comprise one or more from a 3D volume have certain orientation 2D image cross section and
Each other stackedly comprise one or more 2D image cross sections that have certain orientation from the 3D volume relevant with a described 3D volume.
55, according to the system of claim 54, as seen wherein said 3D volume one or morely is illustrated in different viewing areas with described.
56, according to the system of claim 54, the orientation in wherein said cross section is determined according to the 3D plane of a transversal described 3D volume.
57, according to the system of claim 54, comprise that also the 2D cross sectional images presents mechanism, be used for showing one or more from described one of stacked 2D image cross section in particular display area.
58, according to the system of claim 57, wherein said 2D image presents mechanism and shows the 2D image at the subregion of described particular display area with the size of determining according to sub-window position.
59, according to the system of claim 56, also comprise:
The 3D control panel presents mechanism, can:
The 3D control panel is embedded described 3D plane; With
On described 3D control panel, present one or more buttons by this way, if make no matter described 3D control panel is orientated, and described one or more buttons all are visible, wherein
Described 3D control panel is used to handle a 3D volume and relative 3D volume.
60, according to the system of claim 59, wherein said one or more buttons comprise one of the following at least:
At least one button is used to activate the convergent-divergent/proportional control to a described 3D volume;
At least one button is used to select the 3D volume that will manifest;
Button is used for locking/unlocking 3D volume, has the described 3D volume of described embedding plane cutting;
At least one button is used for CONTROL VOLUME and plays; With
Button is used to activate visual fusion control widget.
61, according to the system of claim 59, wherein said 3D control panel presents machine-processed border along described 3D plane and shows described 3D control panel.
62, according to the system of claim 61, wherein:
At least a portion of described 3D control panel presents with three-dimensional right cylinder; With
Each button in described one or more button and function and/or operative association, and can be pressed to activate its related function and/or operation.
63, according to the system of claim 61, wherein when moved on described 3D plane, described 3D control panel presented the position that mechanism can also dynamically be adjusted one or more buttons of described 3D control panel, made described button keep as seen.
64, according to the system of claim 59, comprise that also visual widget presents mechanism, be used for when pressing the button that activates visual fusion control widget, presenting described visual fusion control widget.
65, according to the system of claim 59, also comprise 3D control panel manager, be used for when described button is activated, finish the function and/or the operation that are associated with each described button.
66, a kind ofly carry out the system of data processing, comprising by the 3D control panel:
The 3D data present mechanism, are used for presenting in the viewing area 3D volume; With
The 3D control panel presents mechanism, can:
Present the 3D control panel in described viewing area;
Present one or more buttons at described 3D control panel by this way, make described one or more button as seen, wherein
Described 3D control panel is used to handle a described 3D volume and relevant 3D volume thereof.
67, according to the system of claim 66, wherein said 3D control panel presents the 3D plane that mechanism embeds described 3D control panel a transversal described 3D volume.
68, according to the system of claim 67, wherein:
Described 3D control panel presents with the border of three-dimensional right cylinder along described 3D plane; With
Each button in described one or more button is associated with function and/or the operation of handling a described 3D volume and relevant 3D volume thereof, and the function and/or the operation that can be pressed and be correlated with to activate.
69, according to the system of claim 68, wherein when moved on described 3D plane, described 3D control panel presented the position that mechanism can also dynamically be adjusted one or more buttons of described 3D control panel, made described button keep as seen.
70, according to the system of claim 69, wherein can move described 3D control plane by moving described 3D control panel.
71, according to the system of claim 66, also comprise 3D control panel manager, be used for when button is activated, finishing function and/or the operation that is associated with each described button.
72, a kind of visual widget comprises:
A plurality of weight coefficient controllers; With
Slide bar, wherein
Each weight coefficient controller can on described slide bar, slide and
Be displayed on the described visual widget in the determined value in the position on the described slide bar according to each weight coefficient controller.
73, according to the control of claim 72, wherein said visual widget presents with the 2D planar object.
74, according to the control of claim 72, wherein said visual widget presents with the 3D object.
75, according to the control of claim 72, wherein each weight coefficient controller presents with a kind of color and/or texture.
76, according to the control of claim 72, the value that wherein shows on visual widget presents with texture.
77, according to the control of claim 72, wherein the weight coefficient controller comprises:
Handle; With
Bar section, wherein said handle are used for sliding on described slide bar, and the length of described bar section is relevant with the value of described weight coefficient controller.
78, according to the control of claim 77, the value of wherein said weight coefficient controller is presented at one of the following at least:
On the bar section of described weight coefficient controller;
On the handle of described weight coefficient controller; With
Handle near described weight coefficient controller.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US56226204P | 2004-04-15 | 2004-04-15 | |
| US60/562,262 | 2004-04-15 | ||
| PCT/US2005/012559 WO2005104954A2 (en) | 2004-04-15 | 2005-04-14 | Multiple volume exploration system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101073097A true CN101073097A (en) | 2007-11-14 |
| CN101073097B CN101073097B (en) | 2011-05-18 |
Family
ID=35242208
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2005800114177A Active CN101073097B (en) | 2004-04-15 | 2005-04-14 | Multiple volume exploration system and method |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US7315304B2 (en) |
| EP (1) | EP1737347B1 (en) |
| CN (1) | CN101073097B (en) |
| WO (1) | WO2005104954A2 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102422335A (en) * | 2009-05-12 | 2012-04-18 | 美国医软科技公司 | System, method, apparatus, and computer program for interactive pre-operative assessment |
| CN106462769A (en) * | 2014-04-23 | 2017-02-22 | 电子湾有限公司 | Specular highlights on photos of objects |
| CN110868907A (en) * | 2017-04-28 | 2020-03-06 | 奥林巴斯株式会社 | Endoscopic diagnosis support system, endoscopic diagnosis support program, and endoscopic diagnosis support method |
Families Citing this family (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060132508A1 (en) * | 2004-12-16 | 2006-06-22 | Navid Sadikali | Multi-planar image viewing system and method |
| US7496222B2 (en) * | 2005-06-23 | 2009-02-24 | General Electric Company | Method to define the 3D oblique cross-section of anatomy at a specific angle and be able to easily modify multiple angles of display simultaneously |
| US20070127791A1 (en) * | 2005-11-15 | 2007-06-07 | Sectra Ab | Automated synchronization of 3-D medical images, related methods and computer products |
| EP3136212B1 (en) * | 2006-05-16 | 2021-05-05 | Edda Technology, Inc. | Joy-stick like graphical user interface to adjust cross sectional plane in 3d volume |
| US20090027380A1 (en) * | 2007-07-23 | 2009-01-29 | Vivek Rajan | 3-D visualization |
| CN101809628B (en) * | 2007-09-26 | 2012-12-05 | 皇家飞利浦电子股份有限公司 | Visualization of anatomical data |
| WO2009067654A1 (en) * | 2007-11-21 | 2009-05-28 | Edda Technology, Inc. | Method and system for interactive percutaneous pre-operation surgical planning |
| US11264139B2 (en) | 2007-11-21 | 2022-03-01 | Edda Technology, Inc. | Method and system for adjusting interactive 3D treatment zone for percutaneous treatment |
| US8253726B1 (en) | 2008-01-09 | 2012-08-28 | Spaceclaim Corporation, Inc. | Systems and methods for modifying three dimensional geometry using an arbitrary cross-section plane |
| KR101501518B1 (en) * | 2012-06-11 | 2015-03-11 | 삼성메디슨 주식회사 | The method and apparatus for displaying a two-dimensional image and a three-dimensional image |
| US9829996B2 (en) * | 2012-06-25 | 2017-11-28 | Zspace, Inc. | Operations in a three dimensional display system |
| US9684997B2 (en) * | 2012-06-27 | 2017-06-20 | Pixar | Efficient rendering of volumetric elements |
| KR20150068162A (en) | 2013-12-11 | 2015-06-19 | 삼성전자주식회사 | Apparatus for integration of three dimentional ultrasound images and method thereof |
| US10235807B2 (en) * | 2015-01-20 | 2019-03-19 | Microsoft Technology Licensing, Llc | Building holographic content using holographic tools |
| WO2017214172A1 (en) | 2016-06-06 | 2017-12-14 | Edda Technology, Inc. | Method and system for interactive laparoscopic ultrasound guided ablation planning and surgical procedure simulation |
| WO2019013739A1 (en) | 2017-07-10 | 2019-01-17 | Hewlett-Packard Development Company, L.P. | Determining object volumes in virtual object space |
| US20230372021A1 (en) * | 2022-05-20 | 2023-11-23 | Biosense Webster (Israel) Ltd. | Displaying orthographic and endoscopic views of a plane selected in a three-dimensional anatomical image |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5861889A (en) * | 1996-04-19 | 1999-01-19 | 3D-Eye, Inc. | Three dimensional computer graphics tool facilitating movement of displayed object |
| US6100862A (en) * | 1998-04-20 | 2000-08-08 | Dimensional Media Associates, Inc. | Multi-planar volumetric display system and method of operation |
| AU2002359444A1 (en) * | 2001-11-21 | 2003-06-10 | Viatronix Incorporated | Imaging system and method for cardiac analysis |
| US7355597B2 (en) * | 2002-05-06 | 2008-04-08 | Brown University Research Foundation | Method, apparatus and computer program product for the interactive rendering of multivalued volume data with layered complementary values |
-
2005
- 2005-04-14 EP EP05736449.9A patent/EP1737347B1/en active Active
- 2005-04-14 WO PCT/US2005/012559 patent/WO2005104954A2/en active Application Filing
- 2005-04-14 CN CN2005800114177A patent/CN101073097B/en active Active
- 2005-04-14 US US11/105,638 patent/US7315304B2/en active Active
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102422335A (en) * | 2009-05-12 | 2012-04-18 | 美国医软科技公司 | System, method, apparatus, and computer program for interactive pre-operative assessment |
| US9099015B2 (en) | 2009-05-12 | 2015-08-04 | Edda Technology, Inc. | System, method, apparatus, and computer program for interactive pre-operative assessment involving safety margins and cutting planes in rendered 3D space |
| CN102422335B (en) * | 2009-05-12 | 2016-03-02 | 美国医软科技公司 | For system, the method and apparatus of interactive pre-operative assessment |
| CN106462769A (en) * | 2014-04-23 | 2017-02-22 | 电子湾有限公司 | Specular highlights on photos of objects |
| US10424099B2 (en) | 2014-04-23 | 2019-09-24 | Ebay Inc. | Specular highlights on photos of objects |
| CN110868907A (en) * | 2017-04-28 | 2020-03-06 | 奥林巴斯株式会社 | Endoscopic diagnosis support system, endoscopic diagnosis support program, and endoscopic diagnosis support method |
Also Published As
| Publication number | Publication date |
|---|---|
| US7315304B2 (en) | 2008-01-01 |
| EP1737347A4 (en) | 2015-09-02 |
| CN101073097B (en) | 2011-05-18 |
| EP1737347B1 (en) | 2020-07-01 |
| WO2005104954A3 (en) | 2007-07-05 |
| US20050251038A1 (en) | 2005-11-10 |
| WO2005104954A2 (en) | 2005-11-10 |
| EP1737347A2 (en) | 2007-01-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101073097B (en) | Multiple volume exploration system and method | |
| US11681435B2 (en) | Focus management system | |
| EP2820535B1 (en) | Method for displaying and manipulating a floor layout display on a computer | |
| Khan et al. | Hovercam: interactive 3d navigation for proximal object inspection | |
| US8042058B2 (en) | Portable device having rotatable input buttons and method of operating the same | |
| CN1242318C (en) | User interface for providing consolidation and access | |
| US7663620B2 (en) | Accessing 2D graphic content using axonometric layer views | |
| US8314789B2 (en) | Navigation system for a 3D virtual scene | |
| JP6261894B2 (en) | Medical image display apparatus and method | |
| US20030142136A1 (en) | Three dimensional graphical user interface | |
| US20060284878A1 (en) | Resolution Independent User Interface Design | |
| Khan et al. | Viewcube: a 3d orientation indicator and controller | |
| WO2004066137A9 (en) | System and method for managing a plurality of locations of interest in 3d data displays | |
| CN101395570A (en) | Capturing image data | |
| EP2257899A1 (en) | Reducing the size of a model using visibility factors | |
| WO2011149720A1 (en) | Image browsing and navigating user interface | |
| US8082128B2 (en) | Building material design support system, building material, and program for the system | |
| EP2634671B1 (en) | Device and method for exchanging information between at least one operator and a machine | |
| CN103477305B (en) | The control based on gesture of element or project | |
| Kim et al. | Virtual object sizes for efficient and convenient mid-air manipulation | |
| WO2007097644A2 (en) | Improvements relating to manipulator tools for virtual objects | |
| WO2000063768A1 (en) | System and method for managing the use of desktop space in graphical user interfaces | |
| US6556227B1 (en) | Visualization techniques for constructive systems in a computer-implemented graphics system | |
| Mishra | Using TRIZ for maximizing information presentation in GUI | |
| JP2004139308A (en) | Object display control system and control method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |