TWI677324B - Image display device and image display method - Google Patents

Abstract

An image display device includes: a transparent panel and a display adjustment layer. The transparent panel displays a superimposed image corresponding to a surface area in a first area. The display adjustment layer is arranged on the transparent panel to retain a monocular sight to view the superimposed image. When a first eye and a second eye look at the surface area through the image display device, the first eye can see the superimposed image. Superimposed on the surface area and the second eye sees only the surface area.

Description

Image display device and image display method

The present invention relates to an image display device and an image display method, and more particularly, to an image display device and an image display method applied to a superimposed image.

Traditional doctors use medical images when performing surgery, such as: Magnetic Resonance Imaging (MRI), computed tomography, X-ray images, etc. Before the surgery, Assess the actual position, depth, and direction of the knife.

However, medical images are displayed on a separate display, and doctors can only superimpose medical images and entities in their brains by imagination. It is impossible to give doctors extremely precise guidance during surgery.

Therefore, how to provide an image display device and an image display method so as to superimpose an image on a panel with an entity has become one of the urgent problems in the art.

In order to solve the above problems, an aspect of the present invention provides an image display device, which includes a transparent panel and a display adjustment layer. Transparent The panel displays a superimposed image corresponding to a surface area in a first area. The display adjustment layer is arranged on the transparent panel to retain a monocular sight to view the superimposed image. When a first eye and a second eye look at the surface area through the image display device, the first eye can see the superimposed image. Superimposed on the surface area and the second eye sees only the surface area.

Another aspect of the present invention provides an image display method, comprising: displaying a superimposed image on a first area of a transparent panel, the superimposed image providing a display adjustment layer on the transparent panel corresponding to a surface area display; and providing A single eye looks at the superimposed image. When a first eye and a second eye look through the display adjustment layer and the surface area of the transparent panel, the first eye can see that the superimposed image overlaps the surface area and the second eye only See the surface area.

In summary, the image display device and the image display method shown in the present invention can directly superimpose an image displayed on a transparent panel with a solid object, and solve the problem by removing the display area circuit or switching the display area. In order to solve the problem of parallax of the superimposed image viewed by the human eye, it can also achieve the effect of taking into account the visual depth of the superimposed image viewed by the human eye.

100‧‧‧Image display device

LE‧‧‧Left Eye

RE‧‧‧ Right Eye

SI‧‧‧ Superimposed image

ADJ‧‧‧Display Adjustment Layer

10‧‧‧ Scanner

RI‧‧‧ surface area

SF‧‧‧ Surface of affected area

PL‧‧‧ transparent panel

R1 ~ R3‧‧‧ display area

La‧‧‧ Left Eye Display Area

Ra‧‧‧ Right Eye Display Area

PT‧‧‧ anchor point

20‧‧‧ Eye Tracker

30‧‧‧Mark Tracking Device

In order to make the above and other objects, features, advantages, and embodiments of the present invention more comprehensible, the description of the drawings is as follows: FIG. 1 is a schematic diagram of a use situation of an existing overlay image display; FIG. 2 is based on An embodiment of the present invention is a schematic diagram of a use situation of an overlay image display; 3A-3B are schematic diagrams of a display adjustment layer according to an embodiment of the present invention; FIG. 4 is a schematic diagram of a use situation of an image display device 100 according to an embodiment of the present invention; and FIGS. 5A-5B are based on An embodiment of the present invention is a schematic diagram of a use situation of an image display device; and FIG. 6 is a flowchart of an overlay image display method according to an embodiment of the present invention.

The following is a detailed description of the embodiments with the accompanying drawings, but the embodiments provided are not intended to limit the scope covered by the present invention, and the description of the structural operations is not intended to limit the order of execution, and any recombination of components The structure and the devices with equal effects are all covered by the present invention. In addition, the drawings are for illustration purposes only, and are not drawn to the original dimensions. To facilitate understanding, the same elements in the following description will be described with the same symbols.

Regarding the "first", "second", ..., etc. used herein, they do not specifically refer to the order or order, nor are they used to limit the present invention. They are only used to distinguish elements described in the same technical terms. Or just operate.

Please refer to FIG. 1 for a schematic diagram of a use situation of an existing overlay image display. In the first figure, the transparent panel PL displays the MRI, computer tomography, X-ray image or other medical images below an operation area. For example, a surface area RI on the surface SF of the affected part is an affected part that needs an operation. Surgery position of the transparent panel PL and the affected part on the affected part surface SF Overlap. However, due to parallax between the left eye LE and the right eye RE of a human body (such as a doctor), the medical image seen by the left eye LE through the transparent panel PL will be generated in the doctor's brain at the surface area LI of the surface SF of the affected part. The medical image seen by the right eye RE through the transparent panel PL will be generated in the doctor's brain at the surface area RI of the surface SF of the affected part. The position of the surface area RI is different from that of the surface area LI. As a result, the doctor is not sure of the position of the affected part. Therefore, the parallax between the left eye LE and the right eye RE of the human body (such as a doctor) when viewing the medical image displayed on the transparent panel PL, and taking into account the visual depth, can be accurately taken to accurately match the medical image displayed on the transparent panel PL and the affected part. Overlap.

Since this case is not only applicable to medical images, it can also be applied to other applications that require visual overlay (such as overlaying a known map with a transparent panel PL and overlaying the known map onto a road scene), so it will be implemented in the follow-up In the example, the medical image is referred to as a superimposed image SI, which is displayed on the transparent panel PL, and a solid affected part is referred to as a surface area RI.

An image display device and an image display method that solve the above problems are proposed below.

FIG. 2 is a schematic diagram illustrating a use situation of an overlay image display according to an embodiment of the present invention. In FIG. 2, the image display device 100 includes a transparent panel PL and a display adjustment layer ADJ. The display adjustment layer ADJ is placed on the transparent panel PL. In one embodiment, the display adjustment layer ADJ may be one of a lenticular lens layer and a parallax barrier layer.

As shown in FIG. 2, the transparent panel PL displays a superimposed image SI in a first area corresponding to a surface area RI (for example, an affected part), and a display adjustment layer ADJ is disposed on the transparent panel PL to retain a single eye. Looking at the superimposed image SI, when the first eye RE and the second eye LE pass the image display device When looking at the surface area RI at 100, the first eye RE can see that the superimposed image SI is superimposed on the surface area RI, while the second eye LE only sees the superimposed image SI and does not see the superimposed image SI, so A person will not cause a depth error due to visual displacement caused by two eyes seeing the superimposed image SI at the same time.

In an embodiment, a scanner 10 is disposed below the transparent panel PL of the image display device 100 to scan the surface area RI so that the superimposed image SI corresponds to the surface area RI; the superimposed image SI is below the surface area RI A scan image at a depth, so a viewer can view the image under the surface SF of the affected part through the image display device 100.

In an embodiment, the superimposed image SI includes an image suitable for the right eye RE and an image suitable for the left eye LE. These images may be two-dimensional images or three-dimensional images. The difference lies in the distance difference between the viewing angles of the two-dimensional images or It is a supply from 3D cameras, which is the difference in viewing angle of 3D images.

In one embodiment, the display adjustment layer ADJ is used to allow the left eye LE to see only the first region of the transparent panel PL and the right eye RE to see only a second region of the transparent panel PL. The transparent panel PL can be selected. The superimposed image SI is displayed only in the first region or the second region, so that the left eye LE or the left eye LE selectively sees the superimposed image SI and the surface region RI and the other eye can only see the surface. Regional RI.

For example, please refer to FIGS. 3A to 3B to illustrate a display adjustment layer according to an embodiment of the present invention. In FIG. 3A, the display adjustment layer ADJ is a parallax barrier layer, and the transparent panel PL is divided into a left-eye display area La and a right-eye display area Ra, and the two are long and staggered (the first area includes The plurality of regions Ra and the second region include a plurality of regions La). In this example, the left eye LE can only see the left side of the transparent panel PL The eye display area La and the right eye RE can only see the right eye display area Ra of the transparent panel PL, the transparent panel PL displays the superimposed image SI only on the left eye display area La, and the right eye RE passes the right eye display area Ra of the transparent panel. Only the surface area RI is seen, and the display area Ra at this time does not display any image. In the above embodiment, the display area Ra can optionally be provided with no circuit for displaying the image to make the display area Ra more transparent, without Let the display circuit affect the viewing of the right eye RE.

In an embodiment, as shown in FIG. 3B, the display adjustment layer ADJ is a lenticular lens layer, and a left-eye display area La or a right-eye display area Ra of the transparent panel PL is used.

For example, as shown in FIG. 3B, the display adjustment layer ADJ is a parallax barrier layer, and the transparent panel PL is divided into a left-eye display area La and a right-eye display area Ra, and the two are long and staggered. In this example, when the right-eye display area Ra of the transparent panel PL is viewed through the image display device 100 to the right-eye RE and the left-eye LE, the left-eye LE can see the superimposed image SI and the surface area RI. Overlap, the right eye RE only sees the surface area RI (because the right eye display area Ra does not display an image).

Referring to FIG. 4, FIG. 4 is a schematic diagram illustrating a usage scenario of an image display device 100 according to an embodiment of the present invention. The image display device 100 further includes an eye tracker 20, which is placed above the transparent panel PL to track a relative displacement between the first eye (for example, the right eye RE) and the transparent panel PL. The area displays the superimposed image SI. The eye tracker 20 adjusts the area of the superimposed image SI according to the relative displacement, so that the first eye or the second eye (for example, the left eye LE) can see the superimposed image SI superimposed on the surface area RI. .

In an embodiment, referring to FIGS. 3A and 4, the superimposed image SI includes an image suitable for the right eye RE and an image suitable for the left eye LE. When the left eye display area La displays an image suitable for the left eye LE, When the right-eye display area Ra does not display an image, the left-eye LE can see an image (superimposed image SI) suitable for the left-eye LE and the surface area RI is superimposed, so that the right-eye RE can see the surface area through the right-eye display area Ra. RI, when the eye tracker 20 tracks a relative displacement between the right eye RE (or left eye LE) and the transparent panel PL, when the relative displacement is greater than a displacement threshold (for example, a horizontal displacement of 2 cm), the left eye LE and The right eye RE can be switched from the left-eye display area La and the right-eye display area Ra, which can be seen independently, to the left-eye LE can only see the right-eye display area Ra and the right-eye RE can only see the left-eye display area. La, the eye tracker 20 sends a moving signal to the transparent panel PL, so that the transparent panel PL displays an image suitable for the right eye RE in the left-eye display area La, and the right-eye display area Ra still does not display an image, and the right-eye RE can see at this time. Superimposed the image (superimposed image SI) suitable for the right eye RE and the surface area RI, The left eye RE can only see the surface area RI through the right eye display area Ra, and it is easy to switch between different eyes to see the superimposed image SI. In this embodiment, the right eye display area Ra may not be provided with a circuit capable of displaying an image. Increase the transparency of the right-eye display area Ra.

In an embodiment, referring to FIG. 3A, the superimposed image SI includes an image suitable for the right eye RE and an image suitable for the left eye LE. When the left eye display area La displays an image suitable for the left eye LE, the right eye display area When Ra does not display the image, the left eye LE can see the image (superimposed image SI) suitable for the left eye LE and the surface area RI overlap, so that the right eye RE can see the surface area RI through the right eye display area Ra. The tracker 20 tracks that the relative displacement between the first eye and the transparent panel PL is greater than a displacement threshold (for example, a horizontal displacement of 1 cm). In this situation, the left-eye display area La is about to leave the sight of the left-eye LE and gradually see the right-eye display area Ra. The eye tracker 20 sends a mobile signal to the transparent panel PL, so that the transparent panel PL is suitable for the right-eye display area Ra display. In the left eye LE image, the left eye LE can see the image (superimposed image SI) suitable for the left eye LE and the surface area RI are superimposed through the right eye display area Ra, so that the right eye RE passes through the left eye display area Ra. Only the surface area RI is seen, and the left-eye display area La does not display an image.

In an embodiment, as shown in FIG. 4, the image display device 100 further includes a marker tracking device 30, which is placed under the transparent panel PL to capture an anchor point PT located on the surface area RI, and transmits the image including a The anchor point image is transmitted to the transparent panel PL, and the transparent panel PL calculates a relative displacement between the superimposed image SI and the surface area RI according to the anchor point PT image. This facilitates positioning of the superimposed image SI and the surface region RI.

Referring to FIGS. 5A-5B, a schematic diagram of a usage scenario of the image display device 100 is shown. When the display adjustment layer ADJ is a parallax barrier layer, the transparent panel PL includes multiple display regions R1 to R3, and the multiple display regions R1 to R3 are respectively viewed by the left eye LE or the right eye RE in different examples. In the figure, the right eye RE can see the display area R1 showing the image suitable for the right eye RE, the left eye LE can see the display area R2, and the display areas R2 and R3 do not display any images. Therefore, referring to Figure 4, the right eye RE can Seeing the superimposed image SI and the surface area RI, the left eye LE can only see the surface area RI.

When the eye tracker 20 detects that a relative displacement between the eye RE (or LE) relative to the transparent panel PL exceeds a threshold value A1, the right eye RE can see the display area R2, and the left eye LE can see the display area R3 ( (As shown in FIG. 5B), the eye tracker 20 sends a mobile signal to the transparent panel PL, The bright panel PL now displays the image suitable for the right eye RE in the display area R2, and no images are displayed in the display areas R1 and R3. The right eye RE can continuously see the superimposed image SI and the surface area RI, and the left eye LE can only see To the surface area RI.

By analogy, when the eye tracker 20 detects that a relative displacement between the eye RE (or LE) relative to the transparent panel PL exceeds a threshold value A2, the right eye RE can see the display area R3, and the left eye LE can see In the display area R1, the eye tracker 20 sends a mobile signal to the transparent panel PL, so that the transparent panel PL now displays the image suitable for the right eye RE in the display area R3, and no images are displayed in the display areas R1 and R2, and the right eye RE can last Seeing the superimposed image SI and the surface area RI, the left eye LE can only see the surface area RI continuously, so as to avoid the effect of the head shaking when watching.

Refer to FIG. 6 for the image display method shown in the present invention. The image display method includes step S10, first placing a transparent panel over a surface area; and step S20 displaying a superimposed image on the first area of the transparent panel. The superimposed image corresponds to a surface area below the transparent panel, and a scan can be performed by a The device scans the surface area so that the superimposed image corresponds to the surface area, and the superimposed image is a scanned image at a depth below the surface area.

Step S30 provides a display adjustment layer on the transparent panel, so that the first eye can see that the superimposed image overlaps with the surface area, and the second eye can only see the surface area. The display adjustment layer is used for the first eye to only The first area of the transparent panel can be seen and the second eye can only see the second area of the transparent panel. The transparent panel only displays the superimposed image in the first area, and the second eye only looks at the second area of the transparent panel. To the surface area; the second area of the transparent panel may choose not to provide a circuit for displaying images; the display adjustment layer may be one of a lenticular lens layer and a parallax barrier layer.

Each of the first region and the second region includes a plurality of strip-shaped regions, and the strip-shaped region of the first region and the strip-shaped region of the second region are staggered.

The superimposed image includes an image applicable to the first eye and an image applicable to the second eye. When the image applicable to the first eye is displayed in the first area of the transparent panel, the image display method further includes step S40 to provide an eye tracker for tracking. A relative displacement between the first eye and the transparent panel; step S50 selectively adjusts the display area of the superimposed image so that at least one eye sees the superimposed image overlapping with the surface area, and the other eye sees only the superficial area.

Step S50 includes an implementation method: when the relative displacement is greater than the first displacement threshold, the eye tracker sends a movement signal to the transparent panel, so that the transparent panel is switched in the first area to display an image suitable for the second eye, so that the second eye can It is seen that the superimposed image is superimposed on the surface area and only the surface area is seen at first glance.

Step S50 further includes another implementation method: when the relative displacement is greater than the second displacement threshold, the eye tracker sends a movement signal to a transparent panel, and the transparent panel switches the image applicable to the first eye to the first area and switches to not displaying The image applicable to the first eye is displayed in the second region, so that the first eye can see that the superimposed image is superimposed on the surface region and the second eye can see only the surface region.

The method of the present invention further includes a marking and tracking device under the transparent panel to capture an anchor point located on the surface area and transmit an image including the anchor point to the transparent panel; the transparent panel calculates the superimposed image based on the anchor point image A relative displacement from the surface area.

In summary, the image display device and image shown in the present invention The display method can directly superimpose the image displayed on the transparent panel with the solid object. By removing the display area circuit or switching the display area, it solves the problem of parallax when the superimposed image is viewed by the human eye. To achieve the effect of taking into account the visual depth of the human eye when viewing the superimposed image.

Although the present invention has been disclosed in the above embodiments, it is not intended to limit the present invention. Any person skilled in the art can make various modifications and retouches without departing from the spirit and scope of the present invention. Therefore, the protection of the present invention The scope shall be determined by the scope of the attached patent application.

Claims (10)

An image display device includes: a transparent panel that displays a superimposed image corresponding to a surface area below the transparent panel in a first area of the transparent panel; and a display adjustment layer disposed on the transparent panel for use with In order to maintain a monocular line of sight to view the superimposed image, when a first eye and a second eye look at the surface area through the image display device, the first eye can see that the superimposed image overlaps the surface area. The second eye sees only the surface area. The image display device according to claim 1, wherein the display adjustment layer is used to allow the first eye to see only the first region of the transparent panel and to allow the second eye to see only one of the transparent panel. In the second area, the transparent panel displays the superimposed image only in the first area, and the second eye sees only the surface area through the second area of the transparent panel. The image display device according to claim 2, wherein the first region and the second region each include a plurality of strip-shaped regions, and the strip-shaped region of the first region is intersected with the strip-shaped region of the second region. Settings. The image display device according to claim 2, wherein the second region of the transparent panel is not provided with a circuit for displaying an image. The image display device according to claim 2, wherein the superimposed image includes an image suitable for the first eye and an image suitable for the second eye, and the image suitable for the first eye is displayed in the first area of the transparent panel. The image display device further includes: an eye tracker placed above the transparent panel to track a relative displacement between the first eye and the transparent panel; wherein when the relative displacement is greater than a first displacement threshold When the value is reached, the eye tracker sends a mobile signal to the transparent panel, so that the transparent panel is switched to display the image suitable for the second eye in the first area, so that the second eye can see the superimposed image and the image. The surface area overlaps and the first eye sees only the surface area. The image display device according to claim 2, wherein the superimposed image includes an image suitable for the first eye and an image suitable for the second eye, and the image suitable for the first eye is displayed in the first area of the transparent panel. The image display device further includes: an eye tracker placed above the transparent panel to track a relative displacement between the first eye and the transparent panel; wherein when the relative displacement is greater than a second displacement threshold When the value is reached, the eye tracker sends a mobile signal to the transparent panel, and the transparent panel switches the display of the image applicable to the first eye to the first area to not display and displays the image applicable to the first eye to the first panel. Two areas, so that the first eye can see that the superimposed image is superimposed on the surface area and the second eye can see only the surface area. An image display method includes: placing a transparent panel over a surface area; displaying a superimposed image on a first area of the transparent panel, the superimposed image corresponding to the surface area being displayed; and providing a display adjustment layer on the surface A single eye is provided on the transparent panel to view the superimposed image. When a first eye and a second eye look at the superimposed area through the display adjustment layer and the transparent panel, the first eye can see the superimposed image. The image overlaps the surface area and the second eye sees only the surface area. The image display method according to claim 7, wherein the display adjustment layer is used to allow the first eye to see only the first region of the transparent panel and to allow the second eye to see only one of the transparent panel. In the second area, the transparent panel displays the superimposed image only in the first area, and the second eye sees only the surface area through the second area of the transparent panel. The image display method according to claim 8, wherein the first region and the second region each include a plurality of strip-shaped regions, and the strip-shaped region of the first region is intersected with the strip-shaped region of the second region. Settings. The image display method according to claim 9, wherein the superimposed image includes an image suitable for the first eye and an image suitable for the second eye, and the image suitable for the first eye is displayed in the first area of the transparent panel. The image display method further includes: tracking an relative displacement between the first eye and the transparent panel by an eye tracker placed above the transparent panel; wherein when the relative displacement is greater than a first displacement When the threshold value is reached, the eye tracker sends a mobile signal to the transparent panel, so that the transparent panel is switched to display the image suitable for the second eye in the first area, so that the second eye can see the superimposed image and The surface area overlaps and the first eye sees only the surface area.