TWI471799B - Method and system for processing stereoscopic image with interacting function - Google Patents

Description

Stereo interactive image processing method and system

The present invention relates to a method and system for processing a stereoscopic image, and in particular to a method and system for processing a stereoscopic interactive image.

With the advancement of stereoscopic display technology, more and more products are equipped with stereoscopic display technology. For example, a large-screen movie equipped with stereoscopic display technology can present a visual sense of presence and let the audience get real touch. A TV equipped with stereo display technology will make the hard picture more vivid.

Stereoscopic display technology is an important breakthrough in display technology, and the industry is committed to developing new applications from hardware or software. For the entire electronics industry, this is a comprehensive innovation movement.

This case is about a method and system for processing stereoscopic interactive images.

According to the first aspect of the present invention, a method for processing a stereo interactive image is proposed. The processing method of the stereo interactive image includes the following steps. A stereoscopic image is displayed on a stereoscopic display. The stereoscopic image has an object. The detecting unit detects the finger depth of one of the user's fingers and the stereoscopic display; and detects the viewing distance of the human eye from the stereoscopic display. The processing unit calculates the object depth of one of the object and the stereoscopic display according to the viewing distance. The processing unit adjusts the stereoscopic image according to the depth of the object or the depth of the finger to prevent the object from being obscured by the finger.

According to a second aspect of the present invention, a stereo interactive image system is proposed. The stereo interactive image system includes a stereoscopic display, a detecting unit and a processing unit. The stereoscopic display is used to display a stereoscopic image. The stereoscopic image has an object. The detecting unit is configured to detect the distance between the finger depth of one of the user's fingers and the stereoscopic display and the viewing distance of the stereoscopic display from one of the user's eyes. The processing unit is configured to calculate the object depth of the object and the stereoscopic display according to the viewing distance, and adjust the stereoscopic image according to the object depth or the finger depth to prevent the object from being obscured by the finger, thereby causing the wrong object depth perception.

In order to better understand the above and other aspects of the present invention, the following specific embodiments, together with the drawings, are described in detail below:

The following is a detailed description of various embodiments, which are intended to be illustrative only and not to limit the scope of the invention. Further, the drawings in the embodiments are omitted to partially illustrate the technical features of the present invention.

First embodiment

1 to 2, FIG. 1 is a schematic diagram of a stereo interactive image system 100 of the first embodiment, and FIG. 2 is a block diagram of a stereo interactive image system 100 of the first embodiment. The stereoscopic interactive image system 100 of the present embodiment includes a stereoscopic display 110, a processing unit 120, and a detecting unit 130. The stereoscopic display 110 is configured to display a stereoscopic image, such as a liquid crystal display having a stereoscopic display function, an organic light emitting diode display, a plasma display, or a projection display. The processing unit 120 is configured to execute various computing programs, processing programs, or determining programs, such as a chip, a firmware circuit, or a storage medium storing a plurality of sets of code. The detecting unit 130 is configured to detect a spatial distance of the object, such as an infrared distance detector, a laser distance detector, an ultrasonic distance detector, or a passive distance detector using more than one camera.

Through the parallax of both eyes, the stereoscopic display 110 allows the user 900 to view the stereoscopic image, so that the user 900 feels that the object 710 in the image floats in front of the eyes. When the user 900 makes various interactive actions in front of the stereoscopic display 110, the detection process of the detecting unit 130 and the processing program of the processing unit 120 may further enable the object 710 in the stereoscopic image to interact with the user 900.

During the interaction of the user 900, the object 710 of the stereoscopic image may be obscured by the finger 910 or the limb of the user 900, and the object 710 of the stereoscopic image is not visible. In this embodiment, the processing procedure of the following process is further used to prevent the stereoscopic image object 710 from being obscured during the interaction. Please refer to FIG. 3, FIG. 4A and FIG. 4B, FIG. 3 is a flowchart of a method for processing a stereo interactive image according to the first embodiment, and FIG. 4A is a schematic diagram of the stereo image before the adjustment of the first embodiment, FIG. A schematic diagram of the stereo image adjustment of the first embodiment is shown.

In step S101, as shown in Figure 4A, the detection unit 130 to detect a user's finger 900 and the finger 910 of the stereoscopic display 110 a depth d _f of the user 900, one eye stereoscopic display 920 from a viewing distance of 110 L. The finger depth d _f of this step is obtained by actual measurement, rather than by calculation.

In step S102, as shown in FIG. 4A, the object depth _{dp is} calculated by the processing unit 120. The object depth _{dp is} related to the viewing distance L, the aberration p, and the binocular distance e of the eye 920. The object depth d _p can be calculated according to the following formula (1).

d _p =L×p/(p+e).......................................... .(1)

In step S103, as shown in Figure 4A, the processing unit 120 calculates an error object depth d _p and depth d _f of the fingers.

In step S105, as shown in Fig. 4A, the processing unit 120 determines whether the error is less than a predetermined value. When the error is too large, the finger 910 representing the user 900 has not been selected to the object 710; when the error is less than a certain degree, the finger 910 representing the user 900 has been clicked on the object 710. If the error is not less than the predetermined value, the process proceeds to step S106; if the error is less than the predetermined value, the process proceeds to step S107.

In step S106, as shown in FIGS. 4A to 4B, the processing unit 120 adjusts the object depth _dp and enlarges the area of the object 710. When the object depth _{dp is} too large (even greater than the finger depth _df ), the picture of the stereoscopic display 110 has no way to focus on the predetermined position of the object depth _dp , so that the object 710 will be obscured by the finger 910. This step adjusts the object aberration to change the depth _dp of the object so that the object 710 will be moved to a position far behind the finger 910 to prevent the object 710 from being obscured.

For example, refer to FIG. 4A ~ 4B of the processing unit 120 to adjust the aberration aberrations p p ', according to the above equation (1) the object depth d _p d _p is adjusted to the depth of the object' (object depth d _p 'less than the finger depth _df ) enables the object 710' to be stereoscopically imaged behind the finger 910. In an embodiment, the processing unit 120 may first reduce the object depth _dp ' to a certain extent, and then gradually increase the object depth _dp ' with time, so that the user 900 can gradually adapt to the position of the object 710'.

In addition, the processing unit 120 can also adjust the pattern width s to the pattern width s' such that the area of the object 710' is enlarged. After the area of the object 710' is enlarged, it is less easily obscured by the finger 910 to facilitate the user 900 to select the item 710'.

In step S107, when the error is less than the predetermined value, the processing unit 120 considers that the user 900 has triggered the object 710 or 710'.

Second embodiment

Referring to FIG. 5 and FIG. 6 , FIG. 5 is a flowchart of a method for processing a stereo interactive image according to the second embodiment, and FIG. 6 is a schematic diagram of the stereo image after the second embodiment is adjusted. The method for processing the stereo interactive image of the present embodiment is different from the method for processing the stereo interactive image of the first embodiment in that an indicator 800 is displayed to assist the user 900 in interacting, and the rest of the similarities are not repeated.

In steps S201-S202, the detecting unit 130 detects the finger depth _df and the viewing distance L, and the processing unit 120 calculates the object depth _dp .

In step S203, the processing unit 120 displays the indicator 800 according to the finger depth d _f . In this step, the processing unit 120 controls the indicator 800 and the indicator depth d _{t of the} stereoscopic display 120 to be substantially equal to the finger depth d _f . And when the finger 910 moves, the indicator 800 can move with the finger 910.

Since both the indicator 800 and the object 710 are images floating in front of the eyes, the user 900 can easily compare the difference between the indicator 800 and the object 710. In this way, even if the finger 910 obscures the object 710, the user 900 can select the object 710 by comparing the indicator 800 with the object 710 without any trouble.

In steps S204 to S207, when the processing unit 120 determines that the error between the object depth _dp and the finger depth _df is less than a predetermined value, it is considered that the object 710 has been triggered.

Third embodiment

Please refer to FIG. 7 and FIG. 8 . FIG. 7 is a flowchart of a method for processing a stereo interactive image according to a third embodiment, and FIG. 8 is a schematic diagram of the stereo image after the third embodiment is adjusted. The processing method of the stereo interactive image of the embodiment is different from the processing method of the stereo interactive image of the first embodiment in that the object 730 is presented in a stereoscopic manner to prevent the finger 910 from obscuring the object 730, and the rest of the same is not repeated.

In steps S301 to S302, the detecting unit 130 detects the finger depth d _f and the viewing distance L, and the processing unit 120 calculates the object depth d _p .

In step S303, the processing unit 120 adjusts the object depth _dp to a continuous interval (for example, a continuous interval of the object depth _dp to the object depth _dp ) so that the object 730 assumes a stereoscopic form and enlarges the area of the object 730.

For example, the processing unit 120 presents an object 710 (shown in FIG. 4A) at each position on a continuous interval of the object depth _dp to the object depth _dp " to form the object 730 in a stereoscopic form. If the finger 910 of the user 900 shields a portion of the object 730, the user 900 can still see a portion of the object 730.

In addition, the processing unit 120 can also enlarge the area of the object 730. After the area of the object 730 is enlarged, it is less easily obscured by the finger 910 to facilitate the user to click on the object 730.

In steps S304-S307, when the processing unit 120 determines that the error between the object depth _dp and the finger depth _df is less than a predetermined value, it is deemed that the object 710 has been triggered.

The above embodiments are described by taking the first to third embodiments as examples, but the present application is not limited thereto. For example, the indicator 800 of the second embodiment can be applied to the first embodiment and the third embodiment.

In summary, although the present invention has been disclosed above by way of example, it is not intended to limit the present invention. Those who have ordinary knowledge in the technical field of the present invention can make various changes and refinements without departing from the spirit and scope of the present case. Therefore, the scope of protection of this case is subject to the definition of the scope of the patent application attached.

100. . . Stereo interactive image system

110. . . Stereoscopic display

120. . . Processing unit

130. . . Detection unit

710, 730. . . object

800. . . index

900. . . user

910. . . finger

920. . . eye

p, p’. . . Aberration

d _f . . . Finger depth

d _p , d _p ', d _p ”... object depth

d _t . . . Indicator depth

e. . . Eye spacing

L. . . Viewing distance

s, s’. . . Pattern width

S101, S102, S130, S105, S106, S107, S201, S202, S203, S204, S205, S207, S301, S302, S303, S304, S305, S307‧‧‧ process steps

FIG. 1 is a schematic diagram of a stereoscopic interactive image system of the first embodiment.

FIG. 2 is a block diagram of the stereo interactive image system of the first embodiment.

FIG. 3 is a flow chart showing a method for processing a stereo interactive image of the first embodiment.

FIG. 4A is a schematic view showing the stereo image before the adjustment of the first embodiment.

FIG. 4B is a schematic diagram showing the adjustment of the stereo image of the first embodiment.

FIG. 5 is a flow chart showing a method for processing a stereo interactive image of the second embodiment.

FIG. 6 is a schematic diagram showing the adjustment of the stereoscopic image of the second embodiment.

FIG. 7 is a flow chart showing a method for processing a stereo interactive image of the third embodiment.

FIG. 8 is a schematic diagram showing the adjustment of the stereoscopic image of the third embodiment.

S101, S102, S103, S105, S106, S107. . . Process step

Claims (16)

A method for processing a stereoscopic interactive image, comprising: displaying a stereoscopic image by using a stereoscopic display, the stereoscopic image having an object; detecting, by a detecting unit, a finger of one of the user and a finger depth of the stereoscopic display and the using One of the human eyes is a viewing distance from the stereoscopic display; a processing unit calculates the object depth of the object and the stereoscopic display according to the viewing distance; and adjusts the depth of the object according to the depth of the finger by the processing unit, and adjusts the stereoscopic Image to move the object. The method for processing a stereoscopic interactive image according to claim 1, wherein in the step of adjusting the stereoscopic image, the depth of the object gradually changes with time. The method for processing a stereoscopic interactive image according to claim 1, wherein in the step of adjusting the stereoscopic image, the area of the object is further enlarged. The method for processing a stereoscopic interactive image according to the first aspect of the invention, wherein in the step of adjusting the stereoscopic image, an indicator is displayed according to the depth of the finger. The method for processing a stereoscopic interactive image according to claim 4, wherein in the step of adjusting the stereoscopic image, the indicator and one of the stereoscopic display depths are substantially equal to the finger depth. The method for processing a stereoscopic interactive image as described in claim 4, wherein in the step of adjusting the stereoscopic image, the indicator follows the Finger movement. The method for processing a stereoscopic interactive image according to claim 1, wherein in the step of adjusting the stereoscopic image, the object depth is adjusted to be a continuous interval, so that the object presents a stereoscopic form. The method for processing a stereoscopic interactive image according to claim 7, wherein in the step of adjusting the stereoscopic image, the area of the object is further enlarged. A stereoscopic interactive image system includes: a stereoscopic display for displaying a stereoscopic image, the stereoscopic image having an object; and a detecting unit for detecting a finger depth of one of the user's fingers and the stereoscopic display One of the user's eyes is away from the stereoscopic display; and a processing unit is configured to calculate the object depth of the object and the stereoscopic display according to the viewing distance, and adjust the object depth according to the finger depth, and adjust the A stereo image to move the object. The stereoscopic interactive image system of claim 9, wherein the processing unit controls the depth of the object to gradually change with time. The stereoscopic interactive image system of claim 9, wherein the processing unit enlarges the area of the object. The stereoscopic interactive image system of claim 9, wherein the processing unit displays an indicator according to the depth of the finger. The stereoscopic interactive image system of claim 12, wherein the processing unit controls the indicator and one indicator of the stereoscopic display The depth is substantially equal to the depth of the finger. The stereoscopic interactive image system of claim 12, wherein the processing unit controls the indicator to move with the finger. The stereoscopic interactive image system of claim 9, wherein the processing unit adjusts the depth of the object to a continuous interval to render the object in a stereoscopic form. The stereoscopic interactive image system of claim 15, wherein the processing unit enlarges the area of the object.