TWI493960B - Image processor for use in a frame sequential 3d display system and related 3d display system - Google Patents

Description

Image processor and related three-dimensional display system for field sequential three-dimensional display system

The invention relates to an image processor and related system for a field sequential three-dimensional display system, in particular to an image processor and related system for a field sequential three-dimensional display system without using a frame buffer for format conversion. system.

Three-dimensional (3D) display technology provides a more realistic visual experience than traditional two-dimensional (2D) display technology. In general, stereoscopic image processing involves at least two image systems, the image or film of which can be taken by two slightly different angles and positions, and then alternately output to the left and right eyes, the purpose of which is to simulate the position and angle of the human eye. The slight difference and feel the depth. In the aforementioned frame sequential three-dimensional display system, the two images are typically presented to the viewer via shutter glasses, respectively. The shutter glasses can use the electronically controlled liquid crystal material to make the left and right glasses, and the opening times of the left and right glasses are respectively synchronized with the display intervals of the left and right eye images, so that the viewer sees only the left eye. The left eye image, while the right eye only sees the right eye image, so that the viewer feels the depth illusion similar to real vision.

Most display devices, such as televisions, have a scan frequency of 60 Hz (eg, in the United States) or 50 Hz (eg, in some other countries outside the United States). In the normal two-dimensional mode, the field sequential TV updates the picture every 50 or 60 seconds to provide viewer motion pictures. In the 3D mode, the effective update frequency of the field sequential TV is reduced to half due to the need to provide individual images for the left and right eyes. Therefore, the field sequential three-dimensional display system needs to multiply the initial 2D video signal of 50/60 Hz to provide a 100/120 Hz multiplied two-dimensional video signal, and then process each of the multiplied two-dimensional video signals. A frame sequentially extracts the data, thereby providing a three-dimensional image signal containing 100/120 Hz of one of the corresponding left-eye and right-eye images.

1 is a functional block diagram of a prior art one-dimensional three-dimensional display system 100. The field sequential three-dimensional display system 100 includes an image source 110, an image processor 120, a field sequential display device 130, and shutter glasses 140. The image source 100 can provide an initial two-dimensional image signal S1 that includes a plurality of frames representing a picture. The image processor 120 includes a frame frequency converter 22, a frame buffer 24, and a two-dimensional/three-dimensional converter 26. The frame frequency converter 22 can insert a new frame between two adjacent parallel frames of the initial two-dimensional image signal S1, thereby generating a corresponding multiplied two-dimensional image signal S2 having a higher frame frequency. According to the multiplied two-dimensional image signal S2, the two-dimensional/three-dimensional converter 26 can generate a three-dimensional image signal S3 comprising two series of sequence frames, wherein the two series of sequence frames correspond to the left eye image and the right eye image, respectively. According to the three-dimensional image signal S3, the field sequential display device 130 can alternately display the left eye image and the right eye image, and then control the shutter glasses 140 such that the viewer sees only the left eye image in the left eye and the right eye only in the right eye. image.

FIG. 2 is a schematic diagram of the prior art image processor 120 in operation. It is assumed that the data of the initial two-dimensional image signal S1 is represented by a series of odd frames F ₁ to F _N-1 and a series of even frames F ₂ ～F _N (N is an even number), and the two series of frames are related to the field. The sequence display device 130 displays an image to be displayed. The prior art three-dimensional display system 100 requires the use of a frame buffer 24 to store frames F ₁ -F _N received in corresponding periods. In this way, the frame frequency converter 22 can output each frame of the frames F ₁ to F _N twice. As shown in Fig. 2, the multiplied two-dimensional video signal S2 contains twice the number of frames F ₁ , F ₁ , F ₂ , F ₂ , ... F _N and F _N . According to each pair of frames of the double-frequency two-dimensional image signal S2, the two-dimensional/three-dimensional converter 26 can convert the double-frequency two-dimensional image signal S2 into a corresponding three-dimensional image signal S3, which includes the left-eye image L ₁ ～ L _N and right eye images R ₁ to R _N . The opening and closing of the shutter glasses 140 is controlled by the left eye turn-on signal and the right eye turn-on signal.

There is usually a time difference between the input and output frame data, and the initial two-dimensional image signal S2 needs to be multiplied. Therefore, the prior art requires the use of the frame buffer 24 to store the data of each frame for a period of time so that the image processor 120 can output the correct data, but the frame buffer 24 increases the production cost.

The invention provides a field sequential three-dimensional display system comprising an image source, an image processor, and a display device. The image source is configured to provide an initial two-dimensional image signal including a plurality of first frames, and multiply the initial two-dimensional image signal to generate one of the double-frequency two-dimensional image signals. The image processor includes a two-dimensional/three-dimensional converter for receiving the double-frequency two-dimensional image signal, converting the double-frequency two-dimensional image signal into a series of left-eye images and a series of right-eye images, and outputting the image alternately The series of left eye images and the series of right eye images provide a three-dimensional image signal. The display device is configured to alternately display the series of left eye images and the series of right eye images according to the three-dimensional image signals.

The present invention further provides an image processor for a one-sequence three-dimensional display system, comprising a two-dimensional/three-dimensional converter for directly receiving a double-frequency two-dimensional image signal from an image source, and multiplying the frequency doubled image The image signal is converted into a series of left eye images and a series of right eye images, and the series of left eye images and the series of right eye images are alternately outputted to provide a three-dimensional image signal, wherein the double-frequency two-dimensional image signal and the three-dimensional image The signal has the same frame frequency.

FIG. 3 is a functional block diagram of a one-sequence three-dimensional display system 300 in the first embodiment of the present invention. The field sequential three-dimensional display system 300 includes an image source 310, an image processor 320, a field sequential display device 330, and shutter glasses 340. The image source 310 can provide an initial two-dimensional image signal S1 including a plurality of frames representing a picture, and then multiply the initial two-dimensional image signal S1 to generate a corresponding multi-frequency image signal S2. The image processor 320 includes a two-dimensional/three-dimensional converter 36 and a shutter controller 46. The two-dimensional/three-dimensional converter 36 can generate a three-dimensional image signal S3 comprising two series of sequence frames, wherein the two series of sequence frames correspond to the left eye image and the right eye image, respectively. According to the three-dimensional image signal S3, the field sequential display device 330 can alternately display the left eye image and the right eye image, and the shutter controller 46 can synchronously control the left and right eye lenses of the shutter glasses 340 so that the viewer sees only the left eye. Eye image, while the right eye only sees the right eye image.

FIG. 4 is a schematic diagram showing the operation of the image processor 120 according to the first embodiment of the present invention. It is assumed that the data of the initial two-dimensional image signal S1 is represented by a series of odd frames F ₁ to F _N-1 and a series of even frames F ₂ ～F _N (N is a positive even number), and the two series of frames are respectively related. The left-eye image and the right-eye image to be displayed by the field sequential display device 330. In the three-dimensional display system 300 of the present invention, the image source 310 may generate interpolated frame F ₁ '~ F _N' based on frame F ₁ ~ F _N, then the interpolated frame F ₁ '~ F _N' insertion two initial The image signal S1 is dimensioned to generate a multiplied two-dimensional image signal S2. As shown in FIG. 4, the multiplied two-dimensional video signal S2 sequentially includes frames F ₁ , F ₁ ', F ₂ , F ₂ ', ... F _N and F _N '. In an embodiment of the invention, the inner frame F ₁ '-F _N ' can be generated by copying the frames F ₁ -F _N respectively. In another embodiment of the present invention, specific image processing may be performed on the frames F ₁ -F _N to generate a better quality inset frame F ₁ '~F _N ', such as adaptive artifact masking technology. The artifacts in the inner frame can be faded, and the black stripe processing technique can remove the black stripes that are common around the inner frame, and the occlusion tracking technique can better reconstruct the movement of the edge of the frame. . At the same time, the opening and closing of the shutter glasses 340 is controlled by the left eye turn-on signal and the right eye turn-on signal.

In the sequential three-dimensional display system 300 of the first embodiment of the present invention, the image signals S1 S S3 may be analog signals with NTSC or PAL format, or analog or digital signals with other formats. The image source 310 can include any electronic device with an application hardware (such as a display card) that can support different frames per second (FPS); or any application software (such as Media Player) installed. An electronic device that can display images in different modes. Since the image source 310 can provide the frequency multiplication processing, the image processor 320 of the present invention can perform the two-dimensional/three-dimensional conversion directly according to the double-frequency two-dimensional image signal S2 transmitted from the image source 310, without using the frame buffer. .

As described above, the multiplication operation in the present invention is performed by the image source 310, and the two-dimensional/three-dimensional format conversion is performed by the image processor 320. In the double-frequency two-dimensional image signal S2, two adjacent frames may belong to the same frame pair, and a corresponding pair of left and right eye images may be respectively extracted (for example, from two adjacent frames F ₁ and F ₁ ' respectively撷Receive the left eye image L ₁ and the right eye image R ₁ ); or, the two adjacent side frames may belong to different frame pairs, and the left eye images of the corresponding left and right eye images and another the left and right eye image corresponding to the image of the eye (e.g. from two adjacent frame F ₁ 'and F _2, respectively, capture an eye image R ₁ and the left eye image L _2). Therefore, the present invention needs to be able to recognize the relationship between two adjacent frames, so as to ensure that the operation of the shutter glasses 340 is synchronized with the three-dimensional image signal S3.

Figure 5 is a functional block diagram of a one-sequence three-dimensional display system 500 in a second embodiment of the present invention. The field sequential three-dimensional display system 500 includes an image source 310, an image processor 520, and a one-segment display device 330. Compared with the first embodiment of the present invention, the image processor 520 of the second embodiment of the present invention further includes an identical frame detector 38. The same frame detector 38 can analyze the image characteristics of the comparison frames F ₁ -F _N and F ₁ '-F _N ' for a predetermined period of time, and then identify the corresponding maps in the double-frequency two-dimensional image signal S2. Box right. Then, the same frame detector 38 can instruct the two-dimensional/three-dimensional converter 36 to start format conversion, and the shutter controller 46 can operate the shutter glasses 340 to synchronize the opening and closing of the left and right eyeglasses to the corresponding left and right eyes. image.

FIG. 6 is a schematic diagram of the operation of the image processor 520 of the present invention. The same frame detector 38 can perform image characteristic analysis on the double-frequency two-dimensional image signal S2 for a predetermined period of time, for example, analyzing the first n frame pairs F ₁ , F ₁ ', F ₂ , F ₂ ', .. ., F _n and F _n ' (n is an integer less than N) image characteristics. The same frame detector 38 performs image characterization based on the checksum, histogram, or other image features of the frame. For three consecutive frames (for example, F ₁ , F ₁ ', and F ₂ ) in the double-frequency two-dimensional image signal S2, since the frame F ₁ ' is directly copied from the frame F ₁ or according to the frame F ₁ The resulting image frame, therefore, the image characteristics of the frame F ₁ 'and the image characteristics of the frame F ₁ will be identical or very small, but not the same as the image characteristics of the frame F ₂ . Therefore, if the image characteristics of two adjacent frames in the double-frequency two-dimensional image signal S2 are the same or the difference is very small, the frame detector 38 recognizes the two adjacent parallel frames as belonging to the same corresponding frame pair. Then, the two-dimensional/three-dimensional converter 36 can start to format the frame F _n+1 '~F _N ', and the shutter controller 46 can operate the shutter glasses 340 to synchronize the opening/closing of the left and right glasses to the corresponding ones. The left and right eye images are shown in the left eye open signal and the right eye open signal in Fig. 6.

In the embodiment shown in FIG. 6, the same frame detector 38 can perform image characteristic analysis on three consecutive frames (for example, F ₁ , F ₁ ', and F ₂ ) in the double-frequency two-dimensional image signal S2. Then identify the corresponding frame pair. In other embodiments of the present invention, the same frame detector 38 may be directed to more consecutive frames in the double-frequency two-dimensional video signal S2 (eg, F ₁ , F ₁ ', F ₂ , F ₂ ', ..., F _n , F _n ') perform image characteristic analysis, thereby improving the recognition accuracy of the corresponding frame pair.

The present invention is applicable to a glass field sequential three-dimensional display system that uses shutter glasses to provide a stereoscopic effect, as shown in FIGS. 3 to 6. However, the present invention is also applicable to other kinds of three-dimensional display systems, such as a naked-eye directional backlight time sequential three-dimensional display system or a time multiplexed three-dimensional projector (time- Multiplexed polarizer 3D projector).

In the field sequential three-dimensional display system of the present invention, the frequency multiplication operation is performed by the image source, and the image processor can directly perform the image format conversion according to the double frequency two-dimensional image signal transmitted from the image source, so no image is needed. Frame buffer.

The above are only the preferred embodiments of the present invention, and all changes and modifications made to the scope of the present invention should be within the scope of the present invention.

twenty two. . . Frame frequency converter

twenty four. . . Frame buffer

26, 36. . . 2D/3D converter

38. . . Same frame detector

46. . . Shutter controller

100, 300, 500. . . Field sequential three-dimensional display system

110, 310. . . Image source

120, 320, 520‧‧‧ image processor

130, 330‧‧‧ Field sequential display device

140, 340‧‧‧ shutter glasses

Figure 1 is a functional block diagram of a prior art one-dimensional three-dimensional display system.

Fig. 2 is a schematic view showing the operation of the prior art three-dimensional display device.

Figure 3 is a functional block diagram of a one-sequence three-dimensional display system in the first embodiment of the present invention.

Fig. 4 is a schematic view showing the operation of the image processor of the first embodiment of the present invention.

Figure 5 is a functional block diagram of a one-sequence three-dimensional display system in a second embodiment of the present invention.

Figure 6 is a schematic diagram showing the operation of the image processor of the second embodiment of the present invention.

36. . . 2D/3D converter

38. . . Same frame detector

46. . . Shutter controller

310. . . Image source

330. . . Field sequential display device

340. . . Shutter glasses

500. . . Field sequential three-dimensional display system

520. . . Image processor

Claims (8)

A frame sequential three-dimensional display system includes: an image source for providing an initial two-dimensional image signal including a plurality of first frames, and multiplying the initial two-dimensional image signal by Generating a frequency doubling two-dimensional image signal; an image processor comprising: a two-dimensional/three-dimensional converter for receiving the double-frequency two-dimensional image signal, converting the double-frequency two-dimensional image signal into a series of left signals An eye image and a series of right eye images, and alternately outputting the series of left eye images and the series of right eye images to provide a three-dimensional image signal; and an identical frame detector for using the double-frequency two-dimensional image signal Identifying a corresponding frame pair, and instructing the two-dimensional/three-dimensional converter to convert the corresponding frame pair into one of the three-dimensional image signals corresponding to the left-eye image and a corresponding right-eye image; And a display device for alternately displaying the series of left eye images and the series of right eye images according to the three-dimensional image signals. The field sequential three-dimensional display system of claim 1, wherein the image source is further configured to provide a plurality of second frames related to the plurality of first frames, and insert each second frame into two phases. Corresponding to the first frame to generate the multiplied two-dimensional image signal. The field sequential three-dimensional display system of claim 1, wherein the same frame detector is configured to compare image characteristics of three consecutive frames in the double-frequency two-dimensional image signal, and then in the double-frequency two-dimensional image The corresponding frame pair is detected in the image signal. The field sequential three-dimensional display system of claim 1, wherein the same frame detector is used to compare image characteristics of n consecutive frames in the double-frequency two-dimensional image signal, and then in the double-frequency two-dimensional image The corresponding frame pair is detected in the image signal, where n is an integer greater than one. The field sequential three-dimensional display system of claim 1, further comprising a shutter glasses, wherein: when the corresponding right eye image is displayed, one of the shutter glasses has an electronically controlled right lens that is turned on, and the One of the shutter glasses has an electronically controlled left eyeglass lens that is closed; and when the corresponding left eye image is displayed, the left eyeglass lens is turned on, and the right eyeglass lens is turned off. An image processor for a sequential three-dimensional display system, comprising: a two-dimensional/three-dimensional converter for directly receiving a double-frequency two-dimensional image signal from an image source, and converting the double-frequency two-dimensional image signal a series of left eye images and a series of right eye images, and alternately output the series of left eyes The image and the right eye image of the series provide a three-dimensional image signal, wherein the double-frequency two-dimensional image signal and the three-dimensional image signal have the same frame frequency; and an identical frame detector for comparing the double-frequency image Image characteristics of three consecutive frames in the image signal, and then identifying a corresponding frame pair in the double-frequency two-dimensional image signal, and then instructing the two-dimensional/three-dimensional converter to map the corresponding frame Converting to one of the three-dimensional image signals corresponds to the left eye image and a corresponding right eye image. The image processor of claim 6, wherein the same frame detector is configured to compare image characteristics of n consecutive frames in the double-frequency two-dimensional image signal, and further in the double-frequency two-dimensional image signal Detecting the corresponding pair of frames, and n is an integer greater than one of three. The image processor of claim 6, further comprising a shutter glasses, wherein: when the corresponding right eye image is displayed, one of the shutter glasses is automatically opened, and the shutter glasses are opened One of the electronically controlled left eyeglasses is closed; and when the corresponding left eye image is displayed, the left eyeglass is turned on and the right eyeglass is closed.