WO2013071939A2

WO2013071939A2 - Method and a system for displaying and watching three-dimensional images on the screen

Info

Publication number: WO2013071939A2
Application number: PCT/EE2012/000006
Authority: WO
Inventors: Leonid KUNIN
Original assignee: Oü Unipower
Priority date: 2011-10-11
Filing date: 2012-12-17
Publication date: 2013-05-23
Also published as: WO2013071939A3; EE201100067A; WO2013071939A8

Abstract

The invention provides method and system to enable a user to form 3D image frames sequence in a device comprising any type of screen and watch the 3D image on the screen of this device using respectively configured glasses. More precisely the invention is related to means to mark video frames used in displaying of 3D image, to display these markers to the screen, to detect the markers, to watch the frames by respective watching glasses and to synchronize of the frames. ˙

Description

A METHOD AND A SYSTEM FOR DISPLAYING AND WATCHING

THREE-DIMENSIONAL IMAGES ON THE SCREEN

The field of technology

The present invention relates to the field of technology, and the purpose of the method and the system of the invention is to provide the user with a tool for creating a sequence of frames of a three-dimensional image and to view these 3D images on any type of a screen, stationary or portable. Moreover, this invention involves tools for marking the video frames that are used for showing a three-dimensional image, tools for displaying these on the screen, detecting the markers, watching the images with special glasses and synchronising the frames. To create a 3D image, the initial image has to be split in two - one for the right and the other for the left eye, while every eye may only see the frame / image that is meant for this eye.

State of the art

US 201 1 122238 discloses a 3D glasses device with shutter, which is wirelessly connected to a 3D video display. The glasses feature a slave clock that is coordinated with the master clock of the video display. The interconnection may be using Bluetooth. The shutter glasses receive the screen information and the timestamp of the 3D frame that is compared to the master clock that is in accordance with the time the frames are displayed. The opening and closing of shutters in the shutter glasses is controlled using the slave clock and the received information. The received screen info contains data about the left, the right and / or an empty frame, the temporal succession of frames, the frame refresh rate and the delay for opening and / or closing the shutters.

CN 101977331 discloses general 3D glasses. These glasses contain a frame, a left liquid crystal lens, a right liquid crystal lens, a signal receiver and a control processor that is mounted in the frame. It also includes a data recording module that is used for saving the 3D synchronisation protocol according to different models and different original formats, and a signal comparison module for comparing the received and the previously saved signal in order to find a compatible data protocol for controlling the right and the left side of the glasses. CN 101938667 discloses a processing method of the 3D video signal, and a device for this method. The method contains the following steps: connecting an external 3D digital video signal source and reception; determining the signal format; receiving and saving the signal; multidimensional signal processing; processing the time characteristics of the signal; forwarding the signal to the output etc. This invention offers effective means for displaying digital 3D video with a traditional TV without modifications. A prerequisite for the state of the art applications is that the screen transmitting the image has to be equipped with a signal processing unit that detects the frame sequence and controls the glasses. In the existing glasses, only one side is synchronised and the other is switched based on a timer. Various equipment manufacturers process the left and right frames and their sequence differently, therefore the glasses manufactured by one of them can only be used for viewing a picture from a device from the same manufacturer. Infrared signal is used for syncing with the glasses, therefore the viewing angle is limited, because the infrared signal does not spread as well as the radio signal. The switching frequency for the glasses is limited to the range of 100-120 Hz.

The invention

The purpose of this invention is to provide a method and a device for viewing a 3D image displayed by a device, which may or may not have integrated 3D signal processing hard- and software. The cooperation between the original algorithm of the media device, the contrast marker reading sensor and the 3D glasses provides 3D effects from any type of screens.

The second purpose of this invention is to provide such glasses for viewing 3D images, where the signals for every eye is sychronised separately and independently. Additionally, the switching frequency of the glasses described here is adjusted automatically, according to the incoming frame refresh rate, which enables the usage of screens with very different frame refresh rates. The glasses are controlled by either infrared or radio waves. According to one realisation of the invention, the glasses feature a built-in circuit diagram for reception and playback of audio through headphones with sound and video synchronised.

The method of the invention includes the following stages:

- for each incoming frame a visible contrast marker is created with the multimedia device;

- the picture frames or its parts are marked with visible contrast markers before the start of processing the sequence of frames;

- the contrast marker is added to the incoming 3D frames so that for the frames of the left eye one marker and a different one for the frames of the right eye will be added, the contrast markers of the left and the right eye are of different color - any two colors that can be displayed on the screen;

- the contrast markers are detected with a sensor near the screen; - the transmitter that is connected to the sensor sends left, right and / or blank screen signals to the glasses. According to these signals, the shutter of the left or the right side is opened, or both shutters are closed.

This invention allows us to see 3D images also from screens of devices without a signal processing circuit. The cost of the sensing block and the glasses described by this invention is significantly lower than that of a new 3D device. Any multimedia device is able to generate the sync impulses needed for driving the glasses.

Brief description of the drawings

Fig. 1A shows a video frame for the left eye;

Fig. 1 A shows a video frame for the right eye;

Fig. 2A shows a video frame with a contrast marker for the left eye;

Fig. 2B shows a video frame with a contrast marker for the right eye;

Fig. 3 shows a side-by-side video frame with contrast markers;

Fig. 4 shows a sequence of video frames from the side-by-side frames by the decoder of the media device;

Fig. 5 shows one of the preferred possibilities of devices needed for implementing the method from this invention;

Fig. 6 shows one of the preferred block diagrams for a device that detects and transmits the sync impulses needed for the implementation of the method from this invention;

Fig. 7 shows an alternative video frame with a contrast marker;

Fig. 8 shows an alternative video frame with a contrast marker.

An example of the invention

Fig. 1A and Fig. IB respectively show the left and the right video frames that are the base of the 3D images. Fig. 2A shows one of the preferred implementations of a video frame for the left eye with a contrast marker 1 , and the Fig. 2B shows a video frame for the right eye with a contrast marker 2. According to the preferred implementation, the contrast markers 1 and 2 can be placed anywhere along the peripheral part 3 of the screen.

Fig. 5 shows one of the preferred versions of the device by this invention, together with a 3D screen. The frames or parts of frames (Fig. 1 A and Fig. IB) shall be marked in the multimedia device with contrast markers visible to 4 sensors before processing the sequence of frames. During the processing of the frames, the sequence of frames, compared to that entering the media device, might change. During processing, one sequence for the left and another for the right eye is created (see Fig. 3). These possible changes in the sequence do not change the previously added contrast markers, and therefore even after this possible change in the sequence of the frames, the contrast markers for the left and the right eye are saved (see Fig. 4)·

The media device is programmed to generate and add contrast markers 1 and 2 to video frames. Contrast markers that will then be forwarded to the displaying device 6 via connection cable 5. For each of the video frames for the left eye 7, a marker 1 in the visible part of the frame, and for each of the video frames for the right eye 8, a marker 2 in the visible part of the frame will be added. Any digital standard video data decoding device, such as a media player, personal computer or a mobile device processor is suitable for generating and processing the contrast markers, and rearranging the frames.

A special video image processing algorithm according to the method of this invention has to be programmed to generate the contrast markers and add these to the frames. The frame displaying method that uses contrast markers allows for exact identification of each of the frames in a sequence of several frames. More precisely, thanks to this method, both eyes see exactly the frame they are supposed to see.

Contrast markers 1 and 2 can be placed along the peripheral part of the displayed image or along the screen edge (see Fig. 2A, Fig. 2B). The contrast marker is in the visible part of the image, but the viewer does not see it, because it is covered by the sensor or coded in a way that is unnoticeable to the human eye.

The sensor 9 is used for detecting the contrast markers 1 , 2 that are displayed on the screen. The eye-specific information on the screen 6 is read by the sensor 9. It is operated based on an optical principle, it detects changes in the brightness of the markers.

Kontrastmarkide kasutamine kaadris annab voimaluse kontrastmarkide heleduse pohjal maarata kaadri alguse ja lopu nii parema kui ka vasaku silma jaoks. Mootes kontrastmarkide heledust voib maarata kontrastmargi heleduse korvalekallet (Δ) maksimaalsest heledusest ja maarata kaadrisageduse korvalekalde ekraanil.

The use of the contrast markers in the picture frame based on the brightness of the contrast markers enables to determine the beginning and the end of the frame both for the right and for the left eye. By measuring the brightness of the contrast markers it can be detected the deviation (Δ) of the brightness of the contrast marker from the maximum brightness and determine the deviation of the frame frequency on the screen

Based on this optical information, the electronic circuit of the sensor creates series of commands for the 3D glasses. The impulse generator connected to the sensor 9, and the transmitter 10 detect the contrast markers of the left and the right eye and forward the corresponding impulses to the 3D glasses 1 1 receiver 12 that is connected to the driver circuit (not on the drawing). This driver circuit controls the opening and closing of either of the shutters, so that both eyes only see the signals intended for them.

In addition to the sync impulses driver circuit, an audio receiver and an amplifier for headphones might also be included in the glasses. Commands can be forwarded to the glasses at different frequencies (infrared and radio frequency, incl. Bluetooth, etc.).

The system (see Fig. 5) according to this invention, includes a media player 4, a display device with a screen 6 of any type, a sensor for reading the contrast markers on this screen, an impulse transmitter 10, 3D glasses 1 1. The sensor 9, the impulse generator and transmitter 10 can be separate or integrated into a single housing. An integrated version is depicted on the Fig. 6, where the sensor for contrast markers, the marker impulse generator and transmitter 10 are integrated into the same housing. A block diagram that, in the preferred implementation, consist of the following blocks: a sensor 13, a sync impulse transmitter 14, an USB interface 15, a SD card interface 16, a DRM (Digital Rights Management) block 17.

The elements of the system of this invention - the media player, the screen, the impulse generator and transmitter, and the glasses have built-in feedback.

The preferred implementations of this invention are considered illustrative and non-restrictive in all respects, and all the variations and modifications of the invention that are within the meaning of the scope of this patent claim shall be covered by it.

Claims

PATENT CLAIMS

1. A method for creating and viewing a three-dimensional image on the screen, for which 3D glasses are used the method comprises following steps:

- with the media device (4) contrast markers (1 , 2) are generated and added to the video frames before the subsequent processing, so that for each frame meant for the left eye (7), a contrast marker (1) is added to the visible part, and for each frame for the right eye (8), a contrast marker (2) is added to the visible part;

- the frame sequence with contrast markers is transmitted via connection cable (5) to a device with screen (6);

- the markers displayed on the screen for the left and the right eye are detected with a sensor for contrast markers (9);

- sync impulses are generated based on these contrast markers;

- the sync impulse generator and transmitter (10) transmits the corresponding signals to the receiver (12) of the 3D glasses (1 1);

- the driver circuit of the receiver (12) and the glasses controls the opening of shutters, so that if the receiver (12) receives an impulse that was generated based on a contrast marker for the left eye, the shutter of the left eye is opened, and if the receiver (12) receives an impulse that was generated based on a right eye contrast marker, the right shutter is opened; and if the receiver (12) receives an impulse that was generated based on a blank screen contrast marker, both shutters will be closed.

2. The method of claim 1 , wherein the contrast markers can be placed anywhere along the peripheral part of the screen (3).

3. The method of claim 1 , wherein the driver circuit of the receiver (12) and the glasses is used for controlling an audio signal receiver and an amplifier for headphones.

4. The method in claim 1 , wherein sync impulses are transmitted to the receiver (12) using one of the following frequencies: infrared, radio frequency, incl. Bluetooth.

5. A system for creating and viewing TV images that comprises a media device (4), a device with a screen (6) and 3D glasses for viewing, that differs by the fact that the media device (4) is configured to generate and add contrast markers (1 , 2) to video frames, to transmit these markers via a connection cable (5) to the device (6), so that to each video frame for the left eye (7) a visible contrast marker (1 ) is added to the visible part of the video frame, and to each video frame for the right eye (8) a contrast marker (2) is added to the visible part of the video frame. The system includes the contrast markers (1 , 2), a sensor (9), a sync impulse generator and transmitter (10) from the markers (1 , 2), a receiver of these sync impulses (12) and accordingly synced 3D glasses (1 1 ).

6. The system of claim 5, wherein the sync impulse generator and transmitter (10) includes a sync impulse transmitter 12, an USB interface 15, a SD card interface 16, a DRM (Digital Rights Management) block 17.

7. The system of claim 5, wherein the sensor (9) and the sync impulse generator and transmitter (10) are integrated into a single block.

8. The system of claim 5, wherein the left and the right side of the 3D glasses are

synchronised independently.

9. The system of claim 5, wherein the parts of the system are with feedback.

10. The system of claim 5, wherein the switching frequency of the left, the right and the blank frame in the 3D glasses is set according to the frequency of the frames received by the media device, and by the frequency of the frames processed in the media device.