TWM667285U - Auto-stereoscopic display device for spatial video file conversion - Google Patents

Abstract

A naked-eye stereoscopic display device for spatial video file conversion has an AI device for receiving spatial video files. The AI device has an AI calculation module and a database built in. The AI calculation module builds an AI image model through the information in the database, and the AI calculation module can convert the input spatial video file into an SBS stereoscopic image format according to the AI image model and output it to a display. A naked-eye stereoscopic imaging film is attached to the surface of the display to present a naked-eye stereoscopic image.

Description

Auto-stereoscopic display device for spatial video file conversion

This work is related to the technical field of auto-stereoscopic 3D images, especially to an auto-stereoscopic stereoscopic display device used for spatial video file conversion.

According to the current stereoscopic display device, it mainly uses certain digital processing to make it present a stereoscopic visual effect. Stereoscopic vision is the feeling of being able to distinguish the shape of an object when viewing it with both eyes (binocular vision). The left and right eyes receive different images respectively, and after the brain overlaps them, the layering and depth of the object are perceived, thereby experiencing the three-dimensional feeling of the object. Therefore, the stereoscopic display device needs to separate the left and right eye signals and be received independently by the left and right eyes of the person, so that the viewer can obtain the stereoscopic vision of the object.

The current stereoscopic display devices can be roughly divided into head-mounted and naked-eye technology. The development history of head-mounted technology is quite long. Early 3D movies used anaglyph glasses to present the three-dimensional effect of images. However, since the anaglyph technology can only present the effect on a grayscale or monotonous color background, most of the current polarizing glasses technology is used. Polarizing glasses with different polarization angles are used on the left and right sides. The film itself also uses two projectors to project light with different polarization directions to different columns of pixels, so that the left and right eyes can only see vertical or horizontal polarized light, respectively, to present a three-dimensional effect. In addition, there is also a head-mounted display technology that uses a small screen in front of each eye to provide different independent images for each eye, thereby achieving an excellent three-dimensional visual effect.

In recent years, products that use LCD displays as real-time information output interfaces have been continuously updated, such as the spatial video shooting function released by Apple in September 2023. Videos are recorded through the main lens and ultra-wide-angle lens of the company's image capture device (such as iPhone or Apple Vision Pro), and the field of view of the ultra-wide-angle lens is zoomed to match the field of view of the main lens. The position information of the photographed object is collected by an RGB lens and a laser laser, and the position information of the photographed object on the X-axis, Y-axis, and Z-axis is calculated through its internal calculation program, and the content is then stored in a single video file to record a spatial video. However, if you want to watch spatial videos shot by an iPhone, you must use it with the Apple Vision Pro head-mounted display also sold by Apple to present its three-dimensional visual effect. However, its exclusive head-mounted display is expensive and not affordable for ordinary consumers. In addition, the head-mounted display is large and heavy, which may cause users to feel uncomfortable wearing it and unable to use it for a long time.

On the other hand, auto-stereoscopic display technology can present the visual effect of three-dimensional images without wearing glasses or head-mounted displays. Its basic principle is to use methods such as blocking and refraction to guide part of the light so that the two eyes see two pictures with parallax information, thereby producing a three-dimensional visual effect. For example, the SBS stereoscopic image format composed of the left eye image and the right eye image arranged side by side (SBS) can be pre-arranged, and matched with a naked-eye stereoscopic imaging film composed of a cylindrical lens grating pasted on the naked-eye 3D screen. Through the light-splitting effect of the cylindrical lens, two patterns with parallax information can be projected to the viewer's left and right eyes respectively, that is, the left eye receives the light of the left eye viewing pixel, and the right eye receives the light of the right eye viewing pixel, and images with parallax are formed on the left and right eye retinas respectively. The brain will judge the distance of the object according to the angle of parallax, establish the relative distance of each object, and produce a stereoscopic visual effect.

However, the naked-eye 3D display technology must use at least two cameras to capture images with parallax. The spatial videos shot by the iPhone are 3D format videos shot with dual lenses with a fixed pupil distance. It is easy for the images to be out of focus and blurred because the content is closer to one of the lenses of the phone. However, the spatial videos shot by the iPhone do not need to be very precise in focus. This is because the left and right images shot by the dual lenses are only used for the Apple Vision head-mounted display with two screens. When the iPhone Pro is played, the human brain will automatically focus the image seen by both eyes; however, on a naked-eye 3D screen, when the human eye focuses on the foreground, the background will inevitably be out of focus and blurred, and vice versa. Therefore, it is not suitable to directly convert the spatial video shot by the iPhone into the naked-eye SBS stereoscopic image format.

In view of this, how to solve the above problems is the primary issue that this creation wants to solve.

The purpose of this creation is to provide a naked-eye stereoscopic display device for spatial video file conversion. By using an AI device, Apple's spatial video files can be directly converted and its 3D stereoscopic images can be ensured to be clear, allowing users to view the stereoscopic image content directly on the display screen through a naked-eye stereoscopic imaging film.

To achieve the above-mentioned purpose, this invention provides a naked-eye stereoscopic display device for spatial video file conversion, including:

An AI device, for receiving a spatial video file, the AI device having an AI calculation module and a database that are informationally linked to each other, the AI calculation module constructing an AI image model through information in the database, and the AI calculation module can convert the input spatial video file into an SBS stereoscopic image format according to the AI image model;

A display is electrically connected to the AI device, and the converted SBS stereoscopic image format is used to map each pixel of the left and right images to the corresponding position of the display through a multimedia playback module, and a naked-eye stereoscopic imaging film is attached to the surface of the display to present a naked-eye stereoscopic image through the naked-eye stereoscopic imaging film.

Furthermore, the spatial video file has a first image and a second image. The AI calculation module performs image analysis and feature classification on the first image and the second image in the input spatial video file according to the AI image model. At the same time, the AI calculation module adjusts the image clarity of the foreground and the background in each image separately based on the position information of the first image and the second image. Then, the first image and the second image after the clarity adjustment by the AI calculation module are synthesized and converted into an SBS stereoscopic image format that can be mapped with a naked-eye stereoscopic imaging film.

Preferably, the autostereoscopic imaging film is formed of a light column optical film, so that convex lens shapes connected to each other in sequence are formed on the autostereoscopic imaging film.

Preferably, the display can be composed of one of a mobile phone screen, a computer screen, a TV screen, an electronic photo frame screen or an electronic book screen.

The above-mentioned purposes and advantages of the present invention can be easily understood from the detailed description and accompanying drawings of the following selected embodiments.

As shown in FIGS. 1 and 2, the auto-stereoscopic display device provided by the present invention for converting spatial video files mainly uses an AI (artificial intelligence) device 11 to parse and edit the spatial video files released by Apple Inc., and then converts them into an SBS stereoscopic (3D) image format, and outputs the SBS stereoscopic image format to a display 21. A auto-stereoscopic imaging film 31 is attached to the surface of the display 21, and the auto-stereoscopic imaging film 31 can present auto-stereoscopic images, wherein:

Apple's spatial video files are recorded by simultaneously recording videos with the main lens and ultra-wide-angle lens of its image capture device (such as iPhone or Apple Vision Pro), zooming the ultra-wide-angle lens's field of view to match that of the main lens, and using an RGB lens and a laser to collect the position information of the photographed object. The position information of the photographed object's X-axis, Y-axis, and Z-axis is calculated through its internal calculation program, and then the content is stored in a single video file. A spatial video file containing a first image for left eye viewing and a second image for right eye viewing can be recorded, and the first image and the second image are respectively embedded with the corresponding X-axis, Y-axis, and Z-axis position information.

The AI device 11 of the present invention is composed of an electronic device (such as a host with computing capabilities such as a computer or server) with built-in artificial intelligence programs and algorithms. The AI device 11 is used to receive spatial video files from Apple. The AI device 11 has an AI calculation module 12 and a database 13. The AI calculation module 12 can analyze the information in the database 13 and input a large amount of 2D image data into the database 13 to train/learn and build an AI image model 14, so that the AI calculation module 12 can analyze the input spatial video files (Spatial Video) according to the AI image model 14. The first image and the second image in the video are analyzed and classified for features, and the AI calculation module 12 simultaneously adjusts the image clarity of the foreground and the background in each image according to the position information of the first image and the second image, and then makes the first image and the second image clear. Then, the first image and the second image after the clarity adjustment by the AI calculation module 12 are synthesized and converted into an SBS (Side by Side) stereoscopic image format that can be mapped to the naked-eye stereoscopic imaging film 31. In other words, the present invention does not use traditional methods such as light and shadow, depth map, etc. to establish a 3D model, but uses the AI image model 14 established by the AI device 11 through big data to more easily and quickly obtain the angle images that the left and right eyes deserve.

When a sufficiently large amount of 2D image data is input into the database, the AI calculation module 12 can automatically generate a corresponding second image (e.g., a right eye image) based on only the first image (e.g., a left eye image) according to the AI image model 14, and then synthesize the first image and the automatically generated second image through the AI calculation module 12 to convert them into an SBS (Side by Side) stereoscopic image format that can be mapped to the auto-stereoscopic imaging film 31.

In practical application, the naked-eye stereoscopic imaging film 31 is composed of a light column optical film, so that the naked-eye stereoscopic imaging film 31 is formed with convex lens shapes connected to each other in sequence. By attaching the naked-eye stereoscopic imaging film 31 to the surface of the display 21 which can be composed of a mobile phone screen, a computer screen, a TV screen, an electronic photo frame screen or an electronic book screen, the converted SBS stereoscopic image format can be further displayed through a multimedia dial The playback module (App) maps each pixel of the left and right images to the corresponding position of the display 21, and then uses the refraction principle through the auto-stereoscopic imaging film 31 to project the first image and the second image with parallax information to the left and right eyes of the viewer respectively. The viewer's brain then processes the parallax information to present the visual effect of a auto-stereoscopic image.

From the above description, it can be known that this invention allows users to convert spatial video files shot by iPhone into SBS stereoscopic image format that can be directly played on the display 21 attached with the auto-stereoscopic imaging film 31, and thus there is no need to purchase the expensive Apple Vision Pro, and the stereoscopic visual effect of auto-stereoscopic 3D images can be presented on a general display 21. At the same time, it can effectively solve the problem that the image is out of focus and blurred when shooting with the dual lenses of the iPhone, which is not conducive to playing and viewing on the auto-stereoscopic imaging film 31, and is very practical.

However, the disclosure of the above embodiments is only used to illustrate the present invention, and is not used to limit the present invention. Any replacement of equivalent components should still fall within the scope of the present invention.

In summary, those familiar with the technology in this field can understand that this creation can indeed achieve the above-mentioned purpose and actually complies with the provisions of the Patent Law, so an application is filed in accordance with the law.

11: AI device 12: AI calculation module 13: Database 14: AI image model 21: Display 31: Naked stereo imaging film

Figure 1 is a block diagram of the composition structure of this creation. Figure 2 is a schematic diagram of the usage status of this creation.

11: AI device

12: AI calculation module

13: Database

14: AI image model

21: Display

31: Naked stereo imaging film

Claims (4)

A naked-eye stereoscopic display device for spatial video file conversion includes: An AI device for receiving a spatial video file, the AI device having an AI calculation module and a database that are informationally linked to each other, the AI calculation module constructs an AI image model through the information in the database, and the AI calculation module can convert the input spatial video file into an SBS stereoscopic image format according to the AI image model; A display, electrically connected to the AI device, and the converted SBS stereoscopic image format is mapped to the corresponding position of the display by each pixel of the left and right images through a multimedia playback module, and a naked-eye stereoscopic imaging film is attached to the surface of the display, so that a naked-eye stereoscopic image can be presented through the naked-eye stereoscopic imaging film. A auto-stereoscopic display device for converting spatial video files as described in claim 1, wherein the spatial video file has a first image and a second image, and the AI calculation module performs image analysis and feature classification on the first image and the second image in the input spatial video file according to the AI image model, and the AI calculation module also performs image clarity adjustment for the foreground and the background in each image based on the position information of the first image and the second image, and then synthesizes and converts the first image and the second image after the clarity adjustment by the AI calculation module into an SBS stereoscopic image format that can be mapped with a auto-stereoscopic imaging film. As described in claim 1, the auto-stereoscopic display device used for spatial video file conversion, wherein the auto-stereoscopic imaging film is composed of a light column optical film, so that the auto-stereoscopic imaging film is formed with convex lens shapes connected to each other in sequence. A auto-stereoscopic display device for spatial video file conversion as described in claim 1, wherein the display can be composed of one of a mobile phone screen, a computer screen, a TV screen, an electronic photo frame screen or an electronic book screen.

Images