CN112102160A

CN112102160A - Video processing method and device adaptive to 720 capsule type screen and related products

Info

Publication number: CN112102160A
Application number: CN202011282124.5A
Authority: CN
Inventors: 吴晓斌; 林华
Original assignee: Shouwang Experience Technology Culture Co ltd
Current assignee: Shouwang Experience Technology Culture Co ltd
Priority date: 2020-11-16
Filing date: 2020-11-16
Publication date: 2020-12-18
Anticipated expiration: 2040-11-16
Also published as: CN112102160B

Abstract

The embodiment of the application provides a video processing method and device adaptive to a 720 capsule type screen and a related product, wherein the video processing method comprises the following steps: acquiring a video frame image of a video to be processed; carrying out UV conversion on the video frame image to obtain a video frame UV map; from the video frame UV map, a video file is generated for presentation on the inner surface of the capsule-type screen at 720. Through the scheme, the shot and manufactured films can be seen in a panoramic immersive mode on the 720 capsule type screen, correct watching in the 720 capsule type screen is guaranteed, distortion is avoided, and a user can obtain good panoramic immersive video watching experience when watching the films on the 720 capsule type screen.

Description

Video processing method and device adaptive to 720 capsule type screen and related products

Technical Field

The embodiment of the application relates to the technical field of display, in particular to a video processing method and device adaptive to a 720 capsule type screen and a related product.

Background

The display screen is divided according to the shape of the screen and can be divided into a plane screen, an arc screen, a circular screen and a spherical screen. Wherein plane curtain, 180 degrees arc curtains and 180 degrees spherical screen can not wrap up spectator, 360 degrees ring curtains and 360 degrees spherical screens can wrap up spectator wherein now, and when spectator watched the image that the spherical screen demonstrates, the boundary of spherical screen can not appear in spectator's normal visible range to it is stronger to make spectator's sense of immersion. However, in practical applications, since the viewers are not looking in one direction like in a conventional cinema, but are looking scattered in all directions, the images cannot be set and expanded, and therefore, the situation of normal viewing is not met, and the viewers cannot watch the film by continuing the conventional film watching method.

In order to ensure and continue the way that the audience watches the images in one direction conventionally, the images can be displayed through the 720 capsule type screen, wherein the 720 capsule type screen can provide continuous images with 180-360-degree visual angles in the horizontal direction, the inclination of the sight line of the audience in the same row when watching the 720 capsule type screen is more consistent, and the comfort of the audience watching the images through the 720 capsule type screen is better.

Because the structure of the 720 capsule-type screen is different from that of the flat screen, when a video is displayed on the 720 capsule-type screen, the whole capsule screen cannot be covered, and objects in the displayed image are distorted, so that a user cannot normally watch the video in an immersive mode through the 720 capsule-type full screen, and the user experience is poor.

Disclosure of Invention

In view of the above, an object of the present invention is to provide a video processing method and apparatus adapted to a 720 capsule screen, and related products, so as to overcome the drawbacks of the prior art.

In a first aspect, an embodiment of the present application provides a video processing method adapted to a 720 capsule-type screen, an inner surface of the 720 capsule-type screen being for providing continuous images of 180 to 360 degrees viewing angle in a horizontal direction, the 720 capsule-type screen including a cylindrical part and at least one end part, the method comprising: acquiring a video frame image of a video to be processed; performing UV conversion on the video frame image to obtain a video frame UV map, wherein the video frame UV map comprises a first area used for displaying in a cylindrical part of the 720 capsule-type screen and a second area used for displaying at the end part of the 720 capsule-type screen, the boundary line of the first area and the second area comprises a plurality of boundary arc line segments, and the circle center of a circle where the boundary arc line segments are located and the center of the video frame UV map are located on the same side of the arc line segments; generating a video file for presentation on an inner surface of the 720 capsule-type screen according to the video frame UV map.

In a second aspect, an embodiment of the present application provides a video processing device adapted to a 720-capsule type screen, an inner surface of the 720-capsule type screen being for providing continuous images of 180 to 360 degrees viewing angle in a horizontal direction, the 720-capsule type screen including a cylindrical part and at least one end part, the device comprising: the video frame image acquisition module is used for acquiring a video frame image of a video to be processed; the UV conversion module is used for carrying out UV conversion on the video frame image to obtain a video frame UV map, wherein the video frame UV map comprises a first area used for displaying in a cylindrical part of the 720 capsule type screen and a second area used for displaying at the end part of the 720 capsule type screen, the intersection line of the first area and the second area comprises a plurality of boundary arc line segments, and the circle center of a circle where the boundary arc line segments are located and the center of the video frame UV map are located on the same side of the arc line segments; a generating module for generating a video file for displaying on an inner surface of the 720 capsule type screen according to the video frame UV map.

In a third aspect, an embodiment of the present application provides an electronic device, including: at least one processor, a memory, a communication interface, and a communication bus; the processor is connected with the memory and the communication interface through the communication bus, the memory is used for storing computer execution instructions, and the processor executes the computer execution instructions stored by the memory to execute the video processing method.

In a fourth aspect, embodiments of the present application provide a computer storage medium including computer-executable instructions for a processor to perform a video processing method as described above.

In a fifth aspect, an embodiment of the present application provides a video processing chip applied to a 720 capsule-type screen, an inner surface of the 720 capsule-type screen being used for providing continuous images with a viewing angle of 180 degrees to 360 degrees in a horizontal direction, the 720 capsule-type screen including a barrel and at least one end, the video processing chip calling a stored program to implement the following method: acquiring a video frame image of a video to be processed; performing UV conversion on the video frame image to obtain a video frame UV map, wherein the video frame UV map comprises a first area used for displaying in a cylindrical part of the 720 capsule-type screen and a second area used for displaying at the end part of the 720 capsule-type screen, the boundary line of the first area and the second area comprises a plurality of boundary arc line segments, and the circle center of a circle where the boundary arc line segments are located and the center of the video frame UV map are located on the same side of the arc line segments; generating a video file for presentation on an inner surface of the 720 capsule-type screen according to the video frame UV map.

According to the embodiment of the present invention, when the video frame UV map is displayed on the inner surface of the capsule-type screen 720, the image displayed on the inner surface of the cylindrical portion and the image displayed on the inner surface of the end portion are not distorted, and the aspect ratio of the video frame UV map displayed on the inner surface of the capsule-type screen 720 is not changed compared with the video frame image of the two-dimensional video, so that the user can normally view the panoramic video through the inner surface of the capsule-type screen 720, and the user experience is good. By the video processing scheme provided by the embodiment, the video which is shot and produced can be processed into a video file which can be well watched through the 720 capsule type screen based on the video frame UV mapping obtained by conversion, so that a user can watch the video based on the 720 capsule type screen, and a good panoramic immersive video watching experience can be obtained.

Drawings

Some specific embodiments of the present application will be described in detail hereinafter by way of illustration and not limitation with reference to the accompanying drawings. The same reference numbers in the drawings identify the same or similar elements or components. Those skilled in the art will appreciate that the drawings are not necessarily drawn to scale. In the drawings:

FIGS. 1-37 are schematic block diagrams of various 720 capsule screens provided by an embodiment of the present application;

fig. 38 is a schematic flow chart of a video processing method according to an embodiment of the present application;

39-68 are schematic diagrams of various video frame UV maps provided by embodiments of the present application;

FIG. 69 is a schematic flow chart diagram of another video processing method provided by an embodiment of the present application;

FIGS. 70-72 are schematic block diagrams of a 720 capsule screen provided in an embodiment of the present application;

FIG. 73 is a schematic view of a video frame UV map according to an embodiment of the present application;

FIG. 74 is a schematic view showing a UV map of a video frame on the inner surface of a capsule screen 720 according to an embodiment of the present application;

fig. 75 is a schematic flow chart of a video processing method according to an embodiment of the present application;

fig. 76 is a schematic structural diagram of a video processing apparatus according to an embodiment of the present application;

fig. 77 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

It is not necessary for any particular embodiment of the invention to achieve all of the above advantages at the same time.

In order to make those skilled in the art better understand the technical solutions in the embodiments of the present application, the technical solutions in the embodiments of the present application are clearly and completely described below, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application shall fall within the scope of the protection of the embodiments in the present application.

The screen of the dome is generally spherical and the audience can be enclosed in the dome. The projector placed inside the spherical screen can project images onto almost the whole spherical screen, so that the audience can see the images fully distributed on the whole spherical screen, and the boundary of the spherical screen cannot appear in the normal visual range of the audience, so that the audience is more immersed.

However, because the seats of the audience are arranged in rows, when the audience is far away from the center of the spherical screen, the inclination of the sight line of the audience watching the spherical screen is larger, which is not in accordance with the angle of normal watching, so that the comfort of the audience watching the video through the spherical screen is poor.

In order to improve the comfort of the viewer watching the video, the image may be presented through a 720 capsule-type screen, an inner surface of the 720 capsule-type screen being used to provide a continuous image of a viewing angle of 180 to 360 degrees in a horizontal direction, the 720 capsule-type screen including a cylindrical part and at least one end part. For example, the sidewalls of the cylindrical part may be smoothly arranged in an arc or in a straight line in the axial section, and if the 720 capsule-type screen includes two ends, the two ends may be arranged at both sides of the cylindrical part and may be connected with the cylindrical part in a smooth transition manner. The end portion may be a hemisphere or another shape, which is not limited in this embodiment.

Illustratively, fig. 1 is a schematic block diagram of a 720-capsule screen provided by an embodiment of the present application, as shown in fig. 1, the sidewall of a cylinder 101 of the 720-capsule screen 100 is linearly arranged in an axial cross-section, i.e., the cylinder 101 is a cylinder, and the 720-capsule screen 100 includes an end 102, the end 102 is located at one end of the cylinder 101, and the end 102 is hemispherical. The viewer 103 is positioned in the tubular part 101, and the viewer 103 views 720 the image displayed on the capsule-type screen 100 facing the end 102. Since the cylindrical part 101 of the 720-capsule-type screen 100 can be an extension of the end part 102, when the end part 102 and the cylindrical part 101 both display images, the immersion feeling of the viewers is strong, and since the inclination of the line of sight is uniform when the same row of viewers views the 720-capsule-type screen 100, the comfort of the viewers viewing the video through the 720-capsule-type screen 100 is good.

Illustratively, referring to fig. 2, fig. 2(a) is a front view of a 720 capsule-type screen (diagonal lines indicate the ground, the same applies hereinafter), fig. 2(b) is a top view of the 720 capsule-type screen, fig. 2(c) is a left (or right) view of the 720 capsule-type screen, and fig. 2(d) is a perspective view of the 720 capsule-type screen. As can be seen from the four drawings of fig. 2, the cylindrical part of the 720 capsule type screen has a circular cross section, both end parts have a semi-spherical shape, and the entire casing structure is similar to a capsule shape. The invention does not limit the specific value of the circular radius, and the person skilled in the art can design the circular radius according to the actual situation.

Illustratively, referring to fig. 3, fig. 3(a) is a front view of a 720 capsule-type screen, fig. 3(b) is a top view of the 720 capsule-type screen, fig. 3(c) is a left (or right) view of the 720 capsule-type screen, and fig. 3(d) is a perspective view of the 720 capsule-type screen. As can be seen from the four drawings of fig. 3, the cross-section of the cylindrical part of the 720 capsule-type screen is elliptical. The invention does not limit the specific values of the major axis and the minor axis of the ellipse, nor the proportion of the major axis and the minor axis, and the person skilled in the art can design the ellipse according to the actual situation.

Illustratively, referring to fig. 4, fig. 4(a) is a front view of a 720 capsule-type screen, fig. 4(b) is a top view of the 720 capsule-type screen, fig. 4(c) is a left (or right) view of the 720 capsule-type screen, and fig. 4(d) is a perspective view of the 720 capsule-type screen. As can be seen from the four drawings of fig. 4, the cross-section of the cylindrical part of the 720 capsule-type screen is square with rounded corners. Of course, in practical applications, the cross section of the cylindrical part may be a rectangle or other quadrangle with rounded corners. Wherein the purpose of the rounding is to enable a smooth transition with the two ends. The invention does not limit the specific numerical value of the side length of the quadrangle and the specific numerical value of the radius r of the fillet, and the person skilled in the art can design the quadrangle according to the actual situation.

Illustratively, referring to fig. 5, fig. 5(a) is a front view of a 720 capsule-type screen, fig. 5(b) is a top view of the 720 capsule-type screen, fig. 5(c) is a left (or right) view of the 720 capsule-type screen, and fig. 5(d) is a perspective view of the 720 capsule-type screen. As can be seen from the four diagrams of fig. 5, the cross-section of the cylindrical part of the 720 capsule-type screen is an asymmetrical circle in the top and bottom. Of course, in practical applications, the cross section of the cylindrical portion may be a circle with left and right asymmetry. The invention does not limit the specific parameters of the asymmetric circle, and the person skilled in the art can design the asymmetric circle according to the actual situation.

Fig. 2 to 5 illustrate embodiments in which the side wall of the cylindrical portion is linearly arranged on the axial section, it should be understood that the above embodiments do not limit the present invention, and any embodiments satisfying that the side wall of the cylindrical portion is linearly arranged on the axial section are within the scope of the present invention.

Next, each embodiment in which the side wall of the cylindrical portion is arranged in an arc line in the axial section when the capsule-type screen is totally enclosed 720 will be described.

Illustratively, referring to fig. 6, fig. 6(a) is a front view of a 720 capsule-type screen, fig. 6(b) is a top view of the 720 capsule-type screen, fig. 6(c) is a left (or right) view of the 720 capsule-type screen, and fig. 6(d) is a perspective view of the 720 capsule-type screen. As can be seen from the four drawings of fig. 6, the entire casing structure of the 720 capsule-type screen is an ellipsoid, and the cross-section of the ellipsoid is a circle. The invention does not limit the specific parameters of the ellipsoid shown in fig. 6, and a person skilled in the art can design the ellipsoid according to actual conditions.

Illustratively, referring to fig. 7, fig. 7(a) is a front view of a 720 capsule-type screen, fig. 7(b) is a top view of the 720 capsule-type screen, fig. 7(c) is a left (or right) view of the 720 capsule-type screen, and fig. 7(d) is a perspective view of the 720 capsule-type screen. The same as the 720-capsule type screen of fig. 6 is that the entire casing structure of the 720-capsule type screen of fig. 7 is also an ellipsoid, but it is different that the cross section of the ellipsoid is an ellipse. The invention does not limit the specific parameters of the ellipsoid shown in fig. 7, and a person skilled in the art can design the ellipsoid according to actual conditions.

Of course, it will be understood that the two embodiments of fig. 6 and 7 are the special case of the cylindrical portion side wall being arranged in an arc in the axial section, and when the cylindrical portion side wall is arranged in an arc in the axial section, the cross section of the cylindrical portion may also be an asymmetric circle, a quadrangle with rounded corners, etc. It should be noted that the sidewall of the cylindrical portion is disposed in an arc line or a straight line on the axial section does not necessarily mean that all the sidewalls of the cylindrical portion satisfy a certain line on the axial section, and may be disposed in a straight line on a part of the sidewalls, and disposed in an arc line, for example, the sidewall of the 720 capsule-type screen facing the viewer is disposed in a straight line, and the sidewall of the 720 capsule-type screen at the top of the viewer is disposed in an arc line.

The above embodiment describes a 720 capsule type screen with a fully enclosed shell structure, and the fully enclosed 720 capsule type screen has the advantages that the viewer can watch the display screen in 360 degrees and all directions, and the viewer has a very high non-boundary experience, but the cost is high. In order to save cost, the 720 capsule-type screen can adopt a partially-enclosed casing structure in practical application, and various embodiments of the partially-enclosed casing structure 720 capsule-type screen will be described one by one. In practical applications, the bottom of the 720 capsule-type screen can be "cut off" because viewers tend not to see the display image toward the bottom of the seat.

Illustratively, referring to fig. 8, the fig. 8 is a 720-capsule type screen after "cutting off" the bottom of the 720-capsule type screen of the fig. 2, wherein fig. 8(a) is a front view of the 720-capsule type screen, fig. 8(b) is a top view of the 720-capsule type screen, fig. 8(c) is a left (or right) view of the 720-capsule type screen, and fig. 8(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 9, the fig. 9 is a 720-capsule type screen after "cutting off" the bottom of the 720-capsule type screen of the fig. 3, wherein fig. 9(a) is a front view of the 720-capsule type screen, fig. 9(b) is a top view of the 720-capsule type screen, fig. 9(c) is a left (or right) view of the 720-capsule type screen, and fig. 9(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 10, the fig. 10 is a 720-capsule type screen after "cutting off" the bottom of the 720-capsule type screen of the fig. 4, wherein fig. 10(a) is a front view of the 720-capsule type screen, fig. 10(b) is a top view of the 720-capsule type screen, fig. 10(c) is a left (or right) view of the 720-capsule type screen, and fig. 10(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 11, the fig. 11 is a 720-capsule type screen after "cutting off" the bottom of the 720-capsule type screen of the fig. 5, wherein fig. 11(a) is a front view of the 720-capsule type screen, fig. 11(b) is a top view of the 720-capsule type screen, fig. 11(c) is a left (or right) view of the 720-capsule type screen, and fig. 11(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 12, the fig. 12 is a 720-capsule type screen after "cutting off" the bottom of the 720-capsule type screen of the fig. 6, wherein fig. 12(a) is a front view of the 720-capsule type screen, fig. 12(b) is a top view of the 720-capsule type screen, fig. 12(c) is a left (or right) view of the 720-capsule type screen, and fig. 12(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 13, the fig. 13 is a 720-capsule type screen after "cutting off" the bottom of the 720-capsule type screen of the fig. 7, wherein fig. 13(a) is a front view of the 720-capsule type screen, fig. 13(b) is a top view of the 720-capsule type screen, fig. 13(c) is a left (or right) view of the 720-capsule type screen, and fig. 13(d) is a perspective view of the 720-capsule type screen.

The invention does not specifically limit how much 720 capsule type screens are cut off, namely the degree of opening of the shell structure, in practical application, the invention can be determined according to the size and the position of a seat platform of a spectator, the size of the 720 capsule type screens and the like, and the principle of the invention is that the normal watching and the borderless feeling of the spectator in the vertical direction are not influenced. Preferably, at least the lowermost part of the first row of viewers in front of the screen is ensured to see 720 the capsule screen, and the lower boundary of the vertical field of vision of the human eyes is generally 70 degrees below the horizon.

In practical applications, the rear portion of the 720 capsule-type screen can be "cut away" because viewers tend not to view the display image toward the rear of the seat.

Exemplarily, referring to fig. 14, the fig. 14 is a 720-capsule type screen after "cutting off" a rear portion of the 720-capsule type screen of the fig. 2, wherein fig. 14(a) is a front view of the 720-capsule type screen, fig. 14(b) is a top view of the 720-capsule type screen, fig. 14(c) is a left (or right) view of the 720-capsule type screen, and fig. 14(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 15, the fig. 15 is a 720-capsule type screen after "cutting off" a rear portion of the 720-capsule type screen of the fig. 3, wherein fig. 15(a) is a front view of the 720-capsule type screen, fig. 15(b) is a top view of the 720-capsule type screen, fig. 15(c) is a left (or right) view of the 720-capsule type screen, and fig. 15(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 16, the fig. 16 is a 720-capsule type screen after "cutting off" a rear portion of the 720-capsule type screen of the fig. 4, wherein fig. 16(a) is a front view of the 720-capsule type screen, fig. 16(b) is a top view of the 720-capsule type screen, fig. 16(c) is a left (or right) view of the 720-capsule type screen, and fig. 16(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 17, the fig. 17 is a 720-capsule type screen after "cutting off" a rear portion of the 720-capsule type screen of the fig. 5, wherein fig. 17(a) is a front view of the 720-capsule type screen, fig. 17(b) is a top view of the 720-capsule type screen, fig. 17(c) is a left (or right) view of the 720-capsule type screen, and fig. 17(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 18, the fig. 18 is a 720-capsule type screen after "cutting off" a rear portion of the 720-capsule type screen of the fig. 6, wherein fig. 18(a) is a front view of the 720-capsule type screen, fig. 18(b) is a top view of the 720-capsule type screen, fig. 18(c) is a left (or right) view of the 720-capsule type screen, and fig. 18(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 19, the fig. 19 is a 720-capsule type screen after "cutting off" a rear portion of the 720-capsule type screen of the fig. 7, wherein fig. 19(a) is a front view of the 720-capsule type screen, fig. 19(b) is a top view of the 720-capsule type screen, fig. 19(c) is a left (or right) view of the 720-capsule type screen, and fig. 19(d) is a perspective view of the 720-capsule type screen. The invention does not specially limit how much of the 720 capsule type screen is cut off, namely the degree of the opening of the shell structure, in practical application, the invention can be determined according to the size and the position of the seat of the audience and the size of the 720 capsule type screen, and the principle is that the normal watching and the borderless feeling of the audience are not influenced. Preferably, at least 720 capsule-type screens are ensured to be visible at the top of the line of sight when the first row of viewers is looking straight ahead, and the upper boundary of the vertical field of vision of the human eyes is generally 50 degrees or more above the horizon.

In practical applications, the bottom and rear portions of the 720 capsule-type screen can also be "cut out" together for further cost savings.

Exemplarily, referring to fig. 20, the fig. 20 is a 720-capsule type screen after "cutting off" both a bottom and a rear portion of the 720-capsule type screen of the fig. 2, wherein fig. 20(a) is a front view of the 720-capsule type screen, fig. 20(b) is a top view of the 720-capsule type screen, fig. 20(c) is a left (or right) view of the 720-capsule type screen, and fig. 20(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 21, the fig. 21 is a 720-capsule type screen after "cutting off" both a bottom and a rear portion of the 720-capsule type screen of the fig. 3, wherein fig. 21(a) is a front view of the 720-capsule type screen, fig. 21(b) is a top view of the 720-capsule type screen, fig. 21(c) is a left (or right) view of the 720-capsule type screen, and fig. 21(d) is a perspective view of the 720-capsule type screen.

Illustratively, referring to fig. 22, the 720-capsule-type screen of fig. 4 is "cut off" at the bottom and rear portions thereof, wherein fig. 22(a) is a front view of the 720-capsule-type screen, fig. 22(b) is a top view of the 720-capsule-type screen, fig. 22(c) is a left (or right) view of the 720-capsule-type screen, and fig. 22(d) is a perspective view of the 720-capsule-type screen.

Illustratively, referring to fig. 23, the 720-capsule type screen of fig. 5 is "cut off" at the bottom and rear portions thereof, wherein fig. 23(a) is a front view of the 720-capsule type screen, fig. 23(b) is a top view of the 720-capsule type screen, fig. 23(c) is a left (or right) view of the 720-capsule type screen, and fig. 23(d) is a perspective view of the 720-capsule type screen.

Illustratively, referring to fig. 24, the fig. 24 is a 720-capsule type screen after "cutting off" both a bottom and a rear portion of the 720-capsule type screen of the fig. 6, wherein fig. 24(a) is a front view of the 720-capsule type screen, fig. 24(b) is a top view of the 720-capsule type screen, fig. 24(c) is a left (or right) view of the 720-capsule type screen, and fig. 24(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 25, the fig. 25 is a 720-capsule type screen after "cutting off" both a bottom and a rear portion of the 720-capsule type screen of the fig. 7, wherein fig. 25(a) is a front view of the 720-capsule type screen, fig. 25(b) is a top view of the 720-capsule type screen, fig. 25(c) is a left (or right) view of the 720-capsule type screen, and fig. 25(d) is a perspective view of the 720-capsule type screen.

The invention does not specially limit how much bottom and the rear 720 capsule type screen are cut off, and in practical application, the invention can be determined according to the size and the position of the seat platform of the audience, the size of the 720 capsule type screen and the like, and the principle of the invention is that the normal watching and the borderless feeling of the audience are not influenced. Preferably, at least the uppermost and lowermost parts of the line of sight of the first row of viewers in front view are ensured to see 720 the capsule-type screen, and in general, the upper boundary of the vertical field of vision of human eyes is 50 degrees above the horizon and the lower boundary is 70 degrees below the horizon.

The embodiments of fig. 1 to 25 are all symmetrical in the horizontal direction, but in practical applications, there may be asymmetrical structures, for example, where the housing structure has only one end.

Exemplarily, referring to fig. 26, the fig. 26 is a 720 capsule-type screen in which one end portion of the 720 capsule-type screen of fig. 2 is "cut off". Among them, fig. 26(a) is a front view of the 720 capsule-type screen, fig. 26(b) is a top view of the 720 capsule-type screen, fig. 26(c) is a left (or right) view of the 720 capsule-type screen, and fig. 26(d) is a perspective view of the 720 capsule-type screen.

Exemplarily, referring to fig. 27, the fig. 27 is a 720-capsule type screen in which one end portion of the 720-capsule type screen of fig. 3 is "cut off", in which fig. 27(a) is a front view of the 720-capsule type screen, fig. 27(b) is a top view of the 720-capsule type screen, fig. 27(c) is a left (or right) view of the 720-capsule type screen, and fig. 27(d) is a perspective view of the 720-capsule type screen.

Illustratively, referring to fig. 28, the fig. 28 is a 720-capsule type screen in which one end of the 720-capsule type screen of fig. 4 is "cut off", wherein fig. 28(a) is a front view of the 720-capsule type screen, fig. 28(b) is a top view of the 720-capsule type screen, fig. 28(c) is a left (or right) view of the 720-capsule type screen, and fig. 28(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 29, fig. 29 is a 720-capsule type screen in which one end portion of the 720-capsule type screen of fig. 5 is "cut off", in which fig. 29(a) is a front view of the 720-capsule type screen, fig. 29(b) is a top view of the 720-capsule type screen, fig. 29(c) is a left (or right) view of the 720-capsule type screen, and fig. 29(d) is a perspective view of the 720-capsule type screen.

Illustratively, referring to fig. 30, the fig. 30 is a 720-capsule type screen in which one end portion of the 720-capsule type screen of fig. 6 is "cut off", wherein fig. 30(a) is a front view of the 720-capsule type screen, fig. 30(b) is a top view of the 720-capsule type screen, fig. 30(c) is a left (or right) view of the 720-capsule type screen, and fig. 30(d) is a perspective view of the 720-capsule type screen.

Exemplarily, referring to fig. 31, the fig. 31 is a 720-capsule type screen in which one end of the 720-capsule type screen of the fig. 7 is "cut off", wherein fig. 31(a) is a front view of the 720-capsule type screen, fig. 31(b) is a top view of the 720-capsule type screen, fig. 31(c) is a left (or right) view of the 720-capsule type screen, and fig. 31(d) is a perspective view of the 720-capsule type screen.

Each of fig. 26-31 is an embodiment in which the housing structure has only one end, and in order to further save costs, the bottom of the housing structure may be "cut away" on the premise that the housing structure has only one end.

Exemplarily, referring to fig. 32, the fig. 32 is a 720-capsule type screen of fig. 2 in which one end and bottom are "cut off". Among them, fig. 32(a) is a front view of the 720 capsule-type screen, fig. 32(b) is a top view of the 720 capsule-type screen, fig. 32(c) is a left (or right) view of the 720 capsule-type screen, and fig. 32(d) is a perspective view of the 720 capsule-type screen.

Exemplarily, referring to fig. 33, the fig. 33 is a 720-capsule type screen of fig. 3 in which one end and bottom are "cut off". Among them, fig. 33(a) is a front view of the 720 capsule-type screen, fig. 33(b) is a top view of the 720 capsule-type screen, fig. 33(c) is a left (or right) view of the 720 capsule-type screen, and fig. 33(d) is a perspective view of the 720 capsule-type screen.

Exemplarily, referring to fig. 34, the fig. 34 is a 720 capsule-type screen in which one end and bottom of the 720 capsule-type screen of fig. 4 are "cut off". Among them, fig. 34(a) is a front view of the 720 capsule-type screen, fig. 34(b) is a top view of the 720 capsule-type screen, fig. 34(c) is a left (or right) view of the 720 capsule-type screen, and fig. 34(d) is a perspective view of the 720 capsule-type screen.

Exemplarily, referring to fig. 35, the fig. 35 is a 720-capsule type screen of which one end and bottom are "cut off" of the 720-capsule type screen of fig. 5. Among them, fig. 35(a) is a front view of the 720 capsule-type screen, fig. 35(b) is a top view of the 720 capsule-type screen, fig. 35(c) is a left (or right) view of the 720 capsule-type screen, and fig. 35(d) is a perspective view of the 720 capsule-type screen.

Exemplarily, referring to fig. 36, the fig. 36 is a 720 capsule-type screen in which one end and bottom of the 720 capsule-type screen of fig. 6 are "cut off". Fig. 36(a) is a front view of the 720 capsule-type screen, fig. 36(b) is a top view of the 720 capsule-type screen, fig. 36(c) is a left (or right) view of the 720 capsule-type screen, and fig. 36(d) is a perspective view of the 720 capsule-type screen.

Exemplarily, referring to fig. 37, the fig. 37 is a 720 capsule-type screen in which one end and bottom of the 720 capsule-type screen of fig. 7 are "cut off". Fig. 37(a) is a front view of the 720 capsule-type screen, fig. 37(b) is a top view of the 720 capsule-type screen, fig. 37(c) is a left (or right) view of the 720 capsule-type screen, and fig. 37(d) is a perspective view of the 720 capsule-type screen. The invention does not specifically limit the specific cutting-off of the bottom on the premise that the 720 capsule-type screen only has one end, and in practical application, the cutting-off of the bottom can be determined according to the size and the position of a seat platform of a spectator, the size of the 720 capsule-type screen and the like, and the principle of the cutting-off of the bottom is that the normal watching and the borderless feeling of the spectator are not influenced. Preferably, at least the lowermost part of the first row of viewers in front of the screen is ensured to see 720 the capsule screen, and the lower boundary of the vertical field of vision of the human eyes is generally 70 degrees below the horizon.

In addition, the 720 capsule screen of the present invention may be a self-luminous 720 capsule screen, such as a LED (Light-Emitting Diode) dot-matrix screen or an OLED (Organic Light-Emitting Diode) dot-matrix screen, or may be a projection 720 capsule screen or other screens, and the present invention is not limited in particular.

In addition, because the structure of the 720 capsule-type screen is different from that of the flat screen, when the two-dimensional video displayed on the flat screen is directly displayed on the 720 capsule-type screen, objects in the displayed picture are distorted, so that the user cannot normally watch the two-dimensional video through the 720 capsule-type screen, and the user experience is poor.

To this end, an embodiment of the present application provides a video processing method applied to a 720 capsule-type screen, an inner surface of the 720 capsule-type screen being for providing continuous images of 180 to 360 degrees viewing angle in a horizontal direction, the 720 capsule-type screen including a cylindrical part and at least one end part, the video processing method including: acquiring a video frame image of a video to be processed; performing UV conversion on the video frame image to obtain a video frame UV map, wherein the video frame UV map comprises a first area used for displaying in a cylindrical part of the 720 capsule-type screen and a second area used for displaying at the end part of the 720 capsule-type screen, the boundary line of the first area and the second area comprises a plurality of boundary arc line segments, and the circle center of a circle where the boundary arc line segments are located and the center of the video frame UV map are located on the same side of the arc line segments; generating a video file for presentation on an inner surface of the 720 capsule-type screen according to the video frame UV map. After the video frame images of the two-dimensional video are converted into the video frame UV maps, the video frame UV maps can be combined according to playing time to generate a video file displayed on the inner surface of the 720 capsule-type screen, and therefore when the video file is played on the inner surface of the 720 capsule-type screen, things in the video are not distorted, a user can normally watch the original two-dimensional video through the inner surface of the 720 capsule-type screen, and user experience is good.

The following further describes specific implementation of the embodiments of the present invention with reference to the drawings.

The embodiment of the present application provides a video processing method applied to a 720 capsule-type screen, an inner surface of the 720 capsule-type screen being used to provide continuous images of 180 to 360 degrees of viewing angle in a horizontal direction, the 720 capsule-type screen including a cylindrical portion and at least one end portion.

Illustratively, as shown in fig. 1, the 720 capsule-type screen 100 has a cylindrical body of the cylindrical part 101, the side walls of the cylindrical part 101 are linearly arranged in an axial cross-section, and the 720 capsule-type screen 100 includes one end 102, the end 102 being located at one end of the cylindrical part 101. The viewer 103 is positioned in the tubular part 101, and the viewer 103 views 720 the image displayed on the capsule-type screen 100 facing the end 102.

Of course, in other implementations, the 720 capsule-type screen may be the 720 capsule-type screen as shown in the above embodiments, which is not limited by the embodiments of the present application.

Fig. 38 is a schematic flowchart of a video processing method according to an embodiment of the present application, and as shown in fig. 38, the video processing method according to the embodiment includes the following steps:

201. and acquiring a video frame image of the video to be processed.

The video to be processed can be a video shot and made by an existing shooting method suitable for a plane screen, an arc screen, a circular screen and a spherical screen, the video to be processed can be a two-dimensional video or a three-dimensional video, and the two-dimensional video refers to a video displayed on a two-dimensional plane screen. Such as television video for playing on television, two-dimensional movies without stereoscopic effect, etc. Due to the fact that the manufacturing cost of the three-dimensional video is high, most of the videos shot at present are two-dimensional videos.

The method comprises the steps of obtaining a video frame image of a video to be processed, wherein the video frame image can be a video frame of the video to be processed in a designated playing time interval, and can also be a video frame of all the video to be processed.

202. And performing UV conversion on the video frame image to obtain a video frame UV map, wherein the video frame UV map comprises a first area used for displaying in a cylindrical part of the 720 capsule type screen and a second area used for displaying at the end part of the 720 capsule type screen, the boundary line of the first area and the second area comprises a plurality of boundary arc line segments, and the circle center of a circle where the boundary arc line segments are located and the center of the video frame UV map are located on the same side of the arc line segments.

Specifically, the UV conversion may be performed on the video area for presentation in the tubular portion in the video frame image according to the tubular UV conversion relationship, and the UV conversion may be performed on the video area for presentation in the tubular portion in the video frame image according to the end UV conversion relationship, so as to obtain the video frame UV map including the first area and the second area.

The cylindrical UV conversion relationship may be pre-acquired. Aiming at a video area used for displaying at an end part in a video frame image, performing UV conversion according to a cylindrical UV conversion relation, and converting a two-dimensional coordinate of each pixel point in the area into a UV coordinate according to the cylindrical UV conversion relation, wherein the UV coordinate is short for U, V texture mapping coordinates, the UV coordinate comprises a U coordinate and a V coordinate, the value ranges of the coordinate values of the U coordinate and the V coordinate can be (0, 1), and rendering is performed according to the UV coordinate of each pixel point in the area, the color value of each pixel point in the first area and the like to obtain a first area in the UV mapping of the video frame.

Similarly, the end UV conversion relationship may be pre-acquired. Aiming at a video area used for displaying at the end part in a video frame image, performing UV conversion according to an end part UV conversion relation, converting a two-dimensional coordinate of each pixel point in the area into a UV coordinate according to the end part UV conversion relation, and rendering according to the UV coordinate of each pixel point in the area, a color value of each pixel point in a second area and the like to obtain a second area in a video frame UV map.

The boundary line of the first area and the second area comprises a plurality of arc line segments, and the circle center of a circle where the arc line segments are located and the center of the video frame UV map are located on the same side of the arc line segments.

For example, fig. 39 is a schematic diagram of a video frame UV map provided in the embodiment of the present application, as shown in fig. 39, a video frame UV map 300 is composed of a first area 301 and a second area 302, wherein an intersection line of the first area 301 and the second area 302 includes an arc segment 3001, an arc segment 3002, and an arc segment 3003. The center 3111 of the circle in which the arc segment 3001 is located and the center of the video frame UV map 300 are located on the same side of the arc segment 3001, the center 3112 of the circle in which the arc segment 3002 is located and the center of the video frame UV map 300 are located on the same side of the arc segment 3002, and the center 3113 of the circle in which the arc segment 3003 is located and the center of the video frame UV map 300 are located on the same side of the arc segment 3003.

In addition, in any embodiment of the present application, the outer boundary of the UV map of the video frame may also include an arc segment.

Exemplarily, fig. 40 is a schematic view of a video frame UV map provided in an embodiment of the present application, and as shown in fig. 40, left and right sides of the video frame UV map include protruding portions, a boundary below the protruding portions is an arc line segment, and a center of a circle where the arc line segment is located and a center of the video frame UV map are located at two sides of the arc line segment respectively.

Exemplarily, fig. 41 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, as shown in fig. 41, left and right boundaries of the video frame UV map are arc segments, and a center of a circle where the arc segment of the left or right boundary is located and a center of the video frame UV map are located at two sides of the arc segment respectively.

Exemplarily, fig. 42 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, where left and right sides of the video frame UV map respectively include two protruding portions, a left and right boundary between the two protruding portions is an arc segment, and a center of a circle where the arc segment is located and a center of the video frame UV map are respectively located at two sides of the arc segment; the lower edge of the video frame UV map comprises a lower edge arc line segment, the circle center of a circle where the lower edge arc line segment is located and the center of the video frame UV map are located on two sides of the arc line segment, therefore, under the condition that the top of the video frame UV map is a straight line segment, the effective height in the middle of the video frame UV map obtained after conversion can be smaller than the effective heights on two sides through the lower edge arc line segment, and further, when the video frame UV map is displayed, an object in the center of the video frame UV map moves upwards, and the effective height can be the distance between the upper edge and the lower edge of the video frame UV map in the vertical direction. Specifically, the lower edge arc segment is symmetrical about the vertical center line of the video frame UV map.

For example, fig. 43 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 42, the aspect ratio of the video frame UV map shown in fig. 43 is closer to 1: 1. fig. 42 may be a video frame UV map after image conversion of a video frame with an aspect ratio of 16:9, with an aspect ratio closer to 1: fig. 43 of fig. 1 may be a video frame UV map after image conversion of a video frame having an aspect ratio of 4: 3.

For example, fig. 44 is a schematic view of a video frame UV map provided in an embodiment of the present application, where left and right sides of the video frame UV map include protruding portions, a boundary below the protruding portions is an arc segment, and a center of a circle where the arc segment is located and a center of the video frame UV map are located on two sides of the arc segment respectively. In contrast to fig. 40, fig. 44 shows a projection whose boundary is an arc line segment.

For example, fig. 45 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 44, the aspect ratio of the video frame UV map shown in fig. 45 is closer to 1: 1. similarly, fig. 44 may be a video frame UV map after image conversion of a video frame with an aspect ratio of 16:9, with an aspect ratio closer to 1: fig. 45 of fig. 1 may be a video frame UV map after image conversion of a video frame having an aspect ratio of 4: 3.

For example, fig. 46 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and as shown in fig. 46, the shape of the video frame UV map is a sector.

For example, fig. 47 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 46, the aspect ratio of the video frame UV map shown in fig. 47 is closer to 1: 1.

for example, fig. 48 is a schematic view of a video frame UV map provided in an embodiment of the present application, as shown in fig. 48, boundaries on left and right sides of the video frame UV map are straight line segments, upper and lower boundaries are arc line segments, and centers of circles where the arc line segments are located are both located below the arc line segments (where below is below the video frame UV map shown in fig. 48).

For example, fig. 49 is a schematic diagram of a video frame UV map provided by an embodiment of the present application, and compared with fig. 48, in a direction from top to bottom, a distance between straight line segments shown in fig. 49 as boundaries on left and right sides of the video frame UV map gradually decreases.

Exemplarily, fig. 50 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, where left and right boundaries of the video frame UV map are arc segments, and a circle center of a circle where the arc segment of the left or right boundary is located and a center of the video frame UV map are located at two sides of the arc segment respectively; the upper and lower boundaries of the video frame also comprise arc line segments which are an upper edge arc line segment and a lower edge arc line segment respectively, and the circle center of a circle where the upper edge arc line segment is located and the center of the video frame UV map are located on the same side of the arc line segments; the circle center of the circle where the lower edge arc line segment is located and the center of the video frame UV map are located on two sides of the arc line segment. Therefore, when the video frame UV map is displayed, the object in the center of the video frame UV map moves upwards. Because in general video, the content that the user is expected to focus on is generally in the central part of the video frame; by moving the object in the center of the UV map of the video frame upwards, the displayed content is more in line with the viewing habit of the user, and the user experience is improved.

For example, fig. 51 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 50, the aspect ratio of the video frame UV map shown in fig. 51 is closer to 1: 1.

exemplarily, fig. 52 is a schematic diagram of a video frame UV map provided by an embodiment of the present application, and compared with fig. 50, the video frame UV map shown in fig. 52 includes a first sub-area for displaying at the top of the barrel of the 720 capsule-type screen, and when the inner surface of the 720 capsule-type screen is displayed, the upper edge of the first sub-area meets a point at the top of the 720 capsule-type screen. As shown in fig. 52, the first sub-area is separated from other areas by solid lines, and the first sub-area is located above the UV map of the video frame shown in fig. 52. Specifically, the first sub-area in fig. 52 may be used to fill in the target image, which may be a trademark, icon, etc., to show the target image at the top of the capsule-type screen 720. The specific content of the target image can be determined by those skilled in the art, and this embodiment does not limit this.

For example, fig. 53 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 52, the aspect ratio of the video frame UV map shown in fig. 53 is closer to 1: 1. similar to fig. 52, the first sub-region is separated from other regions by solid lines, and the first sub-region is located above the UV map of the video frame shown in fig. 53; the first sub-region may be used to fill the target image.

Exemplarily, fig. 54 is a schematic view of a video frame UV map provided in an embodiment of the present application, as shown in fig. 54, boundaries of left and right sides and an upper side of the video frame UV map are arc segments, and a center of a circle where each arc segment is located and a center of the video frame UV map are located on the same side of the arc segment.

Exemplarily, fig. 55 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, as shown in fig. 55, boundaries on upper and lower sides of the video frame UV map are arc segments, and a circle center of a circle where each arc segment is located and a center of the video frame UV map are located on a same side of the arc segment; the boundaries of the left and right sides of the video frame UV map are all straight line segments.

For example, fig. 56 is a schematic view of a video frame UV map provided in an embodiment of the present application, as shown in fig. 55, boundaries of left and right sides, upper and lower sides, and a circle center of a circle where the arc line segments on the upper and lower sides are located and a center of the video frame UV map are located on the same side of the arc line segments; the circle center of the circle where the arc line sections on the left side and the right side are located and the center of the video frame UV map are located on the two sides of the arc line section.

For example, fig. 57 is a schematic view of a video frame UV map provided in an embodiment of the present application, and as shown in fig. 57, boundaries on left and right sides of the video frame UV map are straight line segments, upper and lower boundaries are arc line segments, and centers of circles where the arc line segments are located below the arc line segments.

For example, fig. 58 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 57, in a direction from top to bottom, distances between straight line segments shown in fig. 58 as boundaries on left and right sides of the video frame UV map are gradually decreased.

Exemplarily, fig. 59 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and as shown in fig. 59, left and right boundaries of the video frame UV map are arc segments, and a center of a circle where the arc segment of the left or right boundary is located and a center of the video frame UV map are located at two sides of the arc segment respectively.

Exemplarily, fig. 60 is a schematic view of a video frame UV map provided in an embodiment of the present application, as shown in fig. 60, left and right sides of the video frame UV map include protruding portions, a boundary below the protruding portions is an arc line segment, and a center of a circle where the arc line segment is located and a center of the video frame UV map are located at two sides of the arc line segment respectively.

Exemplarily, fig. 61 is a schematic view of a video frame UV map provided in an embodiment of the present application, where left and right sides of the video frame UV map respectively include two protruding portions, a boundary between the two protruding portions includes a plurality of arc segments, and a center of a circle where the arc segments are located and a center of the video frame UV map are respectively located at two sides of the arc segments.

For example, fig. 62 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 61, the aspect ratio of the video frame UV map shown in fig. 62 is closer to 16: 9.

exemplarily, fig. 63 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, where left and right sides of the video frame UV map include protruding portions, a left boundary of the left protruding portion and a right boundary of the right protruding portion are arc segments, a boundary below the protruding portion is also an arc segment, and a circle center of a circle where the arc segment corresponding to the boundary below the protruding portion is located and a center of the video frame UV map are located on two sides of the arc segment respectively; the lower edge of the video frame UV map comprises a lower edge arc line segment, and the circle center of the circle where the lower edge arc line segment is located and the center of the video frame UV map are located on two sides of the arc line segment, so that the height in the middle of the video frame UV map obtained after conversion can be reduced through the lower edge arc line segment under the condition that the tops of the video frame UV maps are the same, and further, when the video frame UV map is displayed, an object in the center of the video frame UV map moves upwards. Specifically, the lower edge arc segment is symmetrical about the vertical center line of the video frame UV map.

For example, fig. 64 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 63, the aspect ratio of the video frame UV map shown in fig. 64 is closer to 1: 1.

exemplarily, fig. 65 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, where left and right sides of the video frame UV map respectively include two protruding portions, a boundary between the two protruding portions is an arc segment, and a center of a circle where the arc segment is located and a center of the video frame UV map are respectively located at two sides of the arc segment; the boundary of the projection is also an arc segment.

For example, fig. 66 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 65, the aspect ratio of the video frame UV map shown in fig. 66 is closer to 1: 1.

for example, fig. 67 is a schematic view of a video frame UV map provided in an embodiment of the present application, and as shown in fig. 67, boundaries on left and right sides of the video frame UV map respectively include a plurality of arc segments.

For example, fig. 68 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 67, the aspect ratio of the video frame UV map shown in fig. 68 is closer to 1: 1.

203. generating a video file for presentation on an inner surface of the 720 capsule-type screen according to the video frame UV map.

Specifically, the video frame UV map may be presented as a frame in a video file on the inner surface of the capsule-type screen at 720.

Specifically, the video frame UV map may be projected on the inner surface of the capsule-type screen 720 by a projector, or the video frame UV map may be displayed by a flexible display screen provided on the inner surface of the capsule-type screen 720. Of course, the above description is merely illustrative and not restrictive of the present application.

Additionally, a projection system may be included in the 720 capsule-type screen, the projection system including at least two sets of projectors mounted inside the 720 capsule-type screen. Illustratively, at least two groups of projectors installed inside the 720 capsule-type screen may be arranged in layers in a central axis direction of the 720 capsule-type screen, each group of projectors projecting a portion on an inner surface of the 720 capsule-type screen, respectively, such that an optical path of the at least two groups of projectors avoids a viewer, wherein the central axis of the 720 capsule-type screen is an axis passing through a center of the 720 capsule-type screen and having left and right symmetry.

After step 203, the method further comprises:

204. and dividing the UV map of the video frame according to the number and the positions of at least two groups of projectors in the projection system to obtain a plurality of sub UV maps projected by the projectors.

Specifically, in order to make the displayed adjacent sub-UV maps appear as one body without a splicing trace when displayed, the adjacent sub-UV maps may have fused edges, and the fused edges of the adjacent sub-UV maps overlap each other when the adjacent sub-UV maps are projected 720 on the inner surface of the capsule-type screen, so that the viewer may consider the displayed adjacent sub-UV maps as a continuous map.

205. And controlling a projector in the projection system to project a plurality of sub UV maps on the inner surface of the 720 capsule-type screen so as to play the generated video on the 720 capsule-type screen.

In an embodiment of the present application, a projection system including at least two sets of projectors installed inside the 720 capsule-type screen can play the generated video on the 720 capsule-type screen by dividing the video frame UV map according to the number and positions of the at least two sets of projectors in the projection system, obtaining a plurality of sub-UV maps for projection by the projectors, and controlling the projectors in the projection system to project the plurality of sub-UV maps on the inner surface of the 720 capsule-type screen to play the generated video on the 720 capsule-type screen.

An embodiment of the present application provides a video processing method, the inner surface of the 720 capsule-type screen being for providing continuous images of a viewing angle of 180 degrees to 360 degrees in a horizontal direction, the 720 capsule-type screen including a cylindrical part and at least one end part, the video processing method including: acquiring a video frame image of a video to be processed; performing UV conversion on the video frame image to obtain a video frame UV map, wherein the video frame UV map comprises a first area used for displaying in a cylindrical part of the 720 capsule-type screen and a second area used for displaying at the end part of the 720 capsule-type screen, the boundary line of the first area and the second area comprises a plurality of boundary arc line segments, and the circle center of a circle where the boundary arc line segments are located and the center of the video frame UV map are located on the same side of the arc line segments; generating a video file for presentation on an inner surface of the 720 capsule-type screen according to the video frame UV map. After converting the video frame image of the two-dimensional video into the video frame UV map, the plurality of video frame UV maps may be combined according to the playing time to generate a video file displayed on the inner surface of the 720 capsule-type screen. Through the scheme, the shot and manufactured films can be seen in a panoramic immersive mode on the 720 capsule type screen, correct watching in the 720 capsule type screen is guaranteed, distortion is avoided, and a user can obtain good panoramic immersive video watching experience when watching the films on the 720 capsule type screen.

The method of the present embodiment may be performed by any suitable electronic device having data processing capabilities, including but not limited to: servers, mobile terminals (such as tablet computers, mobile phones and the like), PCs and the like.

The embodiment of the application provides a video processing method. In the present embodiment, the 720 capsule-type screen includes a smooth transition section provided between the barrel and the end. 720 the inclusion of the smooth transition of the capsule-type screen makes the transition between the barrel and the end more smooth and smooth.

Fig. 69 is a schematic flowchart of a video processing method according to an embodiment of the present application, and as shown in fig. 70 to 72, on the basis of the video processing method according to the first embodiment, in this embodiment, step 202 includes:

2021. and carrying out UV conversion according to the transition UV conversion relation to obtain a transition area in the video frame UV map.

2022. And carrying out UV conversion according to the cylindrical UV conversion relation to obtain a first region in the video frame UV map.

2023. And carrying out UV conversion according to the end UV conversion relation to obtain a second area in the UV mapping of the video frame.

Wherein the transition region comprises an arc-shaped edge line with the same shape as the arc-shaped line segment.

Specifically, the transitional UV conversion relationship may be pre-acquired. Aiming at a video area displayed in the smooth transition section of the 720 capsule type screen in the video frame image, performing UV conversion according to a transition UV conversion relation, converting a two-dimensional coordinate value of each pixel point in the area in the video frame image into a UV coordinate according to the transition UV conversion relation, and rendering according to the UV coordinate of each pixel point and a color value of each pixel point to obtain a transition area in a video frame UV map.

In an embodiment of the present application, by generating the video frame UV map including the transition region such that the image presented by the inner surface of the smooth transition section looks integral with the image presented by the inner surface of the barrel of the 720 capsule-type screen and the image presented by the inner surface of the end of the 720 capsule-type screen when the video frame UV map is presented by the inner surface of the 720 capsule-type screen, the UV map corresponding to the video frame can be considered as one complete picture by the viewer, improving the user experience.

The embodiment of the application provides a video processing method. In the present embodiment, the cylindrical part 101 is divided in the circumferential direction into a first sub-cylindrical part 1011, a second sub-cylindrical part 1012, and a third sub-cylindrical part 1013, wherein the first sub-cylindrical part 1011 is located at the top of the capsule-type screen 100 at 720, and a boundary between the second sub-cylindrical part 1012 and the first sub-cylindrical part 1011 and a boundary between the third sub-cylindrical part 1013 and the first sub-cylindrical part 1011 are symmetrical about a vertical plane 1041 passing through the cylindrical part axis 104. As shown in fig. 70, 71 and 72.

Correspondingly, as shown in fig. 73, fig. 73 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, the first region 301 includes a first sub-region 3011 for being displayed in the first sub-cylinder 1011, a second sub-region 3012 for being displayed in the second sub-cylinder 1012, and a third sub-region 3013 for being displayed in the third sub-cylinder 1013, the first sub-region 3011 is located above the first region 301, the second sub-region 3012 and the third sub-region 3013 are respectively located on two sides of the first region 301 and are communicated through the first sub-region 3011, and the second sub-region 3012 and the third sub-region 3013 are symmetrical with respect to a central line 303 of the first sub-region 3011 in a width direction of the video frame image 300 of the two-dimensional video.

In the embodiment of the present application, for convenience of viewing, the top surface of the tubular portion is used for displaying the upper half portion of the video frame image, and the side surfaces of the tubular portion are used for displaying the left and right portions of the video frame image, so that when the UV conversion is directly performed on the first area according to the tubular UV conversion relationship, the calculation difficulty for obtaining the first area is high.

Therefore, in the embodiment of the application, when the cylindrical part is divided into the second sub-cylindrical part, the first sub-cylindrical part and the third sub-cylindrical part along the circumferential direction, the first region includes the second sub-region for displaying on the second sub-cylindrical part, the first sub-region for displaying on the first sub-cylindrical part and the third sub-region for displaying on the third sub-cylindrical part, and the UV conversion relation corresponding to the second sub-region in the cylindrical UV conversion relation is performed to obtain the second sub-UV map corresponding to the second sub-region. And obtaining the first area according to the first sub UV map, the second sub UV map and the third sub UV map, thereby reducing the calculation difficulty for obtaining the first area.

Optionally, in this embodiment, the first area includes a first sub-area 3011 for being displayed at the top of the barrel of the 720 capsule-type screen, and when the inner surface of the 720 capsule-type screen is displayed, an upper edge of the first sub-area 3011 meets a point at the top of the 720 capsule-type screen. In particular, it may meet at the midpoint B' of the upper edge.

Illustratively, as shown in fig. 74, when the 720 capsule-type screen is shown on the inner surface thereof, the left and right edges of the first sub-area overlap at the capsule-type top, i.e., two points C, D of the left and right edges overlap at C ', and the upper edge of the first sub-area meets at a point B' at the top of the 720 capsule-type screen, forming an overlap line B '-C'. An overlap line B '-C' may be an extension line of A '-B', and a center line A-B of the first sub-area in the width direction of the video frame UV map is shown at A '-B' when the inner surface of the 720 capsule type screen is shown.

An embodiment of the present application provides a video processing method, and fig. 75 is a schematic flowchart of the video processing method provided in the embodiment of the present application, as shown in fig. 75, on the basis of the video processing method provided in the first embodiment, in this embodiment, before step 202, the video processing method further includes:

207. a screen model of the capsule-type screen is acquired 720.

208. And gridding and expanding the inner surface of the screen model to obtain a two-dimensional grid image of the inner surface of the screen model.

209. A boundary line for dividing the first region and the second region is determined from a boundary line between the cylindrical portion and the end portion in the mesh image.

In the embodiment of the present application, the screen model of the capsule-type screen is acquired 720, the inner surface of the screen model is gridded and expanded to obtain the two-dimensional grid image of the inner surface of the screen model, and the boundary for dividing the first region and the second region is determined based on the boundary between the tubular part and the end part in the grid image, wherein the boundary between the tubular part and the end part in the grid image is present in the two-dimensional grid image, and the tubular part and the end part can be divided more accurately.

The embodiment of the present application provides a video processing device applied to a 720 capsule-type screen, an inner surface of the 720 capsule-type screen being used to provide continuous images of 180 to 360 degrees of viewing angle in a horizontal direction, the 720 capsule-type screen including a cylindrical portion and at least one end portion. Fig. 76 is a schematic structural diagram of a video processing apparatus according to an embodiment of the present application, and as shown in fig. 76, a video processing apparatus 400 includes: a video frame image acquisition module 401, a UV conversion module 402, and a generation module 403.

The video frame image acquiring module 401 is configured to acquire a video frame image of a video to be processed;

a UV conversion module 402, configured to perform UV conversion on the video frame image to obtain a video frame UV map, where the video frame UV map includes a first area for displaying in a cylindrical portion of the 720 capsule-type screen and a second area for displaying at an end of the 720 capsule-type screen, where an intersection line between the first area and the second area includes a plurality of boundary arc segments, and a center of a circle where the boundary arc segments are located and a center of the video frame UV map are located on the same side of the arc segments;

a generating module 403, configured to generate a video file for displaying on an inner surface of the 720 capsule-type screen according to the video frame UV map.

The embodiment of the application provides a video processing device, which is applied to a 720 capsule type screen, wherein the inner surface of the 720 capsule type screen is used for providing continuous images with 180-360-degree visual angles in the horizontal direction, the 720 capsule type screen comprises a barrel part and at least one end part, the video processing device is used for processing videos by acquiring video frame images of the videos to be processed, the video frame images of the two-dimensional videos comprise a first area displayed in the barrel part of the 720 capsule type screen and a second area displayed at the end part of the 720 capsule type screen; performing UV conversion on the first area according to a cylindrical UV conversion relation to obtain a first area, wherein when the first area is displayed on the inner surface of the cylindrical part of the 720 capsule-type screen, objects in the displayed image are not distorted; performing UV conversion on the second area according to the end UV conversion relation to obtain a second area, wherein when the second area is displayed on the inner surface of the end of the 720 capsule-type screen, objects in the displayed image are not distorted; obtaining a video frame UV map according to the first area and the second area, wherein the boundary line of the first area and the second area comprises a plurality of arc line segments, and the circle center of the circle where the arc line segments are located and the center of the video frame UV map are located on the same side of the arc line segments; generating a video file for presentation on an inner surface of the 720 capsule-type screen according to the video frame UV map. Because when the video frame UV map is displayed on the inner surface of the 720 capsule-type screen, objects in the images displayed on the inner surface of the cylindrical part and the images displayed on the inner surface of the end part are not distorted, the scheme can ensure that the shot and manufactured films are viewed in a panoramic immersion mode on the 720 capsule-type screen, and ensure that the films can be correctly viewed in the 720 capsule screen without distortion, so that a user can obtain good panoramic immersion-type video viewing experience when viewing the films based on the 720 capsule-type screen.

Based on the video processing method described in the foregoing embodiments, an embodiment of the present application provides an electronic device, configured to execute the video processing method described in any one of the foregoing embodiments, and fig. 77 is a schematic structural diagram of the electronic device provided in the embodiment of the present application, and as shown in fig. 77, the electronic device 50 includes: at least one processor (processor)502, memory 504, bus 506, and communication Interface 508.

Wherein:

the processor 502, communication interface 508, and memory 504 communicate with each other via a communication bus 506.

A communication interface 508 for communicating with other devices.

The processor 502, for executing the program 510, may specifically execute the relevant steps in the video processing method adapted 720 to the capsule-type screen described in the above embodiment.

In particular, program 510 may include program code that includes computer operating instructions.

The processor 502 may be a central processing unit CPU, or an Application Specific Integrated Circuit (ASIC), or one or more Integrated circuits configured to implement an embodiment of the present invention. The electronic device comprises one or more processors, which can be the same type of processor, such as one or more CPUs; or may be different types of processors such as one or more CPUs and one or more ASICs.

And a memory 504 for storing the program 310. Memory 504 may comprise high-speed RAM memory, and may also include non-volatile memory (non-volatile memory), such as at least one disk memory.

An embodiment of the present application provides a video processing chip, the video processing chip invokes a stored program to implement a method applied to a 720 capsule-type screen, an inner surface of the 720 capsule-type screen being for providing continuous images of 180 to 360 degrees viewing angle in a horizontal direction, the 720 capsule-type screen including a cylindrical part and at least one end part, the method including:

acquiring a video frame image of a video to be processed;

performing UV conversion on the video frame image to obtain a video frame UV map, wherein the video frame UV map comprises a first area used for displaying in a cylindrical part of the 720 capsule-type screen and a second area used for displaying at the end part of the 720 capsule-type screen, the boundary line of the first area and the second area comprises a plurality of boundary arc line segments, and the circle center of a circle where the boundary arc line segments are located and the center of the video frame UV map are located on the same side of the arc line segments;

generating a video file for presentation on an inner surface of the 720 capsule-type screen according to the video frame UV map.

The electronic device of the embodiments of the present application exists in various forms, including but not limited to:

(1) a mobile communication device: such devices are characterized by mobile communications capabilities and are primarily targeted at providing voice, data communications. Such terminals include: smart phones (e.g., iphones), multimedia phones, functional phones, and low-end phones, among others.

(2) Ultra mobile personal computer device: the equipment belongs to the category of personal computers, has calculation and processing functions and generally has the characteristic of mobile internet access. Such terminals include: PDA, MID, and UMPC devices, etc., such as ipads.

(3) A portable entertainment device: such devices can display and play multimedia content. This type of device comprises: audio, video players (e.g., ipods), handheld game consoles, electronic books, and smart toys and portable car navigation devices.

(4) And other electronic equipment with data interaction function.

Thus, particular embodiments of the present subject matter have been described. Other embodiments are within the scope of the following claims. In some cases, the actions recited in the claims can be performed in a different order and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may be advantageous.

The systems, devices, modules or units illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product with certain functions. One typical implementation device is a computer. In particular, the computer may be, for example, a personal computer, a laptop computer, a cellular telephone, a camera phone, a smartphone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

For convenience of description, the above devices are described as being divided into various units by function, and are described separately. Of course, the functionality of the units may be implemented in one or more software and/or hardware when implementing the present application.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The application may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular transactions or implement particular abstract data types. The application may also be practiced in distributed computing environments where transactions are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.

The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.

The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A video processing method adapted to a 720-capsule-type screen, an inner surface of the 720-capsule-type screen being for providing continuous images of a viewing angle of 180 to 360 degrees in a horizontal direction, the 720-capsule-type screen including a cylindrical part and at least one end part, the method comprising:

acquiring a video frame image of a video to be processed;

2. The video processing method according to claim 1, wherein the lower edge of the video frame UV map comprises a lower edge arc segment, and the center of the circle where the lower edge arc segment is located and the center of the video frame UV map are located on both sides of the arc segment.

3. The video processing method of claim 2, wherein the lower edge arc segment is symmetric about a vertical center line of the video frame UV map.

4. The video processing method of claim 1, wherein the aspect ratio of the UV map for the video frame is in the range of 1:2 to 2: 1.

5. The video processing method as claimed in claim 1, wherein the first area includes a first sub-area for presentation at the top of the barrel of the 720 capsule-type screen, and an upper edge of the first sub-area meets a point at the top of the 720 capsule-type screen at the time of presentation of the inner surface of the 720 capsule-type screen.

6. The video processing method of claim 5, wherein the left and right edges of the first sub-area overlap at the top of the capsule form an overlap line when the inner surface of the 720 capsule type screen is shown.

7. The video processing method of claim 1, wherein the 720 capsule-type screen comprises a smooth transition, the smooth transition being disposed between the barrel and the tip, the video frame UV map further comprising a transition zone for presentation at the smooth transition;

the obtaining of the video frame UV map by performing UV conversion on the video frame image comprises the following steps:

and carrying out UV conversion according to the transition UV conversion relation to obtain a transition area in the video frame UV mapping, wherein the transition area comprises an arc edge line with the same shape as the boundary arc line segment.

8. The video processing method according to claim 1, wherein the barrel is divided in a circumferential direction into a first sub-barrel, a second sub-barrel and a third sub-barrel, wherein the first sub-barrel is located at the top of the 720 capsule type screen, and a boundary line of the second sub-barrel and the first sub-barrel and a boundary line of the third sub-barrel and the first sub-barrel are symmetrical with respect to a vertical plane passing through an axis of the barrel;

correspondingly, the first region comprises a first sub-region for displaying on the first sub-barrel, a second sub-region for displaying on the second sub-barrel, and a third sub-region for displaying on the third sub-barrel, the first sub-region is located above the first region, the second sub-region and the third sub-region are respectively located on two sides of the first region and are communicated through the first sub-region, and the second sub-region and the third sub-region are symmetrical with respect to a center line of the first sub-region in the width direction of the video frame UV map.

9. The video processing method according to claim 1, wherein said UV converting said video frame image to obtain a video frame UV map, before said method further comprises:

acquiring a screen model of the 720 capsule-type screen;

gridding and expanding the inner surface of the screen model to obtain a two-dimensional grid image of the inner surface of the screen model;

a boundary line for dividing the first region and the second region is determined based on a boundary line between the cylindrical portion and the end portion in the mesh image.

10. The video processing method of claim 1, wherein the 720-capsule type screen projection system comprises at least two sets of projectors installed inside the 720-capsule type screen, the method further comprising:

dividing the video frame UV map according to the number and the positions of at least two groups of projectors in the projection system to obtain a plurality of sub UV maps projected by the projectors;

controlling a projector in the projection system to project the plurality of sub-UV maps on an inner surface of the 720 capsule-type screen to show the formed video file on the 720 capsule-type screen.

11. A video processing device adapted to a 720-capsule-type screen, an inner surface of the 720-capsule-type screen being for providing continuous images of a viewing angle of 180 to 360 degrees in a horizontal direction, the 720-capsule-type screen including a cylindrical portion and at least one end portion, the device comprising:

the video frame image acquisition module is used for acquiring a video frame image of a video to be processed;

the UV conversion module is used for carrying out UV conversion on the video frame image to obtain a video frame UV map, wherein the video frame UV map comprises a first area used for displaying in a cylindrical part of the 720 capsule type screen and a second area used for displaying at the end part of the 720 capsule type screen, the intersection line of the first area and the second area comprises a plurality of boundary arc line segments, and the circle center of a circle where the boundary arc line segments are located and the center of the video frame UV map are located on the same side of the arc line segments;

a generating module for generating a video file for displaying on an inner surface of the 720 capsule type screen according to the video frame UV map.

12. An electronic device, comprising: at least one processor, a memory, a communication interface, and a communication bus;

the processor is connected to the memory and the communication interface through the communication bus, the memory is used for storing computer execution instructions, and the processor executes the computer execution instructions stored by the memory to execute the video processing method according to any one of claims 1-10.

13. A computer storage medium, characterized in that the computer storage medium comprises computer executable instructions for a processor to perform the video processing method according to any of claims 1-10.

14. A video processing chip applied to a 720 capsule-type screen, an inner surface of the 720 capsule-type screen being for providing continuous images of 180 to 360 degrees viewing angle in a horizontal direction, the 720 capsule-type screen including a cylindrical part and at least one end part, the video processing chip calling a stored program to implement the following method:

acquiring a video frame image of a video to be processed;