CN112261400B

CN112261400B - Method, device and product for processing dome screen video stream based on 720-degree capsule screen

Info

Publication number: CN112261400B
Application number: CN202011493067.5A
Authority: CN
Inventors: 吴姜澔; 吴晓斌
Original assignee: Shouwang Experience Technology Culture Co ltd
Current assignee: Shouwang Experience Technology Culture Co ltd
Priority date: 2020-12-16
Filing date: 2020-12-16
Publication date: 2021-03-19
Anticipated expiration: 2040-12-16
Also published as: CN112261400A

Abstract

The application provides a method, a device and a product for processing a dome screen video stream based on a 720-degree capsule screen, wherein the method comprises the following steps: analyzing the obtained video stream data to obtain a video frame image of the dome screen video, and performing UV conversion on the video frame image to obtain a video frame UV map; according to the video frame UV map, generate the video that adapts to 720 degrees capsule type screens, the live broadcast scheme that this application embodiment provided can convert the live broadcast video stream of adaptation dome screen into the live broadcast video stream of adaptation capsule shape display screen through UV map conversion for spectator can directly watch the live broadcast of dome screen video through capsule shape display screen, from this, brought better immersion for spectator, improved spectator and watched the experience of watching when enjoying the immersion type live broadcast.

Description

Method, device and product for processing dome screen video stream based on 720-degree capsule screen

Technical Field

The embodiment of the application relates to the technical field of display, in particular to a method, a device and a product for processing a dome screen video stream based on a 720-degree capsule screen.

Background

With the development of the media live broadcast industry, providing viewers with a good immersive experience is becoming a higher requirement of the media industry, and currently, in order to make a live video stream have a better immersive feeling, a shooting device (e.g., a fisheye camera or the like) is generally used for shooting a dome video stream or a program so as to project a video onto a dome.

However, in practical application, because spectator's seat is arranged in rows, when spectator was far away from the centre of a circle of spherical screen, it was great with the angle of horizontal plane contained angle to watch 360 angles of spherical screen, was not conform to the angle when normally watching for spectator's comfort and immersion all are relatively poor when watching the spherical screen live. In order to improve the immersion feeling when the audience watches the live broadcast, a 720-degree capsule type screen for displaying the live broadcast can be used, the 720-degree capsule type screen is of a fully-closed or partially-closed capsule type shell structure, continuous images with 180-360-degree visual angles can be provided in the shell structure in the horizontal direction, the inclination of the visual lines of the audience in the same row is consistent when the audience watches the display screen, and the comfort of the audience watching the images through the display screen is good.

However, the current immersive live video mainly adopts the adaptive spherical screen as a main part and cannot be adapted to the capsule-shaped screen.

Disclosure of Invention

In view of the above, an object of the present invention is to provide a method, an apparatus and a product for processing a video stream of a dome screen based on a 720-degree capsule screen, so as to match and display an immersive dome video and the 720-degree capsule screen.

In a first aspect, an embodiment of the present application provides a 720-degree capsule-type screen-based dome video stream processing method, applied to a 720-degree capsule-type screen, an inner surface of the 720-degree capsule-type screen being used for providing continuous images with a viewing angle of 180 degrees to 360 degrees in a horizontal direction, the 720-degree capsule-type screen including a tubular part and at least one end part, the 720-degree capsule-type screen-based dome video stream processing method including:

analyzing the obtained video stream data to obtain a video frame image of the dome screen video;

performing UV conversion on the video frame image of the dome screen video to obtain a video frame UV map, wherein the video frame UV map comprises a first UV map displayed in a cylindrical part of the 720-degree capsule-type screen and a second UV map displayed at the end part of the 720-degree capsule-type screen, the boundary line of the first UV map and the second UV map comprises a plurality of arc segments, and the circle center of the circle where the arc segments are located and the center of the video frame UV map are located on the same side of the arc segments;

and generating a video adapted to the 720-degree capsule type screen according to the video frame UV map.

Based on the method for processing a dome video stream based on a 720-degree capsule screen in the first aspect of the present application, an embodiment of the present application provides a device for processing a dome video stream based on a 720-degree capsule screen, including: the device comprises a video frame image acquisition module, a conversion module and a display module; the video frame image acquisition module is used for analyzing the acquired video stream data to acquire a video frame image of the dome screen video; the conversion module is used for performing UV conversion on the video frame image of the dome screen video to obtain a video frame UV map, wherein the video frame UV map comprises a first UV map displayed in a cylindrical part of the 720-degree capsule-type screen and a second UV map displayed at the end part of the 720-degree capsule-type screen, the boundary line of the first UV map and the second UV map comprises a plurality of arc segments, and the circle center of a circle where the arc segments are located and the center of the video frame UV map are located on the same side of the arc segments; the display module is used for displaying the video frame UV map on the inner surface of the 720-degree capsule-type screen so as to play the dome screen video on the 720-degree capsule-type screen.

An electronic device, comprising: at least one processor, a memory, a communication interface, and a communication bus; the processor is connected with the memory and the communication interface through the communication bus, the memory is used for storing computer execution instructions, and the processor executes the computer execution instructions stored by the memory to execute the method.

A storage medium having stored thereon computer program instructions executable by a processor to implement a method as described above.

The embodiment of the application provides a processing scheme for converting a dome screen video into a 720-degree capsule screen video, wherein a video frame image of the dome screen video is obtained; performing UV conversion on the video frame image of the dome screen video to obtain a video frame UV map, wherein the video frame UV map comprises a first UV map displayed at the cylindrical part of the capsule-shaped screen and a second UV map displayed at the end part of the capsule-shaped screen, the boundary line of the first UV map and the second UV map comprises a plurality of arc segments, and the circle center of the circle where the arc segments are located and the center of the video frame UV map are located on two sides of the arc segments; and generating a video adapted to the capsule-shaped screen according to the video frame UV map. Through the method for processing the dome screen video stream based on the 720-degree capsule type screen, the live video stream of the adaptive dome screen can be converted into the live video stream of the adaptive capsule type display screen through UV (ultraviolet) map conversion, so that audiences can directly watch the live broadcast of the dome screen video through the capsule type display screen, therefore, better immersion is brought to the audiences, and watching experience when the audiences watch immersion type live broadcast is improved.

Drawings

Some specific embodiments of the present application will be described in detail hereinafter by way of illustration and not limitation with reference to the accompanying drawings. The same reference numbers in the drawings identify the same or similar elements or components. Those skilled in the art will appreciate that the drawings are not necessarily drawn to scale. In the drawings:

fig. 1 is a schematic structural diagram of a ball curtain provided in an embodiment of the present application;

FIG. 2 is a schematic block diagram of a 720-degree capsule screen provided in an embodiment of the present application;

FIGS. 3-38 are block diagrams of various 720 degree capsule screens;

FIG. 39 is a schematic flow chart of a 720-degree capsule-type screen-based spherical screen video stream processing method according to an embodiment of the present application;

fig. 40 is a schematic diagram of video frame images in a video of a dome video provided in the present application;

fig. 41 is a schematic structural diagram of a ball curtain provided in the embodiment of the present application;

FIGS. 42-70 are schematic diagrams of various video frame UV maps;

FIG. 71 is a schematic block diagram of a 720-degree capsule screen provided in an embodiment of the present application;

FIG. 72 is a schematic block diagram of a 720-degree capsule screen provided in an embodiment of the present application;

FIG. 73 is a schematic block diagram of a 720-degree capsule screen provided in an embodiment of the present application;

FIG. 74 is a schematic view of a video frame UV map according to an embodiment of the present application;

FIG. 75 is a schematic flow chart of a method for processing a video stream of a dome screen based on a 720-degree capsule screen according to an embodiment of the present application;

FIG. 76 is a schematic flow chart of a 720-degree capsule-type screen-based video stream processing method for a dome screen according to an embodiment of the present application;

FIG. 77 is a schematic structural diagram of a 720-degree capsule-type-screen-based video stream processing device according to an embodiment of the present application;

fig. 78 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed Description

The screen of the dome is generally spherical and the audience can be enclosed in the dome. The projector placed inside the spherical screen can project images onto almost the whole spherical screen, so that the audience can see the images fully distributed on the whole spherical screen, and the boundary of the spherical screen cannot appear in the normal visual range of the audience, so that the audience is more immersed.

However, because the seats of the audience are arranged in rows, when the audience is far away from the center of the dome, the inclination of the line of sight of the audience for watching the dome is larger, which is not in accordance with the angle for normally watching, so that the comfort of the audience for watching images through the dome is poor.

When watching the live broadcast of dome screen video, as shown in fig. 1, fig. 1 is a scene graph of watching the live broadcast of dome screen video that this application embodiment provided, wherein, dome screen 10 can be hemispherical shell, and spectator's body department during wherein, receives the difference of each position of body department, needs to keep different angles of watching, just can comparatively comprehensively watch the projected live broadcast video picture on the dome screen to influence the travelling comfort and the immersion effect of spectator when watching the live broadcast of video.

In order to improve the comfort and immersion of the viewer in viewing the image, the image of the video may be presented through a 720-degree capsule-type screen in a fully or partially closed shell structure, the inner surface of the 720-degree capsule-type screen being used to provide continuous images of 180 to 360-degree viewing angles in the horizontal direction. For example, the 720-degree capsule-type screen may include a cylindrical region, a sidewall of which may be smoothly arranged in an arc or a straight line in an axial section, and a hemisphere part located at least one end of the cylindrical region, the hemisphere part being connected in a manner that may be smoothly transitioned.

Illustratively, as shown in fig. 2, fig. 2 is a schematic block diagram of a 720-degree capsule screen provided in an embodiment of the present application, in which a cylindrical region 101 of the 720-degree capsule screen 100 is a cylinder, sidewalls of the cylindrical region 101 are linearly arranged in an axial cross-section, and the 720-degree capsule screen 100 includes a hemispherical portion 102, and the hemispherical portion 102 is located at one end of the cylindrical region 101. The viewer 103 is located in the cylindrical area 101, and the viewer 103 views the image displayed on the 720-degree capsule-type screen 100 facing the hemispherical portion 102. Since the cylindrical region 101 of the 720-degree capsule-type screen 100 is an extension of the hemisphere 102, when images are displayed in both the hemisphere 102 and the cylindrical region 101, the audience is immersed in the images, and since the inclination of the line of sight of the same row of audience who views the 720-degree capsule-type screen 100 is uniform, the audience can view the images through the 720-degree capsule-type screen 100 with good comfort.

However, since the structure of the 720-degree capsule-type screen is different from that of the dome screen, when the dome screen video adapted to the 360-degree dome screen is directly projected and displayed on the 720-degree capsule-type screen, the image in the dome screen video is distorted, and thus the user cannot normally view the 360-degree dome screen video through the 720-degree capsule-type screen.

Of course, the 720-degree capsule-type screen in the embodiment may have other structures.

Illustratively, referring to fig. 3, fig. 3(a) is a front view of a 720-degree capsule-type screen (diagonal lines indicate the ground, the same applies hereinafter), fig. 3(b) is a top view of the 720-degree capsule-type screen, fig. 3(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 3(d) is a perspective view of the 720-degree capsule-type screen. As can be seen from the four drawings of fig. 3, the cylindrical portion of the 720-degree capsule-type screen has a circular cross section, and both end portions have a semi-spherical shape, and the entire casing structure is similar to a capsule shape. The invention does not limit the specific value of the circular radius, and the person skilled in the art can design the circular radius according to the actual situation.

Illustratively, referring to fig. 4, fig. 4(a) is a front view of a 720-degree capsule-type screen, fig. 4(b) is a top view of the 720-degree capsule-type screen, fig. 4(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 4(d) is a perspective view of the 720-degree capsule-type screen. As can be seen from the four drawings of fig. 4, the cross-section of the cylindrical portion of the 720-degree capsule-type screen is elliptical. The invention does not limit the specific values of the major axis and the minor axis of the ellipse, nor the proportion of the major axis and the minor axis, and the person skilled in the art can design the ellipse according to the actual situation.

Illustratively, referring to fig. 5, fig. 5(a) is a front view of a 720-degree capsule-type screen, fig. 5(b) is a top view of the 720-degree capsule-type screen, fig. 5(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 5(d) is a perspective view of the 720-degree capsule-type screen. As can be seen from the four drawings of fig. 5, the cross-section of the cylindrical portion of the 720-degree capsule-type screen is square with rounded corners. Of course, in practical applications, the cross section of the cylindrical part may be a rectangle or other quadrangle with rounded corners. Wherein the purpose of the rounding is to enable a smooth transition with the two ends. The invention does not limit the specific numerical value of the side length of the quadrangle and the specific numerical value of the radius r of the fillet, and the person skilled in the art can design the quadrangle according to the actual situation.

Illustratively, referring to fig. 6, fig. 6(a) is a front view of a 720-degree capsule-type screen, fig. 6(b) is a top view of the 720-degree capsule-type screen, fig. 6(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 6(d) is a perspective view of the 720-degree capsule-type screen. As can be seen from the four diagrams of fig. 6, the cross-section of the cylindrical portion of the 720-degree capsule-type screen is an asymmetrical circle in the top and bottom. Of course, in practical applications, the cross section of the cylindrical portion may be a circle with left and right asymmetry. The invention does not limit the specific parameters of the asymmetric circle, and the person skilled in the art can design the asymmetric circle according to the actual situation.

Fig. 3 to 6 illustrate embodiments in which the side wall of the cylindrical portion is linearly arranged on the axial section, it should be understood that the above embodiments do not limit the present invention, and any embodiments satisfying that the side wall of the cylindrical portion is linearly arranged on the axial section are within the scope of the present invention.

Various embodiments in which the sidewall of the cylindrical portion is arranged in an arc line in the axial section when the 720-degree capsule-type screen is fully closed will be described.

Illustratively, referring to fig. 7, fig. 7(a) is a front view of a 720-degree capsule-type screen, fig. 7(b) is a top view of the 720-degree capsule-type screen, fig. 7(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 7(d) is a perspective view of the 720-degree capsule-type screen. As can be seen from the four drawings of fig. 7, the entire casing structure of the 720-degree capsule-type screen is an ellipsoid, and the cross-section of the ellipsoid is a circle. The invention does not limit the specific parameters of the ellipsoid shown in fig. 7, and a person skilled in the art can design the ellipsoid according to actual conditions.

Illustratively, referring to fig. 8, fig. 8(a) is a front view of a 720-degree capsule-type screen, fig. 8(b) is a top view of the 720-degree capsule-type screen, fig. 8(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 8(d) is a perspective view of the 720-degree capsule-type screen. The same as the 720-degree capsule-type screen of fig. 7, the entire casing structure of the 720-degree capsule-type screen of fig. 8 is also an ellipsoid, but it is different that the cross-section of the ellipsoid is an ellipse. The invention does not limit the specific parameters of the ellipsoid in fig. 8, and those skilled in the art can design the ellipsoid according to the actual situation.

It will of course be appreciated that both of the embodiments of figures 7 and 8 are particular cases where the barrel side walls are arcuately arranged in axial cross-section, and that the cross-section of the barrel may also be asymmetrically circular, quadrilateral with rounded corners, etc. when the barrel side walls are arcuately arranged in axial cross-section. It should be noted that the sidewall of the cylindrical portion is disposed in an arc line or a straight line on the axial section, which does not necessarily mean that all the sidewalls of the cylindrical portion satisfy a certain line on the axial section, and a part of the sidewalls may be disposed in a straight line and a part of the sidewalls may be disposed in an arc line, for example, the sidewall of the 720-degree capsule-type screen facing the viewer is disposed in a straight line, and the sidewall of the 720-degree capsule-type screen at the top of the viewer is disposed in an arc line.

The above embodiment describes a 720-degree capsule screen with a fully-enclosed shell structure, and the fully-enclosed 720-degree capsule screen has the advantages that the viewer can watch the display screen in 360-degree angle and all directions, and the viewer has a very high non-boundary experience, but the cost is high. In order to save cost, the 720-degree capsule-type screen may adopt a partially-enclosed casing structure in practical applications, and various embodiments of the 720-degree capsule-type screen of the partially-enclosed casing structure will be described one by one. In practical applications, the bottom of the 720-degree capsule-type screen can be "cut away" because viewers tend not to view the display image toward the bottom of the seat.

Illustratively, referring to fig. 9, the fig. 9 is a 720-degree capsule-type screen after "cutting off" the bottom of the 720-degree capsule-type screen of the fig. 3, wherein fig. 9(a) is a front view of the 720-degree capsule-type screen, fig. 9(b) is a top view of the 720-degree capsule-type screen, fig. 9(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 9(d) is a perspective view of the 720-degree capsule-type screen.

Exemplarily, referring to fig. 10, the fig. 10 is a 720-degree capsule-type screen after "cutting off" the bottom of the 720-degree capsule-type screen of the fig. 4, wherein fig. 10(a) is a front view of the 720-degree capsule-type screen, fig. 10(b) is a top view of the 720-degree capsule-type screen, fig. 10(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 10(d) is a perspective view of the 720-degree capsule-type screen.

Illustratively, referring to fig. 11, the fig. 11 is a 720-degree capsule-type screen after "cutting off" the bottom of the 720-degree capsule-type screen of the fig. 5, wherein fig. 11(a) is a front view of the 720-degree capsule-type screen, fig. 11(b) is a top view of the 720-degree capsule-type screen, fig. 11(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 11(d) is a perspective view of the 720-degree capsule-type screen.

Exemplarily, referring to fig. 12, the fig. 12 is a 720-degree capsule-type screen after "cutting off" the bottom of the 720-degree capsule-type screen of the fig. 6, in which fig. 12(a) is a front view of the 720-degree capsule-type screen, fig. 12(b) is a top view of the 720-degree capsule-type screen, fig. 12(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 12(d) is a perspective view of the 720-degree capsule-type screen.

Exemplarily, referring to fig. 13, the fig. 13 is a 720-degree capsule-type screen after "cutting off" the bottom of the 720-degree capsule-type screen of the fig. 7, wherein fig. 13(a) is a front view of the 720-degree capsule-type screen, fig. 13(b) is a top view of the 720-degree capsule-type screen, fig. 13(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 13(d) is a perspective view of the 720-degree capsule-type screen.

Exemplarily, referring to fig. 14, the fig. 14 is a 720-degree capsule-type screen after "cutting off" the bottom of the 720-degree capsule-type screen of the fig. 8, wherein fig. 14(a) is a front view of the 720-degree capsule-type screen, fig. 14(b) is a top view of the 720-degree capsule-type screen, fig. 14(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 14(d) is a perspective view of the 720-degree capsule-type screen.

The invention does not specially limit how much 720-degree capsule-type screen is cut off, namely the degree of the opening of the shell structure, in practical application, the invention can be determined according to the size and the position of a seat platform of a spectator, the size of the 720-degree capsule-type screen and the like, and the principle of the invention is that the normal watching and the borderless feeling of the spectator in the vertical direction are not influenced. Preferably, at least the lowermost part of the first row of viewers within the front sight line is ensured to see the 720-degree capsule screen, and the lower boundary of the vertical field of vision of the human eyes is generally 70 degrees below the horizon.

In practical applications, the rear portion of the 720-degree capsule-type screen may be "cut away" because viewers tend not to view the display image toward the rear of the seat.

Exemplarily, referring to fig. 15, the fig. 15 is a 720-degree capsule-type screen after "cutting off" a rear portion of the 720-degree capsule-type screen of the fig. 3, wherein fig. 15(a) is a front view of the 720-degree capsule-type screen, fig. 15(b) is a top view of the 720-degree capsule-type screen, fig. 15(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 15(d) is a perspective view of the 720-degree capsule-type screen.

Exemplarily, referring to fig. 16, the fig. 16 is a 720-degree capsule-type screen after "cutting off" a rear portion of the 720-degree capsule-type screen of the fig. 4, in which fig. 16(a) is a front view of the 720-degree capsule-type screen, fig. 16(b) is a top view of the 720-degree capsule-type screen, fig. 16(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 16(d) is a perspective view of the 720-degree capsule-type screen.

Exemplarily, referring to fig. 17, the fig. 17 is a 720-degree capsule-type screen after "cutting off" a rear portion of the 720-degree capsule-type screen of the fig. 5, wherein fig. 17(a) is a front view of the 720-degree capsule-type screen, fig. 17(b) is a top view of the 720-degree capsule-type screen, fig. 17(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 17(d) is a perspective view of the 720-degree capsule-type screen.

Exemplarily, referring to fig. 18, the fig. 18 is a 720-degree capsule-type screen after "cutting off" a rear portion of the 720-degree capsule-type screen of the fig. 6, in which fig. 18(a) is a front view of the 720-degree capsule-type screen, fig. 18(b) is a top view of the 720-degree capsule-type screen, fig. 18(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 18(d) is a perspective view of the 720-degree capsule-type screen.

Exemplarily, referring to fig. 19, the fig. 19 is a 720-degree capsule-type screen after "cutting off" a rear portion of the 720-degree capsule-type screen of the fig. 7, in which fig. 19(a) is a front view of the 720-degree capsule-type screen, fig. 19(b) is a top view of the 720-degree capsule-type screen, fig. 19(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 19(d) is a perspective view of the 720-degree capsule-type screen.

Exemplarily, referring to fig. 20, the fig. 20 is a 720-degree capsule-type screen after "cutting off" a rear portion of the 720-degree capsule-type screen of the fig. 8, in which fig. 20(a) is a front view of the 720-degree capsule-type screen, fig. 20(b) is a top view of the 720-degree capsule-type screen, fig. 20(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 20(d) is a perspective view of the 720-degree capsule-type screen. The invention does not specially limit how much of the 720-degree capsule-type screen is cut off, namely the degree of the opening of the shell structure, and in practical application, the invention can be determined according to the size and the position of the seat of the audience and the size of the 720-degree capsule-type screen, and the principle of the invention is that the normal watching and the borderless feeling of the audience are not influenced. Preferably, at least the top of the line of sight of the first row of viewers looking straight ahead is ensured to see the 720-degree capsule screen, and the upper boundary of the vertical field of vision of the human eyes is generally 50 degrees or more above the horizon.

In practical applications, the bottom and rear portions of the 720-degree capsule-type screen may also be "cut away" together for further cost savings.

Illustratively, referring to fig. 21, the fig. 21 is a 720-degree capsule-type screen after "cutting off" both a bottom and a rear portion of the 720-degree capsule-type screen of the fig. 3, wherein fig. 21(a) is a front view of the 720-degree capsule-type screen, fig. 21(b) is a top view of the 720-degree capsule-type screen, fig. 21(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 21(d) is a perspective view of the 720-degree capsule-type screen.

Illustratively, referring to fig. 22, the fig. 22 is a 720-degree capsule-type screen in which the bottom and rear portions of the 720-degree capsule-type screen of fig. 4 are "cut off", wherein fig. 22(a) is a front view of the 720-degree capsule-type screen, fig. 22(b) is a top view of the 720-degree capsule-type screen, fig. 22(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 22(d) is a perspective view of the 720-degree capsule-type screen.

Illustratively, referring to fig. 23, the fig. 23 is a 720-degree capsule-type screen after "cutting off" both the bottom and the rear portion of the 720-degree capsule-type screen of the fig. 5, wherein fig. 23(a) is a front view of the 720-degree capsule-type screen, fig. 23(b) is a top view of the 720-degree capsule-type screen, fig. 23(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 23(d) is a perspective view of the 720-degree capsule-type screen.

Illustratively, referring to fig. 24, the fig. 24 is a 720-degree capsule-type screen in which the bottom and rear portions of the 720-degree capsule-type screen of the fig. 6 are "cut off", wherein fig. 24(a) is a front view of the 720-degree capsule-type screen, fig. 24(b) is a top view of the 720-degree capsule-type screen, fig. 24(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 24(d) is a perspective view of the 720-degree capsule-type screen.

Exemplarily, referring to fig. 25, the fig. 25 is a 720-degree capsule-type screen after "cutting off" both a bottom and a rear portion of the 720-degree capsule-type screen of the fig. 7, in which fig. 25(a) is a front view of the 720-degree capsule-type screen, fig. 25(b) is a top view of the 720-degree capsule-type screen, fig. 25(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 25(d) is a perspective view of the 720-degree capsule-type screen.

Illustratively, referring to fig. 26, the fig. 26 is a 720-degree capsule-type screen in which the bottom and rear portions of the 720-degree capsule-type screen of the fig. 8 are "cut off", wherein fig. 26(a) is a front view of the 720-degree capsule-type screen, fig. 26(b) is a top view of the 720-degree capsule-type screen, fig. 26(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 26(d) is a perspective view of the 720-degree capsule-type screen.

The invention does not specially limit how much bottom and the rear 720-degree capsule screen are cut off, and in practical application, the invention can be determined according to the size and the position of a seat platform of a spectator, the size of the 720-degree capsule screen and the like, and the principle of the invention is that the normal watching and the borderless feeling of the spectator are not influenced. Preferably, at least the top and bottom of the first row of viewers' sight line is ensured to see the 720-degree capsule screen when they are looking straight ahead, and in general, the upper boundary of the vertical field of vision of human eyes is 50 degrees above the horizon and the lower boundary is 70 degrees below the horizon.

The embodiments of fig. 3 to 26 are all symmetrical in the horizontal direction, but in practical applications, there may be asymmetrical structures, for example, where the housing structure has only one end.

Exemplarily, referring to fig. 27, the fig. 27 is a 720-degree capsule-type screen in which one end portion of the 720-degree capsule-type screen of fig. 3 is "cut off". Among them, fig. 27(a) is a front view of the 720-degree capsule-type screen, fig. 27(b) is a top view of the 720-degree capsule-type screen, fig. 27(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 27(d) is a perspective view of the 720-degree capsule-type screen.

Exemplarily, referring to fig. 28, the fig. 28 is a 720-degree capsule-type screen in which one end of the 720-degree capsule-type screen of fig. 4 is "cut off", in which fig. 28(a) is a front view of the 720-degree capsule-type screen, fig. 28(b) is a top view of the 720-degree capsule-type screen, fig. 28(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 28(d) is a perspective view of the 720-degree capsule-type screen.

Exemplarily, referring to fig. 29, the fig. 29 is a 720-degree capsule-type screen in which one end of the 720-degree capsule-type screen of the fig. 5 is "cut off", in which fig. 29(a) is a front view of the 720-degree capsule-type screen, fig. 29(b) is a top view of the 720-degree capsule-type screen, fig. 29(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 29(d) is a perspective view of the 720-degree capsule-type screen.

Exemplarily, referring to fig. 30, the fig. 30 is a 720-degree capsule-type screen in which one end of the 720-degree capsule-type screen of fig. 6 is "cut off", wherein fig. 30(a) is a front view of the 720-degree capsule-type screen, fig. 30(b) is a top view of the 720-degree capsule-type screen, fig. 30(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 30(d) is a perspective view of the 720-degree capsule-type screen.

Exemplarily, referring to fig. 31, the fig. 31 is a 720-degree capsule-type screen in which one end of the 720-degree capsule-type screen of the fig. 7 is "cut off", in which fig. 31(a) is a front view of the 720-degree capsule-type screen, fig. 31(b) is a top view of the 720-degree capsule-type screen, fig. 31(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 31(d) is a perspective view of the 720-degree capsule-type screen.

Exemplarily, referring to fig. 32, the fig. 32 is a 720-degree capsule-type screen in which one end of the 720-degree capsule-type screen of the fig. 8 is "cut off", in which fig. 32(a) is a front view of the 720-degree capsule-type screen, fig. 32(b) is a top view of the 720-degree capsule-type screen, fig. 32(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 32(d) is a perspective view of the 720-degree capsule-type screen.

In each of fig. 27-32, which are embodiments in which the housing structure has only one end, the bottom of the housing structure may be "cut away" in order to further save costs, provided that the housing structure has only one end.

Exemplarily, referring to fig. 33, the fig. 33 is a 720-degree capsule-type screen of fig. 3 in which one end and the bottom are "cut off". Among them, fig. 33(a) is a front view of the 720-degree capsule-type screen, fig. 33(b) is a top view of the 720-degree capsule-type screen, fig. 33(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 33(d) is a perspective view of the 720-degree capsule-type screen.

Exemplarily, referring to fig. 34, the fig. 34 is a 720-degree capsule-type screen in which one end and bottom of the 720-degree capsule-type screen of fig. 4 are "cut off". Among them, fig. 34(a) is a front view of the 720-degree capsule-type screen, fig. 34(b) is a top view of the 720-degree capsule-type screen, fig. 34(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 34(d) is a perspective view of the 720-degree capsule-type screen.

Exemplarily, referring to fig. 35, the fig. 35 is a 720-degree capsule-type screen in which one end and bottom of the 720-degree capsule-type screen of fig. 5 are "cut off". Among them, fig. 35(a) is a front view of the 720-degree capsule-type screen, fig. 35(b) is a top view of the 720-degree capsule-type screen, fig. 35(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 35(d) is a perspective view of the 720-degree capsule-type screen.

Exemplarily, referring to fig. 36, the fig. 36 is a 720-degree capsule-type screen in which one end and bottom of the 720-degree capsule-type screen of fig. 6 are "cut off". Fig. 36(a) is a front view of the 720-degree capsule-type screen, fig. 36(b) is a top view of the 720-degree capsule-type screen, fig. 36(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 36(d) is a perspective view of the 720-degree capsule-type screen.

Exemplarily, referring to fig. 37, the fig. 37 is the 720-degree capsule-type screen of fig. 7 with one end and bottom "cut off". Among them, fig. 37(a) is a front view of the 720-degree capsule-type screen, fig. 37(b) is a top view of the 720-degree capsule-type screen, fig. 37(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 37(d) is a perspective view of the 720-degree capsule-type screen.

Exemplarily, referring to fig. 38, the fig. 38 is a 720-degree capsule-type screen in which one end and bottom of the 720-degree capsule-type screen of fig. 8 are "cut off". Among them, fig. 38(a) is a front view of the 720-degree capsule-type screen, fig. 38(b) is a top view of the 720-degree capsule-type screen, fig. 38(c) is a left (or right) view of the 720-degree capsule-type screen, and fig. 38(d) is a perspective view of the 720-degree capsule-type screen. The invention does not specifically limit the cutting-off bottom on the premise that the 720-degree capsule-type screen has only one end, and in practical application, the cutting-off bottom can be determined according to the size and the position of a seat platform of a spectator, the size of the 720-degree capsule-type screen and the like, and the principle of the cutting-off bottom does not influence the normal watching and the borderless feeling of the spectator. Preferably, at least the lowermost part of the first row of viewers within the front sight line is ensured to see the 720-degree capsule screen, and the lower boundary of the vertical field of vision of the human eyes is generally 70 degrees below the horizon.

In addition, the 720-degree capsule screen of the present invention may be a self-luminous 720-degree capsule screen, such as a Light-Emitting Diode (LED) dot-matrix screen or an Organic Light-Emitting Diode (OLED) dot-matrix screen, or may be a projected 720-degree capsule screen or other screens, and the present invention is not limited in particular.

The following further describes specific implementation of the embodiments of the present invention with reference to the drawings.

Example one

An exemplary embodiment of the present invention provides a method for processing a video stream of a dome screen based on a 720-degree capsule screen, which is applied to a 720-degree capsule screen, wherein an inner surface of the 720-degree capsule screen is used to provide continuous images with a viewing angle of 180 degrees to 360 degrees in a horizontal direction, the 720-degree capsule screen includes a tubular portion and at least one end portion, the method for processing a video stream of a dome screen based on a 720-degree capsule screen is shown in fig. 39, fig. 39 is a flowchart of the method for processing a video stream of a dome screen based on a 720-degree capsule screen according to the exemplary embodiment of the present invention, and the method for processing a video stream of a dome screen based on a 720-degree capsule screen includes the following:

s201, analyzing the obtained video stream data to obtain a video frame image of the dome screen video;

the video stream data is a live video stream of a dome screen video, and generally includes video frame image data and audio data.

As shown in fig. 40, fig. 40 is a schematic diagram of video frame images in a video of a dome video provided by the present application, where the video frame images include a region image adapted to the left side of the dome video, a region image adapted to the middle of the dome video, and a region image adapted to the right side of the dome video.

S202, performing UV conversion on the video frame image to obtain a video frame UV map.

Specifically, the UV conversion is performed according to a UV conversion relationship, and may be a method for converting a three-dimensional coordinate of each pixel point into a UV coordinate according to the UV conversion relationship, where the UV coordinate is U, V for short, the UV coordinate includes a U coordinate and a V coordinate, a value range of a coordinate value of the U coordinate and a value range of a coordinate value of the V coordinate may be (0, 1), and the UV map of the video frame is obtained by rendering according to the UV coordinate of each pixel point and a color value of each pixel point, and the like.

As shown in fig. 41, fig. 41 is a schematic diagram of a video frame UV map provided by an embodiment of the present application, the video frame UV map includes a first UV map 301 displayed in a cylindrical area 101 adapted to a 720-degree capsule-type screen, and a second UV map 302 displayed at an end 102 of the 720-degree capsule-type screen, and a boundary line between the first UV map and the second UV map includes a plurality of arc segments 3001, arc segments 3002, and arc segments 3003. The center 3111 of the circle in which the arc segment 3001 is located and the center of the video frame UV map are located on the same side of the arc segment 3001, the center 3112 of the circle in which the arc segment 3002 is located and the center of the video frame UV map are located on the same side of the arc segment 3002, and the center 3113 of the circle in which the arc segment 3003 is located and the center of the video frame UV map are located on the same side of the arc segment 3003.

Of course, the video frame UV map may be other.

Exemplarily, fig. 42 is a schematic view of a video frame UV map provided in an embodiment of the present application, as shown in fig. 42, left and right sides of the video frame UV map include protruding portions, a boundary below the protruding portions is an arc line segment, and a center of a circle where the arc line segment is located and a center of the video frame UV map are located at two sides of the arc line segment respectively.

Exemplarily, fig. 43 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and as shown in fig. 43, left and right boundaries of the video frame UV map are arc segments, and a center of a circle where the arc segment of the left or right boundary is located and a center of the video frame UV map are located at two sides of the arc segment respectively.

Exemplarily, fig. 44 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, where left and right sides of the video frame UV map respectively include two protruding portions, a left and right boundary between the two protruding portions is an arc segment, and a center of a circle where the arc segment is located and a center of the video frame UV map are respectively located at two sides of the arc segment; the lower edge of the video frame UV map comprises a lower edge arc line segment, the circle center of a circle where the lower edge arc line segment is located and the center of the video frame UV map are located on two sides of the arc line segment, therefore, under the condition that the top of the video frame UV map is a straight line segment, the effective height in the middle of the video frame UV map obtained after conversion can be smaller than the effective heights on two sides through the lower edge arc line segment, and further, when the video frame UV map is displayed, an object in the center of the video frame UV map moves upwards, and the effective height can be the distance between the upper edge and the lower edge of the video frame UV map in the vertical direction. Specifically, the lower edge arc segment is symmetrical about the vertical center line of the video frame UV map.

For example, fig. 45 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 44, the aspect ratio of the video frame UV map shown in fig. 45 is closer to 1: 1. fig. 44 may be a video frame UV map after image conversion of a video frame with an aspect ratio of 16:9, with an aspect ratio closer to 1: fig. 45 of fig. 1 may be a video frame UV map after image conversion of a video frame having an aspect ratio of 4: 3.

For example, fig. 46 is a schematic view of a video frame UV map provided in an embodiment of the present application, where left and right sides of the video frame UV map include protruding portions, a boundary below the protruding portions is an arc segment, and a center of a circle where the arc segment is located and a center of the video frame UV map are located on two sides of the arc segment respectively. In contrast to fig. 42, fig. 46 shows a projection whose boundary is an arc line segment.

For example, fig. 47 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 46, the aspect ratio of the video frame UV map shown in fig. 47 is closer to 1: 1. similarly, fig. 46 may be a video frame UV map after image conversion of a video frame with an aspect ratio of 16:9, with an aspect ratio closer to 1: fig. 47 of fig. 1 may be a video frame UV map after image conversion of a video frame having an aspect ratio of 4: 3.

For example, fig. 48 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and as shown in fig. 48, the shape of the video frame UV map is a sector.

For example, fig. 49 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 48, the aspect ratio of the video frame UV map shown in fig. 49 is closer to 1: 1.

for example, fig. 50 is a schematic view of a video frame UV map provided in an embodiment of the present application, as shown in fig. 50, boundaries on left and right sides of the video frame UV map are straight line segments, upper and lower boundaries are arc line segments, and centers of circles where the arc line segments are located are both located below the arc line segments (where below is below the video frame UV map shown in fig. 50).

For example, fig. 51 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 50, in a direction from top to bottom, distances between straight line segments shown in fig. 51 as boundaries on left and right sides of the video frame UV map are gradually decreased.

For example, fig. 52 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, where left and right boundaries of the video frame UV map are arc segments, and a circle center of a circle where the arc segment of the left or right boundary is located and a center of the video frame UV map are located at two sides of the arc segment respectively; the upper and lower boundaries of the video frame also comprise arc line segments which are an upper edge arc line segment and a lower edge arc line segment respectively, and the circle center of a circle where the upper edge arc line segment is located and the center of the video frame UV map are located on the same side of the arc line segments; the circle center of the circle where the lower edge arc line segment is located and the center of the video frame UV map are located on two sides of the arc line segment. Therefore, when the video frame UV map is displayed, the object in the center of the video frame UV map moves upwards. Because in general video, the content that the user is expected to focus on is generally in the central part of the video frame; by moving the object in the center of the UV map of the video frame upwards, the displayed content is more in line with the viewing habit of the user, and the user experience is improved.

For example, fig. 53 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 52, the aspect ratio of the video frame UV map shown in fig. 53 is closer to 1: 1.

exemplarily, fig. 54 is a schematic diagram of a video frame UV map provided by an embodiment of the present application, and compared with fig. 52, the video frame UV map shown in fig. 54 includes a first sub-area for being displayed at the top of the barrel of the 720-degree capsule-type screen, and when the inner surface of the 720-degree capsule-type screen is displayed, the upper edge of the first sub-area meets a point at the top of the 720-degree capsule-type screen. As shown in fig. 54, the first sub-area is separated from other areas by solid lines, and the first sub-area is located above the UV map of the video frame shown in fig. 54. Specifically, the first sub-area in fig. 54 may be used to fill in a target image, which may be a trademark, icon, etc., to show the target image at the top of the 720-degree capsule-type screen. The specific content of the target image can be determined by those skilled in the art, and this embodiment does not limit this.

For example, fig. 55 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 54, the aspect ratio of the video frame UV map shown in fig. 55 is closer to 1: 1. similar to fig. 54, the first sub-region is separated from other regions by solid lines, and the first sub-region is located above the UV map of the video frame shown in fig. 55; the first sub-region may be used to fill the target image.

Exemplarily, fig. 56 is a schematic view of a video frame UV map provided by an embodiment of the present application, and as shown in fig. 56, boundaries of left and right sides and an upper side of the video frame UV map are arc segments, and a circle center of a circle in which each arc segment is located and a center of the video frame UV map are located at the same side of the arc segment.

Exemplarily, fig. 57 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and as shown in fig. 57, the boundaries of the upper and lower sides of the video frame UV map are arc segments, and the center of a circle where each arc segment is located and the center of the video frame UV map are located on the same side of the arc segment; the boundaries of the left and right sides of the video frame UV map are all straight line segments.

For example, fig. 58 is a schematic view of a video frame UV map provided in an embodiment of the present application, as shown in fig. 57, boundaries of left and right sides, upper and lower sides, and a circle center of a circle where the arc line segments on the upper and lower sides are located and a center of the video frame UV map are located on the same side of the arc line segments; the circle center of the circle where the arc line sections on the left side and the right side are located and the center of the video frame UV map are located on the two sides of the arc line section.

Exemplarily, fig. 59 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and as shown in fig. 59, boundaries on left and right sides of the video frame UV map are straight line segments, upper and lower boundaries are arc line segments, and centers of circles where the arc line segments are located below the arc line segments.

For example, fig. 60 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 59, in a direction from top to bottom, a distance between straight line segments shown in fig. 60 as boundaries on left and right sides of the video frame UV map is gradually decreased.

Exemplarily, fig. 61 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, as shown in fig. 61, a left boundary and a right boundary of the video frame UV map are arc segments, and a center of a circle where the arc segment of the left boundary or the right boundary is located and a center of the video frame UV map are located at two sides of the arc segment respectively.

Exemplarily, fig. 62 is a schematic view of a video frame UV map provided in an embodiment of the present application, as shown in fig. 62, left and right sides of the video frame UV map include protruding portions, a boundary below the protruding portions is an arc line segment, and a center of a circle where the arc line segment is located and a center of the video frame UV map are located at two sides of the arc line segment respectively.

Exemplarily, fig. 63 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, where left and right sides of the video frame UV map respectively include two protruding portions, a boundary between the two protruding portions includes a plurality of arc segments, and a center of a circle where the arc segments are located and a center of the video frame UV map are respectively located at two sides of the arc segments.

For example, fig. 64 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 63, the aspect ratio of the video frame UV map shown in fig. 64 is closer to 16: 9.

exemplarily, fig. 65 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, where left and right sides of the video frame UV map include protruding portions, a left boundary of the left protruding portion and a right boundary of the right protruding portion are arc segments, a boundary below the protruding portion is also an arc segment, and a circle center of a circle where the arc segment corresponding to the boundary below the protruding portion is located and a center of the video frame UV map are located on two sides of the arc segment respectively; the lower edge of the video frame UV map comprises a lower edge arc line segment, and the circle center of the circle where the lower edge arc line segment is located and the center of the video frame UV map are located on two sides of the arc line segment, so that the height in the middle of the video frame UV map obtained after conversion can be reduced through the lower edge arc line segment under the condition that the tops of the video frame UV maps are the same, and further, when the video frame UV map is displayed, an object in the center of the video frame UV map moves upwards. Specifically, the lower edge arc segment is symmetrical about the vertical center line of the video frame UV map.

For example, fig. 66 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 65, the aspect ratio of the video frame UV map shown in fig. 66 is closer to 1: 1.

exemplarily, fig. 67 is a schematic view of a video frame UV map provided in an embodiment of the present application, where left and right sides of the video frame UV map respectively include two protruding portions, a boundary between the two protruding portions is an arc segment, and a center of a circle where the arc segment is located and a center of the video frame UV map are respectively located at two sides of the arc segment; the boundary of the projection is also an arc segment.

For example, fig. 68 is a schematic diagram of a video frame UV map provided in an embodiment of the present application, and compared with fig. 67, the aspect ratio of the video frame UV map shown in fig. 68 is closer to 1: 1.

for example, fig. 69 is a schematic view of a video frame UV map provided in an embodiment of the present application, and as shown in fig. 69, boundaries on left and right sides of the video frame UV map respectively include a plurality of arc segments.

For example, fig. 70 is a schematic diagram of a video frame UV map provided by an embodiment of the present application, and compared with fig. 69, the aspect ratio of the video frame UV map shown in fig. 70 is closer to 1: 1.

and S203, generating a video adaptive to the 720-degree capsule type screen according to the video frame UV map.

Optionally, in an implementation manner of this embodiment, performing UV conversion on a video frame image to obtain a video frame UV map includes:

determining longitude and latitude coordinates corresponding to pixel point display positions of the video frame images when the video frame images are displayed on the spherical screen;

according to the longitude and latitude coordinates, carrying out coordinate transformation on pixel points of the video frame image to obtain a two-dimensional image corresponding to the video frame image;

and carrying out UV conversion on the two-dimensional image to obtain the UV mapping of the video frame.

Optionally, in an implementation manner of this embodiment, the 720-degree capsule-type screen includes a smooth transition section 104, the smooth transition section 104 is disposed between the barrel and the end, and the video frame UV map further includes a third UV map for showing the smooth transition section 104, where the third UV map includes an arc-shaped edge line having the same shape as the arc-shaped line segment.

Optionally, in an implementation manner of this embodiment, for the barrel area image adapted to the 720-degree capsule-type screen, pixel position conversion is performed according to a UV conversion relationship of the barrel area of the 720-degree capsule-type screen, so as to obtain a first UV map corresponding to the barrel area 101;

performing pixel position conversion on at least one hemispherical area 102 adapted to the 720-degree capsule-type screen according to a hemispherical area UV conversion relation of at least one end of the 720-degree capsule-type screen to obtain a second UV map corresponding to the hemispherical area 102 of at least one end of the 720-degree capsule-type screen;

and performing fusion processing on the first UV map and the second UV map to obtain a UV map matched with the 720-degree capsule type screen.

Optionally, in an implementation manner of the embodiment, the 720-degree capsule-type screen includes a transition area, the transition area is located between the cylindrical area of the 720-degree capsule-type screen and the hemispherical area of at least one end of the 720-degree capsule-type screen, and the cylindrical area of the 720-degree capsule-type screen and the hemispherical area of at least one end of the 720-degree capsule-type screen are connected in a smooth transition manner;

fusing the first UV map and the second UV map to obtain a UV map adapted to the 720-degree capsule-type screen, further comprising:

determining a transition area on a video frame image of a dome screen video that is adapted to a connected area of a cylindrical area and a spherical area of a 720-degree capsule-type screen

Performing pixel position conversion according to a transition UV conversion relation aiming at the transition area to obtain a third UV map;

the first UV map and the second UV map are fused to obtain a UV map matched with the 720-degree capsule screen, and the method further comprises the following steps:

and taking the third UV map as an image of a fusion position of the first UV map and the second UV map, and carrying out fusion processing on the first UV map and the second UV map to obtain the UV map matched with the 720-degree capsule-type screen.

Alternatively, in one implementation of the present embodiment, the cylindrical region of the 720-degree capsule-type screen is divided into a first cylindrical region 1011, a second cylindrical region 1012, and a third cylindrical region 1013 in the axial direction, wherein the second cylindrical region 1012 is located at the top of the 720-degree capsule-type screen, a boundary between the first cylindrical region 1011 and the second cylindrical region 1012, and a boundary between the third cylindrical region 1013 and the second cylindrical region 1012 are symmetrical with respect to a vertical plane 1041 passing through the axis 104, as shown in fig. 71-73.

Correspondingly, as shown in fig. 74, fig. 74 is a schematic diagram of a video frame UV map provided by an embodiment of the present application, the cylindrical region 301 adapted to the 720-degree capsule-type screen includes a first sub-region 3011 for presentation in the first cylindrical portion 1011, a second sub-region 3012 for presentation in the second sub-cylindrical portion 1012, and a third sub-region 3013 for presentation in the third cylindrical portion 1013, the second sub-region 3012 is located above the cylindrical region 301 adapted to the 720-degree capsule-type screen, the first sub-region 3011 and the third sub-region 3013 are respectively located on the same side of the cylindrical region 301 adapted to the 720-degree capsule-type screen, and are communicated through the second sub-region 3012, and the first sub-region 3011 and the third sub-region 3013 are symmetrical with respect to the second sub-region 3012 in a center line in a width direction of the video frame image 30 of the two-dimensional video.

Fig. 75 is a schematic flowchart of a method for processing a video stream of a dome screen based on a 720-degree capsule-type screen according to an embodiment of the present application, and as shown in fig. 75, on the basis of the method for processing a video stream of a dome screen based on a 720-degree capsule-type screen according to the first embodiment, in this embodiment, step 202 can be specifically implemented by steps 2021 to 2024:

2021. and aiming at the first sub-area, performing UV conversion according to the UV conversion relation corresponding to the first sub-area in the cylindrical UV conversion relation to obtain a first sub-UV map.

2022. And aiming at the second sub-area, performing UV conversion according to the UV conversion relation corresponding to the second sub-area in the cylindrical UV conversion relation to obtain a second sub-UV map.

2023. And aiming at the third sub-area, performing UV conversion according to the UV conversion relation corresponding to the third sub-area in the cylindrical UV conversion relation to obtain a third sub-UV map.

2024. And splicing the first sub UV map, the second sub UV map and the third sub UV map to obtain a first UV map.

And the first sub UV map and the third sub UV map are symmetrical about a center line of the second sub UV map in the width direction of the UV map of the video frame.

In the embodiment of the present application, for convenience of viewing, the top surface of the tub is used to show the upper half of the video frame image, and the side surfaces of the tub are used to show the left and right parts of the video frame image, so that when the UV conversion is directly performed according to the tub UV conversion relationship for the tub area adapted to the 720-degree capsule-type screen, the calculation difficulty of obtaining the first UV map is high.

For this reason, in the embodiment of the present application, when the cylindrical portion is divided into the first sub-cylindrical portion, the second sub-cylindrical portion, and the third sub-cylindrical portion in the circumferential direction, the cylindrical region adapted to the 720-degree capsule-type screen includes the first sub-region for presentation in the first sub-cylindrical portion, the second sub-region for presentation in the second sub-cylindrical portion, and the third sub-region for presentation in the third sub-cylindrical portion, and the UV conversion relationship corresponding to the first sub-region in the cylindrical UV conversion relationship is performed to obtain the first sub-UV map corresponding to the first sub-region, wherein since the shape of the first sub-cylindrical portion is simple, the UV conversion relationship corresponding to the first sub-region is simple, and the calculation difficulty in obtaining the first sub-UV map is low. And according to the same principle, the calculation difficulty for obtaining the second sub UV map and the third sub UV map is lower, and the first sub UV map, the second sub UV map and the third sub UV map are spliced to obtain the first UV map, so that the calculation difficulty for obtaining the first UV map is reduced.

Optionally, in an implementation manner of this example, the 720-degree capsule-type screen is internally installed with at least two sets of projectors, and a video frame UV map is displayed on an inner surface of the 720-degree capsule-type screen to play the dome video on the 720-degree capsule-type screen, including:

dividing the UV mapping of the video frame according to the number and the positions of at least two groups of projectors in the projection system to obtain a plurality of sub UV mappings used for being projected by the projectors;

and controlling a projector in a projection system to project a plurality of sub UV maps on the inner surface of the 720-degree capsule-type screen so as to play the dome screen video on the 720-degree capsule-type screen.

The application provides a dome screen video stream processing method based on a 720-degree capsule screen, which is applied to the 720-degree capsule screen and comprises the following steps: analyzing the obtained video stream data to obtain a video frame image of the dome screen video, performing UV conversion on the video frame image to obtain a video frame UV map, wherein the video frame UV map comprises a first UV map displayed in a cylindrical part of a 720-degree capsule-type screen and a second UV map displayed at the end part of the 720-degree capsule-type screen, the boundary line of the first UV map and the second UV map comprises a plurality of arc segments, and the circle center of a circle where the arc segments are located and the center of the video frame UV map are located on the same side of the arc segments; according to the video frame UV map, a video adaptive to the 720-degree capsule type screen is generated, through the method for processing the dome screen video stream based on the 720-degree capsule type screen, the live video stream adaptive to the dome screen can be converted into the live video stream adaptive to the capsule type display screen through UV map conversion, so that a viewer can directly watch the live broadcast of the dome screen video through the capsule type display screen, therefore, better immersion is brought to the viewer, and the watching experience when the viewer watches the immersion type live broadcast is improved.

Example two

Based on the video processing method described in the first embodiment of the present application, an embodiment of the present application further provides another video processing method, as shown in fig. 76, where fig. 76 is a flowchart of another video processing method provided in the first embodiment of the present application, and the video processing method further includes: analyzing the obtained video stream data of the dome screen video to obtain a video frame image of the dome screen video, and before:

s204, receiving program list information of the ball screen live broadcast, and acquiring live broadcast time and live broadcast channels of preset programs according to the program list information;

s205, receiving the real-time video stream sent by the live broadcast server according to the live broadcast time and the live broadcast channel.

The program list information is information containing the subject name of the live video;

the live broadcast time comprises the start time of the live broadcast theme or the information of the live broadcast time period;

channel information for determining network address or live room ID information corresponding to live video

Optionally, in an implementation manner of this embodiment, the video processing method further includes:

s206, sending an interaction request to a live broadcast server, and receiving interaction content data returned by the live broadcast server in response to the interaction request;

correspondingly, the performing UV conversion on the video frame image to obtain a video frame UV map includes:

s207, adding the interactive content data to the video frame image;

and carrying out UV conversion on the video frame image to obtain a video frame UV map added with the interactive content data.

The interaction request can comprise that a barrage is displayed to the live anchor, and the corresponding interaction content data comprises interaction content returned by the live anchor with returned barrage information.

EXAMPLE III

The embodiment of the application provides a dome screen video stream processing device based on a 720-degree capsule screen; as shown in fig. 76, fig. 76 is a schematic structural diagram of a 720-degree capsule-screen-based dome video stream processing device 40 according to an embodiment of the present application, in which the 720-degree capsule-screen-based dome video stream processing device 40 includes: a video frame image acquisition module 401, a conversion module 402 and a presentation module 403.

The video frame image acquiring module 401 is configured to analyze acquired video stream data to obtain a video frame image of a dome screen video;

a conversion module 402, configured to perform UV conversion on the video frame image of the dome screen video to obtain a video frame UV map, where the video frame UV map includes a first UV map displayed in a cylindrical portion of the 720-degree capsule-type screen and a second UV map displayed at an end of the 720-degree capsule-type screen, a boundary line between the first UV map and the second UV map includes a plurality of arc segments, and a center of a circle where the arc segments are located and a center of the video frame UV map are located on the same side of the arc segments;

a display module 403, configured to display the video frame UV map on an inner surface of the 720-degree capsule-type screen, so as to play the dome video on the 720-degree capsule-type screen.

Optionally, in an implementation manner of this embodiment, the spherical screen video stream processing device based on the 720-degree capsule-type screen further includes a dividing module 407, where the dividing module 407 is configured to divide the video frame UV map according to the number and the positions of at least two groups of projectors in the projection system, so as to obtain a plurality of sub UV maps for being projected by the projectors;

optionally, in an implementation manner of this embodiment, the display module 403 is further configured to control a projector in the projection system to project the sub UV maps onto an inner surface of the 720-degree capsule-type screen, so as to play the dome video on the 720-degree capsule-type screen.

Example four

Based on the 720-degree capsule-screen based dome video stream processing method described in the above embodiments, an embodiment of the present application provides an electronic device for executing the 720-degree capsule-screen based dome video stream processing method described in any of the above embodiments, fig. 75 is a schematic block diagram of an electronic device provided in an embodiment of the present application, and as shown in fig. 77, the electronic device 50 includes: at least one processor (processor)502, memory 504, bus 506, and communication Interface 508.

Wherein:

the processor 502, communication interface 508, and memory 504 communicate with each other via a communication bus 506.

A communication interface 508 for communicating with other devices.

The processor 502 is configured to execute the program 510, and may specifically execute the method described in the foregoing embodiment.

In particular, program 510 may include program code that includes computer operating instructions.

The processor 502 may be a central processing unit CPU, or an Application Specific Integrated Circuit (ASIC), or one or more Integrated circuits configured to implement an embodiment of the present invention. The electronic device comprises one or more processors, which can be the same type of processor, such as one or more CPUs; or may be different types of processors such as one or more CPUs and one or more ASICs.

The memory 504 is used for storing the program 510. Memory 504 may comprise high-speed RAM memory, and may also include non-volatile memory (non-volatile memory), such as at least one disk memory.

Based on the above description of the embodiments, the present application provides a storage medium having stored thereon computer program instructions executable by a processor to implement the method of any of the embodiments.

The screen dome video stream processing device based on the 720-degree capsule screen provided by the embodiment of the application exists in various forms, including but not limited to:

(1) a mobile communication device: such devices are characterized by mobile communications capabilities and are primarily targeted at providing voice, data communications. Such terminals include: smart phones (e.g., iphones), multimedia phones, functional phones, and low-end phones, among others.

(2) Ultra mobile personal computer device: the equipment belongs to the category of personal computers, has calculation and processing functions and generally has mobile internet access performance. Such terminals include: PDA, MID, and UMPC devices, etc., such as ipads.

(3) A portable entertainment device: such devices can display and play multimedia content. This type of device comprises: audio, video players (e.g., ipods), handheld game consoles, electronic books, and smart toys and portable car navigation devices.

(4) And other electronic equipment with data interaction function.

Thus, particular embodiments of the present subject matter have been described. Other embodiments are within the scope of the following claims. In some cases, the actions recited in the claims can be performed in a different order and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may be advantageous.

The systems, devices, modules or units illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product with certain functions. One typical implementation device is a computer. In particular, the computer may be, for example, a personal computer, a laptop computer, a cellular telephone, a camera phone, a smartphone, a personal digital assistant, a media player, a navigation device, an email device, a game console, a tablet computer, a wearable device, or a combination of any of these devices.

For convenience of description, the above devices are described as being divided into various units by function, and are described separately. Of course, the functionality of the units may be implemented in one or more software and/or hardware when implementing the present application.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.

Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.

It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The application may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular transactions or implement particular abstract data types. The application may also be practiced in distributed computing environments where transactions are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.

The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.

The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.

Claims

1. A screen dome video stream processing method based on a 720-degree capsule-type screen, wherein an inner surface of the 720-degree capsule-type screen is used to provide continuous images of 180-360-degree viewing angle in a horizontal direction, the 720-degree capsule-type screen includes a cylindrical part and at least one end part, the method comprising:

2. The method for processing the video stream of the dome screen based on the 720-degree capsule screen of claim 1, wherein the analyzing the obtained video stream data to obtain the video frame image of the dome screen video, the method further comprising:

receiving program list information of the live broadcast of the spherical screen, and acquiring live broadcast time and live broadcast channels of preset programs according to the program list information;

and receiving a real-time video stream sent by a live broadcast server according to the live broadcast time and the live broadcast channel.

3. The method for processing video streams of a dome screen based on 720-degree capsule-type screen according to claim 1, further comprising:

sending an interaction request to a live broadcast server, and receiving interactive content data returned by the live broadcast server in response to the interaction request;

correspondingly, the UV conversion is performed on the video frame image of the spherical screen video to obtain a video frame UV map, which includes:

adding the interactive content data to the video frame image;

and carrying out UV conversion on the video frame image of the dome screen video to obtain a video frame UV map added with the interactive content data.

4. The method as claimed in claim 1, wherein the lower edge of the video frame UV map comprises a lower edge arc segment, and the center of the circle where the lower edge arc segment is located and the center of the video frame UV map are located at two sides of the arc segment.

5. The method of processing a video stream of a dome screen based on a 720-degree capsule-type screen of claim 4, wherein the lower edge arc segment is symmetrical about a vertical center line of the UV map of the video frame.

6. The method of claim 1, wherein the video frame UV map comprises a first sub-area for being displayed at the top of the barrel of the 720-degree capsule-type screen, and an upper edge of the first sub-area meets a point at the top of the 720-degree capsule-type screen when being displayed on the inner surface of the 720-degree capsule-type screen.

7. The method of claim 6, wherein when the 720-degree capsule-type screen is displayed on the inner surface of the 720-degree capsule-type screen, the left and right edges of the first sub-area are overlapped on the top of the capsule-type screen to form an overlapped line.

8. The method for processing the video stream of the dome screen based on the 720-degree capsule-type screen of claim 1, wherein at least two groups of projectors are installed inside the 720-degree capsule-type screen, the method further comprising:

dividing the video frame UV map according to the number and the positions of the at least two groups of projectors in the projection system to obtain a plurality of sub UV maps projected by the projectors;

controlling a projector in the projection system to project the sub UV maps on the inner surface of the 720-degree capsule-type screen so as to play the dome video on the 720-degree capsule-type screen.

9. A video stream processing device of a dome screen based on a 720-degree capsule screen, comprising: the device comprises a video frame image acquisition module, a conversion module and a display module; wherein the content of the first and second substances,

the video frame image acquisition module is used for analyzing the acquired video stream data to acquire a video frame image of the dome screen video;

the conversion module is used for performing UV conversion on the video frame image of the dome screen video to obtain a video frame UV map, wherein the video frame UV map comprises a first UV map displayed in a cylindrical part of the 720-degree capsule-type screen and a second UV map displayed at the end part of the 720-degree capsule-type screen, the boundary line of the first UV map and the second UV map comprises a plurality of arc segments, and the circle center of a circle where the arc segments are located and the center of the video frame UV map are located on the same side of the arc segments;

the display module is used for displaying the video frame UV map on the inner surface of the 720-degree capsule-type screen in real time so as to carry out video live broadcast on the 720-degree capsule-type screen.

10. An electronic device, comprising: at least one processor, a memory, a communication interface, and a communication bus;

the processor is connected with the memory and the communication interface through the communication bus, the memory is used for storing computer execution instructions, and the processor executes the computer execution instructions stored by the memory to execute the method according to any one of claims 1-8.

11. A storage medium having stored thereon computer program instructions executable by a processor to implement the method of any one of claims 1-8.