CN112135082A - Method and device for improving ultra-high definition 4K resolution VR video definition - Google Patents
Method and device for improving ultra-high definition 4K resolution VR video definition Download PDFInfo
- Publication number
- CN112135082A CN112135082A CN201910546653.2A CN201910546653A CN112135082A CN 112135082 A CN112135082 A CN 112135082A CN 201910546653 A CN201910546653 A CN 201910546653A CN 112135082 A CN112135082 A CN 112135082A
- Authority
- CN
- China
- Prior art keywords
- resolution
- hot spot
- video
- rectangular
- spherical
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/015—High-definition television systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0117—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0125—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level one of the standards being a high definition standard
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Graphics (AREA)
- Transforming Electric Information Into Light Information (AREA)
Abstract
The invention discloses a method and a device for improving the definition of an ultra-high definition (UHD) 4K-resolution VR video, wherein a hot spot spherical surface and a non-hot spot spherical surface on a spherical VR video are arranged, the spherical VR video is expanded into a rectangular VR video with the resolution of M x H, the hot spot spherical surface and the non-hot spot spherical surface are respectively mapped to a hot spot area and a non-hot spot area of the rectangular VR video, and the resolution of a picture in the non-hot spot area is processed, so that the rectangular VR video with the resolution of N x H is obtained; and reversing the steps to recover the spherical VR video. The method fully utilizes the space of ultra-high definition resolution, can support spherical VR video with equator resolution higher than 3840, and increases spherical effective information; equipment capable of being seamlessly compatible with various standard ultra-high definition resolutions; only slightly zooming the width of the non-hot spot spherical surface, obviously reducing the extra distortion and image quality degradation degree caused by a full-picture stretching or compressing mode and the performance consumption of image rendering; the continuity of the original spherical picture is not damaged.
Description
Technical Field
The invention relates to the technical field of ultra high definition, in particular to a method and a device for improving the definition of an ultra high definition (4K) resolution VR video.
Background
The conventional ultra high definition 4K resolution is 3840 × 2160, while the ERP (Equi-Rectangular Projection) Projection has a VR (Virtual Reality) video aspect ratio of 2:1, only 3840 × 1920 can be achieved in the framework of ultra-high definition resolution, namely, the VR video with 3840 of the highest supported equatorial resolution is supported.
There are three types of current 4KVR video resolution schemes:
1. the aspect ratio of 2:1 is maintained, 3840 × 1920 resolution is adopted, 4K resolution with the height of 2160 cannot be fully utilized, black edges need to be filled to meet the requirement of the aspect ratio of 16:9 when the video coding is transmitted through standard physical interfaces such as SDI or HDMI, and the filled black edges need to be cut off before video coding;
2. the aspect ratio of 2:1 is stretched into 16:9 to obtain VR video with 3840 × 2160 resolution, black edges do not need to be filled, but distortion and image quality loss are generated on the whole stretched picture, and the video stretching and restoring bring extra performance loss of image calculation rendering but do not bring improvement of definition synchronously;
both modes can only bear VR video with equator resolution of 3840;
3. and (3) projecting the spherical VR video with 4K resolution by using Cube, pyramid, octahedron and other projection algorithms, wherein the video obtained in each mode has different length-width ratios, such as 3:2 of Cube and 2 of octahedron: 1.732, the methods as in 1 cannot fully utilize 4K resolution, and because the sphere is mapped to an independent plane and then reassembled, the picture loses coherence, and the method is very unfriendly to the use requirements of various scenes such as picture preview, director switching, large-screen display and the like.
It can be seen that the prior art cannot fully utilize the 4K resolution and cannot fully utilize the resolution space of the ultra-high definition.
Disclosure of Invention
In order to overcome the defects of the prior art, the invention aims to provide a method and a device for improving the definition of an ultra-high definition 4K-resolution VR video, and aims to solve the problems that the 4K resolution cannot be fully utilized and the ultra-high definition resolution space cannot be fully utilized in the prior art.
The purpose of the invention is realized by adopting the following technical scheme:
a method for improving the definition of an ultra-high definition (UHD) 4K-resolution Virtual Reality (VR) video comprises the following steps of:
the unfolding step comprises the following steps:
setting a hot spot spherical surface and a non-hot spot spherical surface on a spherical VR video with the equator resolution of M; m is a positive number;
expanding a spherical VR video with the equator resolution of M into a rectangular VR video with the resolution of M x H, wherein hot spot spherical surfaces are mapped to hot spot areas of the rectangular VR video, and non-hot spot spherical surfaces are mapped to non-hot spot areas of the rectangular VR video; the resolution of the hot spot region is H, and the resolution of the non-hot spot region is (M-H);
processing the resolution of the picture of the non-hot spot area with the resolution of (M-H) H into (N-H) H; n is a positive number;
placing the picture of the hot spot area with the resolution of H x H and the picture of the non-hot spot area with the resolution of (N-H) x H into the same picture to obtain a rectangular VR video with the resolution of N x H;
the restoration step comprises:
acquiring pictures of a hot spot area with the resolution of H and pictures of a non-hot spot area with the resolution of (N-H) H from a rectangular VR video with the resolution of N H;
processing the resolution of the picture of the non-hot spot area with the resolution of (N-H) H into (M-H) H, wherein the resolution of the rectangular VR video is M H;
and restoring the rectangular VR video with the resolution of M x H into a spherical VR video with the equator resolution of M, wherein the hot spot region of the rectangular VR video is mapped to the hot spot spherical surface, and the non-hot spot region of the rectangular VR video is mapped to the non-hot spot spherical surface.
In addition to the above embodiments, preferably, M > N.
On the basis of any of the above embodiments, it is preferable that the shape of the hot spot spherical surface and the shape of the non-hot spot spherical surface are both hemispheres.
In addition to the above embodiments, M is 4320, N is 3840, and H is 2160 are preferable.
On the basis of any of the foregoing embodiments, preferably, the expanding the spherical VR video with equatorial resolution M into the rectangular VR video with resolution M × H includes:
and expanding the spherical VR video with the equator resolution of M into a rectangular VR video with the resolution of M x H by an ERP method.
On the basis of any of the above embodiments, preferably, the hot spot spherical surface is mapped to a hot spot region of the rectangular VR video, and the non-hot spot spherical surface is mapped to a non-hot spot region of the rectangular VR video, specifically:
the hot spot spherical surface is mapped to a hot spot area at one end of the rectangular VR video, and the non-hot spot spherical surface is mapped to a non-hot spot area at the other end of the rectangular VR video.
An ultra-high definition 4K resolution ratio VR video definition improving device comprises an expansion module and a restoration module which are connected with each other:
the deployment module is to:
setting a hot spot spherical surface and a non-hot spot spherical surface on a spherical VR video with the equator resolution of M; m is a positive number;
expanding a spherical VR video with the equator resolution of M into a rectangular VR video with the resolution of M x H, wherein hot spot spherical surfaces are mapped to hot spot areas of the rectangular VR video, and non-hot spot spherical surfaces are mapped to non-hot spot areas of the rectangular VR video; the resolution of the hot spot region is H, and the resolution of the non-hot spot region is (M-H);
processing the resolution of the picture of the non-hot spot area with the resolution of (M-H) H into (N-H) H; n is a positive number;
placing the picture of the hot spot area with the resolution of H x H and the picture of the non-hot spot area with the resolution of (N-H) x H into the same picture to obtain a rectangular VR video with the resolution of N x H;
the recovery module is used for:
acquiring pictures of a hot spot area with the resolution of H and pictures of a non-hot spot area with the resolution of (N-H) H from a rectangular VR video with the resolution of N H;
processing the resolution of the picture of the non-hot spot area with the resolution of (N-H) H into (M-H) H, wherein the resolution of the rectangular VR video is M H;
and restoring the rectangular VR video with the resolution of M x H into a spherical VR video with the equator resolution of M, wherein the hot spot region of the rectangular VR video is mapped to the hot spot spherical surface, and the non-hot spot region of the rectangular VR video is mapped to the non-hot spot spherical surface.
On the basis of the above embodiment, it is preferable that both the shape of the hot spot spherical surface and the shape of the non-hot spot spherical surface are hemispheres.
In addition to the above embodiments, M is 4320, N is 3840, and H is 2160 are preferable.
On the basis of any of the above embodiments, preferably, the hot spot spherical surface is mapped to a hot spot region of the rectangular VR video, and the non-hot spot spherical surface is mapped to a non-hot spot region of the rectangular VR video, specifically:
the hot spot spherical surface is mapped to a hot spot area at one end of the rectangular VR video, and the non-hot spot spherical surface is mapped to a non-hot spot area at the other end of the rectangular VR video.
Compared with the prior art, the invention has the beneficial effects that:
the invention discloses a method and a device for improving the definition of an ultra-high definition (UHD) 4K-resolution VR video, wherein the method comprises the steps of setting a hot spot spherical surface and a non-hot spot spherical surface on a spherical VR video, expanding the spherical VR video into a rectangular VR video with the resolution of M x H, respectively mapping the hot spot spherical surface and the non-hot spot spherical surface to a hot spot area and a non-hot spot area of the rectangular VR video, and processing the resolution of a picture in the non-hot spot area so as to obtain the rectangular VR video with the resolution of N x H; and reversing the steps to recover the spherical VR video. The method fully utilizes the space of ultrahigh definition resolution, can support the spherical VR video with equator resolution higher than 3840, and increases the effective information of the sphere compared with the prior art which can only support the equator resolution of 3840 at most; since the final output can be standard ultra-high definition resolution, various physical transmission interfaces, terminal codecs, terminal display devices and the like can be seamlessly compatible; the projection of the hot spot spherical surface is not subjected to any additional processing, so that the image quality is prevented from being reduced, only slight scaling is carried out on the width of the non-hot spot spherical surface, and the additional distortion and the image quality reduction degree caused by a full-picture stretching or compressing mode and the performance consumption of image rendering are obviously reduced; the method does not damage the continuity of the original spherical picture, and is very suitable for use scenes such as preview, director switching, large-screen display and the like.
Drawings
The invention is further illustrated with reference to the following figures and examples.
Fig. 1 is a schematic flowchart illustrating a method for improving the definition of an ultra high definition (ultra high definition) 4K-resolution VR video according to an embodiment of the present invention;
FIG. 2 is a flow chart illustrating an unfolding step provided by an embodiment of the present invention;
FIG. 3 is a flow chart illustrating a recovery step provided by an embodiment of the present invention;
fig. 4 shows a schematic structural diagram of an apparatus for improving ultra high definition 4K resolution VR video definition according to an embodiment of the present invention.
Detailed Description
The present invention will be further described with reference to the accompanying drawings and the detailed description, and it should be noted that any combination of the embodiments or technical features described below can be used to form a new embodiment without conflict.
Detailed description of the preferred embodiment
As shown in fig. 1, an embodiment of the present invention provides a method for improving the sharpness of an ultra high definition (ultra high definition) 4K resolution VR video, including a spreading step S1 and a restoring step S2.
An expansion step S1 of expanding and processing the spherical VR video into a rectangular VR video; the restoration step S2 restores the rectangular VR video to the spherical VR video.
As shown in fig. 2, the unfolding step S1 may include steps S11 to S14.
And step S11, hot spot spherical surfaces and non-hot spot spherical surfaces on the spherical VR video with the equator resolution of M are set. The purpose of this step is to define a hot spot sphere on the sphere, and for example, when the method is applied to scenes such as a concert, a evening party, and a release meeting, a hemisphere facing a stage in the middle can be used as the hot spot sphere, or a hemisphere facing a playing field in a sports scene can be used as the hot spot sphere.
The equatorial resolution in the embodiment of the present invention refers to the resolution of the spherical diameter of the spherical VR video. The process of expanding the spherical VR video into the rectangular VR video is similar to the process of projecting a 3D globe into a 2D world map, and the equatorial resolution is the resolution of the spherical diameter before projection and is also the resolution of the rectangle after projection in the width direction.
The embodiment of the invention does not limit the equatorial resolution M of the spherical VR video which can be processed, and is suitable for the spherical VR video with M higher than 3840 or lower than 3840, preferably, M is a positive number which can be 4320. This has the advantage that the method of embodiments of the invention can be used to unwrap and restore a spherical VR video regardless of the equatorial resolution M.
The embodiment of the invention does not limit the arrangement of the hot spot spherical surface and the non-hot spot spherical surface on the spherical VR video, the spherical surface with any area of the spherical VR video can be set as the hot spot spherical surface, and the other spherical surfaces are set as the non-hot spot spherical surfaces. For example, the shapes of the hotspot spherical surface and the non-hotspot spherical surface may be both hemispheres, the spherical surfaces 1/3, 1/4 and 1/5 on the spherical VR video may be set as hotspot spherical surfaces, and the rest of the spherical surfaces are set as non-hotspot spherical surfaces, and the spherical surfaces 2/3, 3/4, 2/5, 3/5 and 4/7 on the spherical VR video may be set as hotspot spherical surfaces and the rest of the spherical surfaces are set as non-hotspot spherical surfaces.
Step S12, expanding a spherical VR video with an equator resolution of M into a rectangular VR video with a resolution of M × H, where the rectangular VR video includes two parts, a hot spot region and a non-hot spot region, and the mapping relationship is: the hot spot spherical surface is mapped to a hot spot area of the rectangular VR video, and the non-hot spot spherical surface is mapped to a non-hot spot area of the rectangular VR video; the resolution of the hot spot region is H, and the resolution of the non-hot spot region is (M-H).
The embodiment of the invention does not limit the position distribution of the hot spot area and the non-hot spot area in the rectangular VR video, the hot spot area can be arranged at one end of the rectangular VR video, the non-hot spot area can be arranged at the other end of the rectangular VR video, the hot spot spherical surface is mapped to the hot spot area at one end of the rectangular VR video, and the non-hot spot spherical surface is mapped to the non-hot spot area at the other end of the rectangular VR video.
According to the embodiment of the invention, the hot spot area can be arranged in the middle of the rectangular VR video, and the non-hot spot areas are arranged on two sides of the hot spot area. For example, the hotspot region may be disposed at the very middle in the width direction of the rectangular VR video, i.e., 1/2, or may be disposed at 1/3, 1/4, 1/5 in the width direction of the rectangular VR video.
The embodiment of the present invention does not limit the resolution M × H of the rectangular VR video expanded in the expanding step S12, and rectangular VR videos with different resolutions can be obtained. For example, when M4320 and H2160, a rectangular VR video with a resolution of 4320 × 2160 can be obtained. The advantage of this is that, no matter what the resolution requirement of the rectangular VR video is, the spherical VR video can be processed by the method of the embodiment of the present invention to obtain the required rectangular VR video.
Step S13, processing the resolution of the picture of the non-hot spot region with the resolution of (M-H) H to (N-H) H; n is a positive number;
the embodiment of the present invention does not limit the resolution (N-H) × H of the picture of the non-hot spot region processed in the expanding step S13, so that the rectangular VR video with the resolution N × H can be obtained in the step S14. For example, the resolution of the picture of the non-hot spot area may be 1680 × 2160, where N is 3840.
Step S14, the picture of the hot spot region with the resolution H × H and the picture of the non-hot spot region with the resolution (N-H) × H are placed in the same picture, so as to obtain a rectangular VR video with the resolution N × H. When N is 3840 and H is 2160, the ultra-high definition resolution of the final output standard can be achieved, and at this time, various physical transmission interfaces, terminal codecs, terminal display devices, etc. can be seamlessly compatible. The advantage of this is that, no matter what the resolution requirement of the rectangular VR video is, the spherical VR video can be processed by the method of the embodiment of the present invention to obtain the required rectangular VR video.
When M is 4320, N is 3840, and H is 2160, step S12 expands the spherical VR video with equatorial resolution 4320 into a rectangular VR video with resolution 4320 × 2160, wherein the hot spot region has a resolution of 2160 × 2160, and the non-hot spot region has a resolution of 2160 × 2160; step S13 processes the resolution of the frame of the non-hot spot area with the resolution of 2160 × 2160 to 1680 × 2160; in step S14, the frame of the hot spot area with the resolution of 2160 × 2160 and the frame of the non-hot spot area with the resolution 1680 × 2160 are placed in the same frame, so as to obtain the rectangular VR video with the resolution 3840 × 2160.
When M is greater than N, the embodiment of the present invention can obtain a lower resolution space from a spherical VR video with a higher resolution than a conventional rectangular VR video by only compressing a non-hot spot region, and can fully utilize an ultra-high definition resolution space of the spherical VR video with a higher resolution than the conventional rectangular VR video, for example, a spherical VR video with an equator resolution M >3840 can be supported, and compared with the prior art which can only support the equator resolution of 3840 at most, the spherical effective information is increased. It can be seen that when the equatorial resolution M is 4320, the spherical effective information is increased compared to the spherical VR video with equatorial resolution M3840:
when M < N, the embodiment of the invention can obtain a higher resolution space from a spherical VR video with lower resolution than the conventional rectangular VR video only by stretching the non-hot spot area.
When M ≠ 3840, the ultra-high definition resolution of the final output standard can be realized by setting N in the embodiment of the present invention to 3840.
As shown in fig. 3, the restoration step S2 may include steps S21 to S23. The operation principle of the restoring step S2 is to reversely process and restore the spherical VR video with the equatorial resolution M in the order of the above steps S14, S13 and S12, and when M is 4320, N is 3840 and H is 2160, the restoring step S2 may include:
step S21, obtaining, from the rectangular VR video with a resolution of 3840 × 2160, a picture of a hot spot area with a resolution of 2160 × 2160 and a picture of a non-hot spot area with a resolution of 1680 × 2160;
step S22, processing the resolution of the frame of the non-hot spot area with the resolution of 1680 × 2160 to 2160 × 2160, and at this time, the resolution of the rectangular VR video is 4320 × 2160;
step S23, restoring the rectangular VR video with a resolution of 4320 × 2160 to a spherical VR video with an equatorial resolution of 4320, wherein hot spots of the rectangular VR video are mapped to hot spot spheres, and non-hot spots of the rectangular VR video are mapped to non-hot spot spheres.
In step S12, an ERP method may be used to expand a spherical VR video with an equator resolution of M into a rectangular VR video with a resolution of M × H.
In the embodiment of the invention, the projection of the hot spot spherical surface is not subjected to any additional processing, so that the image quality is prevented from being reduced, only slight scaling is carried out on the width of the non-hot spot spherical surface, and the additional distortion and the image quality reduction caused by a full-picture stretching or compressing mode and the performance consumption of image rendering are obviously reduced; in addition, the continuity of the original spherical picture is not damaged, and the method is very suitable for use scenes such as preview, guide switching, large-screen display and the like.
In the foregoing embodiment, a method for improving the definition of an ultra high definition 4K resolution VR video is provided, and correspondingly, the present application further provides an intelligent consultation system. Since the system embodiments are substantially similar to the method embodiments, they are described in a relatively simple manner, and reference may be made to some of the descriptions of the method embodiments for relevant points. The system embodiments described below are merely illustrative.
Detailed description of the invention
As shown in fig. 4, an apparatus for improving the sharpness of an ultra high definition (ultra high definition) 4K resolution VR video according to an embodiment of the present invention includes an expansion module 21 and a restoration module 22, which are connected to each other. The expansion module 21 expands and processes the spherical VR video into a rectangular VR video; the restoration module 22 restores the rectangular VR video to the spherical VR video.
The deployment module 21 is configured to:
setting hot spot hemispheres and non-hot spot hemispheres on a spherical VR video with equator resolution of 4320;
expanding a spherical VR video with equator resolution of 4320 into a rectangular VR video with resolution of 4320 × 2160, wherein a hot spot hemisphere is mapped to a hot spot region at one end of the rectangular VR video, and a non-hot spot hemisphere is mapped to a non-hot spot region at the other end of the rectangular VR video; the resolution of the hot spot area is 2160 × 2160, and the resolution of the non-hot spot area is 2160 × 2160;
processing the resolution of the picture of the non-hot spot area with the resolution of 2160 by 2160 to be 1680 by 2160; 3840 is a positive number;
placing the pictures of the hot spot area with the resolution of 2160 × 2160 and the pictures of the non-hot spot area with the resolution of 1680 × 2160 into the same picture, and obtaining a rectangular VR video with the resolution of 3840 × 2160;
the recovery module 22 is configured to:
obtaining pictures of hot spot areas with the resolution of 2160 × 2160 and pictures of non-hot spot areas with the resolution of 1680 × 2160 from a rectangular VR video with the resolution of 3840 × 2160;
processing the resolution of the picture of the non-hot spot area with the resolution of 1680 × 2160 into 2160 × 2160, wherein the resolution of the rectangular VR video is 4320 × 2160;
and restoring the rectangular VR video with the resolution of 4320 × 2160 into the spherical VR video with the equatorial resolution of 4320, wherein hot spot areas of the rectangular VR video are mapped to hot spot hemispheres, and non-hot spot areas of the rectangular VR video are mapped to non-hot spot hemispheres.
The embodiment of the invention fully utilizes the space of ultra-high definition resolution, can support the spherical VR video with equator resolution M being 4320, and increases the effective information of the sphere by 26.6 percent compared with the prior art which can only support the equator resolution of 3840 at most; since the final output can be standard ultra-high definition resolution 3840 × 2160, various physical transmission interfaces, terminal codecs, terminal display devices and the like can be seamlessly compatible; the projection of the hot spot hemisphere is not subjected to any additional processing, so that the image quality is prevented from being reduced, only the width of the non-hot spot hemisphere is slightly zoomed, and the additional distortion and the image quality reduction caused by a full-picture stretching or compressing mode and the performance consumption of image rendering are obviously reduced; the method does not damage the continuity of the original spherical picture, and is very suitable for use scenes such as preview, director switching, large-screen display and the like.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus and method can be implemented in other ways. The apparatus embodiments described above are merely illustrative, and for example, the flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of apparatus, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The invention has been described in terms of its several purposes, including but not limited to, and it is to be understood that such terms are merely intended to cover such departures from the present disclosure as come within known or customary practice in the art to which this invention pertains and which fall within the limits of the appended claims. It should be noted that the embodiments and features of the embodiments may be combined with each other without conflict. Although the present invention has been described to a certain extent, it is apparent that appropriate changes in the respective conditions may be made without departing from the spirit and scope of the present invention. It is to be understood that the invention is not limited to the described embodiments, but is to be accorded the scope consistent with the claims, including equivalents of each element described. Various other modifications and changes may be made by those skilled in the art based on the above-described technical solutions and concepts, and all such modifications and changes should fall within the scope of the claims of the present invention.
Claims (10)
1. A method for improving the definition of an ultra-high definition (UHD) 4K-resolution Virtual Reality (VR) video is characterized by comprising the following steps of:
the unfolding step comprises the following steps:
setting a hot spot spherical surface and a non-hot spot spherical surface on a spherical VR video with the equator resolution of M; m is a positive number;
expanding a spherical VR video with the equator resolution of M into a rectangular VR video with the resolution of M x H, wherein hot spot spherical surfaces are mapped to hot spot areas of the rectangular VR video, and non-hot spot spherical surfaces are mapped to non-hot spot areas of the rectangular VR video; the resolution of the hot spot region is H, and the resolution of the non-hot spot region is (M-H);
processing the resolution of the picture of the non-hot spot area with the resolution of (M-H) H into (N-H) H; n is a positive number;
placing the picture of the hot spot area with the resolution of H x H and the picture of the non-hot spot area with the resolution of (N-H) x H into the same picture to obtain a rectangular VR video with the resolution of N x H;
the restoration step comprises:
acquiring pictures of a hot spot area with the resolution of H and pictures of a non-hot spot area with the resolution of (N-H) H from a rectangular VR video with the resolution of N H;
processing the resolution of the picture of the non-hot spot area with the resolution of (N-H) H into (M-H) H, wherein the resolution of the rectangular VR video is M H;
and restoring the rectangular VR video with the resolution of M x H into a spherical VR video with the equator resolution of M, wherein the hot spot region of the rectangular VR video is mapped to the hot spot spherical surface, and the non-hot spot region of the rectangular VR video is mapped to the non-hot spot spherical surface.
2. The method for improving the sharpness of the Ultra High Definition (UHD) 4K-resolution (VR) video according to claim 1, wherein M > N.
3. The method for improving the definition of the ultra high definition 4K resolution VR video according to claim 1 or 2, wherein the shape of the hot spot sphere and the shape of the non-hot spot sphere are both hemispheres.
4. The method of claim 3, wherein M is 4320, N is 3840, and H is 2160.
5. The method for improving the sharpness of the Ultra High Definition (UHD) 4K-resolution VR video according to claim 1 or 2, wherein the expanding the spherical VR video with equatorial resolution M into the rectangular VR video with resolution M x H comprises:
and expanding the spherical VR video with the equator resolution of M into a rectangular VR video with the resolution of M x H by an ERP method.
6. The method for improving the definition of the ultra high definition 4K resolution VR video according to claim 1 or 2, wherein the hot spot spherical surface is mapped to a hot spot area of the rectangular VR video, and the non-hot spot spherical surface is mapped to a non-hot spot area of the rectangular VR video, specifically:
the hot spot spherical surface is mapped to a hot spot area at one end of the rectangular VR video, and the non-hot spot spherical surface is mapped to a non-hot spot area at the other end of the rectangular VR video.
7. The utility model provides an ultra high definition 4K resolution ratio VR video definition's hoisting device which characterized in that includes interconnect's expansion module, restores the module:
the deployment module is to:
setting a hot spot spherical surface and a non-hot spot spherical surface on a spherical VR video with the equator resolution of M; m is a positive number;
expanding a spherical VR video with the equator resolution of M into a rectangular VR video with the resolution of M x H, wherein hot spot spherical surfaces are mapped to hot spot areas of the rectangular VR video, and non-hot spot spherical surfaces are mapped to non-hot spot areas of the rectangular VR video; the resolution of the hot spot region is H, and the resolution of the non-hot spot region is (M-H);
processing the resolution of the picture of the non-hot spot area with the resolution of (M-H) H into (N-H) H; n is a positive number;
placing the picture of the hot spot area with the resolution of H x H and the picture of the non-hot spot area with the resolution of (N-H) x H into the same picture to obtain a rectangular VR video with the resolution of N x H;
the recovery module is used for:
acquiring pictures of a hot spot area with the resolution of H and pictures of a non-hot spot area with the resolution of (N-H) H from a rectangular VR video with the resolution of N H;
processing the resolution of the picture of the non-hot spot area with the resolution of (N-H) H into (M-H) H, wherein the resolution of the rectangular VR video is M H;
and restoring the rectangular VR video with the resolution of M x H into a spherical VR video with the equator resolution of M, wherein the hot spot region of the rectangular VR video is mapped to the hot spot spherical surface, and the non-hot spot region of the rectangular VR video is mapped to the non-hot spot spherical surface.
8. The apparatus for improving Ultra High Definition (UHD) 4K resolution (VR) video definition according to claim 7, wherein the shape of the hot spot sphere and the shape of the non-hot spot sphere are both hemispheres.
9. The apparatus for improving Ultra High Definition (UHD) 4K resolution (VR) video definition according to claim 8, wherein M is 4320, N is 3840, and H is 2160.
10. The apparatus for improving the sharpness of an Ultra High Definition (UHD) 4K resolution VR video according to claim 7 or 8, wherein the hot spot sphere is mapped to a hot spot region of a rectangular VR video, and the non-hot spot sphere is mapped to a non-hot spot region of the rectangular VR video, specifically:
the hot spot spherical surface is mapped to a hot spot area at one end of the rectangular VR video, and the non-hot spot spherical surface is mapped to a non-hot spot area at the other end of the rectangular VR video.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910546653.2A CN112135082A (en) | 2019-06-24 | 2019-06-24 | Method and device for improving ultra-high definition 4K resolution VR video definition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910546653.2A CN112135082A (en) | 2019-06-24 | 2019-06-24 | Method and device for improving ultra-high definition 4K resolution VR video definition |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112135082A true CN112135082A (en) | 2020-12-25 |
Family
ID=73848996
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910546653.2A Pending CN112135082A (en) | 2019-06-24 | 2019-06-24 | Method and device for improving ultra-high definition 4K resolution VR video definition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112135082A (en) |
-
2019
- 2019-06-24 CN CN201910546653.2A patent/CN112135082A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109792562B (en) | Content-based stream segmentation of video data | |
| CN112204993B (en) | Adaptive panoramic video streaming using overlapping partitioned segments | |
| EP3457697B1 (en) | Method and apparatus for encoding and decoding video image | |
| JP2020509647A (en) | Image mapping and processing method, apparatus, and machine-readable medium | |
| US7656403B2 (en) | Image processing and display | |
| CN101689292B (en) | Banana codec | |
| CN109194923B (en) | Video image processing device, system and method based on local non-uniform resolution | |
| US11057643B2 (en) | Method and apparatus for generating and encoding projection-based frame that includes at least one padding region and at least one projection face packed in 360-degree virtual reality projection layout | |
| CN106780317B (en) | Panoramic projection method and device | |
| CN107426491B (en) | Implementation method of 360-degree panoramic video | |
| TWI683569B (en) | Panorama video compression method and device | |
| US11373337B2 (en) | Image processing method of virtual reality and apparatus thereof | |
| CN110956583A (en) | Spherical image processing method and device and server | |
| CN109804631B (en) | Apparatus and method for encoding and decoding video signal | |
| CN116760965B (en) | Panoramic video encoding method, device, computer equipment and storage medium | |
| US11494870B2 (en) | Method and apparatus for reducing artifacts in projection-based frame | |
| WO2018025474A1 (en) | Information processing device, information processing method, and program | |
| CN106991640B (en) | Panoramic image unfolding method and system | |
| US10963987B2 (en) | Method and apparatus for decoding projection based frame with 360-degree content represented by triangular projection faces packed in triangle-based projection layout | |
| CN107610045B (en) | Brightness compensation method, device and equipment in fisheye picture splicing and storage medium | |
| CN114007059A (en) | Video compression method, decompression method, device, electronic equipment and storage medium | |
| CN112135082A (en) | Method and device for improving ultra-high definition 4K resolution VR video definition | |
| US20230054523A1 (en) | Enhancing 360-degree video using convolutional neural network (cnn)-based filter | |
| CN115997379A (en) | Restoration of image FOV for stereoscopic rendering | |
| CN106897964B (en) | Keep the panoramic video frame rectangle mapping method of adjacent pixel correlation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20201225 |
|
| WD01 | Invention patent application deemed withdrawn after publication |