CN112601065B - Method and device for reconstructing high-freedom video viewable range - Google Patents

Method and device for reconstructing high-freedom video viewable range Download PDF

Info

Publication number
CN112601065B
CN112601065B CN201910946062.4A CN201910946062A CN112601065B CN 112601065 B CN112601065 B CN 112601065B CN 201910946062 A CN201910946062 A CN 201910946062A CN 112601065 B CN112601065 B CN 112601065B
Authority
CN
China
Prior art keywords
range
viewpoint
viewable
parameter
shape
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910946062.4A
Other languages
Chinese (zh)
Other versions
CN112601065A (en
Inventor
虞露
王彬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang University ZJU
Original Assignee
Zhejiang University ZJU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang University ZJU filed Critical Zhejiang University ZJU
Priority to CN201910946062.4A priority Critical patent/CN112601065B/en
Publication of CN112601065A publication Critical patent/CN112601065A/en
Application granted granted Critical
Publication of CN112601065B publication Critical patent/CN112601065B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/194—Transmission of image signals

Abstract

The invention discloses a method and a device for reconstructing a high-freedom video viewable range. The method is used in the multimedia field, extracts the relevant parameters of the high-freedom video viewable range from the code stream, and reconstructs the high-freedom video viewable range according to the parameters. The method provided by the invention can be used for determining the viewable range of the high-freedom video, and judging the quality of the target image in advance before rendering the target image for post-processing. The invention provides a method for reconstructing a high-freedom video viewable range and a corresponding device.

Description

Method and device for reconstructing high-freedom video viewable range
Technical Field
The invention belongs to the field of high-freedom degree video information processing, and particularly relates to a method and a device for reconstructing a high-freedom degree video viewable range through related parameters of the high-freedom degree video viewable range.
Background
The "immersion" is a subjective evaluation, which refers to the perception substitution of the viewer into the virtual scene created and displayed by the multimedia system. As the capabilities of capture devices and display devices have increased year by year, the encoding, transmission and rendering of immersive media as a visual multimedia that can bring a viewer a strong sense of immersion has become a research hotspot in the industry and the scientific community.
The viewing freedom is a very important parameter index for measuring the immersion feeling, and in the three-dimensional space, the viewing freedom of the viewer supports and displays six degrees of freedom at most, including translation along the X, Y and Z axes of the three-dimensional space and rotation around the three axes respectively. As immersion is the media supporting the increase of the viewing freedom, namely, a viewer can move the position and change the orientation in a three-dimensional space to view a scene, the viewer can obtain the interaction inductance and the motion parallax, and stronger visual perception immersion is formed. Compared with the conventional two-dimensional plane image, the method currently comprises the following steps: panoramic video, point cloud video, three degrees of freedom add the video and can all bring the promotion of watching the degree of freedom for the viewer in different degrees, bring the viewer more so far on the spot visual experience.
It is not possible to capture all information in a continuous three-dimensional space, so immersive media needs to be rendered virtually generated for target content in the non-captured position and orientation in order to support free viewer movement. For a viewer at a specific moment, the image renderer combines the position and orientation information of the viewer and the collected image information to render a target viewpoint image through a viewpoint synthesis technology based on depth.
It can be seen that the amount of image information captured determines the viewing freedom that the immersive media can bring to the viewer. Due to the limited number of acquisition devices and data transmission bandwidths, the freedom of movement that all immersive media can bring to a viewer is limited, i.e., the viewer can only get a better immersive media visual quality experience in a defined space.
However, the viewer is not informed of valid viewing space information throughout the current immersive media system. After the current position and orientation information of the viewer is known, the target image renderer cannot judge whether the target image renderer is in an effective viewing space in advance, and also cannot judge the subjective quality after the image is rendered. When the user gradually leaves the effective viewing space or the orientation exceeds the range of the viewing angle, the system cannot give effective information prompt, and no effective guarantee is provided for the user to view the immersive media.
Disclosure of Invention
In order to solve the above problem, the present invention provides a method and an apparatus for reconstructing a high-degree-of-freedom video viewable range. Extracting corresponding parameters of a high-freedom video viewable range from a code stream, wherein the parameters comprise: shape type of viewable area, shape parameter, translation parameter [ x ] t,yt,zt]Rotation parameter
Figure GDA0003407933210000011
Orientation parameter representing a viewpoint
Figure GDA0003407933210000012
Horizon parameter theta0,theta1,phi0,phi1And the like. By the parameters, the viewable viewpoint range and the visual field range of all the viewpoints in the viewpoint range can be reconstructedTherefore, the generation quality of the target image can be judged according to the position and orientation information of the viewer in the three-dimensional space before the target image is rendered, and therefore effective guarantee reminding is carried out on the user.
It is a first object of the present invention to provide a method of reconstructing a high degree of freedom video viewable range, comprising:
extracting the shape type of the viewable viewpoint range from the code stream, and determining the shape type of the viewable viewpoint range;
extracting corresponding shape parameters of the range of the observable viewpoint from the code stream according to the shape type of the range of the observable viewpoint;
determining the range of the point [ x ', y ', z ' ] set according to the shape type and the shape parameter of the range of the observable visual points;
extracting translation parameter [ x ] of visual point range from code streamt,yt,zt]And rotation parameter
Figure GDA0003407933210000021
According to [ x ] describedt,yt,zt]And
Figure GDA0003407933210000022
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]A range of sets;
the range of the point [ x, y, z ] set is the viewable viewpoint range of the reconstructed high-freedom video.
Said determining a range of a set of points [ x ', y ', z ' ] based on a shape type and a shape parameter of said range of viewable viewpoints comprises one of:
(1) the shape type of the range of the observable viewpoint is an ellipsoid, the shape parameters are a, b and c, wherein a, b and c are numbers not less than 0, and the range of the set of points [ x ', y ', z ' ] is as follows:
Figure GDA0003407933210000023
(2) the shape type of the range of the observable viewpoint is a cuboid, the shape parameters are a, b and c, wherein a, b and c are numbers not less than 0, and the range of the set of points [ x ', y ', z ' ] is as follows:
| x ' | is less than or equal to a, | y ' | is less than or equal to b, and | z ' | is less than or equal to c;
(3) the shape type of the range of the observable viewpoint is a cylinder, the shape parameters are a, b, and c, wherein a, b, and c are numbers not less than 0, and the range of the set of points [ x ', y ', z ' ] is:
Figure GDA0003407933210000024
and | z' | is less than or equal to c;
(4) the shape type of the range of the observable visual point is a sphere, the shape parameter is a, wherein a is a number not less than 0, and the range of the set of points [ x ', y ', z ' ] is:
(x′)2+(y′)2+(z′)2≤a2；
(5) the shape type of the range of the viewable viewpoint is a cube, the shape parameter is a, where a is a number not less than 0, and the range of the set of points [ x ', y ', z ' ] is:
| x ' | is less than or equal to a, and | y ' | is less than or equal to a, and | z ' | is less than or equal to a.
Extracting orientation parameters of a viewable viewpoint range representing viewpoints from a code stream
Figure GDA0003407933210000025
And the field of view range parameter theta0,theta1,phi0,phi1Wherein theta is0Is the longitude minimum of the field of view, where theta1Is the maximum longitude of the field of view, where phi0As the latitude minimum of the horizon, phi1Is the latitude maximum of the visual field range;
determining a field of view range representing the viewpoint, the field of view range satisfying the theta at [ theta ]0,theta1]Within the range of phi is [ phi0,phi1]All of [ theta, phi ] within the range]A set of (a);
and determining the visual field range of all the visual points in the viewable visual point range of the reconstructed high-freedom video according to the visual field range of the representative visual point and the orientation change parameters of all the visual points in the viewable visual point range relative to the representative visual point.
Determining the visual field range of all the viewpoints in the viewable viewpoint range of the reconstructed high-freedom video according to the visual field range of the representative viewpoint and the orientation change parameters of all the viewpoints in the viewable viewpoint range relative to the representative viewpoint, wherein the visual field range of all the viewpoints in the viewable viewpoint range of the reconstructed high-freedom video comprises one of the following:
orientation change parameters of all viewpoints relative to the representative viewpoint in the viewable viewpoint range are extracted from the code stream;
the orientation variation parameter of all viewpoints in the viewable viewpoint range with respect to the representative viewpoint is set to zero.
It is a second object of the present invention to provide an apparatus for reconstructing a high degree of freedom video viewable range, comprising:
The observable range parameter extraction module: the input is code stream, and the output is shape type, shape parameter and translation parameter [ x ] of visual viewpoint ranget,yt,zt]And rotation parameter
Figure GDA0003407933210000031
The module extracts the shape type of the viewable viewpoint range from the code stream, determines the shape type of the viewable viewpoint range, extracts the corresponding shape parameter of the viewable viewpoint range from the code stream according to the shape type of the viewable viewpoint range, and extracts the translation parameter [ x ] of the viewable viewpoint range from the code streamt,yt,zt]And rotation parameter
Figure GDA0003407933210000032
Viewable range reconstruction module: the input of the method is the shape type, the shape parameter and the translation parameter [ x ] of the range of the visual pointt,yt,zt]And rotation parameter
Figure GDA0003407933210000033
The output is reconstructionThe module determines points [ x ', y', z 'according to shape type and shape parameters of the viewable viewpoint range']Set range and according to said [ x ]t,yt,zt]And
Figure GDA0003407933210000034
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]Range of set, said points [ x, y, z ]]The range of the set is the viewable viewpoint range of the reconstructed high-freedom video.
Said determining a range of a set of points [ x ', y ', z ' ] based on a shape type and a shape parameter of said range of viewable viewpoints comprises one of:
(1) The shape type of the range of the observable viewpoint is an ellipsoid, the shape parameters are a, b and c, wherein a, b and c are numbers not less than 0, and the range of the set of points [ x ', y ', z ' ] is as follows:
Figure GDA0003407933210000035
(2) the shape type of the range of the observable viewpoint is a cuboid, the shape parameters are a, b and c, wherein a, b and c are numbers not less than 0, and the range of the set of points [ x ', y ', z ' ] is as follows:
| x ' | is less than or equal to a, | y ' | is less than or equal to b, and | z ' | is less than or equal to c;
(3) the shape type of the range of the observable viewpoint is a cylinder, the shape parameters are a, b, and c, wherein a, b, and c are numbers not less than 0, and the range of the set of points [ x ', y ', z ' ] is:
Figure GDA0003407933210000036
and | z' | is less than or equal to c;
(4) the shape type of the range of the observable visual point is a sphere, the shape parameter is a, wherein a is a number not less than 0, and the range of the set of points [ x ', y ', z ' ] is:
(x′)2+(y′)2+(z′)2≤a2；
(5) the shape type of the range of the viewable viewpoint is a cube, the shape parameter is a, where a is a number not less than 0, and the range of the set of points [ x ', y ', z ' ] is:
| x ' | is less than or equal to a, and | y ' | is less than or equal to a, and | z ' | is less than or equal to a.
The viewable range parameter extraction module further comprises a viewable range view parameter extraction module sub-module, and the viewable range reconstruction module further comprises a viewable range viewpoint view range reconstruction module:
The visual range field parameter extraction module: the input is code stream, and the output is orientation parameter of visual point represented by visual point range
Figure GDA0003407933210000041
And the field of view range parameter theta0,theta1,phi0,phi1Wherein theta is0Is the longitude minimum of the field of view, where theta1Is the maximum longitude of the field of view, where phi0As the latitude minimum of the horizon, phi1Is the latitude maximum of the visual field range;
observable range viewpoint visual field range reconstruction module: the input of which is the orientation parameter of the viewable viewpoint range representing the viewpoint
Figure GDA0003407933210000042
Horizon parameter theta0,theta1,phi0,phi1And orientation variation parameters of all viewpoints in the viewable viewpoint range relative to the representative viewpoint, the output of which is a field of view range of all viewpoints in the viewable viewpoint range of the reconstructed high-degree-of-freedom video, the module determining the field of view range of the representative viewpoint, the field of view range satisfying the theta [ theta ] for the theta0,theta1]Within the range of phi is [ phi0,phi1]All of [ theta, phi ] within the range]And determining the view range of all viewpoints in the viewable viewpoint range of the reconstructed high-freedom video according to the view range of the representative viewpoint and the orientation change parameters of all viewpoints in the viewable viewpoint range relative to the representative viewpoint。
Determining the visual field range of all the viewpoints in the viewable viewpoint range of the reconstructed high-freedom video according to the visual field range of the representative viewpoint and the orientation change parameters of all the viewpoints in the viewable viewpoint range relative to the representative viewpoint, wherein the visual field range of all the viewpoints in the viewable viewpoint range of the reconstructed high-freedom video comprises one of the following:
Orientation change parameters of all viewpoints relative to the representative viewpoint in the viewable viewpoint range are extracted from the code stream;
the orientation variation parameter of all viewpoints in the viewable viewpoint range with respect to the representative viewpoint is set to zero.
Due to the adoption of the technical scheme, the invention has the following advantages:
the visual field ranges of all viewpoints in the viewable viewpoint range and the trial viewpoint range can be reconstructed through the parameters, the generation quality of the target image is judged through the position and orientation information of a viewer in a three-dimensional space before the target image is rendered, and further, the operation such as effective prompt is carried out through the generation quality, so that the situation that the user views the target image with poor quality can be avoided.
Drawings
Other features and advantages of the present invention will become apparent from the following description of the preferred embodiment, taken in conjunction with the accompanying drawings, which illustrate, by way of example, the principles of the invention.
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the nature of the invention and not to limit the scope of the invention. In the drawings:
FIG. 1 is a flow chart of the inventive apparatus;
FIG. 2 is a schematic spatial diagram of a range of viewable viewpoints in the form of an ellipsoid in accordance with one embodiment of the present invention;
FIG. 3 is a schematic spatial diagram of a viewable viewpoint range shaped as a cube in accordance with one embodiment of the present invention;
FIG. 4 is a schematic spatial diagram of a cylindrical shape for a range of viewable viewpoints in an embodiment of the present invention;
FIG. 5 is a schematic view of a range of sets of points [ x ', y ', z ' ] undergoing translational rotation in accordance with an embodiment of the present invention;
FIG. 6 is a schematic view of the orientation of different viewpoints for a range of viewable viewpoints in an embodiment of the present invention;
FIG. 7 is a diagram illustrating the viewing ranges of different viewpoints for a range of viewable viewpoints in an embodiment of the present invention;
fig. 8 is a schematic spatial diagram of an octahedron shape type for a range of viewable viewpoints in an embodiment of the present invention.
Detailed Description
For a further understanding of the invention, reference will now be made to the following examples describing preferred embodiments of the invention, but it is to be understood that the description is intended to illustrate further features and advantages of the invention and is not intended to limit the scope of the claims.
Example 1
A method for screening a viewable range of a reconstructed high-freedom video specifically comprises the following steps:
Extracting the shape type of the range of the observable viewpoint from the code stream, and determining that the shape type of the range of the observable viewpoint is an ellipsoid;
according to the shape type of the viewable viewpoint range, which is an ellipsoid, as shown in fig. 2, extracting corresponding shape parameters of a 1m, b 2m, and c 3m from the code stream;
determining the range of the point [ x ', y ', z ' ] set according to the shape type and the shape parameter of the range of the observable visual points as follows:
Figure GDA0003407933210000051
extracting translation parameter [ x ] of visual point range from code streamt＝1m,yt＝1m,zt＝1m]And rotation parameter
Figure GDA0003407933210000052
Figure GDA0003407933210000053
According to [ x ] describedt,yt,zt]And
Figure GDA0003407933210000054
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]The range of the set is specifically as follows:
Figure GDA0003407933210000055
the range of the point [ x, y, z ] set is the viewable viewpoint range of the reconstructed high-freedom video.
Example 2
A method for screening a viewable range of a reconstructed high-freedom video specifically comprises the following steps:
extracting the shape type of the viewable viewpoint range from the code stream, and determining that the shape type of the viewable viewpoint range is a cube;
the type of the shape according to the viewable viewpoint range is a cube, and as shown in fig. 3, corresponding shape parameters a is 2m, b is 2m, and c is 1m are extracted from the code stream;
determining the range of the point [ x ', y ', z ' ] set according to the shape type and the shape parameter of the range of the observable visual points as follows:
| x ' | is less than or equal to 2m, and | y ' | is less than or equal to 2m, and | z ' | is less than or equal to 1 m;
extracting translation parameter [ x ] of visual point range from code streamt＝2m,yt＝2m,zt＝0m]And rotation parameter
Figure GDA0003407933210000056
Figure GDA0003407933210000057
According to [ x ] describedt,yt,zt]And
Figure GDA0003407933210000058
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]The range of the set, as shown in fig. 5, is specifically:
Figure GDA0003407933210000061
the range of the point [ x, y, z ] set is the viewable viewpoint range of the reconstructed high-freedom video.
Example 3
A method for screening a viewable range of a reconstructed high-freedom video specifically comprises the following steps:
extracting the shape type of the range of the viewable viewpoint from the code stream, and determining that the shape type of the range of the viewable viewpoint is a cylinder;
according to the shape type of the viewable viewpoint range, the shape is a cylinder, and as shown in fig. 4, corresponding shape parameters a is 10cm, b is 30cm, and c is 40cm are extracted from the code stream;
determining the range of the point [ x ', y ', z ' ] set according to the shape type and the shape parameter of the range of the observable visual points as follows:
Figure GDA0003407933210000062
and | z' | is less than or equal to 40 cm;
extracting translation parameter [ x ] of visual point range from code streamt＝20cm,yt＝20cm,zt＝0cm]And rotation parameter
Figure GDA0003407933210000063
Figure GDA0003407933210000064
According to [ x ] describedt,yt,zt]And
Figure GDA0003407933210000065
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding points x, y,z]the range of the set is specifically as follows:
Figure GDA0003407933210000066
The range of the point [ x, y, z ] set is the viewable viewpoint range of the reconstructed high-freedom video.
Example 4
A method for screening a viewable range of a reconstructed high-freedom video specifically comprises the following steps:
extracting the shape type of the range of the viewable viewpoint from the code stream, and determining that the shape type of the range of the viewable viewpoint is a cylinder;
extracting corresponding shape parameters from the code stream, wherein the shape type of the viewable viewpoint range is a cylinder, and a is 1m, b is 30cm, and c is 400 mm;
determining the range of the point [ x ', y ', z ' ] set according to the shape type and the shape parameter of the range of the observable visual points as follows:
Figure GDA0003407933210000067
and | z' | is less than or equal to 400 mm;
extracting translation parameter [ x ] of visual point range from code streamt＝0cm,yt＝0cm,zt＝0cm]And rotation parameter
Figure GDA0003407933210000068
Figure GDA0003407933210000069
According to [ x ] describedt,yt,zt]And
Figure GDA00034079332100000610
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]The range of the set is specifically as follows:
Figure GDA00034079332100000611
the range of the point [ x, y, z ] set is the viewable viewpoint range of the reconstructed high-freedom video.
Example 5
A method for screening a viewable range of a reconstructed high-freedom video specifically comprises the following steps:
extracting the shape type of the viewable viewpoint range from the code stream, and determining that the shape type of the viewable viewpoint range is a cube;
Extracting corresponding shape parameters from the code stream, wherein the shape type of the viewable viewpoint range is a cube, and a is 2m, b is 2m, and c is 1 m;
determining the range of the point [ x ', y ', z ' ] set according to the shape type and the shape parameter of the range of the observable visual points as follows:
| x ' | is less than or equal to 2m, and | y ' | is less than or equal to 2m, and | z ' | is less than or equal to 1 m;
extracting translation parameter [ x ] of visual point range from code streamt＝1m,yt＝1m,zt＝0m]And rotation parameter
Figure GDA0003407933210000071
Figure GDA0003407933210000072
According to [ x ] describedt,yt,zt]And
Figure GDA0003407933210000073
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]The range of the set is specifically as follows:
Figure GDA0003407933210000074
the range of the point [ x, y, z ] set is the viewable viewpoint range of the reconstructed high-freedom video;
extracting viewable viewpoint range from code streamThe orientation parameter of the surrounding representing viewpoint
Figure GDA0003407933210000075
And the field of view range parameter theta0＝-0.5π,theta1＝0.5π,phi0＝-0.4π,phi10.5 pi, wherein theta0Is the longitude minimum of the field of view, where theta1Is the maximum longitude of the field of view, where phi0As the latitude minimum of the horizon, phi1Is the latitude maximum of the visual field range;
determining a visual field range representing the viewpoint, the visual field range being a set of all [ theta, phi ] satisfying that theta is in the range of [ -0.5 pi, 0.5 pi ] and phi is in the range of [ -0.4 pi, 0.5 pi ];
determining the view range of all viewpoints in the viewable viewpoint range of the reconstructed high-degree-of-freedom video according to the view range of the representative viewpoint and the orientation change parameters of all viewpoints in the viewable viewpoint range relative to the representative viewpoint, specifically:
Orientation change parameters of all viewpoints in the viewable viewpoint range with respect to the representative viewpoint are set to zero, and it is determined that the visual field ranges of all viewpoints in the viewable viewpoint range of the reconstructed high-degree-of-freedom video are all a set of [ theta, phi ] satisfying the condition that theta is in the range of [ -0.5 pi, 0.5 pi ] and phi is in the range of [ -0.4 pi, 0.5 pi ].
Example 6
A method for screening a viewable range of a reconstructed high-freedom video specifically comprises the following steps:
extracting the shape type of the range of the observable viewpoint from the code stream, and determining that the shape type of the range of the observable viewpoint is an ellipsoid;
extracting corresponding shape parameters from the code stream, namely a is 50cm, b is 20cm, and c is 10cm, according to the shape type of the viewable viewpoint range, wherein the shape type is an ellipsoid;
determining the range of the point [ x ', y ', z ' ] set according to the shape type and the shape parameter of the range of the observable visual points as follows:
Figure GDA0003407933210000081
extracting translation parameter [ x ] of visual point range from code streamt＝1m,yt＝1m,zt＝0m]And rotation parameter
Figure GDA0003407933210000082
Figure GDA0003407933210000083
According to [ x ] describedt,yt,zt]And
Figure GDA0003407933210000084
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]The range of the set is specifically as follows:
Figure GDA0003407933210000085
the range of the point [ x, y, z ] set is the range of the observable viewpoint of the reconstructed high-freedom video,
Extracting orientation parameters of a viewable viewpoint range representing viewpoints from a code stream
Figure GDA0003407933210000086
And the field of view range parameter theta0＝-40°,theta1＝180°,phi0＝20°,phi150 deg., wherein theta0Is the longitude minimum of the field of view, where theta1Is the maximum longitude of the field of view, where phi0As the latitude minimum of the horizon, phi1Is the latitude maximum of the visual field range;
determining a visual field range representing the viewpoint, the visual field range being a set of all [ theta, phi ] satisfying that theta is in the range of [ -40 °,180 ° ] and phi is in the range of [20 °,50 ° ];
determining the view range of all viewpoints in the viewable viewpoint range of the reconstructed high-degree-of-freedom video according to the view range of the representative viewpoint and the orientation change parameters of all viewpoints in the viewable viewpoint range relative to the representative viewpoint, specifically:
extracting orientation change parameters of all viewpoints in a viewable viewpoint range relative to a representative viewpoint from a code stream into
Figure GDA0003407933210000087
Figure GDA0003407933210000088
As shown in FIG. 6, it was confirmed that theta' was satisfied at [ -0.5 π,0.5 π]In the range and phi' is [ -0.4 pi, 0.5 pi]All of [ theta ', phi']A set of (a);
according to said
Figure GDA0003407933210000089
Direction of rotation [ theta ', phi']The extent of the set yields the corresponding direction [ theta (x, y, z), phi (x, y, z)]The range of the set, as shown in fig. 7, is specifically as follows:
Figure GDA00034079332100000810
Figure GDA00034079332100000811
Figure GDA00034079332100000812
The range of the direction [ theta (x, y, z), phi (x, y, z) ] set is the visual field range of all the viewpoints in the viewable viewpoint range of the reconstructed high-freedom video.
Example 7
A method for screening a viewable range of a reconstructed high-freedom video specifically comprises the following steps:
extracting the shape type of the range of the observable viewpoint from the code stream, and determining that the shape type of the range of the observable viewpoint is an ellipsoid;
extracting corresponding shape parameters from the code stream, namely a is 50cm, b is 20cm, and c is 10cm, according to the shape type of the viewable viewpoint range, wherein the shape type is an ellipsoid;
determining the range of the point [ x ', y ', z ' ] set according to the shape type and the shape parameter of the range of the observable visual points as follows:
Figure GDA0003407933210000091
extracting translation parameter [ x ] of visual point range from code streamt＝1m,yt＝1m,zt＝0m]And rotation parameter
Figure GDA0003407933210000092
Figure GDA0003407933210000093
According to [ x ] describedt,yt,zt]And
Figure GDA0003407933210000094
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]The range of the set is specifically as follows:
Figure GDA0003407933210000095
the range of the point [ x, y, z ] set is the range of the observable viewpoint of the reconstructed high-freedom video,
extracting orientation parameters of a viewable viewpoint range representing viewpoints from a code stream
Figure GDA0003407933210000096
And the field of view range parameter theta0＝-40°,theta1＝180°,phi0＝20°,phi150 deg., wherein theta0Is the longitude minimum of the field of view, where theta 1Is the maximum longitude of the field of view, where phi0As the latitude minimum of the horizon, phi1Is the latitude maximum of the visual field range;
determining a visual field range representing the viewpoint, the visual field range being a set of all [ theta, phi ] satisfying that theta is in the range of [ -40 °,180 ° ] and phi is in the range of [20 °,50 ° ];
determining the view range of all viewpoints in the viewable viewpoint range of the reconstructed high-degree-of-freedom video according to the view range of the representative viewpoint and the orientation change parameters of all viewpoints in the viewable viewpoint range relative to the representative viewpoint, specifically:
extracting orientation change parameters of all viewpoints in a viewable viewpoint range relative to a representative viewpoint from a code stream into
Figure GDA0003407933210000097
Figure GDA0003407933210000098
It is determined that theta' is satisfied at [ -0.5 π,0.5 π]In the range and phi' is [ -0.4 pi, 0.5 pi]All of [ theta ', phi']A set of (a);
according to said
Figure GDA0003407933210000099
Direction of rotation [ theta ', phi']The extent of the set yields the corresponding direction [ theta (x, y, z), phi (x, y, z)]The range of the set is specifically as follows:
Figure GDA00034079332100000910
Figure GDA0003407933210000101
Figure GDA0003407933210000102
the range of the direction [ theta (x, y, z), phi (x, y, z) ] set is the visual field range of all the viewpoints in the viewable viewpoint range of the reconstructed high-freedom video.
Example 8
A method for screening a viewable range of a reconstructed high-freedom video specifically comprises the following steps:
Extracting the shape type of the viewable viewpoint range from the code stream, and determining that the shape type of the viewable viewpoint range is a cube;
extracting corresponding shape parameters from the code stream, namely a is 2m, b is 2m, and c is 0m, according to the fact that the shape type of the viewable viewpoint range is a cube;
determining the range of the point [ x ', y ', z ' ] set according to the shape type and the shape parameter of the range of the observable visual points as follows:
| x ' | is less than or equal to 2m, and | y ' | is less than or equal to 2m, and | z ' | is 0 m;
extracting translation parameter [ x ] of visual point range from code streamt＝2m,yt＝2m,zt＝0m]And rotation parameter
Figure GDA0003407933210000103
Figure GDA0003407933210000104
According to [ x ] describedt,yt,zt]And
Figure GDA0003407933210000105
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]The range of the set is specifically as follows:
Figure GDA0003407933210000106
the range of the point [ x, y, z ] set is the viewable viewpoint range of the reconstructed high-freedom video.
Example 9
A method for screening a viewable range of a reconstructed high-freedom video specifically comprises the following steps:
extracting the shape type of the range of the viewable viewpoint from the code stream, and determining that the shape type of the range of the viewable viewpoint is a cylinder;
extracting corresponding shape parameters from the code stream, wherein the shape type of the viewable viewpoint range is a cylinder, and a is 0m, b is 0m, and c is 0 m;
determining the range of the point [ x ', y ', z ' ] set according to the shape type and the shape parameter of the range of the observable visual points as follows:
x ' ═ 0m and y ' ═ 0m and z ' ═ 0 m;
extracting translation parameter [ x ] of visual point range from code streamt＝2m,yt＝2m,zt＝0m]And rotation parameter
Figure GDA0003407933210000107
Figure GDA0003407933210000108
According to [ x ] describedt,yt,zt]And
Figure GDA0003407933210000109
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]The range of the set is specifically as follows:
Figure GDA00034079332100001010
the range of the point [ x, y, z ] set is the viewable viewpoint range of the reconstructed high-freedom video.
Example 10
A method for screening a viewable range of a reconstructed high-freedom video specifically comprises the following steps:
extracting the shape type of the viewable viewpoint range from the code stream, and determining that the shape type of the viewable viewpoint range is a cube;
extracting corresponding shape parameters from the code stream, wherein the shape type of the viewable viewpoint range is a cube, and a is 2m, b is 2m, and c is 1 m;
determining the range of the point [ x ', y ', z ' ] set according to the shape type and the shape parameter of the range of the observable visual points as follows:
| x ' | is less than or equal to 2m, and | y ' | is less than or equal to 2m, and | z ' | is less than or equal to 1 m;
extracting translation parameter [ x ] of visual point range from code streamt＝1m,yt＝1m,zt＝0m]And rotation parameter
Figure GDA0003407933210000111
Figure GDA0003407933210000112
According to [ x ] describedt,yt,zt]And
Figure GDA0003407933210000113
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]The range of the set is specifically as follows:
Figure GDA0003407933210000114
the range of the point [ x, y, z ] set is the range of the observable viewpoint of the reconstructed high-freedom video,
Extracting orientation parameters of a viewable viewpoint range representing viewpoints from a code stream
Figure GDA0003407933210000115
And the field of view range parameter theta0＝-180°,theta1＝+180°,phi0＝-90°,phi190 deg., where theta0Is the longitude minimum of the field of view, where theta1Is the maximum longitude of the field of view, where phi0As the latitude minimum of the horizon, phi1Is the latitude maximum of the visual field range;
determining a visual field range representing the viewpoint, the visual field range being a set of all [ theta, phi ] satisfying that theta is in the range of [ -180 °,180 ° ] and phi is in the range of [ -90 °,90 ° ];
determining the view range of all viewpoints in the viewable viewpoint range of the reconstructed high-degree-of-freedom video according to the view range of the representative viewpoint and the orientation change parameters of all viewpoints in the viewable viewpoint range relative to the representative viewpoint, specifically:
determining that the visual field ranges of all the viewpoints in the viewable viewpoint range of the reconstructed high-degree-of-freedom video are a set of all [ theta, phi ] satisfying that theta is in the range of [ -180 °,180 ° ] and phi is in the range of [ -90 °,90 ° ].
Example 11
An apparatus for screening a viewable range of a reconstructed high-degree-of-freedom video, comprising:
the observable range parameter extraction module: the input is code stream, and the output is shape type, shape parameter and translation parameter [ x ] of visual viewpoint range t,yt,zt]And rotation parameter
Figure GDA0003407933210000116
The module extracts the shape type of a viewable viewpoint range from the code stream, determines that the shape type of the viewable viewpoint range is an ellipsoid, extracts the shape parameter of the corresponding viewable viewpoint range from the code stream as a being 1m, b being 2m and c being 3m according to the shape type of the viewable viewpoint range, and extracts the translation parameter [ x ] of the viewable viewpoint range from the code streamt＝1m,zt＝1m,zt＝1m]And rotation parameter
Figure GDA0003407933210000117
Viewable range reconstruction module: the input of the method is the shape type, the shape parameter and the translation parameter [ x ] of the range of the visual pointt,yt,zt]And rotation parameter
Figure GDA0003407933210000121
The module determines points [ x ', y ', z ] based on shape type and shape parameters of the viewable viewpoint range ']The range of the set is such that,the method specifically comprises the following steps:
Figure GDA0003407933210000122
and according to said [ x ]t,yt,zt]And
Figure GDA0003407933210000123
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]Range of set, said points [ x, y, z ]]The range of the set is the viewable viewpoint range of the reconstructed high-freedom video, and specifically includes:
Figure GDA0003407933210000124
the range of the point [ x, y, z ] set is the viewable viewpoint range of the reconstructed high-freedom video.
Example 12
An apparatus for screening a viewable range of a reconstructed high-degree-of-freedom video, comprising:
The observable range parameter extraction module: the input is code stream, and the output is shape type, shape parameter and translation parameter [ x ] of visual viewpoint ranget,yt,zt]And rotation parameter
Figure GDA0003407933210000125
The module extracts the shape type of a viewable viewpoint range from the code stream, determines that the shape type of the viewable viewpoint range is a cube, extracts the shape parameter of the corresponding viewable viewpoint range from the code stream as a being 2m, b being 2m, c being 1m according to the shape type of the viewable viewpoint range, and extracts the translation parameter [ x ] of the viewable viewpoint range from the code streamt＝2m,yt＝2m,zt＝0m]And rotation parameter
Figure GDA0003407933210000126
Observable rangeA reconstruction module: the input of the method is the shape type, the shape parameter and the translation parameter [ x ] of the range of the visual pointt,yt,zt]And rotation parameter
Figure GDA0003407933210000127
The module determines points [ x ', y ', z ] based on shape type and shape parameters of the viewable viewpoint range ']The range of the set is specifically as follows:
| x ' | is less than or equal to 1m, and | y ' | is less than or equal to 2m, and | z ' | is less than or equal to 1 m;
and according to said [ x ]t,yt,zt]And
Figure GDA0003407933210000128
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]Range of set, said points [ x, y, z ]]The range of the set is the viewable viewpoint range of the reconstructed high-freedom video, and specifically includes:
Figure GDA0003407933210000129
The range of the point [ x, y, z ] set is the viewable viewpoint range of the reconstructed high-freedom video.
Example 13
An apparatus for screening a viewable range of a reconstructed high-degree-of-freedom video, comprising:
the observable range parameter extraction module: the input is code stream, and the output is shape type, shape parameter and translation parameter [ x ] of visual viewpoint ranget,yt,zt]And rotation parameter
Figure GDA00034079332100001210
The module extracts the shape type of the range of the observable viewpoint from the code stream, determines the shape type of the range of the observable viewpoint to be a cylinder, and extracts the corresponding range of the observable viewpoint from the code stream according to the shape type of the range of the observable viewpointThe shape parameter of the frame is a is 10cm, b is 30cm, c is 40cm, and the translation parameter [ x ] of the view point range which can be observed is extracted from the code streamt＝20cm,yt＝20cm,zt＝0cm]And rotation parameter
Figure GDA0003407933210000131
Viewable range reconstruction module: the input of the method is the shape type, the shape parameter and the translation parameter [ x ] of the range of the visual pointt,yt,zt]And rotation parameter
Figure GDA0003407933210000132
The module determines points [ x ', y ', z ] based on shape type and shape parameters of the viewable viewpoint range ']The range of the set is specifically as follows:
Figure GDA0003407933210000133
and | z' | is less than or equal to 40 cm;
And according to said [ x ]t,yt,zt]And
Figure GDA0003407933210000134
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]Range of set, said points [ x, y, z ]]The range of the set is the viewable viewpoint range of the reconstructed high-freedom video, and specifically includes:
Figure GDA0003407933210000135
the range of the point [ x, y, z ] set is the viewable viewpoint range of the reconstructed high-freedom video.
Example 14
An apparatus for screening a viewable range of a reconstructed high-degree-of-freedom video, comprising:
the observable range parameter extraction module: the input is code stream and the output is code streamShape type, shape parameter, translation parameter [ x ] of viewing viewpoint ranget,yt,zt]And rotation parameter
Figure GDA0003407933210000136
The module extracts the shape type of a viewable viewpoint range from the code stream, determines that the shape type of the viewable viewpoint range is a cylinder, extracts the shape parameter of the corresponding viewable viewpoint range from the code stream as a being 1m, b being 30cm and c being 400mm according to the shape type of the viewable viewpoint range, and extracts the translation parameter [ x [ ] of the viewable viewpoint range from the code streamt＝0cm,yt＝0cm,zt＝0cm]And rotation parameter
Figure GDA0003407933210000137
Viewable range reconstruction module: the input of the method is the shape type, the shape parameter and the translation parameter [ x ] of the range of the visual pointt,yt,zt]And rotation parameter
Figure GDA0003407933210000138
The module determines points [ x ', y ', z ] based on shape type and shape parameters of the viewable viewpoint range ']The range of the set is specifically as follows:
Figure GDA0003407933210000139
and | z' | is less than or equal to 400 mm;
and according to said [ x ]t,yt,zt]And
Figure GDA00034079332100001310
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]Range of set, said points [ x, y, z ]]The range of the set is the viewable viewpoint range of the reconstructed high-freedom video, and specifically includes:
Figure GDA00034079332100001311
the range of the point [ x, y, z ] set is the viewable viewpoint range of the reconstructed high-freedom video.
Example 15
An apparatus for screening a viewable range of a reconstructed high-degree-of-freedom video, comprising:
the observable range parameter extraction module: the input is code stream, and the output is shape type, shape parameter and translation parameter [ x ] of visual viewpoint ranget,yt,zt]And rotation parameter
Figure GDA00034079332100001312
The module extracts the shape type of a viewable viewpoint range from the code stream, determines that the shape type of the viewable viewpoint range is a cube, extracts the shape parameter of the corresponding viewable viewpoint range from the code stream as a being 2m, b being 2m, c being 1m according to the shape type of the viewable viewpoint range, and extracts the translation parameter [ x ] of the viewable viewpoint range from the code stream t＝1m,yt＝1m,zt＝0m]And rotation parameter
Figure GDA0003407933210000141
Viewable range reconstruction module: the input of the method is the shape type, the shape parameter and the translation parameter [ x ] of the range of the visual pointt,yt,zt]And rotation parameter
Figure GDA0003407933210000142
The module determines points [ x ', y ', z ] based on shape type and shape parameters of the viewable viewpoint range ']The range of the set is specifically as follows:
| x ' | is less than or equal to 2m, and | y ' | is less than or equal to 2m, and | z ' | is less than or equal to 1 m;
and according to said [ x ]t,yt,zt]And
Figure GDA0003407933210000143
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]Range of set, said points [ x, y, z ]]The range of the set is the viewable viewpoint range of the reconstructed high-freedom video, and specifically includes:
Figure GDA0003407933210000144
the range of the point [ x, y, z ] set is the range of the observable viewpoint of the reconstructed high-freedom video,
the viewable range parameter extraction module further comprises a viewable range view parameter extraction module sub-module, and the viewable range reconstruction module further comprises a viewable range viewpoint view range reconstruction module:
the visual range field parameter extraction module: the input is code stream, and the output is orientation parameter of visual point represented by visual point range
Figure GDA0003407933210000145
And the field of view range parameter theta 0＝-0.5π,theta1＝0.5π,phi0＝-0.4π,phi10.5 pi, wherein theta0Is the longitude minimum of the field of view, where theta1Is the maximum longitude of the field of view, where phi0As the latitude minimum of the horizon, phi1Is the latitude maximum of the visual field range;
observable range viewpoint visual field range reconstruction module: the input of which is the orientation parameter of the viewable viewpoint range representing the viewpoint
Figure GDA0003407933210000146
Horizon parameter theta0,theta1,phi0,phi1And orientation variation parameters of all viewpoints in the viewable viewpoint range relative to the representative viewpoint, the output of which is a field of view range of all viewpoints in the viewable viewpoint range of the reconstructed high-degree-of-freedom video, the module determining the field of view range of the representative viewpointThe value of the angle is theta at [ -0.5 π,0.5 π]In the range of phi of [ -0.4 pi, 0.5 pi]All of [ theta, phi ] within the range]And determining the view range of all viewpoints in the viewable viewpoint range of the reconstructed high-degree-of-freedom video according to the view range of the representative viewpoint and the orientation change parameters of all viewpoints in the viewable viewpoint range relative to the representative viewpoint, specifically:
orientation change parameters of all viewpoints in the viewable viewpoint range with respect to the representative viewpoint are set to zero, and it is determined that the visual field ranges of all viewpoints in the viewable viewpoint range of the reconstructed high-degree-of-freedom video are all a set of [ theta, phi ] satisfying the condition that theta is in the range of [ -0.5 pi, 0.5 pi ] and phi is in the range of [ -0.4 pi, 0.5 pi ].
Example 16
An apparatus for screening a viewable range of a reconstructed high-degree-of-freedom video, comprising:
the observable range parameter extraction module: the input is code stream, and the output is shape type, shape parameter and translation parameter [ x ] of visual viewpoint ranget,yt,zt]And rotation parameter
Figure GDA0003407933210000147
The module extracts the shape type of a viewable viewpoint range from the code stream, determines the shape type of the viewable viewpoint range to be an ellipsoid, extracts the shape parameter of the corresponding viewable viewpoint range from the code stream to be a (50 cm), b (20 cm) and c (10 cm) according to the shape type of the viewable viewpoint range, and extracts the translation parameter [ x ] of the viewable viewpoint range from the code streamt＝1m,yt＝1m,zt＝0m]And rotation parameter
Figure GDA0003407933210000151
Viewable range reconstruction module: the input of the method is the shape type, the shape parameter and the translation parameter [ x ] of the range of the visual pointt,yt,zt]And rotation parameter
Figure GDA0003407933210000152
The module determines points [ x ', y ', z ] based on shape type and shape parameters of the viewable viewpoint range ']The range of the set is specifically as follows:
Figure GDA0003407933210000153
and according to said [ x ]t,yt,zt]And
Figure GDA0003407933210000154
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]Range of set, said points [ x, y, z ] ]The range of the set is the viewable viewpoint range of the reconstructed high-freedom video, and specifically includes:
Figure GDA0003407933210000155
the range of the point [ x, y, z ] set is the range of the observable viewpoint of the reconstructed high-freedom video,
the viewable range parameter extraction module further comprises a viewable range view parameter extraction module sub-module, and the viewable range reconstruction module further comprises a viewable range viewpoint view range reconstruction module:
the visual range field parameter extraction module: the input is code stream, and the output is orientation parameter of visual point represented by visual point range
Figure GDA0003407933210000156
And the field of view range parameter theta0＝-40°,theta1＝180°,phi0＝20°,phi150 deg., wherein theta0Is the longitude minimum of the field of view, where theta1Is the maximum longitude of the field of view, where phi0As the latitude minimum of the horizon, phi1Is the latitude maximum of the visual field range;
observable rangeA viewpoint visual field range reconstruction module: the input of which is the orientation parameter of the viewable viewpoint range representing the viewpoint
Figure GDA0003407933210000157
Horizon parameter theta0,theta1,phi0,phi1And orientation variation parameters of all viewpoints in the viewable viewpoint range relative to the representative viewpoint, the output of which is a field of view range of all viewpoints in the viewable viewpoint range of the reconstructed high-freedom video, the module determining the field of view range of the representative viewpoint, the field of view range satisfying theta at [ -40 °,180 ° ] ]Within the range of phi of [20 DEG, 50 DEG ]]All of [ theta, phi ] within the range]And determining the view range of all viewpoints in the viewable viewpoint range of the reconstructed high-degree-of-freedom video according to the view range of the representative viewpoint and the orientation change parameters of all viewpoints in the viewable viewpoint range relative to the representative viewpoint, specifically:
extracting orientation change parameters of all viewpoints in a viewable viewpoint range relative to a representative viewpoint from a code stream into
Figure GDA0003407933210000158
Figure GDA0003407933210000159
It is determined that theta' is satisfied at [ -0.5 π,0.5 π]In the range and phi' is [ -0.4 pi, 0.5 pi]All of [ theta ', phi']A set of (a);
according to said
Figure GDA00034079332100001510
Direction of rotation [ theta ', phi']The extent of the set yields the corresponding direction [ theta (x, y, z), phi (x, y, z)]The range of the set is specifically as follows:
Figure GDA0003407933210000161
Figure GDA0003407933210000162
Figure GDA0003407933210000163
the range of the direction [ theta (x, y, z), phi (x, y, z) ] set is the visual field range of all the viewpoints in the viewable viewpoint range of the reconstructed high-freedom video.
Example 17
An apparatus for screening a viewable range of a reconstructed high-degree-of-freedom video, comprising:
the observable range parameter extraction module: the input is code stream, and the output is shape type, shape parameter and translation parameter [ x ] of visual viewpoint ranget,yt,zt]And rotation parameter
Figure GDA0003407933210000164
The module extracts the shape type of a viewable viewpoint range from the code stream, determines the shape type of the viewable viewpoint range to be an ellipsoid, extracts the shape parameter of the corresponding viewable viewpoint range from the code stream to be a (50 cm), b (20 cm) and c (10 cm) according to the shape type of the viewable viewpoint range, and extracts the translation parameter [ x ] of the viewable viewpoint range from the code streamt＝1m,yt＝1m,zt＝0m]And rotation parameter
Figure GDA0003407933210000165
Viewable range reconstruction module: the input of the method is the shape type, the shape parameter and the translation parameter [ x ] of the range of the visual pointt,yt,zt]And rotation parameter
Figure GDA0003407933210000166
The module determines points [ x ', y ', z ] based on shape type and shape parameters of the viewable viewpoint range ']The range of the set is specifically as follows:
Figure GDA0003407933210000167
and according to said [ x ]t,yt,zt]And
Figure GDA0003407933210000168
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]Range of set, said points [ x, y, z ]]The range of the set is the viewable viewpoint range of the reconstructed high-freedom video, and specifically includes:
Figure GDA0003407933210000169
the range of the point [ x, y, z ] set is the range of the observable viewpoint of the reconstructed high-freedom video,
the viewable range parameter extraction module further comprises a viewable range view parameter extraction module sub-module, and the viewable range reconstruction module further comprises a viewable range viewpoint view range reconstruction module:
The visual range field parameter extraction module: the input is code stream, and the output is orientation parameter of visual point represented by visual point range
Figure GDA00034079332100001610
And the field of view range parameter theta0＝-40°,theta1＝180°,phi0＝20°,phi150 deg., wherein theta0Is the longitude minimum of the field of view, where theta1Is the maximum longitude of the field of view, where phi0As the latitude minimum of the horizon, phi1Is the latitude maximum of the visual field range;
observable range viewpoint visual field range reconstruction module: the input of which is the orientation parameter of the viewable viewpoint range representing the viewpoint
Figure GDA0003407933210000171
Horizon parameter theta0,theta1,phi0,phi1And orientation variation parameters of all viewpoints in the viewable viewpoint range relative to the representative viewpoint, the output of which is a field of view range of all viewpoints in the viewable viewpoint range of the reconstructed high-freedom video, the module determining the field of view range of the representative viewpoint, the field of view range satisfying theta at [ -40 °,180 ° ]]Within the range of phi of [20 DEG, 50 DEG ]]All of [ theta, phi ] within the range]And determining the view range of all viewpoints in the viewable viewpoint range of the reconstructed high-degree-of-freedom video according to the view range of the representative viewpoint and the orientation change parameters of all viewpoints in the viewable viewpoint range relative to the representative viewpoint, specifically:
Extracting orientation change parameters of all viewpoints in a viewable viewpoint range relative to a representative viewpoint from a code stream into
Figure GDA0003407933210000172
Figure GDA0003407933210000173
It is determined that theta' is satisfied at [ -0.5 π,0.5 π]In the range and phi' is [ -0.4 pi, 0.5 pi]All of [ theta ', phi']A set of (a);
according to said
Figure GDA0003407933210000174
Direction of rotation [ theta ', phi']The extent of the set yields the corresponding direction [ theta (x, y, z), phi (x, y, z)]The range of the set is specifically as follows:
Figure GDA0003407933210000175
Figure GDA0003407933210000176
Figure GDA0003407933210000177
the range of the direction [ theta (x, y, z), phi (x, y, z) ] set is the visual field range of all the viewpoints in the viewable viewpoint range of the reconstructed high-freedom video.
Example 18
An apparatus for screening a viewable range of a reconstructed high-degree-of-freedom video, comprising:
the observable range parameter extraction module: the input is code stream, and the output is shape type, shape parameter and translation parameter [ x ] of visual viewpoint ranget,yt,zt]And rotation parameter
Figure GDA0003407933210000178
The module extracts the shape type of a viewable viewpoint range from the code stream, determines that the shape type of the viewable viewpoint range is a cube, extracts the shape parameter of the corresponding viewable viewpoint range from the code stream as a being 2m, b being 2m and c being 0m according to the shape type of the viewable viewpoint range, and extracts the translation parameter [ x ] of the viewable viewpoint range from the code stream t＝2m,yt＝2m,zt＝0m]And rotation parameter
Figure GDA0003407933210000179
Viewable range reconstruction module: the input of the method is the shape type, the shape parameter and the translation parameter [ x ] of the range of the visual pointt,yt,zt]And rotation parameter
Figure GDA00034079332100001710
The module determines points [ x ', y ', z ] based on shape type and shape parameters of the viewable viewpoint range ']The range of the set is specifically as follows:
| x ' | is less than or equal to 2m, and | y ' | is less than or equal to 2m, and | z ' | is 0 m;
and according to said [ x ]t,yt,zt]And
Figure GDA0003407933210000181
by translation and rotationPoint of rotation [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]Range of set, said points [ x, y, z ]]The range of the set is the viewable viewpoint range of the reconstructed high-freedom video, and specifically includes:
Figure GDA0003407933210000182
the range of the point [ x, y, z ] set is the viewable viewpoint range of the reconstructed high-freedom video.
Example 19
An apparatus for screening a viewable range of a reconstructed high-degree-of-freedom video, comprising:
the observable range parameter extraction module: the input is code stream, and the output is shape type, shape parameter and translation parameter [ x ] of visual viewpoint ranget,yt,zt]And rotation parameter
Figure GDA0003407933210000183
The module extracts the shape type of a viewable viewpoint range from the code stream, determines that the shape type of the viewable viewpoint range is a cylinder, extracts the shape parameter of the corresponding viewable viewpoint range from the code stream as a being 0m, b being 0m and c being 0m according to the shape type of the viewable viewpoint range, and extracts the translation parameter [ x ] of the viewable viewpoint range from the code stream t＝2m,yt＝2m,zt＝0m]And rotation parameter
Figure GDA0003407933210000184
Viewable range reconstruction module: the input of the method is the shape type, the shape parameter and the translation parameter [ x ] of the range of the visual pointt,yt,zt]And rotation parameter
Figure GDA0003407933210000185
The module determines points [ x ', y ', z ] based on shape type and shape parameters of the viewable viewpoint range ']The range of the set is specifically as follows:
x ' ═ 0m and y ' ═ 0m and z ' ═ 0 m;
and according to said [ x ]t,yt,zt]And
Figure GDA0003407933210000186
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]Range of set, said points [ x, y, z ]]The range of the set is the viewable viewpoint range of the reconstructed high-freedom video, and specifically includes:
Figure GDA0003407933210000187
the range of the point [ x, y, z ] set is the viewable viewpoint range of the reconstructed high-freedom video.
Example 20
An apparatus for screening a viewable range of a reconstructed high-degree-of-freedom video, comprising:
the observable range parameter extraction module: the input is code stream, and the output is shape type, shape parameter and translation parameter [ x ] of visual viewpoint ranget,yt,zt]And rotation parameter
Figure GDA0003407933210000188
The module extracts the shape type of a viewable viewpoint range from the code stream, determines that the shape type of the viewable viewpoint range is a cube, extracts the shape parameter of the corresponding viewable viewpoint range from the code stream as a being 2m, b being 2m, c being 1m according to the shape type of the viewable viewpoint range, and extracts the translation parameter [ x ] of the viewable viewpoint range from the code stream t＝1m,yt＝1m,zt＝0m]And rotation parameter
Figure GDA0003407933210000189
Viewable range reconstruction module: the input of the method is the shape type, the shape parameter and the translation parameter [ x ] of the range of the visual pointt,yt,zt]And rotation parameter
Figure GDA00034079332100001810
The module determines points [ x ', y ', z ] based on shape type and shape parameters of the viewable viewpoint range ']The range of the set is specifically as follows:
| x ' | is less than or equal to 2m, and | y ' | is less than or equal to 2m, and | z ' | is less than or equal to 1 m;
and according to said [ x ]t,yt,zt]And
Figure GDA0003407933210000191
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]Range of set, said points [ x, y, z ]]The range of the set is the viewable viewpoint range of the reconstructed high-freedom video, and specifically includes:
Figure GDA0003407933210000192
the range of the point [ x, y, z ] set is the range of the observable viewpoint of the reconstructed high-freedom video,
the viewable range parameter extraction module further comprises a viewable range view parameter extraction module sub-module, and the viewable range reconstruction module further comprises a viewable range viewpoint view range reconstruction module:
the visual range field parameter extraction module: the input is code stream, and the output is orientation parameter of visual point represented by visual point range
Figure GDA0003407933210000193
And the field of view range parameter theta 0＝-180°,theta1＝+180°,phi0＝-90°,phi190 deg., where theta0Is the longitude minimum of the field of view, where theta1Is the maximum longitude of the field of view, where phi0As the latitude minimum of the horizon, phi1Is a field of viewMaximum value of the latitude of the circumference;
observable range viewpoint visual field range reconstruction module: the input of which is the orientation parameter of the viewable viewpoint range representing the viewpoint
Figure GDA0003407933210000194
Horizon parameter theta0,theta1,phi0,phi1And orientation variation parameters of all viewpoints in the viewable viewpoint range relative to the representative viewpoint, the output of which is a field of view range of all viewpoints in the viewable viewpoint range of the reconstructed high-degree-of-freedom video, the module determining the field of view range of the representative viewpoint, the field of view range satisfying theta at [ -180 °,180 ° ]]Within the range of phi of [ -90 DEG, 90 DEG]All of [ theta, phi ] within the range]And determining the view range of all viewpoints in the viewable viewpoint range of the reconstructed high-degree-of-freedom video according to the view range of the representative viewpoint and the orientation change parameters of all viewpoints in the viewable viewpoint range relative to the representative viewpoint, specifically:
determining that the visual field ranges of all the viewpoints in the viewable viewpoint range of the reconstructed high-degree-of-freedom video are a set satisfying all [ theta (x, y, z), phi (x, y, z) ] that theta (x, y, z) is in the range of [ -180 °,180 ° ] and phi (x, y, z) is in the range of [ -90 °,90 ° ].
Example 21
A method for screening a viewable range of a reconstructed high-freedom video specifically comprises the following steps:
extracting the shape type of the viewable viewpoint range from the code stream, and determining that the shape type of the viewable viewpoint range is an octahedron;
the shape type according to the viewable viewpoint range is an octahedron, and as shown in fig. 3, corresponding shape parameters a ═ 2m, b ═ 2m, and c ═ 1m are extracted from the code stream;
determining the range of the point [ x ', y ', z ' ] set according to the shape type and the shape parameter of the range of the observable visual points as follows:
Figure GDA0003407933210000195
extracting translation parameter [ x ] of visual point range from code streamt＝2m,yt＝2m,zt＝0m]And rotation parameter
Figure GDA0003407933210000196
Figure GDA0003407933210000197
According to [ x ] describedt,yt,zt]And
Figure GDA0003407933210000198
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]The range of the set, as shown in fig. 5, is specifically:
Figure GDA0003407933210000201
the range of the point [ x, y, z ] set is the viewable viewpoint range of the reconstructed high-freedom video.
Example 22
An apparatus for screening a viewable range of a reconstructed high-degree-of-freedom video, comprising:
the observable range parameter extraction module: the input is code stream, and the output is shape type, shape parameter and translation parameter [ x ] of visual viewpoint ranget,yt,zt]And rotation parameter
Figure GDA0003407933210000202
The module extracts the shape type of a viewable viewpoint range from the code stream, determines that the shape type of the viewable viewpoint range is an octahedron, extracts the shape parameter of the corresponding viewable viewpoint range from the code stream as a being 1m, b being 2m and c being 3m according to the shape type of the viewable viewpoint range, and extracts the translation parameter [ x is y is x is y is x is y is x is y is x is y is x is y is x is y is x is y is t＝1m,yt＝1m,zt＝1m]And rotation parameter
Figure GDA0003407933210000203
Viewable range reconstruction module: the input of the method is the shape type, the shape parameter and the translation parameter [ x ] of the range of the visual pointt,yt,zt]And rotation parameter
Figure GDA0003407933210000204
The module determines points [ x ', y ', z ] based on shape type and shape parameters of the viewable viewpoint range ']The range of the set is specifically as follows:
Figure GDA0003407933210000205
and according to said [ x ]t,yt,zt]And
Figure GDA0003407933210000206
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]Range of set, said points [ x, y, z ]]The range of the set is the viewable viewpoint range of the reconstructed high-freedom video, and specifically includes:
Figure GDA0003407933210000207
the range of the point [ x, y, z ] set is the viewable viewpoint range of the reconstructed high-freedom video.
Example 23
A method for screening a viewable range of a reconstructed high-freedom video specifically comprises the following steps:
extracting the shape type of the range of the observable viewpoint from the code stream, and determining that the shape type of the range of the observable viewpoint is a sphere;
according to the shape type of the viewable viewpoint range, as shown in fig. 3, extracting a corresponding shape parameter a as 1m from the code stream;
determining the range of the point [ x ', y ', z ' ] set according to the shape type and the shape parameter of the range of the observable visual points as follows:
(x′)2+(y′)2+(z′)2≤(1m)2；
Extracting translation parameter [ x ] of visual point range from code streamt＝2m,yt＝2m,zt＝0m]And rotation parameter
Figure GDA0003407933210000208
Figure GDA0003407933210000209
According to [ x ] describedt,yt,zt]And
Figure GDA00034079332100002010
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]The range of the set, as shown in fig. 5, is specifically:
Figure GDA00034079332100002011
the range of the point [ x, y, z ] set is the viewable viewpoint range of the reconstructed high-freedom video.
Example 24
An apparatus for screening a viewable range of a reconstructed high-degree-of-freedom video, comprising:
the observable range parameter extraction module: the input is code stream, and the output is shape type, shape parameter and translation parameter [ x ] of visual viewpoint ranget,yt,zt]And rotation parameter
Figure GDA0003407933210000211
The module extracts the shape type of the viewable viewpoint range from the code stream, determines the shape type of the viewable viewpoint range as a sphere, and extracts the corresponding viewable viewpoint from the code stream according to the shape type of the viewable viewpoint rangeThe shape parameter of the view point range is a 1m, and a translation parameter [ x ] of the view point range is extracted from the code streamt＝1m,yt＝1m,zt＝1m]And rotation parameter
Figure GDA0003407933210000212
Viewable range reconstruction module: the input of which is the shape type, shape parameter, translation parameter [ xt, yt, zt ] of the visual point range]And rotation parameter
Figure GDA0003407933210000213
The module determines points [ x ', y ', z ] based on shape type and shape parameters of the viewable viewpoint range ' ]The range of the set is specifically as follows:
(x′)2+(y′)2+(z′)2≤(1m)2；
and according to said [ x ]t,yt,zt]And
Figure GDA0003407933210000214
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]Range of set, said points [ x, y, z ]]The range of the set is the viewable viewpoint range of the reconstructed high-freedom video, and specifically includes:
Figure GDA0003407933210000215
the range of the point [ x, y, z ] set is the viewable viewpoint range of the reconstructed high-freedom video.
Example 25
A method for screening a viewable range of a reconstructed high-freedom video specifically comprises the following steps:
extracting the shape type of the viewable viewpoint range from the code stream, and determining that the shape type of the viewable viewpoint range is a cube;
according to the shape type of the viewable viewpoint range being a cube, as shown in fig. 3, extracting a corresponding shape parameter a ═ 1m from the code stream;
determining the range of the point [ x ', y ', z ' ] set according to the shape type and the shape parameter of the range of the observable visual points as follows:
| x ' | is less than or equal to 1m, and | y ' | is less than or equal to 1m, and | z ' | is less than or equal to 1 m;
extracting translation parameter [ x ] of visual point range from code streamt＝2m,yt＝2m,zt＝0m]And rotation parameter
Figure GDA0003407933210000216
Figure GDA0003407933210000217
According to [ x ] describedt,yt,zt]And
Figure GDA0003407933210000218
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]The range of the set, as shown in fig. 5, is specifically:
Figure GDA0003407933210000219
The range of the point [ x, y, z ] set is the viewable viewpoint range of the reconstructed high-freedom video.
Example 26
An apparatus for screening a viewable range of a reconstructed high-degree-of-freedom video, comprising:
the observable range parameter extraction module: the input is code stream, and the output is shape type, shape parameter and translation parameter [ x ] of visual viewpoint ranget,yt,zt]And rotation parameter
Figure GDA0003407933210000221
The module extracts the shape type of the viewable viewpoint range from the code stream, determines the shape type of the viewable viewpoint range as a cube,according to the shape type of the observable viewpoint range, extracting the shape parameter of the corresponding observable viewpoint range from the code stream as a ═ 1m, and extracting the translation parameter [ x ] of the observable viewpoint range from the code streamt＝1m,yt＝1m,zt＝1m]And rotation parameter
Figure GDA0003407933210000222
Viewable range reconstruction module: the input of the method is the shape type, the shape parameter and the translation parameter [ x ] of the range of the visual pointt,yt,zt]And rotation parameter
Figure GDA0003407933210000223
The module determines points [ x ', y ', z ] based on shape type and shape parameters of the viewable viewpoint range ']The range of the set is specifically as follows:
| x ' | is less than or equal to 1m, and | y ' | is less than or equal to 1m, and | z ' | is less than or equal to 1 m;
And according to said [ x ]t,yt,zt]And
Figure GDA0003407933210000224
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]Range of set, said points [ x, y, z ]]The range of the set is the viewable viewpoint range of the reconstructed high-freedom video, and specifically includes:
Figure GDA0003407933210000225
the range of the point [ x, y, z ] set is the viewable viewpoint range of the reconstructed high-freedom video.

Claims (8)

1. A method for reconstructing a high-degree-of-freedom video viewable range, comprising:
extracting the shape type of the viewable viewpoint range from the code stream, and determining the shape type of the viewable viewpoint range;
extracting corresponding shape parameters of the range of the observable viewpoint from the code stream according to the shape type of the range of the observable viewpoint;
determining the range of the point [ x ', y ', z ' ] set according to the shape type and the shape parameter of the range of the observable visual points;
extracting translation parameter [ x ] of visual point range from code streamt，yt，zt]And rotation parameter
Figure FDA0002224152760000014
According to [ x ] describedt，yt，zt]And
Figure FDA0002224152760000013
by translating and rotating points [ x ', y ', z ']The range of the set yields the corresponding point [ x, y, z ]]Range of set, said points [ x, y, z ]]The range of the set is the viewable viewpoint range of the reconstructed high-freedom video.
2. A method of reconstructing a high degree of freedom video viewable range according to claim 1, wherein said determining a range of points [ x ', y ', z ' ] set according to shape type and shape parameters of said viewable viewpoint range comprises one of:
(1) The shape type of the range of the observable viewpoint is an ellipsoid, the shape parameters are a, b and c, wherein a, b and c are numbers not less than 0, and the range of the set of points [ x ', y ', z ' ] is as follows:
Figure FDA0002224152760000011
(2) the shape type of the range of the observable viewpoint is a cuboid, the shape parameters are a, b and c, wherein a, b and c are numbers not less than 0, and the range of the set of points [ x ', y ', z ' ] is as follows:
| x ' | is less than or equal to a, | y ' | is less than or equal to b, and | z ' | is less than or equal to c;
(3) the shape type of the range of the observable viewpoint is a cylinder, the shape parameters are a, b, and c, wherein a, b, and c are numbers not less than 0, and the range of the set of points [ x ', y ', z ' ] is:
Figure FDA0002224152760000012
and | z' | is less than or equal to c;
(4) the shape type of the range of the observable visual point is a sphere, the shape parameter is a, wherein a is a number not less than 0, and the range of the set of points [ x ', y ', z ' ] is:
(x′)2+(y′)2+(z′)2≤a2；
(5) the shape type of the range of the viewable viewpoint is a cube, the shape parameter is a, where a is a number not less than 0, and the range of the set of points [ x ', y ', z ' ] is:
| x ' | is less than or equal to a, and | y ' | is less than or equal to a, and | z ' | is less than or equal to a.
3. A method for reconstructing a high degree of freedom video viewable range as recited in claim 1, further comprising:
Extracting orientation parameters of a viewable viewpoint range representing viewpoints from a code stream
Figure FDA0002224152760000021
And the field of view range parameter theta0，theta1，phi0，phi1Wherein theta is0Is the longitude minimum of the field of view, where theta1Is the maximum longitude of the field of view, where phi0As the latitude minimum of the horizon, phi1Is the latitude maximum of the visual field range;
determining a field of view range representing the viewpoint, the field of view range satisfying the theta at [ theta ]0，theta1]Within the range of phi is [ phi0，phi1]All of [ theta, phi ] within the range]A set of (a);
and determining the visual field range of all the visual points in the viewable visual point range of the reconstructed high-freedom video according to the visual field range of the representative visual point and the orientation change parameters of all the visual points in the viewable visual point range relative to the representative visual point.
4. A method as claimed in claim 3, wherein the determining of the viewing range of all the viewpoints in the viewable viewpoint range of the reconstructed high-freedom video according to the viewing range of the representative viewpoint and the orientation variation parameters of all the viewpoints in the viewable viewpoint range relative to the representative viewpoint comprises one of:
orientation change parameters of all viewpoints relative to the representative viewpoint in the viewable viewpoint range are extracted from the code stream;
The orientation variation parameter of all viewpoints in the viewable viewpoint range with respect to the representative viewpoint is set to zero.
5. An apparatus for reconstructing a high degree of freedom video viewable range, comprising:
the observable range parameter extraction module: the input is code stream, and the output is shape type, shape parameter and translation parameter [ x ] of visual viewpoint ranget，yt，zt]And rotation parameter
Figure FDA0002224152760000022
The module extracts the shape type of the viewable viewpoint range from the code stream, determines the shape type of the viewable viewpoint range, extracts the corresponding shape parameter of the viewable viewpoint range from the code stream according to the shape type of the viewable viewpoint range, and extracts the translation parameter [ x ] of the viewable viewpoint range from the code streamt，yt，zt]And rotation parameter
Figure FDA0002224152760000023
Viewable range reconstruction module: the input is the shape type and shape of the visual point rangeParameter, translation parameter [ x ]t，yt，zt]And rotation parameter
Figure FDA0002224152760000024
The module determines points [ x ', y ', z ] based on shape type and shape parameters of the viewable viewpoint range ']Set range and according to said [ x ]t，yt，zt]And
Figure FDA0002224152760000025
by translating and rotating points [ x ', y ', z ' ]The range of the set yields the corresponding point [ x, y, z ]]Range of set, said points [ x, y, z ]]The range of the set is the viewable viewpoint range of the reconstructed high-freedom video.
6. An apparatus for reconstructing a high degree of freedom video viewable range according to claim 5, wherein said determining a set of points [ x ', y ', z ' ] based on shape type and shape parameters of said viewable viewpoint range comprises one of:
(1) the shape type of the range of the observable viewpoint is an ellipsoid, the shape parameters are a, b and c, wherein a, b and c are numbers not less than 0, and the range of the set of points [ x ', y ', z ' ] is as follows:
Figure FDA0002224152760000031
(2) the shape type of the range of the observable viewpoint is a cuboid, the shape parameters are a, b and c, wherein a, b and c are numbers not less than 0, and the range of the set of points [ x ', y ', z ' ] is as follows:
| x ' | is less than or equal to a, | y ' | is less than or equal to b, and | z ' | is less than or equal to c;
(3) the shape type of the range of the observable viewpoint is a cylinder, the shape parameters are a, b, and c, wherein a, b, and c are numbers not less than 0, and the range of the set of points [ x ', y ', z ' ] is:
Figure FDA0002224152760000032
and | z' | is less than or equal to c;
(4) the shape type of the range of the observable visual point is a sphere, the shape parameter is a, wherein a is a number not less than 0, and the range of the set of points [ x ', y ', z ' ] is:
(x′)2+(y′)2+(z′)2≤a2；
(5) The shape type of the range of the viewable viewpoint is a cube, the shape parameter is a, where a is a number not less than 0, and the range of the set of points [ x ', y ', z ' ] is:
| x ' | is less than or equal to a, and | y ' | is less than or equal to a, and | z ' | is less than or equal to a.
7. The apparatus as claimed in claim 5, wherein the module for extracting parameters of viewable range further comprises a module for extracting parameters of viewable range view field, and the module for reconstructing viewable range further comprises a module for reconstructing viewpoint view field of viewable range:
the visual range field parameter extraction module: the input is code stream, and the output is orientation parameter of visual point represented by visual point range
Figure FDA0002224152760000033
And the field of view range parameter theta0，theta1，phi0，phi1Wherein theta is0Is the longitude minimum of the field of view, where theta1Is the maximum longitude of the field of view, where phi0As the latitude minimum of the horizon, phi1Is the latitude maximum of the visual field range;
observable range viewpoint visual field range reconstruction module: the input of which is the orientation parameter of the viewable viewpoint range representing the viewpoint
Figure FDA0002224152760000034
Horizon parameter theta0，theta1，phi0，phi1And orientation variation parameters of all viewpoints in the viewable viewpoint range relative to the representative viewpoint, the output of which is a field of view range of all viewpoints in the viewable viewpoint range of the reconstructed high-degree-of-freedom video, the module determining the field of view range of the representative viewpoint, the field of view range satisfying the theta [ theta ] for the theta 0，theta1]Within the range of phi is [ phi0，phi1]All of [ theta, phi ] within the range]And determining the view ranges of all the viewpoints in the viewable viewpoint range of the reconstructed high-freedom video according to the view range of the representative viewpoint and the orientation change parameters of all the viewpoints in the viewable viewpoint range relative to the representative viewpoint.
8. The apparatus according to claim 7, wherein the determining of the viewing range of all the viewpoints in the viewable viewpoint range of the reconstructed high-freedom video according to the viewing range of the representative viewpoint and the orientation variation parameters of all the viewpoints in the viewable viewpoint range relative to the representative viewpoint comprises one of:
orientation change parameters of all viewpoints relative to the representative viewpoint in the viewable viewpoint range are extracted from the code stream;
the orientation variation parameter of all viewpoints in the viewable viewpoint range with respect to the representative viewpoint is set to zero.
CN201910946062.4A 2019-10-01 2019-10-01 Method and device for reconstructing high-freedom video viewable range Active CN112601065B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910946062.4A CN112601065B (en) 2019-10-01 2019-10-01 Method and device for reconstructing high-freedom video viewable range

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910946062.4A CN112601065B (en) 2019-10-01 2019-10-01 Method and device for reconstructing high-freedom video viewable range

Publications (2)

Publication Number Publication Date
CN112601065A CN112601065A (en) 2021-04-02
CN112601065B true CN112601065B (en) 2022-02-11

Family

ID=75180086

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910946062.4A Active CN112601065B (en) 2019-10-01 2019-10-01 Method and device for reconstructing high-freedom video viewable range

Country Status (1)

Country Link
CN (1) CN112601065B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6317127B1 (en) * 1996-10-16 2001-11-13 Hughes Electronics Corporation Multi-user real-time augmented reality system and method
CN104040546A (en) * 2012-01-11 2014-09-10 谷歌公司 Method and system for displaying panoramic imagery
CN107079145A (en) * 2014-10-22 2017-08-18 帕拉拉克斯特公司 For collecting the method for the view data for producing immersion video and for the method based on view data viewing space
CN110214339A (en) * 2016-11-30 2019-09-06 诺瓦赛特有限公司 For showing the method and apparatus with the image of the visual field changed

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10474227B2 (en) * 2017-05-09 2019-11-12 Google Llc Generation of virtual reality with 6 degrees of freedom from limited viewer data

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6317127B1 (en) * 1996-10-16 2001-11-13 Hughes Electronics Corporation Multi-user real-time augmented reality system and method
CN104040546A (en) * 2012-01-11 2014-09-10 谷歌公司 Method and system for displaying panoramic imagery
CN107079145A (en) * 2014-10-22 2017-08-18 帕拉拉克斯特公司 For collecting the method for the view data for producing immersion video and for the method based on view data viewing space
CN110214339A (en) * 2016-11-30 2019-09-06 诺瓦赛特有限公司 For showing the method and apparatus with the image of the visual field changed

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
《Interactive Exploration Assistance for Immersive Virtual Environments Based on Object Visibility and Viewpoint Quality》;S. Freitag, B. Weyers and T. W. Kuhlen;《2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), 2018, pp. 355-362, doi: 10.1109/VR.2018.8447553.》;20180331;全文 *
一种实用的头盔显示器立体图像生成技术;刘海艳等;《沈阳理工大学学报》;20050930(第03期);全文 *

Also Published As

Publication number Publication date
CN112601065A (en) 2021-04-02

Similar Documents

Publication Publication Date Title
CN106662749B (en) Preprocessor for full parallax light field compression
KR102458339B1 (en) Electronic Apparatus generating 360 Degrees 3D Stereoscopic Panorama Images and Method thereof
Zakharchenko et al. Quality metric for spherical panoramic video
KR20200065076A (en) Methods, devices and streams for volumetric video formats
KR101538947B1 (en) The apparatus and method of hemispheric freeviewpoint image service technology
CN112189345B (en) Method, device or medium for encoding or decoding data representing a 3D scene
KR20180029315A (en) Image processing method and apparatus for projecting an image of virtual reality content
Lee et al. Discontinuity-adaptive depth map filtering for 3D view generation
US8094148B2 (en) Texture processing apparatus, method and program
Schmeing et al. Depth image based rendering: A faithful approach for the disocclusion problem
GB2592175A (en) Image processing
CN113066191B (en) Virtual-real fusion method and system for holographic stereogram parallax image based on depth map
Bleyer et al. Temporally consistent disparity maps from uncalibrated stereo videos
JP2022533754A (en) Method, apparatus, and computer program product for volumetric video encoding and decoding
CN111147883A (en) Live broadcast method and device, head-mounted display equipment and readable storage medium
EP3729805A1 (en) Method for encoding and decoding volumetric video data
CN112601065B (en) Method and device for reconstructing high-freedom video viewable range
CN108450031B (en) Image capturing apparatus
WO2021130355A1 (en) Video processing device and manifest file for video streaming
Feng et al. Asymmetric bidirectional view synthesis for free viewpoint and three-dimensional video
JP4173440B2 (en) Visual communication signal
JP2011151773A (en) Video processing apparatus and control method
KR101632514B1 (en) Method and apparatus for upsampling depth image
KR20210027483A (en) Methods and Devices for Encoding and Decoding 3 Degrees of Freedom and Volumetric Compatible Video Stream
Redert et al. 3-D scene reconstruction with viewpoint adaptation on stereo displays

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant