WO2016195123A1

WO2016195123A1 - Apparatus and method for processing wide viewing angle image

Info

Publication number: WO2016195123A1
Application number: PCT/KR2015/005415
Authority: WO
Inventors: 최광진; 박영준; 나경건
Original assignee: (주)에프엑스기어
Priority date: 2015-05-29
Filing date: 2015-05-29
Publication date: 2016-12-08
Also published as: JP2018518786A; JP6564939B2

Abstract

The present specification discloses an apparatus for processing a wide viewing angle image and a method for processing a wide viewing angle image using the apparatus, the apparatus comprising: a correction parameter generation unit for analyzing an image input from a camera so as to generate a correction parameter; a projection geometry generation unit for generating a projection geometry for the output of a wide viewing angle image, using the correction parameter; and a wide viewing angle image packaging unit for encoding the input image, the correction parameter, and the projection geometry so as to generate a wide viewing angle image package.

Description

Wide viewing angle image processing device and method

The present invention relates to a wide viewing angle image processing apparatus and method, and more particularly, to an image processing apparatus and method for rendering a wide viewing angle image using projection geometry corrected using camera-specific parameters.

In general, in photographing an image using an optical device such as a camera and displaying the captured image, distortion occurs in the image due to a problem in the camera hardware itself such as a lens of the camera. In order to display such an image, the image distortion should be corrected and displayed for a natural view of the image.

Conventionally, in the case of image distortion correction, the image image itself is corrected before the image display. However, this method has a problem in that the burden of image processing is very large.

In addition, in the case of camera stabilization of a video generated during hand-held shooting, if the video image itself is corrected before display, the burden of image processing is increased. The existing technology for correcting such image distortion or camera shake has a problem that the computation amount and computation time are very large because the image image correction must be preprocessed in the image space before the image is viewed.

In order to solve such a problem, there is a need for an apparatus and method capable of real-time calculation of a video distortion correction and a shake correction at a display time point.

An optical viewing angle image processing apparatus according to an embodiment of the present invention may include a correction parameter generator configured to analyze an image input from a camera to generate correction parameters, and generate projection geometry for outputting the wide viewing angle image using the correction parameters. A projection geometry generating unit and an optical viewing angle image packaging unit generating an optical viewing angle image package by encoding the input image, the correction parameters, and the projection geometry.

In the wide viewing angle image processing apparatus according to the embodiment, the correction parameter may be characterized by including a camera-specific parameter or a stabilization parameter.

In the wide viewing angle image processing apparatus according to the embodiment, the projection geometry generating unit corrects the vertex or texture coordinates of the reference geometry by using the camera-specific parameters, transforms the corrected reference geometry into a curved shape, and projects the projection geometry. It may be characterized by generating the geometry.

The wide viewing angle image processing apparatus may further include a first communication unit configured to provide the wide viewing angle image package to another device.

The wide viewing angle image display apparatus according to another embodiment may decode the second communication unit receiving the wide viewing angle image package provided from the first communication unit and the received wide viewing angle image package, and project the projection geometry into a virtual space, It includes a scene configuration unit for arranging a camera, and configures the scene by texturing the input image to the projected projection geometry.

In the wide viewing angle image display apparatus according to another exemplary embodiment, the correction parameter may include a camera specific parameter or a stabilization parameter.

In the wide viewing angle image display apparatus according to another embodiment, the scene configuration unit may be configured to correct the scene by dynamically adjusting the position of the virtual camera using the stabilization parameter.

In the wide viewing angle image display apparatus according to another embodiment, the scene configuration unit may correct the scene by dynamically adjusting the vertex of the projection geometry projected on the virtual space using the stabilization parameter. .

The wide viewing angle image display apparatus according to another embodiment may further include a display unit which renders and displays the scene in real time.

In the wide viewing angle image display apparatus according to an embodiment, the camera is a stereo camera, and the correction parameter may further include a mechanical error correction parameter, a color correction parameter, or an exposure correction parameter between the cameras.

In the wide viewing angle image display apparatus according to an embodiment, the scene configuration unit for correcting the scene by dynamically adjusting the vertex of the projection geometry or the virtual camera projected to the virtual space by further using the mechanical error correction parameter. It may be characterized by.

In the wide viewing angle image display device according to another embodiment, the wide viewing angle image display device may be a wearable device or a portable communication device.

According to another embodiment, a method of displaying a wide viewing angle image may include generating a correction parameter by analyzing an image input from a camera, generating a projection geometry for outputting a wide viewing angle image using the correction parameter, and inputting the correction parameter. Generating the wide viewing angle image package by encoding the captured image, the correction parameters, and the geometry.

In the wide viewing angle image display method according to another embodiment, the correction parameter may be characterized in that it comprises a camera specific parameter or a stabilization parameter.

In the wide viewing angle image display method according to another embodiment, the step of generating the geometry, the step of correcting the vertex or texture coordinates of the reference geometry using the camera-specific parameters and the vertex of the reference geometry When correcting, the method may include generating the projection geometry by transforming the corrected reference geometry into a curved surface shape.

In another embodiment, a method of displaying a wide viewing angle image, the method further comprises extracting metadata by analyzing the input image, and generating the wide viewing angle image package further includes the metadata. And encoding may be performed.

According to another embodiment, a wide viewing angle image display method includes decoding the wide viewing angle image package, projecting the projection geometry into a virtual space, arranging a virtual camera, and inputting the input image to the projected projection geometry. The method may further include constructing a scene by texturing.

The wide viewing angle image display method according to another embodiment may further include correcting the scene by dynamically adjusting the position of the virtual camera using the stabilization parameter.

The wide viewing angle image display method according to another embodiment may further include correcting the scene by dynamically adjusting vertices of the projection geometry projected into the virtual space using the stabilization parameter. have.

The wide viewing angle image display method according to another embodiment may further include displaying the scene data by rendering the scene data in real time.

In a wide viewing angle image display method according to another embodiment, the input image is a stereo image input to a stereo camera, wherein the correction parameter further includes a mechanical error correction parameter, a color correction parameter, or an exposure correction parameter between cameras. It may be characterized by including.

According to an embodiment of the present invention, the lens distortion correction and the shake correction are performed in the three-dimensional space instead of the image space to perform the three-dimensional rendering process in real time in the rendering step instead of the pre-processing display.

In addition, by generating and encoding the modified three-dimensional projection geometry by using camera-specific parameters, the burden of data processing can be reduced, and in the scene composition and rendering stages, the stabilization parameters generated by using camera-specific parameters can be used. By manipulating a virtual camera or three-dimensional projection geometry in a dimensional virtual space, the burden of data processing can be reduced by correcting distortion.

1 is a block diagram of a wide viewing angle image processing system 1000 according to an exemplary embodiment.

2A and 2B are diagrams for describing scene generation of the scene configuration unit 220.

3A to 3E are diagrams for describing geometry projection and texturing according to a vertex transformation method of geometry according to at least one example embodiment.

4A to 4E are diagrams for describing geometry projection and texturing according to a texture coordinate transformation method of geometry, according to an exemplary embodiment.

5 is a diagram illustrating an example of scene correction using position adjustment of a virtual camera, according to an exemplary embodiment.

6 illustrates an example of scene correction using geometry transformation, according to an exemplary embodiment.

7 is a flowchart illustrating a method of processing a wide viewing angle image, according to an exemplary embodiment.

8 is a flowchart of a method of processing a wide viewing angle image, according to another exemplary embodiment.

9 is a flowchart illustrating a geometry generation step according to an embodiment of the present invention.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. As used herein, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, action, component, part, or combination thereof that is described, and that one or more other features or numbers are present. It is to be understood that the present invention does not exclude, in advance, the possibility of addition, presence of steps, actions, components, parts, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art. Terms such as those defined in the commonly used dictionaries should be construed as meanings consistent with the meanings in the context of the related art, and shall not be construed in ideal or excessively formal sense unless clearly defined herein. . Like reference numerals in the drawings denote like elements. However, in describing the embodiments, when it is determined that detailed descriptions of related known functions or configurations may unnecessarily obscure the subject matter of the present invention, detailed descriptions thereof will be omitted. In addition, the size of each component in the drawings may be exaggerated for description, it does not mean the size that is actually applied.

Embodiments described herein may have aspects that are wholly hardware, partly hardware and partly software, or wholly software. As used herein, "unit", "module", "device" or "system" and the like refer to hardware, a combination of hardware and software, or a computer related entity such as software. For example, parts, modules, devices, or systems herein refer to running processes, processors, objects, executables, threads of execution, programs, and / or computers. computer, but is not limited thereto. For example, both an application running on a computer and a computer may correspond to a part, module, device, system, or the like herein.

Embodiments have been described with reference to the flowchart presented in the drawings. Although the method is shown and described in a series of blocks for the sake of simplicity, the invention is not limited to the order of the blocks, and some blocks may occur in different order or simultaneously with other blocks than those shown and described herein. Various other branches, flow paths, and blocks may be implemented in order to achieve the same or similar results. In addition, not all illustrated blocks may be required for the implementation of the methods described herein. Furthermore, the method according to an embodiment of the present invention may be implemented in the form of a computer program for performing a series of processes, which may be recorded on a computer-readable recording medium.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a wide viewing angle image processing system 1000 according to an exemplary embodiment. The wide viewing angle image processing system 1000 may include the wide viewing angle image processing device 100 and / or the wide viewing angle image display device 200, and the

devices

100 and 200 may be one device such as one chip. It can be integrated into or exist as a separate device. In addition, in an embodiment, when the

devices

100 and 200 exist as separate devices, data communication may be performed through a wired or wireless network.

In one embodiment, the wide viewing angle image processing apparatus 100 may include a correction parameter generator 110, a projection geometry generator 120, and a wide viewing angle image packaging unit 130. The communication unit 140 may further include.

The correction parameter generator 110 may generate a correction parameter by analyzing an image input from the camera. In one embodiment, a camera (not shown) may be included in the wide viewing angle image processing apparatus 100, and the camera may be a monocular camera or a stereo camera having a wide viewing angle, a panorama, a fisheye lens, or the like.

Through the camera, an image photographing a subject and an image photographing a reference grid may be input to the wide viewing angle image processing apparatus 100. The reference grid may be, for example, a square black and white grid pattern as a reference sample for image analysis, and an image photographing a subject may be corrected based on the reference grid.

The correction parameter generator 110 may generate the camera intrinsic parameter and the stabilizing parameter by analyzing the input image (the subject image and the reference grid image). The camera specific parameter is a parameter related to a mechanical error of the camera lens, and the stabilization parameter is a parameter generated by applying the camera specific parameter to a subject photographed image. The stabilization parameter includes a temporal factor as a parameter for correcting artifacts such as camera shake.

In addition, the correction parameter may include internal and external parameters of the camera used when capturing the input image.

The projection geometry generator 120 may generate projection geometry for outputting the wide viewing angle image using the correction parameter generated by the correction parameter generator 110. For example, the projection geometry generator 120 may correct the reference geometry in the form of a flat grid into projection geometry for outputting a wide viewing angle image. In detail, the projection geometry generator 120 may correct vertices of reference geometry or correct texture coordinates by using camera-specific parameters, and then transform the corrected geometry into a curved shape to project a wide viewing angle image output. You can create geometry. Deformation of the geometry, projection, and texturing of the image according to the correction of the vertex or texture coordinates will be described in detail below.

The wide viewing angle image packaging unit 130 may generate the wide viewing angle image package by encoding the image input to the wide viewing angle image processing apparatus 100, the generated correction parameters, and the projection geometry. In the above description, the input image may be an image corrected by further using other parameters in addition to the camera-specific parameters. In another embodiment, the wide viewing angle image packaging unit 130 may further include the metadata for the input image to perform the encoding.

The first communication unit 140 may provide the wide viewing angle image package to another device. The first communication unit 140 may provide an image package through a wired or wireless network, and any wireless communication method may be used. Alternatively, the other device may be another device outside the wide viewing angle image processing system 1000, an internal device, or any other module included in the wide viewing angle image processing device 100.

In another embodiment, the wide viewing angle image display apparatus 200 may receive the wide viewing angle image package generated by the wide viewing angle image processing apparatus 100 and display the wide viewing angle image on the display device.

To this end, the wide viewing angle image display apparatus 200 may include a second communication unit 210, a scene configuration unit 220, and a display unit 230 as shown in FIG. 1. In one embodiment, the second communication unit 210 may receive a wide viewing angle image package through a wired or wireless network. In another embodiment, the second communication unit 210 may directly receive the wide viewing angle image package generated by the wide viewing angle image packaging unit 130. For example, the wide viewing angle image processing apparatus 100 and the wide viewing angle image display apparatus 200 may be integrated into one device. The second communication unit 210 may transmit the received wide viewing angle image package to the scene composition unit 220.

The scene configuration unit 220 may decode the received (transmitted) wide viewing angle image package in real time, project the projection geometry into the virtual space, and place the camera in the virtual space. Thereafter, the input image may be textured on the projected projection geometry to construct a scene. The scene configuration unit 220 may project the projection geometry onto a spherical surface in the virtual space. That is, the projection geometry is projection geometry corrected based on camera specific parameters. This geometry is projection geometry that is calibrated in vertex units or texture coordinates are corrected.

2A and 2B are diagrams for describing scene generation of the scene configuration unit 220. Referring to FIG. 2A, the scene configuration unit 220 arranges a virtual camera 21 for rendering in the virtual space 20, and projects the projection geometry into the virtual space 20. For example, as shown in FIG. 2A, the scene configuration unit 220 projects the projection geometry onto a spherical surface formed in the virtual space 20. As shown in FIG. 2B, an image 23 is textured to the projected projection geometry to construct a scene. The display unit 230 renders a scene in real time and displays the scene on a display device (not shown). In another embodiment, an additional correction module may be further included in the wide viewing angle image display apparatus 200 to correct artifacts caused by distortion of the eyepiece of the display device.

In another embodiment, the projection geometry generator 120 included in the wide viewing angle image processing apparatus 100 may correct vertex or texture coordinates of the reference projection geometry by using camera-specific parameters, and correct the corrected reference projection geometry. The shape of the curved surface may be used to generate projection geometry to be used to render the photographed image. In the present specification, the projection geometry refers to the projection geometry to be used for rendering the photographed image, and the reference projection geometry refers to a projection geometry template as a sample for generating the projection geometry.

3A and 3E are diagrams for describing projection geometry projection and texturing according to a vertex transformation method of projection geometry, according to an exemplary embodiment. In one embodiment, the projection geometry generator 120 may generate the corrected projection geometry by converting the vertices of the reference projection geometry using camera-specific parameters. With reference to FIG. 3A, reference projection geometry 31 is shown together for comparison with the generated projection geometry 32. Referring to FIG. 3A, the projection geometry 32 in which the vertices are converted has a shape where the edge is curved and is compressed with respect to the center. When texturing is performed on the generated projection geometry 32, the textured image appears without distortion as shown in FIG. 3B. For example, a straight line of the subject appears as a straight line even in the textured image.

Referring to FIGS. 3C and 3D, the scene configuration unit 220 arranges the projection geometry 32 in the virtual space. In this case, by projecting the projection geometry onto any spherical surface of the virtual space, the concave curved projection geometry shown in FIG. 3B may be unfolded as shown in FIGS. 3C and 3D. FIG. 3D shows a state of texturing an image photographed on the projected projection geometry, and FIG. 3E shows a state of displaying the textured image from the front at the same angle of view as the camera's angle of view when the image is captured.

4A to 4E are diagrams for describing projection geometry projection and texturing according to a texture coordinate transformation method of projection geometry, according to an exemplary embodiment. The texture coordinates are coordinates in which the image is textured and are independent of the shape of the projection geometry. As shown in FIG. 4A, the projection geometry 42 does not change the shape of the reference projection geometry. However, when the image is textured on the projection geometry 42, as shown in FIG. 4B, the image textured on the projection geometry shows a shape inwardly distorted rather than rectangular.

Referring to FIG. 4C, when the projection geometry 42 whose texture coordinates are corrected is disposed on a spherical surface in the virtual space, and the image is rendered to the projection geometry 42 to render, the image is output as shown in FIG. 4D. 4E shows a state in which the textured image is displayed from the front at the same angle of view as the camera angle when the image is captured. Through this process, the wide viewing angle image can be represented on the spherical surface of the virtual space without distortion.

In another embodiment, the scene configuration unit 220 may correct the scene so that the corrected image can be rendered by dynamically adjusting the position of the virtual camera in the virtual space by using a correction parameter (eg, a stabilization parameter). .

5 illustrates an example of scene correction using position adjustment of a virtual camera, according to an exemplary embodiment. Referring to FIG. 5, the scene configuration unit 220 may correct a scene by dynamically adjusting a position of a virtual camera based on a correction parameter. In FIG. 5, only the up, down, left, and right directions are illustrated, and the rendered image may be corrected by moving to an arbitrary position in the 3D virtual space.

6 illustrates an example of scene correction using projection geometry transformation, according to an embodiment. Referring to FIG. 6, in one embodiment, the scene configuration unit 220 may correct a scene by converting projection geometry while the virtual camera is fixed. For example, as shown in FIG. 6, the projection geometry can be moved in the up, down, left, right, or yaw, pitch, and roll directions.

In another embodiment, the scene configuration unit 220 may perform scene correction by adjusting the virtual camera and the projection geometry together. Such scene correction may be performed in real time at the same time as the rendering of the image.

In an embodiment, the camera may be a stereo camera. When the wide viewing angle image processing apparatus 100 receives a stereo image from a stereo camera, the correction parameter generator 110 may correct a machine error correction parameter and color between the cameras. Parameters or exposure compensation parameters can be created. That is, the above parameter may be included in the correction parameter.

In this case, the scene configuration unit 220 may further perform scene correction by adjusting a vertex or a virtual camera of the projection geometry projected in the virtual space by further using a mechanical error correction parameter in addition to the stabilization parameter. For example, the scene configuration unit 220 may statically adjust the projection geometry or the virtual camera in the scene composition using the machine error correction parameter to correct the machine error. That is, the scene configuration unit 220 performs the stabilization of the scene configuration in terms of time using the stabilization parameter, and provides a real-time image of improved quality by correcting the mechanical error between stereo cameras using the mechanical error correction parameter. Can be.

In one embodiment, the wide viewing angle image processing apparatus 100 and the wide viewing angle image display apparatus 200 may be a server, a personal computer, a laptop, a tablet PC, a smartphone, and the like, and the devices may include a camera. In particular, the wide viewing angle image display device 200 may be a wearable device or any portable communication device.

7 is a flowchart illustrating a method of processing a wide viewing angle image, according to an exemplary embodiment. Referring to FIG. 7, the method for processing a wide viewing angle image includes receiving an image from a camera (S11), generating a correction parameter by analyzing the received image (S12), and outputting a wide viewing angle image using the correction parameter. Generating the projection geometry (S13), and encoding the input image, the correction parameter, and the projection geometry may include generating the wide viewing angle image package (S14). In step S12, the generated correction parameter may include a camera specific parameter or a stabilization parameter.

In another embodiment, the camera-specific parameter wide viewing angle image processing method may further include transmitting the generated wide viewing angle image package to another device.

8 is a flowchart of a method of processing a wide viewing angle image, according to another exemplary embodiment. Referring to FIG. 8, the wide viewing angle image processing method may be performed subsequent to or independently of the wide viewing angle image processing method disclosed in FIG. 7.

In the wide viewing angle image processing method according to another embodiment shown in FIG. 8, receiving the wide viewing angle image package, decoding the wide viewing angle image package (S21), projecting projection geometry into a virtual space, and Disposing a virtual camera in a virtual space (S22), constructing a scene by texturing the image on the projected projection geometry (S23), correcting the scene using the parameters (S24), and correcting the scene. It may include the step of rendering and displaying (S25). In one embodiment, steps S23 to S25 may be performed dynamically at the same time.

The wide viewing angle image processing method may further include correcting a scene by dynamically adjusting a position of the virtual camera using a correction parameter (for example, a stabilization parameter). In another embodiment, the wide viewing angle image processing method may further include correcting a scene by dynamically adjusting the projection geometry by using a correction parameter (eg, a stabilization parameter).

In another embodiment, the wide viewing angle image processing method may further include extracting metadata by analyzing the input image. In this case, the generating of the wide viewing angle image package may include generating the metadata. In addition, encoding may be performed.

9 is a flowchart illustrating a projection geometry generation step according to an embodiment of the present invention. Referring to FIG. 9, after step 12, in order to generate projection geometry for outputting a wide viewing angle image using correction parameters, correcting vertex or texture coordinates of reference projection geometry using camera-specific parameters (S131). And deforming the corrected reference projection geometry into a curved surface to generate the projection geometry (S132). As described above with reference to FIG. 5, the step S132 refers to a case in which the shape of the projection geometry is changed by converting the vertices of the projection geometry, and thus, the shape of the projection geometry is used when the projection geometry having the texture coordinates corrected. It does not change, only the texture coordinates inherent in this projection geometry change.

10 is a flowchart of a method of processing a wide viewing angle image, according to another exemplary embodiment. The wide viewing angle image processing method of FIG. 10 relates to a method of rendering and displaying an image photographed using a stereo camera. In the wide viewing angle image processing method illustrated in FIG. 10, a step (S31) of receiving an image from a stereo camera, generating a correction parameter by analyzing the received stereo image (S32), and correcting the stereo image using the correction parameter And a step S33 of generating a projection geometry using the correction parameter and a step S25 of encoding a stereo image, a correction parameter, and a projection geometry to generate an image package. In another embodiment, step S33 may be omitted. In step S32, the correction parameter may further include a machine error correction parameter, a color correction parameter or an exposure correction parameter between cameras.

In another embodiment, the wide viewing angle image package generated by the wide viewing angle image processing method described with reference to FIG. 10 may be decoded and displayed on the display device. In this case, the rendered scene may be corrected by changing the position of the projection geometry or the virtual camera projected in the virtual space.

Although the present invention described above has been described with reference to the embodiments shown in the drawings, this is merely exemplary, and it will be understood by those skilled in the art that various modifications and variations may be made therefrom. However, such modifications should be considered to be within the technical protection scope of the present invention. Therefore, the true technical protection scope of the present invention will be defined by the technical spirit of the appended claims.

Claims

A correction parameter generator for generating a correction parameter by analyzing an image input from the camera;

A projection geometry generation unit generating projection geometry for outputting a wide viewing angle image using the correction parameter; And

And an optical viewing angle image packaging unit encoding the input image, correction parameters, and projection geometry to generate a wide viewing angle image package.
The method of claim 1,

The correction parameter is

And a camera specific parameter or stabilization parameter.
The method of claim 2,

The projection geometry generation unit,

And correcting the vertex or texture coordinates of the reference geometry by using the camera-specific parameters, and generating the projection geometry by transforming the corrected reference geometry into a curved shape.
The method of claim 1,

And a first communication unit configured to provide the wide viewing angle image package to another device.
A second communication unit receiving a wide viewing angle image package provided from the first communication unit of claim 4; And

A wide viewing angle comprising a scene configuration unit for decoding a received wide viewing angle image package, projecting the projection geometry into a virtual space, arranging a virtual camera, and texturing the input image onto the projected projection geometry to construct a scene Video display device.
The method of claim 5,

The correction parameter is

A wide viewing angle image display device comprising a camera specific parameter or a stabilization parameter.
The method of claim 6,

The scene configuration unit,

And widening the position of the virtual camera by using the stabilization parameter to correct the scene.
The method of claim 6,

The scene configuration unit,

And correcting the scene by dynamically adjusting vertices of the projection geometry projected in the virtual space using the stabilization parameter.
The method of claim 5,

And a display unit which renders and displays the scene in real time.
The method of claim 1,

The camera is a stereo camera,

The correction parameter may further include a mechanical error correction parameter, a color correction parameter, or an exposure correction parameter between cameras.
The method of claim 10,

The scene configuration unit,

And adjusting the vertex of the projection geometry projected into the virtual space or the virtual camera by further using the mechanical error correction parameter to correct the scene.
The method of claim 5,

The wide viewing angle image display device,

A wide viewing angle image display device, characterized in that the wearable device or a portable communication device.
Analyzing the image input from the camera to generate a correction parameter;

Generating projection geometry for outputting a wide viewing angle image using the correction parameter; And

And generating a wide viewing angle image package by encoding the input image, correction parameters, and geometry.
The method of claim 13,

The correction parameter is

And a camera specific parameter or stabilization parameter.
The method of claim 14,

Generating the geometry,

Correcting vertex or texture coordinates of reference geometry using the camera specific parameters; And

And if the vertices of the reference geometry are corrected, modifying the corrected reference geometry into a curved surface to generate the projection geometry.
The method of claim 13,

The method may further include extracting metadata by analyzing the input image.

The generating of the wide viewing angle image package may further include encoding the metadata to perform encoding.
The method of claim 16

Decoding the wide viewing angle image package, projecting the projection geometry into a virtual space, and placing a virtual camera; And

And constructing a scene by texturing the input image onto the projected projection geometry.
The method of claim 17,

And correcting the scene by dynamically adjusting the position of the virtual camera by using the stabilization parameter.
The method of claim 17,

And correcting the scene by dynamically adjusting vertices of the projection geometry projected into the virtual space using the stabilization parameter.
The method of claim 17,

And real-time rendering and displaying the scene data.
The method of claim 17,

The input image is a stereo image input to a stereo camera,

The correction parameter further comprises a mechanical error correction parameter, a color correction parameter or an exposure correction parameter between the cameras.