WO2018186646A1

WO2018186646A1 - Device and method for processing high-definition 360-degree vr image

Info

Publication number: WO2018186646A1
Application number: PCT/KR2018/003882
Authority: WO
Inventors: 윤국진; 정준영
Original assignee: 한국전자통신연구원
Priority date: 2017-04-03
Filing date: 2018-04-03
Publication date: 2018-10-11
Also published as: KR20180112708A; US20200084516A1; US10848837B2

Abstract

Provided are a device and a method for providing a high-definition 360-degree virtual reality (VR) image. A 360-degree VR image decoding method, according to the present disclosure, comprises the steps of: receiving a bitstream including 360-degree VR image information; decoding, from the bitstream, information associated with a 360-degree VR service; detecting a region of interest on the basis of the information associated with the 360-degree VR service; and providing, to a user, a 360-degree VR image for the region of interest.

Description

High definition 360 degree VR image processing device and method

The present disclosure relates to a high-definition 360-degree VR image processing apparatus and method. More specifically, the present disclosure relates to an apparatus and method for providing signaling information regarding a high definition 360 degree VR broadcast service and also providing a high quality 360 degree VR image to a region of interest of a user.

The advent of digital broadcasting has changed the traditional broadcasting method of watching a signal unilaterally transmitted from a broadcasting station into a form in which a user can selectively watch only desired content at a desired time. In addition, the development of broadband transmission technology has been able to provide realistic broadcast services that can provide viewers with 4K or higher quality immersive media (eg, UHDTV, 3DTV, etc.) while overcoming bandwidth limitations.

360-degree virtual reality (VR) media is a media that can select and view the desired view by providing viewers with a 360-degree image, the recent efforts to service 360-degree VR media through the integration of the broadcasting network has been accelerated . Currently applied 360-degree VR media can provide full 4K or FHD-level VR media at the same time, which can provide viewers with the desired view or region of interest (RoI) without delay. However, there is a problem in that the image quality of the reproduced view is deteriorated according to the movement of the actual viewer. In addition, in another form, the 360-degree VR service streaming to the corresponding area based on the viewer's movement or the view information selected by the viewer may provide a relatively high quality view, but in response to the user's movement, There is a problem in that a delay time (Motion to Photon, MTP) for playing an image is long.

As a technology related to 360-degree VR media, a technology that provides a panorama video broadcasting service recognition and signaling to indicate related video characteristics, and first transmits a thumbnail image, and a receiver transmits data of a specific region requested based on the thumbnail. Techniques such as technology to classify panorama video into tiles of a certain area and transmit only data of tiles for the area selected by the user. These existing technologies have proposed signaling, tiling transmission and synchronization methods for providing a panoramic broadcasting service, but the 360-degree VR broadcasting service based on the user's movement or the user's selection in a broadcasting network environment for a high-definition 360-degree VR image is proposed. There is a problem that it is difficult to provide.

An object of the present disclosure is to provide a high-definition 360-degree VR image processing apparatus and method.

Another technical problem of the present disclosure is to provide an encoding apparatus and method for providing signaling information regarding a high definition 360 degree VR broadcast service.

Another technical problem of the present disclosure is to provide a decoding apparatus and method for receiving signaling information regarding a high definition 360 degree VR broadcast service.

Another technical problem of the present disclosure is to provide an encoding apparatus and method for providing a high-definition 360-degree VR image for a region of interest of a user.

Another technical problem of the present disclosure is to provide a decoding apparatus and method for providing a high-definition 360-degree VR image for the user's region of interest.

Technical problems to be achieved in the present disclosure are not limited to the above-mentioned technical problems, and other technical problems not mentioned above will be clearly understood by those skilled in the art from the following description. Could be.

According to the present disclosure, a high quality 360 degree VR image processing apparatus and method may be provided.

In addition, according to the present disclosure, an apparatus and method for providing signaling information for a high definition 360 degree VR broadcast service may be provided.

In addition, according to the present disclosure, an apparatus and method for providing a high-definition 360-degree VR image for the ROI of a user may be provided.

The effects obtainable in the present disclosure are not limited to the above-mentioned effects, and other effects not mentioned above may be clearly understood by those skilled in the art from the following description. will be.

1 is a view for explaining a scenario of serving a high-definition 360-degree VR media through a broadcasting network according to an embodiment of the present disclosure.

2 is a view for explaining the structure of a 360-degree VR video stream transmitted through a broadcasting network according to an embodiment of the present disclosure.

3 is a diagram for describing a signaling structure regarding a 360 degree VR broadcast service according to one embodiment of the present disclosure.

4 is a diagram illustrating a configuration of a high-definition 360-degree VR image processing apparatus according to an embodiment of the present disclosure.

FIG. 5 is a diagram for describing a process of providing a high-definition 360-degree image of a region of interest (RoI) according to an exemplary embodiment.

6 is a diagram for describing a process of providing a high-definition 360 degree image of a region of interest (RoI) according to another exemplary embodiment of the present disclosure.

FIG. 7 is a diagram for describing a process of providing a high-definition 360-degree VR image to a region of interest of a user in a low-degree 360-degree VR image according to an embodiment of the present disclosure.

According to an aspect of the present disclosure, the method includes: receiving a bitstream including 360 degree VR (Virtual Reality) image information; Decoding information associated with a 360 degree VR service from the bitstream; Detecting a region of interest based on information associated with the 360 degree VR service; And providing the 360 degree VR image to the user for the ROI.

According to another aspect of the present disclosure, a bitstream including 360-degree VR image information is received, information about a 360-degree VR service is decoded from the bitstream, and a region of interest is based on information associated with the 360-degree VR service. And detecting and providing the 360-degree VR image to the user with respect to the ROI.

According to another aspect of the present disclosure, a method of receiving 360-degree VR image information; Recognizing a region of interest of the user; And encoding information related to a 360 degree VR service, wherein the information related to the 360 degree VR service includes at least one of segmentation information of the 360 degree VR image and the ROI information. An image encoding method may be provided.

According to another aspect of the present disclosure, receiving 360-degree VR image information, recognizing a region of interest of a user, encoding information associated with a 360-degree VR service, information associated with a 360-degree VR service is the 360-degree VR image A 360 degree image encoding apparatus may include at least one of segmentation information and the ROI information.

As the invention allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the present invention to specific embodiments, it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention. Like reference numerals in the drawings refer to the same or similar functions throughout the several aspects. Shape and size of the elements in the drawings may be exaggerated for clarity. DETAILED DESCRIPTION For the following detailed description of exemplary embodiments, reference is made to the accompanying drawings that show, by way of illustration, specific embodiments. These embodiments are described in sufficient detail to enable those skilled in the art to practice the embodiments. It should be understood that the various embodiments are different but need not be mutually exclusive. For example, certain shapes, structures, and characteristics described herein may be embodied in other embodiments without departing from the spirit and scope of the invention with respect to one embodiment. In addition, it is to be understood that the location or arrangement of individual components within each disclosed embodiment may be changed without departing from the spirit and scope of the embodiments. The following detailed description, therefore, is not to be taken in a limiting sense, and the scope of the exemplary embodiments, if properly described, is defined only by the appended claims, along with the full scope of equivalents to which such claims are entitled.

In the present invention, terms such as first and second may be used to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as the second component, and similarly, the second component may also be referred to as the first component. The term and / or includes a combination of a plurality of related items or any item of a plurality of related items.

When any component of the invention is said to be “connected” or “connected” to another component, it may be directly connected to or connected to that other component, but other components may be present in between. It should be understood that it may. On the other hand, when a component is referred to as being "directly connected" or "directly connected" to another component, it should be understood that there is no other component in between.

The components shown in the embodiments of the present invention are shown independently to represent different characteristic functions, and do not mean that each component is made of separate hardware or one software component unit. In other words, each component is included in each component for convenience of description, and at least two of the components may be combined into one component, or one component may be divided into a plurality of components to perform a function. Integrated and separate embodiments of the components are also included within the scope of the present invention without departing from the spirit of the invention.

The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting of the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In the present invention, the terms "comprise" or "have" are intended to indicate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more other features. It is to be understood that the present invention does not exclude the possibility of the presence or the addition of numbers, steps, operations, components, components, or a combination thereof. In other words, the description "include" a specific configuration in the present invention does not exclude a configuration other than the configuration, it means that additional configuration may be included in the scope of the technical spirit of the present invention or the present invention.

Some components of the present invention are not essential components for performing essential functions in the present invention but may be optional components for improving performance. The present invention can be implemented including only the components essential for implementing the essentials of the present invention except for the components used for improving performance, and the structure including only the essential components except for the optional components used for improving performance. Also included in the scope of the present invention.

EMBODIMENT OF THE INVENTION Hereinafter, embodiment of this invention is described concretely with reference to drawings. In describing the embodiments of the present specification, when it is determined that a detailed description of a related well-known configuration or function may obscure the gist of the present specification, the detailed description is omitted and the same reference numerals are used for the same elements in the drawings. Duplicate descriptions of the same components are omitted.

The first scenario is a scenario of simultaneously serving a 360-degree VR image of low quality and high quality based on an image acquired by a 360-degree VR camera. Here, the term “high definition” may mean a basic resolution of media acquired from a 360-degree VR acquisition device. The low quality 360 degree VR image 110 may refer to an image which is down-converted to have a predetermined size with respect to a high quality 360 degree VR image obtained by a 360 degree VR camera. For example, if the high definition 360 degree VR image has a resolution of 16Kx8K, the low quality 360 degree VR image 110 may have a resolution of 4Kx2K. The resolution of 4Kx2K is based on the resolution of the current commercial UHD TV and head mounted display (HMD), and the resolution of the low-quality 360-degree VR image 110 is not limited thereto and may be arbitrarily changed. Meanwhile, the low definition 360 degree VR image 110 may be provided for compatibility with an existing receiver in a broadcast environment, and may be used to minimize MTP time according to a user's movement or a user's selection.

The high-definition 360-degree VR image 120 of the present disclosure may refer to a high-definition image provided for a region of interest (RoI). The region of interest may be recognized according to the movement of the user or the selection of the user. For example, the selection of the user may mean a user input through an external device, but is not limited thereto and may include a predetermined operation of the user for determining the ROI. The high-definition 360-degree VR image 120 may be divided into areas of any size, and each divided area may be encoded independently. Referring to FIG. 1, the high quality 360 degree VR image 120 may be divided into tiled based regions. For example, a user may watch a 360-degree VR image of a low quality, and a high-definition 360-degree VR image is provided for a region of interest of the user, so that the user may watch a 360-degree VR image that is more sharp and improved in a region of interest. Can be.

The second scenario is a scenario in which the high-definition VR image 130 is serviced under a broadcast environment based on the high-definition 360-degree VR image 130 divided into regions having a predetermined size without a low-degree 360-degree VR image. For example, the receiver may display an initial view region 132 to be reproduced among the divided regions through signaling and reproduce the corresponding region determined in response to the movement of the user or the selection of the user. For example, the size of a predetermined partition may be determined such that the partition has a constant resolution such as FHD or 4K, and may also vary according to a resolution supported by a mobile device such as a TV or an HMD.

The low-quality 360-degree VR image 210 may be encoded by the HEVC encoder 212 and may be transmitted by being divided into one Elementary Stream (ID) _ID, Asset_ID, or AdaptationSet ID, or may also be transmitted as unique identification information of a separately encoded stream. It may be sent 214. The stream may mean a bitstream. ES_ID, Asset_ID and AdaptationSet_ID may be used as encoding stream unique identification information for distinguishing encoding streams in MPEG-2 Systems, MPEG-MMT and MPEG-DASH standards, respectively. For example, the low-definition 360-degree VR image 210 may have a resolution of 4Kx2K, but is not limited thereto and may vary depending on a terminal providing an image.

Meanwhile, the high quality 360 degree VR image 220 may be divided into regions having a constant size. Each of the divided regions may be encoded by the HEVC encoder 222 and may be transmitted by being divided into one ES ID, Asset ID, or Adaptation_set ID for each region (224). In this case, the number of streams of the high-definition 360-degree VR image 220 may vary depending on the number of divided regions. For example, the stream of the high-definition 360-degree VR image 220 may have a resolution of 4Kx2K, but is not limited thereto, and may vary depending on a terminal providing an image. In addition, the low-quality 360-degree VR video stream may be transmitted in the same channel as the partition stream of the high-definition 360-degree VR video 220, or may be transmitted in a separate channel to maintain compatibility with the conventional receiver (216). For example, a separate channel may be a separate channel in an IP network or a broadcasting network. In addition, the partition stream of the high-definition 360-degree VR image 220 may be transmitted through one channel or through an IP network by using channel combining (226).

Referring to FIG. 3, the signaling structure for the 360-degree VR broadcast service may include signaling information additionally required for the classification or broadcast service of the 360-degree VR video stream of low quality and high quality.

According to an embodiment, the first signaling structure 310 is a signaling structure for distinguishing a high-definition 360-degree VR broadcast service and may indicate information applied to a program or service level and signaled.

VR_contents_ID may mean an identifier for distinguishing various VR images transmitted from a program or a channel. In addition, the VR_contents_ID may be utilized as unique identification information for distinguishing variously transmitted VR contents. In addition, it can be used as information representing the actual VR content configuration. For example, the actual VR content configuration may mean 2D or 3D. VR_projectionType may mean various VR projection types. In addition, the VR_projectionType may be used to remap or reproduce the image received at the receiver to a 360 degree VR image. Total_width and Total_height may mean the total horizontal and vertical size of the high-definition 360-degree VR image, respectively. Number_ROI may mean the total number of partitions.

In addition, the second signaling structure 320 according to an embodiment may include an identifier for distinguishing a low-quality 360-degree VR image and information signaled by being applied to a coding stream level of each region of the high-definition 360-degree VR video stream divided into a specific size. Can mean.

The VR_totalview_present may be used to determine the presence or absence of a low quality 360 degree VR video stream. Viewport_ID may mean an identifier for identifying each partition. For example, the Viewport_ID may be used to decode or play the corresponding area according to the user's movement or the user's selection. Initial_viewport_flag may be used to identify a region to be reproduced first in a terminal such as a TV or an HMD when a service is provided based on a divided region without a low quality 360 degree VR image as in the second scenario described with reference to FIG. 1. RoI_x_strartposition and RoI_x_endposition may mean horizontal start coordinates and horizontal end coordinates for the split image, respectively. RoI_y_strartposition and RoI_y_endposition may mean a vertical start coordinate and a vertical end coordinate for the split image, respectively. Based on the horizontal / vertical start coordinates and the horizontal / vertical end coordinates, the position of the divided region within the entire VR image may be known.

Meanwhile, the signaling information constituting the first signaling structure 310 and / or the second signaling structure 320 may be converted into various forms such as various metadata or XML as well as the above structure and used.

The high definition 360 degree VR image processing apparatus may include an encoding apparatus and / or a decoding apparatus of a 360 degree VR image. In addition, the 360-degree VR image may be transmitted through a heterogeneous network including a broadcasting network or a broadcasting network and an IP network.

Referring to FIG. 4, the high definition 360 degree image processing apparatus 400 may include a receiving module 410, a buffer module 420, a viewport control module 430, a decoder module 440, a RoI mapping module 450, and / or 360 VR mapping module 460 may be included. However, this is only a part of the components necessary to describe the present embodiment, the components included in the high-definition 360-degree image processing apparatus 400 is not limited to the above-described example.

The receiving module 410 may receive a transport stream based on various standard standards and analyze the signaling information and other control information related to providing the 360-degree VR service described with reference to FIG. 3. In addition, the receiving module 410 may perform a function of separately separating the 360-degree VR stream based on the low quality and / or the divided region and delivering the 360-degree VR stream to the corresponding buffer. The buffer module 420 may buffer the stream transmitted from the receiving module 410. In addition, the buffer module 420 may perform synchronization based on a decoding time stamp (DTS) or a presentation time stamp (PTS) of each stream. For example, in the case of the 360-degree VR service, since it is required to reproduce the synchronized scene according to the user's movement, the buffer module 420 may perform frame-by-frame synchronization based on the DTS or the PTS. In this case, the low quality 360 degree VR stream may be transmitted to the corresponding device as an IP stream in an IP environment in order to provide compatibility with a terminal such as an existing HMD.

The viewport control module 430 may extract a corresponding stream according to a user's movement or a user's selection based on a terminal such as a TV or an HMD. In addition, the viewport control module 430 may transmit the extracted stream to the decoder module 440. For example, the viewport control module 430 may transmit the low quality 360 degree VR video stream and the partition stream extracted by the viewport control module 430 to the decoder module 440. In this case, the user's motion information, the user's selection information, or the user's motion or area information according to the user's selection may be received in the IP environment. The partition stream may be mapped based on a low quality 360-degree VR stream, and may be used to provide a high quality image to an area viewed by a user later. Meanwhile, the buffer module 420 may also perform frame synchronization based on the DTS and / or the PTS even in the partition streams not extracted by the viewport control module 430. In addition, the buffer module 420 may continuously drop the packet through synchronization. The decoding of the low quality 360 degree VR video stream is continuously performed, while the decoding of the partition stream may vary according to the region of interest of the user. Since the synchronization process for the entire stream is performed from the buffer module 420, the high-definition 360-degree VR image processing apparatus through the terminal such as the actual HMD, minimizing the MTP generated in response to the user's movement, the region of interest of high definition Can be provided. That is, even if the region of interest moves, the high-definition 360-degree VR image processing apparatus may play back based on a low-definition 360-degree VR image stream when moving, and if the region of interest is selected, immediately decode the corresponding divided region stream.

The RoI mapping module 450 may readjust the stream to be suitable for the resolution supported by the terminal such as the HMD with respect to the partition stream extracted by the viewport control module 430. The 360 VR mapping module 460 may map the segmented video stream to the ROI based on the user's movement or the user's selection in the low quality 360 degree VR video stream. In addition, the 360 VR mapping module 460 may transmit the mapped result to a terminal such as a TV or an HMD (470).

The high-definition 360-degree VR image processing apparatus of the present disclosure may decode the partition stream included in the region of interest 512 with respect to the region of interest 512 and transmit the decoded region stream to the 360 VR mapping module. The region of interest 512 may be detected by user movement or user selection. Referring to FIG. 5, the resolution of the extracted partition stream may have a horizontal resolution of 4K. For example, if the terminal such as the HMD supports 4K horizontal resolution for the region of interest, the resolution of the extracted partition stream is the same as the resolution supported for the region of interest in the terminal such as the HMD. May directly transfer the extracted partition stream to the 360 VR mapping module of FIG. 4 without additional processing.

The high-definition 360-degree VR image processing apparatus may decode the partition stream included in the region of interest 612 with respect to the region of interest 612 and transmit the decoded region stream to the 360 VR mapping module. The region of interest 612 may be determined by user movement or user selection. In FIG. 6, as shown in FIG. 5, a terminal such as an HMD supports 4K horizontal resolution for a region of interest. Referring to FIG. 6, unlike FIG. 5, the region of interest 612 is located on a total of nine partition streams, that is, partition streams having a horizontal resolution of 4K or more. For example, if the region of interest 612 is selected as shown in FIG. 6, all nine partition streams included in the region of interest 612 may be decoded, but the size of the region decoded for reproduction in a terminal such as an actual HMD may be decoded. Needs to be readjusted. That is, the high-definition 360-degree VR image processing apparatus may continuously decode a total of nine partition region streams in which the region of interest 610 is located. Also, the high-definition 360-degree VR image processing apparatus may detect a region of interest from the decoded partial image 620 based on the center of the region corresponding to the region of interest 622. For example, the high-definition 360-degree VR image processing apparatus sets the center coordinates 624 of the region corresponding to the region of interest 622 in the decoded partial image 620 to (0,0), and uses the center coordinates to determine left 2K. , The area corresponding to the right 2K, the upper 1K and the lower 1K, a total of 4K can be extracted. The high definition 360 degree VR image processing apparatus may transmit the final extracted ROI 630 to the 360 VR mapping module. On the other hand, when the user's movement is performed in the nine decoded regions, the high-definition 360-degree VR image processing apparatus extracts the region of interest through the process of readjusting the region in the nine decoded images.

Referring to FIG. 7, a user may watch a low-definition 360-degree VR image 710, and the ROI 712 may be determined according to a user's movement or a user's selection. The high-definition 360-degree VR image processing apparatus may map the reconstructed region of interest 712 on the determined region of interest 712 and the high-definition region stream. Meanwhile, the processing described above with reference to FIG. 5 or 6 may be performed according to the relationship between the ROI 712 and the divided region of the high quality image. In addition, the high-definition 360-degree VR image processing apparatus may transmit a result image of the high-quality readjusted ROI 722 to a terminal such as a TV or an HMD.

According to the present disclosure, a high-definition 360-degree VR image processing apparatus capable of minimizing MTP through a mobile device such as a TV or HMD while providing 4K or more image quality for viewers' movements or views desired by a broadcast service environment. May be provided.

In addition, according to the present disclosure, there may be provided a receiving apparatus and method based on a user interest area for providing signaling information for a 360 degree VR broadcast service.

In addition, according to the present disclosure, an apparatus and method for minimizing MTP while providing a region of interest of high definition according to a user's movement or a user's selection in a broadcasting network environment for a high definition 360 degree VR media may be provided.

In addition, according to the present disclosure, an apparatus and method for providing a high-definition 360-degree VR broadcast service to viewers through various broadcasting networks such as terrestrial waves and cables may be provided.

The above embodiments may be performed in the same manner in the high definition 360 degree VR video encoding apparatus and the high quality 360 degree VR video decoding apparatus.

The order of applying the embodiment may be different in the high definition 360 degree VR video encoding apparatus and the high definition 360 degree VR video decoding apparatus, and the order of applying the embodiment is the high definition 360 degree VR video encoding apparatus and the high definition 360 degree VR video. It may be the same in the decoding apparatus.

The above embodiment may be performed with respect to each of the luminance and chrominance signals, and the same embodiment may be performed with respect to the luminance and the chrominance signals.

In the above-described embodiments, the methods are described based on a flowchart as a series of steps or units, but the present invention is not limited to the order of steps, and certain steps may occur in a different order or simultaneously from other steps as described above. Can be. Also, one of ordinary skill in the art appreciates that the steps shown in the flowcharts are not exclusive, that other steps may be included, or that one or more steps in the flowcharts may be deleted without affecting the scope of the present invention. I can understand.

The above-described embodiments include examples of various aspects. While not all possible combinations may be described to represent the various aspects, one of ordinary skill in the art will recognize that other combinations are possible. Accordingly, the invention is intended to embrace all other replacements, modifications and variations that fall within the scope of the following claims.

Embodiments according to the present invention described above may be implemented in the form of program instructions that may be executed by various computer components, and may be recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the computer-readable recording medium may be those specially designed and configured for the present invention, or may be known and available to those skilled in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs, DVDs, and magneto-optical media such as floptical disks. media), and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules to perform the process according to the invention, and vice versa.

Although the present invention has been described by specific embodiments such as specific components and the like, but the embodiments and the drawings are provided to assist in a more general understanding of the present invention, the present invention is not limited to the above embodiments. For those skilled in the art, various modifications and variations can be made from these descriptions.

Accordingly, the spirit of the present invention should not be limited to the above-described embodiments, and all of the equivalents or equivalents of the claims, as well as the appended claims, fall within the scope of the spirit of the present invention. I will say.

Claims

Receiving a bitstream including 360 degree VR (Virtual Reality) image information;

Decoding information associated with a 360 degree VR service from the bitstream;

Detecting a region of interest based on information associated with the 360 degree VR service; And

And providing the user with the 360 degree VR image for the ROI.
The method of claim 1,

The 360-degree VR image information includes information about the same image frame having a plurality of resolutions, 360-degree image decoding method.
The method of claim 1,

The region of interest is obtained by motion information of the user and the user's input.
The method of claim 1,

The 360-degree VR image information includes at least one of information about an image frame having a first resolution and information about the image frame having a second resolution that is higher than the first resolution.

And a video frame having the second resolution is reconstructed based on the information related to the 360-degree VR service.
The method of claim 4, wherein

Detecting the region of interest,

Decoding segmentation information of an image frame having the second resolution from information associated with the 360 degree VR service; And

Detecting the region of interest based on the segmentation information.
The method of claim 5,

Providing the 360-degree VR image,

Mapping an image frame having the second resolution to the detected region of interest in the image frame having the first resolution; And

And providing the mapped result image to the user.
The method of claim 1,

The information related to the 360-degree VR service,

And at least one of dimension information, projection type information, size information, resolution information, and segmentation information of the 360 degree VR image.
In the 360 degree video decoding apparatus,

The device,

Receiving a bitstream including 360 degree VR (Virtual Reality) image information, decoding information related to a 360 degree VR service from the bitstream, detecting a region of interest based on the information related to the 360 degree VR service, And providing the 360 degree VR image to the user for the ROI.
The method of claim 8,

The 360-degree VR image information includes information about the same image frame having a plurality of resolutions.
The method of claim 8,

The region of interest is obtained by the motion information of the user and the user's input.
The method of claim 8,

The 360-degree VR image information includes at least one of information about an image frame having a first resolution and information about the image frame having a second resolution that is higher than the first resolution.

And a video frame having the second resolution is reconstructed based on information associated with the 360-degree VR service.
The method of claim 11,

The device,

And decoding the segmentation information of the image frame having the second resolution from the information related to the 360-degree VR service and detecting the ROI based on the segmentation information.
The method of claim 12,

The device,

And mapping the image frame having the second resolution to the detected ROI in the image frame having the first resolution, and providing the mapped result image to the user.
The method of claim 8,

The information related to the 360-degree VR service,

And at least one of dimension information, projection type information, size information, resolution information, and segmentation information of the 360 degree VR image.
Receiving 360 degree VR (Virtual Reality) image information;

Recognizing a region of interest of the user; And

Encoding information associated with a 360 degree VR service,

The information related to the 360-degree VR service includes at least one of segmentation information of the 360-degree VR image and the ROI information.
The method of claim 15,

The 360-degree VR image information includes at least one of information about an image frame having a first resolution and information about the image frame having a second resolution that is higher than the first resolution.

The segmentation information is information about regions that are divided so that the image frame having the second resolution has a predetermined size.
The method of claim 15,

The region of interest is obtained by motion information of the user and the user's input.
In the 360 degree video encoding apparatus,

The device,

Receive 360-degree VR (Virtual Reality) image information, recognize the user's region of interest, encode information related to the 360-degree VR service,

And the information related to the 360-degree VR service includes at least one of segmentation information of the 360-degree VR image and the ROI information.
The method of claim 18,

The 360-degree VR image information includes at least one of information about an image frame having a first resolution and information about the image frame having a second resolution that is higher than the first resolution.

The splitting information is information about regions segmented so that the image frame having the second resolution has a predetermined size.
The method of claim 18,

The ROI is obtained by the motion information of the user and the user's input.