KR102575567B1 - System and method for providing three dimensional volumetric content service - Google Patents

Abstract

The present invention relates to a 3D stereoscopic content service providing system, and more particularly, to a 3D stereoscopic content service providing system and method capable of partially providing 3D stereoscopic content with high definition, The content image obtained by the acquisition device is divided into three regions, point clouds for each region are separately extracted, different voxel sizes are determined for each region, and the content image is based on voxel data corresponding to the determined voxel size. It is a technology that processes images into 3D stereoscopic images.

Description

3D stereoscopic content service providing system and method {SYSTEM AND METHOD FOR PROVIDING THREE DIMENSIONAL VOLUMETRIC CONTENT SERVICE}

The present invention relates to a 3D stereoscopic content service providing system, and more particularly, to a 3D stereoscopic content service providing system and method capable of partially providing 3D stereoscopic content having high definition.

In general, 3D content production technology is being utilized for Augmented Reality (AR) services and Virtual Reality (VR) services.

Here, virtual reality uses virtual images that are not real for all of itself (object), background, and environment, whereas augmented reality is a technology that overlays a 3D virtual image on a real image or background to show as one image, Also known as Mixed Reality (MR).

In recent years, companies have been implementing various services that produce 3D stereoscopic content, such as idol singers and athletes, and provide it as augmented reality on a display screen such as a smartphone.

3D stereoscopic content may be produced by photographing an actor through a plurality of cameras and extracting 3D location information and color information from the photographed 2D image.

In this production method, 3D stereoscopic content is generated based on a volumetric pixel (voxel). The smaller the size of the voxel, the more detailed stereoscopic information and color information can be expressed, thereby increasing the clarity of the content.

However, 3D stereoscopic content produced by the existing 3D content production method has a problem in that overall sharpness is not uniform, and the sharpness of some areas is lowered compared to 2D images, resulting in a phenomenon in which they appear crushed.

In addition, since the amount of data of 3D stereoscopic content currently being provided is large, there is a limit to increasing the amount of data in order to increase the clarity of the content.

Therefore, in the future, there is a demand for development of a 3D stereoscopic content service providing system capable of providing 3D stereoscopic content with partially improved sharpness without increasing the amount of data.

A technical problem to be solved by the present invention is to provide 3D stereoscopic content with improved clarity without increasing the amount of data by generating voxel data to reduce the voxel size of a specific part of the content image to be enhanced. It is to provide a 3D stereoscopic content service providing system and method.

The technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the description below. You will be able to.

A 3D stereoscopic content service providing system according to the present invention for achieving the above technical problem includes an image capturing device and a stereoscopic image generating device. The image capture device obtains a content image by photographing a predetermined object. The 3D image generating device processes the obtained content image into a 3D stereoscopic image, recognizes a specific part when the content image is received, and includes a first region corresponding to the specific part among the content video, and other than the specific part. The point clouds for the second area corresponding to the part and the third area located at the boundary between the first area and the second area are separated and extracted, and the first area and the second area are separated based on the point cloud. Different voxel sizes are determined, voxel data corresponding to the determined voxel size is generated, and the content image is processed into a 3D stereoscopic image based on the voxel data.

A method for providing a 3D stereoscopic content service according to the present invention for achieving the above technical problem is a 3D stereoscopic content service providing system including a 3D image generating device that is communicatively connected to an image capturing device and a stereoscopic image reproducing device. A content service providing method comprising the step of acquiring a content image by photographing a predetermined object by the image capture device, recognizing a specific part of the obtained content image by the 3D image generating device, the 3D image generating device comprising: , A point cloud for a first area corresponding to a specific part of the content image, a second area corresponding to a part other than the specific part, and a third area located at the boundary between the first area and the second area. Separating and extracting, by the 3D image generating apparatus, determining different voxel sizes for the first region and the second region based on the point cloud, by the 3D image generating apparatus, corresponding to the determined voxel sizes Generating voxel data for generating a 3D image; encoding data for a 3D stereoscopic image by processing the content image into a 3D stereoscopic image based on the voxel data; the 3D image reproducing device comprising: decoding data of the 3D stereoscopic image and performing rendering; and reproducing the rendered 3D stereoscopic image by the 3D image reproducing apparatus.

A 3D image generating device according to the present invention for achieving the above technical problem is a 3D image generating device that is communicatively connected to an image acquisition device and a 3D image reproducing device, and includes a specific part recognizing unit, a point cloud extracting unit, a voxel size determining unit, It includes a voxel data generating unit and an encoding unit. The specific portion recognizer recognizes a specific portion of the content image obtained from the image capture device. The point cloud extractor extracts a first area corresponding to a specific part of the content image, a second area corresponding to a part other than the specific part, and a third area located at the boundary between the first area and the second area. The point clouds for each are separated and extracted. The voxel size determiner determines different voxel sizes for the first area and the second area based on the point cloud. The voxel data generator generates voxel data corresponding to the determined voxel size. The encoding unit encodes data for a 3D stereoscopic image by processing the content image into a 3D stereoscopic image based on the voxel data.

A method for providing a 3D stereoscopic content service of a stereoscopic image generating apparatus according to the present invention for achieving the above technical problem includes a specific part recognizing unit, a point cloud extracting unit, a voxel size determining unit, a voxel data generating unit, and an encoding unit. A method of providing a 3D stereoscopic content service by a stereoscopic image generating device, wherein the specific part recognizing unit recognizes a specific part among content images obtained from an image capturing device, and the point cloud extractor corresponds to the specific part among the content images. separating and extracting a point cloud for a first area corresponding to a first area, a second area corresponding to a part other than the specific part, and a third area located at a boundary between the first area and the second area, respectively; determining, by a size determination unit, different sizes of voxels for the first and second areas based on the point cloud; generating, by the voxel data generation unit, voxel data corresponding to the determined voxel sizes; and , encoding the data for the 3D stereoscopic image by processing the content image into a 3D stereoscopic image based on the voxel data.

The recording medium according to the present invention for achieving the above technical problem can be read by a computer recording a program for executing the method according to any one of claims 12 to 18 and 31 to 42.

The technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art from the description below. You will be able to.

A system and method for providing a 3D stereoscopic content service according to at least one embodiment of the present invention configured as described above generates voxel data to reduce the size of a voxel of a specific part of a content image to be enhanced, thereby increasing the amount of data. It is possible to provide 3D stereoscopic content with improved sharpness without increasing .

That is, the present invention can improve the sharpness of a local area of content while minimizing an increase in content capacity.

The effects obtainable in the present invention are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood by those skilled in the art from the description below. will be.

1 is a block diagram illustrating a 3D stereoscopic content service providing system according to the present invention.
FIG. 2 is a diagram for explaining the image capture device of FIG. 1 .
3 is a diagram for explaining a process of recognizing a specific part of a content image.
4 is a diagram for explaining a process of extracting a point cloud of a content image.
5 and 6 are diagrams for explaining a process of determining a voxel size of a content image.
7(a) and 7(b) are diagrams showing stereoscopic images corresponding to voxel sizes.
FIG. 8 is a block diagram for explaining the 3D image generating apparatus of FIG. 1 .
9 is a flowchart illustrating a 3D stereoscopic content service providing method of the 3D stereoscopic content service providing system according to the present invention.
10 to 13 are flowcharts for explaining a method for recognizing a specific part of a content video.

In order to fully understand the present invention and the advantages in operation of the present invention and the objects achieved by the practice of the present invention, reference should be made to the accompanying drawings describing exemplary embodiments of the present invention and the contents described in the accompanying drawings.

Hereinafter, the present invention will be described in detail by describing preferred embodiments of the present invention with reference to the accompanying drawings. Like reference numerals in each figure indicate like members.

It may operate by selectively combining one or more of these. In addition, although all of the components may be implemented as a single independent piece of hardware, some or all of the components are selectively combined to perform some or all of the combined functions in one or a plurality of hardware. It may be implemented as a computer program having. Codes and code segments constituting the computer program may be easily inferred by a person skilled in the art. Such a computer program may implement an embodiment of the present invention by being stored in a computer readable storage medium, read and executed by a computer. A storage medium of a computer program may include a magnetic recording medium, an optical recording medium, a carrier wave medium, and the like.

In the description of the embodiment, in the case of being described as being formed in "upper (above) or lower (below)", "before (front) or after (back)" of each component, "upper (above) or lower (below)" (below)” and “before (front) or after (behind)” include both those formed by direct contact between two components or by placing one or more other components between the two components.

In addition, terms such as "include", "comprise" or "have" described above mean that the corresponding component may be inherent unless otherwise stated, excluding other components. It should be construed as being able to further include other components. All terms, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs, unless defined otherwise. Commonly used terms, such as terms defined in a dictionary, should be interpreted as consistent with the meaning in the context of the related art, and unless explicitly defined in the present invention, they are not interpreted in an ideal or excessively formal meaning.

Also, terms such as first, second, A, B, (a), and (b) may be used in describing the components of the present invention. These terms are only used to distinguish the component from other components, and the nature, order, or order of the corresponding component is not limited by the term. When an element is described as being “connected,” “coupled to,” or “connected” to another element, that element is or may be directly connected to the other element, but there is another element between the elements. It will be understood that elements may be “connected”, “coupled” or “connected”.

And, in the description of the present invention, if it is determined that the subject matter of the present invention may be unnecessarily obscured as a matter obvious to those skilled in the art with respect to related known technologies, the detailed description thereof will be omitted.

The 3D stereoscopic content service providing system of the present invention is a system for providing a stereoscopic content service with improved clarity by improving the clarity of volumetric content using AI recognition technology.

1 is a block diagram illustrating a 3D stereoscopic content service providing system according to the present invention.

As shown in FIG. 1 , an image acquisition device 100 for obtaining a content image by photographing a predetermined object, a stereoscopic image generating device 200 for processing the acquired content image into a 3D stereoscopic image, and a 3D stereoscopic image It may include a 3D image reproducing apparatus 300 that reproduces.

Here, the image capture device 100 may include a plurality of cameras, and may obtain a content image by simultaneously photographing an object in different directions through the plurality of cameras.

In addition, when the content image is received, the 3D image generating apparatus 200 recognizes a specific portion of the content image to be enhanced in sharpness, and generates a first region corresponding to the specific portion and a first region corresponding to the specific portion of the content image and a portion other than the specific portion. Each point cloud for the second region is separately extracted, and based on the point cloud, the voxel (volumetric pixel) size of the first region and the second region is determined differently, and corresponds to the determined voxel size. The content image may be processed into a 3D stereoscopic image based on the voxel data.

Here, when recognizing a specific part, the 3D image generating apparatus 200, upon receiving a content image, checks whether information on a specific part to be sharpened is set in advance in the received content image, and identifies the specific part. If information about the image is set in advance, a specific part of the content image may be recognized by analyzing the content image based on the set information.

At this time, the 3D image generating apparatus 200 checks whether information on a specific part to be enhanced is set in advance, and if the information on the specific part is not set in advance, the point cloud for the entire part of the content image can be extracted.

For example, the 3D image generating apparatus 200 may include a storage unit in which a data table including information about a content image and information about a specific part to be enhanced is stored.

In some cases, when recognizing a specific part, upon receiving a content image, the 3D image generating apparatus 200 checks whether there is a user input for selecting a specific part to be sharpened from the received content image, and inputs the user input. If there is, a specific part of the content image may be recognized by analyzing the content image based on the user input.

Here, when checking whether there is a user input, the 3D image generating apparatus 200 may extract a point cloud for an entire portion of the content video if there is no user input.

In another case, when recognizing a specific part, upon receiving a content image, the 3D image generating apparatus 200 checks whether information on a specific part to be sharpened is set in advance in the received content image, and If the information about the part is not set in advance, it is checked whether there is a user input to select a specific part to be sharpened in the received content video. may recognize

Here, the 3D image generating apparatus 200 may extract a point cloud for an entire portion of the content image if information on a specific portion is not set in advance and there is no user input.

Also, when extracting the point cloud, the 3D image generating apparatus 200 may further separate and extract the point cloud for the third area located at the boundary between the first area and the second area.

Here, the 3D image generating apparatus 200 determines the position of the third region based on the position of the first region when dividing the point cloud for the third region, and the point cloud of the third region corresponding to the determined position. can be separated and extracted.

Also, when determining the position of the third region, the 3D image generating apparatus 200 may determine an area surrounding the periphery of the first region as the position of the third region.

Next, when determining the voxel size, the 3D image generating apparatus 200 may determine the voxel size for the first area and the voxel size for the second area differently from each other after removing noise based on the point cloud.

Here, when determining the voxel size, the 3D image generating apparatus 200 may determine a voxel size for the first region smaller than a voxel size for the second region.

The reason is that when the sharpness of the whole part of the content video is increased, the data amount increases and the transmission speed is low. This is because user satisfaction can be increased in terms of speed and image quality because the sharpness of a specific desired part is improved quickly.

In some cases, when determining the voxel size, the 3D image generating apparatus 200 checks whether the point cloud for the third area located between the first area and the second area has been separated and extracted, and When the point cloud for the first, second, and third regions is extracted, different voxel sizes may be determined based on the point cloud.

Here, when determining the voxel size, the 3D image generating apparatus 200 may determine a voxel size of the third region smaller than that of the second region and larger than that of the first region.

The reason is that, when the voxel size value of the third area does not have a voxel size value between the voxel size of the first area and the voxel size of the second area, the boundary line is formed due to the voxel size difference between the first area and the second area. This is because it may cause deterioration in the quality of content images.

For example, when determining the voxel size, the 3D image generating apparatus 200 determines the voxel size of the third region to have an intermediate value between the voxel size value of the first region and the voxel size value of the second region. can

Also, when processing the content image into a 3D stereoscopic image, the stereoscopic image generating apparatus 200 generates voxel data corresponding to the determined voxel size and processes the content image into a 3D stereoscopic image. Data for an image may be encoded and transmitted.

Meanwhile, when reproducing a 3D stereoscopic image, the 3D image reproducing apparatus 200 may reproduce the 3D stereoscopic image by decoding and rendering the data when data for the processed 3D stereoscopic image is received.

For example, the 3D image reproducing apparatus 200 may include a user speaker, such as a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), or a portable PMP (PMP). multimedia player), navigation, slate PC, tablet PC, ultrabook, wearable device (eg, watch type terminal (smartwatch), glass type terminal (smart glass)) , Head Mounted Display (HMD), etc., may be applied to mobile terminals, and may be applied to fixed terminals such as digital TVs, desktop computers, digital signage, and the like.

In this way, the present invention can provide 3D stereoscopic content with improved clarity without increasing the amount of data by generating voxel data so that the voxel size of a specific portion of the content image to be enhanced is reduced.

That is, the present invention can improve the sharpness of a local area of content while minimizing an increase in content capacity.

FIG. 2 is a diagram for explaining the image capture device of FIG. 1 .

As shown in FIG. 2 , the image acquisition device of the present invention may include a plurality of cameras 120 that acquire content images by photographing a predetermined object 110 .

That is, the image capture device may include a plurality of cameras 120 , and the object 110 may be simultaneously photographed in different directions through the plurality of cameras 120 to obtain a content image.

For example, the present invention can produce 3D stereoscopic content by photographing actors through 30 or more cameras in a chroma keyed studio and extracting 3D location information and color information from the photographed 2D images. It is not limited to this.

3 is a diagram for explaining a process of recognizing a specific part of a content image.

As shown in FIG. 3 , the apparatus for generating a 3D image according to the present invention may recognize a specific portion 140 of the content image 130 to be sharpened when a content image is received.

As an embodiment, when receiving the content image 130, the 3D image generating apparatus checks whether information on a specific portion 140 to be enhanced is set in advance in the received content image 130, and If information on the portion 140 is set in advance, a specific portion of the content image may be recognized by analyzing the content image based on the set information.

Here, the 3D image generating device may extract a point cloud for the entire portion of the content image 130 if information on the specific portion 140 is not set in advance.

The 3D image generating apparatus may store a data table including information on the content image 130 and information on a specific portion 140 to be enhanced.

For example, the data table may include information about a plurality of content images 130 classified according to the shape, size, and degree of movement of an object, one or more corresponding to each classified content image 130. It may include information about a specific part 140 of.

For example, information on a plurality of content images includes information on content images 130 corresponding to people, animals, and inanimate objects classified according to the shape of the object, large, medium, It may include information on the content images 130 corresponding to the small size and information on the content images 130 corresponding to the high-speed, medium-speed, low-speed, and motionless fixed images classified according to the motion degree of the object. .

As shown in FIG. 3 , when the content video 130 is a dancer, the face region 142 and the hand region 144 of the entire region of the dancer may be preset as a specific part 140 .

That is, when the content image 130 is a dancer, the information on the content image may include a human object shape, a medium size object size, and a medium speed movement degree. Based on these information, the content image ( 130), a specific part to increase sharpness may be set in advance.

As another embodiment, when recognizing the specific part 140, the apparatus for generating a 3D image of the present invention receives the content video 130 to increase the sharpness of the specific part 140 in the received content video 130. It is checked whether there is a user input for selecting , and if there is a user input, a specific portion 140 of the content image 130 may be recognized by analyzing the content image 130 based on the user input.

Here, when checking whether there is a user input, the 3D image generating apparatus may extract a point cloud for the entire portion of the content image 130 if there is no user input.

In addition, when confirming whether there is a user input, the 3D image generating device creates a question window for inquiring whether a specific part 140 to be sharpened in the content image 130 is selected, and displays the created question window. It is transmitted to a preset user device, and whether there is a user input for selecting a specific part 140 from the user device may be checked.

As another embodiment, when recognizing a specific portion 140, the apparatus for generating a stereoscopic image of the present invention analyzes the received content image 130 when receiving the content image 130, and determines sharpness based on the analysis result. A specific part 130 to be raised may be automatically determined and recognized.

Here, when analyzing the received content image 130, the apparatus for generating a 3D image may divide the content image 130 into a plurality of sub-regions and analyze complexity of an object for each sub-region.

For example, when a specific part 140 to be enhanced is automatically determined, the apparatus for generating a stereoscopic image extracts a sub-region whose complexity is greater than or equal to a reference value from among the content image 130 divided into a plurality of sub-regions based on the analysis result. And, the extracted sub-region can be automatically determined as a specific part 140 to increase sharpness.

That is, when analyzing the received content video 130, the stereoscopic image generating apparatus may analyze the content type of the content video 130.

In addition, when automatically determining a specific portion to be enhanced in sharpness, the stereoscopic image generating apparatus may automatically determine a specific portion to be enhanced in accordance with the content type of the content image based on the analysis result.

For example, if the content type of the content video 130 is dance, the 3D image generating apparatus may be a specific part to increase sharpness such as a face, arm, leg, etc., or if the content type of the content video 130 is soccer. Legs, back numbers, etc. may be specific parts to increase sharpness, and if the content type of the content video 130 is a lecture, blackboard, hands, etc. may be specific parts to increase sharpness.

As such, the present invention may analyze the content type of the content video 130 and automatically determine a specific part corresponding thereto.

As another embodiment, the apparatus for generating a stereoscopic image of the present invention, when recognizing a specific part, upon receiving a content image, checks whether information on a specific part to be enhanced in the received content image is set in advance, , If information on a specific part is not set in advance, it is checked whether there is a user input to select a specific part to be sharpened in the received content video, and if there is a user input, the content video is analyzed based on the user input to You can also recognize a specific part.

Here, the 3D image generating device may extract a point cloud for an entire portion of the content image if information on a specific portion is not previously set and there is no user input.

In addition, when checking whether there is a user input, the 3D image generating apparatus creates a question window for inquiring whether a specific part 140 to be sharpened in the content video 130 is selected if there is no user input, and generates The question window is transmitted to a preset user device, and it is possible to check whether there is a user input for selecting a specific part 140 from the user device.

4 is a diagram for explaining a process of extracting a point cloud of a content image.

As shown in FIG. 4 , the apparatus for generating a stereoscopic image of the present invention includes a point cloud 202 for a first area corresponding to a specific part of a content image and a second area corresponding to a part other than the specific part. By separating each, (X, Y, Z, T) coordinate data corresponding to the point cloud 202 can be extracted.

In some cases, when extracting the point cloud, the 3D image generating apparatus may further separate and extract the point cloud for the third area located at the boundary between the first area and the second area.

The reason for this is that, when determining the voxel size, a difference in voxel size between the first and second areas is reduced by arranging a third area, which is a buffer area, between the first and second areas. This is because it is possible to remove noise, such as a boundary line, and to improve the quality of a content image.

Here, when separating the point cloud for the third region, the 3D image generating apparatus determines the position of the third region based on the position of the first region, separates the point cloud of the third region corresponding to the determined position, can be extracted.

That is, when determining the position of the third region, the apparatus for generating a 3D image may determine a region surrounding the periphery of the first region as the position of the third region.

In some cases, the 3D image generating apparatus may determine the area of the third region based on the area of the first region when determining the position of the third region.

For example, when determining the area of the third region, the apparatus for generating a 3D image may increase or decrease the area of the third region in proportion to a rate of increase or decrease in the area of the first region when the area of the first region increases or decreases.

Here, when determining the area of the third region, the 3D image generating apparatus may determine the area of the third region to have an area smaller than that of the first region.

For example, when determining the area of the third region, the 3D image generating apparatus may determine the area of the third region to have an area of about 10% to about 60% of the area of the first region, but is not limited thereto. don't

5 and 6 are diagrams for explaining a process of determining a voxel size of a content image.

As shown in FIG. 5 , the apparatus for generating a 3D image of the present invention determines different volumetric pixel (voxel) sizes for a first region 520 and a second region 510 based on a point cloud, Voxel data corresponding to the determined voxel size may be generated.

Here, when determining the voxel size, the stereoscopic image generating apparatus may determine the voxel size for the first region 520 and the voxel size for the second region 510 differently after removing noise based on the point cloud. there is.

For example, when determining the voxel size, the 3D image generating apparatus may determine the voxel size of the first region 520 to be smaller than the voxel size of the second region 510 .

The reason is that when the sharpness of the whole part of the content video is increased, the data amount increases and the transmission speed is low. This is because user satisfaction can be increased in terms of speed and image quality because the sharpness of a specific desired part is improved quickly.

For example, when determining the voxel size, the apparatus for generating a 3D image may determine a small voxel size for the first region to have a voxel size that is about 1% to about 60% of the voxel size for the second region.

The reason for this is that as the size of the voxel of the content image decreases, detailed three-dimensional information and color information can be expressed, and thus the sharpness of the content image increases.

Meanwhile, as shown in FIG. 6 , when determining the voxel size, the 3D image generating apparatus 200 for the third area 530 located between the first area 520 and the second area 510 It is checked whether the point cloud is separated and extracted, and when the point cloud for the third region 530 is extracted, the voxel sizes of the first, second, and third regions 520, 510, and 530 are determined based on the point cloud. You may decide differently.

Here, when the 3D image generating apparatus determines the voxel size, the voxel size of the third region 530 is smaller than that of the second region 510 and larger than that of the first region 520. can make a big decision.

The reason is that, when the voxel size value of the third area 530 does not have a voxel size value between the voxel size of the first area 520 and the voxel size of the second area 510, the first area 520 This is because a boundary line may occur between the first area and the second area 510, which may result in deterioration in the quality of the content video.

For example, when determining the voxel size, the 3D image generating apparatus sets the third area 530 to have an intermediate value between the voxel size value for the first area 520 and the voxel size value for the second area 510. It is possible to determine the voxel size for .

7(a) and 7(b) are diagrams showing stereoscopic images corresponding to voxel sizes.

As shown in FIG. 7(a), when a content image is processed and reproduced based on voxel data generated by determining the entire portion of the content image to have the same voxel size, the quality of the 3D image is lowered due to the sharpness of the reproduced content image. can lead to degradation.

For example, as shown in FIG. 7(a) , when about 650,000 content images having a voxel size of about 3 mm are processed and reproduced, the sharpness of the reproduced content image may deteriorate.

In comparison, as shown in FIG. 7( b ), when about 1.5 million content images having a voxel size of about 1.25 mm are processed and reproduced, the clarity of the reproduced content image can be improved.

However, as shown in FIG. 7(b), sharpness may be improved as the voxel size of the entire portion of the content image is smaller, but the reproduction speed may be very slow due to the increase in the amount of data.

Therefore, according to the present invention, by implementing a small voxel size for only a specific portion among all portions of a content image, user satisfaction can be increased by improving the clarity of a reproduced content image while minimizing the amount of data.

For example, according to the present invention, when processing a face region, which is a specific part, from among all parts of a content video to a voxel size of about 1.25 mm, and processing a region other than the specific part to a voxel size of about 3 mm, the data of the content video is processed. It is possible to improve the sharpness of the content image while minimizing the amount.

In some cases, the present invention may arrange a buffer region having a voxel size of about 2 mm between a face region having a voxel size of about 1.25 mm and another region having a voxel size of about 3 mm.

That is, the buffer area may be located around the face area of the content image.

Here, the area of the buffer area may be determined based on the area of the face area.

For example, when the area of the face area increases or decreases, the area of the buffer area may increase or decrease in proportion to the rate of increase or decrease in the area of the face area.

That is, the area of the buffer area may be determined to have a smaller area than the area of the face area.

For example, the area of the buffer area may be determined to have an area of about 10% to about 60% of the area of the face area, but is not limited thereto.

As described above, in the present invention, when processing the buffer area located around the face area of the content image to a voxel size of about 2 mm, the boundary line between the face area having a voxel size of about 1.25 mm and another area having a voxel size of about 3 mm It is possible to improve the quality of the content video by removing the occurrence of noise.

FIG. 8 is a block diagram for explaining the 3D image generating apparatus of FIG. 1 .

As shown in FIG. 8 , the 3D image generating apparatus 200 includes a specific part recognizing unit 210 for recognizing a specific part to be sharpened among content images obtained from an image capture device, and a specific part of the content image. A point cloud extractor 220 that separates and extracts a point cloud for a corresponding first area and a second area corresponding to a part other than a specific part, respectively, and a voxel size for the first area and the second area based on the point cloud. A voxel size determiner 230 that differently determines v, a voxel data generator 240 that generates voxel data corresponding to the determined voxel size, and processes a content image into a 3D stereoscopic image based on the voxel data to create a 3D stereoscopic image. It may include an encoding unit 250 that encodes data for an image.

When receiving the content image, the specific portion recognizer 210 checks whether information on a specific portion to be enhanced is set in advance in the received content image, and if information on the specific portion is set in advance, the set information Based on this, it is possible to recognize a specific part of the content image by analyzing the content image.

Here, the specific part recognizing unit 210 checks whether information on a specific part to be enhanced is set in advance, and if the information on the specific part is not set in advance, the point cloud for the entire part of the content video can be extracted.

In some cases, the 3D image generating apparatus 200 may further include a storage unit in which a data table including information about a content image and information about a specific part to be enhanced is stored.

Here, the data table may include information about a plurality of content images classified according to the shape, size, and degree of motion of the object, and information on one or more specific parts corresponding to each content image classified. can

For example, information about a plurality of content images includes information about content images corresponding to people, animals, and inanimate objects classified according to the shape of an object, and information corresponding to large, medium, and small objects classified according to the size of the object. It may include information on content images and information on content images corresponding to high-speed, medium-speed, low-speed, and motionless fixation classified according to the motion degree of the object.

In addition, the specific part recognizing unit 210 checks whether information on a specific part to be enhanced is set in advance, and if the information on the specific part is not set in advance, whether there is a user input for selecting the specific part. is checked, and if there is a user input, a specific part of the content image may be recognized by analyzing the content image based on the user input.

Here, when checking whether there is a user input, the specific part recognizer 210 may extract a point cloud for the entire part of the content image if there is no user input.

In some cases, when checking whether there is a user input, the specific part recognizer 210 creates a question window asking whether or not to select a specific part to be sharpened in the content image, and displays the generated question window in advance. It is transmitted to the set user device, and it may be checked whether there is a user input for selecting a specific part from the user device.

As another embodiment, the specific part recognizing unit 210, when recognizing a specific part, upon receiving a content image, checks whether there is a user input for selecting a specific part to be sharpened from the received content image, and If there is an input, a specific part of the content image may be recognized by analyzing the content image based on the user input.

Here, when checking whether there is a user input, the specific part recognizer 210 may extract a point cloud for the entire part of the content image if there is no user input.

In some cases, when checking whether there is a user input, the specific part recognizer 210 creates a question window asking whether or not to select a specific part to be sharpened in the content image, and displays the generated question window in advance. It is transmitted to the set user device, and it may be checked whether there is a user input for selecting a specific part from the user device.

As another embodiment, the specific part recognizing unit 210, when recognizing a specific part, analyzes the received content video when a content video is received, and automatically determines a specific part to be enhanced based on the analysis result. Recognizable.

Here, when analyzing the received content image, the specific portion recognizing unit 210 may divide the content image into a plurality of sub-regions and analyze complexity of an object for each sub-region.

Further, when the specific part recognizing unit 210 automatically determines a specific part to be enhanced, based on the analysis result, a sub-region having a complexity greater than or equal to a reference value is extracted from a content image divided into a plurality of sub-regions, and the extracted sub-region is selected. It may be automatically determined as a specific part to increase the sharpness.

Here, the specific part recognizing unit 210 may analyze the content type of the content image when analyzing the received content image.

In addition, the specific part recognizing unit 210 may automatically determine a specific part to be enhanced in accordance with the content type of the content image based on the analysis result when automatically determining a specific part to be enhanced in sharpness.

Next, the point cloud extractor 220 may further separate and extract the point cloud for the third area located at the boundary between the first area and the second area.

Here, the point cloud extractor 220 determines the location of the third area based on the location of the first area when separating the point cloud for the third area, and the point cloud of the third area corresponding to the determined location. can be separated and extracted.

Further, when determining the location of the third area, the point cloud extractor 220 may determine an area surrounding the periphery of the first area as the location of the third area.

In some cases, the point cloud extractor 220 may determine the area of the third area based on the area of the first area when determining the location of the third area.

For example, when determining the area of the third area, the point cloud extractor 220 may increase or decrease the area of the third area in proportion to the ratio of increase or decrease in the area of the first area when the area of the first area increases or decreases.

Here, when determining the area of the third area, the point cloud extractor 220 may determine the area of the third area to have an area smaller than that of the first area.

For example, when determining the area of the third area, the point cloud extractor 220 may determine the area of the third area to have an area that is about 10% to about 60% of the area of the first area.

Subsequently, the voxel size determiner 230 may determine a different voxel size for the first region and a different voxel size for the second region after removing noise based on the point cloud.

That is, the voxel size determiner 230 may determine a voxel size for the first area smaller than a voxel size for the second area.

For example, the voxel size determiner 230 may determine a small voxel size for the first region to have a voxel size that is about 1% to about 60% of the voxel size for the second region.

Further, the voxel size determiner 230 checks whether the point cloud for the third area located between the first area and the second area has been separated and extracted, and if the point cloud for the third area is extracted, the point cloud Based on , voxel sizes for the first, second, and third regions may be determined differently.

Here, the voxel size determiner 230 may determine a voxel size of the third region smaller than that of the second region and larger than that of the first region.

For example, the voxel size determiner 230 may determine the voxel size of the third area to have an intermediate value between the voxel size value of the first area and the voxel size value of the second area.

9 is a flowchart for explaining a 3D stereoscopic content service providing method of a 3D stereoscopic content service providing system according to the present invention, and FIGS. 10 to 13 are flowcharts for explaining a method for recognizing a specific part of a content image.

As shown in FIG. 9 , according to the present invention, a content image may be acquired by photographing a predetermined object (S10).

Further, the present invention may recognize a specific part to be enhanced among the obtained content images (S20).

As a first embodiment, as shown in FIG. 10, in the step of recognizing a specific part (S20), the present invention checks whether information on a specific part to be enhanced in the acquired content image is set in advance ( S22), if information on a specific part is set in advance, the specific part of the content video can be recognized by analyzing the content video based on the set information (S26).

Here, in the present invention, if information on a specific part is not set in advance, a point cloud for the entire part of the content video can be extracted (S28).

In some cases, as a second embodiment, the present invention, as shown in FIG. 11, in the step of recognizing a specific part (S20), whether information on a specific part to be enhanced in the acquired content image is set in advance. (S22), and if the information on a specific part is not set in advance, it is checked whether there is a user input for selecting a specific part (S24), and if there is a user input, the content video is analyzed based on the user input and the content video is analyzed. A specific part can be recognized (S26).

Here, in the present invention, when checking whether information on a specific part is set in advance, if the information on the specific part is set in advance, the specific part of the content image can be recognized by analyzing the content image based on the set information ( S26).

Further, in the present invention, if there is no user input, the point cloud for the entire portion of the content video can be extracted (S28).

In addition, the present invention, when checking whether there is a user input, if information on a specific part is not set in advance, a question window is created to inquire whether a specific part to be sharpened in the content video is selected, and the generated A question window may be transmitted to a preset user device, and it may be checked whether there is a user input for selecting a specific part from the user device.

As a third embodiment, as shown in FIG. 12, in the step of recognizing a specific part (S20), the present invention checks whether there is a user input for selecting a specific part to be sharpened in the acquired content image (S21 ), and if there is a user input, the content image is analyzed based on the user input (S23), and a specific part of the content image can be recognized based on the analyzed content image (S26).

Here, in the present invention, if there is no user input, the point cloud for the entire portion of the content video can be extracted (S28).

In addition, the present invention, when checking whether there is a user input, creates a question window for inquiring whether to select a specific part to increase the clarity of the content image, transmits the generated question window to a preset user device, It may be checked whether there is a user input for selecting a specific part from the user device.

As a fourth embodiment, as shown in FIG. 13, in the step of recognizing a specific part (S20), the acquired content video is analyzed (S23), and a specific part to be sharpened is automatically determined based on the analysis result (S25). ), a specific part of the content image can be recognized according to the automatic determination (S26).

Here, in the present invention, when analyzing the acquired content image, the content image may be divided into a plurality of sub-regions and complexity of an object for each sub-region may be analyzed.

In addition, the present invention, when automatically determining a specific part to increase the sharpness, based on the analysis result, extracts a sub-region having a complexity greater than or equal to a reference value among a content image divided into a plurality of sub-regions, and enhances the sharpness of the extracted sub-region. It can be automatically determined as a specific part to do.

The reason for this is that the sharpness of a high-complexity part of the content image may be lowered and a noise phenomenon may occur, compared to a low-complexity part of the content image.

Therefore, when a high-complexity part of the content image is recognized as a specific part and the voxel size is reduced, the quality of the content image can be improved.

In some cases, the present invention may analyze the content type of the content image when analyzing the acquired content image.

The reason for this is that the quality of the content image can be improved by effectively recognizing specific parts to be sharpened appropriately for the type of content and processing them to reduce the size of the voxel.

For example, if the content type is sports related to soccer, specific parts such as a soccer player's legs and a soccer ball are recognized in the content video, and if the content type is education related to lectures, specific parts such as the instructor's hand and blackboard are recognized in the content video. can do.

Further, in the present invention, when automatically determining a specific part to increase sharpness, based on the analysis result, it is possible to automatically determine a specific part to increase sharpness corresponding to a content type of a content image.

Next, according to the present invention, a point cloud for a first region corresponding to a specific part of the content image and a second region corresponding to a part other than the specific part may be separated and extracted (S30 and S40).

In some cases, the present invention may further separate and extract the point cloud for the third area located at the boundary between the first area and the second area.

Here, according to the present invention, the location of the third area may be determined based on the location of the first area, and a point cloud of the third area corresponding to the determined location may be separated and extracted.

For example, when determining the position of the third region, an area surrounding the first region may be determined as the position of the third region.

As another example, when the location of the third region is determined, the area of the third region may be determined based on the area of the first region.

Here, in the present invention, when determining the area of the third region, if the area of the first region increases or decreases, the area of the third region may increase or decrease in proportion to the ratio of the area increase or decrease of the first region.

That is, according to the present invention, the area of the third region may be determined to have an area smaller than that of the first region.

The reason is that if the area of the third area is too large, the amount of data increases, and if the area of the second area is too small, noise such as a boundary between the first and second areas may not be removed.

For example, the present invention may determine the area of the third region to have an area that is about 10% to about 60% of the area of the first region.

Next, according to the present invention, voxel sizes for the first area and the second area may be determined differently based on the point cloud (S50 and S60).

Here, in the present invention, after noise is removed based on the point cloud, the voxel size for the first area and the voxel size for the second area may be determined differently from each other.

That is, according to the present invention, the voxel size of the first region may be smaller than the voxel size of the second region.

The reason is that when the sharpness of the whole part of the content video is increased, the data amount increases and the transmission speed is low. This is because user satisfaction can be increased in terms of speed and image quality because the sharpness of a specific desired part is improved quickly.

For example, in the present invention, the voxel size of the first region may be determined to be small so as to have a voxel size that is about 1% to about 60% of the voxel size of the second region.

In some cases, when the voxel size is determined, the present invention checks whether the point cloud for the third region located between the first region and the second region has been separated and extracted, and the point cloud for the third region is extracted. In this case, the voxel sizes of the first, second, and third regions may be differently determined based on the point cloud.

Here, according to the present invention, the voxel size of the third region may be smaller than that of the second region and larger than that of the first region.

In some cases, when determining the voxel size, the 3D image generating apparatus 200 checks whether the point cloud for the third area located between the first area and the second area has been separated and extracted, and When the point cloud for the first, second, and third regions is extracted, different voxel sizes may be determined based on the point cloud.

Here, when determining the voxel size, the 3D image generating apparatus 200 may determine a voxel size of the third region smaller than that of the second region and larger than that of the first region.

The reason is that, when the voxel size value of the third area does not have a voxel size value between the voxel size of the first area and the voxel size of the second area, the boundary line is formed due to the voxel size difference between the first area and the second area. This is because it may cause deterioration in the quality of content images.

Therefore, according to the present invention, the voxel size of the third region may be determined to have an intermediate value between the voxel size value of the first region and the voxel size value of the second region.

And, according to the present invention, voxel data corresponding to the determined voxel size may be generated.

Next, according to the present invention, data for the 3D stereoscopic image may be encoded by processing the content image into a 3D stereoscopic image based on the voxel data (S70).

Next, in the present invention, data for a 3D stereoscopic image may be decoded and rendered (S80).

Also, according to the present invention, the rendered 3D stereoscopic image can be reproduced (S90).

In this way, the present invention can provide 3D stereoscopic content with improved clarity without increasing the amount of data by generating voxel data so that the voxel size of a specific portion of the content image to be enhanced is reduced.

That is, the present invention can improve the sharpness of a local area of content while minimizing an increase in content capacity.

Meanwhile, an embodiment of the present invention may further provide a computer readable program for executing any one of the 3D stereoscopic content service providing methods and a recording medium on which the program is recorded.

Various embodiments described herein may be implemented in a recording medium readable by a computer or a device similar thereto using, for example, software, hardware, or a combination thereof.

According to software implementation, embodiments such as procedures or functions may be implemented together with a separate software module to perform at least one function or operation. The software code may be implemented by a software application written in any suitable programming language.

The method according to the above-described embodiment may be produced as a program to be executed on a computer and stored in a computer-readable recording medium. Examples of the computer-readable recording medium include ROM, RAM, CD-ROM, and magnetic tape. , floppy disks, and those implemented in the form of optical data storage devices are also included.

The computer-readable recording medium is distributed to computer systems connected through a network, so that computer-readable codes can be stored and executed in a distributed manner. In addition, functional programs, codes, and code segments for implementing the above-described method can be easily inferred by programmers in the technical field to which the embodiment belongs.

It is apparent to those skilled in the art that the present invention can be embodied in other specific forms without departing from the spirit and essential characteristics of the present invention.

Accordingly, the above detailed description should not be construed as limiting in all respects and should be considered illustrative. The scope of the present invention should be determined by reasonable interpretation of the appended claims, and all changes within the equivalent scope of the present invention are included in the scope of the present invention.

100: image acquisition device
200: stereoscopic image generating device
210: specific part recognition unit
220: point cloud extraction unit
230: voxel size determining unit
240: voxel data generator
250: encoding unit
300: 3D image playback device

Claims (43)

an image acquisition device that obtains a content image by photographing a predetermined object; and
A stereoscopic image generating device for processing the obtained content image into a three-dimensional stereoscopic image;
The three-dimensional image generating device,
When the content video is received, a specific part is recognized, a first region corresponding to the specific part of the content video, a second region corresponding to a part other than the specific part, and a boundary between the first region and the second region. The point clouds for the third area located at are separated and extracted, the voxel sizes for the first area and the second area are determined differently based on the point cloud, and the voxel size for the third area is determined. A size between the voxel size of the first area and the voxel size of the second area is determined, voxel data corresponding to the determined voxel size is generated, and the content image is processed into a 3D stereoscopic image based on the voxel data. 3D stereoscopic content service providing system. The method of claim 1, wherein the image acquisition device,
Including multiple cameras;
A system for providing a 3D stereoscopic content service, characterized in that the content images are obtained by simultaneously photographing the object in different directions through the plurality of cameras. The method of claim 1, wherein the 3D image generating device comprises:
When recognizing the specific part, when the content video is received, it is checked whether information on the specific part is set in advance in the received content video, and if the information on the specific part is set in advance, the set information A system for providing a 3D stereoscopic content service, characterized in that for recognizing a specific part of the content image by analyzing the content image based on the basis. The method of claim 3, wherein the stereoscopic image generating device,
When checking whether the information on the specific part is set in advance, if the information on the specific part is not set in advance, a point cloud for the entire part of the content video is extracted. system. The method of claim 1, wherein the 3D image generating device comprises:
When the voxel size is determined, noise is removed based on the point cloud, and then a voxel size for the first area and a voxel size for the second area are determined differently from each other. system. The method of claim 1, wherein the 3D image generating device comprises:
The 3D stereoscopic content service providing system of claim 1 , wherein when the voxel size is determined, a voxel size for the first area is smaller than a voxel size for the second area. The method of claim 1, wherein the 3D image generating device comprises:
When the voxel size is determined, it is checked whether the point cloud for the third area is separated and extracted, and if the point cloud for the third area is extracted, the first, second, and third areas are extracted based on the point cloud. A system for providing a 3D stereoscopic content service, characterized in that the voxel size for is determined differently. The method of claim 7, wherein the stereoscopic image generating device,
When the voxel size is determined, a voxel size for the third area is determined to be smaller than a voxel size for the second area and larger than a voxel size for the first area. system. The method of claim 1, wherein the 3D image generating device comprises:
When processing the content image into a 3D stereoscopic image, voxel data corresponding to the determined voxel size is generated to process the content image into a 3D stereoscopic image, and data for the processed 3D stereoscopic image is encoded. A system for providing a three-dimensional stereoscopic content service characterized by transmitting. According to claim 1,
The 3D stereoscopic content service providing system further comprising a stereoscopic image reproducing device for reproducing the 3D stereoscopic image. The method of claim 10, wherein the stereoscopic image reproducing apparatus,
When the 3D stereoscopic image is reproduced, when the processed 3D stereoscopic image data is received, the 3D stereoscopic content service providing system reproduces the 3D stereoscopic image by decoding and rendering the data. A 3D stereoscopic content service providing method of a 3D stereoscopic content service providing system including a stereoscopic image generating device that is communicatively connected to an image capture device and a stereoscopic image reproducing device, the method comprising:
obtaining, by the image capture device, a content image by photographing a predetermined object;
Recognizing, by the 3D image generating device, a specific part of the obtained content image;
The stereoscopic image generating apparatus includes a first region corresponding to a specific part of the content image, a second region corresponding to a part other than the specific part, and a third region located at a boundary between the first region and the second region. separating and extracting point clouds for each region;
The 3D image generating apparatus determines different voxel sizes for the first area and the second area based on the point cloud, and sets the voxel size for the third area to the first area voxel size and the second area. determining a size between region voxel sizes;
generating, by the 3D image generating apparatus, voxel data corresponding to the determined voxel size;
encoding the data for the 3D stereoscopic image by processing the content image into a 3D stereoscopic image based on the voxel data, by the stereoscopic image generating device;
decoding and rendering data of the 3D stereoscopic image by the 3D image reproducing apparatus; and
The 3D stereoscopic content service providing method comprising the step of reproducing, by the stereoscopic image reproducing apparatus, the 3D stereoscopic image on which the rendering has been performed. The method of claim 12, wherein recognizing the specific part comprises:
It is checked whether information on the specific part is set in advance in the obtained content video, and if the information on the specific part is set in advance, the content video is analyzed based on the set information to obtain a specific part of the content video. A method of providing a 3D stereoscopic content service, characterized in that for recognizing. The method of claim 13, wherein the step of checking whether information on the specific part is set in advance,
A method for providing a 3D stereoscopic content service, characterized in that, if the information on the specific portion is not set in advance, a point cloud for the entire portion of the content video is extracted. 13. The method of claim 12, wherein determining the voxel size comprises:
and determining a different voxel size for the first area and a voxel size for the second area after noise is removed based on the point cloud. 13. The method of claim 12, wherein determining the voxel size comprises:
The 3D stereoscopic content service providing method of claim 1 , wherein a voxel size of the first area is smaller than a voxel size of the second area. 13. The method of claim 12, wherein determining the voxel size comprises:
It is checked whether the point cloud for the third area is separated and extracted, and when the point cloud for the third area is extracted, the voxel sizes for the first, second, and third areas are set differently based on the point cloud. A method of providing a 3D stereoscopic content service, characterized in that determining. The method of claim 17, wherein determining the voxel size comprises:
and determining a voxel size of the third area smaller than a voxel size of the second area and larger than a voxel size of the first area. A stereoscopic image generating device that is communicatively connected to an image capture device and a stereoscopic image reproducing device,
a specific part recognizing unit recognizing a specific part among the content images obtained from the image capture device;
A point cloud for a first area corresponding to a specific part of the content image, a second area corresponding to a part other than the specific part, and a third area located at the boundary between the first area and the second area, respectively. a point cloud extraction unit that separates and extracts;
Based on the point cloud, different voxel sizes are determined for the first area and the second area, and the voxel size for the third area is set to a size between the voxel size of the first area and the voxel size of the second area. a voxel size determining unit that determines a voxel size;
a voxel data generating unit generating voxel data corresponding to the determined voxel size; and
and an encoding unit processing the content image into a 3D stereoscopic image based on the voxel data and encoding data for the 3D stereoscopic image. The method of claim 19, wherein the specific part recognition unit,
When the content video is received, it is checked whether the information on the specific part is set in advance in the received content video, and if the information on the specific part is set in advance, the content video is analyzed based on the set information. An apparatus for generating a stereoscopic image, characterized in that for recognizing a specific part of a content image. The method of claim 20, wherein the specific part recognition unit,
When checking whether the information on the specific part is set in advance, if the information on the specific part is not set in advance, a point cloud for the entire part of the content video is extracted. According to claim 19,
and a storage unit storing a data table including information on the content image and information on the specific part. The method of claim 19, wherein the specific part recognition unit,
When recognizing the specific part, if the content video is received, it is checked whether there is a user input for selecting a specific part from the received content video, and if there is a user input, the content video is analyzed based on the user input to An apparatus for generating a stereoscopic image, characterized in that for recognizing a specific part of a content image. The method of claim 23, wherein the specific part recognition unit,
When checking whether there is the user input, if there is no user input, a point cloud for an entire part of the content video is extracted. The method of claim 24, wherein the point cloud extractor,
When separating the point cloud for the third area, the location of the third area is determined based on the location of the first area, and the point cloud of the third area corresponding to the determined location is separated and extracted. A three-dimensional image generating device. The method of claim 19, wherein the voxel size determiner comprises:
After noise is removed based on the point cloud, a voxel size for the first region and a voxel size for the second region are differently determined. The method of claim 19, wherein the voxel size determiner comprises:
The stereoscopic image generating apparatus of claim 1 , wherein a voxel size of the first region is smaller than a voxel size of the second region. The method of claim 19, wherein the voxel size determiner comprises:
It is checked whether the point cloud for the third area is separated and extracted, and when the point cloud for the third area is extracted, the voxel sizes for the first, second, and third areas are set differently based on the point cloud. A stereoscopic image generating device, characterized in that for determining. 29. The method of claim 28, wherein the voxel size determiner comprises:
and determining a voxel size of the third area smaller than a voxel size of the second area and larger than a voxel size of the first area. The method of claim 29, wherein the voxel size determiner comprises:
and determining a voxel size of the third region to have an intermediate value between a voxel size value of the first region and a voxel size value of the second region. A 3D stereoscopic content service providing method of a stereoscopic image generating apparatus including a specific part recognizing unit, a point cloud extracting unit, a voxel size determining unit, a voxel data generating unit, and an encoding unit, the method comprising:
Recognizing, by the specific portion recognizing unit, a specific portion of content images obtained from an image capture device;
The point cloud extractor includes a first area corresponding to a specific part of the content image, a second area corresponding to a part other than the specific part, and a third area located at the boundary between the first area and the second area. separating and extracting point clouds for each;
The voxel size determiner determines different voxel sizes for the first area and the second area based on the point cloud, and sets the voxel size for the third area to the first area voxel size and the second area. as the size between the voxel sizes deciding;
generating, by the voxel data generation unit, voxel data corresponding to the determined voxel size; and
and processing, by the encoding unit, the content image into a 3D stereoscopic image based on the voxel data and encoding data for the 3D stereoscopic image. . 32. The method of claim 31, wherein recognizing the specific part comprises:
It is checked whether information on the specific part is set in advance in the obtained content video, and if the information on the specific part is set in advance, the content video is analyzed based on the set information to obtain a specific part of the content video. A method of providing a 3D stereoscopic content service by a stereoscopic image generating device, characterized in that for recognizing. The method of claim 32, wherein the step of checking whether information on the specific part is set in advance,
A method for providing a 3D stereoscopic content service of a stereoscopic image generating apparatus, characterized in that, if the information on the specific portion is not set in advance, a point cloud for the entire portion of the content image is extracted. 32. The method of claim 31, wherein recognizing the specific part comprises:
It is confirmed whether there is a user input for selecting a specific part from the obtained content image, and if there is a user input, the content image is analyzed based on the user input to recognize a specific part of the content image. A method for providing 3D stereoscopic content service from a generating device. 35. The method of claim 34, wherein checking whether there is a user input comprises:
A method of providing a 3D stereoscopic content service of a stereoscopic image generating device, characterized in that, if there is no user input, a point cloud for an entire portion of the content image is extracted. 32. The method of claim 31, wherein separating the point cloud for the third area comprises:
3D stereoscopic content service provided by a stereoscopic image generating device characterized in that the position of the third region is determined based on the position of the first region, and a point cloud of the third region corresponding to the determined position is separated and extracted. method. 37. The method of claim 36, wherein determining the location of the third area comprises:
The method of providing a 3D stereoscopic contents service by a stereoscopic image generating device, characterized in that an area surrounding the periphery of the first area is determined as the position of the third area. 32. The method of claim 31, wherein determining the voxel size comprises:
3. The method of claim 1 , wherein, after noise is removed based on the point cloud, a voxel size for the first region and a voxel size for the second region are differently determined. 32. The method of claim 31, wherein determining the voxel size comprises:
The method of providing a 3D stereoscopic content service by a stereoscopic image generating apparatus, wherein the size of the voxels of the first area is smaller than the size of the voxels of the second area. 32. The method of claim 31, wherein determining the voxel size comprises:
It is checked whether the point cloud for the third area located between the first area and the second area is separated and extracted, and if the point cloud for the third area is extracted, the first and second areas are extracted based on the point cloud. , A method of providing a 3D stereoscopic content service by a stereoscopic image generating device, characterized in that the voxel size for the third region is determined differently. 41. The method of claim 40, wherein determining the voxel size comprises:
and determining a voxel size of the third area smaller than a voxel size of the second area and larger than a voxel size of the first area. 42. The method of claim 41, wherein determining the voxel size comprises:
The 3D stereoscopic content service of the stereoscopic image generating device characterized in that the size of the voxels of the third area is determined to have a median value between the size of the voxels of the first area and the size of the voxels of the second area. How to provide. A computer-readable recording medium recording a program for executing the method according to any one of claims 12 to 18 and 31 to 42.