KR20210126318A - System and method for providing three dimensional volumetric content service - Google Patents

Abstract

The present invention relates to a system and a method for providing a three-dimensional volumetric content service which can provide three-dimensional volumetric content having partially high clarity. The system for providing a three-dimensional volumetric content service comprises: an image acquisition device photographing a prescribed object to acquire a content image; and a volumetric image generation device processing the acquired content image into a three-dimensional volumetric image. The volumetric image generation device recognizes a specific part in the content image when the content image is received, separates point clouds for a first region corresponding to the specific part in the content image and a second region corresponding to the part other than the specific part to extract the point clouds, differently determines voxel sizes for the first region and the second region based on the point clouds, and generates voxel data corresponding to the determined voxel sizes to process the content image into a three-dimensional volumetric image based on the voxel data.

Description

System and method for providing 3D stereoscopic content service {SYSTEM AND METHOD FOR PROVIDING THREE DIMENSIONAL VOLUMETRIC CONTENT SERVICE}

The present invention relates to a 3D stereoscopic content service providing system, and more particularly, to a 3D stereoscopic content service providing system and method capable of partially providing 3D stereoscopic content with high definition.

In general, 3D stereoscopic content production technology is being utilized for an augmented reality (AR) service and a virtual reality (VR) service.

Here, while virtual reality uses a virtual image rather than a real one for both itself (object), the background, and the environment, augmented reality is a technology that shows a three-dimensional virtual image as a single image by overlaying a real image or background, Also known as Mixed Reality (MR).

In recent years, various services have been implemented in companies, such as idol singers and athletes, by producing 3D stereoscopic contents and providing them in augmented reality on a display screen such as a smartphone.

The 3D stereoscopic content may be produced by photographing an actor through a plurality of cameras and extracting 3D location information and color information from the captured 2D image.

In this production method, 3D stereoscopic content is generated based on a voxel (volumetric pixel). As the size of a voxel is smaller, detailed stereoscopic information and color information can be expressed, thereby increasing the clarity of the content.

However, the 3D stereoscopic content produced by the existing 3D stereoscopic content production method has a problem in that the overall clarity is not uniform, and the sharpness of some areas is lowered compared to the 2D image, so that the phenomenon appears squashed.

In addition, since the 3D stereoscopic content currently provided has a large amount of data, there is a limit in increasing the amount of data in order to increase the clarity of the content.

Accordingly, in the future, there is a demand for a system for providing a 3D stereoscopic content service capable of providing 3D stereoscopic content with partially improved low definition without increasing the amount of data.

According to the present invention, 3D stereoscopic content capable of providing 3D stereoscopic content with improved sharpness without increasing the amount of data by generating voxel data to reduce the voxel size of a specific portion of a content image to increase sharpness To provide a service providing system and method.

The technical problems to be achieved in the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the following description. will be able

In order to solve the above technical problem, a system for providing a three-dimensional stereoscopic content service according to an embodiment of the present invention includes an image acquisition device for acquiring a content image by photographing a predetermined object, and a three-dimensional stereoscopic image for the obtained content image. and a stereoscopic image generating device for processing into an image, wherein the stereoscopic image generating device recognizes a specific part of the content image when the content image is received, and places the content image in a first area corresponding to the specific part and a part other than the specific part. Point clouds for the corresponding second region are separated and extracted, voxel sizes of the first region and the second region are determined differently based on the point cloud, and voxel data corresponding to the determined voxel size is generated to generate voxel data Based on this, the content image can be processed into a 3D stereoscopic image.

In addition, the method for providing a 3D stereoscopic content service according to an embodiment of the present invention provides a 3D stereoscopic content of a 3D stereoscopic contents service providing system including an image acquisition device and a stereoscopic image generating device communicatively connected to a stereoscopic image reproducing device A service providing method, comprising the steps of: acquiring, by an image acquisition device, a content image by photographing a predetermined object; recognizing, by the stereoscopic image generating device, a specific part of the acquired content image; separating and extracting point clouds for a first region corresponding to , and a second region corresponding to a portion other than a specific portion, respectively; determining different sizes; generating, by the stereoscopic image generating apparatus, voxel data corresponding to the determined voxel size; The steps of encoding data on an image, decoding and rendering data on the 3D stereoscopic image by a stereoscopic image reproducing apparatus, and reproducing the rendered 3D stereoscopic image by the stereoscopic image reproducing apparatus may include.

In addition, the stereoscopic image generating apparatus according to an embodiment of the present invention is a stereoscopic image generating apparatus communicatively connected to the image acquiring apparatus and the stereoscopic image reproducing apparatus, and a specific part for recognizing a specific part of a content image acquired from the image acquiring apparatus A recognition unit, a point cloud extraction unit that separates and extracts point clouds for the first area corresponding to a specific part of the content image and the second area corresponding to a part other than the specific part, respectively, and the first area based on the point cloud and a voxel size determiner that determines different voxel sizes for the second region, a voxel data generator that generates voxel data corresponding to the determined voxel size, and processes the content image into a 3D stereoscopic image based on the voxel data Thus, it may include an encoding unit that encodes data for the 3D stereoscopic image.

In addition, the method of providing a 3D stereoscopic content service by the stereoscopic image generating apparatus according to an embodiment of the present invention includes a specific part recognizer, a point cloud extractor, a voxel size determiner, a voxel data generator, and an encoding unit. A method for providing a 3D stereoscopic content service of an image generating device, the method comprising: recognizing, by a specific part recognizing unit, a specific part of a content image acquired from an image acquisition device; Separating and extracting point clouds for a second region corresponding to a portion other than a specific portion, and determining, by a voxel size determiner, different voxel sizes for the first region and the second region based on the point cloud; , generating, by a voxel data generator, voxel data corresponding to the determined voxel size, and encoding, by an encoding unit, data on the 3D stereoscopic image by processing the content image into a 3D stereoscopic image based on the voxel data. can

Meanwhile, an embodiment of the present invention may further provide a computer-readable program for executing any one of the three-dimensional stereoscopic content service providing methods and a recording medium in which the program is recorded.

The system and method for providing a three-dimensional stereoscopic content service according to at least one embodiment of the present invention configured as described above generates voxel data such that the voxel size of a specific part of a content image for which clarity is to be increased is small, thereby providing a data amount. It is possible to provide 3D stereoscopic content with improved sharpness without increasing .

That is, according to the present invention, it is possible to improve the sharpness of a local area of content while minimizing an increase in content capacity.

The effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned may be clearly understood by those of ordinary skill in the art to which the present invention belongs from the following description. will be.

1 is a block diagram illustrating a system for providing a 3D stereoscopic content service according to the present invention.
FIG. 2 is a diagram for explaining the image acquisition device of FIG. 1 .
3 is a diagram for explaining a process of recognizing a specific part of a content image.
4 is a diagram for explaining a process of extracting a point cloud of a content image.
5 and 6 are diagrams for explaining a process of determining a voxel size of a content image.
7(a) and 7(b) are diagrams illustrating a stereoscopic image corresponding to a voxel size.
FIG. 8 is a block diagram illustrating the apparatus for generating a stereoscopic image of FIG. 1 .
9 is a flowchart illustrating a 3D stereoscopic content service providing method of the 3D stereoscopic content service providing system according to the present invention.
10 to 13 are flowcharts for explaining a method for recognizing a specific part of a content image.

Hereinafter, an apparatus and various methods to which embodiments of the present invention are applied will be described in more detail with reference to the drawings. The suffixes "module" and "part" for the components used in the following description are given or mixed in consideration of only the ease of writing the specification, and do not have a meaning or role distinct from each other by themselves.

In the above, even though all the components constituting the embodiment of the present invention are described as being combined or operating in combination, the present invention is not necessarily limited to this embodiment. That is, within the scope of the object of the present invention, all the components may operate by selectively combining one or more. In addition, all of the components may be implemented as one independent hardware, but some or all of the components are selectively combined to perform some or all functions of the combined components in one or a plurality of hardware program modules It may be implemented as a computer program having Codes and code segments constituting the computer program can be easily deduced by those skilled in the art of the present invention. Such a computer program is stored in a computer readable storage medium (Computer Readable Media), read and executed by the computer, thereby implementing the embodiment of the present invention. The storage medium of the computer program may include a magnetic recording medium, an optical recording medium, a carrier wave medium, and the like.

In the description of the embodiment, in the case where it is described as being formed in "above (above) or below (below)", "before (front) or after (rear)" of each component, "above (above) or below" “(below)” and “before (front) or after (behind)” include both components formed by direct contact with each other or one or more other components disposed between the two components.

In addition, terms such as "comprises", "comprises" or "have" described above mean that the corresponding component may be embedded, unless otherwise stated, so that other components are excluded. Rather, it should be construed as being able to further include other components. All terms, including technical and scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs, unless otherwise defined. Terms commonly used, such as those defined in the dictionary, should be interpreted as being consistent with the meaning of the context of the related art, and are not interpreted in an ideal or excessively formal meaning unless explicitly defined in the present invention.

In addition, in describing the components of the present invention, terms such as first, second, A, B, (a), (b), etc. may be used. These terms are only for distinguishing the components from other components, and the essence, order, or order of the components are not limited by the terms. When it is described that a component is “connected”, “coupled” or “connected” to another component, the component may be directly connected or connected to the other component, but another component is between each component. It should be understood that elements may be “connected,” “coupled,” or “connected.”

In the description of the present invention, if it is determined that the subject matter of the present invention may be unnecessarily obscured as it is obvious to those skilled in the art with respect to related known techniques, the detailed description thereof will be omitted.

The system for providing a three-dimensional three-dimensional content service of the present invention is a system for providing a three-dimensional content service with improved clarity by improving the clarity of volumetric content using AI recognition technology.

1 is a block diagram illustrating a system for providing a 3D stereoscopic content service according to the present invention.

As shown in FIG. 1 , an image acquisition device 100 for acquiring a content image by photographing a predetermined object, a stereoscopic image generating device 200 for processing the acquired content image into a 3D stereoscopic image, and a 3D stereoscopic image It may include a stereoscopic image reproducing apparatus 300 that reproduces the

Here, the image acquisition apparatus 100 may include a plurality of cameras, and may acquire a content image by simultaneously photographing an object in different directions through the plurality of cameras.

Then, when the content image is received, the stereoscopic image generating apparatus 200 recognizes a specific part of the content image for which the sharpness is to be increased, and a first area corresponding to the specific part of the content image and a portion other than the specific part of the content image. Point clouds for the second region are separately extracted, and voxel (volumetric pixel) sizes for the first region and the second region are determined differently based on the point cloud, and corresponding to the determined voxel size. voxel data can be generated and the content image can be processed into a 3D stereoscopic image based on the voxel data.

Here, when recognizing a specific part, the stereoscopic image generating apparatus 200 checks whether information on a specific part for which clarity is to be increased in the received content image is set in advance when a content image is received, If information about the content is preset, a specific part of the content image may be recognized by analyzing the content image based on the set information.

At this time, when the stereoscopic image generating apparatus 200 determines whether information on a specific part for which the sharpness is to be increased is preset, if the information on the specific part is not preset, the point cloud for the entire part of the content image can be extracted.

For example, the stereoscopic image generating apparatus 200 may include a storage unit in which a data table including information on a content image and information on a specific part to be sharpened is stored.

In some cases, when recognizing a specific part, the stereoscopic image generating apparatus 200 checks whether there is a user input for selecting a specific part for which clarity is to be increased from the received content image upon receiving the content image, and the user input If there is, it is possible to recognize a specific part of the content image by analyzing the content image based on the user input.

Here, when checking whether there is a user input, the stereoscopic image generating apparatus 200 may extract a point cloud for the entire portion of the content image if there is no user input.

As another case, when the stereoscopic image generating apparatus 200 recognizes a specific part, when receiving a content image, it is checked whether information on a specific part whose clarity is to be increased in the received content image is preset, and If the information on the part is not set in advance, it is checked whether there is a user input to select a specific part to increase the sharpness of the received content image. may be recognized.

Here, the stereoscopic image generating apparatus 200 may extract a point cloud for the entire part of the content image when information on the specific part is not preset and there is no user input.

Also, when extracting the point cloud, the stereoscopic image generating apparatus 200 may further separate and extract the point cloud for the third region positioned at the boundary between the first region and the second region.

Here, the stereoscopic image generating apparatus 200 determines the position of the third region based on the position of the first region when the point cloud for the third region is separated, and the point cloud of the third region corresponding to the determined position. can be isolated and extracted.

Also, when determining the position of the third region, the stereoscopic image generating apparatus 200 may determine a region surrounding the periphery of the first region as the position of the third region.

Next, when determining the size of the 3D image, the apparatus 200 for generating a stereoscopic image may remove noise based on the point cloud and then determine the voxel size of the first region and the voxel size of the second region to be different from each other.

Here, when determining the voxel size, the stereoscopic image generating apparatus 200 may determine the voxel size of the first region to be smaller than the voxel size of the second region.

The reason is that when the sharpness of the entire part of the content image is increased, the data amount increases and the transmission speed is low. This is because the user's satisfaction in terms of speed and image quality can be increased because the sharpness of a desired specific part is improved quickly.

In some cases, when determining the voxel size, the stereoscopic image generating apparatus 200 checks whether a point cloud for a third region positioned between the first region and the second region is separated and extracted, and When the point cloud for the 'A' is extracted, the voxel sizes for the first, second, and third regions may be determined differently based on the point cloud.

Here, when determining the voxel size, the stereoscopic image generating apparatus 200 may determine the voxel size of the third region to be smaller than the voxel size for the second region and larger than the voxel size for the first region.

The reason is that when the voxel size value of the third region does not have a voxel size value between the voxel size of the first region and the voxel size of the second region, the boundary line is changed due to the voxel size difference between the first region and the second region. This is because the quality of the content image may be deteriorated.

For example, when determining the voxel size, the stereoscopic image generating apparatus 200 determines the voxel size of the third region to have an intermediate value between the voxel size value of the first region and the voxel size value of the second region. can

In addition, the stereoscopic image generating apparatus 200 generates voxel data corresponding to the determined voxel size when processing the content image into a 3D stereoscopic image, processes the content image into a 3D stereoscopic image, and processes the processed 3D stereoscopic image. Data for an image may be encoded and transmitted.

Meanwhile, the stereoscopic image reproducing apparatus 200 may reproduce the 3D stereoscopic image by decoding the data and performing rendering when the processed 3D stereoscopic image data is received when playing the 3D stereoscopic image.

For example, the stereoscopic image reproducing apparatus 200 may include a user speaker, and may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, personal digital assistants (PDA), and a portable device (PMP). multimedia player), navigation, slate PC, tablet PC, ultrabook, wearable device, for example, watch-type terminal (smartwatch), glass-type terminal (smart glass) , may be applied to a mobile terminal including a head mounted display (HMD), and the like, or may be applied to a fixed terminal such as a digital TV, a desktop computer, and a digital signage.

As described above, the present invention can provide 3D stereoscopic content with improved clarity without increasing the amount of data by generating voxel data such that the voxel size of a specific portion of the content image to be enhanced is small.

That is, according to the present invention, it is possible to improve the sharpness of a local area of content while minimizing an increase in content capacity.

FIG. 2 is a diagram for explaining the image acquisition device of FIG. 1 .

As shown in FIG. 2 , the image acquisition apparatus of the present invention may include a plurality of cameras 120 that acquire a content image by photographing a predetermined object 110 .

That is, the image acquisition apparatus may include a plurality of cameras 120 , and may acquire a content image by simultaneously photographing the object 110 in different directions through the plurality of cameras 120 .

For example, the present invention can produce 3D stereoscopic content by photographing an actor through 30 or more cameras in a chroma keyed studio, and extracting 3D position information and color information from the photographed 2D image, The present invention is not limited thereto.

3 is a diagram for explaining a process of recognizing a specific part of a content image.

As shown in FIG. 3 , the apparatus for generating a stereoscopic image of the present invention may recognize a specific portion 140 of the content image 130 for which the sharpness is to be increased when the content image is received.

As an embodiment, when the stereoscopic image generating apparatus receives the content image 130 , it checks whether information on the specific portion 140 for which clarity is to be increased in the received content image 130 is set in advance, If information on the part 140 is preset, a specific part of the content image may be recognized by analyzing the content image based on the set information.

Here, the apparatus for generating a stereoscopic image may extract a point cloud for the entire portion of the content image 130 if information on the specific portion 140 is not previously set.

The apparatus for generating a stereoscopic image may store a data table including information on the content image 130 and information on a specific part 140 for which clarity is to be increased.

For example, the data table may include information on a plurality of content images 130 classified according to the shape, size, and degree of movement of an object. It may include information about a specific part 140 of .

For example, information on a plurality of content images includes information on content images 130 corresponding to people, animals, and inanimate objects classified according to the shape of the object, large, medium, and It may include information on content images 130 corresponding to the small size, and information on content images 130 corresponding to high-speed, medium-speed, low-speed, and non-movement fixation classified according to the degree of movement of the object. .

As shown in FIG. 3 , when the content image 130 is a dancer, the face region 142 and the hand region 144 among the entire region of the dancer may be preset as a specific part 140 .

That is, when the content image 130 is a dancer, the information on the content image may include an object shape of a human, a medium size of an object, and a medium speed, and based on such information, the content image ( 130), a specific part to increase the sharpness may be preset.

As another embodiment, when the stereoscopic image generating apparatus of the present invention recognizes the specific part 140 , when the content image 130 is received, the specific part 140 for which clarity is to be increased in the received content image 130 . It is checked whether there is a user input for selecting , and if there is a user input, a specific portion 140 of the content image 130 may be recognized by analyzing the content image 130 based on the user input.

Here, when checking whether there is a user input, the stereoscopic image generating apparatus may extract a point cloud for the entire portion of the content image 130 if there is no user input.

Also, when confirming whether there is a user input, the stereoscopic image generating apparatus generates a question window for inquiring whether to select a specific part 140 to increase sharpness in the content image 130 , and returns the generated question window. It is transmitted to a preset user device, and it can be checked whether there is a user input for selecting a specific part 140 from the user device.

As another embodiment, the apparatus for generating a stereoscopic image of the present invention analyzes the received content image 130 upon receiving the content image 130 when recognizing the specific part 140 , and determines the sharpness based on the analysis result. A specific part 130 to be raised may be automatically determined and recognized.

Here, when analyzing the received content image 130 , the apparatus for generating a stereoscopic image may divide the content image 130 into a plurality of sub-regions and analyze the complexity of an object for each sub-region.

As an example, when the stereoscopic image generating apparatus automatically determines the specific part 140 for which the sharpness is to be increased, the content image 130 divided into a plurality of sub-regions based on the analysis result extracts a sub-region having a complexity greater than or equal to a reference value, , it is possible to automatically determine the extracted sub-region as a specific part 140 for which the sharpness is to be increased.

That is, when analyzing the received content image 130 , the stereoscopic image generating apparatus may analyze the content type of the content image 130 .

In addition, when the stereoscopic image generating apparatus automatically determines the specific part for which the sharpness is to be increased, based on the analysis result, the 3D image generating apparatus may automatically determine the specific part for which the sharpness is to be increased according to the content type of the content image.

For example, in the stereoscopic image generating apparatus, if the content type of the content image 130 is dance, the face, arms, legs, etc. may be specific parts to increase clarity, and if the content type of the content image 130 is soccer A leg, a back number, etc. may be specific parts for which clarity is to be increased, and if the content type of the content image 130 is lecture, a blackboard, a hand, etc. may be specific parts for which sharpness is to be increased.

As such, according to the present invention, a specific part corresponding thereto may be automatically determined by analyzing the content type of the content image 130 .

As another embodiment, the apparatus for generating a stereoscopic image of the present invention, upon receiving a content image, when recognizing a specific part, checks whether information on a specific part whose clarity is to be increased in the received content image is preset, and , if the information on a specific part is not set in advance, it is checked whether there is a user input to select a specific part to increase the clarity of the received content image, and if there is a user input, the content image is analyzed based on the user input and It can also recognize specific parts.

Here, the apparatus for generating a stereoscopic image may extract a point cloud for the entire part of the content image when information on the specific part is not preset and there is no user input.

And, when checking whether there is a user input, the stereoscopic image generating apparatus generates and generates a question window inquiring whether to select a specific part 140 to increase clarity in the content image 130 if there is no user input, The question window is transmitted to a preset user device, and it can be checked whether there is a user input for selecting a specific part 140 from the user device.

4 is a diagram for explaining a process of extracting a point cloud of a content image.

As shown in FIG. 4 , the apparatus for generating a stereoscopic image of the present invention includes a point cloud 202 for a first area corresponding to a specific portion of a content image and a second area corresponding to a portion other than the specific portion of the content image. ) may be separated to extract (X, Y, Z, T) coordinate data corresponding to the point cloud 202 .

In some cases, when extracting the point cloud, the apparatus for generating a stereoscopic image may further separate and extract the point cloud for the third area positioned at the boundary between the first area and the second area.

The reason is that by arranging a third region that is a buffer region between the first region and the second region, a difference in voxel size between the first region and the second region is reduced when the voxel size is determined, so that the first region and the second region This is because it is possible to remove noise such as a boundary line between the two and improve the quality of the content image.

Here, the stereoscopic image generating apparatus determines the position of the third region based on the position of the first region when separating the point cloud for the third region, and separates the point cloud of the third region corresponding to the determined position. can be extracted.

That is, when determining the position of the third region, the 3D image generating apparatus may determine a region surrounding the periphery of the first region as the position of the third region.

In some cases, the apparatus for generating a stereoscopic image may determine the area of the third region based on the area of the first region when determining the position of the third region.

For example, when determining the area of the third region, the apparatus for generating a stereoscopic image may increase or decrease the area of the third region in proportion to an area increase/decrease ratio of the first region if the area of the first region increases or decreases.

Here, when determining the area of the third region, the apparatus for generating a stereoscopic image may determine the area of the third region to have a smaller area than the area of the first region.

For example, when determining the area of the third region, the apparatus for generating a stereoscopic image may determine the area of the third region to have an area that is about 10% to about 60% of the area of the first region, but is not limited thereto. does not

5 and 6 are diagrams for explaining a process of determining a voxel size of a content image.

5, the apparatus for generating a stereoscopic image of the present invention determines different voxel (volumetric pixel) sizes for the first region 520 and the second region 510 based on the point cloud, Voxel data corresponding to the determined voxel size may be generated.

Here, the apparatus for generating a stereoscopic image may determine the voxel size of the first region 520 and the voxel size of the second region 510 differently from each other after noise is removed based on the point cloud when determining the voxel size. have.

For example, when determining the voxel size, the apparatus for generating a stereoscopic image may determine the voxel size of the first region 520 to be smaller than the voxel size of the second region 510 .

The reason is that when the sharpness of the entire part of the content image is increased, the data amount increases and the transmission speed is low. This is because the user's satisfaction in terms of speed and image quality can be increased because the sharpness of a desired specific part is improved quickly.

For example, when determining the voxel size, the apparatus for generating a stereoscopic image may determine the voxel size of the first region to be small such that the voxel size is about 1% to about 60% of the voxel size of the second region.

The reason is that the smaller the voxel size of the content image, the more detailed stereoscopic information and color information can be expressed, and thus the sharpness of the content image increases.

Meanwhile, as shown in FIG. 6 , when determining the voxel size, the 3D image generating apparatus 200 applies the third region 530 between the first region 520 and the second region 510 . It is checked whether the point cloud is separated and extracted, and when the point cloud for the third region 530 is extracted, the voxel sizes of the first, second, and third regions 520 , 510 , and 530 are determined from each other based on the point cloud. You may decide differently.

Here, when the stereoscopic image generating apparatus determines the voxel size, the voxel size of the third region 530 is smaller than the voxel size of the second region 510 and larger than the voxel size of the first region 520 . can be largely determined.

The reason is that when the voxel size value of the third region 530 does not have a voxel size value between the voxel size of the first region 520 and the voxel size of the second region 510 , the first region 520 . This is because a boundary line is generated between the second region 510 and the second region 510 , which may result in deterioration of the quality of the content image.

For example, when determining a voxel size, the apparatus for generating a stereoscopic image may have an intermediate value between a voxel size value of the first region 520 and a voxel size value of the second region 510 in the third region 530 . It is possible to determine the voxel size for .

7(a) and 7(b) are diagrams illustrating a stereoscopic image corresponding to a voxel size.

As shown in FIG. 7A , when the content image is processed and reproduced based on voxel data generated by determining the entire portion of the content image to have the same voxel size, the clarity of the reproduced content image is lowered and the quality of the stereoscopic image is reduced. may lead to deterioration.

For example, as shown in FIG. 7A , when about 650,000 content images having a voxel size of about 3 mm are processed and reproduced, the clarity of the reproduced content images may be deteriorated.

In contrast, as shown in FIG. 7B , when about 1.5 million content images having a voxel size of about 1.25 mm are processed and reproduced, the clarity of the reproduced content images may be improved.

However, as shown in FIG. 7B , as the voxel size of the entire portion of the content image decreases, the sharpness may be improved, but the reproduction speed may be very slow due to an increase in the amount of data.

Accordingly, according to the present invention, by implementing a small voxel size for only a specific portion of the entire content image, it is possible to improve the clarity of the reproduced content image while minimizing the data amount, thereby increasing user satisfaction.

As an example, according to the present invention, when a face region, which is a specific part of the entire content image, is processed to have a voxel size of about 1.25 mm, and processed to a size of about 3 mm voxel for an area other than the specific part, data of the content image It is possible to improve the clarity of the content image while minimizing the amount.

In some cases, the present invention may dispose a buffer region having a size of about 2 mm voxels between a face region having a size of about 1.25 mm voxels and another region having a size of about 3 mm voxels.

That is, the buffer area may be located around the face area of the content image.

Here, the area of the buffer area may be determined based on the area of the face area.

For example, the area of the buffer region may increase or decrease in proportion to an area increase/decrease ratio of the face region when the area of the face region increases or decreases.

That is, the area of the buffer area may be determined to have a smaller area than the area of the face area.

For example, the area of the buffer area may be determined to have an area of about 10% to about 60% of the area of the face area, but is not limited thereto.

As described above, according to the present invention, when the buffer region located around the face region of the content image is processed to have a voxel size of about 2 mm, a boundary line between a face region having a voxel size of about 1.25 mm and another region having a voxel size of about 3 mm It is possible to improve the quality of the content image by removing noise generation such as

FIG. 8 is a block diagram illustrating the apparatus for generating a stereoscopic image of FIG. 1 .

As shown in FIG. 8 , the stereoscopic image generating apparatus 200 includes a specific part recognition unit 210 for recognizing a specific part to be sharpened among the content images acquired from the image acquisition device, and a specific part recognition unit 210 for a specific part of the content image. The point cloud extracting unit 220 that separates and extracts point clouds for the corresponding first region and the second region corresponding to a portion other than the specific portion, and voxel sizes for the first region and the second region based on the point cloud The voxel size determiner 230 that determines the voxel size to be different from each other, the voxel data generator 240 that generates voxel data corresponding to the determined voxel size, and processes the content image into a 3D stereoscopic image based on the voxel data to form a 3D stereoscopic image It may include an encoding unit 250 for encoding data for the image.

When receiving the content image, the specific part recognition unit 210 checks whether information on a specific part for which clarity is to be increased in the received content image is preset, and if the information on the specific part is preset, the set information Based on the content image, it is possible to recognize a specific part of the content image.

Here, when the specific part recognition unit 210 determines whether information on a specific part for which the sharpness is to be increased is preset, if the information on the specific part is not preset, the point cloud for the entire part of the content image can be extracted.

In some cases, the stereoscopic image generating apparatus 200 may further include a storage unit in which a data table including information on a content image and information on a specific part to be sharpened is stored.

Here, the data table includes information on a plurality of content images classified according to the shape, size, and degree of movement of an object, and includes information on one or more specific parts corresponding to each classified content image. can

For example, the information on the plurality of content images may include information on content images corresponding to people, animals, and inanimate objects classified according to the shape of the object, and corresponding to large, medium, and small images classified according to the size of the object. It may include information on content images, and information on content images corresponding to high-speed, medium-speed, low-speed, and non-movement fixation classified according to the degree of movement of an object.

In addition, the specific part recognition unit 210 checks whether information on a specific part for which the sharpness is to be increased is preset, and whether there is a user input for selecting a specific part if the information on the specific part is not preset. , and if there is a user input, a specific part of the content image may be recognized by analyzing the content image based on the user input.

Here, the specific part recognizer 210 may extract a point cloud for the entire part of the content image when there is no user input when checking whether there is a user input.

In some cases, the specific part recognition unit 210 generates a question window inquiring whether to select a specific part for which clarity is to be increased in the content image when checking whether there is a user input, and previews the generated question window in advance. It is transmitted to the set user device, and it can also be checked whether there is a user input for selecting a specific part from the user device.

As another embodiment, when recognizing a specific part, the specific part recognition unit 210 checks whether there is a user input for selecting a specific part for which clarity is to be increased from the received content image when receiving a content image, and the user If there is an input, a specific part of the content image may be recognized by analyzing the content image based on the user input.

Here, the specific part recognizer 210 may extract a point cloud for the entire part of the content image when there is no user input when checking whether there is a user input.

In some cases, the specific part recognition unit 210 generates a question window inquiring whether to select a specific part for which clarity is to be increased in the content image when checking whether there is a user input, and previews the generated question window in advance. It is transmitted to the set user device, and it can also be checked whether there is a user input for selecting a specific part from the user device.

As another embodiment, when recognizing a specific part, the specific part recognition unit 210 analyzes the received content image when receiving a content image, and automatically determines a specific part to increase clarity based on the analysis result. can recognize

Here, when analyzing the received content image, the specific part recognizer 210 may divide the content image into a plurality of sub-regions and analyze the complexity of an object for each sub-region.

In addition, the specific part recognition unit 210 extracts a sub-region having a complexity greater than or equal to a reference value from among the content images divided into a plurality of sub-regions based on the analysis result when automatically determining a specific part to increase the sharpness, and extracts the extracted sub-region. can be automatically determined as a specific part to increase the sharpness.

Here, the specific part recognition unit 210 may analyze the content type of the content image when analyzing the received content image.

In addition, the specific part recognizing unit 210 may automatically determine a specific part for which the sharpness is to be increased according to the content type of the content image based on the analysis result when automatically determining the specific part for which the sharpness is to be increased.

Next, the point cloud extractor 220 may further separate and extract the point cloud for the third area located at the boundary between the first area and the second area.

Here, the point cloud extractor 220 determines the position of the third region based on the position of the first region when separating the point cloud for the third region, and the point cloud of the third region corresponding to the determined position. can be isolated and extracted.

In addition, when determining the location of the third area, the point cloud extractor 220 may determine an area surrounding the periphery of the first area as the location of the third area.

In some cases, when determining the location of the third area, the point cloud extractor 220 may determine the area of the third area based on the area of the first area.

For example, when determining the area of the third region, the point cloud extractor 220 may increase or decrease the area of the third region in proportion to an area increase/decrease ratio of the first region if the area of the first region increases or decreases.

Here, when determining the area of the third region, the point cloud extractor 220 may determine the area of the third region to have an area smaller than the area of the first region.

For example, when determining the area of the third region, the point cloud extractor 220 may determine the area of the third region to have an area of about 10% to about 60% of the area of the first region.

Next, the voxel size determiner 230 may determine a voxel size for the first region and a voxel size for the second region to be different from each other after noise is removed based on the point cloud.

That is, the voxel size determiner 230 may determine the voxel size of the first region to be smaller than the voxel size of the second region.

For example, the voxel size determiner 230 may determine the voxel size of the first region to be small to have a voxel size of about 1% to about 60% of the voxel size of the second region.

Then, the voxel size determiner 230 checks whether the point cloud for the third region positioned between the first region and the second region is separated and extracted, and when the point cloud for the third region is extracted, the point cloud Based on , voxel sizes for the first, second, and third regions may be determined differently.

Here, the voxel size determiner 230 may determine the voxel size of the third region to be smaller than the voxel size for the second region and larger than the voxel size for the first region.

For example, the voxel size determiner 230 may determine the voxel size of the third region to have an intermediate value between the voxel size value of the first region and the voxel size value of the second region.

9 is a flowchart illustrating a 3D stereoscopic content service providing method of the 3D stereoscopic content service providing system according to the present invention, and FIGS. 10 to 13 are flowcharts illustrating a method for recognizing a specific part of a content image.

As shown in FIG. 9 , in the present invention, a content image may be obtained by photographing a predetermined object (S10).

And, according to the present invention, it is possible to recognize a specific part of the acquired content image for which the sharpness is to be increased (S20).

As a first embodiment, in the present invention, as shown in FIG. 10 , in the step of recognizing a specific part ( S20 ), it is checked whether information on a specific part for which clarity is to be increased in the acquired content image is preset ( S22), if information on a specific part is set in advance, the specific part of the content image may be recognized by analyzing the content image based on the set information (S26).

Here, in the present invention, if the information on the specific part is not set in advance, it is possible to extract the point cloud for the entire part of the content image (S28).

In some cases, as a second embodiment, the present invention, as shown in FIG. 11 , in the step of recognizing a specific part ( S20 ), determines whether information on a specific part for which clarity is to be increased in the acquired content image is preset. is checked (S22), and if the information on a specific part is not set in advance, it is checked whether there is a user input for selecting a specific part (S24), and if there is a user input, the content image is analyzed based on the user input to analyze the content image. A specific part can be recognized (S26).

Here, in the present invention, when it is checked whether information on a specific part is preset, if information on a specific part is preset, a specific part of the content image can be recognized by analyzing the content image based on the set information ( S26).

And, in the present invention, if there is no user input, it is possible to extract a point cloud for the entire portion of the content image (S28).

In addition, the present invention, when checking whether there is a user input, if the information on the specific part is not set in advance, creates a question window inquiring whether to select a specific part to increase the clarity of the content image, and the generated The question window may be transmitted to a preset user device, and it may be checked whether there is a user input for selecting a specific part from the user device.

As a third embodiment, in the present invention, as shown in FIG. 12 , in the step of recognizing a specific part (S20), it is checked whether there is a user input for selecting a specific part for which the sharpness is to be increased from the acquired content image (S21) ), if there is a user input, the content image is analyzed based on the user input (S23), and a specific part of the content image can be recognized based on the analyzed content image (S26).

Here, in the present invention, if there is no user input, it is possible to extract a point cloud for the entire part of the content image (S28).

In addition, the present invention, when checking whether there is a user input, generates a question window inquiring whether to select a specific part to increase clarity in the content image, and transmits the generated question window to a preset user device, It may also be checked whether there is a user input for selecting a specific part from the user device.

As a fourth embodiment, as shown in FIG. 13 , in the step of recognizing a specific part (S20), the acquired content image is analyzed (S23), and a specific part to be sharpened based on the analysis result is automatically determined (S25) ), it is possible to recognize a specific part of the content image according to the automatic determination (S26).

Here, in the present invention, when analyzing the acquired content image, the content image may be divided into a plurality of sub-regions and the complexity of the object for each sub-region may be analyzed.

In addition, the present invention extracts a sub-region having a complexity greater than or equal to a reference value from among the content images divided into a plurality of sub-regions based on the analysis result when automatically determining a specific part to increase sharpness, and increases the sharpness of the extracted sub-region It can be automatically determined as a specific part of the

The reason for this is that the high-complexity portion of the content image may have lowered sharpness and crushed noise compared to the low-complexity portion.

Accordingly, when a part of the content image with high complexity is recognized as a specific part and the voxel size is reduced, the quality of the content image can be improved.

In some cases, the present invention may analyze the content type of the content image when analyzing the acquired content image.

The reason is that the quality of the content image can be improved when the voxel size is reduced by effectively recognizing specific portions to be sharpened appropriately for the content type.

For example, if the content type is sports related to soccer, specific parts such as the legs and soccer ball of a soccer player are recognized in the content image, and if the content type is education related to lecture, specific parts such as the instructor's hand and blackboard are recognized in the content image can do.

Also, according to the present invention, when a specific part for which sharpness is to be increased is automatically determined, a specific part for which sharpness is to be increased may be automatically determined based on the analysis result in accordance with the content type of the content image.

Next, according to the present invention, the point clouds for the first region corresponding to a specific part of the content image and the second region corresponding to a part other than the specific part may be separated and extracted (S30 and S40).

In some cases, the present invention may further separate and extract the point cloud for the third region located at the boundary between the first region and the second region.

Here, in the present invention, the position of the third region may be determined based on the position of the first region, and the point cloud of the third region corresponding to the determined position may be separated and extracted.

For example, in the present invention, when determining the location of the third area, an area surrounding the periphery of the first area may be determined as the location of the third area.

As another example, when determining the location of the third area, the present invention may determine the area of the third area based on the area of the first area.

Here, in the present invention, when the area of the third region is determined, if the area of the first region is increased or decreased, the area of the third region may be increased or decreased in proportion to the area increase/decrease ratio of the first region.

That is, in the present invention, the area of the third region may be determined to have an area smaller than that of the first region.

This is because, if the area of the third region is too large, the amount of data increases, and if the area of the second region is too small, noise generation such as a boundary line between the first region and the second region may not be removed.

For example, in the present invention, the area of the third region may be determined to have an area of about 10% to about 60% of the area of the first region.

Next, the present invention may determine different voxel sizes for the first region and the second region based on the point cloud ( S50 and S60 ).

Here, in the present invention, after noise is removed based on the point cloud, the voxel size of the first region and the voxel size of the second region may be determined differently from each other.

That is, according to the present invention, the voxel size of the first region may be determined to be smaller than the voxel size of the second region.

The reason is that when the sharpness of the entire part of the content image is increased, the data amount increases and the transmission speed is low. This is because the user's satisfaction in terms of speed and image quality can be increased because the sharpness of a desired specific part is improved quickly.

For example, in the present invention, the voxel size of the first region may be determined to be small to have a voxel size of about 1% to about 60% compared to the voxel size of the second region.

In some cases, in the present invention, when determining the voxel size, it is checked whether the point cloud for the third region positioned between the first region and the second region is separated and extracted, and the point cloud for the third region is extracted. Then, the voxel sizes for the first, second, and third regions may be determined differently based on the point cloud.

Here, in the present invention, the voxel size of the third region may be determined to be smaller than the voxel size for the second region and larger than the voxel size for the first region.

In some cases, when determining the voxel size, the stereoscopic image generating apparatus 200 checks whether a point cloud for a third region positioned between the first region and the second region is separated and extracted, and When the point cloud for the 'A' is extracted, the voxel sizes for the first, second, and third regions may be determined differently based on the point cloud.

Here, when determining the voxel size, the stereoscopic image generating apparatus 200 may determine the voxel size of the third region to be smaller than the voxel size for the second region and larger than the voxel size for the first region.

The reason is that when the voxel size value of the third region does not have a voxel size value between the voxel size of the first region and the voxel size of the second region, the boundary line is changed due to the voxel size difference between the first region and the second region. This is because the quality of the content image may be deteriorated.

Accordingly, according to the present invention, the voxel size of the third region may be determined to have an intermediate value between the voxel size value of the first region and the voxel size value of the second region.

And, according to the present invention, voxel data corresponding to the determined voxel size may be generated.

Next, according to the present invention, data on the 3D stereoscopic image may be encoded by processing the content image into a 3D stereoscopic image based on the voxel data ( S70 ).

Next, according to the present invention, data for a 3D stereoscopic image may be decoded and rendering may be performed (S80).

And, according to the present invention, a 3D stereoscopic image on which rendering has been performed can be reproduced (S90).

As described above, the present invention can provide 3D stereoscopic content with improved clarity without increasing the amount of data by generating voxel data such that the voxel size of a specific portion of the content image to be enhanced is small.

That is, according to the present invention, it is possible to improve the sharpness of a local area of content while minimizing an increase in content capacity.

Meanwhile, an embodiment of the present invention may further provide a computer-readable program for executing any one of the three-dimensional stereoscopic content service providing methods and a recording medium in which the program is recorded.

Various embodiments described herein may be implemented in a computer-readable recording medium using, for example, software, hardware, or a combination thereof.

According to the software implementation, embodiments such as a procedure or function may be implemented together with a separate software module for performing at least one function or operation. The software code may be implemented by a software application written in a suitable programming language.

The method according to the above-described embodiment may be produced as a program to be executed by a computer and stored in a computer-readable recording medium. Examples of the computer-readable recording medium include ROM, RAM, CD-ROM, magnetic tape. , a floppy disk, an optical data storage device, etc. are also included.

The computer-readable recording medium is distributed in network-connected computer systems, so that the computer-readable code can be stored and executed in a distributed manner. In addition, functional programs, codes, and code segments for implementing the above-described method can be easily inferred by programmers in the technical field to which the embodiment belongs.

It is apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit and essential characteristics of the present invention.

Accordingly, the above detailed description should not be construed as restrictive in all respects but as exemplary. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present invention are included in the scope of the present invention.

100: image acquisition device
200: stereoscopic image generating device
210: specific part recognition unit
220: point cloud extraction unit
230: voxel size determiner
240: voxel data generator
250: encoding unit
300: stereoscopic image playback device

Claims (47)

an image acquisition device for acquiring a content image by photographing a predetermined object; and,
and a stereoscopic image generating device that processes the obtained content image into a three-dimensional stereoscopic image,
The stereoscopic image generating device comprises:
When the content image is received, a specific part is recognized, and point clouds for a first area corresponding to a specific part of the content image and a second area corresponding to a part other than the specific part are separated and extracted, respectively, and the point determining different voxel sizes for the first region and the second region based on the cloud, generating voxel data corresponding to the determined voxel size, and processing the content image into a 3D stereoscopic image based on the voxel data 3D stereoscopic content service providing system. According to claim 1, wherein the image acquisition device,
including multiple cameras;
The system for providing a three-dimensional stereoscopic content service, characterized in that the plurality of cameras simultaneously photograph the object in different directions to obtain the content image. According to claim 1, wherein the stereoscopic image generating device,
When recognizing the specific part, when the content image is received, it is checked whether information on a specific part for which the sharpness is to be increased is preset in the received content image, and if the information on the specific part is preset 3D stereoscopic content service providing system, characterized in that by analyzing the content image based on the set information, a specific part of the content image is recognized. The method of claim 3, wherein the stereoscopic image generating device comprises:
3, characterized in that when it is checked whether the information on the specific part for which the sharpness is to be increased is preset, if the information on the specific part is not preset, the point cloud for the entire part of the content image is extracted 3D content service provision system. According to claim 1, wherein the stereoscopic image generating device,
3D stereoscopic content service providing system, characterized in that when extracting the point cloud, the point cloud for the third area located at the boundary between the first area and the second area is further separated and extracted. According to claim 1, wherein the stereoscopic image generating device,
When determining the voxel size, after noise is removed based on the point cloud, the voxel size of the first region and the voxel size of the second region are determined differently from each other. system. According to claim 1, wherein the stereoscopic image generating device,
and determining that the voxel size of the first region is smaller than the voxel size of the second region when the voxel size is determined. According to claim 1, wherein the stereoscopic image generating device,
When determining the voxel size, it is checked whether the point cloud for the third region positioned between the first region and the second region is separated and extracted, and when the point cloud for the third region is extracted, the point cloud is 3D stereoscopic content service providing system, wherein voxel sizes of the first, second, and third regions are determined differently based on each other. The apparatus of claim 8, wherein the stereoscopic image generating device comprises:
and determining the voxel size for the third region to be smaller than the voxel size for the second region and larger than the voxel size for the first region when determining the voxel size. system. According to claim 1, wherein the stereoscopic image generating device,
When the content image is processed into a 3D stereoscopic image, voxel data corresponding to the determined voxel size is generated, the content image is processed into a 3D stereoscopic image, and data for the processed 3D stereoscopic image is encoded. 3D stereoscopic content service providing system, characterized in that it is transmitted. According to claim 1,
3D stereoscopic content service providing system, characterized in that it further comprises a stereoscopic image reproducing apparatus for reproducing the 3D stereoscopic image. The apparatus of claim 11 , wherein the stereoscopic image reproducing apparatus comprises:
When the 3D stereoscopic image is reproduced, when data on the processed 3D stereoscopic image is received, the 3D stereoscopic content service providing system decodes the data and performs rendering to reproduce the 3D stereoscopic image. A method for providing a 3D stereoscopic content service in a 3D stereoscopic content service providing system, comprising a stereoscopic image generating device communicatively connected to an image acquisition device and a stereoscopic image reproducing device, the method comprising:
acquiring, by the image acquisition device, a content image by photographing a predetermined object;
recognizing, by the stereoscopic image generating apparatus, a specific part of the acquired content image;
separating and extracting, by the stereoscopic image generating apparatus, point clouds for a first area corresponding to a specific portion of the content image and a second area corresponding to a portion other than the specific portion of the content image;
determining, by the stereoscopic image generating apparatus, different voxel sizes for the first region and the second region based on the point cloud;
generating, by the stereoscopic image generating apparatus, voxel data corresponding to the determined voxel size;
encoding, by the stereoscopic image generating apparatus, data on the 3D stereoscopic image by processing the content image into a 3D stereoscopic image based on the voxel data;
decoding, by the stereoscopic image reproducing apparatus, data on the 3D stereoscopic image and rendering; and,
and reproducing, by the stereoscopic image reproducing apparatus, the rendered 3D stereoscopic image. The method of claim 13, wherein recognizing the specific part comprises:
In the acquired content image, it is checked whether information on a specific part for which the sharpness is to be increased is preset, and if the information on the specific part is preset, the content image is analyzed based on the set information to analyze the content image. A method of providing a 3D stereoscopic content service, characterized in that it recognizes a specific part of the 15. The method of claim 14, wherein the step of determining whether information on a specific part to increase the sharpness is preset,
3D stereoscopic content service providing method, characterized in that if the information on the specific part is not set in advance, a point cloud for the entire part of the content image is extracted. The method of claim 13, wherein the extracting of the point cloud comprises:
A method for providing a three-dimensional stereoscopic content service, characterized in that the point cloud for a third area located at a boundary between the first area and the second area is further separated and extracted. The method of claim 13 , wherein determining the voxel size comprises:
3D stereoscopic content service providing method, characterized in that after noise is removed based on the point cloud, the voxel size of the first region and the voxel size of the second region are determined to be different from each other. The method of claim 13 , wherein determining the voxel size comprises:
and determining a voxel size of the first region to be smaller than a voxel size of the second region. The method of claim 13 , wherein determining the voxel size comprises:
It is checked whether the point cloud for the third region located between the first region and the second region is separated and extracted, and when the point cloud for the third region is extracted, the first and second regions based on the point cloud , a method for providing a 3D stereoscopic content service, characterized in that different voxel sizes of the third region are determined. The method of claim 19, wherein determining the voxel size comprises:
and determining a voxel size for the third region to be smaller than a voxel size for the second region and larger than a voxel size for the first region. A stereoscopic image generating device communicatively connected to an image acquiring device and a stereoscopic image reproducing device, comprising:
a specific part recognition unit for recognizing a specific part of the content image acquired from the image acquisition device;
a point cloud extracting unit that separates and extracts point clouds for a first area corresponding to a specific part of the content image and a second area corresponding to a part other than the specific part;
a voxel size determiner configured to differently determine voxel sizes for the first region and the second region based on the point cloud;
a voxel data generator configured to generate voxel data corresponding to the determined voxel size; and,
and an encoding unit which processes the content image into a 3D stereoscopic image based on the voxel data and encodes data for the 3D stereoscopic image. The method of claim 21, wherein the specific part recognition unit,
When the content image is received, it is checked whether information on a specific part to be sharpened in the received content image is preset, and if the information on the specific part is preset, the content image based on the set information A stereoscopic image generating apparatus, characterized in that by analyzing a specific part of the content image is recognized. The method of claim 22, wherein the specific part recognition unit,
When it is checked whether the information on the specific part for which the sharpness is to be increased is preset, if the information on the specific part is not preset, the point cloud for the entire part of the content image is extracted image generating device. 22. The method of claim 21,
and a storage unit storing a data table including information on the content image and information on the specific part. The method of claim 21, wherein the specific part recognition unit,
When recognizing the specific part, if the content image is received, it is checked whether there is a user input for selecting a specific part from the received content image, and if there is the user input, the content image is analyzed based on the user input and the content image is analyzed. A stereoscopic image generating apparatus, characterized in that it recognizes a specific part of the content image. The method of claim 25, wherein the specific part recognition unit,
The apparatus for generating a stereoscopic image, characterized in that when it is checked whether the user input is present, and if there is no user input, a point cloud for the entire portion of the content image is extracted. The method of claim 21, wherein the point cloud extraction unit,
and further separating and extracting a point cloud for a third region positioned at a boundary between the first region and the second region. The method of claim 27, wherein the point cloud extraction unit,
When separating the point cloud for the third region, the position of the third region is determined based on the position of the first region, and the point cloud of the third region corresponding to the determined position is separated and extracted. A stereoscopic image generating device. The method of claim 21, wherein the voxel size determiner comprises:
and, after noise is removed based on the point cloud, the voxel size of the first region and the voxel size of the second region are determined to be different from each other. The method of claim 21, wherein the voxel size determiner comprises:
and determining a voxel size of the first region to be smaller than a voxel size of the second region. The method of claim 21, wherein the voxel size determiner comprises:
It is checked whether the point cloud for the third region located between the first region and the second region is separated and extracted, and when the point cloud for the third region is extracted, the first and second regions based on the point cloud , and determining different voxel sizes for the third region. 32. The method of claim 31, wherein the voxel size determiner comprises:
and determining a voxel size of the third region to be smaller than a voxel size for the second region and larger than a voxel size for the first region. The method of claim 32, wherein the voxel size determining unit comprises:
and determining the voxel size of the third region to have an intermediate value between the voxel size value of the first region and the voxel size value of the second region. A method of providing a 3D stereoscopic content service in a stereoscopic image generating apparatus including a specific part recognition unit, a point cloud extractor, a voxel size determiner, a voxel data generation unit, and an encoding unit, the method comprising:
recognizing, by the specific part recognition unit, a specific part of the content image acquired from the image acquisition device;
separating and extracting, by the point cloud extracting unit, point clouds for a first area corresponding to a specific part of the content image and a second area corresponding to a part other than the specific part;
determining, by the voxel size determiner, different voxel sizes for the first region and the second region based on the point cloud;
generating, by the voxel data generator, voxel data corresponding to the determined voxel size; and,
and encoding, by the encoding unit, data on the 3D stereoscopic image by processing the content image into a 3D stereoscopic image based on the voxel data. . The method of claim 34, wherein recognizing the specific part comprises:
In the acquired content image, it is checked whether information on a specific part for which the sharpness is to be increased is preset, and if the information on the specific part is preset, the content image is analyzed based on the set information to analyze the content image. A method of providing a 3D stereoscopic content service by a stereoscopic image generating apparatus, characterized in that a specific part is recognized. 36. The method of claim 35, wherein the step of determining whether information on a specific portion to be enhanced sharpness is set in advance,
The 3D stereoscopic content service providing method of the apparatus for generating a stereoscopic image, characterized in that if the information on the specific part is not set in advance, a point cloud for the entire part of the content image is extracted. The method of claim 34, wherein recognizing the specific part comprises:
3D image characterized in that it is checked whether there is a user input for selecting a specific part from the acquired content image, and if there is a user input, the content image is analyzed based on the user input to recognize a specific part of the content image A method of providing a 3D stereoscopic content service by a generating device. The method of claim 37, wherein the step of checking whether there is a user input comprises:
The 3D stereoscopic content service providing method of the stereoscopic image generating apparatus, characterized in that when there is no user input, a point cloud for the entire portion of the content image is extracted. The method of claim 34, wherein extracting the point cloud comprises:
and further separating and extracting a point cloud for a third region located at a boundary between the first region and the second region. 40. The method of claim 39, wherein separating the point cloud for the third area comprises:
3D stereoscopic content service provided by a stereoscopic image generating apparatus, characterized in that the position of the third region is determined based on the position of the first region, and a point cloud of the third region corresponding to the determined position is separated and extracted Way. The method of claim 40, wherein determining the location of the third region comprises:
and determining a region surrounding the periphery of the first region as the position of the third region. 35. The method of claim 34, wherein determining the voxel size comprises:
The method for providing a 3D stereoscopic content service of a stereoscopic image generating apparatus, characterized in that after noise is removed based on the point cloud, a voxel size for the first region and a voxel size for the second region are determined to be different from each other. 35. The method of claim 34, wherein determining the voxel size comprises:
and determining a voxel size of the first region to be smaller than a voxel size of the second region. 35. The method of claim 34, wherein determining the voxel size comprises:
It is checked whether the point cloud for the third region located between the first region and the second region is separated and extracted, and when the point cloud for the third region is extracted, the first and second regions based on the point cloud , a 3D stereoscopic content service providing method of a stereoscopic image generating apparatus, characterized in that different voxel sizes are determined for the third region. 45. The method of claim 44, wherein determining the voxel size comprises:
and determining a voxel size of the third region to be smaller than a voxel size for the second region and larger than a voxel size for the first region. 46. The method of claim 45, wherein determining the voxel size comprises:
and determining the voxel size of the third region to have an intermediate value between the voxel size value of the first region and the voxel size value of the second region. How to provide. A computer-readable recording medium in which a program for executing the method according to any one of claims 13 to 20 and 34 to 46 is recorded.

Images